2024-04-18T04:41:13.361 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T04:41:13.361 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} --archive /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661535 --name teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi --verbose -- /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661535/orig.config.yaml 2024-04-18T04:41:13.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:41:13.505 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661535 branch: reef description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7661535' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: reef ceph: cephfs: max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - overall HEALTH_ - \(MON_DOWN\) sha1: 56a91dd158be807f143cc918a11685fc9ee164ae ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 56a91dd158be807f143cc918a11685fc9ee164ae thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 5203 sha1: 56a91dd158be807f143cc918a11685fc9ee164ae sleep_before_teardown: 0 subset: 88/512 suite: fs suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi096.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBacnF1e/jE/+ZrxridAyjfdaukJofMeiALsoW7IoHwkF0sM7MjyCJu9jjWJx4llc9dUKtKwNOhj/ZMLEei9anQ= smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKfxGZC5aWg/xsSkj7ePm+4PTVJXGmZYk0JsIPMqLyM66w/kbvF3jfLJqByVWzivkT1agm8Fklg88zeFIiiH68A= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-17_22:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-18T04:41:13.506 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa; will attempt to use it 2024-04-18T04:41:13.506 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa/tasks 2024-04-18T04:41:13.507 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-18T04:41:13.508 INFO:teuthology.task.internal:Checking packages... 2024-04-18T04:41:13.533 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '56a91dd158be807f143cc918a11685fc9ee164ae' 2024-04-18T04:41:13.533 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T04:41:13.533 INFO:teuthology.packaging:ref: None 2024-04-18T04:41:13.533 INFO:teuthology.packaging:tag: None 2024-04-18T04:41:13.533 INFO:teuthology.packaging:branch: reef 2024-04-18T04:41:13.533 INFO:teuthology.packaging:sha1: 56a91dd158be807f143cc918a11685fc9ee164ae 2024-04-18T04:41:13.533 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=reef 2024-04-18T04:41:13.792 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1237-g646b8c7d-1jammy 2024-04-18T04:41:13.793 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-18T04:41:13.799 INFO:teuthology.task.internal:no buildpackages task found 2024-04-18T04:41:13.799 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-18T04:41:13.815 INFO:teuthology.task.internal:Saving configuration 2024-04-18T04:41:13.838 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-18T04:41:13.844 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-18T04:41:13.865 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661535', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 04:35:35.404584', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBc0L1ipW8O/fEZGOxiu2cweBJq5ZzSSSZDzMn7hcLXK'} 2024-04-18T04:41:13.883 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661535', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 04:35:35.405864', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE5u9L6H7dVNx55uYjm6BJP1oAX2ohnpiUTzlvcfmRHq'} 2024-04-18T04:41:13.884 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-18T04:41:13.890 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-18T04:41:13.890 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-18T04:41:13.890 INFO:teuthology.run_tasks:Running task console_log... 2024-04-18T04:41:13.965 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9476329ee0>, signals=[15]) 2024-04-18T04:41:13.965 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-18T04:41:13.974 INFO:teuthology.task.internal:Opening connections... 2024-04-18T04:41:13.974 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T04:41:13.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:41:14.057 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2024-04-18T04:41:14.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:41:14.136 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-18T04:41:14.142 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2024-04-18T04:41:14.147 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2024-04-18T04:41:14.147 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-04-18T04:41:14.192 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T04:41:14.192 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Ubuntu" 2024-04-18T04:41:14.192 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="22.04" 2024-04-18T04:41:14.192 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T04:41:14.193 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_CODENAME=jammy 2024-04-18T04:41:14.193 INFO:teuthology.orchestra.run.smithi096.stdout:ID=ubuntu 2024-04-18T04:41:14.193 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE=debian 2024-04-18T04:41:14.193 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T04:41:14.193 INFO:teuthology.orchestra.run.smithi096.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T04:41:14.193 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T04:41:14.193 INFO:teuthology.orchestra.run.smithi096.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T04:41:14.193 INFO:teuthology.orchestra.run.smithi096.stdout:UBUNTU_CODENAME=jammy 2024-04-18T04:41:14.193 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-04-18T04:41:14.216 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-04-18T04:41:14.222 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-04-18T04:41:14.222 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-04-18T04:41:14.270 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T04:41:14.270 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2024-04-18T04:41:14.270 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="22.04" 2024-04-18T04:41:14.270 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T04:41:14.270 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=jammy 2024-04-18T04:41:14.270 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2024-04-18T04:41:14.270 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2024-04-18T04:41:14.270 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T04:41:14.270 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T04:41:14.270 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T04:41:14.271 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T04:41:14.271 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=jammy 2024-04-18T04:41:14.271 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-04-18T04:41:14.291 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-18T04:41:14.300 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-18T04:41:14.306 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-18T04:41:14.306 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2024-04-18T04:41:14.308 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2024-04-18T04:41:14.318 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-18T04:41:14.324 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-18T04:41:14.324 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2024-04-18T04:41:14.354 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2024-04-18T04:41:14.369 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-18T04:41:14.424 INFO:teuthology.run_tasks:Running task kernel... 2024-04-18T04:41:14.441 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-18T04:41:14.441 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-18T04:41:14.442 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T04:41:14.443 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T04:41:14.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:41:14.447 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-04-18T04:41:14.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:41:14.448 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-04-18T04:41:14.493 INFO:teuthology.orchestra.run.smithi096.stdout:5.15.0-56-generic 2024-04-18T04:41:14.493 INFO:teuthology.task.kernel:Running kernel on smithi096: 5.15.0-56-generic 2024-04-18T04:41:14.493 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-04-18T04:41:14.495 INFO:teuthology.orchestra.run.smithi139.stdout:5.15.0-56-generic 2024-04-18T04:41:14.495 INFO:teuthology.task.kernel:Running kernel on smithi139: 5.15.0-56-generic 2024-04-18T04:41:14.496 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get clean 2024-04-18T04:41:14.620 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-04-18T04:41:14.624 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get update 2024-04-18T04:41:14.902 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T04:41:14.906 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T04:41:14.917 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T04:41:14.917 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T04:41:14.970 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-18T04:41:14.970 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-18T04:41:15.331 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-18T04:41:15.333 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-18T04:41:15.335 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-18T04:41:15.340 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-18T04:41:15.469 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-18T04:41:15.472 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-18T04:41:15.624 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-18T04:41:15.662 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-18T04:41:15.666 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-18T04:41:15.780 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-18T04:41:15.791 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-18T04:41:15.803 INFO:teuthology.orchestra.run.smithi139.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-18T04:41:15.804 INFO:teuthology.orchestra.run.smithi139.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-18T04:41:15.815 INFO:teuthology.orchestra.run.smithi139.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-18T04:41:15.818 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-18T04:41:15.829 INFO:teuthology.orchestra.run.smithi139.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-18T04:41:15.830 INFO:teuthology.orchestra.run.smithi139.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,754 kB] 2024-04-18T04:41:15.833 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-18T04:41:15.834 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,754 kB] 2024-04-18T04:41:15.854 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-18T04:41:15.869 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-18T04:41:15.870 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-18T04:41:15.873 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-18T04:41:15.884 INFO:teuthology.orchestra.run.smithi139.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-18T04:41:15.896 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-18T04:41:15.897 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T04:41:15.928 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T04:41:15.931 INFO:teuthology.orchestra.run.smithi139.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-18T04:41:15.931 INFO:teuthology.orchestra.run.smithi139.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-18T04:41:15.931 INFO:teuthology.orchestra.run.smithi139.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T04:41:15.936 INFO:teuthology.orchestra.run.smithi139.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T04:41:15.936 INFO:teuthology.orchestra.run.smithi139.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-18T04:41:15.937 INFO:teuthology.orchestra.run.smithi139.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T04:41:15.948 INFO:teuthology.orchestra.run.smithi139.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-18T04:41:15.993 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-18T04:41:16.001 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T04:41:16.001 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-18T04:41:16.019 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-18T04:41:16.092 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-18T04:41:16.101 INFO:teuthology.orchestra.run.smithi139.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-18T04:41:16.126 INFO:teuthology.orchestra.run.smithi139.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-18T04:41:16.217 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-18T04:41:16.533 INFO:teuthology.orchestra.run.smithi139.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-18T04:41:16.538 INFO:teuthology.orchestra.run.smithi139.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-18T04:41:16.539 INFO:teuthology.orchestra.run.smithi139.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-18T04:41:16.552 INFO:teuthology.orchestra.run.smithi139.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-18T04:41:16.555 INFO:teuthology.orchestra.run.smithi139.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-18T04:41:16.654 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-18T04:41:16.660 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-18T04:41:16.661 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-18T04:41:16.674 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,075 kB] 2024-04-18T04:41:16.676 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-18T04:41:16.679 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-18T04:41:16.688 INFO:teuthology.orchestra.run.smithi139.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,075 kB] 2024-04-18T04:41:16.786 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-18T04:41:16.800 INFO:teuthology.orchestra.run.smithi139.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-18T04:41:16.806 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-18T04:41:16.807 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-18T04:41:16.808 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-18T04:41:16.812 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-18T04:41:16.812 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-18T04:41:16.812 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-18T04:41:16.817 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-18T04:41:16.820 INFO:teuthology.orchestra.run.smithi139.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-18T04:41:16.821 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-18T04:41:16.822 INFO:teuthology.orchestra.run.smithi139.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-18T04:41:16.822 INFO:teuthology.orchestra.run.smithi139.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-18T04:41:16.825 INFO:teuthology.orchestra.run.smithi139.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-18T04:41:16.826 INFO:teuthology.orchestra.run.smithi139.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-18T04:41:16.826 INFO:teuthology.orchestra.run.smithi139.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-18T04:41:16.830 INFO:teuthology.orchestra.run.smithi139.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-18T04:41:16.835 INFO:teuthology.orchestra.run.smithi139.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-18T04:41:16.985 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-18T04:41:17.004 INFO:teuthology.orchestra.run.smithi139.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-18T04:41:17.069 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-18T04:41:17.086 INFO:teuthology.orchestra.run.smithi139.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-18T04:41:17.156 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-18T04:41:17.170 INFO:teuthology.orchestra.run.smithi139.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-18T04:41:17.235 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-18T04:41:17.251 INFO:teuthology.orchestra.run.smithi139.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-18T04:41:17.264 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-18T04:41:17.291 INFO:teuthology.orchestra.run.smithi139.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-18T04:41:21.420 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 12.9 MB in 3s (4,993 kB/s) 2024-04-18T04:41:21.498 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 12.9 MB in 3s (4,973 kB/s) 2024-04-18T04:41:22.772 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-04-18T04:41:22.789 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T04:41:22.791 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T04:41:22.807 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T04:41:22.849 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-04-18T04:41:22.865 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T04:41:23.057 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2024-04-18T04:41:23.057 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2024-04-18T04:41:23.063 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-18T04:41:23.064 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-18T04:41:23.225 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T04:41:23.225 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T04:41:23.225 INFO:teuthology.orchestra.run.smithi139.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T04:41:23.226 INFO:teuthology.orchestra.run.smithi139.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T04:41:23.226 INFO:teuthology.orchestra.run.smithi139.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T04:41:23.226 INFO:teuthology.orchestra.run.smithi139.stdout: python2.7-minimal 2024-04-18T04:41:23.226 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T04:41:23.227 INFO:teuthology.orchestra.run.smithi139.stdout:The following additional packages will be installed: 2024-04-18T04:41:23.227 INFO:teuthology.orchestra.run.smithi139.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T04:41:23.227 INFO:teuthology.orchestra.run.smithi139.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-18T04:41:23.227 INFO:teuthology.orchestra.run.smithi139.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-18T04:41:23.229 INFO:teuthology.orchestra.run.smithi139.stdout:Suggested packages: 2024-04-18T04:41:23.229 INFO:teuthology.orchestra.run.smithi139.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-18T04:41:23.229 INFO:teuthology.orchestra.run.smithi139.stdout:Recommended packages: 2024-04-18T04:41:23.229 INFO:teuthology.orchestra.run.smithi139.stdout: thermald 2024-04-18T04:41:23.232 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T04:41:23.233 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T04:41:23.233 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T04:41:23.233 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T04:41:23.233 INFO:teuthology.orchestra.run.smithi096.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T04:41:23.233 INFO:teuthology.orchestra.run.smithi096.stdout: python2.7-minimal 2024-04-18T04:41:23.233 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T04:41:23.234 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-04-18T04:41:23.235 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T04:41:23.235 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-18T04:41:23.235 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-18T04:41:23.236 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-04-18T04:41:23.236 INFO:teuthology.orchestra.run.smithi096.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-18T04:41:23.236 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-04-18T04:41:23.236 INFO:teuthology.orchestra.run.smithi096.stdout: thermald 2024-04-18T04:41:23.278 INFO:teuthology.orchestra.run.smithi139.stdout:The following NEW packages will be installed: 2024-04-18T04:41:23.278 INFO:teuthology.orchestra.run.smithi139.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T04:41:23.278 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-18T04:41:23.278 INFO:teuthology.orchestra.run.smithi139.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-18T04:41:23.279 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages will be upgraded: 2024-04-18T04:41:23.280 INFO:teuthology.orchestra.run.smithi139.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T04:41:23.285 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-04-18T04:41:23.285 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T04:41:23.285 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-18T04:41:23.285 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-18T04:41:23.286 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2024-04-18T04:41:23.287 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T04:41:23.336 INFO:teuthology.orchestra.run.smithi139.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T04:41:23.336 INFO:teuthology.orchestra.run.smithi139.stdout:Need to get 113 MB of archives. 2024-04-18T04:41:23.337 INFO:teuthology.orchestra.run.smithi139.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-18T04:41:23.337 INFO:teuthology.orchestra.run.smithi139.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-18T04:41:23.345 INFO:teuthology.orchestra.run.smithi096.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T04:41:23.345 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 113 MB of archives. 2024-04-18T04:41:23.345 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-18T04:41:23.345 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-18T04:41:24.053 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-18T04:41:24.138 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-18T04:41:24.256 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-18T04:41:24.403 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-18T04:41:25.810 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-18T04:41:25.811 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-18T04:41:25.811 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-18T04:41:26.133 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-18T04:41:26.181 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-18T04:41:26.214 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-18T04:41:26.214 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-18T04:41:26.215 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-18T04:41:26.375 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-18T04:41:26.443 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-18T04:41:26.570 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 113 MB in 3s (39.2 MB/s) 2024-04-18T04:41:26.753 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-18T04:41:26.845 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 113 MB in 3s (36.0 MB/s) 2024-04-18T04:41:27.038 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-18T04:41:28.656 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-18T04:41:28.661 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T04:41:28.759 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:28.963 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-18T04:41:28.967 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T04:41:29.044 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:30.910 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-18T04:41:30.931 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T04:41:31.011 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:31.197 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-18T04:41:31.218 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T04:41:31.309 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:31.913 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-18T04:41:31.934 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T04:41:31.971 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:32.100 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-18T04:41:32.120 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T04:41:32.158 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:38.297 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T04:41:38.405 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T04:41:38.671 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T04:41:38.738 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T04:41:38.792 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T04:41:38.855 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T04:41:39.095 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-18T04:41:39.117 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-18T04:41:39.161 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T04:41:39.187 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T04:41:39.308 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T04:41:39.603 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-18T04:41:39.614 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-18T04:41:39.653 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T04:41:45.033 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-18T04:41:45.069 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T04:41:45.107 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:45.113 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-18T04:41:45.150 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T04:41:45.207 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:47.637 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T04:41:47.759 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T04:41:48.100 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T04:41:48.222 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:48.284 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T04:41:48.339 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-18T04:41:48.381 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T04:41:48.459 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:48.698 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T04:41:48.794 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:48.912 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-18T04:41:49.040 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:49.787 INFO:teuthology.orchestra.run.smithi139.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-18T04:41:49.787 INFO:teuthology.orchestra.run.smithi139.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-18T04:41:49.788 INFO:teuthology.orchestra.run.smithi139.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-18T04:41:49.788 INFO:teuthology.orchestra.run.smithi139.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-18T04:41:49.944 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:50.452 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-18T04:41:50.453 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-18T04:41:50.453 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-18T04:41:50.453 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-18T04:41:51.218 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:51.346 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:52.694 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:52.747 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-18T04:41:52.865 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-18T04:41:52.974 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:53.025 INFO:teuthology.orchestra.run.smithi139.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T04:41:53.026 INFO:teuthology.orchestra.run.smithi139.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-18T04:41:54.045 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-18T04:41:54.146 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-18T04:41:54.272 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T04:41:54.334 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T04:41:54.335 INFO:teuthology.orchestra.run.smithi096.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-18T04:42:07.039 INFO:teuthology.orchestra.run.smithi139.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T04:42:07.039 INFO:teuthology.orchestra.run.smithi139.stdout:Sourcing file `/etc/default/grub' 2024-04-18T04:42:07.056 INFO:teuthology.orchestra.run.smithi139.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T04:42:07.072 INFO:teuthology.orchestra.run.smithi139.stdout:Generating grub configuration file ... 2024-04-18T04:42:07.340 INFO:teuthology.orchestra.run.smithi139.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T04:42:07.355 INFO:teuthology.orchestra.run.smithi139.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T04:42:07.649 INFO:teuthology.orchestra.run.smithi139.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T04:42:07.654 INFO:teuthology.orchestra.run.smithi139.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T04:42:07.719 INFO:teuthology.orchestra.run.smithi139.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T04:42:07.724 INFO:teuthology.orchestra.run.smithi139.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T04:42:07.905 INFO:teuthology.orchestra.run.smithi139.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T04:42:07.906 INFO:teuthology.orchestra.run.smithi139.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T04:42:07.906 INFO:teuthology.orchestra.run.smithi139.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T04:42:07.949 INFO:teuthology.orchestra.run.smithi139.stdout:done 2024-04-18T04:42:08.358 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T04:42:08.358 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub' 2024-04-18T04:42:08.362 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T04:42:08.395 INFO:teuthology.orchestra.run.smithi096.stdout:Generating grub configuration file ... 2024-04-18T04:42:08.450 DEBUG:teuthology.orchestra.run.smithi139:> dpkg -s linux-image-generic 2024-04-18T04:42:08.473 INFO:teuthology.orchestra.run.smithi139.stdout:Package: linux-image-generic 2024-04-18T04:42:08.473 INFO:teuthology.orchestra.run.smithi139.stdout:Status: install ok installed 2024-04-18T04:42:08.473 INFO:teuthology.orchestra.run.smithi139.stdout:Priority: optional 2024-04-18T04:42:08.473 INFO:teuthology.orchestra.run.smithi139.stdout:Section: kernel 2024-04-18T04:42:08.473 INFO:teuthology.orchestra.run.smithi139.stdout:Installed-Size: 21 2024-04-18T04:42:08.473 INFO:teuthology.orchestra.run.smithi139.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T04:42:08.473 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: amd64 2024-04-18T04:42:08.473 INFO:teuthology.orchestra.run.smithi139.stdout:Source: linux-meta 2024-04-18T04:42:08.473 INFO:teuthology.orchestra.run.smithi139.stdout:Version: 5.15.0.102.99 2024-04-18T04:42:08.473 INFO:teuthology.orchestra.run.smithi139.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T04:42:08.474 INFO:teuthology.orchestra.run.smithi139.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T04:42:08.474 INFO:teuthology.orchestra.run.smithi139.stdout:Recommends: thermald 2024-04-18T04:42:08.474 INFO:teuthology.orchestra.run.smithi139.stdout:Description: Generic Linux kernel image 2024-04-18T04:42:08.474 INFO:teuthology.orchestra.run.smithi139.stdout: This package will always depend on the latest generic kernel image 2024-04-18T04:42:08.474 INFO:teuthology.orchestra.run.smithi139.stdout: available. 2024-04-18T04:42:08.474 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-18T04:42:08.474 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T04:42:08.474 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T04:42:08.474 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-18T04:42:08.475 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi139.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T04:42:08.475 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get clean 2024-04-18T04:42:08.636 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get update 2024-04-18T04:42:08.736 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T04:42:08.752 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T04:42:08.756 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T04:42:08.757 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T04:42:08.767 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T04:42:08.787 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T04:42:09.141 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T04:42:09.147 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T04:42:09.215 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T04:42:09.221 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T04:42:09.407 INFO:teuthology.orchestra.run.smithi096.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T04:42:09.407 INFO:teuthology.orchestra.run.smithi096.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T04:42:09.407 INFO:teuthology.orchestra.run.smithi096.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T04:42:09.453 INFO:teuthology.orchestra.run.smithi096.stdout:done 2024-04-18T04:42:09.918 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-04-18T04:42:09.937 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-04-18T04:42:09.937 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-04-18T04:42:09.938 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-04-18T04:42:09.938 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-04-18T04:42:09.938 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 21 2024-04-18T04:42:09.938 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T04:42:09.938 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-04-18T04:42:09.938 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-04-18T04:42:09.938 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.15.0.102.99 2024-04-18T04:42:09.938 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T04:42:09.938 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T04:42:09.938 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-04-18T04:42:09.938 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-04-18T04:42:09.938 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-04-18T04:42:09.938 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-04-18T04:42:09.939 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-18T04:42:09.939 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T04:42:09.939 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T04:42:09.939 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-18T04:42:09.939 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T04:42:09.939 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-04-18T04:42:10.090 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-04-18T04:42:10.109 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T04:42:10.109 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-04-18T04:42:10.159 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-04-18T04:42:10.247 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T04:42:10.259 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T04:42:10.280 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T04:42:10.348 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2024-04-18T04:42:10.348 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2024-04-18T04:42:10.362 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T04:42:10.504 INFO:teuthology.orchestra.run.smithi139.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-18T04:42:10.504 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T04:42:10.504 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T04:42:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T04:42:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T04:42:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T04:42:10.505 INFO:teuthology.orchestra.run.smithi139.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T04:42:10.505 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T04:42:10.543 INFO:teuthology.orchestra.run.smithi139.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T04:42:10.544 DEBUG:teuthology.orchestra.run.smithi139:> dpkg -s linux-image-generic 2024-04-18T04:42:10.604 INFO:teuthology.orchestra.run.smithi139.stdout:Package: linux-image-generic 2024-04-18T04:42:10.604 INFO:teuthology.orchestra.run.smithi139.stdout:Status: install ok installed 2024-04-18T04:42:10.604 INFO:teuthology.orchestra.run.smithi139.stdout:Priority: optional 2024-04-18T04:42:10.605 INFO:teuthology.orchestra.run.smithi139.stdout:Section: kernel 2024-04-18T04:42:10.605 INFO:teuthology.orchestra.run.smithi139.stdout:Installed-Size: 21 2024-04-18T04:42:10.605 INFO:teuthology.orchestra.run.smithi139.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T04:42:10.605 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: amd64 2024-04-18T04:42:10.605 INFO:teuthology.orchestra.run.smithi139.stdout:Source: linux-meta 2024-04-18T04:42:10.605 INFO:teuthology.orchestra.run.smithi139.stdout:Version: 5.15.0.102.99 2024-04-18T04:42:10.605 INFO:teuthology.orchestra.run.smithi139.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T04:42:10.605 INFO:teuthology.orchestra.run.smithi139.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T04:42:10.605 INFO:teuthology.orchestra.run.smithi139.stdout:Recommends: thermald 2024-04-18T04:42:10.605 INFO:teuthology.orchestra.run.smithi139.stdout:Description: Generic Linux kernel image 2024-04-18T04:42:10.605 INFO:teuthology.orchestra.run.smithi139.stdout: This package will always depend on the latest generic kernel image 2024-04-18T04:42:10.605 INFO:teuthology.orchestra.run.smithi139.stdout: available. 2024-04-18T04:42:10.606 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2024-04-18T04:42:10.649 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.75TN5nQJGp 2024-04-18T04:42:10.650 DEBUG:teuthology.orchestra.run.smithi139:> sudo cp /boot/grub/grub.cfg /tmp/tmp.75TN5nQJGp 2024-04-18T04:42:10.706 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.75TN5nQJGp 2024-04-18T04:42:10.830 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.75TN5nQJGp is 10KB 2024-04-18T04:42:10.843 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.75TN5nQJGp 2024-04-18T04:42:10.848 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T04:42:10.900 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:42:10.900 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T04:42:10.901 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T04:42:10.964 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-18T04:42:10.964 DEBUG:teuthology.orchestra.run.smithi139:> sudo update-grub 2024-04-18T04:42:11.607 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T04:42:11.624 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T04:42:11.677 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T04:42:11.853 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-18T04:42:11.853 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-18T04:42:12.006 INFO:teuthology.orchestra.run.smithi096.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-18T04:42:12.006 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T04:42:12.006 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T04:42:12.006 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T04:42:12.007 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T04:42:12.007 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T04:42:12.007 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T04:42:12.007 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T04:42:12.043 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T04:42:12.045 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-04-18T04:42:12.102 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-04-18T04:42:12.102 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-04-18T04:42:12.102 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-04-18T04:42:12.102 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-04-18T04:42:12.102 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 21 2024-04-18T04:42:12.102 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T04:42:12.102 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-04-18T04:42:12.102 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-04-18T04:42:12.102 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.15.0.102.99 2024-04-18T04:42:12.102 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T04:42:12.102 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T04:42:12.103 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-04-18T04:42:12.103 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-04-18T04:42:12.103 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-04-18T04:42:12.103 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-04-18T04:42:12.103 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-18T04:42:12.151 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.ycz5SFRJgY 2024-04-18T04:42:12.151 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ycz5SFRJgY 2024-04-18T04:42:12.155 INFO:teuthology.orchestra.run.smithi139.stderr:Sourcing file `/etc/default/grub' 2024-04-18T04:42:12.156 INFO:teuthology.orchestra.run.smithi139.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T04:42:12.162 INFO:teuthology.orchestra.run.smithi139.stderr:Generating grub configuration file ... 2024-04-18T04:42:12.206 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.ycz5SFRJgY 2024-04-18T04:42:12.327 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.ycz5SFRJgY is 10KB 2024-04-18T04:42:12.341 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.ycz5SFRJgY 2024-04-18T04:42:12.346 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T04:42:12.360 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T04:42:12.366 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T04:42:12.399 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:42:12.399 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T04:42:12.399 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T04:42:12.481 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-18T04:42:12.481 DEBUG:teuthology.orchestra.run.smithi096:> sudo update-grub 2024-04-18T04:42:12.604 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T04:42:12.609 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T04:42:12.651 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T04:42:12.656 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T04:42:12.787 INFO:teuthology.orchestra.run.smithi139.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T04:42:12.787 INFO:teuthology.orchestra.run.smithi139.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T04:42:12.787 INFO:teuthology.orchestra.run.smithi139.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T04:42:12.799 INFO:teuthology.orchestra.run.smithi139.stderr:done 2024-04-18T04:42:12.812 DEBUG:teuthology.orchestra.run.smithi139:> sudo shutdown -r now 2024-04-18T04:42:13.707 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub' 2024-04-18T04:42:13.708 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T04:42:13.710 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2024-04-18T04:42:13.957 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T04:42:13.963 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T04:42:14.254 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T04:42:14.260 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T04:42:14.302 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T04:42:14.308 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T04:42:14.459 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T04:42:14.459 INFO:teuthology.orchestra.run.smithi096.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T04:42:14.459 INFO:teuthology.orchestra.run.smithi096.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T04:42:14.478 INFO:teuthology.orchestra.run.smithi096.stderr:done 2024-04-18T04:42:14.490 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2024-04-18T04:42:42.831 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-18T04:42:42.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-18T04:42:42.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:42:44.494 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T04:42:44.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T04:42:44.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:43:01.279 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-04-18T04:43:02.814 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-18T04:43:10.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-18T04:43:10.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:43:11.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T04:43:11.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:43:13.346 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-04-18T04:43:14.882 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-18T04:43:25.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-18T04:43:25.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:43:26.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T04:43:26.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:43:43.774 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-04-18T04:43:45.310 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-18T04:43:58.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-18T04:43:58.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:43:59.137 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-04-18T04:43:59.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-18T04:43:59.718 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-102-generic"... 2024-04-18T04:43:59.719 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-04-18T04:43:59.764 INFO:teuthology.orchestra.run.smithi139.stdout:5.15.0-102-generic 2024-04-18T04:43:59.764 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-18T04:43:59.764 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T04:43:59.764 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T04:44:00.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T04:44:00.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:44:00.765 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-18T04:44:00.766 DEBUG:teuthology.orchestra.run.smithi139:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T04:44:00.964 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-04-18T04:44:01.133 INFO:teuthology.orchestra.run.smithi139.stdout:ttyS1 2024-04-18T04:44:01.162 DEBUG:teuthology.parallel:result is None 2024-04-18T04:44:01.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T04:44:01.570 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T04:44:01.570 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-04-18T04:44:01.618 INFO:teuthology.orchestra.run.smithi096.stdout:5.15.0-102-generic 2024-04-18T04:44:01.618 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-18T04:44:01.619 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T04:44:01.619 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T04:44:02.620 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-18T04:44:02.620 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T04:44:02.712 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2024-04-18T04:44:02.744 DEBUG:teuthology.parallel:result is None 2024-04-18T04:44:02.744 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-18T04:44:02.755 INFO:teuthology.task.internal:Creating test directory... 2024-04-18T04:44:02.755 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T04:44:02.758 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T04:44:02.763 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-18T04:44:02.774 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-18T04:44:02.787 INFO:teuthology.task.internal:Creating archive directory... 2024-04-18T04:44:02.787 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T04:44:02.803 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T04:44:02.903 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-18T04:44:02.911 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-18T04:44:02.911 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T04:44:02.914 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T04:44:02.936 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T04:44:02.944 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T04:44:02.948 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T04:44:02.956 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T04:44:02.958 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-18T04:44:02.968 INFO:teuthology.task.internal:Configuring sudo... 2024-04-18T04:44:02.969 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T04:44:03.004 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T04:44:03.026 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-18T04:44:03.042 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-18T04:44:03.042 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T04:44:03.059 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T04:44:03.072 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T04:44:03.110 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T04:44:03.159 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:44:03.159 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T04:44:03.218 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T04:44:03.223 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T04:44:03.273 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:44:03.273 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T04:44:03.339 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2024-04-18T04:44:03.341 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2024-04-18T04:44:03.409 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-18T04:44:03.419 INFO:teuthology.task.internal:Starting timer... 2024-04-18T04:44:03.419 INFO:teuthology.run_tasks:Running task pcp... 2024-04-18T04:44:03.433 INFO:teuthology.run_tasks:Running task selinux... 2024-04-18T04:44:03.442 DEBUG:teuthology.task.selinux:Excluding smithi096: OS 'ubuntu' does not support SELinux 2024-04-18T04:44:03.442 DEBUG:teuthology.task.selinux:Excluding smithi139: OS 'ubuntu' does not support SELinux 2024-04-18T04:44:03.443 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-18T04:44:03.443 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-18T04:44:03.443 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-18T04:44:03.443 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-18T04:44:03.453 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-18T04:44:03.458 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-18T04:44:03.589 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-18T04:44:03.606 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-18T04:44:03.607 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi096.front.sepia.ceph.com,smithi139.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-18T04:51:01.187 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi096.front.sepia.ceph.com'), Remote(name='ubuntu@smithi139.front.sepia.ceph.com')] 2024-04-18T04:51:01.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T04:51:01.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:51:01.276 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-04-18T04:51:01.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-18T04:51:01.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-18T04:51:01.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:51:01.435 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-04-18T04:51:01.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-18T04:51:01.510 INFO:teuthology.run_tasks:Running task clock... 2024-04-18T04:51:01.521 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-18T04:51:01.522 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T04:51:01.523 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T04:51:01.525 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T04:51:01.525 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T04:51:01.552 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-18T04:51:01.552 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: Command line: ntpd -gq 2024-04-18T04:51:01.553 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: ---------------------------------------------------- 2024-04-18T04:51:01.553 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: ntp-4 is maintained by Network Time Foundation, 2024-04-18T04:51:01.553 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-18T04:51:01.553 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: corporation. Support and training for ntp-4 are 2024-04-18T04:51:01.553 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: available at https://www.nwtime.org/support 2024-04-18T04:51:01.553 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: ---------------------------------------------------- 2024-04-18T04:51:01.554 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: proto: precision = 0.045 usec (-24) 2024-04-18T04:51:01.554 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: basedate set to 2022-02-04 2024-04-18T04:51:01.554 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: gps base set to 2022-02-06 (week 2196) 2024-04-18T04:51:01.554 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T04:51:01.554 INFO:teuthology.orchestra.run.smithi096.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T04:51:01.554 INFO:teuthology.orchestra.run.smithi096.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T04:51:01.555 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T04:51:01.555 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T04:51:01.555 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T04:51:01.556 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T04:51:01.556 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: Listen normally on 3 enp3s0f1 172.21.15.96:123 2024-04-18T04:51:01.556 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: Listen normally on 4 lo [::1]:123 2024-04-18T04:51:01.556 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc0d%5]:123 2024-04-18T04:51:01.556 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:01 ntpd[17191]: Listening on routing socket on fd #22 for interface updates 2024-04-18T04:51:01.579 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-18T04:51:01.579 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: Command line: ntpd -gq 2024-04-18T04:51:01.579 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: ---------------------------------------------------- 2024-04-18T04:51:01.579 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: ntp-4 is maintained by Network Time Foundation, 2024-04-18T04:51:01.579 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-18T04:51:01.579 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: corporation. Support and training for ntp-4 are 2024-04-18T04:51:01.579 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: available at https://www.nwtime.org/support 2024-04-18T04:51:01.579 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: ---------------------------------------------------- 2024-04-18T04:51:01.580 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: proto: precision = 0.044 usec (-24) 2024-04-18T04:51:01.580 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: basedate set to 2022-02-04 2024-04-18T04:51:01.580 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: gps base set to 2022-02-06 (week 2196) 2024-04-18T04:51:01.580 INFO:teuthology.orchestra.run.smithi139.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T04:51:01.581 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T04:51:01.581 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T04:51:01.581 INFO:teuthology.orchestra.run.smithi139.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T04:51:01.582 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T04:51:01.582 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T04:51:01.582 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T04:51:01.582 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: Listen normally on 3 enp3s0f1 172.21.15.139:123 2024-04-18T04:51:01.582 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: Listen normally on 4 lo [::1]:123 2024-04-18T04:51:01.582 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f59%5]:123 2024-04-18T04:51:01.582 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:01 ntpd[17193]: Listening on routing socket on fd #22 for interface updates 2024-04-18T04:51:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:02 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:02 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:02 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:02 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:02 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:02.555 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:02 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:02.555 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:02 ntpd[17191]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:02.555 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:02 ntpd[17191]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:02.555 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:02 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:02.555 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:02 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:02.555 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:02 ntpd[17191]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:02.555 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:02 ntpd[17191]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:02.580 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:02 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:02.580 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:02 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:02.580 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:02 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:02.580 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:02 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:02.580 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:02 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:02.580 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:02 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:02.580 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:02 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:02.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:02 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:02.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:02 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:02.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:02 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:02.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:02 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:02.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:02 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:03.553 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:03 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:03.553 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:03 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:03.553 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:03 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:03.553 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:03 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:03.553 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:03 ntpd[17191]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:03.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:03 ntpd[17191]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:04.553 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:04 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:04.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:04 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:04.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:04 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:04.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:04 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:04.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:04 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:04.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:04 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:04.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:04 ntpd[17191]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:04.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:04 ntpd[17191]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:04.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:04 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:04.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:04 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:04.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:04 ntpd[17191]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:04.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:04 ntpd[17191]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:04.580 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:04 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:04.580 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:04 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:04.580 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:04 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:04.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:04 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:04.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:04 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:04.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:04 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:04.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:04 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:04.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:04 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:04.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:04 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:04.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:04 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:04.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:04 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:04.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:04 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:04.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:04 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:04.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:04 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:05.553 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:05 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:05.553 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:05 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:05.553 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:05 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:05.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:05 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:05.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:05 ntpd[17191]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:05.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:05 ntpd[17191]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:06 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:06 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:06 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:06 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:06 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:06 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:06 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:06.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:06 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:06.555 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:06 ntpd[17191]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:06.555 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:06 ntpd[17191]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:06.555 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:06 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:06.555 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:06 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:06.555 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:06 ntpd[17191]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:06.555 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:06 ntpd[17191]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:06.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:06.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:06.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:06.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:06.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:06.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:06.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:06.582 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:06.582 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:06.582 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:06.582 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:06.582 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:06.582 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:06.582 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:06.582 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:06.582 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:06.582 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:06.582 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:06 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:07.553 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:07 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:07.553 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:07 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:07.553 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:07 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:07.553 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:07 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:07.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:07 ntpd[17191]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:07.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:07 ntpd[17191]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:08.553 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:08 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:08.553 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:08 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:08.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:08 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:08.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:08 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:08.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:08 ntpd[17191]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:08.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:08 ntpd[17191]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:08.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:08 ntpd[17191]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:08.554 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:08 ntpd[17191]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:08.554 INFO:teuthology.orchestra.run.smithi096.stdout:18 Apr 04:51:08 ntpd[17191]: ntpd: time slew -0.000954 s 2024-04-18T04:51:08.555 INFO:teuthology.orchestra.run.smithi096.stdout:ntpd: time slew -0.000954s 2024-04-18T04:51:08.555 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:08 ntpd[17191]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T04:51:08.555 INFO:teuthology.orchestra.run.smithi096.stderr:18 Apr 04:51:08 ntpd[17191]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T04:51:08.580 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:08 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:08.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:08 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:08.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:08 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:08.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:08 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:08.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:08 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:08.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:08 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:08.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:08 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:08.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:08 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:08.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:08 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:08.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:08 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:08.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:08 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:51:08.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:08 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:51:08.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:08 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:51:08.581 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:08 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:51:08.582 INFO:teuthology.orchestra.run.smithi139.stdout:18 Apr 04:51:08 ntpd[17193]: ntpd: time slew +0.000371 s 2024-04-18T04:51:08.582 INFO:teuthology.orchestra.run.smithi139.stdout:ntpd: time slew +0.000371s 2024-04-18T04:51:08.582 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:08 ntpd[17193]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T04:51:08.582 INFO:teuthology.orchestra.run.smithi139.stderr:18 Apr 04:51:08 ntpd[17193]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T04:51:08.621 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T04:51:08.621 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-04-18T04:51:08.621 INFO:teuthology.orchestra.run.smithi096.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T04:51:08.621 INFO:teuthology.orchestra.run.smithi096.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T04:51:08.621 INFO:teuthology.orchestra.run.smithi096.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T04:51:08.621 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T04:51:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T04:51:08.636 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================== 2024-04-18T04:51:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T04:51:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T04:51:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T04:51:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T04:51:08.636 INFO:teuthology.run_tasks:Running task install... 2024-04-18T04:51:08.645 DEBUG:teuthology.task.install:project ceph 2024-04-18T04:51:08.646 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae'}} 2024-04-18T04:51:08.646 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae'} 2024-04-18T04:51:08.646 INFO:teuthology.task.install:Using flavor: default 2024-04-18T04:51:08.651 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-18T04:51:08.652 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-04-18T04:51:08.652 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-key list | grep Ceph 2024-04-18T04:51:08.653 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-key list | grep Ceph 2024-04-18T04:51:08.721 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-18T04:51:08.740 INFO:teuthology.orchestra.run.smithi139.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-18T04:51:08.746 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T04:51:08.747 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T04:51:08.748 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-18T04:51:08.748 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-18T04:51:08.748 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=56a91dd158be807f143cc918a11685fc9ee164ae 2024-04-18T04:51:08.769 INFO:teuthology.orchestra.run.smithi139.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T04:51:08.769 INFO:teuthology.orchestra.run.smithi139.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T04:51:08.770 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-18T04:51:08.770 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-18T04:51:08.770 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=56a91dd158be807f143cc918a11685fc9ee164ae 2024-04-18T04:51:08.929 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default/ 2024-04-18T04:51:08.929 INFO:teuthology.task.install.deb:Package version is 18.2.2-1229-g56a91dd1-1jammy 2024-04-18T04:51:08.969 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default/ 2024-04-18T04:51:08.969 INFO:teuthology.task.install.deb:Package version is 18.2.2-1229-g56a91dd1-1jammy 2024-04-18T04:51:09.121 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:51:09.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T04:51:09.135 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get update 2024-04-18T04:51:09.140 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:51:09.140 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T04:51:09.154 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-04-18T04:51:09.329 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T04:51:09.329 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T04:51:09.332 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T04:51:09.341 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T04:51:09.344 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T04:51:09.361 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T04:51:09.365 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T04:51:09.373 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy InRelease 2024-04-18T04:51:09.394 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-18T04:51:09.415 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-18T04:51:09.421 INFO:teuthology.orchestra.run.smithi139.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy InRelease 2024-04-18T04:51:09.436 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-18T04:51:09.446 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T04:51:09.457 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-18T04:51:09.463 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2024-04-18T04:51:09.494 INFO:teuthology.orchestra.run.smithi139.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-18T04:51:09.531 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2024-04-18T04:51:09.573 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-18T04:51:09.689 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 28.5 kB in 0s (80.4 kB/s) 2024-04-18T04:51:09.697 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 28.5 kB in 0s (74.0 kB/s) 2024-04-18T04:51:10.625 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T04:51:10.640 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1229-g56a91dd1-1jammy cephadm=18.2.2-1229-g56a91dd1-1jammy ceph-mds=18.2.2-1229-g56a91dd1-1jammy ceph-mgr=18.2.2-1229-g56a91dd1-1jammy ceph-common=18.2.2-1229-g56a91dd1-1jammy ceph-fuse=18.2.2-1229-g56a91dd1-1jammy ceph-test=18.2.2-1229-g56a91dd1-1jammy ceph-volume=18.2.2-1229-g56a91dd1-1jammy radosgw=18.2.2-1229-g56a91dd1-1jammy python3-rados=18.2.2-1229-g56a91dd1-1jammy python3-rgw=18.2.2-1229-g56a91dd1-1jammy python3-cephfs=18.2.2-1229-g56a91dd1-1jammy python3-rbd=18.2.2-1229-g56a91dd1-1jammy libcephfs2=18.2.2-1229-g56a91dd1-1jammy libcephfs-dev=18.2.2-1229-g56a91dd1-1jammy librados2=18.2.2-1229-g56a91dd1-1jammy librbd1=18.2.2-1229-g56a91dd1-1jammy rbd-fuse=18.2.2-1229-g56a91dd1-1jammy python3-cephfs=18.2.2-1229-g56a91dd1-1jammy cephfs-shell=18.2.2-1229-g56a91dd1-1jammy cephfs-top=18.2.2-1229-g56a91dd1-1jammy cephfs-mirror=18.2.2-1229-g56a91dd1-1jammy 2024-04-18T04:51:10.662 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-04-18T04:51:10.678 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1229-g56a91dd1-1jammy cephadm=18.2.2-1229-g56a91dd1-1jammy ceph-mds=18.2.2-1229-g56a91dd1-1jammy ceph-mgr=18.2.2-1229-g56a91dd1-1jammy ceph-common=18.2.2-1229-g56a91dd1-1jammy ceph-fuse=18.2.2-1229-g56a91dd1-1jammy ceph-test=18.2.2-1229-g56a91dd1-1jammy ceph-volume=18.2.2-1229-g56a91dd1-1jammy radosgw=18.2.2-1229-g56a91dd1-1jammy python3-rados=18.2.2-1229-g56a91dd1-1jammy python3-rgw=18.2.2-1229-g56a91dd1-1jammy python3-cephfs=18.2.2-1229-g56a91dd1-1jammy python3-rbd=18.2.2-1229-g56a91dd1-1jammy libcephfs2=18.2.2-1229-g56a91dd1-1jammy libcephfs-dev=18.2.2-1229-g56a91dd1-1jammy librados2=18.2.2-1229-g56a91dd1-1jammy librbd1=18.2.2-1229-g56a91dd1-1jammy rbd-fuse=18.2.2-1229-g56a91dd1-1jammy python3-cephfs=18.2.2-1229-g56a91dd1-1jammy cephfs-shell=18.2.2-1229-g56a91dd1-1jammy cephfs-top=18.2.2-1229-g56a91dd1-1jammy cephfs-mirror=18.2.2-1229-g56a91dd1-1jammy 2024-04-18T04:51:10.702 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T04:51:10.744 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-04-18T04:51:10.910 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-18T04:51:10.911 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-18T04:51:10.952 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2024-04-18T04:51:10.953 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2024-04-18T04:51:11.098 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T04:51:11.099 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T04:51:11.099 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T04:51:11.099 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T04:51:11.099 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T04:51:11.099 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T04:51:11.100 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T04:51:11.102 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-04-18T04:51:11.102 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T04:51:11.102 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-18T04:51:11.102 INFO:teuthology.orchestra.run.smithi096.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-18T04:51:11.102 INFO:teuthology.orchestra.run.smithi096.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-18T04:51:11.103 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-18T04:51:11.103 INFO:teuthology.orchestra.run.smithi096.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-18T04:51:11.103 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-18T04:51:11.103 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-18T04:51:11.103 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-18T04:51:11.104 INFO:teuthology.orchestra.run.smithi096.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-18T04:51:11.104 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-18T04:51:11.104 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-18T04:51:11.104 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-18T04:51:11.104 INFO:teuthology.orchestra.run.smithi096.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-18T04:51:11.104 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-18T04:51:11.105 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-18T04:51:11.105 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-18T04:51:11.105 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-18T04:51:11.105 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-18T04:51:11.105 INFO:teuthology.orchestra.run.smithi096.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-18T04:51:11.106 INFO:teuthology.orchestra.run.smithi096.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-18T04:51:11.106 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-18T04:51:11.106 INFO:teuthology.orchestra.run.smithi096.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-18T04:51:11.106 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-04-18T04:51:11.106 INFO:teuthology.orchestra.run.smithi096.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-18T04:51:11.107 INFO:teuthology.orchestra.run.smithi096.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-18T04:51:11.107 INFO:teuthology.orchestra.run.smithi096.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-18T04:51:11.107 INFO:teuthology.orchestra.run.smithi096.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-18T04:51:11.107 INFO:teuthology.orchestra.run.smithi096.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-18T04:51:11.107 INFO:teuthology.orchestra.run.smithi096.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-18T04:51:11.107 INFO:teuthology.orchestra.run.smithi096.stdout: python3-watchdog 2024-04-18T04:51:11.108 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-04-18T04:51:11.108 INFO:teuthology.orchestra.run.smithi096.stdout: btrfs-tools 2024-04-18T04:51:11.151 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T04:51:11.151 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T04:51:11.151 INFO:teuthology.orchestra.run.smithi139.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T04:51:11.152 INFO:teuthology.orchestra.run.smithi139.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T04:51:11.152 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T04:51:11.152 INFO:teuthology.orchestra.run.smithi139.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T04:51:11.152 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T04:51:11.153 INFO:teuthology.orchestra.run.smithi139.stdout:The following additional packages will be installed: 2024-04-18T04:51:11.153 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T04:51:11.153 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-18T04:51:11.153 INFO:teuthology.orchestra.run.smithi139.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-18T04:51:11.153 INFO:teuthology.orchestra.run.smithi139.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-18T04:51:11.154 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-18T04:51:11.154 INFO:teuthology.orchestra.run.smithi139.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-18T04:51:11.154 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-18T04:51:11.154 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-18T04:51:11.154 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-18T04:51:11.155 INFO:teuthology.orchestra.run.smithi139.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-18T04:51:11.155 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-18T04:51:11.155 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-18T04:51:11.155 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-18T04:51:11.155 INFO:teuthology.orchestra.run.smithi139.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-18T04:51:11.155 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-18T04:51:11.155 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-18T04:51:11.155 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-18T04:51:11.155 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-18T04:51:11.156 INFO:teuthology.orchestra.run.smithi139.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-18T04:51:11.156 INFO:teuthology.orchestra.run.smithi139.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-18T04:51:11.156 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-18T04:51:11.156 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-18T04:51:11.156 INFO:teuthology.orchestra.run.smithi139.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-18T04:51:11.157 INFO:teuthology.orchestra.run.smithi139.stdout:Suggested packages: 2024-04-18T04:51:11.157 INFO:teuthology.orchestra.run.smithi139.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-18T04:51:11.157 INFO:teuthology.orchestra.run.smithi139.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-18T04:51:11.157 INFO:teuthology.orchestra.run.smithi139.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-18T04:51:11.157 INFO:teuthology.orchestra.run.smithi139.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-18T04:51:11.157 INFO:teuthology.orchestra.run.smithi139.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-18T04:51:11.157 INFO:teuthology.orchestra.run.smithi139.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-18T04:51:11.157 INFO:teuthology.orchestra.run.smithi139.stdout: python3-watchdog 2024-04-18T04:51:11.157 INFO:teuthology.orchestra.run.smithi139.stdout:Recommended packages: 2024-04-18T04:51:11.157 INFO:teuthology.orchestra.run.smithi139.stdout: btrfs-tools 2024-04-18T04:51:11.206 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-04-18T04:51:11.206 INFO:teuthology.orchestra.run.smithi096.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T04:51:11.206 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T04:51:11.206 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-18T04:51:11.206 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-18T04:51:11.206 INFO:teuthology.orchestra.run.smithi096.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-18T04:51:11.206 INFO:teuthology.orchestra.run.smithi096.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-18T04:51:11.206 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-18T04:51:11.206 INFO:teuthology.orchestra.run.smithi096.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-18T04:51:11.206 INFO:teuthology.orchestra.run.smithi096.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-18T04:51:11.207 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-18T04:51:11.207 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-18T04:51:11.207 INFO:teuthology.orchestra.run.smithi096.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-18T04:51:11.207 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T04:51:11.207 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T04:51:11.207 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T04:51:11.207 INFO:teuthology.orchestra.run.smithi096.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T04:51:11.207 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T04:51:11.207 INFO:teuthology.orchestra.run.smithi096.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T04:51:11.207 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-18T04:51:11.207 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-18T04:51:11.207 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-18T04:51:11.207 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T04:51:11.207 INFO:teuthology.orchestra.run.smithi096.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T04:51:11.207 INFO:teuthology.orchestra.run.smithi096.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T04:51:11.208 INFO:teuthology.orchestra.run.smithi096.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T04:51:11.208 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-18T04:51:11.208 INFO:teuthology.orchestra.run.smithi096.stdout: socat xmlstarlet 2024-04-18T04:51:11.260 INFO:teuthology.orchestra.run.smithi139.stdout:The following NEW packages will be installed: 2024-04-18T04:51:11.260 INFO:teuthology.orchestra.run.smithi139.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T04:51:11.260 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T04:51:11.261 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-18T04:51:11.261 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-18T04:51:11.261 INFO:teuthology.orchestra.run.smithi139.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-18T04:51:11.261 INFO:teuthology.orchestra.run.smithi139.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-18T04:51:11.261 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-18T04:51:11.262 INFO:teuthology.orchestra.run.smithi139.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-18T04:51:11.262 INFO:teuthology.orchestra.run.smithi139.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-18T04:51:11.262 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-18T04:51:11.263 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-18T04:51:11.263 INFO:teuthology.orchestra.run.smithi139.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-18T04:51:11.263 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T04:51:11.263 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T04:51:11.263 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T04:51:11.263 INFO:teuthology.orchestra.run.smithi139.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T04:51:11.263 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T04:51:11.263 INFO:teuthology.orchestra.run.smithi139.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T04:51:11.263 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-18T04:51:11.263 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-18T04:51:11.263 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-18T04:51:11.263 INFO:teuthology.orchestra.run.smithi139.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T04:51:11.263 INFO:teuthology.orchestra.run.smithi139.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T04:51:11.264 INFO:teuthology.orchestra.run.smithi139.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T04:51:11.264 INFO:teuthology.orchestra.run.smithi139.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T04:51:11.264 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-18T04:51:11.264 INFO:teuthology.orchestra.run.smithi139.stdout: socat xmlstarlet 2024-04-18T04:51:11.394 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 115 newly installed, 0 to remove and 302 not upgraded. 2024-04-18T04:51:11.395 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 163 MB of archives. 2024-04-18T04:51:11.395 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 745 MB of additional disk space will be used. 2024-04-18T04:51:11.395 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-18T04:51:11.425 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1229-g56a91dd1-1jammy [3,440 kB] 2024-04-18T04:51:11.451 INFO:teuthology.orchestra.run.smithi139.stdout:0 upgraded, 115 newly installed, 0 to remove and 302 not upgraded. 2024-04-18T04:51:11.452 INFO:teuthology.orchestra.run.smithi139.stdout:Need to get 163 MB of archives. 2024-04-18T04:51:11.452 INFO:teuthology.orchestra.run.smithi139.stdout:After this operation, 745 MB of additional disk space will be used. 2024-04-18T04:51:11.452 INFO:teuthology.orchestra.run.smithi139.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-18T04:51:11.478 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-18T04:51:11.523 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-18T04:51:11.534 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-18T04:51:11.580 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-18T04:51:11.726 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-18T04:51:11.767 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-18T04:51:11.774 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-18T04:51:11.787 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1229-g56a91dd1-1jammy [3,105 kB] 2024-04-18T04:51:11.817 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-18T04:51:11.842 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-18T04:51:11.853 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-18T04:51:11.891 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-18T04:51:11.898 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-18T04:51:11.905 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-18T04:51:11.937 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1229-g56a91dd1-1jammy [3,440 kB] 2024-04-18T04:51:11.948 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-18T04:51:11.953 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1229-g56a91dd1-1jammy [680 kB] 2024-04-18T04:51:11.966 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1229-g56a91dd1-1jammy [356 kB] 2024-04-18T04:51:11.973 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1229-g56a91dd1-1jammy [32.8 kB] 2024-04-18T04:51:11.974 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1229-g56a91dd1-1jammy [180 kB] 2024-04-18T04:51:11.978 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1229-g56a91dd1-1jammy [63.7 kB] 2024-04-18T04:51:11.980 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1229-g56a91dd1-1jammy [330 kB] 2024-04-18T04:51:11.986 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1229-g56a91dd1-1jammy [5,891 kB] 2024-04-18T04:51:12.064 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-18T04:51:12.072 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-18T04:51:12.100 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-18T04:51:12.114 INFO:teuthology.orchestra.run.smithi139.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-18T04:51:12.124 INFO:teuthology.orchestra.run.smithi139.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-18T04:51:12.147 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1229-g56a91dd1-1jammy [112 kB] 2024-04-18T04:51:12.150 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1229-g56a91dd1-1jammy [441 kB] 2024-04-18T04:51:12.150 INFO:teuthology.orchestra.run.smithi139.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-18T04:51:12.164 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1229-g56a91dd1-1jammy [21.9 MB] 2024-04-18T04:51:12.271 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-18T04:51:12.321 INFO:teuthology.orchestra.run.smithi139.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-18T04:51:12.475 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-18T04:51:12.530 INFO:teuthology.orchestra.run.smithi139.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-18T04:51:12.851 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-18T04:51:12.857 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-18T04:51:12.859 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-18T04:51:12.871 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-18T04:51:12.872 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-18T04:51:12.873 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-18T04:51:12.875 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-18T04:51:12.877 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-18T04:51:12.878 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-18T04:51:12.907 INFO:teuthology.orchestra.run.smithi139.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-18T04:51:12.913 INFO:teuthology.orchestra.run.smithi139.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-18T04:51:12.915 INFO:teuthology.orchestra.run.smithi139.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-18T04:51:12.927 INFO:teuthology.orchestra.run.smithi139.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-18T04:51:12.928 INFO:teuthology.orchestra.run.smithi139.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-18T04:51:12.929 INFO:teuthology.orchestra.run.smithi139.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-18T04:51:12.931 INFO:teuthology.orchestra.run.smithi139.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-18T04:51:12.934 INFO:teuthology.orchestra.run.smithi139.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-18T04:51:12.935 INFO:teuthology.orchestra.run.smithi139.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-18T04:51:12.997 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1229-g56a91dd1-1jammy [5,002 kB] 2024-04-18T04:51:13.044 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-18T04:51:13.100 INFO:teuthology.orchestra.run.smithi139.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-18T04:51:13.113 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1229-g56a91dd1-1jammy [241 kB] 2024-04-18T04:51:13.119 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1229-g56a91dd1-1jammy [130 kB] 2024-04-18T04:51:13.124 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1229-g56a91dd1-1jammy [1,491 kB] 2024-04-18T04:51:13.179 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1229-g56a91dd1-1jammy [6,079 kB] 2024-04-18T04:51:13.406 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1229-g56a91dd1-1jammy [22.3 MB] 2024-04-18T04:51:13.483 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-18T04:51:13.493 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-18T04:51:13.498 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-18T04:51:13.502 INFO:teuthology.orchestra.run.smithi096.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-18T04:51:13.520 INFO:teuthology.orchestra.run.smithi096.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T04:51:13.524 INFO:teuthology.orchestra.run.smithi096.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-18T04:51:13.526 INFO:teuthology.orchestra.run.smithi096.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-18T04:51:13.529 INFO:teuthology.orchestra.run.smithi139.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1229-g56a91dd1-1jammy [3,105 kB] 2024-04-18T04:51:13.540 INFO:teuthology.orchestra.run.smithi139.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-18T04:51:13.550 INFO:teuthology.orchestra.run.smithi139.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-18T04:51:13.555 INFO:teuthology.orchestra.run.smithi139.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-18T04:51:13.559 INFO:teuthology.orchestra.run.smithi139.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-18T04:51:13.568 INFO:teuthology.orchestra.run.smithi096.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-18T04:51:13.577 INFO:teuthology.orchestra.run.smithi139.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T04:51:13.581 INFO:teuthology.orchestra.run.smithi139.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-18T04:51:13.582 INFO:teuthology.orchestra.run.smithi096.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-18T04:51:13.583 INFO:teuthology.orchestra.run.smithi139.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-18T04:51:13.586 INFO:teuthology.orchestra.run.smithi096.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-18T04:51:13.624 INFO:teuthology.orchestra.run.smithi139.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-18T04:51:13.639 INFO:teuthology.orchestra.run.smithi139.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-18T04:51:13.643 INFO:teuthology.orchestra.run.smithi139.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-18T04:51:13.840 INFO:teuthology.orchestra.run.smithi096.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-18T04:51:13.897 INFO:teuthology.orchestra.run.smithi139.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-18T04:51:13.923 INFO:teuthology.orchestra.run.smithi096.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-18T04:51:13.980 INFO:teuthology.orchestra.run.smithi139.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-18T04:51:14.026 INFO:teuthology.orchestra.run.smithi096.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-18T04:51:14.082 INFO:teuthology.orchestra.run.smithi139.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-18T04:51:14.094 INFO:teuthology.orchestra.run.smithi096.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-18T04:51:14.148 INFO:teuthology.orchestra.run.smithi139.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-18T04:51:14.206 INFO:teuthology.orchestra.run.smithi096.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-18T04:51:14.218 INFO:teuthology.orchestra.run.smithi139.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1229-g56a91dd1-1jammy [680 kB] 2024-04-18T04:51:14.266 INFO:teuthology.orchestra.run.smithi139.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-18T04:51:14.323 INFO:teuthology.orchestra.run.smithi139.stdout:Get:42 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1229-g56a91dd1-1jammy [356 kB] 2024-04-18T04:51:14.330 INFO:teuthology.orchestra.run.smithi096.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-18T04:51:14.332 INFO:teuthology.orchestra.run.smithi096.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1229-g56a91dd1-1jammy [14.1 kB] 2024-04-18T04:51:14.332 INFO:teuthology.orchestra.run.smithi096.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-18T04:51:14.332 INFO:teuthology.orchestra.run.smithi096.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1229-g56a91dd1-1jammy [831 kB] 2024-04-18T04:51:14.340 INFO:teuthology.orchestra.run.smithi096.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-18T04:51:14.349 INFO:teuthology.orchestra.run.smithi096.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1229-g56a91dd1-1jammy [2,154 kB] 2024-04-18T04:51:14.352 INFO:teuthology.orchestra.run.smithi096.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-18T04:51:14.353 INFO:teuthology.orchestra.run.smithi139.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-18T04:51:14.372 INFO:teuthology.orchestra.run.smithi139.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-18T04:51:14.383 INFO:teuthology.orchestra.run.smithi139.stdout:Get:45 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1229-g56a91dd1-1jammy [32.8 kB] 2024-04-18T04:51:14.384 INFO:teuthology.orchestra.run.smithi139.stdout:Get:46 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1229-g56a91dd1-1jammy [180 kB] 2024-04-18T04:51:14.385 INFO:teuthology.orchestra.run.smithi096.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1229-g56a91dd1-1jammy [238 kB] 2024-04-18T04:51:14.389 INFO:teuthology.orchestra.run.smithi096.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-18T04:51:14.389 INFO:teuthology.orchestra.run.smithi096.stdout:Get:66 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1229-g56a91dd1-1jammy [144 kB] 2024-04-18T04:51:14.391 INFO:teuthology.orchestra.run.smithi096.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1229-g56a91dd1-1jammy [2,237 kB] 2024-04-18T04:51:14.397 INFO:teuthology.orchestra.run.smithi096.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-18T04:51:14.401 INFO:teuthology.orchestra.run.smithi139.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-18T04:51:14.414 INFO:teuthology.orchestra.run.smithi139.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-18T04:51:14.425 INFO:teuthology.orchestra.run.smithi139.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1229-g56a91dd1-1jammy [63.7 kB] 2024-04-18T04:51:14.427 INFO:teuthology.orchestra.run.smithi139.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1229-g56a91dd1-1jammy [330 kB] 2024-04-18T04:51:14.451 INFO:teuthology.orchestra.run.smithi139.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-18T04:51:14.459 INFO:teuthology.orchestra.run.smithi139.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-18T04:51:14.485 INFO:teuthology.orchestra.run.smithi096.stdout:Get:69 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1229-g56a91dd1-1jammy [8,625 kB] 2024-04-18T04:51:14.492 INFO:teuthology.orchestra.run.smithi139.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1229-g56a91dd1-1jammy [5,891 kB] 2024-04-18T04:51:14.592 INFO:teuthology.orchestra.run.smithi096.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-18T04:51:14.650 INFO:teuthology.orchestra.run.smithi139.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-18T04:51:14.845 INFO:teuthology.orchestra.run.smithi096.stdout:Get:71 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1229-g56a91dd1-1jammy [14.3 kB] 2024-04-18T04:51:14.848 INFO:teuthology.orchestra.run.smithi096.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1229-g56a91dd1-1jammy [42.6 MB] 2024-04-18T04:51:15.211 INFO:teuthology.orchestra.run.smithi139.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1229-g56a91dd1-1jammy [112 kB] 2024-04-18T04:51:15.217 INFO:teuthology.orchestra.run.smithi139.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1229-g56a91dd1-1jammy [441 kB] 2024-04-18T04:51:15.241 INFO:teuthology.orchestra.run.smithi139.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1229-g56a91dd1-1jammy [21.9 MB] 2024-04-18T04:51:15.401 INFO:teuthology.orchestra.run.smithi096.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-18T04:51:15.403 INFO:teuthology.orchestra.run.smithi096.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-18T04:51:15.405 INFO:teuthology.orchestra.run.smithi096.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-18T04:51:15.407 INFO:teuthology.orchestra.run.smithi096.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-18T04:51:15.407 INFO:teuthology.orchestra.run.smithi096.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-18T04:51:15.409 INFO:teuthology.orchestra.run.smithi096.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-18T04:51:15.410 INFO:teuthology.orchestra.run.smithi096.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-18T04:51:15.411 INFO:teuthology.orchestra.run.smithi096.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-18T04:51:15.415 INFO:teuthology.orchestra.run.smithi096.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T04:51:15.464 INFO:teuthology.orchestra.run.smithi139.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-18T04:51:15.466 INFO:teuthology.orchestra.run.smithi139.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-18T04:51:15.469 INFO:teuthology.orchestra.run.smithi139.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-18T04:51:15.471 INFO:teuthology.orchestra.run.smithi139.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-18T04:51:15.472 INFO:teuthology.orchestra.run.smithi139.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-18T04:51:15.474 INFO:teuthology.orchestra.run.smithi139.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-18T04:51:15.475 INFO:teuthology.orchestra.run.smithi139.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-18T04:51:15.476 INFO:teuthology.orchestra.run.smithi139.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-18T04:51:15.481 INFO:teuthology.orchestra.run.smithi139.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T04:51:15.482 INFO:teuthology.orchestra.run.smithi096.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-18T04:51:15.545 INFO:teuthology.orchestra.run.smithi139.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-18T04:51:15.648 INFO:teuthology.orchestra.run.smithi096.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-18T04:51:15.711 INFO:teuthology.orchestra.run.smithi139.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-18T04:51:16.357 INFO:teuthology.orchestra.run.smithi096.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-18T04:51:16.362 INFO:teuthology.orchestra.run.smithi096.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-18T04:51:16.363 INFO:teuthology.orchestra.run.smithi096.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-18T04:51:16.414 INFO:teuthology.orchestra.run.smithi096.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-18T04:51:16.418 INFO:teuthology.orchestra.run.smithi139.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-18T04:51:16.423 INFO:teuthology.orchestra.run.smithi139.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-18T04:51:16.424 INFO:teuthology.orchestra.run.smithi139.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-18T04:51:16.438 INFO:teuthology.orchestra.run.smithi096.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-18T04:51:16.440 INFO:teuthology.orchestra.run.smithi096.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-18T04:51:16.441 INFO:teuthology.orchestra.run.smithi096.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-18T04:51:16.443 INFO:teuthology.orchestra.run.smithi096.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-18T04:51:16.444 INFO:teuthology.orchestra.run.smithi096.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-18T04:51:16.475 INFO:teuthology.orchestra.run.smithi139.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-18T04:51:16.499 INFO:teuthology.orchestra.run.smithi139.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-18T04:51:16.501 INFO:teuthology.orchestra.run.smithi139.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-18T04:51:16.502 INFO:teuthology.orchestra.run.smithi139.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-18T04:51:16.504 INFO:teuthology.orchestra.run.smithi139.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-18T04:51:16.505 INFO:teuthology.orchestra.run.smithi139.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-18T04:51:16.610 INFO:teuthology.orchestra.run.smithi096.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-18T04:51:16.671 INFO:teuthology.orchestra.run.smithi139.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-18T04:51:16.750 INFO:teuthology.orchestra.run.smithi096.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-18T04:51:16.810 INFO:teuthology.orchestra.run.smithi139.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-18T04:51:16.962 INFO:teuthology.orchestra.run.smithi139.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1229-g56a91dd1-1jammy [5,002 kB] 2024-04-18T04:51:17.034 INFO:teuthology.orchestra.run.smithi096.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-18T04:51:17.078 INFO:teuthology.orchestra.run.smithi096.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-18T04:51:17.099 INFO:teuthology.orchestra.run.smithi139.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-18T04:51:17.104 INFO:teuthology.orchestra.run.smithi096.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-18T04:51:17.112 INFO:teuthology.orchestra.run.smithi096.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-18T04:51:17.144 INFO:teuthology.orchestra.run.smithi139.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-18T04:51:17.156 INFO:teuthology.orchestra.run.smithi096.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-18T04:51:17.169 INFO:teuthology.orchestra.run.smithi139.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-18T04:51:17.178 INFO:teuthology.orchestra.run.smithi139.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-18T04:51:17.179 INFO:teuthology.orchestra.run.smithi139.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1229-g56a91dd1-1jammy [241 kB] 2024-04-18T04:51:17.181 INFO:teuthology.orchestra.run.smithi096.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-18T04:51:17.184 INFO:teuthology.orchestra.run.smithi096.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-18T04:51:17.190 INFO:teuthology.orchestra.run.smithi139.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1229-g56a91dd1-1jammy [130 kB] 2024-04-18T04:51:17.198 INFO:teuthology.orchestra.run.smithi139.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1229-g56a91dd1-1jammy [1,491 kB] 2024-04-18T04:51:17.218 INFO:teuthology.orchestra.run.smithi096.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-18T04:51:17.222 INFO:teuthology.orchestra.run.smithi139.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-18T04:51:17.237 INFO:teuthology.orchestra.run.smithi096.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T04:51:17.248 INFO:teuthology.orchestra.run.smithi139.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-18T04:51:17.249 INFO:teuthology.orchestra.run.smithi139.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-18T04:51:17.276 INFO:teuthology.orchestra.run.smithi139.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1229-g56a91dd1-1jammy [6,079 kB] 2024-04-18T04:51:17.284 INFO:teuthology.orchestra.run.smithi139.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-18T04:51:17.302 INFO:teuthology.orchestra.run.smithi139.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T04:51:17.405 INFO:teuthology.orchestra.run.smithi096.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-18T04:51:17.469 INFO:teuthology.orchestra.run.smithi139.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-18T04:51:17.595 INFO:teuthology.orchestra.run.smithi096.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1229-g56a91dd1-1jammy [121 kB] 2024-04-18T04:51:17.597 INFO:teuthology.orchestra.run.smithi096.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.2-1229-g56a91dd1-1jammy [230 kB] 2024-04-18T04:51:17.602 INFO:teuthology.orchestra.run.smithi096.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.2-1229-g56a91dd1-1jammy [34.1 kB] 2024-04-18T04:51:17.603 INFO:teuthology.orchestra.run.smithi096.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.2-1229-g56a91dd1-1jammy [23.5 kB] 2024-04-18T04:51:17.603 INFO:teuthology.orchestra.run.smithi096.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1229-g56a91dd1-1jammy [38.3 kB] 2024-04-18T04:51:17.604 INFO:teuthology.orchestra.run.smithi096.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1229-g56a91dd1-1jammy [11.6 MB] 2024-04-18T04:51:17.612 INFO:teuthology.orchestra.run.smithi139.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1229-g56a91dd1-1jammy [22.3 MB] 2024-04-18T04:51:17.808 INFO:teuthology.orchestra.run.smithi096.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-18T04:51:17.872 INFO:teuthology.orchestra.run.smithi139.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-18T04:51:18.028 INFO:teuthology.orchestra.run.smithi096.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-18T04:51:18.032 INFO:teuthology.orchestra.run.smithi096.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-18T04:51:18.041 INFO:teuthology.orchestra.run.smithi096.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-18T04:51:18.094 INFO:teuthology.orchestra.run.smithi139.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-18T04:51:18.097 INFO:teuthology.orchestra.run.smithi139.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-18T04:51:18.106 INFO:teuthology.orchestra.run.smithi139.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-18T04:51:18.756 INFO:teuthology.orchestra.run.smithi139.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1229-g56a91dd1-1jammy [14.1 kB] 2024-04-18T04:51:18.756 INFO:teuthology.orchestra.run.smithi139.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1229-g56a91dd1-1jammy [831 kB] 2024-04-18T04:51:18.772 INFO:teuthology.orchestra.run.smithi139.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1229-g56a91dd1-1jammy [2,154 kB] 2024-04-18T04:51:18.839 INFO:teuthology.orchestra.run.smithi139.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1229-g56a91dd1-1jammy [238 kB] 2024-04-18T04:51:18.840 INFO:teuthology.orchestra.run.smithi096.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1229-g56a91dd1-1jammy [93.1 kB] 2024-04-18T04:51:18.844 INFO:teuthology.orchestra.run.smithi139.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1229-g56a91dd1-1jammy [144 kB] 2024-04-18T04:51:18.847 INFO:teuthology.orchestra.run.smithi139.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1229-g56a91dd1-1jammy [2,237 kB] 2024-04-18T04:51:18.927 INFO:teuthology.orchestra.run.smithi139.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1229-g56a91dd1-1jammy [8,625 kB] 2024-04-18T04:51:19.237 INFO:teuthology.orchestra.run.smithi139.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1229-g56a91dd1-1jammy [14.3 kB] 2024-04-18T04:51:19.238 INFO:teuthology.orchestra.run.smithi139.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1229-g56a91dd1-1jammy [42.6 MB] 2024-04-18T04:51:19.397 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 163 MB in 8s (21.3 MB/s) 2024-04-18T04:51:19.533 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-18T04:51:19.630 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-18T04:51:19.635 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-18T04:51:19.682 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-18T04:51:20.068 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T04:51:20.098 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-18T04:51:20.135 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T04:51:20.429 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cmd2. 2024-04-18T04:51:20.456 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-18T04:51:20.495 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-18T04:51:20.781 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-18T04:51:20.808 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-18T04:51:20.890 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-18T04:51:20.993 INFO:teuthology.orchestra.run.smithi139.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1229-g56a91dd1-1jammy [121 kB] 2024-04-18T04:51:20.995 INFO:teuthology.orchestra.run.smithi139.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.2-1229-g56a91dd1-1jammy [230 kB] 2024-04-18T04:51:21.000 INFO:teuthology.orchestra.run.smithi139.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.2-1229-g56a91dd1-1jammy [34.1 kB] 2024-04-18T04:51:21.001 INFO:teuthology.orchestra.run.smithi139.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.2-1229-g56a91dd1-1jammy [23.5 kB] 2024-04-18T04:51:21.002 INFO:teuthology.orchestra.run.smithi139.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1229-g56a91dd1-1jammy [38.3 kB] 2024-04-18T04:51:21.003 INFO:teuthology.orchestra.run.smithi139.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1229-g56a91dd1-1jammy [11.6 MB] 2024-04-18T04:51:21.218 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-18T04:51:21.245 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-18T04:51:21.285 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T04:51:21.354 INFO:teuthology.orchestra.run.smithi139.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1229-g56a91dd1-1jammy [93.1 kB] 2024-04-18T04:51:21.630 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T04:51:21.656 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-18T04:51:21.696 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T04:51:21.912 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 163 MB in 10s (16.1 MB/s) 2024-04-18T04:51:21.982 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T04:51:22.009 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-18T04:51:22.040 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T04:51:22.107 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-18T04:51:22.197 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-18T04:51:22.203 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-18T04:51:22.244 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-18T04:51:22.486 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T04:51:22.512 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T04:51:22.530 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T04:51:22.557 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-18T04:51:22.561 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:51:22.597 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T04:51:22.933 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cmd2. 2024-04-18T04:51:22.938 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T04:51:22.960 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-18T04:51:22.965 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T04:51:22.999 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-18T04:51:23.030 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:51:23.328 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-18T04:51:23.333 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T04:51:23.354 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-18T04:51:23.360 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T04:51:23.400 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:51:23.419 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-18T04:51:23.753 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-18T04:51:23.756 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-18T04:51:23.780 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-18T04:51:23.782 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-18T04:51:23.820 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T04:51:23.822 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T04:51:24.139 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librados2. 2024-04-18T04:51:24.166 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../011-librados2_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:24.167 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T04:51:24.194 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-18T04:51:24.205 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librados2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:24.234 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T04:51:24.578 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T04:51:24.606 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-18T04:51:24.608 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librbd1. 2024-04-18T04:51:24.623 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../012-librbd1_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:24.645 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T04:51:24.658 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librbd1 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:25.065 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T04:51:25.077 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T04:51:25.092 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T04:51:25.104 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../013-libcephfs2_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:25.140 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:51:25.144 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:25.430 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rados. 2024-04-18T04:51:25.456 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../014-python3-rados_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:25.496 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rados (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:25.576 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T04:51:25.603 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T04:51:25.651 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:51:25.765 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T04:51:25.781 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:51:25.824 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-argparse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:26.076 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T04:51:26.088 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T04:51:26.091 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../016-python3-cephfs_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:26.114 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T04:51:26.135 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cephfs (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:26.188 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:51:26.446 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T04:51:26.472 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:51:26.512 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-common (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:26.549 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-18T04:51:26.576 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-18T04:51:26.615 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T04:51:26.823 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T04:51:26.850 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-04-18T04:51:26.898 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-18T04:51:26.960 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librados2. 2024-04-18T04:51:26.987 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../011-librados2_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:27.035 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librados2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:27.134 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T04:51:27.149 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../019-python3-rbd_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:27.184 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rbd (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:27.512 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T04:51:27.538 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-18T04:51:27.546 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librbd1. 2024-04-18T04:51:27.573 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../012-librbd1_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:27.578 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T04:51:27.621 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librbd1 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:27.898 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librgw2. 2024-04-18T04:51:27.924 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../021-librgw2_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:27.965 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librgw2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:28.116 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T04:51:28.142 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../013-libcephfs2_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:28.190 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libcephfs2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:28.468 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rados. 2024-04-18T04:51:28.475 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T04:51:28.483 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../014-python3-rados_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:28.501 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../022-python3-rgw_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:28.526 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rados (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:28.542 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rgw (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:28.828 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-18T04:51:28.854 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T04:51:28.855 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-18T04:51:28.881 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:51:28.886 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T04:51:28.921 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-ceph-argparse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:29.156 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T04:51:29.172 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../016-python3-cephfs_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:29.197 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T04:51:29.206 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cephfs (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:29.224 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../024-libradosstriper1_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:29.264 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libradosstriper1 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:29.501 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T04:51:29.527 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:51:29.567 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-ceph-common (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:29.668 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-common. 2024-04-18T04:51:29.694 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../025-ceph-common_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:29.734 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-common (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:29.895 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T04:51:29.922 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-04-18T04:51:29.962 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-18T04:51:30.281 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T04:51:30.308 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../019-python3-rbd_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:30.348 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rbd (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:30.709 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T04:51:30.736 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-18T04:51:30.857 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T04:51:31.063 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librgw2. 2024-04-18T04:51:31.632 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../021-librgw2_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:31.632 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librgw2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:31.632 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-base. 2024-04-18T04:51:31.633 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../026-ceph-base_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:31.633 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-base (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:31.648 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T04:51:31.663 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../022-python3-rgw_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:31.706 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rgw (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:31.810 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-18T04:51:31.837 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-18T04:51:31.877 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-18T04:51:32.050 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-18T04:51:32.077 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-18T04:51:32.116 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T04:51:32.155 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cheroot. 2024-04-18T04:51:32.181 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-18T04:51:32.221 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T04:51:32.411 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T04:51:32.438 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../024-libradosstriper1_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:32.469 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libradosstriper1 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:32.533 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-18T04:51:32.559 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-18T04:51:32.594 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-18T04:51:32.889 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-common. 2024-04-18T04:51:32.893 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-18T04:51:32.916 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../025-ceph-common_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:32.920 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-18T04:51:32.956 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-common (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:32.962 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-18T04:51:33.263 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-18T04:51:33.289 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-18T04:51:33.329 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-18T04:51:33.632 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempora. 2024-04-18T04:51:33.658 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-04-18T04:51:33.699 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-18T04:51:33.968 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-portend. 2024-04-18T04:51:33.994 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-04-18T04:51:34.035 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-18T04:51:34.320 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-base. 2024-04-18T04:51:34.337 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-18T04:51:34.346 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../026-ceph-base_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:34.364 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-18T04:51:34.395 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-base (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:34.404 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-18T04:51:34.724 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T04:51:34.750 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-18T04:51:34.790 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-18T04:51:34.965 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-18T04:51:34.992 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-18T04:51:35.049 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-18T04:51:35.152 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T04:51:35.179 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-04-18T04:51:35.218 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-18T04:51:35.351 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cheroot. 2024-04-18T04:51:35.377 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-18T04:51:35.418 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T04:51:35.530 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T04:51:35.559 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-04-18T04:51:35.704 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-18T04:51:35.730 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-18T04:51:35.738 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-18T04:51:35.771 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-18T04:51:36.049 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T04:51:36.074 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-18T04:51:36.078 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-18T04:51:36.100 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-18T04:51:36.116 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-18T04:51:36.140 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-18T04:51:36.377 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-mako. 2024-04-18T04:51:36.403 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-18T04:51:36.435 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T04:51:36.443 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-18T04:51:36.469 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-18T04:51:36.509 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-18T04:51:36.713 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T04:51:36.739 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T04:51:36.762 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-tempora. 2024-04-18T04:51:36.777 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-04-18T04:51:36.779 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T04:51:36.821 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-18T04:51:37.091 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T04:51:37.098 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-portend. 2024-04-18T04:51:37.117 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-18T04:51:37.124 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-04-18T04:51:37.158 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-18T04:51:37.165 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-18T04:51:37.451 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-18T04:51:37.452 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webob. 2024-04-18T04:51:37.477 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-18T04:51:37.478 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-18T04:51:37.517 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-18T04:51:37.518 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-18T04:51:37.804 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T04:51:37.830 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-18T04:51:37.846 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T04:51:37.870 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-18T04:51:37.872 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-18T04:51:37.916 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T04:51:38.215 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T04:51:38.232 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T04:51:38.242 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-04-18T04:51:38.259 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-18T04:51:38.282 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-18T04:51:38.299 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T04:51:38.602 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-paste. 2024-04-18T04:51:38.618 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T04:51:38.628 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-18T04:51:38.645 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-04-18T04:51:38.668 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T04:51:38.685 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-18T04:51:38.988 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T04:51:38.988 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T04:51:39.014 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-18T04:51:39.014 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-18T04:51:39.054 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-18T04:51:39.055 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T04:51:39.307 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-mako. 2024-04-18T04:51:39.333 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-18T04:51:39.365 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T04:51:39.374 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T04:51:39.400 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-18T04:51:39.449 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-18T04:51:39.643 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T04:51:39.670 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T04:51:39.710 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T04:51:39.752 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T04:51:39.778 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-04-18T04:51:39.818 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-18T04:51:40.129 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T04:51:40.156 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-18T04:51:40.196 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T04:51:40.307 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T04:51:40.333 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-18T04:51:40.388 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-18T04:51:40.559 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-certifi. 2024-04-18T04:51:40.586 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-04-18T04:51:40.625 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-18T04:51:40.665 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-webob. 2024-04-18T04:51:40.691 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-18T04:51:40.732 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-18T04:51:40.945 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-idna. 2024-04-18T04:51:40.971 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2024-04-18T04:51:41.011 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-18T04:51:41.076 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T04:51:41.103 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-18T04:51:41.146 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T04:51:41.323 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-urllib3. 2024-04-18T04:51:41.349 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-18T04:51:41.389 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T04:51:41.454 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T04:51:41.480 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-18T04:51:41.612 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T04:51:41.709 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests. 2024-04-18T04:51:41.735 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-18T04:51:41.775 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T04:51:41.882 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-paste. 2024-04-18T04:51:41.908 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-18T04:51:41.940 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T04:51:42.061 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T04:51:42.077 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-18T04:51:42.111 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T04:51:42.260 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T04:51:42.275 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-18T04:51:42.318 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T04:51:42.422 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T04:51:42.438 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:51:42.481 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:42.621 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T04:51:42.647 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-18T04:51:42.696 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-18T04:51:42.869 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T04:51:42.896 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:42.935 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:42.974 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T04:51:43.000 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-04-18T04:51:43.040 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-18T04:51:43.247 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T04:51:43.273 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2024-04-18T04:51:43.313 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-18T04:51:43.343 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T04:51:43.370 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-18T04:51:43.409 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T04:51:43.652 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T04:51:43.678 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../058-ceph-mgr_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:43.718 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:43.773 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-certifi. 2024-04-18T04:51:43.799 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-04-18T04:51:43.839 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-18T04:51:44.104 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T04:51:44.131 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../059-ceph-mon_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:44.167 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-idna. 2024-04-18T04:51:44.171 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mon (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:44.193 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2024-04-18T04:51:44.233 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-18T04:51:44.528 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-urllib3. 2024-04-18T04:51:44.554 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-18T04:51:44.878 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T04:51:45.517 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T04:51:45.543 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../060-ceph-osd_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:45.583 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-osd (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:45.665 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-requests. 2024-04-18T04:51:45.680 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-18T04:51:45.715 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T04:51:45.984 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T04:51:46.011 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-18T04:51:46.051 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T04:51:46.370 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T04:51:46.394 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:51:46.437 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:46.603 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph. 2024-04-18T04:51:46.630 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../061-ceph_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:46.670 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:46.842 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T04:51:46.868 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:46.908 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:46.989 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T04:51:47.015 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../062-ceph-fuse_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:47.055 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-fuse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:47.219 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T04:51:47.245 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2024-04-18T04:51:47.286 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-18T04:51:47.425 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T04:51:47.452 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../063-ceph-mds_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:47.491 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mds (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:47.614 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T04:51:47.641 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../058-ceph-mgr_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:47.680 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:47.828 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephadm. 2024-04-18T04:51:47.851 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../064-cephadm_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:47.886 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephadm (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:48.025 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T04:51:48.052 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../059-ceph-mon_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:48.083 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mon (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:48.197 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T04:51:48.224 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-18T04:51:48.264 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-18T04:51:48.550 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-18T04:51:48.565 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T04:51:48.599 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T04:51:48.687 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T04:51:48.713 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../060-ceph-osd_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:48.753 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-osd (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:49.596 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-babel. 2024-04-18T04:51:49.612 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T04:51:49.655 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T04:51:49.784 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph. 2024-04-18T04:51:49.799 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../061-ceph_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:49.833 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:49.999 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T04:51:50.026 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-18T04:51:50.066 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T04:51:50.136 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T04:51:50.163 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../062-ceph-fuse_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:50.202 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-fuse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:50.436 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T04:51:50.463 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:51:50.502 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:50.564 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T04:51:50.590 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../063-ceph-mds_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:50.630 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mds (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:50.831 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T04:51:50.857 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-18T04:51:50.897 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-18T04:51:51.042 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package cephadm. 2024-04-18T04:51:51.068 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../064-cephadm_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:51:51.108 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking cephadm (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:51.175 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T04:51:51.202 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-18T04:51:51.233 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-18T04:51:51.378 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T04:51:51.401 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-18T04:51:51.444 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-18T04:51:51.553 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-py. 2024-04-18T04:51:51.580 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-04-18T04:51:51.619 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-18T04:51:51.755 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-18T04:51:51.782 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T04:51:51.813 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T04:51:51.948 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-18T04:51:51.975 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-18T04:51:52.014 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-18T04:51:52.317 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-toml. 2024-04-18T04:51:52.344 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-04-18T04:51:52.383 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-18T04:51:52.686 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T04:51:52.713 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-18T04:51:52.753 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T04:51:52.877 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-babel. 2024-04-18T04:51:52.904 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T04:51:52.943 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T04:51:53.073 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T04:51:53.100 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T04:51:53.140 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T04:51:53.255 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T04:51:53.281 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-18T04:51:53.321 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T04:51:53.442 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-routes. 2024-04-18T04:51:53.469 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-18T04:51:53.509 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T04:51:53.666 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T04:51:53.693 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:51:53.732 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:53.838 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T04:51:53.864 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:51:53.904 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:54.044 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T04:51:54.071 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-18T04:51:54.111 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-18T04:51:54.363 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T04:51:54.390 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-18T04:51:54.421 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-18T04:51:54.724 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-py. 2024-04-18T04:51:54.751 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-04-18T04:51:54.791 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-18T04:51:55.125 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-18T04:51:55.152 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-18T04:51:55.153 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-18T04:51:55.179 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-18T04:51:55.200 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T04:51:55.219 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-18T04:51:55.522 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-toml. 2024-04-18T04:51:55.549 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-04-18T04:51:55.622 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-18T04:51:55.712 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T04:51:55.739 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-18T04:51:55.779 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T04:51:55.908 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T04:51:55.935 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-18T04:51:55.966 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T04:51:56.149 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-18T04:51:56.175 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-18T04:51:56.215 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-18T04:51:56.303 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T04:51:56.330 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T04:51:56.369 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T04:51:56.518 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T04:51:56.545 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-18T04:51:56.584 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T04:51:56.647 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-routes. 2024-04-18T04:51:56.663 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-18T04:51:56.705 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T04:51:57.034 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T04:51:57.061 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:51:57.100 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:57.595 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T04:51:57.623 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:51:57.661 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:51:58.330 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-18T04:51:58.357 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-18T04:51:58.396 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T04:51:58.581 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T04:51:58.609 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-04-18T04:51:58.647 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-18T04:51:58.892 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T04:51:58.919 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-18T04:51:58.933 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T04:51:58.960 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-18T04:51:58.966 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T04:51:59.000 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-18T04:51:59.337 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T04:51:59.337 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-18T04:51:59.363 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-18T04:51:59.364 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-18T04:51:59.403 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T04:51:59.403 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-18T04:51:59.689 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T04:51:59.714 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T04:51:59.716 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-18T04:51:59.741 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-04-18T04:51:59.755 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T04:51:59.781 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-18T04:52:00.068 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T04:52:00.095 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-04-18T04:52:00.134 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-18T04:52:00.413 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T04:52:00.428 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-18T04:52:00.462 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T04:52:00.583 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T04:52:00.610 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:52:00.649 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:00.748 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T04:52:00.776 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-04-18T04:52:00.815 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-18T04:52:01.144 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T04:52:01.171 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-18T04:52:01.210 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T04:52:01.527 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T04:52:01.554 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-04-18T04:52:01.585 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-18T04:52:01.840 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T04:52:01.855 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T04:52:01.856 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:52:01.882 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-18T04:52:01.898 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:01.921 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-18T04:52:02.185 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T04:52:02.212 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-18T04:52:02.251 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T04:52:02.283 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T04:52:02.310 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-18T04:52:02.349 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T04:52:02.587 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T04:52:02.615 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T04:52:02.654 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T04:52:02.669 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T04:52:02.696 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-04-18T04:52:02.735 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-18T04:52:02.915 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package jq. 2024-04-18T04:52:02.931 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T04:52:02.973 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-18T04:52:03.097 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T04:52:03.125 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-04-18T04:52:03.164 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-18T04:52:03.225 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package socat. 2024-04-18T04:52:03.241 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-18T04:52:03.275 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-18T04:52:03.458 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T04:52:03.486 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-18T04:52:03.517 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T04:52:03.562 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T04:52:03.577 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-18T04:52:03.612 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-18T04:52:03.803 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T04:52:03.830 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-04-18T04:52:03.869 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-18T04:52:03.949 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-test. 2024-04-18T04:52:03.965 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../098-ceph-test_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:52:03.999 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-test (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:04.197 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T04:52:04.225 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-18T04:52:04.264 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T04:52:04.938 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T04:52:04.952 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:52:04.994 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:05.280 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T04:52:05.307 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-18T04:52:05.338 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T04:52:05.683 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T04:52:05.711 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T04:52:05.749 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T04:52:05.862 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T04:52:05.889 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../099-ceph-volume_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:52:05.928 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-volume (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:06.010 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package jq. 2024-04-18T04:52:06.026 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T04:52:06.068 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-18T04:52:06.299 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-18T04:52:06.326 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:52:06.365 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephfs-mirror (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:06.429 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package socat. 2024-04-18T04:52:06.456 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-18T04:52:06.496 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-18T04:52:06.677 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-colorama. 2024-04-18T04:52:06.704 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-04-18T04:52:06.743 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-18T04:52:06.791 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T04:52:06.806 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-18T04:52:06.841 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-18T04:52:06.987 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephfs-shell. 2024-04-18T04:52:07.003 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../102-cephfs-shell_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:52:07.045 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephfs-shell (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:07.220 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-test. 2024-04-18T04:52:07.247 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../098-ceph-test_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:52:07.286 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-test (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:07.290 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephfs-top. 2024-04-18T04:52:07.306 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../103-cephfs-top_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:52:07.340 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephfs-top (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:07.559 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T04:52:07.576 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:52:07.617 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs-dev (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:07.987 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T04:52:08.014 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-18T04:52:08.053 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T04:52:08.383 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T04:52:08.399 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-18T04:52:08.441 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-18T04:52:08.853 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T04:52:08.880 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T04:52:08.919 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T04:52:09.256 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T04:52:09.265 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T04:52:09.283 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-18T04:52:09.293 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../099-ceph-volume_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:52:09.322 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-18T04:52:09.348 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-volume (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:09.625 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pygments. 2024-04-18T04:52:09.654 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-18T04:52:09.691 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T04:52:09.786 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-18T04:52:09.814 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:52:09.861 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking cephfs-mirror (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:10.163 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T04:52:10.172 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-colorama. 2024-04-18T04:52:10.190 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-18T04:52:10.199 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-04-18T04:52:10.229 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-18T04:52:10.238 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-18T04:52:10.524 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package cephfs-shell. 2024-04-18T04:52:10.531 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T04:52:10.552 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../102-cephfs-shell_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:52:10.559 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-18T04:52:10.598 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-18T04:52:10.599 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking cephfs-shell (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:10.867 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T04:52:10.886 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-18T04:52:10.927 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package cephfs-top. 2024-04-18T04:52:10.933 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-18T04:52:10.954 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../103-cephfs-top_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:52:11.276 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking cephfs-top (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:11.513 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T04:52:11.540 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:52:11.571 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libcephfs-dev (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:11.663 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package radosgw. 2024-04-18T04:52:11.690 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../113-radosgw_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:52:11.729 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking radosgw (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:11.907 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T04:52:11.934 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-18T04:52:11.973 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T04:52:12.303 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T04:52:12.331 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-18T04:52:12.361 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-18T04:52:12.690 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T04:52:12.718 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../114-rbd-fuse_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:52:12.756 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking rbd-fuse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:12.764 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T04:52:12.792 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T04:52:12.830 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T04:52:13.044 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-18T04:52:13.142 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T04:52:13.170 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-18T04:52:13.200 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-18T04:52:13.294 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T04:52:13.421 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T04:52:13.528 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pygments. 2024-04-18T04:52:13.546 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-18T04:52:13.578 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T04:52:13.680 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-18T04:52:13.982 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T04:52:13.998 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-18T04:52:14.005 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-18T04:52:14.040 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-18T04:52:14.362 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T04:52:14.387 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-18T04:52:14.411 INFO:teuthology.orchestra.run.smithi096.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-18T04:52:14.426 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-18T04:52:14.489 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephadm (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:14.695 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T04:52:14.722 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-18T04:52:14.761 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-18T04:52:14.997 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user cephadm....done 2024-04-18T04:52:15.145 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T04:52:15.446 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-18T04:52:15.540 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package radosgw. 2024-04-18T04:52:15.568 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../113-radosgw_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:52:15.607 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking radosgw (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:15.697 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-18T04:52:15.823 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-18T04:52:16.091 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T04:52:16.326 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T04:52:16.342 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../114-rbd-fuse_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:52:16.351 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T04:52:16.376 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking rbd-fuse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:16.477 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-18T04:52:16.655 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-18T04:52:16.812 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T04:52:16.914 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T04:52:17.040 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T04:52:17.172 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-18T04:52:17.301 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-18T04:52:17.431 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-18T04:52:17.664 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-18T04:52:17.682 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-18T04:52:17.925 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-18T04:52:18.120 INFO:teuthology.orchestra.run.smithi139.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-18T04:52:18.176 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-18T04:52:18.183 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up cephadm (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:18.453 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-18T04:52:18.674 INFO:teuthology.orchestra.run.smithi139.stdout:Adding system user cephadm....done 2024-04-18T04:52:18.712 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-argparse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:18.797 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T04:52:18.988 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T04:52:19.065 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-18T04:52:19.114 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-18T04:52:19.316 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-18T04:52:19.373 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-18T04:52:19.467 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-18T04:52:19.616 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T04:52:19.710 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T04:52:19.750 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-18T04:52:19.961 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T04:52:20.087 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-18T04:52:20.110 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T04:52:20.236 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-18T04:52:20.380 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T04:52:20.503 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T04:52:20.741 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-18T04:52:20.771 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-18T04:52:21.000 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-18T04:52:21.072 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T04:52:21.243 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-18T04:52:21.519 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-18T04:52:21.749 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T04:52:21.769 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-18T04:52:22.008 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T04:52:22.046 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-18T04:52:22.134 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-18T04:52:22.252 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T04:52:22.305 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-ceph-argparse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:22.536 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-18T04:52:22.548 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T04:52:22.682 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-18T04:52:22.950 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-18T04:52:22.963 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-18T04:52:23.213 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T04:52:23.217 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T04:52:23.327 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-18T04:52:23.591 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T04:52:23.678 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T04:52:23.804 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-18T04:52:23.875 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-18T04:52:24.063 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T04:52:24.167 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T04:52:24.314 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-18T04:52:24.494 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-18T04:52:24.618 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T04:52:24.745 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-18T04:52:24.871 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-common (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:25.172 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-idna (3.3-1) ... 2024-04-18T04:52:25.300 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T04:52:25.490 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T04:52:25.543 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T04:52:25.652 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-18T04:52:25.778 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T04:52:26.088 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-18T04:52:26.497 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-18T04:52:26.620 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:52:26.754 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-18T04:52:26.756 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T04:52:27.022 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T04:52:27.133 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T04:52:27.148 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-18T04:52:27.276 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T04:52:27.409 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-18T04:52:27.561 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-18T04:52:27.710 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T04:52:27.829 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-18T04:52:28.045 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-18T04:52:28.255 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:52:28.279 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-18T04:52:28.397 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-18T04:52:28.405 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-ceph-common (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:28.515 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-18T04:52:28.706 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-idna (3.3-1) ... 2024-04-18T04:52:28.808 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-18T04:52:29.032 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T04:52:29.060 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-18T04:52:29.302 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-18T04:52:29.554 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T04:52:29.804 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-18T04:52:30.072 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T04:52:30.190 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-18T04:52:30.246 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:52:30.355 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-18T04:52:30.474 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T04:52:30.609 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T04:52:30.617 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T04:52:30.742 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-18T04:52:30.868 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T04:52:30.885 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-18T04:52:31.161 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-18T04:52:31.194 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-18T04:52:31.413 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-18T04:52:31.446 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T04:52:31.647 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:52:31.823 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-18T04:52:31.902 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-18T04:52:31.949 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-18T04:52:32.249 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T04:52:32.275 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-18T04:52:32.358 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T04:52:32.551 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-18T04:52:32.760 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-18T04:52:32.827 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-18T04:52:33.019 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-18T04:52:33.120 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T04:52:33.270 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:52:33.371 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-18T04:52:33.396 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T04:52:33.622 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T04:52:33.714 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T04:52:33.748 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-18T04:52:34.015 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T04:52:34.032 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T04:52:34.166 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T04:52:34.283 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-18T04:52:34.418 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-18T04:52:34.459 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-18T04:52:34.694 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-18T04:52:34.752 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-18T04:52:34.961 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T04:52:35.011 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T04:52:35.221 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-18T04:52:35.398 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-18T04:52:35.606 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T04:52:35.664 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T04:52:35.806 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T04:52:35.882 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T04:52:36.200 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-18T04:52:36.243 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T04:52:36.369 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librados2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:36.467 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-18T04:52:36.495 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librgw2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:36.706 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:36.726 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:52:36.807 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:36.852 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T04:52:36.934 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libradosstriper1 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:37.068 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-18T04:52:37.187 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T04:52:37.353 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librbd1 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:37.471 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T04:52:37.479 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-modules-core (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:37.606 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-fuse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:37.722 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-18T04:52:37.816 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T04:52:37.817 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T04:52:37.848 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-18T04:52:38.115 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-18T04:52:38.265 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs-dev (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:38.374 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rados (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:38.383 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T04:52:38.501 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephfs-top (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:38.626 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-18T04:52:38.627 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T04:52:39.011 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T04:52:39.312 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T04:52:39.639 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T04:52:39.790 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librados2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:39.857 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rbd (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:39.958 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librgw2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:39.974 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up rbd-fuse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:40.100 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rgw (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:40.194 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:40.218 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cephfs (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:40.344 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephfs-shell (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:40.345 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libcephfs2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:40.470 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-common (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:40.496 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libradosstriper1 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:40.647 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-18T04:52:40.957 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librbd1 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:41.013 INFO:teuthology.orchestra.run.smithi096.stdout:Adding group ceph....done 2024-04-18T04:52:41.092 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-modules-core (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:41.217 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-fuse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:41.374 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user ceph....done 2024-04-18T04:52:41.430 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T04:52:41.430 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T04:52:41.542 INFO:teuthology.orchestra.run.smithi096.stdout:Setting system user ceph properties....done 2024-04-18T04:52:41.556 INFO:teuthology.orchestra.run.smithi096.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T04:52:41.688 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T04:52:41.975 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T04:52:42.027 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libcephfs-dev (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:42.170 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rados (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:42.321 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up cephfs-top (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:42.397 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephfs-mirror (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:42.472 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T04:52:42.604 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-18T04:52:42.604 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-18T04:52:43.057 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-test (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:43.183 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up radosgw (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:43.632 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T04:52:43.632 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T04:52:43.701 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rbd (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:43.827 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up rbd-fuse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:43.936 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rgw (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:44.062 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cephfs (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:44.068 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-base (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:44.163 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up cephfs-shell (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:44.306 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-common (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:44.391 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T04:52:44.830 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mds (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:44.857 INFO:teuthology.orchestra.run.smithi139.stdout:Adding group ceph....done 2024-04-18T04:52:45.163 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T04:52:45.163 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T04:52:45.334 INFO:teuthology.orchestra.run.smithi139.stdout:Adding system user ceph....done 2024-04-18T04:52:45.485 INFO:teuthology.orchestra.run.smithi139.stdout:Setting system user ceph properties....done 2024-04-18T04:52:45.498 INFO:teuthology.orchestra.run.smithi139.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T04:52:45.634 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T04:52:45.640 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:45.850 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T04:52:45.850 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T04:52:45.982 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T04:52:46.300 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-osd (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:46.490 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up cephfs-mirror (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:46.576 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T04:52:46.576 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T04:52:46.719 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-18T04:52:46.719 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-18T04:52:47.002 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:47.128 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:47.216 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-test (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:47.271 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mon (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:47.367 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up radosgw (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:47.480 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T04:52:47.480 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T04:52:47.866 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T04:52:47.866 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T04:52:47.955 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-cephadm (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:48.106 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:48.232 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-dashboard (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:48.369 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-base (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:48.392 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-volume (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:48.787 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T04:52:48.956 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T04:52:49.347 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mds (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:49.594 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T04:52:49.594 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T04:52:49.690 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T04:52:50.081 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T04:52:50.149 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-18T04:52:50.209 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-18T04:52:50.324 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T04:52:50.324 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T04:52:50.409 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-18T04:52:50.409 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-18T04:52:50.593 INFO:teuthology.orchestra.run.smithi096.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-18T04:52:50.593 INFO:teuthology.orchestra.run.smithi096.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-18T04:52:50.594 INFO:teuthology.orchestra.run.smithi096.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-18T04:52:50.594 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T04:52:50.594 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T04:52:50.594 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T04:52:50.594 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T04:52:50.594 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T04:52:50.595 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T04:52:50.595 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T04:52:50.595 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-04-18T04:52:50.595 INFO:teuthology.orchestra.run.smithi096.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-18T04:52:50.595 INFO:teuthology.orchestra.run.smithi096.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-18T04:52:50.596 INFO:teuthology.orchestra.run.smithi096.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-18T04:52:50.596 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-18T04:52:50.596 INFO:teuthology.orchestra.run.smithi096.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-18T04:52:50.597 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-04-18T04:52:50.597 INFO:teuthology.orchestra.run.smithi096.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-18T04:52:50.597 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-18T04:52:50.597 INFO:teuthology.orchestra.run.smithi096.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-18T04:52:50.636 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-04-18T04:52:50.637 INFO:teuthology.orchestra.run.smithi096.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-18T04:52:50.637 INFO:teuthology.orchestra.run.smithi096.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-18T04:52:50.637 INFO:teuthology.orchestra.run.smithi096.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-18T04:52:50.637 INFO:teuthology.orchestra.run.smithi096.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-18T04:52:50.637 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-18T04:52:50.637 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-18T04:52:50.637 INFO:teuthology.orchestra.run.smithi096.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-18T04:52:50.638 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2024-04-18T04:52:50.638 INFO:teuthology.orchestra.run.smithi096.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-18T04:52:50.696 INFO:teuthology.orchestra.run.smithi096.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-18T04:52:50.696 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 55.7 MB of archives. 2024-04-18T04:52:50.696 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-18T04:52:50.696 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-18T04:52:50.799 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-osd (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:50.857 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-18T04:52:50.866 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-18T04:52:50.908 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-18T04:52:50.909 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-18T04:52:50.910 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-18T04:52:50.920 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-18T04:52:50.921 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-18T04:52:50.923 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-18T04:52:50.924 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-18T04:52:50.924 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-18T04:52:50.926 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-18T04:52:50.930 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-18T04:52:50.948 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-18T04:52:50.949 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-18T04:52:50.950 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-18T04:52:51.069 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T04:52:51.069 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T04:52:51.248 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-18T04:52:51.250 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-18T04:52:51.307 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-18T04:52:51.310 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-18T04:52:51.310 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-18T04:52:51.314 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-18T04:52:51.315 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-18T04:52:51.322 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-18T04:52:51.322 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-18T04:52:51.344 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-18T04:52:51.344 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-18T04:52:51.354 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-18T04:52:51.373 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-18T04:52:51.376 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-18T04:52:51.377 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-18T04:52:51.377 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-18T04:52:51.378 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-18T04:52:51.388 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-18T04:52:51.390 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-18T04:52:51.560 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:51.611 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-18T04:52:51.611 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-18T04:52:51.612 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-18T04:52:51.612 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-18T04:52:51.612 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-18T04:52:51.612 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-18T04:52:51.624 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-18T04:52:51.624 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-18T04:52:51.702 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:51.878 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mon (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:52.021 INFO:teuthology.orchestra.run.smithi096.stdout:Preconfiguring packages ... 2024-04-18T04:52:52.107 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T04:52:52.107 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T04:52:52.166 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 55.7 MB in 1s (56.9 MB/s) 2024-04-18T04:52:52.486 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173236 files and directories currently installed.) 2024-04-18T04:52:52.491 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T04:52:52.605 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-cephadm (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:52.647 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T04:52:52.756 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:52.890 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-dashboard (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:53.066 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-volume (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:52:53.285 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-18T04:52:53.461 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T04:52:54.267 INFO:teuthology.orchestra.run.smithi096.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-18T04:52:54.513 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package flex. 2024-04-18T04:52:54.595 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T04:52:54.603 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173236 files and directories currently installed.) 2024-04-18T04:52:54.609 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-18T04:52:54.653 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-18T04:52:55.104 INFO:teuthology.orchestra.run.smithi139.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T04:52:55.107 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-18T04:52:55.160 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T04:52:55.161 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-04-18T04:52:55.348 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2024-04-18T04:52:55.349 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2024-04-18T04:52:55.351 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-18T04:52:55.519 INFO:teuthology.orchestra.run.smithi139.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-18T04:52:55.519 INFO:teuthology.orchestra.run.smithi139.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-18T04:52:55.519 INFO:teuthology.orchestra.run.smithi139.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-18T04:52:55.519 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T04:52:55.519 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T04:52:55.519 INFO:teuthology.orchestra.run.smithi139.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T04:52:55.519 INFO:teuthology.orchestra.run.smithi139.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T04:52:55.519 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T04:52:55.520 INFO:teuthology.orchestra.run.smithi139.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T04:52:55.520 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T04:52:55.520 INFO:teuthology.orchestra.run.smithi139.stdout:The following additional packages will be installed: 2024-04-18T04:52:55.520 INFO:teuthology.orchestra.run.smithi139.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-18T04:52:55.520 INFO:teuthology.orchestra.run.smithi139.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-18T04:52:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-18T04:52:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-18T04:52:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-18T04:52:55.522 INFO:teuthology.orchestra.run.smithi139.stdout:Suggested packages: 2024-04-18T04:52:55.522 INFO:teuthology.orchestra.run.smithi139.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-18T04:52:55.522 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-18T04:52:55.522 INFO:teuthology.orchestra.run.smithi139.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-18T04:52:55.561 INFO:teuthology.orchestra.run.smithi139.stdout:The following NEW packages will be installed: 2024-04-18T04:52:55.562 INFO:teuthology.orchestra.run.smithi139.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-18T04:52:55.562 INFO:teuthology.orchestra.run.smithi139.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-18T04:52:55.563 INFO:teuthology.orchestra.run.smithi139.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-18T04:52:55.563 INFO:teuthology.orchestra.run.smithi139.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-18T04:52:55.563 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-18T04:52:55.563 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-18T04:52:55.563 INFO:teuthology.orchestra.run.smithi139.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-18T04:52:55.564 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages will be upgraded: 2024-04-18T04:52:55.564 INFO:teuthology.orchestra.run.smithi139.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-18T04:52:55.745 INFO:teuthology.orchestra.run.smithi139.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-18T04:52:55.745 INFO:teuthology.orchestra.run.smithi139.stdout:Need to get 55.7 MB of archives. 2024-04-18T04:52:55.745 INFO:teuthology.orchestra.run.smithi139.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-18T04:52:55.745 INFO:teuthology.orchestra.run.smithi139.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-18T04:52:55.752 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T04:52:56.249 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173309 files and directories currently installed.) 2024-04-18T04:52:56.254 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T04:52:56.379 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-18T04:52:56.383 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T04:52:56.395 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-18T04:52:56.522 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-18T04:52:56.523 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-18T04:52:56.524 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-18T04:52:56.552 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-18T04:52:56.553 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-18T04:52:56.557 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-18T04:52:56.559 INFO:teuthology.orchestra.run.smithi139.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-18T04:52:56.561 INFO:teuthology.orchestra.run.smithi139.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-18T04:52:56.728 INFO:teuthology.orchestra.run.smithi139.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-18T04:52:56.767 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T04:52:56.890 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T04:52:57.011 INFO:teuthology.orchestra.run.smithi139.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-18T04:52:57.021 INFO:teuthology.orchestra.run.smithi139.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-18T04:52:57.026 INFO:teuthology.orchestra.run.smithi139.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-18T04:52:57.109 INFO:teuthology.orchestra.run.smithi139.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-18T04:52:57.217 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T04:52:57.592 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package bison. 2024-04-18T04:52:57.695 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173309 files and directories currently installed.) 2024-04-18T04:52:57.701 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-18T04:52:57.744 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T04:52:58.136 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-18T04:52:58.164 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-18T04:52:58.177 INFO:teuthology.orchestra.run.smithi139.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-18T04:52:58.181 INFO:teuthology.orchestra.run.smithi139.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-18T04:52:58.182 INFO:teuthology.orchestra.run.smithi139.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-18T04:52:58.188 INFO:teuthology.orchestra.run.smithi139.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-18T04:52:58.189 INFO:teuthology.orchestra.run.smithi139.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-18T04:52:58.199 INFO:teuthology.orchestra.run.smithi139.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-18T04:52:58.203 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-18T04:52:58.367 INFO:teuthology.orchestra.run.smithi139.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-18T04:52:58.698 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package dump. 2024-04-18T04:52:58.725 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-18T04:52:58.756 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking dump (0.4b47-3) ... 2024-04-18T04:52:58.963 INFO:teuthology.orchestra.run.smithi139.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-18T04:52:58.963 INFO:teuthology.orchestra.run.smithi139.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-18T04:52:59.035 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package indent. 2024-04-18T04:52:59.051 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:52:59.093 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-18T04:52:59.144 INFO:teuthology.orchestra.run.smithi139.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-18T04:52:59.145 INFO:teuthology.orchestra.run.smithi139.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-18T04:52:59.183 INFO:teuthology.orchestra.run.smithi139.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-18T04:52:59.245 INFO:teuthology.orchestra.run.smithi139.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-18T04:52:59.252 INFO:teuthology.orchestra.run.smithi139.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-18T04:52:59.253 INFO:teuthology.orchestra.run.smithi139.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-18T04:52:59.254 INFO:teuthology.orchestra.run.smithi139.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-18T04:52:59.255 INFO:teuthology.orchestra.run.smithi139.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-18T04:52:59.346 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-18T04:52:59.362 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-18T04:52:59.404 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T04:52:59.461 INFO:teuthology.orchestra.run.smithi139.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-18T04:52:59.725 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-18T04:52:59.755 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-18T04:52:59.792 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-18T04:52:59.871 INFO:teuthology.orchestra.run.smithi139.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-18T04:53:00.045 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-18T04:53:00.060 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-18T04:53:00.103 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T04:53:00.440 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-18T04:53:00.467 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-18T04:53:00.506 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T04:53:00.685 INFO:teuthology.orchestra.run.smithi139.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-18T04:53:00.685 INFO:teuthology.orchestra.run.smithi139.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-18T04:53:00.686 INFO:teuthology.orchestra.run.smithi139.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-18T04:53:00.686 INFO:teuthology.orchestra.run.smithi139.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-18T04:53:00.686 INFO:teuthology.orchestra.run.smithi139.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-18T04:53:00.686 INFO:teuthology.orchestra.run.smithi139.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-18T04:53:00.710 INFO:teuthology.orchestra.run.smithi139.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-18T04:53:00.710 INFO:teuthology.orchestra.run.smithi139.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-18T04:53:00.726 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-18T04:53:00.742 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-18T04:53:00.776 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T04:53:01.029 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjson-perl. 2024-04-18T04:53:01.045 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-18T04:53:01.087 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-18T04:53:01.115 INFO:teuthology.orchestra.run.smithi139.stdout:Preconfiguring packages ... 2024-04-18T04:53:01.274 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 55.7 MB in 5s (10.8 MB/s) 2024-04-18T04:53:01.357 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-18T04:53:01.373 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-18T04:53:01.415 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-18T04:53:01.651 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173236 files and directories currently installed.) 2024-04-18T04:53:01.657 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T04:53:01.836 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T04:53:02.422 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-18T04:53:03.085 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-18T04:53:03.113 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T04:53:03.151 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-18T04:53:03.412 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-18T04:53:03.429 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T04:53:03.429 INFO:teuthology.orchestra.run.smithi139.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-18T04:53:03.471 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-18T04:53:03.691 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package flex. 2024-04-18T04:53:03.794 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173236 files and directories currently installed.) 2024-04-18T04:53:03.799 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-18T04:53:03.824 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-18T04:53:03.839 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-18T04:53:03.852 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-18T04:53:03.882 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-18T04:53:04.227 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-18T04:53:04.255 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-18T04:53:04.293 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-18T04:53:04.380 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T04:53:04.586 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-18T04:53:04.621 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-18T04:53:04.649 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-18T04:53:04.696 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-18T04:53:05.013 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T04:53:05.016 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-18T04:53:05.044 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:53:05.074 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:53:05.411 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-18T04:53:05.439 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:53:05.477 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-18T04:53:05.583 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173309 files and directories currently installed.) 2024-04-18T04:53:05.588 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T04:53:05.743 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T04:53:05.772 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-18T04:53:05.788 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:53:05.830 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-18T04:53:06.074 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-18T04:53:06.091 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T04:53:06.124 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T04:53:06.211 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T04:53:06.366 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T04:53:06.620 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-18T04:53:06.648 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-18T04:53:06.720 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-18T04:53:06.734 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T04:53:07.073 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package modemmanager. 2024-04-18T04:53:07.101 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-18T04:53:07.139 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-18T04:53:07.142 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package bison. 2024-04-18T04:53:07.246 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173309 files and directories currently installed.) 2024-04-18T04:53:07.252 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-18T04:53:07.310 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T04:53:07.745 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-18T04:53:07.747 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package network-manager. 2024-04-18T04:53:07.773 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-18T04:53:07.775 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-18T04:53:07.811 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-18T04:53:07.821 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-18T04:53:08.173 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package dump. 2024-04-18T04:53:08.201 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-18T04:53:08.231 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking dump (0.4b47-3) ... 2024-04-18T04:53:08.421 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ppp. 2024-04-18T04:53:08.449 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-18T04:53:08.526 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package indent. 2024-04-18T04:53:08.542 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:53:08.601 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-18T04:53:08.730 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-18T04:53:08.870 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-18T04:53:08.898 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-18T04:53:08.937 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T04:53:09.036 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package pptp-linux. 2024-04-18T04:53:09.064 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-18T04:53:09.103 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-18T04:53:09.249 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-18T04:53:09.277 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-18T04:53:09.316 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-18T04:53:09.347 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-18T04:53:09.363 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-18T04:53:09.397 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-18T04:53:09.585 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-18T04:53:09.601 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-18T04:53:09.643 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T04:53:09.667 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-18T04:53:09.694 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-18T04:53:09.734 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking postgresql-client-common (238) ... 2024-04-18T04:53:09.947 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-18T04:53:09.974 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-18T04:53:10.005 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T04:53:10.055 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-18T04:53:10.082 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:53:10.121 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:53:10.232 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-18T04:53:10.248 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-18T04:53:10.293 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T04:53:10.543 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libjson-perl. 2024-04-18T04:53:10.571 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-18T04:53:10.610 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-18T04:53:10.726 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package postgresql-common. 2024-04-18T04:53:10.754 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-18T04:53:10.811 INFO:teuthology.orchestra.run.smithi096.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-18T04:53:10.833 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking postgresql-common (238) ... 2024-04-18T04:53:10.930 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-18T04:53:10.957 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-18T04:53:10.996 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-18T04:53:11.250 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package postgresql-14. 2024-04-18T04:53:11.278 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:53:11.311 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:53:12.671 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package postgresql. 2024-04-18T04:53:12.688 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-18T04:53:12.721 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-18T04:53:12.729 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking postgresql (14+238) ... 2024-04-18T04:53:12.750 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T04:53:12.956 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package postgresql-client. 2024-04-18T04:53:12.984 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-18T04:53:13.023 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking postgresql-client (14+238) ... 2024-04-18T04:53:13.038 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-18T04:53:13.275 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-18T04:53:13.299 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-18T04:53:13.342 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-18T04:53:13.519 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-18T04:53:13.535 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T04:53:13.577 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-18T04:53:13.669 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package tcl8.6. 2024-04-18T04:53:13.697 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-18T04:53:13.736 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-18T04:53:13.905 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-18T04:53:13.932 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-18T04:53:13.974 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-18T04:53:14.005 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package tcl. 2024-04-18T04:53:14.022 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-18T04:53:14.060 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-18T04:53:14.283 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-18T04:53:14.310 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-18T04:53:14.341 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-18T04:53:14.425 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package wpasupplicant. 2024-04-18T04:53:14.453 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-18T04:53:14.492 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-18T04:53:14.652 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-18T04:53:14.680 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-18T04:53:14.719 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-18T04:53:14.838 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-18T04:53:14.854 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-18T04:53:14.904 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-18T04:53:15.072 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-18T04:53:15.099 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:53:15.138 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:53:15.291 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-18T04:53:15.319 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-18T04:53:15.358 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-18T04:53:15.483 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-18T04:53:15.510 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:53:15.549 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-18T04:53:15.636 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up postgresql-client-common (238) ... 2024-04-18T04:53:15.819 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-18T04:53:15.834 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:53:15.847 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-18T04:53:15.877 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-18T04:53:15.973 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-18T04:53:16.099 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:53:16.121 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-18T04:53:16.136 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T04:53:16.179 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T04:53:16.217 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-18T04:53:16.318 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T04:53:16.445 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:53:16.791 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-18T04:53:16.818 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-18T04:53:16.857 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-18T04:53:16.959 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-18T04:53:17.034 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-18T04:53:17.160 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package modemmanager. 2024-04-18T04:53:17.188 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-18T04:53:17.218 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-18T04:53:17.397 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-18T04:53:17.398 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-18T04:53:17.851 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package network-manager. 2024-04-18T04:53:17.870 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T04:53:17.879 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-18T04:53:17.925 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-18T04:53:17.996 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-18T04:53:18.122 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T04:53:18.273 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-18T04:53:18.399 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T04:53:18.517 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T04:53:18.634 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-18T04:53:18.685 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ppp. 2024-04-18T04:53:18.712 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-18T04:53:18.744 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-18T04:53:18.981 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-18T04:53:19.272 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package pptp-linux. 2024-04-18T04:53:19.297 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-18T04:53:19.339 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-18T04:53:19.391 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-18T04:53:19.509 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up dump (0.4b47-3) ... 2024-04-18T04:53:19.594 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-18T04:53:19.610 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-18T04:53:19.627 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-18T04:53:19.652 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-18T04:53:19.669 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-18T04:53:19.904 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-18T04:53:19.930 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-18T04:53:19.958 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-18T04:53:19.988 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking postgresql-client-common (238) ... 2024-04-18T04:53:20.220 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-18T04:53:20.292 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-18T04:53:20.308 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:53:20.350 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:53:20.897 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package postgresql-common. 2024-04-18T04:53:20.926 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-18T04:53:20.983 INFO:teuthology.orchestra.run.smithi139.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-18T04:53:20.998 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-18T04:53:21.019 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking postgresql-common (238) ... 2024-04-18T04:53:21.124 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T04:53:21.214 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-18T04:53:21.284 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-18T04:53:21.393 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-18T04:53:21.504 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package postgresql-14. 2024-04-18T04:53:21.532 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:53:21.553 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-18T04:53:21.582 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:53:21.687 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-18T04:53:21.813 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-18T04:53:21.981 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up postgresql-client (14+238) ... 2024-04-18T04:53:22.124 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-18T04:53:22.599 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:22.599 INFO:teuthology.orchestra.run.smithi096.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-18T04:53:22.599 INFO:teuthology.orchestra.run.smithi096.stdout:which means they are currently configured by ifupdown: 2024-04-18T04:53:22.599 INFO:teuthology.orchestra.run.smithi096.stdout:- enp3s0f1 2024-04-18T04:53:22.599 INFO:teuthology.orchestra.run.smithi096.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-18T04:53:22.600 INFO:teuthology.orchestra.run.smithi096.stdout:remove their configuration from /etc/network/interfaces. 2024-04-18T04:53:22.600 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:22.721 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-18T04:53:22.890 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package postgresql. 2024-04-18T04:53:22.907 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-18T04:53:22.948 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking postgresql (14+238) ... 2024-04-18T04:53:23.038 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-18T04:53:23.167 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package postgresql-client. 2024-04-18T04:53:23.183 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-18T04:53:23.216 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking postgresql-client (14+238) ... 2024-04-18T04:53:23.345 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-18T04:53:23.452 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-18T04:53:23.469 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-18T04:53:23.511 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-18T04:53:23.830 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package tcl8.6. 2024-04-18T04:53:23.835 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-18T04:53:23.858 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-18T04:53:23.896 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-18T04:53:23.978 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T04:53:24.104 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-18T04:53:24.191 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package tcl. 2024-04-18T04:53:24.219 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-18T04:53:24.230 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up postgresql-common (238) ... 2024-04-18T04:53:24.262 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-18T04:53:24.568 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package wpasupplicant. 2024-04-18T04:53:24.585 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-18T04:53:24.618 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-18T04:53:24.956 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-18T04:53:24.972 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-18T04:53:25.014 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-18T04:53:25.126 INFO:teuthology.orchestra.run.smithi096.stdout:Adding user postgres to group ssl-cert 2024-04-18T04:53:25.351 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:25.352 INFO:teuthology.orchestra.run.smithi096.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-18T04:53:25.375 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-18T04:53:25.404 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-18T04:53:25.451 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-18T04:53:25.557 INFO:teuthology.orchestra.run.smithi096.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-18T04:53:25.557 INFO:teuthology.orchestra.run.smithi096.stdout:Removing obsolete dictionary files: 2024-04-18T04:53:25.746 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up postgresql-client-common (238) ... 2024-04-18T04:53:25.956 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-18T04:53:26.082 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-18T04:53:26.104 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-18T04:53:26.208 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:53:26.351 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-18T04:53:26.477 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T04:53:26.499 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:53:26.603 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:53:26.832 INFO:teuthology.orchestra.run.smithi096.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-18T04:53:26.846 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-18T04:53:26.894 INFO:teuthology.orchestra.run.smithi096.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-18T04:53:26.894 INFO:teuthology.orchestra.run.smithi096.stdout:This user must also own the server process. 2024-04-18T04:53:26.895 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:26.895 INFO:teuthology.orchestra.run.smithi096.stdout:The database cluster will be initialized with locale "en_US". 2024-04-18T04:53:26.895 INFO:teuthology.orchestra.run.smithi096.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-18T04:53:26.895 INFO:teuthology.orchestra.run.smithi096.stdout:The default text search configuration will be set to "english". 2024-04-18T04:53:26.895 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:26.895 INFO:teuthology.orchestra.run.smithi096.stdout:Data page checksums are disabled. 2024-04-18T04:53:26.895 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:26.895 INFO:teuthology.orchestra.run.smithi096.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-18T04:53:26.895 INFO:teuthology.orchestra.run.smithi096.stdout:creating subdirectories ... ok 2024-04-18T04:53:26.895 INFO:teuthology.orchestra.run.smithi096.stdout:selecting dynamic shared memory implementation ... posix 2024-04-18T04:53:26.910 INFO:teuthology.orchestra.run.smithi096.stdout:selecting default max_connections ... 100 2024-04-18T04:53:26.931 INFO:teuthology.orchestra.run.smithi096.stdout:selecting default shared_buffers ... 128MB 2024-04-18T04:53:26.938 INFO:teuthology.orchestra.run.smithi096.stdout:selecting default time zone ... Etc/UTC 2024-04-18T04:53:26.939 INFO:teuthology.orchestra.run.smithi096.stdout:creating configuration files ... ok 2024-04-18T04:53:27.052 INFO:teuthology.orchestra.run.smithi096.stdout:running bootstrap script ... ok 2024-04-18T04:53:27.097 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-18T04:53:27.184 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-18T04:53:27.543 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-18T04:53:27.543 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-18T04:53:27.702 INFO:teuthology.orchestra.run.smithi096.stdout:performing post-bootstrap initialization ... ok 2024-04-18T04:53:28.053 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T04:53:28.154 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-18T04:53:28.280 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T04:53:28.406 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-18T04:53:28.419 INFO:teuthology.orchestra.run.smithi096.stdout:syncing data to disk ... ok 2024-04-18T04:53:28.790 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T04:53:28.837 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-18T04:53:29.066 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T04:53:29.192 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-18T04:53:29.327 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-18T04:53:30.032 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-18T04:53:30.158 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up dump (0.4b47-3) ... 2024-04-18T04:53:30.260 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-18T04:53:30.317 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-18T04:53:30.452 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-18T04:53:30.561 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-18T04:53:30.662 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-18T04:53:30.763 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T04:53:30.854 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-18T04:53:30.931 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-18T04:53:31.057 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-18T04:53:31.234 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-18T04:53:31.368 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-18T04:53:31.494 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-18T04:53:31.564 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-18T04:53:31.637 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up postgresql-client (14+238) ... 2024-04-18T04:53:31.673 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-18T04:53:31.738 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-18T04:53:31.782 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up postgresql (14+238) ... 2024-04-18T04:53:31.900 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-18T04:53:32.026 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-18T04:53:32.206 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:32.206 INFO:teuthology.orchestra.run.smithi139.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-18T04:53:32.206 INFO:teuthology.orchestra.run.smithi139.stdout:which means they are currently configured by ifupdown: 2024-04-18T04:53:32.207 INFO:teuthology.orchestra.run.smithi139.stdout:- enp3s0f1 2024-04-18T04:53:32.207 INFO:teuthology.orchestra.run.smithi139.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-18T04:53:32.207 INFO:teuthology.orchestra.run.smithi139.stdout:remove their configuration from /etc/network/interfaces. 2024-04-18T04:53:32.207 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:32.283 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-18T04:53:32.283 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-18T04:53:32.333 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-18T04:53:32.650 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-18T04:53:32.838 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-18T04:53:33.005 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-18T04:53:33.047 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-18T04:53:33.366 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T04:53:33.518 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T04:53:33.548 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-18T04:53:33.708 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T04:53:33.843 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-18T04:53:33.969 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up postgresql-common (238) ... 2024-04-18T04:53:34.852 INFO:teuthology.orchestra.run.smithi139.stdout:Adding user postgres to group ssl-cert 2024-04-18T04:53:34.855 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-18T04:53:34.963 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T04:53:35.088 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:35.089 INFO:teuthology.orchestra.run.smithi139.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-18T04:53:35.313 INFO:teuthology.orchestra.run.smithi139.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-18T04:53:35.313 INFO:teuthology.orchestra.run.smithi139.stdout:Removing obsolete dictionary files: 2024-04-18T04:53:35.589 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T04:53:35.595 DEBUG:teuthology.parallel:result is None 2024-04-18T04:53:35.888 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-18T04:53:36.270 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:53:36.580 INFO:teuthology.orchestra.run.smithi139.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-18T04:53:36.593 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-18T04:53:36.640 INFO:teuthology.orchestra.run.smithi139.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-18T04:53:36.640 INFO:teuthology.orchestra.run.smithi139.stdout:This user must also own the server process. 2024-04-18T04:53:36.640 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:36.640 INFO:teuthology.orchestra.run.smithi139.stdout:The database cluster will be initialized with locale "en_US". 2024-04-18T04:53:36.640 INFO:teuthology.orchestra.run.smithi139.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-18T04:53:36.640 INFO:teuthology.orchestra.run.smithi139.stdout:The default text search configuration will be set to "english". 2024-04-18T04:53:36.640 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:36.640 INFO:teuthology.orchestra.run.smithi139.stdout:Data page checksums are disabled. 2024-04-18T04:53:36.640 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:36.641 INFO:teuthology.orchestra.run.smithi139.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-18T04:53:36.641 INFO:teuthology.orchestra.run.smithi139.stdout:creating subdirectories ... ok 2024-04-18T04:53:36.641 INFO:teuthology.orchestra.run.smithi139.stdout:selecting dynamic shared memory implementation ... posix 2024-04-18T04:53:36.653 INFO:teuthology.orchestra.run.smithi139.stdout:selecting default max_connections ... 100 2024-04-18T04:53:36.674 INFO:teuthology.orchestra.run.smithi139.stdout:selecting default shared_buffers ... 128MB 2024-04-18T04:53:36.684 INFO:teuthology.orchestra.run.smithi139.stdout:selecting default time zone ... Etc/UTC 2024-04-18T04:53:36.684 INFO:teuthology.orchestra.run.smithi139.stdout:creating configuration files ... ok 2024-04-18T04:53:36.799 INFO:teuthology.orchestra.run.smithi139.stdout:running bootstrap script ... ok 2024-04-18T04:53:37.417 INFO:teuthology.orchestra.run.smithi139.stdout:performing post-bootstrap initialization ... ok 2024-04-18T04:53:38.098 INFO:teuthology.orchestra.run.smithi139.stdout:syncing data to disk ... ok 2024-04-18T04:53:38.503 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-18T04:53:41.301 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-18T04:53:41.469 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-18T04:53:41.620 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up postgresql (14+238) ... 2024-04-18T04:53:41.771 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-18T04:53:41.922 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-18T04:53:42.197 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-18T04:53:42.198 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-18T04:53:42.724 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-18T04:53:42.926 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-18T04:53:43.245 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T04:53:43.413 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T04:53:44.758 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-18T04:53:44.874 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T04:53:46.031 INFO:teuthology.orchestra.run.smithi139.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T04:53:46.035 DEBUG:teuthology.parallel:result is None 2024-04-18T04:53:46.036 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=56a91dd158be807f143cc918a11685fc9ee164ae 2024-04-18T04:53:46.185 DEBUG:teuthology.orchestra.run.smithi096:> dpkg-query -W -f '${Version}' ceph 2024-04-18T04:53:46.204 INFO:teuthology.orchestra.run.smithi096.stdout:18.2.2-1229-g56a91dd1-1jammy 2024-04-18T04:53:46.205 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1229-g56a91dd1-1jammy 2024-04-18T04:53:46.205 INFO:teuthology.task.install:The correct ceph version 18.2.2-1229-g56a91dd1-1jammy is installed. 2024-04-18T04:53:46.207 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=56a91dd158be807f143cc918a11685fc9ee164ae 2024-04-18T04:53:46.347 DEBUG:teuthology.orchestra.run.smithi139:> dpkg-query -W -f '${Version}' ceph 2024-04-18T04:53:46.366 INFO:teuthology.orchestra.run.smithi139.stdout:18.2.2-1229-g56a91dd1-1jammy 2024-04-18T04:53:46.366 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1229-g56a91dd1-1jammy 2024-04-18T04:53:46.366 INFO:teuthology.task.install:The correct ceph version 18.2.2-1229-g56a91dd1-1jammy is installed. 2024-04-18T04:53:46.368 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-18T04:53:46.368 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:53:46.368 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T04:53:46.383 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:53:46.383 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T04:53:46.423 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-18T04:53:46.424 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:53:46.424 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T04:53:46.437 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T04:53:46.493 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:53:46.493 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T04:53:46.507 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T04:53:46.563 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-18T04:53:46.563 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:53:46.564 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T04:53:46.577 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T04:53:46.629 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:53:46.629 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T04:53:46.642 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T04:53:46.695 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-18T04:53:46.695 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:53:46.696 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T04:53:46.708 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T04:53:46.761 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:53:46.761 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T04:53:46.773 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T04:53:46.827 INFO:teuthology.run_tasks:Running task ceph... 2024-04-18T04:53:46.905 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-18T04:53:46.905 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /var/log/ceph 2024-04-18T04:53:46.907 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /var/log/ceph 2024-04-18T04:53:46.920 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-18T04:53:46.920 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T04:53:46.963 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T04:53:46.975 INFO:tasks.ceph:Creating extra log directories... 2024-04-18T04:53:46.975 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T04:53:47.023 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T04:53:47.042 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-18T04:53:47.043 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-18T04:53:47.043 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-18T04:53:47.043 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:53:47.043 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-18T04:53:47.083 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-18T04:53:47.157 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:53:47.157 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-18T04:53:47.163 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-18T04:53:47.245 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-18T04:53:47.245 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-18T04:53:47.245 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661535', 'branch': 'reef', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7661535', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 5203, 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae', 'sleep_before_teardown': 0, 'subset': '88/512', 'suite': 'fs', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi096.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBacnF1e/jE/+ZrxridAyjfdaukJofMeiALsoW7IoHwkF0sM7MjyCJu9jjWJx4llc9dUKtKwNOhj/ZMLEei9anQ=', 'smithi139.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKfxGZC5aWg/xsSkj7ePm+4PTVJXGmZYk0JsIPMqLyM66w/kbvF3jfLJqByVWzivkT1agm8Fklg88zeFIiiH68A='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-17_22:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-18T04:53:47.246 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T04:53:47.248 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T04:53:47.288 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T04:53:47.295 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T04:53:47.344 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:53:47.344 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T04:53:47.354 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T04:53:47.354 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 2024-04-18T04:53:47.402 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T04:53:47.402 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T04:53:47.402 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 869 Links: 1 2024-04-18T04:53:47.403 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:53:47.403 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-04-18 04:47:48.248621560 +0000 2024-04-18T04:53:47.403 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-18 04:47:48.008623703 +0000 2024-04-18T04:53:47.403 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-18 04:47:48.008623703 +0000 2024-04-18T04:53:47.403 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-04-18T04:53:47.403 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T04:53:47.456 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-04-18T04:53:47.456 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-04-18T04:53:47.456 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000444199 s, 1.2 MB/s 2024-04-18T04:53:47.458 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T04:53:47.508 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 2024-04-18T04:53:47.554 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T04:53:47.554 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T04:53:47.554 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-04-18T04:53:47.554 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:53:47.554 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-04-18 04:47:48.480619488 +0000 2024-04-18T04:53:47.554 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-18 04:47:48.476619523 +0000 2024-04-18T04:53:47.554 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-18 04:47:48.476619523 +0000 2024-04-18T04:53:47.555 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-04-18T04:53:47.555 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T04:53:47.609 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-04-18T04:53:47.609 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-04-18T04:53:47.609 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000418026 s, 1.2 MB/s 2024-04-18T04:53:47.610 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T04:53:47.659 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 2024-04-18T04:53:47.706 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T04:53:47.706 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T04:53:47.706 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-04-18T04:53:47.706 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:53:47.706 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-04-18 04:47:49.004614808 +0000 2024-04-18T04:53:47.706 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-18 04:47:49.000614842 +0000 2024-04-18T04:53:47.707 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-18 04:47:49.000614842 +0000 2024-04-18T04:53:47.707 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-04-18T04:53:47.707 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T04:53:47.761 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-04-18T04:53:47.761 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-04-18T04:53:47.761 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000304938 s, 1.7 MB/s 2024-04-18T04:53:47.763 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T04:53:47.811 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 2024-04-18T04:53:47.858 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T04:53:47.859 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T04:53:47.859 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-04-18T04:53:47.859 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:53:47.859 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-04-18 04:47:49.756608090 +0000 2024-04-18T04:53:47.859 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-18 04:47:49.504610341 +0000 2024-04-18T04:53:47.859 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-18 04:47:49.504610341 +0000 2024-04-18T04:53:47.859 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-04-18T04:53:47.859 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T04:53:47.912 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-04-18T04:53:47.912 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-04-18T04:53:47.912 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000288669 s, 1.8 MB/s 2024-04-18T04:53:47.913 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T04:53:47.965 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T04:53:47.965 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:53:47.965 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T04:53:47.971 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T04:53:47.971 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2024-04-18T04:53:48.020 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T04:53:48.020 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T04:53:48.021 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 864 Links: 1 2024-04-18T04:53:48.021 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:53:48.021 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-18 04:47:45.851054860 +0000 2024-04-18T04:53:48.021 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-18 04:47:45.595057147 +0000 2024-04-18T04:53:48.021 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-18 04:47:45.595057147 +0000 2024-04-18T04:53:48.021 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-04-18T04:53:48.021 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T04:53:48.074 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-18T04:53:48.075 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-18T04:53:48.075 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000441023 s, 1.2 MB/s 2024-04-18T04:53:48.076 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T04:53:48.126 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2024-04-18T04:53:48.176 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T04:53:48.176 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T04:53:48.176 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-04-18T04:53:48.176 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:53:48.176 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-18 04:47:46.079052823 +0000 2024-04-18T04:53:48.176 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-18 04:47:46.075052859 +0000 2024-04-18T04:53:48.176 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-18 04:47:46.075052859 +0000 2024-04-18T04:53:48.176 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-04-18T04:53:48.176 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T04:53:48.235 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-18T04:53:48.235 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-18T04:53:48.235 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.00041816 s, 1.2 MB/s 2024-04-18T04:53:48.236 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T04:53:48.285 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2024-04-18T04:53:48.331 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T04:53:48.332 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T04:53:48.332 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 899 Links: 1 2024-04-18T04:53:48.332 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:53:48.332 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-18 04:47:46.839046035 +0000 2024-04-18T04:53:48.332 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-18 04:47:46.595048215 +0000 2024-04-18T04:53:48.332 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-18 04:47:46.595048215 +0000 2024-04-18T04:53:48.332 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-04-18T04:53:48.332 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T04:53:48.386 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-18T04:53:48.386 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-18T04:53:48.386 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000447597 s, 1.1 MB/s 2024-04-18T04:53:48.388 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T04:53:48.437 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2024-04-18T04:53:48.483 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T04:53:48.483 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T04:53:48.484 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-04-18T04:53:48.484 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:53:48.484 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-18 04:47:47.299041927 +0000 2024-04-18T04:53:48.484 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-18 04:47:47.063044035 +0000 2024-04-18T04:53:48.484 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-18 04:47:47.063044035 +0000 2024-04-18T04:53:48.484 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-04-18T04:53:48.484 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T04:53:48.538 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-18T04:53:48.538 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-18T04:53:48.538 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000387917 s, 1.3 MB/s 2024-04-18T04:53:48.539 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T04:53:48.589 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-18T04:53:48.589 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-18T04:53:48.589 INFO:tasks.ceph:Generating config... 2024-04-18T04:53:48.590 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-18T04:53:48.590 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-18T04:53:48.590 INFO:tasks.ceph:[client] debug client = 20 2024-04-18T04:53:48.590 INFO:tasks.ceph:[client] debug ms = 1 2024-04-18T04:53:48.590 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-18T04:53:48.591 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-18T04:53:48.591 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-18T04:53:48.591 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-18T04:53:48.591 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-18T04:53:48.591 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-18T04:53:48.591 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-18T04:53:48.591 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-18T04:53:48.591 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-18T04:53:48.591 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-18T04:53:48.591 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-18T04:53:48.591 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-18T04:53:48.591 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-18T04:53:48.591 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-18T04:53:48.591 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-18T04:53:48.592 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-18T04:53:48.592 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-18T04:53:48.592 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-18T04:53:48.592 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-18T04:53:48.592 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-18T04:53:48.592 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-18T04:53:48.592 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-18T04:53:48.592 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-18T04:53:48.592 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-18T04:53:48.592 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-18T04:53:48.592 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-18T04:53:48.592 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-18T04:53:48.592 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-18T04:53:48.592 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-18T04:53:48.592 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-18T04:53:48.593 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-18T04:53:48.593 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-18T04:53:48.593 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-18T04:53:48.593 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-18T04:53:48.593 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-18T04:53:48.593 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-18T04:53:48.593 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-18T04:53:48.593 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-18T04:53:48.593 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-18T04:53:48.593 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-18T04:53:48.593 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-18T04:53:48.593 INFO:tasks.ceph:Setting up mon.a... 2024-04-18T04:53:48.594 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-18T04:53:48.628 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.keyring 2024-04-18T04:53:48.653 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-18T04:53:48.727 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T04:53:48.781 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.96'), ('mon.b', '172.21.15.139'), ('mon.c', '[v2:172.21.15.139:3301,v1:172.21.15.139:6790]')] 2024-04-18T04:53:48.782 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.96,172.21.15.139,[v2:172.21.15.139:3301,v1:172.21.15.139:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-18T04:53:48.783 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:53:48.783 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-18T04:53:48.830 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.96 --add b 172.21.15.139 --addv c '[v2:172.21.15.139:3301,v1:172.21.15.139:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:53:48.917 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:53:48.917 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: generated fsid 8d7e5b20-8020-4511-8581-fbe2b42a23db 2024-04-18T04:53:48.917 INFO:teuthology.orchestra.run.smithi096.stdout:setting min_mon_release = pacific 2024-04-18T04:53:48.917 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 0 2024-04-18T04:53:48.917 INFO:teuthology.orchestra.run.smithi096.stdout:fsid 8d7e5b20-8020-4511-8581-fbe2b42a23db 2024-04-18T04:53:48.917 INFO:teuthology.orchestra.run.smithi096.stdout:last_changed 2024-04-18T04:53:48.921127+0000 2024-04-18T04:53:48.917 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-04-18T04:53:48.921127+0000 2024-04-18T04:53:48.917 INFO:teuthology.orchestra.run.smithi096.stdout:min_mon_release 16 (pacific) 2024-04-18T04:53:48.917 INFO:teuthology.orchestra.run.smithi096.stdout:election_strategy: 1 2024-04-18T04:53:48.917 INFO:teuthology.orchestra.run.smithi096.stdout:0: [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon.a 2024-04-18T04:53:48.917 INFO:teuthology.orchestra.run.smithi096.stdout:1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-04-18T04:53:48.917 INFO:teuthology.orchestra.run.smithi096.stdout:2: [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] mon.c 2024-04-18T04:53:48.918 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-18T04:53:48.919 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-18T04:53:48.966 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8d7e5b20-8020-4511-8581-fbe2b42a23db... 2024-04-18T04:53:48.967 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T04:53:49.011 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T04:53:49.039 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2024-04-18T04:53:49.039 INFO:teuthology.orchestra.run.smithi096.stdout: chdir = "" 2024-04-18T04:53:49.039 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T04:53:49.039 INFO:teuthology.orchestra.run.smithi096.stdout: auth supported = cephx 2024-04-18T04:53:49.039 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.039 INFO:teuthology.orchestra.run.smithi096.stdout: filestore xattr use omap = true 2024-04-18T04:53:49.039 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.039 INFO:teuthology.orchestra.run.smithi096.stdout: mon clock drift allowed = 1.000 2024-04-18T04:53:49.039 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.039 INFO:teuthology.orchestra.run.smithi096.stdout: osd crush chooseleaf type = 0 2024-04-18T04:53:49.040 INFO:teuthology.orchestra.run.smithi096.stdout: auth debug = true 2024-04-18T04:53:49.040 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.040 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on old message = true 2024-04-18T04:53:49.040 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on bug = true 2024-04-18T04:53:49.040 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.040 INFO:teuthology.orchestra.run.smithi096.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T04:53:49.040 INFO:teuthology.orchestra.run.smithi096.stdout: mon pg warn max object skew = 0 2024-04-18T04:53:49.040 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.040 INFO:teuthology.orchestra.run.smithi096.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T04:53:49.040 INFO:teuthology.orchestra.run.smithi096.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T04:53:49.040 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.040 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default size = 2 2024-04-18T04:53:49.040 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.040 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow primary affinity = true 2024-04-18T04:53:49.040 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow pg remap = true 2024-04-18T04:53:49.040 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on legacy crush tunables = false 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on crush straw calc version zero = false 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on no sortbitwise = false 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on osd down out interval zero = false 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on too few osds = false 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: mon_allow_pool_size_one = true 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: osd default data pool replay window = 5 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: mon allow pool delete = true 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: mon cluster log file level = debug 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: debug asserts on shutdown = true 2024-04-18T04:53:49.041 INFO:teuthology.orchestra.run.smithi096.stdout: mon health detail to clog = false 2024-04-18T04:53:49.042 INFO:teuthology.orchestra.run.smithi096.stdout: mon host = "172.21.15.96,172.21.15.139,[v2:172.21.15.139:3301,v1:172.21.15.139:6790]" 2024-04-18T04:53:49.042 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = 8d7e5b20-8020-4511-8581-fbe2b42a23db 2024-04-18T04:53:49.042 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.042 INFO:teuthology.orchestra.run.smithi096.stdout:[osd] 2024-04-18T04:53:49.042 INFO:teuthology.orchestra.run.smithi096.stdout: osd journal size = 100 2024-04-18T04:53:49.042 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.042 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub load threshold = 5.0 2024-04-18T04:53:49.042 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub max interval = 600 2024-04-18T04:53:49.042 INFO:teuthology.orchestra.run.smithi096.stdout: osd mclock profile = high_recovery_ops 2024-04-18T04:53:49.042 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.042 INFO:teuthology.orchestra.run.smithi096.stdout: osd recover clone overlap = true 2024-04-18T04:53:49.042 INFO:teuthology.orchestra.run.smithi096.stdout: osd recovery max chunk = 1048576 2024-04-18T04:53:49.042 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.042 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug shutdown = true 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug op order = true 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug verify stray on activate = true 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: osd open classes on start = true 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug pg log writeout = true 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: osd deep scrub update digest min age = 30 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: osd map max advance = 10 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: journal zero on create = true 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: filestore ondisk finisher threads = 3 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: filestore apply finisher threads = 3 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: bdev debug aio = true 2024-04-18T04:53:49.043 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug misdirected ops = true 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore block size = 96636764160 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore compression mode = aggressive 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore fsck on mount = True 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluefs = 20 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluestore = 20 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: debug osd = 20 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: debug rocksdb = 10 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd full ratio = 0.9 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd nearfull ratio = 0.8 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: osd blocked scrub grace period = 3600 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: osd failsafe full ratio = 0.95 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: osd max markdown count = 1000 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: osd objectstore = bluestore 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: osd op complaint time = 180 2024-04-18T04:53:49.044 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr] 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgr = 20 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout: mgr/telemetry/nag = false 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout:[mon] 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout: debug paxos = 20 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout: mon data avail warn = 5 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout: mon mgr mkfs grace = 240 2024-04-18T04:53:49.045 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-04-18T04:53:49.046 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd reporter subtree level = osd 2024-04-18T04:53:49.046 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd prime pg temp = true 2024-04-18T04:53:49.046 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-04-18T04:53:49.046 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.046 INFO:teuthology.orchestra.run.smithi096.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T04:53:49.046 INFO:teuthology.orchestra.run.smithi096.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T04:53:49.046 INFO:teuthology.orchestra.run.smithi096.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T04:53:49.046 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.046 INFO:teuthology.orchestra.run.smithi096.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T04:53:49.046 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T04:53:49.046 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T04:53:49.046 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.046 INFO:teuthology.orchestra.run.smithi096.stdout: # 1m isn't quite enough 2024-04-18T04:53:49.046 INFO:teuthology.orchestra.run.smithi096.stdout: mon_down_mkfs_grace = 2m 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_filestore_osds = false 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout: mon op complaint time = 120 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout:[client] 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout: rgw cache enabled = true 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable ops log = true 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable usage log = true 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout: client mount timeout = 600 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout: client_shutdown_timeout = 120 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout: debug client = 20 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout: rados mon op timeout = 900 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout: rados osd op timeout = 900 2024-04-18T04:53:49.047 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.a] 2024-04-18T04:53:49.048 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.b] 2024-04-18T04:53:49.048 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.c] 2024-04-18T04:53:49.048 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-04-18T04:53:49.048 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.c] 2024-04-18T04:53:49.048 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.e] 2024-04-18T04:53:49.048 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2024-04-18T04:53:49.048 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.d] 2024-04-18T04:53:49.048 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.f] 2024-04-18T04:53:49.048 INFO:teuthology.orchestra.run.smithi096.stdout:[mds] 2024-04-18T04:53:49.048 INFO:teuthology.orchestra.run.smithi096.stdout: debug mds = 20 2024-04-18T04:53:49.048 INFO:teuthology.orchestra.run.smithi096.stdout: debug mds balancer = 20 2024-04-18T04:53:49.048 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-18T04:53:49.048 INFO:teuthology.orchestra.run.smithi096.stdout: mds bal fragment size max = 10000 2024-04-18T04:53:49.048 INFO:teuthology.orchestra.run.smithi096.stdout: mds bal merge size = 5 2024-04-18T04:53:49.048 INFO:teuthology.orchestra.run.smithi096.stdout: mds bal split bits = 3 2024-04-18T04:53:49.048 INFO:teuthology.orchestra.run.smithi096.stdout: mds bal split size = 100 2024-04-18T04:53:49.049 INFO:teuthology.orchestra.run.smithi096.stdout: mds debug frag = True 2024-04-18T04:53:49.049 INFO:teuthology.orchestra.run.smithi096.stdout: mds debug scatterstat = True 2024-04-18T04:53:49.049 INFO:teuthology.orchestra.run.smithi096.stdout: mds oft prefetch dirfrags = True 2024-04-18T04:53:49.049 INFO:teuthology.orchestra.run.smithi096.stdout: mds op complaint time = 180 2024-04-18T04:53:49.049 INFO:teuthology.orchestra.run.smithi096.stdout: mds verify scatter = True 2024-04-18T04:53:49.049 INFO:teuthology.orchestra.run.smithi096.stdout: mds_dir_prefetch = True 2024-04-18T04:53:49.049 INFO:teuthology.orchestra.run.smithi096.stdout: mds_sleep_rank_change = 5000000.0 2024-04-18T04:53:49.049 INFO:teuthology.orchestra.run.smithi096.stdout: osd op complaint time = 180 2024-04-18T04:53:49.049 INFO:teuthology.orchestra.run.smithi096.stdout: rados mon op timeout = 900 2024-04-18T04:53:49.049 INFO:teuthology.orchestra.run.smithi096.stdout: rados osd op timeout = 900 2024-04-18T04:53:49.050 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2024-04-18T04:53:49.050 INFO:teuthology.orchestra.run.smithi139.stdout: chdir = "" 2024-04-18T04:53:49.050 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T04:53:49.050 INFO:teuthology.orchestra.run.smithi139.stdout: auth supported = cephx 2024-04-18T04:53:49.050 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.050 INFO:teuthology.orchestra.run.smithi139.stdout: filestore xattr use omap = true 2024-04-18T04:53:49.050 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.050 INFO:teuthology.orchestra.run.smithi139.stdout: mon clock drift allowed = 1.000 2024-04-18T04:53:49.050 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.050 INFO:teuthology.orchestra.run.smithi139.stdout: osd crush chooseleaf type = 0 2024-04-18T04:53:49.050 INFO:teuthology.orchestra.run.smithi139.stdout: auth debug = true 2024-04-18T04:53:49.050 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.050 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on old message = true 2024-04-18T04:53:49.051 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on bug = true 2024-04-18T04:53:49.051 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.051 INFO:teuthology.orchestra.run.smithi139.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T04:53:49.051 INFO:teuthology.orchestra.run.smithi139.stdout: mon pg warn max object skew = 0 2024-04-18T04:53:49.051 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.051 INFO:teuthology.orchestra.run.smithi139.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T04:53:49.051 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T04:53:49.051 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.051 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default size = 2 2024-04-18T04:53:49.051 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.051 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow primary affinity = true 2024-04-18T04:53:49.051 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow pg remap = true 2024-04-18T04:53:49.051 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on legacy crush tunables = false 2024-04-18T04:53:49.051 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on crush straw calc version zero = false 2024-04-18T04:53:49.051 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on no sortbitwise = false 2024-04-18T04:53:49.051 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on osd down out interval zero = false 2024-04-18T04:53:49.052 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on too few osds = false 2024-04-18T04:53:49.052 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T04:53:49.052 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T04:53:49.052 INFO:teuthology.orchestra.run.smithi139.stdout: mon_allow_pool_size_one = true 2024-04-18T04:53:49.052 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.052 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T04:53:49.052 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.052 INFO:teuthology.orchestra.run.smithi139.stdout: osd default data pool replay window = 5 2024-04-18T04:53:49.052 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.052 INFO:teuthology.orchestra.run.smithi139.stdout: mon allow pool delete = true 2024-04-18T04:53:49.052 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.052 INFO:teuthology.orchestra.run.smithi139.stdout: mon cluster log file level = debug 2024-04-18T04:53:49.052 INFO:teuthology.orchestra.run.smithi139.stdout: debug asserts on shutdown = true 2024-04-18T04:53:49.052 INFO:teuthology.orchestra.run.smithi139.stdout: mon health detail to clog = false 2024-04-18T04:53:49.052 INFO:teuthology.orchestra.run.smithi139.stdout: mon host = "172.21.15.96,172.21.15.139,[v2:172.21.15.139:3301,v1:172.21.15.139:6790]" 2024-04-18T04:53:49.052 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = 8d7e5b20-8020-4511-8581-fbe2b42a23db 2024-04-18T04:53:49.053 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.053 INFO:teuthology.orchestra.run.smithi139.stdout:[osd] 2024-04-18T04:53:49.053 INFO:teuthology.orchestra.run.smithi139.stdout: osd journal size = 100 2024-04-18T04:53:49.053 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.053 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub load threshold = 5.0 2024-04-18T04:53:49.053 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub max interval = 600 2024-04-18T04:53:49.053 INFO:teuthology.orchestra.run.smithi139.stdout: osd mclock profile = high_recovery_ops 2024-04-18T04:53:49.053 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.053 INFO:teuthology.orchestra.run.smithi139.stdout: osd recover clone overlap = true 2024-04-18T04:53:49.053 INFO:teuthology.orchestra.run.smithi139.stdout: osd recovery max chunk = 1048576 2024-04-18T04:53:49.053 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.053 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug shutdown = true 2024-04-18T04:53:49.053 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug op order = true 2024-04-18T04:53:49.053 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug verify stray on activate = true 2024-04-18T04:53:49.053 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.053 INFO:teuthology.orchestra.run.smithi139.stdout: osd open classes on start = true 2024-04-18T04:53:49.054 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug pg log writeout = true 2024-04-18T04:53:49.054 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.054 INFO:teuthology.orchestra.run.smithi139.stdout: osd deep scrub update digest min age = 30 2024-04-18T04:53:49.054 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.054 INFO:teuthology.orchestra.run.smithi139.stdout: osd map max advance = 10 2024-04-18T04:53:49.054 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.054 INFO:teuthology.orchestra.run.smithi139.stdout: journal zero on create = true 2024-04-18T04:53:49.054 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.054 INFO:teuthology.orchestra.run.smithi139.stdout: filestore ondisk finisher threads = 3 2024-04-18T04:53:49.054 INFO:teuthology.orchestra.run.smithi139.stdout: filestore apply finisher threads = 3 2024-04-18T04:53:49.054 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.054 INFO:teuthology.orchestra.run.smithi139.stdout: bdev debug aio = true 2024-04-18T04:53:49.054 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug misdirected ops = true 2024-04-18T04:53:49.054 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore block size = 96636764160 2024-04-18T04:53:49.054 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore compression mode = aggressive 2024-04-18T04:53:49.055 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore fsck on mount = True 2024-04-18T04:53:49.055 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluefs = 20 2024-04-18T04:53:49.055 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluestore = 20 2024-04-18T04:53:49.055 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-04-18T04:53:49.055 INFO:teuthology.orchestra.run.smithi139.stdout: debug osd = 20 2024-04-18T04:53:49.055 INFO:teuthology.orchestra.run.smithi139.stdout: debug rocksdb = 10 2024-04-18T04:53:49.055 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T04:53:49.055 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd full ratio = 0.9 2024-04-18T04:53:49.055 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd nearfull ratio = 0.8 2024-04-18T04:53:49.055 INFO:teuthology.orchestra.run.smithi139.stdout: osd blocked scrub grace period = 3600 2024-04-18T04:53:49.055 INFO:teuthology.orchestra.run.smithi139.stdout: osd failsafe full ratio = 0.95 2024-04-18T04:53:49.055 INFO:teuthology.orchestra.run.smithi139.stdout: osd max markdown count = 1000 2024-04-18T04:53:49.055 INFO:teuthology.orchestra.run.smithi139.stdout: osd objectstore = bluestore 2024-04-18T04:53:49.055 INFO:teuthology.orchestra.run.smithi139.stdout: osd op complaint time = 180 2024-04-18T04:53:49.055 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.055 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr] 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout: debug mgr = 20 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout: mgr/telemetry/nag = false 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout:[mon] 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout: debug paxos = 20 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout: mon data avail warn = 5 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout: mon mgr mkfs grace = 240 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-04-18T04:53:49.056 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd reporter subtree level = osd 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd prime pg temp = true 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: # 1m isn't quite enough 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: mon_down_mkfs_grace = 2m 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_filestore_osds = false 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: mon op complaint time = 120 2024-04-18T04:53:49.057 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-18T04:53:49.058 INFO:teuthology.orchestra.run.smithi139.stdout:[client] 2024-04-18T04:53:49.058 INFO:teuthology.orchestra.run.smithi139.stdout: rgw cache enabled = true 2024-04-18T04:53:49.058 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable ops log = true 2024-04-18T04:53:49.058 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable usage log = true 2024-04-18T04:53:49.058 INFO:teuthology.orchestra.run.smithi139.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T04:53:49.058 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T04:53:49.058 INFO:teuthology.orchestra.run.smithi139.stdout: client mount timeout = 600 2024-04-18T04:53:49.058 INFO:teuthology.orchestra.run.smithi139.stdout: client_shutdown_timeout = 120 2024-04-18T04:53:49.058 INFO:teuthology.orchestra.run.smithi139.stdout: debug client = 20 2024-04-18T04:53:49.058 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-04-18T04:53:49.058 INFO:teuthology.orchestra.run.smithi139.stdout: rados mon op timeout = 900 2024-04-18T04:53:49.058 INFO:teuthology.orchestra.run.smithi139.stdout: rados osd op timeout = 900 2024-04-18T04:53:49.058 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.a] 2024-04-18T04:53:49.058 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.b] 2024-04-18T04:53:49.058 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.c] 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a] 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.c] 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.e] 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.b] 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.d] 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.f] 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout:[mds] 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout: debug mds = 20 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout: debug mds balancer = 20 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal fragment size max = 10000 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal merge size = 5 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal split bits = 3 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal split size = 100 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout: mds debug frag = True 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout: mds debug scatterstat = True 2024-04-18T04:53:49.059 INFO:teuthology.orchestra.run.smithi139.stdout: mds oft prefetch dirfrags = True 2024-04-18T04:53:49.060 INFO:teuthology.orchestra.run.smithi139.stdout: mds op complaint time = 180 2024-04-18T04:53:49.060 INFO:teuthology.orchestra.run.smithi139.stdout: mds verify scatter = True 2024-04-18T04:53:49.060 INFO:teuthology.orchestra.run.smithi139.stdout: mds_dir_prefetch = True 2024-04-18T04:53:49.060 INFO:teuthology.orchestra.run.smithi139.stdout: mds_sleep_rank_change = 5000000.0 2024-04-18T04:53:49.060 INFO:teuthology.orchestra.run.smithi139.stdout: osd op complaint time = 180 2024-04-18T04:53:49.060 INFO:teuthology.orchestra.run.smithi139.stdout: rados mon op timeout = 900 2024-04-18T04:53:49.060 INFO:teuthology.orchestra.run.smithi139.stdout: rados osd op timeout = 900 2024-04-18T04:53:49.061 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-18T04:53:49.061 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-18T04:53:49.149 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-18T04:53:49.149 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:53:49.149 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-18T04:53:49.154 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:53:49.154 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-18T04:53:49.201 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T04:53:49.202 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:53:49.202 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T04:53:49.202 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T04:53:49.265 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:53:49.265 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:53:49.310 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi139.front.sepia.ceph.com 2024-04-18T04:53:49.310 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:53:49.311 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T04:53:49.311 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T04:53:49.334 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:53:49.334 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:53:49.380 INFO:tasks.ceph:Setting up mon nodes... 2024-04-18T04:53:49.380 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-18T04:53:49.380 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-18T04:53:49.423 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-18T04:53:49.426 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-18T04:53:49.468 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-18T04:53:49.488 INFO:tasks.ceph:Setting up mds nodes... 2024-04-18T04:53:49.489 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-18T04:53:49.531 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-18T04:53:49.534 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-18T04:53:49.589 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-18T04:53:49.676 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-18T04:53:49.679 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-18T04:53:49.737 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-18T04:53:49.820 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-18T04:53:49.822 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-18T04:53:49.877 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-18T04:53:49.922 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-18T04:53:49.925 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-18T04:53:49.980 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-18T04:53:50.063 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-18T04:53:50.065 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-18T04:53:50.117 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-18T04:53:50.198 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-18T04:53:50.201 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-18T04:53:50.253 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-18T04:53:50.254 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-18T04:53:50.290 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-18T04:53:50.301 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-18T04:53:50.301 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-18T04:53:50.301 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-18T04:53:50.357 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T04:53:50.357 INFO:tasks.ceph:role: osd.0 2024-04-18T04:53:50.357 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T04:53:50.357 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T04:53:50.423 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T04:53:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T04:53:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T04:53:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T04:53:50.423 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T04:53:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-04-18T04:53:50.423 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T04:53:50.423 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T04:53:50.423 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T04:53:50.423 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T04:53:50.871 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-04-18T04:53:50.873 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-04-18T04:53:50.873 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-18T04:53:50.982 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-18T04:53:50.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:53:50.992 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T04:53:50.992 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-18T04:53:51.043 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T04:53:51.043 INFO:tasks.ceph:role: osd.1 2024-04-18T04:53:51.044 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T04:53:51.044 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-18T04:53:51.105 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T04:53:51.105 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T04:53:51.105 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T04:53:51.105 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T04:53:51.105 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T04:53:51.105 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-04-18T04:53:51.105 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T04:53:51.105 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T04:53:51.105 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T04:53:51.105 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T04:53:51.575 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-04-18T04:53:51.577 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-04-18T04:53:51.577 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-18T04:53:51.703 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-18T04:53:51.714 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T04:53:51.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:53:51.715 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-18T04:53:51.769 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T04:53:51.770 INFO:tasks.ceph:role: osd.2 2024-04-18T04:53:51.770 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T04:53:51.770 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-18T04:53:51.833 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T04:53:51.833 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T04:53:51.833 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T04:53:51.833 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T04:53:51.833 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T04:53:51.833 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-04-18T04:53:51.834 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T04:53:51.834 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T04:53:51.834 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T04:53:51.834 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T04:53:52.314 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-04-18T04:53:52.316 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-04-18T04:53:52.317 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-18T04:53:52.471 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-18T04:53:52.481 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T04:53:52.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:53:52.482 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-18T04:53:52.538 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T04:53:52.538 INFO:tasks.ceph:role: osd.3 2024-04-18T04:53:52.538 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T04:53:52.538 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-18T04:53:52.601 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T04:53:52.601 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T04:53:52.601 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T04:53:52.601 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T04:53:52.602 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T04:53:52.602 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-04-18T04:53:52.602 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T04:53:52.602 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T04:53:52.602 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T04:53:52.602 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T04:53:53.031 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-04-18T04:53:53.033 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-04-18T04:53:53.033 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-18T04:53:53.121 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-18T04:53:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T04:53:53.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:53:53.175 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:53:53.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:53.285+0000 7fb02134a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-18T04:53:53.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:53.285+0000 7fb02134a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-18T04:53:53.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:53.285+0000 7fb02134a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T04:53:53.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:53.285+0000 7fb02134a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T04:53:53.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:53.285+0000 7fb02134a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T04:53:53.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:53.289+0000 7fb02134a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-18T04:53:56.271 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-18T04:53:56.284 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:53:56.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:56.365+0000 7fb070ea17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-18T04:53:56.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:56.365+0000 7fb070ea17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-18T04:53:56.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:56.365+0000 7fb070ea17c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T04:53:56.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:56.365+0000 7fb070ea17c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T04:53:56.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:56.365+0000 7fb070ea17c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T04:53:56.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:56.369+0000 7fb070ea17c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-18T04:53:59.342 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-18T04:53:59.399 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:53:59.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:59.481+0000 7f141df517c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-18T04:53:59.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:59.485+0000 7f141df517c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-18T04:53:59.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:59.485+0000 7f141df517c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T04:53:59.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:59.485+0000 7f141df517c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T04:53:59.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:59.485+0000 7f141df517c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T04:53:59.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:53:59.485+0000 7f141df517c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-18T04:54:02.468 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-18T04:54:02.527 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:54:02.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:02.609+0000 7f45cf6657c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-18T04:54:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:02.609+0000 7f45cf6657c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-18T04:54:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:02.609+0000 7f45cf6657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-18T04:54:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:02.609+0000 7f45cf6657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-18T04:54:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:02.609+0000 7f45cf6657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-18T04:54:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:02.609+0000 7f45cf6657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-18T04:54:05.593 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-18T04:54:05.651 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-18T04:54:05.665 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-18T04:54:05.665 INFO:tasks.ceph:role: osd.4 2024-04-18T04:54:05.665 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-18T04:54:05.665 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T04:54:05.728 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T04:54:05.728 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T04:54:05.728 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T04:54:05.728 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T04:54:05.728 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T04:54:05.728 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-04-18T04:54:05.728 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T04:54:05.728 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T04:54:05.729 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T04:54:05.729 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T04:54:06.204 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-04-18T04:54:06.206 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-04-18T04:54:06.206 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-18T04:54:06.337 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-18T04:54:06.348 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T04:54:06.349 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:54:06.349 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-18T04:54:06.403 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-18T04:54:06.403 INFO:tasks.ceph:role: osd.5 2024-04-18T04:54:06.403 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-18T04:54:06.403 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-18T04:54:06.466 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T04:54:06.466 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T04:54:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T04:54:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T04:54:06.467 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T04:54:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-04-18T04:54:06.467 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T04:54:06.467 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T04:54:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T04:54:06.467 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T04:54:06.894 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-04-18T04:54:06.896 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-04-18T04:54:06.897 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-18T04:54:06.960 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-18T04:54:07.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:54:07.012 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T04:54:07.013 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-18T04:54:07.065 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-18T04:54:07.065 INFO:tasks.ceph:role: osd.6 2024-04-18T04:54:07.065 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-18T04:54:07.065 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-18T04:54:07.126 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T04:54:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T04:54:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T04:54:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T04:54:07.126 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T04:54:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-04-18T04:54:07.126 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T04:54:07.126 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T04:54:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T04:54:07.126 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T04:54:07.577 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-04-18T04:54:07.579 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-04-18T04:54:07.579 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-18T04:54:07.682 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-18T04:54:07.691 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T04:54:07.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:54:07.692 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-18T04:54:07.745 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-18T04:54:07.745 INFO:tasks.ceph:role: osd.7 2024-04-18T04:54:07.745 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-18T04:54:07.745 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-18T04:54:07.806 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T04:54:07.807 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T04:54:07.807 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T04:54:07.807 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T04:54:07.807 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T04:54:07.807 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-04-18T04:54:07.807 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T04:54:07.807 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T04:54:07.807 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T04:54:07.807 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T04:54:08.273 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-04-18T04:54:08.275 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-04-18T04:54:08.275 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-18T04:54:08.417 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-18T04:54:08.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:54:08.429 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T04:54:08.429 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:54:08.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:08.544+0000 7efdfb3dc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-18T04:54:08.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:08.544+0000 7efdfb3dc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-18T04:54:08.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:08.544+0000 7efdfb3dc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-18T04:54:08.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:08.544+0000 7efdfb3dc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-18T04:54:08.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:08.544+0000 7efdfb3dc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-18T04:54:08.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:08.552+0000 7efdfb3dc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-18T04:54:11.552 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-18T04:54:11.566 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:54:11.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:11.644+0000 7f9b1fed87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-18T04:54:11.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:11.644+0000 7f9b1fed87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-18T04:54:11.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:11.644+0000 7f9b1fed87c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-18T04:54:11.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:11.644+0000 7f9b1fed87c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-18T04:54:11.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:11.644+0000 7f9b1fed87c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-18T04:54:11.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:11.644+0000 7f9b1fed87c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-18T04:54:14.628 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-18T04:54:14.685 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:54:14.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:14.768+0000 7f8edf2ce7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-18T04:54:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:14.768+0000 7f8edf2ce7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-18T04:54:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:14.768+0000 7f8edf2ce7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-18T04:54:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:14.768+0000 7f8edf2ce7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-18T04:54:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:14.768+0000 7f8edf2ce7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-18T04:54:14.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:14.768+0000 7f8edf2ce7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-18T04:54:17.247 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:54:17.250 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:54:17.751 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-18T04:54:17.765 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:54:17.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:17.844+0000 7fbb91fe37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-18T04:54:17.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:17.844+0000 7fbb91fe37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-18T04:54:17.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:17.844+0000 7fbb91fe37c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-18T04:54:17.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:17.844+0000 7fbb91fe37c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-18T04:54:17.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:17.844+0000 7fbb91fe37c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-18T04:54:17.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:17.844+0000 7fbb91fe37c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-18T04:54:20.818 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-18T04:54:20.872 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-18T04:54:20.873 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:54:20.873 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-18T04:54:20.887 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:54:20.887 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-18T04:54:20.940 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:54:20.941 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-18T04:54:20.994 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:54:20.994 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-18T04:54:21.049 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:54:21.049 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-18T04:54:21.101 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:54:21.101 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-18T04:54:21.157 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:54:21.157 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-18T04:54:21.213 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:54:21.213 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-18T04:54:21.269 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:54:21.269 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-18T04:54:21.283 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:54:21.283 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-18T04:54:21.339 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:54:21.339 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-18T04:54:21.398 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:54:21.398 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-18T04:54:21.451 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:54:21.451 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-18T04:54:21.507 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:54:21.507 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-18T04:54:21.563 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:54:21.563 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-18T04:54:21.618 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:54:21.618 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-18T04:54:21.674 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:54:21.675 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-18T04:54:21.680 INFO:tasks.ceph:Adding keys to all mons... 2024-04-18T04:54:21.680 DEBUG:teuthology.orchestra.run.smithi096:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-18T04:54:21.723 DEBUG:teuthology.orchestra.run.smithi139:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-18T04:54:21.732 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.y] 2024-04-18T04:54:21.732 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBdpyBmQ1qBGRAAUJn+qP1c1igEWd4tKxILQw== 2024-04-18T04:54:21.732 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-04-18T04:54:21.733 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBdpyBmLpbvHxAACsd6C13TIm8jXvjJSTMY1w== 2024-04-18T04:54:21.733 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.c] 2024-04-18T04:54:21.733 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBdpyBmKjiWKBAAOpe671/k4F9iplHxn258tw== 2024-04-18T04:54:21.733 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.e] 2024-04-18T04:54:21.733 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBdpyBmovYlMRAAoKntuqxPIvSFR0S6Q/652w== 2024-04-18T04:54:21.733 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.0] 2024-04-18T04:54:21.733 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBhpyBmlEcSERAAsROHd8Pcwasigc7/ACHYTg== 2024-04-18T04:54:21.733 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.1] 2024-04-18T04:54:21.733 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBkpyBm5O0CFhAAzZfZt/dsEx8SOqqKMZpakQ== 2024-04-18T04:54:21.733 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.2] 2024-04-18T04:54:21.733 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBnpyBm3s/0HBAAtcn/lfbAd42XtotvG0K+Xw== 2024-04-18T04:54:21.734 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.3] 2024-04-18T04:54:21.734 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBqpyBm8/eDJBAAqXHgOEkGVTU3ihWUTn9PLw== 2024-04-18T04:54:21.734 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.x] 2024-04-18T04:54:21.734 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBdpyBmQzwtHBAAd949mSyduqsP++zvfYfHiQ== 2024-04-18T04:54:21.734 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2024-04-18T04:54:21.734 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBdpyBmCG88NxAAFETn70IDHFjZowgUUN7yhw== 2024-04-18T04:54:21.734 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.d] 2024-04-18T04:54:21.734 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBepyBmiNEJBBAAG/bNUmlR9rqEQVj0vv+NNQ== 2024-04-18T04:54:21.734 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.f] 2024-04-18T04:54:21.734 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBepyBmoWEdDBAALSOPKzglU3GSdjAkIdAEdQ== 2024-04-18T04:54:21.734 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.4] 2024-04-18T04:54:21.734 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBwpyBmbJ6xIBAA225Y36U1kgxecnGF+EOmxg== 2024-04-18T04:54:21.734 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.5] 2024-04-18T04:54:21.735 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBzpyBmovCxJhAA7t8lMmYYbgHXRALzwiSfbw== 2024-04-18T04:54:21.735 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.6] 2024-04-18T04:54:21.735 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQB2pyBmfWIqLhAAUwGvpAlLOON4kPAzmT2U3A== 2024-04-18T04:54:21.735 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.7] 2024-04-18T04:54:21.735 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQB5pyBm0RmpMhAAqHKi/s/q4C0hkLoKk3uG4g== 2024-04-18T04:54:21.735 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2024-04-18T04:54:21.735 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBepyBmzqGQERAA/ddKH2eEkKfsvsaDdu2ilw== 2024-04-18T04:54:21.736 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr.y] 2024-04-18T04:54:21.736 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQBdpyBmQ1qBGRAAUJn+qP1c1igEWd4tKxILQw== 2024-04-18T04:54:21.737 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a] 2024-04-18T04:54:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQBdpyBmLpbvHxAACsd6C13TIm8jXvjJSTMY1w== 2024-04-18T04:54:21.737 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.c] 2024-04-18T04:54:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQBdpyBmKjiWKBAAOpe671/k4F9iplHxn258tw== 2024-04-18T04:54:21.737 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.e] 2024-04-18T04:54:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQBdpyBmovYlMRAAoKntuqxPIvSFR0S6Q/652w== 2024-04-18T04:54:21.737 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.0] 2024-04-18T04:54:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQBhpyBmlEcSERAAsROHd8Pcwasigc7/ACHYTg== 2024-04-18T04:54:21.737 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.1] 2024-04-18T04:54:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQBkpyBm5O0CFhAAzZfZt/dsEx8SOqqKMZpakQ== 2024-04-18T04:54:21.737 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.2] 2024-04-18T04:54:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQBnpyBm3s/0HBAAtcn/lfbAd42XtotvG0K+Xw== 2024-04-18T04:54:21.737 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.3] 2024-04-18T04:54:21.737 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQBqpyBm8/eDJBAAqXHgOEkGVTU3ihWUTn9PLw== 2024-04-18T04:54:21.737 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr.x] 2024-04-18T04:54:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQBdpyBmQzwtHBAAd949mSyduqsP++zvfYfHiQ== 2024-04-18T04:54:21.738 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.b] 2024-04-18T04:54:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQBdpyBmCG88NxAAFETn70IDHFjZowgUUN7yhw== 2024-04-18T04:54:21.738 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.d] 2024-04-18T04:54:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQBepyBmiNEJBBAAG/bNUmlR9rqEQVj0vv+NNQ== 2024-04-18T04:54:21.738 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.f] 2024-04-18T04:54:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQBepyBmoWEdDBAALSOPKzglU3GSdjAkIdAEdQ== 2024-04-18T04:54:21.738 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.4] 2024-04-18T04:54:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQBwpyBmbJ6xIBAA225Y36U1kgxecnGF+EOmxg== 2024-04-18T04:54:21.738 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.5] 2024-04-18T04:54:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQBzpyBmovCxJhAA7t8lMmYYbgHXRALzwiSfbw== 2024-04-18T04:54:21.738 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.6] 2024-04-18T04:54:21.738 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQB2pyBmfWIqLhAAUwGvpAlLOON4kPAzmT2U3A== 2024-04-18T04:54:21.738 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.7] 2024-04-18T04:54:21.739 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQB5pyBm0RmpMhAAqHKi/s/q4C0hkLoKk3uG4g== 2024-04-18T04:54:21.739 INFO:teuthology.orchestra.run.smithi139.stdout:[client.0] 2024-04-18T04:54:21.739 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQBepyBmzqGQERAA/ddKH2eEkKfsvsaDdu2ilw== 2024-04-18T04:54:21.739 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T04:54:21.779 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T04:54:21.824 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:54:21.826 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:54:21.869 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:54:21.915 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:54:21.962 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:54:21.964 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:54:22.040 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:54:22.042 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:54:22.125 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:54:22.128 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:54:22.206 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:54:22.211 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:54:22.289 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:54:22.294 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:54:22.371 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T04:54:22.383 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T04:54:22.463 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:54:22.471 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:54:22.554 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:54:22.556 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:54:22.599 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:54:22.643 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:54:22.686 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:54:22.727 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:54:22.770 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:54:22.807 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:54:22.855 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:54:22.887 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:54:22.943 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:54:22.966 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:54:23.007 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T04:54:23.051 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T04:54:23.096 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-18T04:54:23.096 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-18T04:54:23.108 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T04:54:23.195 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-18T04:54:23.205 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-18T04:54:23.219 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T04:54:23.311 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-18T04:54:23.321 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-18T04:54:23.372 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T04:54:23.457 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-18T04:54:23.509 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:54:23.511 DEBUG:teuthology.orchestra.run.smithi139:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:54:23.555 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-18T04:54:23.555 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-18T04:54:23.555 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-18T04:54:23.559 INFO:tasks.ceph.mon.a:Started 2024-04-18T04:54:23.559 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-18T04:54:23.559 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-18T04:54:23.600 INFO:tasks.ceph.mon.b:Started 2024-04-18T04:54:23.601 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-18T04:54:23.601 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-18T04:54:23.603 INFO:tasks.ceph.mon.c:Started 2024-04-18T04:54:23.603 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-18T04:54:23.603 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-18T04:54:23.603 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-18T04:54:23.606 INFO:tasks.ceph.mgr.y:Started 2024-04-18T04:54:23.606 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-18T04:54:23.606 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-18T04:54:23.609 INFO:tasks.ceph.mgr.x:Started 2024-04-18T04:54:23.609 INFO:tasks.ceph:Setting crush tunables to default 2024-04-18T04:54:23.609 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd crush tunables default 2024-04-18T04:54:23.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.725+0000 7fa64b193640 1 Processor -- start 2024-04-18T04:54:23.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.725+0000 7fa64b193640 1 -- start start 2024-04-18T04:54:23.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa64b193640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 0x7fa64406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:23.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa64b193640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa64406f3b0 0x7fa6440c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:23.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa64b193640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa644159ce0 con 0x7fa6440c94f0 2024-04-18T04:54:23.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa64b193640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa64406d910 con 0x7fa64406f3b0 2024-04-18T04:54:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa64b193640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa644159160 con 0x7fa644152e70 2024-04-18T04:54:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa643fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa64406f3b0 0x7fa6440c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa648f2f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 0x7fa64406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa643fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa64406f3b0 0x7fa6440c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:43322/0 (socket says 172.21.15.96:43322) 2024-04-18T04:54:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa643fff640 1 -- 172.21.15.96:0/1318544537 learned_addr learned my addr 172.21.15.96:0/1318544537 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa643fff640 1 -- 172.21.15.96:0/1318544537 >> v2:172.21.15.139:3300/0 conn(0x7fa64406f3b0 msgr2=0x7fa6440c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T04:54:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa643fff640 1 -- 172.21.15.96:0/1318544537 >> v2:172.21.15.139:3300/0 conn(0x7fa64406f3b0 msgr2=0x7fa6440c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:54:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa643fff640 1 --2- 172.21.15.96:0/1318544537 >> v2:172.21.15.139:3300/0 conn(0x7fa64406f3b0 0x7fa6440c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:54:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa648f2f640 1 -- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 msgr2=0x7fa64406ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:54:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa648f2f640 1 -- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 msgr2=0x7fa64406ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:54:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa648f2f640 1 --2- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 0x7fa64406ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:54:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa643fff640 1 --2- 172.21.15.96:0/1318544537 >> v2:172.21.15.139:3300/0 conn(0x7fa64406f3b0 0x7fa6440c8fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:54:23.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.729+0000 7fa648f2f640 1 --2- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 0x7fa64406ee70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:54:23.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.933+0000 7fa643fff640 1 --2- 172.21.15.96:0/1318544537 >> v2:172.21.15.139:3300/0 conn(0x7fa64406f3b0 0x7fa6440c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:23.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.933+0000 7fa648f2f640 1 --2- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 0x7fa64406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:23.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.933+0000 7fa643fff640 1 -- 172.21.15.96:0/1318544537 >> v2:172.21.15.139:3300/0 conn(0x7fa64406f3b0 msgr2=0x7fa6440c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:54:23.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.933+0000 7fa643fff640 1 -- 172.21.15.96:0/1318544537 >> v2:172.21.15.139:3300/0 conn(0x7fa64406f3b0 msgr2=0x7fa6440c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:54:23.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.933+0000 7fa643fff640 1 --2- 172.21.15.96:0/1318544537 >> v2:172.21.15.139:3300/0 conn(0x7fa64406f3b0 0x7fa6440c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:54:23.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.933+0000 7fa643fff640 1 --2- 172.21.15.96:0/1318544537 >> v2:172.21.15.139:3300/0 conn(0x7fa64406f3b0 0x7fa6440c8fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:54:23.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.933+0000 7fa648f2f640 1 -- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 msgr2=0x7fa64406ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T04:54:23.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.933+0000 7fa648f2f640 1 -- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 msgr2=0x7fa64406ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:54:23.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.933+0000 7fa648f2f640 1 --2- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 0x7fa64406ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:54:23.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.933+0000 7fa648f2f640 1 --2- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 0x7fa64406ee70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:54:23.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa6437fe640 1 -- 172.21.15.96:0/1318544537 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211553535 0 0) 0x7fa644159ce0 con 0x7fa6440c94f0 2024-04-18T04:54:23.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa6437fe640 1 -- 172.21.15.96:0/1318544537 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa634003530 con 0x7fa6440c94f0 2024-04-18T04:54:23.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa6437fe640 1 -- 172.21.15.96:0/1318544537 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2812721848 0 0) 0x7fa634003530 con 0x7fa6440c94f0 2024-04-18T04:54:23.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa6437fe640 1 -- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 msgr2=0x7fa64406ee70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:54:23.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa6437fe640 1 --2- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 0x7fa64406ee70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:23.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa6437fe640 1 -- 172.21.15.96:0/1318544537 >> v2:172.21.15.139:3300/0 conn(0x7fa64406f3b0 msgr2=0x7fa6440c8fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:54:23.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa6437fe640 1 --2- 172.21.15.96:0/1318544537 >> v2:172.21.15.139:3300/0 conn(0x7fa64406f3b0 0x7fa6440c8fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:23.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa6437fe640 1 -- 172.21.15.96:0/1318544537 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa644159440 con 0x7fa6440c94f0 2024-04-18T04:54:23.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa6437fe640 1 -- 172.21.15.96:0/1318544537 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fa63c001a00 con 0x7fa6440c94f0 2024-04-18T04:54:23.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa6437fe640 1 -- 172.21.15.96:0/1318544537 >> v1:172.21.15.139:6789/0 conn(0x7fa6440c94f0 legacy=0x7fa64406dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:23.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa6437fe640 1 --2- 172.21.15.96:0/1318544537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa634003980 0x7fa634003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:23.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa6437fe640 1 --2- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 0x7fa6340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:23.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa6437fe640 1 --2- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa634004d10 0x7fa634005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:23.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa6437fe640 1 -- 172.21.15.96:0/1318544537 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64406d910 con 0x7fa634003980 2024-04-18T04:54:23.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa6437fe640 1 -- 172.21.15.96:0/1318544537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa644159160 con 0x7fa634004d10 2024-04-18T04:54:23.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa6437fe640 1 -- 172.21.15.96:0/1318544537 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63400ba40 con 0x7fa644152e70 2024-04-18T04:54:23.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa648f2f640 1 --2- 172.21.15.96:0/1318544537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa634003980 0x7fa634003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:23.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa643fff640 1 --2- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 0x7fa6340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:23.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.957+0000 7fa649730640 1 --2- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa634004d10 0x7fa634005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:23.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.961+0000 7fa648f2f640 1 -- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 msgr2=0x7fa6340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:23.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.961+0000 7fa648f2f640 1 --2- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644152e70 0x7fa6340047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:23.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.961+0000 7fa648f2f640 1 -- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa634004d10 msgr2=0x7fa634005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:23.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.961+0000 7fa648f2f640 1 --2- 172.21.15.96:0/1318544537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa634004d10 0x7fa634005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:23.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.961+0000 7fa648f2f640 1 -- 172.21.15.96:0/1318544537 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa634003530 con 0x7fa634003980 2024-04-18T04:54:23.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.965+0000 7fa648f2f640 1 --2- 172.21.15.96:0/1318544537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa634003980 0x7fa634003da0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa63800e900 tx=0x7fa63801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d67a4c3e95e98b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:23.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.965+0000 7fa6437fe640 1 -- 172.21.15.96:0/1318544537 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6380a6630 con 0x7fa634003980 2024-04-18T04:54:23.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.965+0000 7fa6437fe640 1 -- 172.21.15.96:0/1318544537 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6380a6790 con 0x7fa634003980 2024-04-18T04:54:23.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.965+0000 7fa6437fe640 1 -- 172.21.15.96:0/1318544537 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6380a6b40 con 0x7fa634003980 2024-04-18T04:54:23.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.965+0000 7fa64b193640 1 -- 172.21.15.96:0/1318544537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa634003980 msgr2=0x7fa634003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:23.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.965+0000 7fa64b193640 1 --2- 172.21.15.96:0/1318544537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa634003980 0x7fa634003da0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa63800e900 tx=0x7fa63801c850 comp rx=0 tx=0).stop 2024-04-18T04:54:23.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.965+0000 7fa649730640 1 -- 172.21.15.96:0/1318544537 reap_dead start 2024-04-18T04:54:23.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.965+0000 7fa64b193640 1 -- 172.21.15.96:0/1318544537 shutdown_connections 2024-04-18T04:54:23.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.965+0000 7fa64b193640 1 -- 172.21.15.96:0/1318544537 >> 172.21.15.96:0/1318544537 conn(0x7fa6440661c0 msgr2=0x7fa64406fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:23.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.965+0000 7fa64b193640 1 -- 172.21.15.96:0/1318544537 shutdown_connections 2024-04-18T04:54:23.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.969+0000 7fa64b193640 1 -- 172.21.15.96:0/1318544537 wait complete. 2024-04-18T04:54:23.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa64b193640 1 Processor -- start 2024-04-18T04:54:23.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa64b193640 1 -- start start 2024-04-18T04:54:23.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa64b193640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa634003980 0x7fa644162130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:23.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa64b193640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6440ccd10 0x7fa64415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:23.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa64b193640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa6440ca320 0x7fa6441f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:23.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa64b193640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa644161ca0 con 0x7fa634003980 2024-04-18T04:54:23.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa64b193640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6440ca7d0 con 0x7fa6440ccd10 2024-04-18T04:54:23.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa64b193640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64415c440 con 0x7fa6440ca320 2024-04-18T04:54:23.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa648f2f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa634003980 0x7fa644162130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:23.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa643fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6440ccd10 0x7fa64415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:23.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa649730640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa6440ca320 0x7fa6441f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:23.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa648f2f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa634003980 0x7fa644162130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42858/0 (socket says 172.21.15.96:42858) 2024-04-18T04:54:23.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa648f2f640 1 -- 172.21.15.96:0/851965536 learned_addr learned my addr 172.21.15.96:0/851965536 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:23.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa643fff640 1 -- 172.21.15.96:0/851965536 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa6440ca320 msgr2=0x7fa6441f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:23.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa643fff640 1 --2- 172.21.15.96:0/851965536 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa6440ca320 0x7fa6441f4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:23.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa643fff640 1 -- 172.21.15.96:0/851965536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa634003980 msgr2=0x7fa644162130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:23.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa643fff640 1 --2- 172.21.15.96:0/851965536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa634003980 0x7fa644162130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:23.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa643fff640 1 -- 172.21.15.96:0/851965536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64415c700 con 0x7fa6440ccd10 2024-04-18T04:54:23.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa643fff640 1 --2- 172.21.15.96:0/851965536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6440ccd10 0x7fa64415c9e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa6300128e0 tx=0x7fa630012da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:23.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa6417fa640 1 -- 172.21.15.96:0/851965536 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63000ebc0 con 0x7fa6440ccd10 2024-04-18T04:54:23.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa6417fa640 1 -- 172.21.15.96:0/851965536 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63000c050 con 0x7fa6440ccd10 2024-04-18T04:54:23.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa6417fa640 1 -- 172.21.15.96:0/851965536 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630012ed0 con 0x7fa6440ccd10 2024-04-18T04:54:23.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa64b193640 1 -- 172.21.15.96:0/851965536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa644161650 con 0x7fa6440ccd10 2024-04-18T04:54:23.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa64b193640 1 -- 172.21.15.96:0/851965536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64415a5a0 con 0x7fa6440ccd10 2024-04-18T04:54:23.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.973+0000 7fa6417fa640 1 -- 172.21.15.96:0/851965536 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa630004320 con 0x7fa6440ccd10 2024-04-18T04:54:23.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.977+0000 7fa6417fa640 1 -- 172.21.15.96:0/851965536 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa63001f400 con 0x7fa6440ccd10 2024-04-18T04:54:23.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.977+0000 7fa64b193640 1 -- 172.21.15.96:0/851965536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa644161e10 con 0x7fa6440ccd10 2024-04-18T04:54:23.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:23.989+0000 7fa6417fa640 1 -- 172.21.15.96:0/851965536 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fa630024060 con 0x7fa6440ccd10 2024-04-18T04:54:24.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:24.053+0000 7fa64b193640 1 -- 172.21.15.96:0/851965536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa644067050 con 0x7fa6440ccd10 2024-04-18T04:54:24.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:24.061+0000 7fa6417fa640 1 -- 172.21.15.96:0/851965536 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa63002d020 con 0x7fa6440ccd10 2024-04-18T04:54:24.061 INFO:teuthology.orchestra.run.smithi096.stderr:adjusted tunables profile to default 2024-04-18T04:54:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:24.065+0000 7fa64b193640 1 -- 172.21.15.96:0/851965536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6440ccd10 msgr2=0x7fa64415c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:24.065+0000 7fa64b193640 1 --2- 172.21.15.96:0/851965536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6440ccd10 0x7fa64415c9e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa6300128e0 tx=0x7fa630012da0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:24.065+0000 7fa64b193640 1 -- 172.21.15.96:0/851965536 shutdown_connections 2024-04-18T04:54:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:24.065+0000 7fa64b193640 1 --2- 172.21.15.96:0/851965536 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa6440ca320 0x7fa6441f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:24.065+0000 7fa64b193640 1 --2- 172.21.15.96:0/851965536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6440ccd10 0x7fa64415c9e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:24.065+0000 7fa64b193640 1 --2- 172.21.15.96:0/851965536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa634003980 0x7fa644162130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:24.065+0000 7fa64b193640 1 -- 172.21.15.96:0/851965536 >> 172.21.15.96:0/851965536 conn(0x7fa6440661c0 msgr2=0x7fa644157760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:24.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:24.065+0000 7fa64b193640 1 -- 172.21.15.96:0/851965536 shutdown_connections 2024-04-18T04:54:24.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:24.065+0000 7fa64b193640 1 -- 172.21.15.96:0/851965536 wait complete. 2024-04-18T04:54:24.080 INFO:tasks.ceph:check_enable_crimson: False 2024-04-18T04:54:24.080 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-18T04:54:24.080 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:54:24.080 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-18T04:54:24.092 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:54:24.092 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-18T04:54:24.144 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:54:24.144 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-18T04:54:24.162 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:24.165+0000 7f48b3de5180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-18T04:54:24.172 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:54:24.172 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-18T04:54:24.228 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:54:24.228 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-18T04:54:24.232 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:24.232+0000 7f18aa8bc180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-18T04:54:24.242 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:54:24.242 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-18T04:54:24.295 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:54:24.295 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-18T04:54:24.350 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-18T04:54:24.350 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-18T04:54:24.402 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 6c224c98-68f4-4b58-8fcc-f52da6840a35 0 2024-04-18T04:54:24.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87d55d0640 1 Processor -- start 2024-04-18T04:54:24.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87d55d0640 1 -- start start 2024-04-18T04:54:24.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87d55d0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f87d0159270 0x7f87d01596a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87d55d0640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d01568f0 con 0x7f87d00c8950 2024-04-18T04:54:24.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87d55d0640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d00c34a0 con 0x7f87d0150020 2024-04-18T04:54:24.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87d55d0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d00c4160 con 0x7f87d0159270 2024-04-18T04:54:24.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87ceffd640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f87d0150020 0x7f87d00c2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:39800/0 (socket says 172.21.15.139:39800) 2024-04-18T04:54:24.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87ceffd640 1 -- 172.21.15.139:0/3534888331 learned_addr learned my addr 172.21.15.139:0/3534888331 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-18T04:54:24.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cf7fe640 1 --2- 172.21.15.139:0/3534888331 >> v2:172.21.15.96:3300/0 conn(0x7f87d0159270 0x7f87d01596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cdffb640 1 -- 172.21.15.139:0/3534888331 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849587440 0 0) 0x7f87d00c34a0 con 0x7f87d0150020 2024-04-18T04:54:24.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cdffb640 1 -- 172.21.15.139:0/3534888331 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87b8003530 con 0x7f87d0150020 2024-04-18T04:54:24.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cdffb640 1 -- 172.21.15.139:0/3534888331 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1125100675 0 0) 0x7f87b8003530 con 0x7f87d0150020 2024-04-18T04:54:24.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cdffb640 1 -- 172.21.15.139:0/3534888331 >> v2:172.21.15.96:3300/0 conn(0x7f87d0159270 msgr2=0x7f87d01596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:24.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cdffb640 1 --2- 172.21.15.139:0/3534888331 >> v2:172.21.15.96:3300/0 conn(0x7f87d0159270 0x7f87d01596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cdffb640 1 -- 172.21.15.139:0/3534888331 >> v1:172.21.15.96:6789/0 conn(0x7f87d00c8950 legacy=0x7f87d006ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cdffb640 1 -- 172.21.15.139:0/3534888331 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d0159be0 con 0x7f87d0150020 2024-04-18T04:54:24.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cdffb640 1 -- 172.21.15.139:0/3534888331 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f87c0001680 con 0x7f87d0150020 2024-04-18T04:54:24.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cdffb640 1 -- 172.21.15.139:0/3534888331 >> v1:172.21.15.139:6789/0 conn(0x7f87d0150020 legacy=0x7f87d00c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cdffb640 1 --2- 172.21.15.139:0/3534888331 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f87b8003980 0x7f87b8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cdffb640 1 --2- 172.21.15.139:0/3534888331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87b80047d0 0x7f87b8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cdffb640 1 --2- 172.21.15.139:0/3534888331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87b8005190 0x7f87b800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cdffb640 1 -- 172.21.15.139:0/3534888331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d00c4160 con 0x7f87b8005190 2024-04-18T04:54:24.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cdffb640 1 -- 172.21.15.139:0/3534888331 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b800c030 con 0x7f87b80047d0 2024-04-18T04:54:24.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cdffb640 1 -- 172.21.15.139:0/3534888331 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b800c1f0 con 0x7f87b8003980 2024-04-18T04:54:24.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87ceffd640 1 --2- 172.21.15.139:0/3534888331 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f87b8003980 0x7f87b8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87ce7fc640 1 --2- 172.21.15.139:0/3534888331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87b80047d0 0x7f87b8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cf7fe640 1 --2- 172.21.15.139:0/3534888331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87b8005190 0x7f87b800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87ceffd640 1 -- 172.21.15.139:0/3534888331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87b80047d0 msgr2=0x7f87b8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:24.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87ceffd640 1 --2- 172.21.15.139:0/3534888331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87b80047d0 0x7f87b8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87ceffd640 1 -- 172.21.15.139:0/3534888331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87b8005190 msgr2=0x7f87b800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:24.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87ceffd640 1 --2- 172.21.15.139:0/3534888331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87b8005190 0x7f87b800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87ceffd640 1 -- 172.21.15.139:0/3534888331 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b8003530 con 0x7f87b8003980 2024-04-18T04:54:24.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cf7fe640 1 --2- 172.21.15.139:0/3534888331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87b8005190 0x7f87b800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:54:24.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.564+0000 7f87cf7fe640 1 -- 172.21.15.139:0/3534888331 reap_dead start 2024-04-18T04:54:24.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.568+0000 7f87ceffd640 1 --2- 172.21.15.139:0/3534888331 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f87b8003980 0x7f87b8003da0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f87c000c240 tx=0x7f87c001cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87676e419153b9de server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:24.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.568+0000 7f87cdffb640 1 -- 172.21.15.139:0/3534888331 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c00a5b20 con 0x7f87b8003980 2024-04-18T04:54:24.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.568+0000 7f87cdffb640 1 -- 172.21.15.139:0/3534888331 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c00a5c80 con 0x7f87b8003980 2024-04-18T04:54:24.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.568+0000 7f87cdffb640 1 -- 172.21.15.139:0/3534888331 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0005b20 con 0x7f87b8003980 2024-04-18T04:54:24.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.568+0000 7f87d55d0640 1 -- 172.21.15.139:0/3534888331 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f87b8003980 msgr2=0x7f87b8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.568+0000 7f87d55d0640 1 --2- 172.21.15.139:0/3534888331 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f87b8003980 0x7f87b8003da0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f87c000c240 tx=0x7f87c001cc20 comp rx=0 tx=0).stop 2024-04-18T04:54:24.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.568+0000 7f87d55d0640 1 -- 172.21.15.139:0/3534888331 shutdown_connections 2024-04-18T04:54:24.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.568+0000 7f87d55d0640 1 --2- 172.21.15.139:0/3534888331 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f87b8003980 0x7f87b8003da0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.568+0000 7f87d55d0640 1 -- 172.21.15.139:0/3534888331 >> 172.21.15.139:0/3534888331 conn(0x7f87d00cb560 msgr2=0x7f87d00cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:24.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.568+0000 7f87d55d0640 1 -- 172.21.15.139:0/3534888331 shutdown_connections 2024-04-18T04:54:24.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.568+0000 7f87d55d0640 1 -- 172.21.15.139:0/3534888331 wait complete. 2024-04-18T04:54:24.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87d55d0640 1 Processor -- start 2024-04-18T04:54:24.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87d55d0640 1 -- start start 2024-04-18T04:54:24.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87d55d0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87b8003980 0x7f87d01ed280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87d55d0640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f87d0146d00 0x7f87d00c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87d55d0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87d00c7c80 0x7f87d01edd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87d55d0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d00c8100 con 0x7f87d00c7c80 2024-04-18T04:54:24.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87d55d0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d01deee0 con 0x7f87b8003980 2024-04-18T04:54:24.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87d55d0640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d01df1c0 con 0x7f87d0146d00 2024-04-18T04:54:24.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87ce7fc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f87d0146d00 0x7f87d00c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87ce7fc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f87d0146d00 0x7f87d00c7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:42830/0 (socket says 172.21.15.139:42830) 2024-04-18T04:54:24.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87ceffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87b8003980 0x7f87d01ed280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87ce7fc640 1 -- 172.21.15.139:0/2014367493 learned_addr learned my addr 172.21.15.139:0/2014367493 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-18T04:54:24.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87cf7fe640 1 --2- 172.21.15.139:0/2014367493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87d00c7c80 0x7f87d01edd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87ce7fc640 1 -- 172.21.15.139:0/2014367493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87b8003980 msgr2=0x7f87d01ed280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87ce7fc640 1 --2- 172.21.15.139:0/2014367493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87b8003980 0x7f87d01ed280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87ce7fc640 1 -- 172.21.15.139:0/2014367493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87d00c7c80 msgr2=0x7f87d01edd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87ce7fc640 1 --2- 172.21.15.139:0/2014367493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87d00c7c80 0x7f87d01edd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87ce7fc640 1 -- 172.21.15.139:0/2014367493 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d01df4a0 con 0x7f87d0146d00 2024-04-18T04:54:24.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87ce7fc640 1 --2- 172.21.15.139:0/2014367493 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f87d0146d00 0x7f87d00c7740 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f87c4007820 tx=0x7f87c400fc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:24.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87b77fe640 1 -- 172.21.15.139:0/2014367493 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c40050d0 con 0x7f87d0146d00 2024-04-18T04:54:24.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87b77fe640 1 -- 172.21.15.139:0/2014367493 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c4005230 con 0x7f87d0146d00 2024-04-18T04:54:24.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87b77fe640 1 -- 172.21.15.139:0/2014367493 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c400d730 con 0x7f87d0146d00 2024-04-18T04:54:24.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87d55d0640 1 -- 172.21.15.139:0/2014367493 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d01df780 con 0x7f87d0146d00 2024-04-18T04:54:24.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87d55d0640 1 -- 172.21.15.139:0/2014367493 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d01dfd40 con 0x7f87d0146d00 2024-04-18T04:54:24.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87b77fe640 1 -- 172.21.15.139:0/2014367493 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f87c400db90 con 0x7f87d0146d00 2024-04-18T04:54:24.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87b77fe640 1 -- 172.21.15.139:0/2014367493 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f87c4003d00 con 0x7f87d0146d00 2024-04-18T04:54:24.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.572+0000 7f87d55d0640 1 -- 172.21.15.139:0/2014367493 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d01dff00 con 0x7f87d0146d00 2024-04-18T04:54:24.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.576+0000 7f87b77fe640 1 -- 172.21.15.139:0/2014367493 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f87c4003600 con 0x7f87d0146d00 2024-04-18T04:54:24.599 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:24.601+0000 7f48b3de5180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-18T04:54:24.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.644+0000 7f87d55d0640 1 -- 172.21.15.139:0/2014367493 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6c224c98-68f4-4b58-8fcc-f52da6840a35", "id": 0} v 0) v1 -- 0x7f87d0067050 con 0x7f87d0146d00 2024-04-18T04:54:24.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.652+0000 7f87b77fe640 1 -- 172.21.15.139:0/2014367493 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6c224c98-68f4-4b58-8fcc-f52da6840a35", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f87c40037a0 con 0x7f87d0146d00 2024-04-18T04:54:24.653 INFO:teuthology.orchestra.run.smithi139.stdout:0 2024-04-18T04:54:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.652+0000 7f87d55d0640 1 -- 172.21.15.139:0/2014367493 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f87d0146d00 msgr2=0x7f87d00c7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.652+0000 7f87d55d0640 1 --2- 172.21.15.139:0/2014367493 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f87d0146d00 0x7f87d00c7740 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f87c4007820 tx=0x7f87c400fc00 comp rx=0 tx=0).stop 2024-04-18T04:54:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.652+0000 7f87d55d0640 1 -- 172.21.15.139:0/2014367493 shutdown_connections 2024-04-18T04:54:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.652+0000 7f87d55d0640 1 --2- 172.21.15.139:0/2014367493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87d00c7c80 0x7f87d01edd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.652+0000 7f87d55d0640 1 --2- 172.21.15.139:0/2014367493 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f87d0146d00 0x7f87d00c7740 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.652+0000 7f87d55d0640 1 --2- 172.21.15.139:0/2014367493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87b8003980 0x7f87d01ed280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.652+0000 7f87d55d0640 1 -- 172.21.15.139:0/2014367493 >> 172.21.15.139:0/2014367493 conn(0x7f87d00cb560 msgr2=0x7f87d0071680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.652+0000 7f87d55d0640 1 -- 172.21.15.139:0/2014367493 shutdown_connections 2024-04-18T04:54:24.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.652+0000 7f87d55d0640 1 -- 172.21.15.139:0/2014367493 wait complete. 2024-04-18T04:54:24.671 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new f549b00e-f0eb-4405-af21-810ee96bca90 1 2024-04-18T04:54:24.757 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:24.756+0000 7f18aa8bc180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-18T04:54:24.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.784+0000 7f38bf24e640 1 Processor -- start 2024-04-18T04:54:24.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.784+0000 7f38bf24e640 1 -- start start 2024-04-18T04:54:24.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.784+0000 7f38bf24e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f38b8150020 0x7f38b80c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.784+0000 7f38bf24e640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38b80c2fa0 0x7f38b806ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.784+0000 7f38bf24e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b81568f0 con 0x7f38b806efa0 2024-04-18T04:54:24.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.784+0000 7f38bf24e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b80c4160 con 0x7f38b8150020 2024-04-18T04:54:24.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.784+0000 7f38bf24e640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b8155ad0 con 0x7f38b80c2fa0 2024-04-18T04:54:24.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.784+0000 7f38b7fff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38b80c2fa0 0x7f38b806ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.784+0000 7f38b7fff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38b80c2fa0 0x7f38b806ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:42842/0 (socket says 172.21.15.139:42842) 2024-04-18T04:54:24.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.784+0000 7f38b7fff640 1 -- 172.21.15.139:0/2735763655 learned_addr learned my addr 172.21.15.139:0/2735763655 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-18T04:54:24.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.784+0000 7f38bcfea640 1 --2- 172.21.15.139:0/2735763655 >> v2:172.21.15.96:3300/0 conn(0x7f38b8150020 0x7f38b80c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.784+0000 7f38b7fff640 1 -- 172.21.15.139:0/2735763655 >> v2:172.21.15.96:3300/0 conn(0x7f38b8150020 msgr2=0x7f38b80c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:24.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.784+0000 7f38b7fff640 1 --2- 172.21.15.139:0/2735763655 >> v2:172.21.15.96:3300/0 conn(0x7f38b8150020 0x7f38b80c2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.784+0000 7f38b7fff640 1 -- 172.21.15.139:0/2735763655 >> v1:172.21.15.96:6789/0 conn(0x7f38b806efa0 legacy=0x7f38b8159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:24.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.784+0000 7f38b7fff640 1 -- 172.21.15.139:0/2735763655 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b80c34a0 con 0x7f38b80c2fa0 2024-04-18T04:54:24.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.788+0000 7f38b7fff640 1 --2- 172.21.15.139:0/2735763655 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38b80c2fa0 0x7f38b806ea60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009870 tx=0x7f38ac01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a35a7a5984c5df1f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:24.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.788+0000 7f38b77fe640 1 -- 172.21.15.139:0/2735763655 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac0a95f0 con 0x7f38b80c2fa0 2024-04-18T04:54:24.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.788+0000 7f38b77fe640 1 -- 172.21.15.139:0/2735763655 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ac0a9750 con 0x7f38b80c2fa0 2024-04-18T04:54:24.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.788+0000 7f38b77fe640 1 -- 172.21.15.139:0/2735763655 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac0a9ae0 con 0x7f38b80c2fa0 2024-04-18T04:54:24.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.788+0000 7f38bf24e640 1 -- 172.21.15.139:0/2735763655 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38b80c2fa0 msgr2=0x7f38b806ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.788+0000 7f38bf24e640 1 --2- 172.21.15.139:0/2735763655 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38b80c2fa0 0x7f38b806ea60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009870 tx=0x7f38ac01c530 comp rx=0 tx=0).stop 2024-04-18T04:54:24.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.788+0000 7f38bf24e640 1 -- 172.21.15.139:0/2735763655 shutdown_connections 2024-04-18T04:54:24.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.788+0000 7f38bf24e640 1 --2- 172.21.15.139:0/2735763655 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38b80c2fa0 0x7f38b806ea60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.788+0000 7f38bf24e640 1 --2- 172.21.15.139:0/2735763655 >> v2:172.21.15.96:3300/0 conn(0x7f38b8150020 0x7f38b80c2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.788+0000 7f38bf24e640 1 -- 172.21.15.139:0/2735763655 >> 172.21.15.139:0/2735763655 conn(0x7f38b80cb560 msgr2=0x7f38b80cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:24.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.788+0000 7f38bf24e640 1 -- 172.21.15.139:0/2735763655 shutdown_connections 2024-04-18T04:54:24.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.788+0000 7f38bf24e640 1 -- 172.21.15.139:0/2735763655 wait complete. 2024-04-18T04:54:24.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.788+0000 7f38bf24e640 1 Processor -- start 2024-04-18T04:54:24.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.788+0000 7f38bf24e640 1 -- start start 2024-04-18T04:54:24.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bf24e640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38b806efa0 0x7f38b81543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bf24e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38b80c2fa0 0x7f38b81645f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bf24e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38b8150020 0x7f38b80c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bf24e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b8164160 con 0x7f38b80c2fa0 2024-04-18T04:54:24.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bf24e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b814eee0 con 0x7f38b8150020 2024-04-18T04:54:24.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bf24e640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b814f1c0 con 0x7f38b806efa0 2024-04-18T04:54:24.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bcfea640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38b806efa0 0x7f38b81543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bcfea640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38b806efa0 0x7f38b81543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:42846/0 (socket says 172.21.15.139:42846) 2024-04-18T04:54:24.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bd7eb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38b8150020 0x7f38b80c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bcfea640 1 -- 172.21.15.139:0/4119889102 learned_addr learned my addr 172.21.15.139:0/4119889102 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-18T04:54:24.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38b7fff640 1 --2- 172.21.15.139:0/4119889102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38b80c2fa0 0x7f38b81645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bcfea640 1 -- 172.21.15.139:0/4119889102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38b8150020 msgr2=0x7f38b80c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bcfea640 1 --2- 172.21.15.139:0/4119889102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38b8150020 0x7f38b80c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bcfea640 1 -- 172.21.15.139:0/4119889102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38b80c2fa0 msgr2=0x7f38b81645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bcfea640 1 --2- 172.21.15.139:0/4119889102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38b80c2fa0 0x7f38b81645f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bcfea640 1 -- 172.21.15.139:0/4119889102 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac0094d0 con 0x7f38b806efa0 2024-04-18T04:54:24.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bd7eb640 1 --2- 172.21.15.139:0/4119889102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38b8150020 0x7f38b80c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:54:24.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bcfea640 1 --2- 172.21.15.139:0/4119889102 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38b806efa0 0x7f38b81543d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f38a800d620 tx=0x7f38a800dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:24.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38b57fa640 1 -- 172.21.15.139:0/4119889102 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a800b620 con 0x7f38b806efa0 2024-04-18T04:54:24.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38b57fa640 1 -- 172.21.15.139:0/4119889102 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a800b780 con 0x7f38b806efa0 2024-04-18T04:54:24.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bf24e640 1 -- 172.21.15.139:0/4119889102 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b814f4a0 con 0x7f38b806efa0 2024-04-18T04:54:24.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38b57fa640 1 -- 172.21.15.139:0/4119889102 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a800bb10 con 0x7f38b806efa0 2024-04-18T04:54:24.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bf24e640 1 -- 172.21.15.139:0/4119889102 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b8163df0 con 0x7f38b806efa0 2024-04-18T04:54:24.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38b57fa640 1 -- 172.21.15.139:0/4119889102 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f38a801e460 con 0x7f38b806efa0 2024-04-18T04:54:24.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38b57fa640 1 -- 172.21.15.139:0/4119889102 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f38a80148b0 con 0x7f38b806efa0 2024-04-18T04:54:24.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.792+0000 7f38bf24e640 1 -- 172.21.15.139:0/4119889102 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b8067050 con 0x7f38b806efa0 2024-04-18T04:54:24.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.796+0000 7f38b57fa640 1 -- 172.21.15.139:0/4119889102 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f38a8014ac0 con 0x7f38b806efa0 2024-04-18T04:54:24.830 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:24.833+0000 7f48b3de5180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-18T04:54:24.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.864+0000 7f38bf24e640 1 -- 172.21.15.139:0/4119889102 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f549b00e-f0eb-4405-af21-810ee96bca90", "id": 1} v 0) v1 -- 0x7f38b814d630 con 0x7f38b806efa0 2024-04-18T04:54:24.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.876+0000 7f38b57fa640 1 -- 172.21.15.139:0/4119889102 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f549b00e-f0eb-4405-af21-810ee96bca90", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f38a8014d90 con 0x7f38b806efa0 2024-04-18T04:54:24.877 INFO:teuthology.orchestra.run.smithi139.stdout:1 2024-04-18T04:54:24.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.876+0000 7f38bf24e640 1 -- 172.21.15.139:0/4119889102 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38b806efa0 msgr2=0x7f38b81543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.876+0000 7f38bf24e640 1 --2- 172.21.15.139:0/4119889102 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38b806efa0 0x7f38b81543d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f38a800d620 tx=0x7f38a800dae0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.876+0000 7f38bf24e640 1 -- 172.21.15.139:0/4119889102 shutdown_connections 2024-04-18T04:54:24.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.876+0000 7f38bf24e640 1 --2- 172.21.15.139:0/4119889102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38b8150020 0x7f38b80c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.876+0000 7f38bf24e640 1 --2- 172.21.15.139:0/4119889102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38b80c2fa0 0x7f38b81645f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.876+0000 7f38bf24e640 1 --2- 172.21.15.139:0/4119889102 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38b806efa0 0x7f38b81543d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.876+0000 7f38bf24e640 1 -- 172.21.15.139:0/4119889102 >> 172.21.15.139:0/4119889102 conn(0x7f38b80cb560 msgr2=0x7f38b80c4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:24.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.876+0000 7f38bf24e640 1 -- 172.21.15.139:0/4119889102 shutdown_connections 2024-04-18T04:54:24.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:24.876+0000 7f38bf24e640 1 -- 172.21.15.139:0/4119889102 wait complete. 2024-04-18T04:54:24.894 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 696a7659-c87a-4d40-8b78-a34663f26cd2 2 2024-04-18T04:54:25.003 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:25.004+0000 7f18aa8bc180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-18T04:54:25.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.012+0000 7fa922278640 1 Processor -- start 2024-04-18T04:54:25.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.012+0000 7fa922278640 1 -- start start 2024-04-18T04:54:25.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa922278640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa91c0c8950 0x7fa91c06ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa922278640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa91c06efa0 0x7fa91c159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa922278640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa91c1568f0 con 0x7fa91c150020 2024-04-18T04:54:25.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa922278640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91c0c4160 con 0x7fa91c0c8950 2024-04-18T04:54:25.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa922278640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91c155ad0 con 0x7fa91c06efa0 2024-04-18T04:54:25.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa920815640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa91c06efa0 0x7fa91c159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa91bfff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa91c150020 0x7fa91c0c2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:39810/0 (socket says 172.21.15.139:39810) 2024-04-18T04:54:25.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa91bfff640 1 -- 172.21.15.139:0/3320170353 learned_addr learned my addr 172.21.15.139:0/3320170353 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-18T04:54:25.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa913fff640 1 --2- 172.21.15.139:0/3320170353 >> v2:172.21.15.96:3300/0 conn(0x7fa91c0c8950 0x7fa91c06ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa920815640 1 -- 172.21.15.139:0/3320170353 >> v2:172.21.15.96:3300/0 conn(0x7fa91c0c8950 msgr2=0x7fa91c06ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:25.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa920815640 1 --2- 172.21.15.139:0/3320170353 >> v2:172.21.15.96:3300/0 conn(0x7fa91c0c8950 0x7fa91c06ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa920815640 1 -- 172.21.15.139:0/3320170353 >> v1:172.21.15.139:6789/0 conn(0x7fa91c150020 legacy=0x7fa91c0c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa91b7fe640 1 -- 172.21.15.139:0/3320170353 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511158741 0 0) 0x7fa91c1568f0 con 0x7fa91c150020 2024-04-18T04:54:25.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa920815640 1 -- 172.21.15.139:0/3320170353 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c0c34a0 con 0x7fa91c06efa0 2024-04-18T04:54:25.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa913fff640 1 --2- 172.21.15.139:0/3320170353 >> v2:172.21.15.96:3300/0 conn(0x7fa91c0c8950 0x7fa91c06ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:25.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa920815640 1 --2- 172.21.15.139:0/3320170353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa91c06efa0 0x7fa91c159270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0667c0 tx=0x7fa91401c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4ee44ae9a08e2e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:25.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa91b7fe640 1 -- 172.21.15.139:0/3320170353 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9140a59f0 con 0x7fa91c06efa0 2024-04-18T04:54:25.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa91b7fe640 1 -- 172.21.15.139:0/3320170353 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9140a5b50 con 0x7fa91c06efa0 2024-04-18T04:54:25.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.016+0000 7fa91b7fe640 1 -- 172.21.15.139:0/3320170353 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9140ad440 con 0x7fa91c06efa0 2024-04-18T04:54:25.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 -- 172.21.15.139:0/3320170353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa91c06efa0 msgr2=0x7fa91c159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 --2- 172.21.15.139:0/3320170353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa91c06efa0 0x7fa91c159270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0667c0 tx=0x7fa91401c930 comp rx=0 tx=0).stop 2024-04-18T04:54:25.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 -- 172.21.15.139:0/3320170353 shutdown_connections 2024-04-18T04:54:25.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 --2- 172.21.15.139:0/3320170353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa91c06efa0 0x7fa91c159270 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 --2- 172.21.15.139:0/3320170353 >> v2:172.21.15.96:3300/0 conn(0x7fa91c0c8950 0x7fa91c06ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 -- 172.21.15.139:0/3320170353 >> 172.21.15.139:0/3320170353 conn(0x7fa91c0cb560 msgr2=0x7fa91c0cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:25.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 -- 172.21.15.139:0/3320170353 shutdown_connections 2024-04-18T04:54:25.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 -- 172.21.15.139:0/3320170353 wait complete. 2024-04-18T04:54:25.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 Processor -- start 2024-04-18T04:54:25.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 -- start start 2024-04-18T04:54:25.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa91c06efa0 0x7fa91c158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa91c0c8950 0x7fa91c1f5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa91c150020 0x7fa91c145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c1590a0 con 0x7fa91c0c8950 2024-04-18T04:54:25.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c1f59d0 con 0x7fa91c06efa0 2024-04-18T04:54:25.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c158840 con 0x7fa91c150020 2024-04-18T04:54:25.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa91bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa91c06efa0 0x7fa91c158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa91bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa91c06efa0 0x7fa91c158220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41972/0 (socket says 172.21.15.139:41972) 2024-04-18T04:54:25.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa91bfff640 1 -- 172.21.15.139:0/2536867301 learned_addr learned my addr 172.21.15.139:0/2536867301 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-18T04:54:25.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa920815640 1 --2- 172.21.15.139:0/2536867301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa91c150020 0x7fa91c145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa913fff640 1 --2- 172.21.15.139:0/2536867301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa91c0c8950 0x7fa91c1f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa920815640 1 -- 172.21.15.139:0/2536867301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa91c06efa0 msgr2=0x7fa91c158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa920815640 1 --2- 172.21.15.139:0/2536867301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa91c06efa0 0x7fa91c158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa920815640 1 -- 172.21.15.139:0/2536867301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa91c0c8950 msgr2=0x7fa91c1f5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa920815640 1 --2- 172.21.15.139:0/2536867301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa91c0c8950 0x7fa91c1f5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa920815640 1 -- 172.21.15.139:0/2536867301 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa914009a70 con 0x7fa91c150020 2024-04-18T04:54:25.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa91bfff640 1 --2- 172.21.15.139:0/2536867301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa91c06efa0 0x7fa91c158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:54:25.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa920815640 1 --2- 172.21.15.139:0/2536867301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa91c150020 0x7fa91c145450 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa91c155c10 tx=0x7fa9140196d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:25.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa9197fa640 1 -- 172.21.15.139:0/2536867301 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9140ade80 con 0x7fa91c150020 2024-04-18T04:54:25.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa9197fa640 1 -- 172.21.15.139:0/2536867301 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9140b9450 con 0x7fa91c150020 2024-04-18T04:54:25.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 -- 172.21.15.139:0/2536867301 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91c158ae0 con 0x7fa91c150020 2024-04-18T04:54:25.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa9197fa640 1 -- 172.21.15.139:0/2536867301 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9140b97e0 con 0x7fa91c150020 2024-04-18T04:54:25.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa922278640 1 -- 172.21.15.139:0/2536867301 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91c1f4c90 con 0x7fa91c150020 2024-04-18T04:54:25.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa9197fa640 1 -- 172.21.15.139:0/2536867301 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa9140b9c40 con 0x7fa91c150020 2024-04-18T04:54:25.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.020+0000 7fa9197fa640 1 -- 172.21.15.139:0/2536867301 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fa9140b7400 con 0x7fa91c150020 2024-04-18T04:54:25.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.024+0000 7fa922278640 1 -- 172.21.15.139:0/2536867301 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91c1f4af0 con 0x7fa91c150020 2024-04-18T04:54:25.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.024+0000 7fa9197fa640 1 -- 172.21.15.139:0/2536867301 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fa91c1f4af0 con 0x7fa91c150020 2024-04-18T04:54:25.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.092+0000 7fa922278640 1 -- 172.21.15.139:0/2536867301 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd new", "uuid": "696a7659-c87a-4d40-8b78-a34663f26cd2", "id": 2} v 0) v1 -- 0x7fa91c067050 con 0x7fa91c150020 2024-04-18T04:54:25.165 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.104+0000 7fa9197fa640 1 -- 172.21.15.139:0/2536867301 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "696a7659-c87a-4d40-8b78-a34663f26cd2", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa9140b2070 con 0x7fa91c150020 2024-04-18T04:54:25.166 INFO:teuthology.orchestra.run.smithi139.stdout:2 2024-04-18T04:54:25.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.104+0000 7fa922278640 1 -- 172.21.15.139:0/2536867301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa91c150020 msgr2=0x7fa91c145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.104+0000 7fa922278640 1 --2- 172.21.15.139:0/2536867301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa91c150020 0x7fa91c145450 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa91c155c10 tx=0x7fa9140196d0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.104+0000 7fa922278640 1 -- 172.21.15.139:0/2536867301 shutdown_connections 2024-04-18T04:54:25.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.104+0000 7fa922278640 1 --2- 172.21.15.139:0/2536867301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa91c150020 0x7fa91c145450 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.104+0000 7fa922278640 1 --2- 172.21.15.139:0/2536867301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa91c0c8950 0x7fa91c1f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.104+0000 7fa922278640 1 --2- 172.21.15.139:0/2536867301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa91c06efa0 0x7fa91c158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.104+0000 7fa922278640 1 -- 172.21.15.139:0/2536867301 >> 172.21.15.139:0/2536867301 conn(0x7fa91c0cb560 msgr2=0x7fa91c072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:25.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.104+0000 7fa922278640 1 -- 172.21.15.139:0/2536867301 shutdown_connections 2024-04-18T04:54:25.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.104+0000 7fa922278640 1 -- 172.21.15.139:0/2536867301 wait complete. 2024-04-18T04:54:25.167 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 3478e035-79f8-42c6-8fd3-9bcaa33b81f8 3 2024-04-18T04:54:25.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.280+0000 7f40d8260640 1 Processor -- start 2024-04-18T04:54:25.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.280+0000 7f40d8260640 1 -- start start 2024-04-18T04:54:25.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.280+0000 7f40d8260640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f40d0150f50 0x7f40d00c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.280+0000 7f40d8260640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f40d00c1640 0x7f40d0157250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.280+0000 7f40d8260640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d0156dc0 con 0x7f40d0157790 2024-04-18T04:54:25.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.280+0000 7f40d8260640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d0157bc0 con 0x7f40d00c1640 2024-04-18T04:54:25.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.280+0000 7f40d8260640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d00c7610 con 0x7f40d0150f50 2024-04-18T04:54:25.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.280+0000 7f40d5ffc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f40d0150f50 0x7f40d00c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.280+0000 7f40d67fd640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f40d0157790 0x7f40d00c8c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:39822/0 (socket says 172.21.15.139:39822) 2024-04-18T04:54:25.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.280+0000 7f40d67fd640 1 -- 172.21.15.139:0/1395588365 learned_addr learned my addr 172.21.15.139:0/1395588365 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-18T04:54:25.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.280+0000 7f40d57fb640 1 --2- 172.21.15.139:0/1395588365 >> v2:172.21.15.96:3300/0 conn(0x7f40d00c1640 0x7f40d0157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.280+0000 7f40d5ffc640 1 -- 172.21.15.139:0/1395588365 >> v2:172.21.15.96:3300/0 conn(0x7f40d00c1640 msgr2=0x7f40d0157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:25.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.280+0000 7f40d5ffc640 1 --2- 172.21.15.139:0/1395588365 >> v2:172.21.15.96:3300/0 conn(0x7f40d00c1640 0x7f40d0157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.280+0000 7f40d5ffc640 1 -- 172.21.15.139:0/1395588365 >> v1:172.21.15.139:6789/0 conn(0x7f40d0157790 legacy=0x7f40d00c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.280+0000 7f40d4ffa640 1 -- 172.21.15.139:0/1395588365 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639858882 0 0) 0x7f40d0156dc0 con 0x7f40d0157790 2024-04-18T04:54:25.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.280+0000 7f40d5ffc640 1 -- 172.21.15.139:0/1395588365 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d00c1f60 con 0x7f40d0150f50 2024-04-18T04:54:25.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.284+0000 7f40d5ffc640 1 --2- 172.21.15.139:0/1395588365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40d0150f50 0x7f40d00c70d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f40d00c9b80 tx=0x7f40cc01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f33f25fda0b57f6c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:25.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.284+0000 7f40d4ffa640 1 -- 172.21.15.139:0/1395588365 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc0a8970 con 0x7f40d0150f50 2024-04-18T04:54:25.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.284+0000 7f40d4ffa640 1 -- 172.21.15.139:0/1395588365 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc0a8ad0 con 0x7f40d0150f50 2024-04-18T04:54:25.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.284+0000 7f40d4ffa640 1 -- 172.21.15.139:0/1395588365 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc0a8e60 con 0x7f40d0150f50 2024-04-18T04:54:25.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.284+0000 7f40d8260640 1 -- 172.21.15.139:0/1395588365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40d0150f50 msgr2=0x7f40d00c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.284+0000 7f40d8260640 1 --2- 172.21.15.139:0/1395588365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40d0150f50 0x7f40d00c70d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f40d00c9b80 tx=0x7f40cc01ec70 comp rx=0 tx=0).stop 2024-04-18T04:54:25.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.284+0000 7f40d8260640 1 -- 172.21.15.139:0/1395588365 shutdown_connections 2024-04-18T04:54:25.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.284+0000 7f40d8260640 1 --2- 172.21.15.139:0/1395588365 >> v2:172.21.15.96:3300/0 conn(0x7f40d00c1640 0x7f40d0157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.284+0000 7f40d8260640 1 --2- 172.21.15.139:0/1395588365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40d0150f50 0x7f40d00c70d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.284+0000 7f40d8260640 1 -- 172.21.15.139:0/1395588365 >> 172.21.15.139:0/1395588365 conn(0x7f40d006fb50 msgr2=0x7f40d006ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:25.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.284+0000 7f40d8260640 1 -- 172.21.15.139:0/1395588365 shutdown_connections 2024-04-18T04:54:25.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.284+0000 7f40d8260640 1 -- 172.21.15.139:0/1395588365 wait complete. 2024-04-18T04:54:25.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.284+0000 7f40d8260640 1 Processor -- start 2024-04-18T04:54:25.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.284+0000 7f40d8260640 1 -- start start 2024-04-18T04:54:25.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d8260640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40d00c1640 0x7f40d01e10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d8260640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f40d0150f50 0x7f40d01e15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d8260640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d0157790 0x7f40d006bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d8260640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d01e1f50 con 0x7f40d0157790 2024-04-18T04:54:25.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d8260640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d01468c0 con 0x7f40d00c1640 2024-04-18T04:54:25.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d8260640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d006cab0 con 0x7f40d0150f50 2024-04-18T04:54:25.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d57fb640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f40d0150f50 0x7f40d01e15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d5ffc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40d00c1640 0x7f40d01e10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d57fb640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f40d0150f50 0x7f40d01e15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:42872/0 (socket says 172.21.15.139:42872) 2024-04-18T04:54:25.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d57fb640 1 -- 172.21.15.139:0/4076412266 learned_addr learned my addr 172.21.15.139:0/4076412266 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-18T04:54:25.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d5ffc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40d00c1640 0x7f40d01e10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41984/0 (socket says 172.21.15.139:41984) 2024-04-18T04:54:25.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d67fd640 1 --2- 172.21.15.139:0/4076412266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d0157790 0x7f40d006bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d5ffc640 1 -- 172.21.15.139:0/4076412266 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f40d0150f50 msgr2=0x7f40d01e15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d5ffc640 1 --2- 172.21.15.139:0/4076412266 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f40d0150f50 0x7f40d01e15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d5ffc640 1 -- 172.21.15.139:0/4076412266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d0157790 msgr2=0x7f40d006bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d5ffc640 1 --2- 172.21.15.139:0/4076412266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d0157790 0x7f40d006bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d5ffc640 1 -- 172.21.15.139:0/4076412266 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc009420 con 0x7f40d00c1640 2024-04-18T04:54:25.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d57fb640 1 --2- 172.21.15.139:0/4076412266 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f40d0150f50 0x7f40d01e15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:54:25.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d67fd640 1 --2- 172.21.15.139:0/4076412266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d0157790 0x7f40d006bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:54:25.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d5ffc640 1 --2- 172.21.15.139:0/4076412266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40d00c1640 0x7f40d01e10b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0af000 tx=0x7f40cc01ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:25.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40c67fc640 1 -- 172.21.15.139:0/4076412266 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc0be070 con 0x7f40d00c1640 2024-04-18T04:54:25.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40c67fc640 1 -- 172.21.15.139:0/4076412266 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc0b9430 con 0x7f40d00c1640 2024-04-18T04:54:25.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d8260640 1 -- 172.21.15.139:0/4076412266 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d006cd90 con 0x7f40d00c1640 2024-04-18T04:54:25.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40c67fc640 1 -- 172.21.15.139:0/4076412266 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc0b97c0 con 0x7f40d00c1640 2024-04-18T04:54:25.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d8260640 1 -- 172.21.15.139:0/4076412266 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d01e3540 con 0x7f40d00c1640 2024-04-18T04:54:25.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40c67fc640 1 -- 172.21.15.139:0/4076412266 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f40cc0b7040 con 0x7f40d00c1640 2024-04-18T04:54:25.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40c67fc640 1 -- 172.21.15.139:0/4076412266 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f40cc0c3940 con 0x7f40d00c1640 2024-04-18T04:54:25.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.288+0000 7f40d8260640 1 -- 172.21.15.139:0/4076412266 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d01e30a0 con 0x7f40d00c1640 2024-04-18T04:54:25.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.292+0000 7f40c67fc640 1 -- 172.21.15.139:0/4076412266 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f40cc0b5070 con 0x7f40d00c1640 2024-04-18T04:54:25.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.360+0000 7f40d8260640 1 -- 172.21.15.139:0/4076412266 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3478e035-79f8-42c6-8fd3-9bcaa33b81f8", "id": 3} v 0) v1 -- 0x7f40d0067050 con 0x7f40d00c1640 2024-04-18T04:54:25.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.368+0000 7f40c67fc640 1 -- 172.21.15.139:0/4076412266 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3478e035-79f8-42c6-8fd3-9bcaa33b81f8", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f40cc0c34b0 con 0x7f40d00c1640 2024-04-18T04:54:25.369 INFO:teuthology.orchestra.run.smithi139.stdout:3 2024-04-18T04:54:25.369 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:25.373+0000 7f48b3de5180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-18T04:54:25.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.368+0000 7f40d8260640 1 -- 172.21.15.139:0/4076412266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40d00c1640 msgr2=0x7f40d01e10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.368+0000 7f40d8260640 1 --2- 172.21.15.139:0/4076412266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40d00c1640 0x7f40d01e10b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0af000 tx=0x7f40cc01ba10 comp rx=0 tx=0).stop 2024-04-18T04:54:25.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.368+0000 7f40d8260640 1 -- 172.21.15.139:0/4076412266 shutdown_connections 2024-04-18T04:54:25.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.368+0000 7f40d8260640 1 --2- 172.21.15.139:0/4076412266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40d0157790 0x7f40d006bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.368+0000 7f40d8260640 1 --2- 172.21.15.139:0/4076412266 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f40d0150f50 0x7f40d01e15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.368+0000 7f40d8260640 1 --2- 172.21.15.139:0/4076412266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40d00c1640 0x7f40d01e10b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.368+0000 7f40d8260640 1 -- 172.21.15.139:0/4076412266 >> 172.21.15.139:0/4076412266 conn(0x7f40d006fb50 msgr2=0x7f40d014b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:25.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.368+0000 7f40d8260640 1 -- 172.21.15.139:0/4076412266 shutdown_connections 2024-04-18T04:54:25.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.368+0000 7f40d8260640 1 -- 172.21.15.139:0/4076412266 wait complete. 2024-04-18T04:54:25.386 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 153e8e45-7303-4173-97ab-f99f7243c9d4 4 2024-04-18T04:54:25.423 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:25.425+0000 7f48b3de5180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-18T04:54:25.474 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:25.477+0000 7f48b3de5180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-18T04:54:25.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.496+0000 7f0762d4f640 1 Processor -- start 2024-04-18T04:54:25.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.496+0000 7f0762d4f640 1 -- start start 2024-04-18T04:54:25.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.496+0000 7f0762d4f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f075c0c70c0 0x7f075c1571c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.496+0000 7f0762d4f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075c156d30 con 0x7f075c151110 2024-04-18T04:54:25.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.496+0000 7f0762d4f640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075c0c1810 con 0x7f075c0c8ba0 2024-04-18T04:54:25.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.496+0000 7f0762d4f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0c82e0 con 0x7f075c0c70c0 2024-04-18T04:54:25.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.496+0000 7f075bfff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f075c0c70c0 0x7f075c1571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.496+0000 7f07612ec640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f075c0c8ba0 0x7f075c161550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:39826/0 (socket says 172.21.15.139:39826) 2024-04-18T04:54:25.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.496+0000 7f07612ec640 1 -- 172.21.15.139:0/2211656660 learned_addr learned my addr 172.21.15.139:0/2211656660 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-18T04:54:25.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.496+0000 7f075b7fe640 1 -- 172.21.15.139:0/2211656660 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824830427 0 0) 0x7f075c0c1810 con 0x7f075c0c8ba0 2024-04-18T04:54:25.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.496+0000 7f075b7fe640 1 -- 172.21.15.139:0/2211656660 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f074c003530 con 0x7f075c0c8ba0 2024-04-18T04:54:25.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.496+0000 7f075bfff640 1 -- 172.21.15.139:0/2211656660 >> v1:172.21.15.139:6789/0 conn(0x7f075c0c8ba0 legacy=0x7f075c161550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.496+0000 7f075bfff640 1 -- 172.21.15.139:0/2211656660 >> v1:172.21.15.96:6789/0 conn(0x7f075c151110 legacy=0x7f075c06ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.496+0000 7f075bfff640 1 -- 172.21.15.139:0/2211656660 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c0c85c0 con 0x7f075c0c70c0 2024-04-18T04:54:25.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.500+0000 7f075bfff640 1 --2- 172.21.15.139:0/2211656660 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f075c0c70c0 0x7f075c1571c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f07480097f0 tx=0x7f074801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a61b9ee6a64e99b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:25.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.500+0000 7f075b7fe640 1 -- 172.21.15.139:0/2211656660 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480aa5f0 con 0x7f075c0c70c0 2024-04-18T04:54:25.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.500+0000 7f075b7fe640 1 -- 172.21.15.139:0/2211656660 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07480aa750 con 0x7f075c0c70c0 2024-04-18T04:54:25.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.500+0000 7f075b7fe640 1 -- 172.21.15.139:0/2211656660 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480aaae0 con 0x7f075c0c70c0 2024-04-18T04:54:25.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.500+0000 7f0762d4f640 1 -- 172.21.15.139:0/2211656660 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f075c0c70c0 msgr2=0x7f075c1571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.500+0000 7f0762d4f640 1 --2- 172.21.15.139:0/2211656660 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f075c0c70c0 0x7f075c1571c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f07480097f0 tx=0x7f074801c4b0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.500+0000 7f0762d4f640 1 -- 172.21.15.139:0/2211656660 shutdown_connections 2024-04-18T04:54:25.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.500+0000 7f0762d4f640 1 --2- 172.21.15.139:0/2211656660 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f075c0c70c0 0x7f075c1571c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.500+0000 7f0762d4f640 1 -- 172.21.15.139:0/2211656660 >> 172.21.15.139:0/2211656660 conn(0x7f075c06ed60 msgr2=0x7f075c06f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:25.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.500+0000 7f0762d4f640 1 -- 172.21.15.139:0/2211656660 shutdown_connections 2024-04-18T04:54:25.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.500+0000 7f0762d4f640 1 -- 172.21.15.139:0/2211656660 wait complete. 2024-04-18T04:54:25.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f0762d4f640 1 Processor -- start 2024-04-18T04:54:25.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f0762d4f640 1 -- start start 2024-04-18T04:54:25.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f0762d4f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f075c0c70c0 0x7f075c1402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f0762d4f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075c0c8ba0 0x7f075c1ef910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f0762d4f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f075c151110 0x7f075c1efe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f0762d4f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0b2100 con 0x7f075c151110 2024-04-18T04:54:25.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f0762d4f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c140800 con 0x7f075c0c8ba0 2024-04-18T04:54:25.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f0762d4f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c1516b0 con 0x7f075c0c70c0 2024-04-18T04:54:25.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f0760aeb640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f075c0c70c0 0x7f075c1402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f075bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075c0c8ba0 0x7f075c1ef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f075bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075c0c8ba0 0x7f075c1ef910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41998/0 (socket says 172.21.15.139:41998) 2024-04-18T04:54:25.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f075bfff640 1 -- 172.21.15.139:0/3274381821 learned_addr learned my addr 172.21.15.139:0/3274381821 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-18T04:54:25.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f0760aeb640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f075c0c70c0 0x7f075c1402c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:42884/0 (socket says 172.21.15.139:42884) 2024-04-18T04:54:25.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f07612ec640 1 --2- 172.21.15.139:0/3274381821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f075c151110 0x7f075c1efe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f075bfff640 1 -- 172.21.15.139:0/3274381821 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f075c0c70c0 msgr2=0x7f075c1402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f075bfff640 1 --2- 172.21.15.139:0/3274381821 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f075c0c70c0 0x7f075c1402c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f075bfff640 1 -- 172.21.15.139:0/3274381821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f075c151110 msgr2=0x7f075c1efe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f075bfff640 1 --2- 172.21.15.139:0/3274381821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f075c151110 0x7f075c1efe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f075bfff640 1 -- 172.21.15.139:0/3274381821 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0748009420 con 0x7f075c0c8ba0 2024-04-18T04:54:25.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f0760aeb640 1 --2- 172.21.15.139:0/3274381821 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f075c0c70c0 0x7f075c1402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:54:25.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f075bfff640 1 --2- 172.21.15.139:0/3274381821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075c0c8ba0 0x7f075c1ef910 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f07480ac040 tx=0x7f074801acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:25.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f07597fa640 1 -- 172.21.15.139:0/3274381821 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480be610 con 0x7f075c0c8ba0 2024-04-18T04:54:25.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f07597fa640 1 -- 172.21.15.139:0/3274381821 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07480be790 con 0x7f075c0c8ba0 2024-04-18T04:54:25.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f0762d4f640 1 -- 172.21.15.139:0/3274381821 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075c140fd0 con 0x7f075c0c8ba0 2024-04-18T04:54:25.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f07597fa640 1 -- 172.21.15.139:0/3274381821 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480beb40 con 0x7f075c0c8ba0 2024-04-18T04:54:25.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f0762d4f640 1 -- 172.21.15.139:0/3274381821 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075c0b1dc0 con 0x7f075c0c8ba0 2024-04-18T04:54:25.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f07597fa640 1 -- 172.21.15.139:0/3274381821 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f07480b4400 con 0x7f075c0c8ba0 2024-04-18T04:54:25.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f07597fa640 1 -- 172.21.15.139:0/3274381821 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f07480a7070 con 0x7f075c0c8ba0 2024-04-18T04:54:25.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.504+0000 7f0762d4f640 1 -- 172.21.15.139:0/3274381821 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075c067050 con 0x7f075c0c8ba0 2024-04-18T04:54:25.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.508+0000 7f07597fa640 1 -- 172.21.15.139:0/3274381821 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f07480b46b0 con 0x7f075c0c8ba0 2024-04-18T04:54:25.551 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:25.553+0000 7f48b3de5180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-18T04:54:25.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.576+0000 7f0762d4f640 1 -- 172.21.15.139:0/3274381821 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "153e8e45-7303-4173-97ab-f99f7243c9d4", "id": 4} v 0) v1 -- 0x7f075c0c9760 con 0x7f075c0c8ba0 2024-04-18T04:54:25.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.584+0000 7f07597fa640 1 -- 172.21.15.139:0/3274381821 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "153e8e45-7303-4173-97ab-f99f7243c9d4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f07480b4850 con 0x7f075c0c8ba0 2024-04-18T04:54:25.586 INFO:teuthology.orchestra.run.smithi139.stdout:4 2024-04-18T04:54:25.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.588+0000 7f0762d4f640 1 -- 172.21.15.139:0/3274381821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075c0c8ba0 msgr2=0x7f075c1ef910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.588+0000 7f0762d4f640 1 --2- 172.21.15.139:0/3274381821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075c0c8ba0 0x7f075c1ef910 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f07480ac040 tx=0x7f074801acf0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.588+0000 7f0762d4f640 1 -- 172.21.15.139:0/3274381821 shutdown_connections 2024-04-18T04:54:25.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.588+0000 7f0762d4f640 1 --2- 172.21.15.139:0/3274381821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f075c151110 0x7f075c1efe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.588+0000 7f0762d4f640 1 --2- 172.21.15.139:0/3274381821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075c0c8ba0 0x7f075c1ef910 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.588+0000 7f0762d4f640 1 --2- 172.21.15.139:0/3274381821 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f075c0c70c0 0x7f075c1402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.588+0000 7f0762d4f640 1 -- 172.21.15.139:0/3274381821 >> 172.21.15.139:0/3274381821 conn(0x7f075c06ed60 msgr2=0x7f075c14f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:25.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.588+0000 7f0762d4f640 1 -- 172.21.15.139:0/3274381821 shutdown_connections 2024-04-18T04:54:25.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.588+0000 7f0762d4f640 1 -- 172.21.15.139:0/3274381821 wait complete. 2024-04-18T04:54:25.588 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:25.588+0000 7f18aa8bc180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-18T04:54:25.603 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 3c75746b-7345-48b7-8c5d-22cd241b77c7 5 2024-04-18T04:54:25.603 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:25.605+0000 7f48b3de5180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-18T04:54:25.645 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:25.644+0000 7f18aa8bc180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-18T04:54:25.679 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:25.681+0000 7f48b3de5180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-18T04:54:25.699 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:25.700+0000 7f18aa8bc180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-18T04:54:25.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.716+0000 7f5919199640 1 Processor -- start 2024-04-18T04:54:25.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.716+0000 7f5919199640 1 -- start start 2024-04-18T04:54:25.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.716+0000 7f5919199640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5914150ec0 0x7f59140c8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.716+0000 7f5919199640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f59140cc530 0x7f59140cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.716+0000 7f5919199640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59140c76d0 con 0x7f5914156ce0 2024-04-18T04:54:25.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.716+0000 7f5919199640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59140c1850 con 0x7f5914150ec0 2024-04-18T04:54:25.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.716+0000 7f5919199640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59140c87f0 con 0x7f59140cc530 2024-04-18T04:54:25.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.716+0000 7f591359e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f59140cc530 0x7f59140cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.716+0000 7f591359e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f59140cc530 0x7f59140cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42002/0 (socket says 172.21.15.139:42002) 2024-04-18T04:54:25.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.716+0000 7f591359e640 1 -- 172.21.15.139:0/558109983 learned_addr learned my addr 172.21.15.139:0/558109983 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-18T04:54:25.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.716+0000 7f5912d9d640 1 --2- 172.21.15.139:0/558109983 >> v2:172.21.15.96:3300/0 conn(0x7f5914150ec0 0x7f59140c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.716+0000 7f591359e640 1 -- 172.21.15.139:0/558109983 >> v2:172.21.15.96:3300/0 conn(0x7f5914150ec0 msgr2=0x7f59140c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:25.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.716+0000 7f591359e640 1 --2- 172.21.15.139:0/558109983 >> v2:172.21.15.96:3300/0 conn(0x7f5914150ec0 0x7f59140c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.716+0000 7f591359e640 1 -- 172.21.15.139:0/558109983 >> v1:172.21.15.96:6789/0 conn(0x7f5914156ce0 legacy=0x7f59140c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:25.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.716+0000 7f591359e640 1 -- 172.21.15.139:0/558109983 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59140c8ad0 con 0x7f59140cc530 2024-04-18T04:54:25.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.720+0000 7f591359e640 1 --2- 172.21.15.139:0/558109983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59140cc530 0x7f59140cc980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f59140afa10 tx=0x7f590c01f1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27ed3e657182a618 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:25.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.720+0000 7f5911d9b640 1 -- 172.21.15.139:0/558109983 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c0af400 con 0x7f59140cc530 2024-04-18T04:54:25.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.720+0000 7f5911d9b640 1 -- 172.21.15.139:0/558109983 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c0ab050 con 0x7f59140cc530 2024-04-18T04:54:25.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.720+0000 7f5911d9b640 1 -- 172.21.15.139:0/558109983 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c0af780 con 0x7f59140cc530 2024-04-18T04:54:25.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.720+0000 7f5919199640 1 -- 172.21.15.139:0/558109983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59140cc530 msgr2=0x7f59140cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.720+0000 7f5919199640 1 --2- 172.21.15.139:0/558109983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59140cc530 0x7f59140cc980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f59140afa10 tx=0x7f590c01f1a0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.720+0000 7f5919199640 1 -- 172.21.15.139:0/558109983 shutdown_connections 2024-04-18T04:54:25.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.720+0000 7f5919199640 1 --2- 172.21.15.139:0/558109983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59140cc530 0x7f59140cc980 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.720+0000 7f5919199640 1 --2- 172.21.15.139:0/558109983 >> v2:172.21.15.96:3300/0 conn(0x7f5914150ec0 0x7f59140c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.720+0000 7f5919199640 1 -- 172.21.15.139:0/558109983 >> 172.21.15.139:0/558109983 conn(0x7f591406fbf0 msgr2=0x7f5914070000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:25.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.720+0000 7f5919199640 1 -- 172.21.15.139:0/558109983 shutdown_connections 2024-04-18T04:54:25.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.720+0000 7f5919199640 1 -- 172.21.15.139:0/558109983 wait complete. 2024-04-18T04:54:25.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f5919199640 1 Processor -- start 2024-04-18T04:54:25.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f5919199640 1 -- start start 2024-04-18T04:54:25.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f5919199640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59140cc530 0x7f5914157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f5919199640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5914150ec0 0x7f59141ec9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f5919199640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5914156ce0 0x7f59141ecef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f5919199640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591414d140 con 0x7f5914150ec0 2024-04-18T04:54:25.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f5919199640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59141f02f0 con 0x7f59140cc530 2024-04-18T04:54:25.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f5919199640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591406f000 con 0x7f5914156ce0 2024-04-18T04:54:25.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f5912d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59140cc530 0x7f5914157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f5912d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59140cc530 0x7f5914157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42014/0 (socket says 172.21.15.139:42014) 2024-04-18T04:54:25.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f5912d9d640 1 -- 172.21.15.139:0/2177052082 learned_addr learned my addr 172.21.15.139:0/2177052082 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-18T04:54:25.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f591359e640 1 --2- 172.21.15.139:0/2177052082 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5914156ce0 0x7f59141ecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f591259c640 1 --2- 172.21.15.139:0/2177052082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5914150ec0 0x7f59141ec9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f591359e640 1 -- 172.21.15.139:0/2177052082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59140cc530 msgr2=0x7f5914157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f591359e640 1 --2- 172.21.15.139:0/2177052082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59140cc530 0x7f5914157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f591359e640 1 -- 172.21.15.139:0/2177052082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5914150ec0 msgr2=0x7f59141ec9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f591359e640 1 --2- 172.21.15.139:0/2177052082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5914150ec0 0x7f59141ec9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f591359e640 1 -- 172.21.15.139:0/2177052082 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c009b30 con 0x7f5914156ce0 2024-04-18T04:54:25.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f5912d9d640 1 --2- 172.21.15.139:0/2177052082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59140cc530 0x7f5914157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:54:25.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f591359e640 1 --2- 172.21.15.139:0/2177052082 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5914156ce0 0x7f59141ecef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f590c0ae000 tx=0x7f590c01bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:25.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f58fb7fe640 1 -- 172.21.15.139:0/2177052082 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c0afdc0 con 0x7f5914156ce0 2024-04-18T04:54:25.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f58fb7fe640 1 -- 172.21.15.139:0/2177052082 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c009510 con 0x7f5914156ce0 2024-04-18T04:54:25.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f5919199640 1 -- 172.21.15.139:0/2177052082 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59141ec4d0 con 0x7f5914156ce0 2024-04-18T04:54:25.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f58fb7fe640 1 -- 172.21.15.139:0/2177052082 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c0ba640 con 0x7f5914156ce0 2024-04-18T04:54:25.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f5919199640 1 -- 172.21.15.139:0/2177052082 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59141f04e0 con 0x7f5914156ce0 2024-04-18T04:54:25.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f58fb7fe640 1 -- 172.21.15.139:0/2177052082 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f590c0b6040 con 0x7f5914156ce0 2024-04-18T04:54:25.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f58fb7fe640 1 -- 172.21.15.139:0/2177052082 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f590c0c6c10 con 0x7f5914156ce0 2024-04-18T04:54:25.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.724+0000 7f5919199640 1 -- 172.21.15.139:0/2177052082 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5914067050 con 0x7f5914156ce0 2024-04-18T04:54:25.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.728+0000 7f58fb7fe640 1 -- 172.21.15.139:0/2177052082 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f590c0b4070 con 0x7f5914156ce0 2024-04-18T04:54:25.730 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:25.733+0000 7f48b3de5180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-18T04:54:25.780 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:25.780+0000 7f18aa8bc180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-18T04:54:25.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.796+0000 7f5919199640 1 -- 172.21.15.139:0/2177052082 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3c75746b-7345-48b7-8c5d-22cd241b77c7", "id": 5} v 0) v1 -- 0x7f59141ec660 con 0x7f5914156ce0 2024-04-18T04:54:25.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.804+0000 7f58fb7fe640 1 -- 172.21.15.139:0/2177052082 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3c75746b-7345-48b7-8c5d-22cd241b77c7", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f59140c76d0 con 0x7f5914156ce0 2024-04-18T04:54:25.805 INFO:teuthology.orchestra.run.smithi139.stdout:5 2024-04-18T04:54:25.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.804+0000 7f5919199640 1 -- 172.21.15.139:0/2177052082 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5914156ce0 msgr2=0x7f59141ecef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.804+0000 7f5919199640 1 --2- 172.21.15.139:0/2177052082 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5914156ce0 0x7f59141ecef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f590c0ae000 tx=0x7f590c01bf40 comp rx=0 tx=0).stop 2024-04-18T04:54:25.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.804+0000 7f5919199640 1 -- 172.21.15.139:0/2177052082 shutdown_connections 2024-04-18T04:54:25.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.804+0000 7f5919199640 1 --2- 172.21.15.139:0/2177052082 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5914156ce0 0x7f59141ecef0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.804+0000 7f5919199640 1 --2- 172.21.15.139:0/2177052082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5914150ec0 0x7f59141ec9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.804+0000 7f5919199640 1 --2- 172.21.15.139:0/2177052082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59140cc530 0x7f5914157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.804+0000 7f5919199640 1 -- 172.21.15.139:0/2177052082 >> 172.21.15.139:0/2177052082 conn(0x7f591406fbf0 msgr2=0x7f59140c6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:25.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.804+0000 7f5919199640 1 -- 172.21.15.139:0/2177052082 shutdown_connections 2024-04-18T04:54:25.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.804+0000 7f5919199640 1 -- 172.21.15.139:0/2177052082 wait complete. 2024-04-18T04:54:25.821 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 874be4c3-b94e-40f8-8cc9-cc5782741a8c 6 2024-04-18T04:54:25.835 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:25.836+0000 7f18aa8bc180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-18T04:54:25.879 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:25.881+0000 7f48b3de5180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-18T04:54:25.915 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:25.916+0000 7f18aa8bc180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-18T04:54:25.938 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:25.941+0000 7f48b3de5180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-18T04:54:25.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.940+0000 7f891b79f640 1 Processor -- start 2024-04-18T04:54:25.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.940+0000 7f891b79f640 1 -- start start 2024-04-18T04:54:25.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f891b79f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8914156740 0x7f891406af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f891b79f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89140c3050 0x7f891406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f891b79f640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89140c8400 con 0x7f891406c2f0 2024-04-18T04:54:25.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f891b79f640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89140c8ba0 con 0x7f8914156740 2024-04-18T04:54:25.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f891b79f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89140c9090 con 0x7f89140c3050 2024-04-18T04:54:25.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f891953b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8914156740 0x7f891406af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f8918d3a640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f891406c2f0 0x7f89140cc5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:39830/0 (socket says 172.21.15.139:39830) 2024-04-18T04:54:25.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f8918d3a640 1 -- 172.21.15.139:0/835825114 learned_addr learned my addr 172.21.15.139:0/835825114 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-18T04:54:25.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f8919d3c640 1 --2- 172.21.15.139:0/835825114 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89140c3050 0x7f891406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f891953b640 1 -- 172.21.15.139:0/835825114 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89140c3050 msgr2=0x7f891406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:25.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f891953b640 1 --2- 172.21.15.139:0/835825114 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89140c3050 0x7f891406ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f891953b640 1 -- 172.21.15.139:0/835825114 >> v1:172.21.15.139:6789/0 conn(0x7f891406c2f0 legacy=0x7f89140cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f890bfff640 1 -- 172.21.15.139:0/835825114 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191973871 0 0) 0x7f89140c8400 con 0x7f891406c2f0 2024-04-18T04:54:25.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f891953b640 1 -- 172.21.15.139:0/835825114 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89140c7260 con 0x7f8914156740 2024-04-18T04:54:25.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f891953b640 1 --2- 172.21.15.139:0/835825114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8914156740 0x7f891406af70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f89100097c0 tx=0x7f891001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cffb73bf4aedd9af server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:25.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f890bfff640 1 -- 172.21.15.139:0/835825114 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89100a8990 con 0x7f8914156740 2024-04-18T04:54:25.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f890bfff640 1 -- 172.21.15.139:0/835825114 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89100a8af0 con 0x7f8914156740 2024-04-18T04:54:25.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.944+0000 7f890bfff640 1 -- 172.21.15.139:0/835825114 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89100a8e80 con 0x7f8914156740 2024-04-18T04:54:25.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 -- 172.21.15.139:0/835825114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8914156740 msgr2=0x7f891406af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 --2- 172.21.15.139:0/835825114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8914156740 0x7f891406af70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f89100097c0 tx=0x7f891001ec90 comp rx=0 tx=0).stop 2024-04-18T04:54:25.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 -- 172.21.15.139:0/835825114 shutdown_connections 2024-04-18T04:54:25.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 --2- 172.21.15.139:0/835825114 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89140c3050 0x7f891406ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 --2- 172.21.15.139:0/835825114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8914156740 0x7f891406af70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 -- 172.21.15.139:0/835825114 >> 172.21.15.139:0/835825114 conn(0x7f891406ed60 msgr2=0x7f891406f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:25.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 -- 172.21.15.139:0/835825114 shutdown_connections 2024-04-18T04:54:25.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 -- 172.21.15.139:0/835825114 wait complete. 2024-04-18T04:54:25.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 Processor -- start 2024-04-18T04:54:25.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 -- start start 2024-04-18T04:54:25.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f891406c2f0 0x7f89140cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89140c3050 0x7f89141eeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8914156740 0x7f89141510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:25.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89140cc9d0 con 0x7f89140c3050 2024-04-18T04:54:25.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89141ef060 con 0x7f891406c2f0 2024-04-18T04:54:25.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89140cc6f0 con 0x7f8914156740 2024-04-18T04:54:25.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891953b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f891406c2f0 0x7f89140cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891953b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f891406c2f0 0x7f89140cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42022/0 (socket says 172.21.15.139:42022) 2024-04-18T04:54:25.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f8919d3c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8914156740 0x7f89141510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891953b640 1 -- 172.21.15.139:0/3784343957 learned_addr learned my addr 172.21.15.139:0/3784343957 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-18T04:54:25.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f8918d3a640 1 --2- 172.21.15.139:0/3784343957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89140c3050 0x7f89141eeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:25.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891953b640 1 -- 172.21.15.139:0/3784343957 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8914156740 msgr2=0x7f89141510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891953b640 1 --2- 172.21.15.139:0/3784343957 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8914156740 0x7f89141510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891953b640 1 -- 172.21.15.139:0/3784343957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89140c3050 msgr2=0x7f89141eeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:25.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891953b640 1 --2- 172.21.15.139:0/3784343957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89140c3050 0x7f89141eeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:25.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891953b640 1 -- 172.21.15.139:0/3784343957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8910009420 con 0x7f891406c2f0 2024-04-18T04:54:25.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f8918d3a640 1 --2- 172.21.15.139:0/3784343957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89140c3050 0x7f89141eeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:25.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891953b640 1 --2- 172.21.15.139:0/3784343957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f891406c2f0 0x7f89140cc080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f891001c8c0 tx=0x7f891001ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:25.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f8909ffb640 1 -- 172.21.15.139:0/3784343957 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89100b0e10 con 0x7f891406c2f0 2024-04-18T04:54:25.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f8909ffb640 1 -- 172.21.15.139:0/3784343957 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89100b9410 con 0x7f891406c2f0 2024-04-18T04:54:25.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 -- 172.21.15.139:0/3784343957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89140ca640 con 0x7f891406c2f0 2024-04-18T04:54:25.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f8909ffb640 1 -- 172.21.15.139:0/3784343957 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89100b97c0 con 0x7f891406c2f0 2024-04-18T04:54:25.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f891b79f640 1 -- 172.21.15.139:0/3784343957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89140cac00 con 0x7f891406c2f0 2024-04-18T04:54:25.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f8909ffb640 1 -- 172.21.15.139:0/3784343957 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f89100b7040 con 0x7f891406c2f0 2024-04-18T04:54:25.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.948+0000 7f8909ffb640 1 -- 172.21.15.139:0/3784343957 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f89100c5c80 con 0x7f891406c2f0 2024-04-18T04:54:25.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.952+0000 7f891b79f640 1 -- 172.21.15.139:0/3784343957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8914067050 con 0x7f891406c2f0 2024-04-18T04:54:25.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:25.956+0000 7f8909ffb640 1 -- 172.21.15.139:0/3784343957 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f89100b5070 con 0x7f891406c2f0 2024-04-18T04:54:25.973 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:25.972+0000 7f18aa8bc180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-18T04:54:26.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.020+0000 7f891b79f640 1 -- 172.21.15.139:0/3784343957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "874be4c3-b94e-40f8-8cc9-cc5782741a8c", "id": 6} v 0) v1 -- 0x7f89140c7930 con 0x7f891406c2f0 2024-04-18T04:54:26.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.024+0000 7f8909ffb640 1 -- 172.21.15.139:0/3784343957 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "874be4c3-b94e-40f8-8cc9-cc5782741a8c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f89100b9d60 con 0x7f891406c2f0 2024-04-18T04:54:26.025 INFO:teuthology.orchestra.run.smithi139.stdout:6 2024-04-18T04:54:26.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.024+0000 7f891b79f640 1 -- 172.21.15.139:0/3784343957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f891406c2f0 msgr2=0x7f89140cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:26.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.024+0000 7f891b79f640 1 --2- 172.21.15.139:0/3784343957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f891406c2f0 0x7f89140cc080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f891001c8c0 tx=0x7f891001ba30 comp rx=0 tx=0).stop 2024-04-18T04:54:26.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.024+0000 7f891b79f640 1 -- 172.21.15.139:0/3784343957 shutdown_connections 2024-04-18T04:54:26.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.024+0000 7f891b79f640 1 --2- 172.21.15.139:0/3784343957 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8914156740 0x7f89141510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.024+0000 7f891b79f640 1 --2- 172.21.15.139:0/3784343957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89140c3050 0x7f89141eeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.024+0000 7f891b79f640 1 --2- 172.21.15.139:0/3784343957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f891406c2f0 0x7f89140cc080 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.024+0000 7f891b79f640 1 -- 172.21.15.139:0/3784343957 >> 172.21.15.139:0/3784343957 conn(0x7f891406ed60 msgr2=0x7f8914154a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:26.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.024+0000 7f891b79f640 1 -- 172.21.15.139:0/3784343957 shutdown_connections 2024-04-18T04:54:26.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.024+0000 7f891b79f640 1 -- 172.21.15.139:0/3784343957 wait complete. 2024-04-18T04:54:26.041 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9 7 2024-04-18T04:54:26.130 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:26.128+0000 7f18aa8bc180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-18T04:54:26.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.148+0000 7f785f8e2640 1 Processor -- start 2024-04-18T04:54:26.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.148+0000 7f785f8e2640 1 -- start start 2024-04-18T04:54:26.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.148+0000 7f785f8e2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78580ca590 0x7f78580caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:26.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.148+0000 7f785f8e2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7858155bc0 con 0x7f78580cb440 2024-04-18T04:54:26.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.148+0000 7f785f8e2640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7858155e60 con 0x7f785814fe30 2024-04-18T04:54:26.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.148+0000 7f785f8e2640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7858150210 con 0x7f78580ca590 2024-04-18T04:54:26.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.148+0000 7f785ce7d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78580ca590 0x7f78580caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:26.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.148+0000 7f785d67e640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f785814fe30 0x7f7858070670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:39838/0 (socket says 172.21.15.139:39838) 2024-04-18T04:54:26.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.148+0000 7f785d67e640 1 -- 172.21.15.139:0/224274714 learned_addr learned my addr 172.21.15.139:0/224274714 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-18T04:54:26.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.148+0000 7f784ffff640 1 -- 172.21.15.139:0/224274714 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014792799 0 0) 0x7f7858155e60 con 0x7f785814fe30 2024-04-18T04:54:26.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.148+0000 7f784ffff640 1 -- 172.21.15.139:0/224274714 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7844005740 con 0x7f785814fe30 2024-04-18T04:54:26.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.148+0000 7f785ce7d640 1 -- 172.21.15.139:0/224274714 >> v1:172.21.15.139:6789/0 conn(0x7f785814fe30 legacy=0x7f7858070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:26.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.148+0000 7f785ce7d640 1 -- 172.21.15.139:0/224274714 >> v1:172.21.15.96:6789/0 conn(0x7f78580cb440 legacy=0x7f78580c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:26.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.148+0000 7f785ce7d640 1 -- 172.21.15.139:0/224274714 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7858156140 con 0x7f78580ca590 2024-04-18T04:54:26.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785ce7d640 1 --2- 172.21.15.139:0/224274714 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78580ca590 0x7f78580caf00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f78540097f0 tx=0x7f785401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db2766bf82fb2324 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:26.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f784ffff640 1 -- 172.21.15.139:0/224274714 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78540ab600 con 0x7f78580ca590 2024-04-18T04:54:26.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f784ffff640 1 -- 172.21.15.139:0/224274714 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78540a7050 con 0x7f78580ca590 2024-04-18T04:54:26.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f784ffff640 1 -- 172.21.15.139:0/224274714 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78540ab980 con 0x7f78580ca590 2024-04-18T04:54:26.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785f8e2640 1 -- 172.21.15.139:0/224274714 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78580ca590 msgr2=0x7f78580caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:26.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785f8e2640 1 --2- 172.21.15.139:0/224274714 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78580ca590 0x7f78580caf00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f78540097f0 tx=0x7f785401c4a0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785f8e2640 1 -- 172.21.15.139:0/224274714 shutdown_connections 2024-04-18T04:54:26.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785f8e2640 1 --2- 172.21.15.139:0/224274714 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78580ca590 0x7f78580caf00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785f8e2640 1 -- 172.21.15.139:0/224274714 >> 172.21.15.139:0/224274714 conn(0x7f785806e660 msgr2=0x7f785806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:26.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785f8e2640 1 -- 172.21.15.139:0/224274714 shutdown_connections 2024-04-18T04:54:26.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785f8e2640 1 -- 172.21.15.139:0/224274714 wait complete. 2024-04-18T04:54:26.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785f8e2640 1 Processor -- start 2024-04-18T04:54:26.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785f8e2640 1 -- start start 2024-04-18T04:54:26.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785f8e2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78580ca590 0x7f78580c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:26.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785f8e2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78580cb440 0x7f78581547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:26.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785f8e2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f785814fe30 0x7f78581f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:26.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785f8e2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78580c71a0 con 0x7f785814fe30 2024-04-18T04:54:26.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785f8e2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7858154d00 con 0x7f78580ca590 2024-04-18T04:54:26.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785f8e2640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7858143600 con 0x7f78580cb440 2024-04-18T04:54:26.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785d67e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78580ca590 0x7f78580c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:26.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785ce7d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78580cb440 0x7f78581547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:26.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785d67e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78580ca590 0x7f78580c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42034/0 (socket says 172.21.15.139:42034) 2024-04-18T04:54:26.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785d67e640 1 -- 172.21.15.139:0/2572876749 learned_addr learned my addr 172.21.15.139:0/2572876749 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-18T04:54:26.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785de7f640 1 --2- 172.21.15.139:0/2572876749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f785814fe30 0x7f78581f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:26.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785d67e640 1 -- 172.21.15.139:0/2572876749 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78580cb440 msgr2=0x7f78581547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:26.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785d67e640 1 --2- 172.21.15.139:0/2572876749 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78580cb440 0x7f78581547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785d67e640 1 -- 172.21.15.139:0/2572876749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f785814fe30 msgr2=0x7f78581f1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:26.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785d67e640 1 --2- 172.21.15.139:0/2572876749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f785814fe30 0x7f78581f1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785d67e640 1 -- 172.21.15.139:0/2572876749 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7854009420 con 0x7f78580ca590 2024-04-18T04:54:26.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785ce7d640 1 --2- 172.21.15.139:0/2572876749 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78580cb440 0x7f78581547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:54:26.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785de7f640 1 --2- 172.21.15.139:0/2572876749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f785814fe30 0x7f78581f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:26.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f785d67e640 1 --2- 172.21.15.139:0/2572876749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78580ca590 0x7f78580c6c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f784800c420 tx=0x7f784800c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:26.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.152+0000 7f784dffb640 1 -- 172.21.15.139:0/2572876749 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7848005cf0 con 0x7f78580ca590 2024-04-18T04:54:26.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.156+0000 7f784dffb640 1 -- 172.21.15.139:0/2572876749 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7848005e50 con 0x7f78580ca590 2024-04-18T04:54:26.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.156+0000 7f785f8e2640 1 -- 172.21.15.139:0/2572876749 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78580c66a0 con 0x7f78580ca590 2024-04-18T04:54:26.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.156+0000 7f784dffb640 1 -- 172.21.15.139:0/2572876749 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78480072d0 con 0x7f78580ca590 2024-04-18T04:54:26.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.156+0000 7f785f8e2640 1 -- 172.21.15.139:0/2572876749 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78581f0c40 con 0x7f78580ca590 2024-04-18T04:54:26.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.156+0000 7f784dffb640 1 -- 172.21.15.139:0/2572876749 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f784801c440 con 0x7f78580ca590 2024-04-18T04:54:26.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.156+0000 7f784dffb640 1 -- 172.21.15.139:0/2572876749 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f7848012a60 con 0x7f78580ca590 2024-04-18T04:54:26.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.156+0000 7f785f8e2640 1 -- 172.21.15.139:0/2572876749 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7858067050 con 0x7f78580ca590 2024-04-18T04:54:26.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.156+0000 7f784dffb640 1 -- 172.21.15.139:0/2572876749 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f7848021060 con 0x7f78580ca590 2024-04-18T04:54:26.192 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:26.192+0000 7f18aa8bc180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-18T04:54:26.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.220+0000 7f785f8e2640 1 -- 172.21.15.139:0/2572876749 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9", "id": 7} v 0) v1 -- 0x7f7858070ae0 con 0x7f78580ca590 2024-04-18T04:54:26.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.228+0000 7f784dffb640 1 -- 172.21.15.139:0/2572876749 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7848017070 con 0x7f78580ca590 2024-04-18T04:54:26.227 INFO:teuthology.orchestra.run.smithi139.stdout:7 2024-04-18T04:54:26.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.228+0000 7f785f8e2640 1 -- 172.21.15.139:0/2572876749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78580ca590 msgr2=0x7f78580c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:26.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.228+0000 7f785f8e2640 1 --2- 172.21.15.139:0/2572876749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78580ca590 0x7f78580c6c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f784800c420 tx=0x7f784800c8e0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.228+0000 7f785f8e2640 1 -- 172.21.15.139:0/2572876749 shutdown_connections 2024-04-18T04:54:26.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.228+0000 7f785f8e2640 1 --2- 172.21.15.139:0/2572876749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f785814fe30 0x7f78581f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.228+0000 7f785f8e2640 1 --2- 172.21.15.139:0/2572876749 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78580cb440 0x7f78581547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.228+0000 7f785f8e2640 1 --2- 172.21.15.139:0/2572876749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78580ca590 0x7f78580c6c60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.228+0000 7f785f8e2640 1 -- 172.21.15.139:0/2572876749 >> 172.21.15.139:0/2572876749 conn(0x7f785806e660 msgr2=0x7f785814ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:26.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.228+0000 7f785f8e2640 1 -- 172.21.15.139:0/2572876749 shutdown_connections 2024-04-18T04:54:26.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-18T04:54:26.228+0000 7f785f8e2640 1 -- 172.21.15.139:0/2572876749 wait complete. 2024-04-18T04:54:26.243 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-18T04:54:26.243 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-18T04:54:26.246 INFO:tasks.ceph.osd.0:Started 2024-04-18T04:54:26.246 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-18T04:54:26.246 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-18T04:54:26.250 INFO:tasks.ceph.osd.1:Started 2024-04-18T04:54:26.250 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-18T04:54:26.251 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-18T04:54:26.253 INFO:tasks.ceph.osd.2:Started 2024-04-18T04:54:26.253 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-18T04:54:26.253 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-18T04:54:26.255 INFO:tasks.ceph.osd.3:Started 2024-04-18T04:54:26.255 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-18T04:54:26.255 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-18T04:54:26.257 INFO:tasks.ceph.osd.4:Started 2024-04-18T04:54:26.257 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-18T04:54:26.258 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-18T04:54:26.259 INFO:tasks.ceph.osd.5:Started 2024-04-18T04:54:26.259 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-18T04:54:26.259 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-18T04:54:26.261 INFO:tasks.ceph.osd.6:Started 2024-04-18T04:54:26.261 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-18T04:54:26.261 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-18T04:54:26.263 INFO:tasks.ceph.osd.7:Started 2024-04-18T04:54:26.264 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:54:26.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fd67e5640 1 Processor -- start 2024-04-18T04:54:26.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fd67e5640 1 -- start start 2024-04-18T04:54:26.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fd67e5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8fd0151100 0x7f8fd00c1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:26.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fd67e5640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fd00c95f0 0x7f8fd00c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:26.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fd67e5640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd00c2160 con 0x7f8fd00c9210 2024-04-18T04:54:26.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fd67e5640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd00c2b10 con 0x7f8fd0151100 2024-04-18T04:54:26.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fd67e5640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd00c8690 con 0x7f8fd00c95f0 2024-04-18T04:54:26.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fcffff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f8fd00c9210 0x7f8fd01509f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.96:39022/0 (socket says 172.21.15.96:39022) 2024-04-18T04:54:26.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fcffff640 1 -- 172.21.15.96:0/3249240236 learned_addr learned my addr 172.21.15.96:0/3249240236 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:26.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fcf7fe640 1 --2- 172.21.15.96:0/3249240236 >> v2:172.21.15.139:3300/0 conn(0x7f8fd0151100 0x7f8fd00c1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:26.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fd4d82640 1 --2- 172.21.15.96:0/3249240236 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fd00c95f0 0x7f8fd00c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:26.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fceffd640 1 -- 172.21.15.96:0/3249240236 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484832077 0 0) 0x7f8fd00c2160 con 0x7f8fd00c9210 2024-04-18T04:54:26.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fceffd640 1 -- 172.21.15.96:0/3249240236 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fb8003530 con 0x7f8fd00c9210 2024-04-18T04:54:26.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fd4d82640 1 -- 172.21.15.96:0/3249240236 >> v2:172.21.15.139:3300/0 conn(0x7f8fd0151100 msgr2=0x7f8fd00c1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:26.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fd4d82640 1 --2- 172.21.15.96:0/3249240236 >> v2:172.21.15.139:3300/0 conn(0x7f8fd0151100 0x7f8fd00c1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fd4d82640 1 -- 172.21.15.96:0/3249240236 >> v1:172.21.15.139:6789/0 conn(0x7f8fd00c9210 legacy=0x7f8fd01509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:26.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.429+0000 7f8fd4d82640 1 -- 172.21.15.96:0/3249240236 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd00c7a10 con 0x7f8fd00c95f0 2024-04-18T04:54:26.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd4d82640 1 --2- 172.21.15.96:0/3249240236 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fd00c95f0 0x7f8fd00c1a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009d90 tx=0x7f8fc801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9536d71c322cad6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:26.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fceffd640 1 -- 172.21.15.96:0/3249240236 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc80a5a00 con 0x7f8fd00c95f0 2024-04-18T04:54:26.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fceffd640 1 -- 172.21.15.96:0/3249240236 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc80a5b60 con 0x7f8fd00c95f0 2024-04-18T04:54:26.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fceffd640 1 -- 172.21.15.96:0/3249240236 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc80ad440 con 0x7f8fd00c95f0 2024-04-18T04:54:26.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd67e5640 1 -- 172.21.15.96:0/3249240236 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fd00c95f0 msgr2=0x7f8fd00c1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:26.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd67e5640 1 --2- 172.21.15.96:0/3249240236 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fd00c95f0 0x7f8fd00c1a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009d90 tx=0x7f8fc801c940 comp rx=0 tx=0).stop 2024-04-18T04:54:26.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd67e5640 1 -- 172.21.15.96:0/3249240236 shutdown_connections 2024-04-18T04:54:26.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd67e5640 1 --2- 172.21.15.96:0/3249240236 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fd00c95f0 0x7f8fd00c1a80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd67e5640 1 --2- 172.21.15.96:0/3249240236 >> v2:172.21.15.139:3300/0 conn(0x7f8fd0151100 0x7f8fd00c1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd67e5640 1 -- 172.21.15.96:0/3249240236 >> 172.21.15.96:0/3249240236 conn(0x7f8fd00661c0 msgr2=0x7f8fd006fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:26.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd67e5640 1 -- 172.21.15.96:0/3249240236 shutdown_connections 2024-04-18T04:54:26.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd67e5640 1 -- 172.21.15.96:0/3249240236 wait complete. 2024-04-18T04:54:26.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd67e5640 1 Processor -- start 2024-04-18T04:54:26.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd67e5640 1 -- start start 2024-04-18T04:54:26.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd67e5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd00c9210 0x7f8fd015d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:26.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd67e5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd00c95f0 0x7f8fd01f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:26.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd67e5640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fd0151100 0x7f8fd01f3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd67e5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd014ee90 con 0x7f8fd00c95f0 2024-04-18T04:54:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd67e5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd01f3c90 con 0x7f8fd00c9210 2024-04-18T04:54:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fd67e5640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd015b470 con 0x7f8fd0151100 2024-04-18T04:54:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fcf7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd00c95f0 0x7f8fd01f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fcf7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd00c95f0 0x7f8fd01f3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42898/0 (socket says 172.21.15.96:42898) 2024-04-18T04:54:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fcf7fe640 1 -- 172.21.15.96:0/691834729 learned_addr learned my addr 172.21.15.96:0/691834729 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.433+0000 7f8fcffff640 1 --2- 172.21.15.96:0/691834729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd00c9210 0x7f8fd015d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.437+0000 7f8fd4d82640 1 --2- 172.21.15.96:0/691834729 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fd0151100 0x7f8fd01f3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.437+0000 7f8fcf7fe640 1 -- 172.21.15.96:0/691834729 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fd0151100 msgr2=0x7f8fd01f3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.437+0000 7f8fcf7fe640 1 --2- 172.21.15.96:0/691834729 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fd0151100 0x7f8fd01f3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.437+0000 7f8fcf7fe640 1 -- 172.21.15.96:0/691834729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd00c9210 msgr2=0x7f8fd015d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.437+0000 7f8fcf7fe640 1 --2- 172.21.15.96:0/691834729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd00c9210 0x7f8fd015d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.437+0000 7f8fcf7fe640 1 -- 172.21.15.96:0/691834729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc8009a70 con 0x7f8fd00c95f0 2024-04-18T04:54:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.437+0000 7f8fcf7fe640 1 --2- 172.21.15.96:0/691834729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd00c95f0 0x7f8fd01f3120 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000e870 tx=0x7f8fc000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.437+0000 7f8fccff9640 1 -- 172.21.15.96:0/691834729 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0009510 con 0x7f8fd00c95f0 2024-04-18T04:54:26.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.437+0000 7f8fccff9640 1 -- 172.21.15.96:0/691834729 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc000eec0 con 0x7f8fd00c95f0 2024-04-18T04:54:26.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.437+0000 7f8fd67e5640 1 -- 172.21.15.96:0/691834729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd014e5f0 con 0x7f8fd00c95f0 2024-04-18T04:54:26.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.437+0000 7f8fccff9640 1 -- 172.21.15.96:0/691834729 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc000cb40 con 0x7f8fd00c95f0 2024-04-18T04:54:26.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.437+0000 7f8fd67e5640 1 -- 172.21.15.96:0/691834729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd014ebb0 con 0x7f8fd00c95f0 2024-04-18T04:54:26.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.437+0000 7f8fccff9640 1 -- 172.21.15.96:0/691834729 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f8fc00059a0 con 0x7f8fd00c95f0 2024-04-18T04:54:26.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.437+0000 7f8fccff9640 1 -- 172.21.15.96:0/691834729 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f8fc00067a0 con 0x7f8fd00c95f0 2024-04-18T04:54:26.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.437+0000 7f8fd67e5640 1 -- 172.21.15.96:0/691834729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd015b2d0 con 0x7f8fd00c95f0 2024-04-18T04:54:26.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.449+0000 7f8fccff9640 1 -- 172.21.15.96:0/691834729 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f8fd015b2d0 con 0x7f8fd00c95f0 2024-04-18T04:54:26.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.505+0000 7f8fd67e5640 1 -- 172.21.15.96:0/691834729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fd0067050 con 0x7f8fd00c95f0 2024-04-18T04:54:26.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.505+0000 7f8fccff9640 1 -- 172.21.15.96:0/691834729 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8fc0021060 con 0x7f8fd00c95f0 2024-04-18T04:54:26.504 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:26.505 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":10,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:54:26.227201+0000","last_up_change":"0.000000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:54:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.509+0000 7f8fd67e5640 1 -- 172.21.15.96:0/691834729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd00c95f0 msgr2=0x7f8fd01f3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.509+0000 7f8fd67e5640 1 --2- 172.21.15.96:0/691834729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd00c95f0 0x7f8fd01f3120 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000e870 tx=0x7f8fc000ec70 comp rx=0 tx=0).stop 2024-04-18T04:54:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.509+0000 7f8fd67e5640 1 -- 172.21.15.96:0/691834729 shutdown_connections 2024-04-18T04:54:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.509+0000 7f8fd67e5640 1 --2- 172.21.15.96:0/691834729 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fd0151100 0x7f8fd01f3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.509+0000 7f8fd67e5640 1 --2- 172.21.15.96:0/691834729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fd00c95f0 0x7f8fd01f3120 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.509+0000 7f8fd67e5640 1 --2- 172.21.15.96:0/691834729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd00c9210 0x7f8fd015d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.509+0000 7f8fd67e5640 1 -- 172.21.15.96:0/691834729 >> 172.21.15.96:0/691834729 conn(0x7f8fd00661c0 msgr2=0x7f8fd0155450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.509+0000 7f8fd67e5640 1 -- 172.21.15.96:0/691834729 shutdown_connections 2024-04-18T04:54:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:26.509+0000 7f8fd67e5640 1 -- 172.21.15.96:0/691834729 wait complete. 2024-04-18T04:54:26.521 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-18T04:54:26.521 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-18T04:54:26.635 INFO:tasks.ceph.mgr.y.smithi096.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-18T04:54:26.635 INFO:tasks.ceph.mgr.y.smithi096.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-18T04:54:26.635 INFO:tasks.ceph.mgr.y.smithi096.stderr: from numpy import show_config as show_numpy_config 2024-04-18T04:54:26.684 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:26.685+0000 7f48b3de5180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-18T04:54:26.843 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:26.845+0000 7f48b3de5180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-18T04:54:26.876 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-04-18T04:54:26.876+0000 7fcaddee87c0 -1 Falling back to public interface 2024-04-18T04:54:26.876 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-04-18T04:54:26.876+0000 7f3ac60947c0 -1 Falling back to public interface 2024-04-18T04:54:26.877 INFO:tasks.ceph.mgr.x.smithi139.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-18T04:54:26.877 INFO:tasks.ceph.mgr.x.smithi139.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-18T04:54:26.877 INFO:tasks.ceph.mgr.x.smithi139.stderr: from numpy import show_config as show_numpy_config 2024-04-18T04:54:26.877 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-04-18T04:54:26.876+0000 7f3ac5055640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6807/0: (98) Address already in use 2024-04-18T04:54:26.888 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-04-18T04:54:26.888+0000 7fdc14ae57c0 -1 Falling back to public interface 2024-04-18T04:54:26.899 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-04-18T04:54:26.900+0000 7f1f039f57c0 -1 Falling back to public interface 2024-04-18T04:54:26.914 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-04-18T04:54:26.917+0000 7ff69b78f7c0 -1 Falling back to public interface 2024-04-18T04:54:26.922 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:26.920+0000 7f18aa8bc180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-18T04:54:26.930 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T04:54:26.933+0000 7fbc103807c0 -1 Falling back to public interface 2024-04-18T04:54:26.930 INFO:tasks.ceph.osd.3.smithi096.stderr:2024-04-18T04:54:26.933+0000 7f77007647c0 -1 Falling back to public interface 2024-04-18T04:54:26.931 INFO:tasks.ceph.osd.2.smithi096.stderr:2024-04-18T04:54:26.933+0000 7fcb12c777c0 -1 Falling back to public interface 2024-04-18T04:54:27.008 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:27.009+0000 7f48b3de5180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-18T04:54:27.074 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:27.072+0000 7f18aa8bc180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-18T04:54:27.076 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:27.077+0000 7f48b3de5180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-18T04:54:27.216 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:27.217+0000 7f48b3de5180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-18T04:54:27.248 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:27.248+0000 7f18aa8bc180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-18T04:54:27.318 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:27.316+0000 7f18aa8bc180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-18T04:54:27.327 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T04:54:27.441 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.441+0000 7f0e9020c640 1 Processor -- start 2024-04-18T04:54:27.445 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.441+0000 7f0e9020c640 1 -- start start 2024-04-18T04:54:27.445 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e9020c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e881575e0 0x7f0e880ca180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:27.445 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e9020c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0e880c9aa0 0x7f0e880ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:27.445 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e9020c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0e8806edd0 0x7f0e88160f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:27.445 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e9020c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e88160b60 con 0x7f0e8806edd0 2024-04-18T04:54:27.445 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e9020c640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e880c5700 con 0x7f0e880c9aa0 2024-04-18T04:54:27.445 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e9020c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e880c61f0 con 0x7f0e881575e0 2024-04-18T04:54:27.446 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e8e7a9640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0e8806edd0 0x7f0e88160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:27.446 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e8e7a9640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0e8806edd0 0x7f0e88160f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42910/0 (socket says 172.21.15.96:42910) 2024-04-18T04:54:27.446 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e8e7a9640 1 -- 172.21.15.96:0/929981538 learned_addr learned my addr 172.21.15.96:0/929981538 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:27.446 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e8dfa8640 1 --2- 172.21.15.96:0/929981538 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e881575e0 0x7f0e880ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:27.446 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e8d7a7640 1 --2- 172.21.15.96:0/929981538 >> v2:172.21.15.139:3300/0 conn(0x7f0e880c9aa0 0x7f0e880ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:27.446 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e8e7a9640 1 -- 172.21.15.96:0/929981538 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e881575e0 msgr2=0x7f0e880ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:27.446 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e8e7a9640 1 --2- 172.21.15.96:0/929981538 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e881575e0 0x7f0e880ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.446 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e8e7a9640 1 -- 172.21.15.96:0/929981538 >> v2:172.21.15.139:3300/0 conn(0x7f0e880c9aa0 msgr2=0x7f0e880ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:27.446 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e8e7a9640 1 --2- 172.21.15.96:0/929981538 >> v2:172.21.15.139:3300/0 conn(0x7f0e880c9aa0 0x7f0e880ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.446 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e8e7a9640 1 -- 172.21.15.96:0/929981538 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e880c5950 con 0x7f0e8806edd0 2024-04-18T04:54:27.446 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e8d7a7640 1 --2- 172.21.15.96:0/929981538 >> v2:172.21.15.139:3300/0 conn(0x7f0e880c9aa0 0x7f0e880ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:27.446 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e8dfa8640 1 --2- 172.21.15.96:0/929981538 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e881575e0 0x7f0e880ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:54:27.446 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e8e7a9640 1 --2- 172.21.15.96:0/929981538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e8806edd0 0x7f0e88160f80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0e8806f250 tx=0x7f0e8001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ebeb0fb17e49d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:27.447 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e8cfa6640 1 -- 172.21.15.96:0/929981538 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800a5750 con 0x7f0e8806edd0 2024-04-18T04:54:27.447 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e8cfa6640 1 -- 172.21.15.96:0/929981538 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e800a58b0 con 0x7f0e8806edd0 2024-04-18T04:54:27.447 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.445+0000 7f0e8cfa6640 1 -- 172.21.15.96:0/929981538 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800a5c40 con 0x7f0e8806edd0 2024-04-18T04:54:27.450 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 -- 172.21.15.96:0/929981538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e8806edd0 msgr2=0x7f0e88160f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:27.450 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 --2- 172.21.15.96:0/929981538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e8806edd0 0x7f0e88160f80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0e8806f250 tx=0x7f0e8001c9c0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.450 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 -- 172.21.15.96:0/929981538 shutdown_connections 2024-04-18T04:54:27.450 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 --2- 172.21.15.96:0/929981538 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e8806edd0 0x7f0e88160f80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.450 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 --2- 172.21.15.96:0/929981538 >> v2:172.21.15.139:3300/0 conn(0x7f0e880c9aa0 0x7f0e880ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.450 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 --2- 172.21.15.96:0/929981538 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e881575e0 0x7f0e880ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.450 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 -- 172.21.15.96:0/929981538 >> 172.21.15.96:0/929981538 conn(0x7f0e880cb680 msgr2=0x7f0e880c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:27.451 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 -- 172.21.15.96:0/929981538 shutdown_connections 2024-04-18T04:54:27.451 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 -- 172.21.15.96:0/929981538 wait complete. 2024-04-18T04:54:27.451 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 Processor -- start 2024-04-18T04:54:27.451 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 -- start start 2024-04-18T04:54:27.451 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e8806edd0 0x7f0e8815fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:27.451 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e880c9aa0 0x7f0e881483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:27.451 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e881575e0 0x7f0e88148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:27.451 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88158e10 con 0x7f0e8806edd0 2024-04-18T04:54:27.451 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88146b00 con 0x7f0e880c9aa0 2024-04-18T04:54:27.451 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88146560 con 0x7f0e881575e0 2024-04-18T04:54:27.451 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e8dfa8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e8806edd0 0x7f0e8815fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:27.451 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e8dfa8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e8806edd0 0x7f0e8815fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42922/0 (socket says 172.21.15.96:42922) 2024-04-18T04:54:27.451 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e8dfa8640 1 -- 172.21.15.96:0/166318374 learned_addr learned my addr 172.21.15.96:0/166318374 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:27.451 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e8e7a9640 1 --2- 172.21.15.96:0/166318374 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e881575e0 0x7f0e88148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:27.451 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e8d7a7640 1 --2- 172.21.15.96:0/166318374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e880c9aa0 0x7f0e881483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:27.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e8dfa8640 1 -- 172.21.15.96:0/166318374 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e881575e0 msgr2=0x7f0e88148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:27.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e8dfa8640 1 --2- 172.21.15.96:0/166318374 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e881575e0 0x7f0e88148930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e8dfa8640 1 -- 172.21.15.96:0/166318374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e880c9aa0 msgr2=0x7f0e881483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:27.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e8dfa8640 1 --2- 172.21.15.96:0/166318374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e880c9aa0 0x7f0e881483f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e8dfa8640 1 -- 172.21.15.96:0/166318374 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e80009b30 con 0x7f0e8806edd0 2024-04-18T04:54:27.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e8e7a9640 1 --2- 172.21.15.96:0/166318374 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e881575e0 0x7f0e88148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:54:27.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e8d7a7640 1 --2- 172.21.15.96:0/166318374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e880c9aa0 0x7f0e881483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:27.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e8dfa8640 1 --2- 172.21.15.96:0/166318374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e8806edd0 0x7f0e8815fa50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800e840 tx=0x7f0e7800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:27.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e7e7fc640 1 -- 172.21.15.96:0/166318374 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7800c8d0 con 0x7f0e8806edd0 2024-04-18T04:54:27.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e7e7fc640 1 -- 172.21.15.96:0/166318374 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7800ca30 con 0x7f0e8806edd0 2024-04-18T04:54:27.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 -- 172.21.15.96:0/166318374 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e88146820 con 0x7f0e8806edd0 2024-04-18T04:54:27.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e7e7fc640 1 -- 172.21.15.96:0/166318374 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7800cdc0 con 0x7f0e8806edd0 2024-04-18T04:54:27.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e9020c640 1 -- 172.21.15.96:0/166318374 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e881580d0 con 0x7f0e8806edd0 2024-04-18T04:54:27.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.449+0000 7f0e7e7fc640 1 -- 172.21.15.96:0/166318374 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0e7801c750 con 0x7f0e8806edd0 2024-04-18T04:54:27.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.453+0000 7f0e7e7fc640 1 -- 172.21.15.96:0/166318374 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0e78013c20 con 0x7f0e8806edd0 2024-04-18T04:54:27.453 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.453+0000 7f0e9020c640 1 -- 172.21.15.96:0/166318374 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e880675e0 con 0x7f0e8806edd0 2024-04-18T04:54:27.453 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.453+0000 7f0e7e7fc640 1 -- 172.21.15.96:0/166318374 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f0e7803bdc0 con 0x7f0e8806edd0 2024-04-18T04:54:27.466 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:27.464+0000 7f18aa8bc180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-18T04:54:27.508 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.509+0000 7f0e9020c640 1 -- 172.21.15.96:0/166318374 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e88154bf0 con 0x7f0e8806edd0 2024-04-18T04:54:27.509 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.509+0000 7f0e7e7fc640 1 -- 172.21.15.96:0/166318374 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0e7802a030 con 0x7f0e8806edd0 2024-04-18T04:54:27.509 INFO:teuthology.misc.health.smithi096.stdout: 2024-04-18T04:54:27.509 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":10,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:54:26.227201+0000","last_up_change":"0.000000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:54:27.511 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.513+0000 7f0e9020c640 1 -- 172.21.15.96:0/166318374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e8806edd0 msgr2=0x7f0e8815fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:27.511 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.513+0000 7f0e9020c640 1 --2- 172.21.15.96:0/166318374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e8806edd0 0x7f0e8815fa50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800e840 tx=0x7f0e7800ed00 comp rx=0 tx=0).stop 2024-04-18T04:54:27.511 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.513+0000 7f0e9020c640 1 -- 172.21.15.96:0/166318374 shutdown_connections 2024-04-18T04:54:27.511 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.513+0000 7f0e9020c640 1 --2- 172.21.15.96:0/166318374 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e881575e0 0x7f0e88148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.512 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.513+0000 7f0e9020c640 1 --2- 172.21.15.96:0/166318374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e880c9aa0 0x7f0e881483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.512 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.513+0000 7f0e9020c640 1 --2- 172.21.15.96:0/166318374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e8806edd0 0x7f0e8815fa50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.512 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.513+0000 7f0e9020c640 1 -- 172.21.15.96:0/166318374 >> 172.21.15.96:0/166318374 conn(0x7f0e880cb680 msgr2=0x7f0e88146f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:27.512 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.513+0000 7f0e9020c640 1 -- 172.21.15.96:0/166318374 shutdown_connections 2024-04-18T04:54:27.512 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:27.513+0000 7f0e9020c640 1 -- 172.21.15.96:0/166318374 wait complete. 2024-04-18T04:54:27.523 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-18T04:54:27.854 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:27.857+0000 7f48b3de5180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-18T04:54:27.930 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:27.933+0000 7f48b3de5180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-18T04:54:28.097 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:28.096+0000 7f18aa8bc180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-18T04:54:28.109 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:28.109+0000 7f48b3de5180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-18T04:54:28.173 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:28.172+0000 7f18aa8bc180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-18T04:54:28.183 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:28.185+0000 7f48b3de5180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-18T04:54:28.352 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:28.352+0000 7f18aa8bc180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-18T04:54:28.427 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:28.424+0000 7f18aa8bc180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-18T04:54:28.470 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:28.473+0000 7f48b3de5180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-18T04:54:28.531 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:28.533+0000 7f48b3de5180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-18T04:54:28.725 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:28.724+0000 7f18aa8bc180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-18T04:54:28.787 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-04-18T04:54:28.784+0000 7f18aa8bc180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-18T04:54:29.575 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:29.577+0000 7f485b39a640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-18T04:54:29.575 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-18T04:54:29.577+0000 7f485b39a640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-18T04:54:30.535 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-04-18T04:54:30.532+0000 7f1f039f57c0 -1 osd.4 0 log_to_monitors true 2024-04-18T04:54:30.537 INFO:tasks.ceph.osd.2.smithi096.stderr:2024-04-18T04:54:30.537+0000 7fcb12c777c0 -1 osd.2 0 log_to_monitors true 2024-04-18T04:54:30.712 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-04-18T04:54:30.713+0000 7ff69b78f7c0 -1 osd.0 0 log_to_monitors true 2024-04-18T04:54:30.725 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-04-18T04:54:30.724+0000 7fcaddee87c0 -1 osd.7 0 log_to_monitors true 2024-04-18T04:54:30.742 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-04-18T04:54:30.740+0000 7f3ac60947c0 -1 osd.5 0 log_to_monitors true 2024-04-18T04:54:30.790 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T04:54:30.792+0000 7fbc103807c0 -1 osd.1 0 log_to_monitors true 2024-04-18T04:54:30.801 INFO:tasks.ceph.osd.3.smithi096.stderr:2024-04-18T04:54:30.800+0000 7f77007647c0 -1 osd.3 0 log_to_monitors true 2024-04-18T04:54:30.836 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-04-18T04:54:30.836+0000 7fdc14ae57c0 -1 osd.6 0 log_to_monitors true 2024-04-18T04:54:32.214 INFO:tasks.ceph.osd.2.smithi096.stderr:2024-04-18T04:54:32.216+0000 7fcb0ec1c640 -1 osd.2 0 waiting for initial osdmap 2024-04-18T04:54:32.231 INFO:tasks.ceph.osd.2.smithi096.stderr:2024-04-18T04:54:32.232+0000 7fcb06a4f640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T04:54:32.298 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-04-18T04:54:32.296+0000 7f1eff99a640 -1 osd.4 0 waiting for initial osdmap 2024-04-18T04:54:32.325 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-04-18T04:54:32.324+0000 7f1ef77cd640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T04:54:33.556 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-04-18T04:54:33.556+0000 7ff697734640 -1 osd.0 0 waiting for initial osdmap 2024-04-18T04:54:33.570 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T04:54:33.572+0000 7fbc0c325640 -1 osd.1 0 waiting for initial osdmap 2024-04-18T04:54:33.574 INFO:tasks.ceph.osd.3.smithi096.stderr:2024-04-18T04:54:33.576+0000 7f76fc709640 -1 osd.3 0 waiting for initial osdmap 2024-04-18T04:54:33.575 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-04-18T04:54:33.576+0000 7ff68f567640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T04:54:33.578 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-04-18T04:54:33.576+0000 7fcad9e8d640 -1 osd.7 0 waiting for initial osdmap 2024-04-18T04:54:33.598 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-04-18T04:54:33.596+0000 7fdc10a8a640 -1 osd.6 0 waiting for initial osdmap 2024-04-18T04:54:33.598 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-04-18T04:54:33.600+0000 7fbc04158640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T04:54:33.604 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-04-18T04:54:33.604+0000 7fcad1cc0640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T04:54:33.606 INFO:tasks.ceph.osd.3.smithi096.stderr:2024-04-18T04:54:33.608+0000 7f76f453c640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T04:54:33.615 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-04-18T04:54:33.616+0000 7f3ac2039640 -1 osd.5 0 waiting for initial osdmap 2024-04-18T04:54:33.640 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-04-18T04:54:33.640+0000 7f3ab9e6c640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T04:54:33.644 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-04-18T04:54:33.644+0000 7fdc088bd640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T04:54:34.330 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T04:54:34.450 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdaedc87640 1 Processor -- start 2024-04-18T04:54:34.451 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdaedc87640 1 -- start start 2024-04-18T04:54:34.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdaedc87640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdae806a520 0x7fdae80c1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:34.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdaedc87640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdae80c2730 0x7fdae815ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:34.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdaedc87640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae80c67a0 con 0x7fdae806a900 2024-04-18T04:54:34.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdaedc87640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae80c1de0 con 0x7fdae806a520 2024-04-18T04:54:34.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdaedc87640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80c59c0 con 0x7fdae80c2730 2024-04-18T04:54:34.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdae7fff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdae80c2730 0x7fdae815ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:34.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdae77fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdae806a520 0x7fdae80c1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:34.452 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdae6ffd640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fdae806a900 0x7fdae80c2020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.96:33482/0 (socket says 172.21.15.96:33482) 2024-04-18T04:54:34.453 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdae6ffd640 1 -- 172.21.15.96:0/1618069783 learned_addr learned my addr 172.21.15.96:0/1618069783 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:34.453 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdae67fc640 1 -- 172.21.15.96:0/1618069783 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857102668 0 0) 0x7fdae80c67a0 con 0x7fdae806a900 2024-04-18T04:54:34.453 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdae67fc640 1 -- 172.21.15.96:0/1618069783 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdad0003530 con 0x7fdae806a900 2024-04-18T04:54:34.453 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdae7fff640 1 -- 172.21.15.96:0/1618069783 >> v2:172.21.15.139:3300/0 conn(0x7fdae806a520 msgr2=0x7fdae80c1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:34.453 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdae7fff640 1 --2- 172.21.15.96:0/1618069783 >> v2:172.21.15.139:3300/0 conn(0x7fdae806a520 0x7fdae80c1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.453 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdae7fff640 1 -- 172.21.15.96:0/1618069783 >> v1:172.21.15.139:6789/0 conn(0x7fdae806a900 legacy=0x7fdae80c2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:34.454 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.452+0000 7fdae7fff640 1 -- 172.21.15.96:0/1618069783 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae815b080 con 0x7fdae80c2730 2024-04-18T04:54:34.455 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdae7fff640 1 --2- 172.21.15.96:0/1618069783 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdae80c2730 0x7fdae815ab40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdae0009d90 tx=0x7fdae001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d37f7dab602c7f82 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:34.455 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdae67fc640 1 -- 172.21.15.96:0/1618069783 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae00a5920 con 0x7fdae80c2730 2024-04-18T04:54:34.455 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdae67fc640 1 -- 172.21.15.96:0/1618069783 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae00a5a80 con 0x7fdae80c2730 2024-04-18T04:54:34.455 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdae67fc640 1 -- 172.21.15.96:0/1618069783 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae00a5df0 con 0x7fdae80c2730 2024-04-18T04:54:34.456 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdaedc87640 1 -- 172.21.15.96:0/1618069783 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdae80c2730 msgr2=0x7fdae815ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:34.456 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdaedc87640 1 --2- 172.21.15.96:0/1618069783 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdae80c2730 0x7fdae815ab40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdae0009d90 tx=0x7fdae001c970 comp rx=0 tx=0).stop 2024-04-18T04:54:34.456 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdaedc87640 1 -- 172.21.15.96:0/1618069783 shutdown_connections 2024-04-18T04:54:34.456 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdaedc87640 1 --2- 172.21.15.96:0/1618069783 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdae80c2730 0x7fdae815ab40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.456 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdaedc87640 1 --2- 172.21.15.96:0/1618069783 >> v2:172.21.15.139:3300/0 conn(0x7fdae806a520 0x7fdae80c1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.456 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdaedc87640 1 -- 172.21.15.96:0/1618069783 >> 172.21.15.96:0/1618069783 conn(0x7fdae80ca6b0 msgr2=0x7fdae80caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:34.456 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdaedc87640 1 -- 172.21.15.96:0/1618069783 shutdown_connections 2024-04-18T04:54:34.456 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdaedc87640 1 -- 172.21.15.96:0/1618069783 wait complete. 2024-04-18T04:54:34.457 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdaedc87640 1 Processor -- start 2024-04-18T04:54:34.457 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdaedc87640 1 -- start start 2024-04-18T04:54:34.460 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdaedc87640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdae806a520 0x7fdae8157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:34.460 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdaedc87640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdae806a900 0x7fdae81540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:34.460 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdaedc87640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdae80c2730 0x7fdae806d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:34.460 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdaedc87640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae814f040 con 0x7fdae806a900 2024-04-18T04:54:34.460 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdaedc87640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae81f2190 con 0x7fdae80c2730 2024-04-18T04:54:34.460 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdaedc87640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae81f2470 con 0x7fdae806a520 2024-04-18T04:54:34.460 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.456+0000 7fdae6ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdae806a900 0x7fdae81540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:34.460 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdae6ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdae806a900 0x7fdae81540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42976/0 (socket says 172.21.15.96:42976) 2024-04-18T04:54:34.460 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdae6ffd640 1 -- 172.21.15.96:0/69610057 learned_addr learned my addr 172.21.15.96:0/69610057 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:34.460 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdae77fe640 1 --2- 172.21.15.96:0/69610057 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdae806a520 0x7fdae8157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:34.460 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdae7fff640 1 --2- 172.21.15.96:0/69610057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdae80c2730 0x7fdae806d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:34.461 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdae6ffd640 1 -- 172.21.15.96:0/69610057 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdae806a520 msgr2=0x7fdae8157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:34.461 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdae6ffd640 1 --2- 172.21.15.96:0/69610057 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdae806a520 0x7fdae8157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.461 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdae6ffd640 1 -- 172.21.15.96:0/69610057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdae80c2730 msgr2=0x7fdae806d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:34.461 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdae6ffd640 1 --2- 172.21.15.96:0/69610057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdae80c2730 0x7fdae806d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.461 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdae6ffd640 1 -- 172.21.15.96:0/69610057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae0009a70 con 0x7fdae806a900 2024-04-18T04:54:34.461 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdae6ffd640 1 --2- 172.21.15.96:0/69610057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdae806a900 0x7fdae81540c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00c4d0 tx=0x7fdadc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:34.461 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdacffff640 1 -- 172.21.15.96:0/69610057 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc005cf0 con 0x7fdae806a900 2024-04-18T04:54:34.461 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdacffff640 1 -- 172.21.15.96:0/69610057 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdadc005e50 con 0x7fdae806a900 2024-04-18T04:54:34.461 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdaedc87640 1 -- 172.21.15.96:0/69610057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae81f2750 con 0x7fdae806a900 2024-04-18T04:54:34.461 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdacffff640 1 -- 172.21.15.96:0/69610057 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc007270 con 0x7fdae806a900 2024-04-18T04:54:34.461 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdaedc87640 1 -- 172.21.15.96:0/69610057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae81f2d10 con 0x7fdae806a900 2024-04-18T04:54:34.461 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdaedc87640 1 -- 172.21.15.96:0/69610057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae80c11f0 con 0x7fdae806a900 2024-04-18T04:54:34.462 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdacffff640 1 -- 172.21.15.96:0/69610057 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7fdadc0073d0 con 0x7fdae806a900 2024-04-18T04:54:34.462 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdacffff640 1 --2- 172.21.15.96:0/69610057 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdad4066630 0x7fdad4068af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:34.462 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdacffff640 1 -- 172.21.15.96:0/69610057 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3166+0+0 (secure 0 0 0) 0x7fdadc082c20 con 0x7fdae806a900 2024-04-18T04:54:34.462 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdae77fe640 1 --2- 172.21.15.96:0/69610057 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdad4066630 0x7fdad4068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:34.462 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.460+0000 7fdae77fe640 1 --2- 172.21.15.96:0/69610057 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdad4066630 0x7fdad4068af0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdad8009b60 tx=0x7fdad8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:34.465 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.464+0000 7fdacffff640 1 -- 172.21.15.96:0/69610057 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fdadc050a80 con 0x7fdae806a900 2024-04-18T04:54:34.631 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.632+0000 7fdaedc87640 1 -- 172.21.15.96:0/69610057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdae8066ed0 con 0x7fdae806a900 2024-04-18T04:54:34.632 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.632+0000 7fdacffff640 1 -- 172.21.15.96:0/69610057 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12256 (secure 0 0 0) 0x7fdadc0540a0 con 0x7fdae806a900 2024-04-18T04:54:34.632 INFO:teuthology.misc.health.smithi096.stdout: 2024-04-18T04:54:34.633 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":15,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:54:34.602636+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:54:34.635 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.636+0000 7fdaedc87640 1 -- 172.21.15.96:0/69610057 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdad4066630 msgr2=0x7fdad4068af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:34.635 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.636+0000 7fdaedc87640 1 --2- 172.21.15.96:0/69610057 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdad4066630 0x7fdad4068af0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdad8009b60 tx=0x7fdad8009190 comp rx=0 tx=0).stop 2024-04-18T04:54:34.635 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.636+0000 7fdaedc87640 1 -- 172.21.15.96:0/69610057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdae806a900 msgr2=0x7fdae81540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:34.635 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.636+0000 7fdaedc87640 1 --2- 172.21.15.96:0/69610057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdae806a900 0x7fdae81540c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00c4d0 tx=0x7fdadc00c990 comp rx=0 tx=0).stop 2024-04-18T04:54:34.635 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.636+0000 7fdaedc87640 1 -- 172.21.15.96:0/69610057 shutdown_connections 2024-04-18T04:54:34.635 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.636+0000 7fdaedc87640 1 --2- 172.21.15.96:0/69610057 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdad4066630 0x7fdad4068af0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.635 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.636+0000 7fdaedc87640 1 --2- 172.21.15.96:0/69610057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdae80c2730 0x7fdae806d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.635 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.636+0000 7fdaedc87640 1 --2- 172.21.15.96:0/69610057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdae806a900 0x7fdae81540c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.635 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.636+0000 7fdaedc87640 1 --2- 172.21.15.96:0/69610057 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdae806a520 0x7fdae8157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.635 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.636+0000 7fdaedc87640 1 -- 172.21.15.96:0/69610057 >> 172.21.15.96:0/69610057 conn(0x7fdae80ca6b0 msgr2=0x7fdae814fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:34.635 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.636+0000 7fdaedc87640 1 -- 172.21.15.96:0/69610057 shutdown_connections 2024-04-18T04:54:34.636 INFO:teuthology.misc.health.smithi096.stderr:2024-04-18T04:54:34.636+0000 7fdaedc87640 1 -- 172.21.15.96:0/69610057 wait complete. 2024-04-18T04:54:34.649 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-18T04:54:34.649 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-18T04:54:34.649 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-18T04:54:34.649 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-18T04:54:34.651 INFO:tasks.ceph.mds.a:Started 2024-04-18T04:54:34.651 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-18T04:54:34.652 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-18T04:54:34.653 INFO:tasks.ceph.mds.c:Started 2024-04-18T04:54:34.653 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-18T04:54:34.654 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-18T04:54:34.655 INFO:tasks.ceph.mds.e:Started 2024-04-18T04:54:34.656 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-18T04:54:34.656 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-18T04:54:34.659 INFO:tasks.ceph.mds.b:Started 2024-04-18T04:54:34.659 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-18T04:54:34.659 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-18T04:54:34.661 INFO:tasks.ceph.mds.d:Started 2024-04-18T04:54:34.661 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-18T04:54:34.662 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-18T04:54:34.664 INFO:tasks.ceph.mds.f:Started 2024-04-18T04:54:34.664 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-18T04:54:34.664 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:54:34.731 INFO:tasks.ceph.mds.e.smithi096.stdout:starting mds.e at 2024-04-18T04:54:34.732 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2024-04-18T04:54:34.733 INFO:tasks.ceph.mds.c.smithi096.stdout:starting mds.c at 2024-04-18T04:54:34.748 INFO:tasks.ceph.mds.f.smithi139.stdout:starting mds.f at 2024-04-18T04:54:34.753 INFO:tasks.ceph.mds.d.smithi139.stdout:starting mds.d at 2024-04-18T04:54:34.753 INFO:tasks.ceph.mds.b.smithi139.stdout:starting mds.b at 2024-04-18T04:54:34.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.772+0000 7f1b202a6640 1 Processor -- start 2024-04-18T04:54:34.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.772+0000 7f1b202a6640 1 -- start start 2024-04-18T04:54:34.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.772+0000 7f1b202a6640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1b181532d0 0x7f1b18158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:34.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.772+0000 7f1b202a6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1b180cacc0 0x7f1b1815ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:34.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.772+0000 7f1b202a6640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1815d3b0 con 0x7f1b180c3fd0 2024-04-18T04:54:34.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.772+0000 7f1b202a6640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b180c5970 con 0x7f1b180cacc0 2024-04-18T04:54:34.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.772+0000 7f1b202a6640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b181594a0 con 0x7f1b181532d0 2024-04-18T04:54:34.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.772+0000 7f1b1d841640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1b180cacc0 0x7f1b1815ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:34.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.772+0000 7f1b1d841640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1b180cacc0 0x7f1b1815ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43004/0 (socket says 172.21.15.96:43004) 2024-04-18T04:54:34.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.772+0000 7f1b1d841640 1 -- 172.21.15.96:0/3385935614 learned_addr learned my addr 172.21.15.96:0/3385935614 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:34.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.772+0000 7f1b1d841640 1 -- 172.21.15.96:0/3385935614 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1b181532d0 msgr2=0x7f1b18158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:34.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.772+0000 7f1b1d841640 1 --2- 172.21.15.96:0/3385935614 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1b181532d0 0x7f1b18158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.772+0000 7f1b1d841640 1 -- 172.21.15.96:0/3385935614 >> v1:172.21.15.139:6789/0 conn(0x7f1b180c3fd0 legacy=0x7f1b180ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:34.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.772+0000 7f1b1d841640 1 -- 172.21.15.96:0/3385935614 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b181536b0 con 0x7f1b180cacc0 2024-04-18T04:54:34.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b1d841640 1 --2- 172.21.15.96:0/3385935614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b180cacc0 0x7f1b1815ce70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1b080098a0 tx=0x7f1b0801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7509367a0b8bed8f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:34.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b1d040640 1 -- 172.21.15.96:0/3385935614 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b080a89b0 con 0x7f1b180cacc0 2024-04-18T04:54:34.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b1d040640 1 -- 172.21.15.96:0/3385935614 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b080a8b10 con 0x7f1b180cacc0 2024-04-18T04:54:34.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b1d040640 1 -- 172.21.15.96:0/3385935614 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b080a8ea0 con 0x7f1b180cacc0 2024-04-18T04:54:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b202a6640 1 -- 172.21.15.96:0/3385935614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b180cacc0 msgr2=0x7f1b1815ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b202a6640 1 --2- 172.21.15.96:0/3385935614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b180cacc0 0x7f1b1815ce70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1b080098a0 tx=0x7f1b0801ecf0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b202a6640 1 -- 172.21.15.96:0/3385935614 shutdown_connections 2024-04-18T04:54:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b202a6640 1 --2- 172.21.15.96:0/3385935614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b180cacc0 0x7f1b1815ce70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b202a6640 1 --2- 172.21.15.96:0/3385935614 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1b181532d0 0x7f1b18158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b202a6640 1 -- 172.21.15.96:0/3385935614 >> 172.21.15.96:0/3385935614 conn(0x7f1b18071760 msgr2=0x7f1b1806b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:34.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b202a6640 1 -- 172.21.15.96:0/3385935614 shutdown_connections 2024-04-18T04:54:34.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b202a6640 1 -- 172.21.15.96:0/3385935614 wait complete. 2024-04-18T04:54:34.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b202a6640 1 Processor -- start 2024-04-18T04:54:34.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b202a6640 1 -- start start 2024-04-18T04:54:34.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b202a6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b180c3fd0 0x7f1b18154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b202a6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b180cacc0 0x7f1b181efb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b202a6640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1b181532d0 0x7f1b18156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b202a6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b18159f20 con 0x7f1b180c3fd0 2024-04-18T04:54:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b202a6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b18158ae0 con 0x7f1b180cacc0 2024-04-18T04:54:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b202a6640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b18154b70 con 0x7f1b181532d0 2024-04-18T04:54:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b1e042640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b180c3fd0 0x7f1b18154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b1e042640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b180c3fd0 0x7f1b18154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43016/0 (socket says 172.21.15.96:43016) 2024-04-18T04:54:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.776+0000 7f1b1e042640 1 -- 172.21.15.96:0/3440228356 learned_addr learned my addr 172.21.15.96:0/3440228356 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b1d841640 1 --2- 172.21.15.96:0/3440228356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b180cacc0 0x7f1b181efb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b1e843640 1 --2- 172.21.15.96:0/3440228356 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1b181532d0 0x7f1b18156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b1e042640 1 -- 172.21.15.96:0/3440228356 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1b181532d0 msgr2=0x7f1b18156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b1e042640 1 --2- 172.21.15.96:0/3440228356 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1b181532d0 0x7f1b18156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b1e042640 1 -- 172.21.15.96:0/3440228356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b180cacc0 msgr2=0x7f1b181efb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:34.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b1e042640 1 --2- 172.21.15.96:0/3440228356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b180cacc0 0x7f1b181efb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b1e042640 1 -- 172.21.15.96:0/3440228356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b080094d0 con 0x7f1b180c3fd0 2024-04-18T04:54:34.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b1e042640 1 --2- 172.21.15.96:0/3440228356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b180c3fd0 0x7f1b18154410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400ba80 tx=0x7f1b1400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:34.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b0effd640 1 -- 172.21.15.96:0/3440228356 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1400cc00 con 0x7f1b180c3fd0 2024-04-18T04:54:34.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b0effd640 1 -- 172.21.15.96:0/3440228356 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1400cd80 con 0x7f1b180c3fd0 2024-04-18T04:54:34.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b202a6640 1 -- 172.21.15.96:0/3440228356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b180cd8c0 con 0x7f1b180c3fd0 2024-04-18T04:54:34.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b0effd640 1 -- 172.21.15.96:0/3440228356 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14014680 con 0x7f1b180c3fd0 2024-04-18T04:54:34.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b202a6640 1 -- 172.21.15.96:0/3440228356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b18155a30 con 0x7f1b180c3fd0 2024-04-18T04:54:34.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b202a6640 1 -- 172.21.15.96:0/3440228356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b18155890 con 0x7f1b180c3fd0 2024-04-18T04:54:34.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b0effd640 1 -- 172.21.15.96:0/3440228356 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f1b1401d3b0 con 0x7f1b180c3fd0 2024-04-18T04:54:34.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b0effd640 1 --2- 172.21.15.96:0/3440228356 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1afc066600 0x7f1afc068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:34.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b1d841640 1 --2- 172.21.15.96:0/3440228356 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1afc066600 0x7f1afc068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:34.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b0effd640 1 -- 172.21.15.96:0/3440228356 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1b14083c10 con 0x7f1b180c3fd0 2024-04-18T04:54:34.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.780+0000 7f1b1d841640 1 --2- 172.21.15.96:0/3440228356 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1afc066600 0x7f1afc068ac0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1b080b2000 tx=0x7f1b08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:34.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.784+0000 7f1b0effd640 1 -- 172.21.15.96:0/3440228356 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1b18155890 con 0x7f1b180c3fd0 2024-04-18T04:54:34.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.952+0000 7f1b202a6640 1 -- 172.21.15.96:0/3440228356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b18155890 con 0x7f1b180c3fd0 2024-04-18T04:54:34.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.952+0000 7f1b0effd640 1 -- 172.21.15.96:0/3440228356 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12256 (secure 0 0 0) 0x7f1b18155890 con 0x7f1b180c3fd0 2024-04-18T04:54:34.952 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:34.952 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":15,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:54:34.602636+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:54:34.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.952+0000 7f1b202a6640 1 -- 172.21.15.96:0/3440228356 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1afc066600 msgr2=0x7f1afc068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:34.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.952+0000 7f1b202a6640 1 --2- 172.21.15.96:0/3440228356 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1afc066600 0x7f1afc068ac0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1b080b2000 tx=0x7f1b08008040 comp rx=0 tx=0).stop 2024-04-18T04:54:34.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.952+0000 7f1b202a6640 1 -- 172.21.15.96:0/3440228356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b180c3fd0 msgr2=0x7f1b18154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:34.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.952+0000 7f1b202a6640 1 --2- 172.21.15.96:0/3440228356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b180c3fd0 0x7f1b18154410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400ba80 tx=0x7f1b1400bf40 comp rx=0 tx=0).stop 2024-04-18T04:54:34.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.952+0000 7f1b202a6640 1 -- 172.21.15.96:0/3440228356 shutdown_connections 2024-04-18T04:54:34.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.952+0000 7f1b202a6640 1 --2- 172.21.15.96:0/3440228356 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1afc066600 0x7f1afc068ac0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.952+0000 7f1b202a6640 1 --2- 172.21.15.96:0/3440228356 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1b181532d0 0x7f1b18156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.952+0000 7f1b202a6640 1 --2- 172.21.15.96:0/3440228356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b180cacc0 0x7f1b181efb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.956+0000 7f1b202a6640 1 --2- 172.21.15.96:0/3440228356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b180c3fd0 0x7f1b18154410 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:34.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.956+0000 7f1b202a6640 1 -- 172.21.15.96:0/3440228356 >> 172.21.15.96:0/3440228356 conn(0x7f1b18071760 msgr2=0x7f1b180c94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:34.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.956+0000 7f1b202a6640 1 -- 172.21.15.96:0/3440228356 shutdown_connections 2024-04-18T04:54:34.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:34.956+0000 7f1b202a6640 1 -- 172.21.15.96:0/3440228356 wait complete. 2024-04-18T04:54:34.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:54:32.641813+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T04:54:34.969 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T04:54:35.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.080+0000 7fc3d1624640 1 Processor -- start 2024-04-18T04:54:35.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.080+0000 7fc3d1624640 1 -- start start 2024-04-18T04:54:35.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.084+0000 7fc3d1624640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc3cc0c3650 0x7fc3cc0c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:35.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.084+0000 7fc3d1624640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3cc0c8100 con 0x7fc3cc14fc60 2024-04-18T04:54:35.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.084+0000 7fc3d1624640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3cc0c5660 con 0x7fc3cc155d00 2024-04-18T04:54:35.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.084+0000 7fc3d1624640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3cc0c8350 con 0x7fc3cc0c3650 2024-04-18T04:54:35.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.084+0000 7fc3cb7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc3cc0c3650 0x7fc3cc0c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:35.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.084+0000 7fc3caffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc3cc14fc60 0x7fc3cc06d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55430/0 (socket says 172.21.15.96:55430) 2024-04-18T04:54:35.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.084+0000 7fc3caffd640 1 -- 172.21.15.96:0/2672480539 learned_addr learned my addr 172.21.15.96:0/2672480539 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:35.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.084+0000 7fc3cb7fe640 1 -- 172.21.15.96:0/2672480539 >> v1:172.21.15.139:6789/0 conn(0x7fc3cc155d00 legacy=0x7fc3cc156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:35.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.084+0000 7fc3cb7fe640 1 -- 172.21.15.96:0/2672480539 >> v1:172.21.15.96:6789/0 conn(0x7fc3cc14fc60 legacy=0x7fc3cc06d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:35.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.084+0000 7fc3cb7fe640 1 -- 172.21.15.96:0/2672480539 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc0c8630 con 0x7fc3cc0c3650 2024-04-18T04:54:35.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.084+0000 7fc3cb7fe640 1 --2- 172.21.15.96:0/2672480539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3cc0c3650 0x7fc3cc0c3a70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009d90 tx=0x7fc3c401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19b0062280305b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:35.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.084+0000 7fc3ca7fc640 1 -- 172.21.15.96:0/2672480539 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c40a5830 con 0x7fc3cc0c3650 2024-04-18T04:54:35.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.084+0000 7fc3ca7fc640 1 -- 172.21.15.96:0/2672480539 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c40a5990 con 0x7fc3cc0c3650 2024-04-18T04:54:35.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.084+0000 7fc3ca7fc640 1 -- 172.21.15.96:0/2672480539 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c40a5d20 con 0x7fc3cc0c3650 2024-04-18T04:54:35.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 -- 172.21.15.96:0/2672480539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3cc0c3650 msgr2=0x7fc3cc0c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:35.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 --2- 172.21.15.96:0/2672480539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3cc0c3650 0x7fc3cc0c3a70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009d90 tx=0x7fc3c401c870 comp rx=0 tx=0).stop 2024-04-18T04:54:35.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 -- 172.21.15.96:0/2672480539 shutdown_connections 2024-04-18T04:54:35.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 --2- 172.21.15.96:0/2672480539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3cc0c3650 0x7fc3cc0c3a70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 -- 172.21.15.96:0/2672480539 >> 172.21.15.96:0/2672480539 conn(0x7fc3cc06c610 msgr2=0x7fc3cc0ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:35.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 -- 172.21.15.96:0/2672480539 shutdown_connections 2024-04-18T04:54:35.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 -- 172.21.15.96:0/2672480539 wait complete. 2024-04-18T04:54:35.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 Processor -- start 2024-04-18T04:54:35.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 -- start start 2024-04-18T04:54:35.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3cc0c3650 0x7fc3cc155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:35.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc3cc14fc60 0x7fc3cc154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:35.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3cc155d00 0x7fc3cc1f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:35.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc149380 con 0x7fc3cc155d00 2024-04-18T04:54:35.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc14ed40 con 0x7fc3cc0c3650 2024-04-18T04:54:35.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc1f3180 con 0x7fc3cc14fc60 2024-04-18T04:54:35.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3cb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3cc155d00 0x7fc3cc1f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:35.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3cb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3cc155d00 0x7fc3cc1f2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43036/0 (socket says 172.21.15.96:43036) 2024-04-18T04:54:35.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3cb7fe640 1 -- 172.21.15.96:0/2523288658 learned_addr learned my addr 172.21.15.96:0/2523288658 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:35.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3c27fc640 1 --2- 172.21.15.96:0/2523288658 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc3cc14fc60 0x7fc3cc154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:35.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3caffd640 1 --2- 172.21.15.96:0/2523288658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3cc0c3650 0x7fc3cc155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:35.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3cb7fe640 1 -- 172.21.15.96:0/2523288658 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc3cc14fc60 msgr2=0x7fc3cc154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:35.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3cb7fe640 1 --2- 172.21.15.96:0/2523288658 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc3cc14fc60 0x7fc3cc154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3cb7fe640 1 -- 172.21.15.96:0/2523288658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3cc0c3650 msgr2=0x7fc3cc155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:35.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3cb7fe640 1 --2- 172.21.15.96:0/2523288658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3cc0c3650 0x7fc3cc155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3cb7fe640 1 -- 172.21.15.96:0/2523288658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c4009a70 con 0x7fc3cc155d00 2024-04-18T04:54:35.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3caffd640 1 --2- 172.21.15.96:0/2523288658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3cc0c3650 0x7fc3cc155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:35.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3cb7fe640 1 --2- 172.21.15.96:0/2523288658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3cc155d00 0x7fc3cc1f2c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40b0040 tx=0x7fc3c4019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:35.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3c3fff640 1 -- 172.21.15.96:0/2523288658 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c40b9860 con 0x7fc3cc155d00 2024-04-18T04:54:35.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3c3fff640 1 -- 172.21.15.96:0/2523288658 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c40b99c0 con 0x7fc3cc155d00 2024-04-18T04:54:35.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 -- 172.21.15.96:0/2523288658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3cc146b30 con 0x7fc3cc155d00 2024-04-18T04:54:35.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3c3fff640 1 -- 172.21.15.96:0/2523288658 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c40b9d50 con 0x7fc3cc155d00 2024-04-18T04:54:35.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.088+0000 7fc3d1624640 1 -- 172.21.15.96:0/2523288658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3cc1495d0 con 0x7fc3cc155d00 2024-04-18T04:54:35.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.092+0000 7fc3d1624640 1 -- 172.21.15.96:0/2523288658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3cc067050 con 0x7fc3cc155d00 2024-04-18T04:54:35.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.092+0000 7fc3c3fff640 1 -- 172.21.15.96:0/2523288658 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7fc3c40ad440 con 0x7fc3cc155d00 2024-04-18T04:54:35.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.092+0000 7fc3c3fff640 1 --2- 172.21.15.96:0/2523288658 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc3b0066600 0x7fc3b0068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:35.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.092+0000 7fc3c3fff640 1 -- 172.21.15.96:0/2523288658 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc3c411f100 con 0x7fc3cc155d00 2024-04-18T04:54:35.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.092+0000 7fc3caffd640 1 --2- 172.21.15.96:0/2523288658 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc3b0066600 0x7fc3b0068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:35.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.092+0000 7fc3caffd640 1 --2- 172.21.15.96:0/2523288658 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc3b0066600 0x7fc3b0068ac0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc005890 tx=0x7fc3bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:35.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.096+0000 7fc3c3fff640 1 -- 172.21.15.96:0/2523288658 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc3c40eca50 con 0x7fc3cc155d00 2024-04-18T04:54:35.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.240+0000 7fc3d1624640 1 -- 172.21.15.96:0/2523288658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3cc0c4e00 con 0x7fc3cc155d00 2024-04-18T04:54:35.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.240+0000 7fc3c3fff640 1 -- 172.21.15.96:0/2523288658 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3c40f0070 con 0x7fc3cc155d00 2024-04-18T04:54:35.242 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-18T04:54:35.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.244+0000 7fc3d1624640 1 -- 172.21.15.96:0/2523288658 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc3b0066600 msgr2=0x7fc3b0068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:35.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.244+0000 7fc3d1624640 1 --2- 172.21.15.96:0/2523288658 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc3b0066600 0x7fc3b0068ac0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc005890 tx=0x7fc3bc009040 comp rx=0 tx=0).stop 2024-04-18T04:54:35.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.244+0000 7fc3d1624640 1 -- 172.21.15.96:0/2523288658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3cc155d00 msgr2=0x7fc3cc1f2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:35.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.244+0000 7fc3d1624640 1 --2- 172.21.15.96:0/2523288658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3cc155d00 0x7fc3cc1f2c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40b0040 tx=0x7fc3c4019610 comp rx=0 tx=0).stop 2024-04-18T04:54:35.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.244+0000 7fc3d1624640 1 -- 172.21.15.96:0/2523288658 shutdown_connections 2024-04-18T04:54:35.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.244+0000 7fc3d1624640 1 --2- 172.21.15.96:0/2523288658 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc3b0066600 0x7fc3b0068ac0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.244+0000 7fc3d1624640 1 --2- 172.21.15.96:0/2523288658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3cc155d00 0x7fc3cc1f2c40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.244+0000 7fc3d1624640 1 --2- 172.21.15.96:0/2523288658 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc3cc14fc60 0x7fc3cc154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.244+0000 7fc3d1624640 1 --2- 172.21.15.96:0/2523288658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3cc0c3650 0x7fc3cc155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.244+0000 7fc3d1624640 1 -- 172.21.15.96:0/2523288658 >> 172.21.15.96:0/2523288658 conn(0x7fc3cc06c610 msgr2=0x7fc3cc156170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:35.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.244+0000 7fc3d1624640 1 -- 172.21.15.96:0/2523288658 shutdown_connections 2024-04-18T04:54:35.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.244+0000 7fc3d1624640 1 -- 172.21.15.96:0/2523288658 wait complete. 2024-04-18T04:54:35.259 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:54:35.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.376+0000 7fded494a640 1 Processor -- start 2024-04-18T04:54:35.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.376+0000 7fded494a640 1 -- start start 2024-04-18T04:54:35.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fded494a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fded0151210 0x7fded00c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:35.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fded494a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fded015a950 0x7fded015ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:35.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fded494a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded015b2c0 con 0x7fded00c1db0 2024-04-18T04:54:35.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fded494a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded0157150 con 0x7fded015a950 2024-04-18T04:54:35.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fded494a640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded0157430 con 0x7fded0151210 2024-04-18T04:54:35.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fdeced9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fded015a950 0x7fded015ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:35.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fdeced9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fded015a950 0x7fded015ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43038/0 (socket says 172.21.15.96:43038) 2024-04-18T04:54:35.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fdeced9d640 1 -- 172.21.15.96:0/3726359398 learned_addr learned my addr 172.21.15.96:0/3726359398 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:35.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fdecdd9b640 1 --1- 172.21.15.96:0/3726359398 >> v1:172.21.15.96:6789/0 conn(0x7fded00c1db0 0x7fded00ca300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55440/0 (socket says 172.21.15.96:55440) 2024-04-18T04:54:35.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fdecd59a640 1 -- 172.21.15.96:0/3726359398 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894895311 0 0) 0x7fded015b2c0 con 0x7fded00c1db0 2024-04-18T04:54:35.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fdece59c640 1 --2- 172.21.15.96:0/3726359398 >> v2:172.21.15.139:3300/0 conn(0x7fded0151210 0x7fded00c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:35.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fdecd59a640 1 -- 172.21.15.96:0/3726359398 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeb8003530 con 0x7fded00c1db0 2024-04-18T04:54:35.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fdeced9d640 1 -- 172.21.15.96:0/3726359398 >> v2:172.21.15.139:3300/0 conn(0x7fded0151210 msgr2=0x7fded00c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:35.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fdeced9d640 1 --2- 172.21.15.96:0/3726359398 >> v2:172.21.15.139:3300/0 conn(0x7fded0151210 0x7fded00c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fdeced9d640 1 -- 172.21.15.96:0/3726359398 >> v1:172.21.15.96:6789/0 conn(0x7fded00c1db0 legacy=0x7fded00ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:35.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fdeced9d640 1 -- 172.21.15.96:0/3726359398 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded0157710 con 0x7fded015a950 2024-04-18T04:54:35.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fdeced9d640 1 --2- 172.21.15.96:0/3726359398 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fded015a950 0x7fded015ad80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fded00c7b80 tx=0x7fdec801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf4d8f509ce71f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:35.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fdecd59a640 1 -- 172.21.15.96:0/3726359398 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec80af400 con 0x7fded015a950 2024-04-18T04:54:35.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fdecd59a640 1 -- 172.21.15.96:0/3726359398 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec80ab050 con 0x7fded015a950 2024-04-18T04:54:35.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.380+0000 7fdecd59a640 1 -- 172.21.15.96:0/3726359398 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec80af780 con 0x7fded015a950 2024-04-18T04:54:35.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 -- 172.21.15.96:0/3726359398 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fded015a950 msgr2=0x7fded015ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:35.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 --2- 172.21.15.96:0/3726359398 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fded015a950 0x7fded015ad80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fded00c7b80 tx=0x7fdec801f1e0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 -- 172.21.15.96:0/3726359398 shutdown_connections 2024-04-18T04:54:35.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 --2- 172.21.15.96:0/3726359398 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fded015a950 0x7fded015ad80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 --2- 172.21.15.96:0/3726359398 >> v2:172.21.15.139:3300/0 conn(0x7fded0151210 0x7fded00c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 -- 172.21.15.96:0/3726359398 >> 172.21.15.96:0/3726359398 conn(0x7fded006c750 msgr2=0x7fded00c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:35.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 -- 172.21.15.96:0/3726359398 shutdown_connections 2024-04-18T04:54:35.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 -- 172.21.15.96:0/3726359398 wait complete. 2024-04-18T04:54:35.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 Processor -- start 2024-04-18T04:54:35.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 -- start start 2024-04-18T04:54:35.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fded00c1db0 0x7fded00c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:35.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fded0151210 0x7fded013f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:35.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fded015a950 0x7fded013f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:35.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded014ad40 con 0x7fded00c1db0 2024-04-18T04:54:35.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded00ca150 con 0x7fded015a950 2024-04-18T04:54:35.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded01401b0 con 0x7fded0151210 2024-04-18T04:54:35.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fdece59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fded00c1db0 0x7fded00c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fdece59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fded00c1db0 0x7fded00c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43040/0 (socket says 172.21.15.96:43040) 2024-04-18T04:54:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fdece59c640 1 -- 172.21.15.96:0/4179572326 learned_addr learned my addr 172.21.15.96:0/4179572326 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fdecdd9b640 1 --2- 172.21.15.96:0/4179572326 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fded0151210 0x7fded013f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fdeced9d640 1 --2- 172.21.15.96:0/4179572326 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fded015a950 0x7fded013f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fdece59c640 1 -- 172.21.15.96:0/4179572326 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fded0151210 msgr2=0x7fded013f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fdece59c640 1 --2- 172.21.15.96:0/4179572326 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fded0151210 0x7fded013f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fdece59c640 1 -- 172.21.15.96:0/4179572326 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fded015a950 msgr2=0x7fded013f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fdece59c640 1 --2- 172.21.15.96:0/4179572326 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fded015a950 0x7fded013f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fdece59c640 1 -- 172.21.15.96:0/4179572326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec8009b30 con 0x7fded00c1db0 2024-04-18T04:54:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fdeced9d640 1 --2- 172.21.15.96:0/4179572326 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fded015a950 0x7fded013f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fdece59c640 1 --2- 172.21.15.96:0/4179572326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fded00c1db0 0x7fded00c9550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdec000d5f0 tx=0x7fdec000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fdebeffd640 1 -- 172.21.15.96:0/4179572326 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec00125f0 con 0x7fded00c1db0 2024-04-18T04:54:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fdebeffd640 1 -- 172.21.15.96:0/4179572326 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec0012750 con 0x7fded00c1db0 2024-04-18T04:54:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fdebeffd640 1 -- 172.21.15.96:0/4179572326 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0012ae0 con 0x7fded00c1db0 2024-04-18T04:54:35.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 -- 172.21.15.96:0/4179572326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded014af30 con 0x7fded00c1db0 2024-04-18T04:54:35.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 -- 172.21.15.96:0/4179572326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded0151830 con 0x7fded00c1db0 2024-04-18T04:54:35.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.384+0000 7fded494a640 1 -- 172.21.15.96:0/4179572326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded0140690 con 0x7fded00c1db0 2024-04-18T04:54:35.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.388+0000 7fdebeffd640 1 -- 172.21.15.96:0/4179572326 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7fdec0012c40 con 0x7fded00c1db0 2024-04-18T04:54:35.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.388+0000 7fdebeffd640 1 --2- 172.21.15.96:0/4179572326 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdeb0066600 0x7fdeb0068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:35.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.388+0000 7fdebeffd640 1 -- 172.21.15.96:0/4179572326 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdec0084270 con 0x7fded00c1db0 2024-04-18T04:54:35.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.388+0000 7fdecdd9b640 1 --2- 172.21.15.96:0/4179572326 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdeb0066600 0x7fdeb0068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:35.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.388+0000 7fdecdd9b640 1 --2- 172.21.15.96:0/4179572326 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdeb0066600 0x7fdeb0068ac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdec40010f0 tx=0x7fdec4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:35.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.392+0000 7fdebeffd640 1 -- 172.21.15.96:0/4179572326 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fdec0051970 con 0x7fded00c1db0 2024-04-18T04:54:35.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.580+0000 7fded494a640 1 -- 172.21.15.96:0/4179572326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fded0156d70 con 0x7fded00c1db0 2024-04-18T04:54:35.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.580+0000 7fdebeffd640 1 -- 172.21.15.96:0/4179572326 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7fdec0007380 con 0x7fded00c1db0 2024-04-18T04:54:35.582 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:35.583 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1188672263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1188672263},{"type":"v1","addr":"172.21.15.96:6835","nonce":1188672263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-18T04:54:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 2 2024-04-18T04:54:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.584+0000 7fded494a640 1 -- 172.21.15.96:0/4179572326 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdeb0066600 msgr2=0x7fdeb0068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.584+0000 7fded494a640 1 --2- 172.21.15.96:0/4179572326 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdeb0066600 0x7fdeb0068ac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdec40010f0 tx=0x7fdec4009040 comp rx=0 tx=0).stop 2024-04-18T04:54:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.584+0000 7fded494a640 1 -- 172.21.15.96:0/4179572326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fded00c1db0 msgr2=0x7fded00c9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.584+0000 7fded494a640 1 --2- 172.21.15.96:0/4179572326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fded00c1db0 0x7fded00c9550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdec000d5f0 tx=0x7fdec000dab0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.584+0000 7fded494a640 1 -- 172.21.15.96:0/4179572326 shutdown_connections 2024-04-18T04:54:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.584+0000 7fded494a640 1 --2- 172.21.15.96:0/4179572326 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdeb0066600 0x7fdeb0068ac0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.584+0000 7fded494a640 1 --2- 172.21.15.96:0/4179572326 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fded015a950 0x7fded013f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.584+0000 7fded494a640 1 --2- 172.21.15.96:0/4179572326 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fded0151210 0x7fded013f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.584+0000 7fded494a640 1 --2- 172.21.15.96:0/4179572326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fded00c1db0 0x7fded00c9550 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:35.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.584+0000 7fded494a640 1 -- 172.21.15.96:0/4179572326 >> 172.21.15.96:0/4179572326 conn(0x7fded006c750 msgr2=0x7fded0142e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:35.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.584+0000 7fded494a640 1 -- 172.21.15.96:0/4179572326 shutdown_connections 2024-04-18T04:54:35.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:35.584+0000 7fded494a640 1 -- 172.21.15.96:0/4179572326 wait complete. 2024-04-18T04:54:37.602 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:54:37.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.736+0000 7f291a98b640 1 Processor -- start 2024-04-18T04:54:37.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.736+0000 7f291a98b640 1 -- start start 2024-04-18T04:54:37.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.736+0000 7f291a98b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2914151210 0x7f29140c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:37.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.736+0000 7f291a98b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f29140c1db0 0x7f29140ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:37.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.736+0000 7f291a98b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2914157150 con 0x7f29140ca840 2024-04-18T04:54:37.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.736+0000 7f291a98b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2914157430 con 0x7f2914151210 2024-04-18T04:54:37.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.736+0000 7f291a98b640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2914157710 con 0x7f29140c1db0 2024-04-18T04:54:37.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.736+0000 7f2913fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2914151210 0x7f29140c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:37.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.736+0000 7f2918f28640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f29140ca840 0x7f291415a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55446/0 (socket says 172.21.15.96:55446) 2024-04-18T04:54:37.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.736+0000 7f2918f28640 1 -- 172.21.15.96:0/58442178 learned_addr learned my addr 172.21.15.96:0/58442178 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:37.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.736+0000 7f290b7fe640 1 --2- 172.21.15.96:0/58442178 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f29140c1db0 0x7f29140ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:37.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.736+0000 7f2913fff640 1 -- 172.21.15.96:0/58442178 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f29140c1db0 msgr2=0x7f29140ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:37.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.736+0000 7f2913fff640 1 --2- 172.21.15.96:0/58442178 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f29140c1db0 0x7f29140ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:37.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.736+0000 7f2913fff640 1 -- 172.21.15.96:0/58442178 >> v1:172.21.15.96:6789/0 conn(0x7f29140ca840 legacy=0x7f291415a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:37.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.736+0000 7f2913fff640 1 -- 172.21.15.96:0/58442178 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29141579f0 con 0x7f2914151210 2024-04-18T04:54:37.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.736+0000 7f290b7fe640 1 --2- 172.21.15.96:0/58442178 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f29140c1db0 0x7f29140ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:54:37.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f2913fff640 1 --2- 172.21.15.96:0/58442178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2914151210 0x7f29140c1870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f29040097c0 tx=0x7f290401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c2237fd84b2722 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:37.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f29137fe640 1 -- 172.21.15.96:0/58442178 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29040ab600 con 0x7f2914151210 2024-04-18T04:54:37.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f29137fe640 1 -- 172.21.15.96:0/58442178 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29040a7050 con 0x7f2914151210 2024-04-18T04:54:37.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f29137fe640 1 -- 172.21.15.96:0/58442178 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29040ab980 con 0x7f2914151210 2024-04-18T04:54:37.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 -- 172.21.15.96:0/58442178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2914151210 msgr2=0x7f29140c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 --2- 172.21.15.96:0/58442178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2914151210 0x7f29140c1870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f29040097c0 tx=0x7f290401c3c0 comp rx=0 tx=0).stop 2024-04-18T04:54:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 -- 172.21.15.96:0/58442178 shutdown_connections 2024-04-18T04:54:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 --2- 172.21.15.96:0/58442178 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f29140c1db0 0x7f29140ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 --2- 172.21.15.96:0/58442178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2914151210 0x7f29140c1870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 -- 172.21.15.96:0/58442178 >> 172.21.15.96:0/58442178 conn(0x7f291406c750 msgr2=0x7f29140c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 -- 172.21.15.96:0/58442178 shutdown_connections 2024-04-18T04:54:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 -- 172.21.15.96:0/58442178 wait complete. 2024-04-18T04:54:37.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 Processor -- start 2024-04-18T04:54:37.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 -- start start 2024-04-18T04:54:37.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140c1db0 0x7f29141ec880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:37.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f29140ca840 0x7f291414c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:37.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2914151210 0x7f291414fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:37.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29141ed8c0 con 0x7f29140c1db0 2024-04-18T04:54:37.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291414c390 con 0x7f2914151210 2024-04-18T04:54:37.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291414cd60 con 0x7f29140ca840 2024-04-18T04:54:37.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f2913fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140c1db0 0x7f29141ec880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:37.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f2913fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140c1db0 0x7f29141ec880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43096/0 (socket says 172.21.15.96:43096) 2024-04-18T04:54:37.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f2913fff640 1 -- 172.21.15.96:0/4207871540 learned_addr learned my addr 172.21.15.96:0/4207871540 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:37.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f2913fff640 1 -- 172.21.15.96:0/4207871540 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f29140ca840 msgr2=0x7f291414c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:37.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f2913fff640 1 --2- 172.21.15.96:0/4207871540 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f29140ca840 0x7f291414c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:37.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f2913fff640 1 -- 172.21.15.96:0/4207871540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2914151210 msgr2=0x7f291414fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:37.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f2913fff640 1 --2- 172.21.15.96:0/4207871540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2914151210 0x7f291414fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:37.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f2913fff640 1 -- 172.21.15.96:0/4207871540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2904009420 con 0x7f29140c1db0 2024-04-18T04:54:37.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f2913fff640 1 --2- 172.21.15.96:0/4207871540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140c1db0 0x7f29141ec880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f29040ae040 tx=0x7f2904019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:37.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f29117fa640 1 -- 172.21.15.96:0/4207871540 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29040b48e0 con 0x7f29140c1db0 2024-04-18T04:54:37.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f29117fa640 1 -- 172.21.15.96:0/4207871540 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29040b4a60 con 0x7f29140c1db0 2024-04-18T04:54:37.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 -- 172.21.15.96:0/4207871540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2914156f20 con 0x7f29140c1db0 2024-04-18T04:54:37.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f29117fa640 1 -- 172.21.15.96:0/4207871540 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29040b4e10 con 0x7f29140c1db0 2024-04-18T04:54:37.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.740+0000 7f291a98b640 1 -- 172.21.15.96:0/4207871540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291414b4a0 con 0x7f29140c1db0 2024-04-18T04:54:37.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.744+0000 7f291a98b640 1 -- 172.21.15.96:0/4207871540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2914067050 con 0x7f29140c1db0 2024-04-18T04:54:37.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.744+0000 7f29117fa640 1 -- 172.21.15.96:0/4207871540 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f29040b2040 con 0x7f29140c1db0 2024-04-18T04:54:37.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.744+0000 7f29117fa640 1 --2- 172.21.15.96:0/4207871540 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f28f4066690 0x7f28f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:37.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.744+0000 7f29117fa640 1 -- 172.21.15.96:0/4207871540 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f290411ec40 con 0x7f29140c1db0 2024-04-18T04:54:37.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.744+0000 7f290b7fe640 1 --2- 172.21.15.96:0/4207871540 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f28f4066690 0x7f28f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:37.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.744+0000 7f290b7fe640 1 --2- 172.21.15.96:0/4207871540 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f28f4066690 0x7f28f4068b50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f28fc006f10 tx=0x7f28fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:37.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.748+0000 7f29117fa640 1 -- 172.21.15.96:0/4207871540 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f29040ec3e0 con 0x7f29140c1db0 2024-04-18T04:54:37.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.940+0000 7f291a98b640 1 -- 172.21.15.96:0/4207871540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29140c6c50 con 0x7f29140c1db0 2024-04-18T04:54:37.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.944+0000 7f29117fa640 1 -- 172.21.15.96:0/4207871540 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5045 (secure 0 0 0) 0x7f29040b0090 con 0x7f29140c1db0 2024-04-18T04:54:37.943 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:37.943 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/4225147900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":4225147900},{"type":"v1","addr":"172.21.15.96:6839","nonce":4225147900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/2054604275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2054604275},{"type":"v1","addr":"172.21.15.139:6836","nonce":2054604275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2105821790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":2105821790},{"type":"v1","addr":"172.21.15.139:6837","nonce":2105821790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1188672263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1188672263},{"type":"v1","addr":"172.21.15.96:6835","nonce":1188672263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/4278976485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":4278976485},{"type":"v1","addr":"172.21.15.96:6837","nonce":4278976485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/3935291095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":3935291095},{"type":"v1","addr":"172.21.15.139:6833","nonce":3935291095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-04-18T04:54:37.944 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 3 2024-04-18T04:54:37.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.944+0000 7f291a98b640 1 -- 172.21.15.96:0/4207871540 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f28f4066690 msgr2=0x7f28f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:37.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.944+0000 7f291a98b640 1 --2- 172.21.15.96:0/4207871540 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f28f4066690 0x7f28f4068b50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f28fc006f10 tx=0x7f28fc008040 comp rx=0 tx=0).stop 2024-04-18T04:54:37.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.944+0000 7f291a98b640 1 -- 172.21.15.96:0/4207871540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140c1db0 msgr2=0x7f29141ec880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:37.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.944+0000 7f291a98b640 1 --2- 172.21.15.96:0/4207871540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140c1db0 0x7f29141ec880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f29040ae040 tx=0x7f2904019160 comp rx=0 tx=0).stop 2024-04-18T04:54:37.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.944+0000 7f291a98b640 1 -- 172.21.15.96:0/4207871540 shutdown_connections 2024-04-18T04:54:37.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.944+0000 7f291a98b640 1 --2- 172.21.15.96:0/4207871540 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f28f4066690 0x7f28f4068b50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:37.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.944+0000 7f291a98b640 1 --2- 172.21.15.96:0/4207871540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2914151210 0x7f291414fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:37.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.944+0000 7f291a98b640 1 --2- 172.21.15.96:0/4207871540 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f29140ca840 0x7f291414c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:37.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.944+0000 7f291a98b640 1 --2- 172.21.15.96:0/4207871540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140c1db0 0x7f29141ec880 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:37.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.944+0000 7f291a98b640 1 -- 172.21.15.96:0/4207871540 >> 172.21.15.96:0/4207871540 conn(0x7f291406c750 msgr2=0x7f29140c5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:37.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.944+0000 7f291a98b640 1 -- 172.21.15.96:0/4207871540 shutdown_connections 2024-04-18T04:54:37.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:37.944+0000 7f291a98b640 1 -- 172.21.15.96:0/4207871540 wait complete. 2024-04-18T04:54:37.962 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:54:38.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.080+0000 7fe991c73640 1 Processor -- start 2024-04-18T04:54:38.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.080+0000 7fe991c73640 1 -- start start 2024-04-18T04:54:38.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.080+0000 7fe991c73640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe98c0c3fd0 0x7fe98c158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.080+0000 7fe991c73640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98c1536b0 con 0x7fe98c0cacc0 2024-04-18T04:54:38.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.080+0000 7fe991c73640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98c159680 con 0x7fe98c1532d0 2024-04-18T04:54:38.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.080+0000 7fe991c73640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98c0c5970 con 0x7fe98c0c3fd0 2024-04-18T04:54:38.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe98affd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe98c0cacc0 0x7fe98c0ce740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55456/0 (socket says 172.21.15.96:55456) 2024-04-18T04:54:38.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe98affd640 1 -- 172.21.15.96:0/2657872033 learned_addr learned my addr 172.21.15.96:0/2657872033 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:38.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe98bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe98c0c3fd0 0x7fe98c158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe98a7fc640 1 -- 172.21.15.96:0/2657872033 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890626844 0 0) 0x7fe98c1536b0 con 0x7fe98c0cacc0 2024-04-18T04:54:38.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe98a7fc640 1 -- 172.21.15.96:0/2657872033 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe978003530 con 0x7fe98c0cacc0 2024-04-18T04:54:38.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe98bfff640 1 -- 172.21.15.96:0/2657872033 >> v1:172.21.15.139:6789/0 conn(0x7fe98c1532d0 legacy=0x7fe98c15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:38.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe98bfff640 1 -- 172.21.15.96:0/2657872033 >> v1:172.21.15.96:6789/0 conn(0x7fe98c0cacc0 legacy=0x7fe98c0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe98bfff640 1 -- 172.21.15.96:0/2657872033 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c159960 con 0x7fe98c0c3fd0 2024-04-18T04:54:38.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe98bfff640 1 --2- 172.21.15.96:0/2657872033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c0c3fd0 0x7fe98c158f60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe984009d90 tx=0x7fe98401f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4f0e7397409ecf server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:38.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe98a7fc640 1 -- 172.21.15.96:0/2657872033 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9840af600 con 0x7fe98c0c3fd0 2024-04-18T04:54:38.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe98a7fc640 1 -- 172.21.15.96:0/2657872033 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9840ab050 con 0x7fe98c0c3fd0 2024-04-18T04:54:38.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe98a7fc640 1 -- 172.21.15.96:0/2657872033 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9840af980 con 0x7fe98c0c3fd0 2024-04-18T04:54:38.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe991c73640 1 -- 172.21.15.96:0/2657872033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c0c3fd0 msgr2=0x7fe98c158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe991c73640 1 --2- 172.21.15.96:0/2657872033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c0c3fd0 0x7fe98c158f60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe984009d90 tx=0x7fe98401f120 comp rx=0 tx=0).stop 2024-04-18T04:54:38.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe991c73640 1 -- 172.21.15.96:0/2657872033 shutdown_connections 2024-04-18T04:54:38.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe991c73640 1 --2- 172.21.15.96:0/2657872033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c0c3fd0 0x7fe98c158f60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe991c73640 1 -- 172.21.15.96:0/2657872033 >> 172.21.15.96:0/2657872033 conn(0x7fe98c071760 msgr2=0x7fe98c06b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:38.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe991c73640 1 -- 172.21.15.96:0/2657872033 shutdown_connections 2024-04-18T04:54:38.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.084+0000 7fe991c73640 1 -- 172.21.15.96:0/2657872033 wait complete. 2024-04-18T04:54:38.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe991c73640 1 Processor -- start 2024-04-18T04:54:38.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe991c73640 1 -- start start 2024-04-18T04:54:38.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe991c73640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe98c0c3fd0 0x7fe98c149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe991c73640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe98c0cacc0 0x7fe98c1470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe991c73640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c1532d0 0x7fe98c147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe991c73640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c1594a0 con 0x7fe98c1532d0 2024-04-18T04:54:38.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe991c73640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c159f20 con 0x7fe98c0cacc0 2024-04-18T04:54:38.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe991c73640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c0c7e60 con 0x7fe98c0c3fd0 2024-04-18T04:54:38.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe98bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c1532d0 0x7fe98c147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe98bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c1532d0 0x7fe98c147610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43110/0 (socket says 172.21.15.96:43110) 2024-04-18T04:54:38.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe98bfff640 1 -- 172.21.15.96:0/476017810 learned_addr learned my addr 172.21.15.96:0/476017810 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:38.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe98b7fe640 1 --2- 172.21.15.96:0/476017810 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe98c0c3fd0 0x7fe98c149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe98affd640 1 --2- 172.21.15.96:0/476017810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe98c0cacc0 0x7fe98c1470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe98bfff640 1 -- 172.21.15.96:0/476017810 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe98c0c3fd0 msgr2=0x7fe98c149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe98bfff640 1 --2- 172.21.15.96:0/476017810 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe98c0c3fd0 0x7fe98c149460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe98bfff640 1 -- 172.21.15.96:0/476017810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe98c0cacc0 msgr2=0x7fe98c1470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe98bfff640 1 --2- 172.21.15.96:0/476017810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe98c0cacc0 0x7fe98c1470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe98bfff640 1 -- 172.21.15.96:0/476017810 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe984009a70 con 0x7fe98c1532d0 2024-04-18T04:54:38.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe98b7fe640 1 --2- 172.21.15.96:0/476017810 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe98c0c3fd0 0x7fe98c149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:54:38.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe98bfff640 1 --2- 172.21.15.96:0/476017810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c1532d0 0x7fe98c147610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe98401cd50 tx=0x7fe98401bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:38.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe983fff640 1 -- 172.21.15.96:0/476017810 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984009450 con 0x7fe98c1532d0 2024-04-18T04:54:38.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe983fff640 1 -- 172.21.15.96:0/476017810 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9840b9410 con 0x7fe98c1532d0 2024-04-18T04:54:38.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe991c73640 1 -- 172.21.15.96:0/476017810 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98c1f21f0 con 0x7fe98c1532d0 2024-04-18T04:54:38.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe983fff640 1 -- 172.21.15.96:0/476017810 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9840b97a0 con 0x7fe98c1532d0 2024-04-18T04:54:38.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe991c73640 1 -- 172.21.15.96:0/476017810 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98c1f27b0 con 0x7fe98c1532d0 2024-04-18T04:54:38.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe991c73640 1 -- 172.21.15.96:0/476017810 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98c067050 con 0x7fe98c1532d0 2024-04-18T04:54:38.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.088+0000 7fe983fff640 1 -- 172.21.15.96:0/476017810 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe9840b6050 con 0x7fe98c1532d0 2024-04-18T04:54:38.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.092+0000 7fe983fff640 1 --2- 172.21.15.96:0/476017810 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe96c066690 0x7fe96c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.092+0000 7fe983fff640 1 -- 172.21.15.96:0/476017810 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe9841223f0 con 0x7fe98c1532d0 2024-04-18T04:54:38.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.092+0000 7fe98b7fe640 1 --2- 172.21.15.96:0/476017810 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe96c066690 0x7fe96c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.092+0000 7fe98b7fe640 1 --2- 172.21.15.96:0/476017810 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe96c066690 0x7fe96c068b50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0098b0 tx=0x7fe97c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:38.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.096+0000 7fe983fff640 1 -- 172.21.15.96:0/476017810 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe9840efa20 con 0x7fe98c1532d0 2024-04-18T04:54:38.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.252+0000 7fe991c73640 1 -- 172.21.15.96:0/476017810 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe98c0c5750 con 0x7fe98c1532d0 2024-04-18T04:54:38.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.256+0000 7fe983fff640 1 -- 172.21.15.96:0/476017810 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12382 (secure 0 0 0) 0x7fe9840b4020 con 0x7fe98c1532d0 2024-04-18T04:54:38.256 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:38.256 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:54:36.622794+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.720340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.767224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.811511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.710188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.860525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.704784+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:54:38.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.256+0000 7fe991c73640 1 -- 172.21.15.96:0/476017810 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe96c066690 msgr2=0x7fe96c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.256+0000 7fe991c73640 1 --2- 172.21.15.96:0/476017810 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe96c066690 0x7fe96c068b50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0098b0 tx=0x7fe97c008040 comp rx=0 tx=0).stop 2024-04-18T04:54:38.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.256+0000 7fe991c73640 1 -- 172.21.15.96:0/476017810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c1532d0 msgr2=0x7fe98c147610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.256+0000 7fe991c73640 1 --2- 172.21.15.96:0/476017810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c1532d0 0x7fe98c147610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe98401cd50 tx=0x7fe98401bec0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.256+0000 7fe991c73640 1 -- 172.21.15.96:0/476017810 shutdown_connections 2024-04-18T04:54:38.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.256+0000 7fe991c73640 1 --2- 172.21.15.96:0/476017810 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe96c066690 0x7fe96c068b50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.256+0000 7fe991c73640 1 --2- 172.21.15.96:0/476017810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe98c1532d0 0x7fe98c147610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.256+0000 7fe991c73640 1 --2- 172.21.15.96:0/476017810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe98c0cacc0 0x7fe98c1470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.256+0000 7fe991c73640 1 --2- 172.21.15.96:0/476017810 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe98c0c3fd0 0x7fe98c149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.256+0000 7fe991c73640 1 -- 172.21.15.96:0/476017810 >> 172.21.15.96:0/476017810 conn(0x7fe98c071760 msgr2=0x7fe98c0cdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:38.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.256+0000 7fe991c73640 1 -- 172.21.15.96:0/476017810 shutdown_connections 2024-04-18T04:54:38.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.256+0000 7fe991c73640 1 -- 172.21.15.96:0/476017810 wait complete. 2024-04-18T04:54:38.274 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:54:32.641813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T04:54:38.275 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T04:54:38.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.388+0000 7f8995476640 1 Processor -- start 2024-04-18T04:54:38.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.388+0000 7f8995476640 1 -- start start 2024-04-18T04:54:38.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8995476640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f89900cacc0 0x7f8990158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8995476640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f89900c3fd0 0x7f89900ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8995476640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89901536b0 con 0x7f89901532d0 2024-04-18T04:54:38.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8995476640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89900c5970 con 0x7f89900cacc0 2024-04-18T04:54:38.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8995476640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89901594a0 con 0x7f89900c3fd0 2024-04-18T04:54:38.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8987fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f89900cacc0 0x7f8990158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8987fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f89900cacc0 0x7f8990158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43126/0 (socket says 172.21.15.96:43126) 2024-04-18T04:54:38.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8987fff640 1 -- 172.21.15.96:0/571748542 learned_addr learned my addr 172.21.15.96:0/571748542 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:38.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f898f7fe640 1 --2- 172.21.15.96:0/571748542 >> v2:172.21.15.139:3300/0 conn(0x7f89900c3fd0 0x7f89900ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8987fff640 1 -- 172.21.15.96:0/571748542 >> v2:172.21.15.139:3300/0 conn(0x7f89900c3fd0 msgr2=0x7f89900ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:38.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8987fff640 1 --2- 172.21.15.96:0/571748542 >> v2:172.21.15.139:3300/0 conn(0x7f89900c3fd0 0x7f89900ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8987fff640 1 -- 172.21.15.96:0/571748542 >> v1:172.21.15.139:6789/0 conn(0x7f89901532d0 legacy=0x7f899015ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:38.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8987fff640 1 -- 172.21.15.96:0/571748542 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8990159680 con 0x7f89900cacc0 2024-04-18T04:54:38.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f898f7fe640 1 --2- 172.21.15.96:0/571748542 >> v2:172.21.15.139:3300/0 conn(0x7f89900c3fd0 0x7f89900ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:38.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8987fff640 1 --2- 172.21.15.96:0/571748542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89900cacc0 0x7f8990158f60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f899008c800 tx=0x7f897801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d693270d538c77c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:38.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f898e7fc640 1 -- 172.21.15.96:0/571748542 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780a89d0 con 0x7f89900cacc0 2024-04-18T04:54:38.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f898e7fc640 1 -- 172.21.15.96:0/571748542 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89780a8b30 con 0x7f89900cacc0 2024-04-18T04:54:38.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f898e7fc640 1 -- 172.21.15.96:0/571748542 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780b0440 con 0x7f89900cacc0 2024-04-18T04:54:38.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8995476640 1 -- 172.21.15.96:0/571748542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89900cacc0 msgr2=0x7f8990158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8995476640 1 --2- 172.21.15.96:0/571748542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89900cacc0 0x7f8990158f60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f899008c800 tx=0x7f897801ecd0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8995476640 1 -- 172.21.15.96:0/571748542 shutdown_connections 2024-04-18T04:54:38.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8995476640 1 --2- 172.21.15.96:0/571748542 >> v2:172.21.15.139:3300/0 conn(0x7f89900c3fd0 0x7f89900ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8995476640 1 --2- 172.21.15.96:0/571748542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89900cacc0 0x7f8990158f60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8995476640 1 -- 172.21.15.96:0/571748542 >> 172.21.15.96:0/571748542 conn(0x7f8990071760 msgr2=0x7f899006b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:38.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8995476640 1 -- 172.21.15.96:0/571748542 shutdown_connections 2024-04-18T04:54:38.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.392+0000 7f8995476640 1 -- 172.21.15.96:0/571748542 wait complete. 2024-04-18T04:54:38.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8995476640 1 Processor -- start 2024-04-18T04:54:38.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8995476640 1 -- start start 2024-04-18T04:54:38.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8995476640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89900c3fd0 0x7f89901f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8995476640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89900cacc0 0x7f89900cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8995476640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89901532d0 0x7f89900cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8995476640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8990159f20 con 0x7f89900cacc0 2024-04-18T04:54:38.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8995476640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8990157bd0 con 0x7f89901532d0 2024-04-18T04:54:38.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8995476640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899014d720 con 0x7f89900c3fd0 2024-04-18T04:54:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8987fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89900cacc0 0x7f89900cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8987fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89900cacc0 0x7f89900cb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43140/0 (socket says 172.21.15.96:43140) 2024-04-18T04:54:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8987fff640 1 -- 172.21.15.96:0/1533251745 learned_addr learned my addr 172.21.15.96:0/1533251745 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8987fff640 1 -- 172.21.15.96:0/1533251745 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89900c3fd0 msgr2=0x7f89901f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f898effd640 1 --2- 172.21.15.96:0/1533251745 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89900c3fd0 0x7f89901f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f898f7fe640 1 --2- 172.21.15.96:0/1533251745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89901532d0 0x7f89900cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8987fff640 1 --2- 172.21.15.96:0/1533251745 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89900c3fd0 0x7f89901f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8987fff640 1 -- 172.21.15.96:0/1533251745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89901532d0 msgr2=0x7f89900cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8987fff640 1 --2- 172.21.15.96:0/1533251745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89901532d0 0x7f89900cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8987fff640 1 -- 172.21.15.96:0/1533251745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89780094d0 con 0x7f89900cacc0 2024-04-18T04:54:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f898effd640 1 --2- 172.21.15.96:0/1533251745 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89900c3fd0 0x7f89901f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8987fff640 1 --2- 172.21.15.96:0/1533251745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89900cacc0 0x7f89900cb1c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8978000c10 tx=0x7f897801ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f89877fe640 1 -- 172.21.15.96:0/1533251745 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780b1e90 con 0x7f89900cacc0 2024-04-18T04:54:38.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f89877fe640 1 -- 172.21.15.96:0/1533251745 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89780b9410 con 0x7f89900cacc0 2024-04-18T04:54:38.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f89877fe640 1 -- 172.21.15.96:0/1533251745 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780b97e0 con 0x7f89900cacc0 2024-04-18T04:54:38.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8995476640 1 -- 172.21.15.96:0/1533251745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899014da00 con 0x7f89900cacc0 2024-04-18T04:54:38.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8995476640 1 -- 172.21.15.96:0/1533251745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89901eed90 con 0x7f89900cacc0 2024-04-18T04:54:38.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f8995476640 1 -- 172.21.15.96:0/1533251745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8990159c20 con 0x7f89900cacc0 2024-04-18T04:54:38.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.396+0000 7f89877fe640 1 -- 172.21.15.96:0/1533251745 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89780b7040 con 0x7f89900cacc0 2024-04-18T04:54:38.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.400+0000 7f89877fe640 1 --2- 172.21.15.96:0/1533251745 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8970066690 0x7f8970068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.400+0000 7f89877fe640 1 -- 172.21.15.96:0/1533251745 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8978121e80 con 0x7f89900cacc0 2024-04-18T04:54:38.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.400+0000 7f898effd640 1 --2- 172.21.15.96:0/1533251745 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8970066690 0x7f8970068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.400+0000 7f898effd640 1 --2- 172.21.15.96:0/1533251745 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8970066690 0x7f8970068b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f898000a830 tx=0x7f8980008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:38.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.404+0000 7f89877fe640 1 -- 172.21.15.96:0/1533251745 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8990159c20 con 0x7f89900cacc0 2024-04-18T04:54:38.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.560+0000 7f8995476640 1 -- 172.21.15.96:0/1533251745 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8990159c20 con 0x7f89900cacc0 2024-04-18T04:54:38.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.560+0000 7f89877fe640 1 -- 172.21.15.96:0/1533251745 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8990159c20 con 0x7f89900cacc0 2024-04-18T04:54:38.560 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-18T04:54:38.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.564+0000 7f8995476640 1 -- 172.21.15.96:0/1533251745 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8970066690 msgr2=0x7f8970068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.564+0000 7f8995476640 1 --2- 172.21.15.96:0/1533251745 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8970066690 0x7f8970068b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f898000a830 tx=0x7f8980008040 comp rx=0 tx=0).stop 2024-04-18T04:54:38.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.564+0000 7f8995476640 1 -- 172.21.15.96:0/1533251745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89900cacc0 msgr2=0x7f89900cb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.564+0000 7f8995476640 1 --2- 172.21.15.96:0/1533251745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89900cacc0 0x7f89900cb1c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8978000c10 tx=0x7f897801ba70 comp rx=0 tx=0).stop 2024-04-18T04:54:38.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.564+0000 7f8995476640 1 -- 172.21.15.96:0/1533251745 shutdown_connections 2024-04-18T04:54:38.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.564+0000 7f8995476640 1 --2- 172.21.15.96:0/1533251745 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8970066690 0x7f8970068b50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.564+0000 7f8995476640 1 --2- 172.21.15.96:0/1533251745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89901532d0 0x7f89900cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.564+0000 7f8995476640 1 --2- 172.21.15.96:0/1533251745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89900cacc0 0x7f89900cb1c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.564+0000 7f8995476640 1 --2- 172.21.15.96:0/1533251745 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89900c3fd0 0x7f89901f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.564+0000 7f8995476640 1 -- 172.21.15.96:0/1533251745 >> 172.21.15.96:0/1533251745 conn(0x7f8990071760 msgr2=0x7f89900ccf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:38.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.564+0000 7f8995476640 1 -- 172.21.15.96:0/1533251745 shutdown_connections 2024-04-18T04:54:38.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.564+0000 7f8995476640 1 -- 172.21.15.96:0/1533251745 wait complete. 2024-04-18T04:54:38.579 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-18T04:54:38.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.684+0000 7f4821593640 1 Processor -- start 2024-04-18T04:54:38.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.684+0000 7f4821593640 1 -- start start 2024-04-18T04:54:38.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f4821593640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f481c151210 0x7f481c0c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f4821593640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f481c15a950 0x7f481c15adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f4821593640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f481c15b300 con 0x7f481c0c1db0 2024-04-18T04:54:38.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f4821593640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481c157150 con 0x7f481c151210 2024-04-18T04:54:38.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f4821593640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481c157430 con 0x7f481c15a950 2024-04-18T04:54:38.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f48127fc640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f481c0c1db0 0x7f481c0ca300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55464/0 (socket says 172.21.15.96:55464) 2024-04-18T04:54:38.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f48127fc640 1 -- 172.21.15.96:0/2574187079 learned_addr learned my addr 172.21.15.96:0/2574187079 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:38.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481b7fe640 1 --2- 172.21.15.96:0/2574187079 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f481c15a950 0x7f481c15adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 -- 172.21.15.96:0/2574187079 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683864886 0 0) 0x7f481c15b300 con 0x7f481c0c1db0 2024-04-18T04:54:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481affd640 1 --2- 172.21.15.96:0/2574187079 >> v2:172.21.15.139:3300/0 conn(0x7f481c151210 0x7f481c0c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 -- 172.21.15.96:0/2574187079 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4808003530 con 0x7f481c0c1db0 2024-04-18T04:54:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 -- 172.21.15.96:0/2574187079 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 7567506 0 0) 0x7f4808003530 con 0x7f481c0c1db0 2024-04-18T04:54:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 -- 172.21.15.96:0/2574187079 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f481c15a950 msgr2=0x7f481c15adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 --2- 172.21.15.96:0/2574187079 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f481c15a950 0x7f481c15adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 -- 172.21.15.96:0/2574187079 >> v2:172.21.15.139:3300/0 conn(0x7f481c151210 msgr2=0x7f481c0c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 --2- 172.21.15.96:0/2574187079 >> v2:172.21.15.139:3300/0 conn(0x7f481c151210 0x7f481c0c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 -- 172.21.15.96:0/2574187079 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c157710 con 0x7f481c0c1db0 2024-04-18T04:54:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 -- 172.21.15.96:0/2574187079 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f4804001680 con 0x7f481c0c1db0 2024-04-18T04:54:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 -- 172.21.15.96:0/2574187079 >> v1:172.21.15.96:6789/0 conn(0x7f481c0c1db0 legacy=0x7f481c0ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 --2- 172.21.15.96:0/2574187079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4808003980 0x7f4808003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 --2- 172.21.15.96:0/2574187079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48080047d0 0x7f4808004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 --2- 172.21.15.96:0/2574187079 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f481c15a950 0x7f4808005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 -- 172.21.15.96:0/2574187079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c157150 con 0x7f48080047d0 2024-04-18T04:54:38.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 -- 172.21.15.96:0/2574187079 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c157430 con 0x7f4808003980 2024-04-18T04:54:38.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 -- 172.21.15.96:0/2574187079 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480800b990 con 0x7f481c15a950 2024-04-18T04:54:38.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f48127fc640 1 --2- 172.21.15.96:0/2574187079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48080047d0 0x7f4808004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f48127fc640 1 -- 172.21.15.96:0/2574187079 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f481c15a950 msgr2=0x7f4808005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:38.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f48127fc640 1 --2- 172.21.15.96:0/2574187079 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f481c15a950 0x7f4808005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f48127fc640 1 -- 172.21.15.96:0/2574187079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4808003980 msgr2=0x7f4808003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:38.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f48127fc640 1 --2- 172.21.15.96:0/2574187079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4808003980 0x7f4808003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f48127fc640 1 -- 172.21.15.96:0/2574187079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4808003530 con 0x7f48080047d0 2024-04-18T04:54:38.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f48127fc640 1 --2- 172.21.15.96:0/2574187079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48080047d0 0x7f4808004c50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f480400c290 tx=0x7f480401cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c23b35107400df server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:38.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 -- 172.21.15.96:0/2574187079 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48040058e0 con 0x7f48080047d0 2024-04-18T04:54:38.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 -- 172.21.15.96:0/2574187079 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4804005a40 con 0x7f48080047d0 2024-04-18T04:54:38.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.688+0000 7f481a7fc640 1 -- 172.21.15.96:0/2574187079 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804005df0 con 0x7f48080047d0 2024-04-18T04:54:38.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 -- 172.21.15.96:0/2574187079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48080047d0 msgr2=0x7f4808004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 --2- 172.21.15.96:0/2574187079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48080047d0 0x7f4808004c50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f480400c290 tx=0x7f480401cd00 comp rx=0 tx=0).stop 2024-04-18T04:54:38.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f481b7fe640 1 -- 172.21.15.96:0/2574187079 reap_dead start 2024-04-18T04:54:38.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 -- 172.21.15.96:0/2574187079 shutdown_connections 2024-04-18T04:54:38.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 -- 172.21.15.96:0/2574187079 >> 172.21.15.96:0/2574187079 conn(0x7f481c06c750 msgr2=0x7f481c0c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:38.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 -- 172.21.15.96:0/2574187079 shutdown_connections 2024-04-18T04:54:38.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 -- 172.21.15.96:0/2574187079 wait complete. 2024-04-18T04:54:38.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 Processor -- start 2024-04-18T04:54:38.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 -- start start 2024-04-18T04:54:38.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48080047d0 0x7f481c0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f481c0ca1b0 0x7f481c142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f481c1ece70 0x7f481c0c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c145210 con 0x7f48080047d0 2024-04-18T04:54:38.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c0c1500 con 0x7f481c0ca1b0 2024-04-18T04:54:38.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481c144c50 con 0x7f481c1ece70 2024-04-18T04:54:38.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f481affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48080047d0 0x7f481c0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f481affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48080047d0 0x7f481c0c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43158/0 (socket says 172.21.15.96:43158) 2024-04-18T04:54:38.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f481affd640 1 -- 172.21.15.96:0/1518004246 learned_addr learned my addr 172.21.15.96:0/1518004246 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:38.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f48127fc640 1 --2- 172.21.15.96:0/1518004246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f481c0ca1b0 0x7f481c142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f481affd640 1 -- 172.21.15.96:0/1518004246 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f481c1ece70 msgr2=0x7f481c0c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f481affd640 1 --2- 172.21.15.96:0/1518004246 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f481c1ece70 0x7f481c0c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f481affd640 1 -- 172.21.15.96:0/1518004246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f481c0ca1b0 msgr2=0x7f481c142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f481affd640 1 --2- 172.21.15.96:0/1518004246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f481c0ca1b0 0x7f481c142e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f481affd640 1 -- 172.21.15.96:0/1518004246 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c144f30 con 0x7f48080047d0 2024-04-18T04:54:38.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f481affd640 1 --2- 172.21.15.96:0/1518004246 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48080047d0 0x7f481c0c8e70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f480c00e7c0 tx=0x7f480c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:38.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4813fff640 1 -- 172.21.15.96:0/1518004246 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c00eed0 con 0x7f48080047d0 2024-04-18T04:54:38.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4813fff640 1 -- 172.21.15.96:0/1518004246 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c00c8c0 con 0x7f48080047d0 2024-04-18T04:54:38.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 -- 172.21.15.96:0/1518004246 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481c142330 con 0x7f48080047d0 2024-04-18T04:54:38.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4813fff640 1 -- 172.21.15.96:0/1518004246 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c00cc70 con 0x7f48080047d0 2024-04-18T04:54:38.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 -- 172.21.15.96:0/1518004246 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481c1ed2f0 con 0x7f48080047d0 2024-04-18T04:54:38.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.692+0000 7f4821593640 1 -- 172.21.15.96:0/1518004246 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481c067050 con 0x7f48080047d0 2024-04-18T04:54:38.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.696+0000 7f4813fff640 1 -- 172.21.15.96:0/1518004246 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f480c013470 con 0x7f48080047d0 2024-04-18T04:54:38.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.696+0000 7f4813fff640 1 --2- 172.21.15.96:0/1518004246 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f47fc0666c0 0x7f47fc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:38.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.696+0000 7f4813fff640 1 -- 172.21.15.96:0/1518004246 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f480c084620 con 0x7f48080047d0 2024-04-18T04:54:38.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.696+0000 7f48127fc640 1 --2- 172.21.15.96:0/1518004246 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f47fc0666c0 0x7f47fc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:38.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.696+0000 7f48127fc640 1 --2- 172.21.15.96:0/1518004246 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f47fc0666c0 0x7f47fc068b80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f48040aa000 tx=0x7f4804001a10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:38.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.700+0000 7f4813fff640 1 -- 172.21.15.96:0/1518004246 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f480c051dc0 con 0x7f48080047d0 2024-04-18T04:54:38.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.860+0000 7f4821593640 1 -- 172.21.15.96:0/1518004246 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f481c0c6c50 con 0x7f48080047d0 2024-04-18T04:54:38.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.860+0000 7f4813fff640 1 -- 172.21.15.96:0/1518004246 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f480c021090 con 0x7f48080047d0 2024-04-18T04:54:38.862 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:38.862 INFO:teuthology.orchestra.run.smithi096.stdout:[ 2024-04-18T04:54:38.862 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:54:38.862 INFO:teuthology.orchestra.run.smithi096.stdout: "poolnum": 1, 2024-04-18T04:54:38.863 INFO:teuthology.orchestra.run.smithi096.stdout: "poolname": ".mgr" 2024-04-18T04:54:38.863 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:54:38.863 INFO:teuthology.orchestra.run.smithi096.stdout:] 2024-04-18T04:54:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.864+0000 7f4821593640 1 -- 172.21.15.96:0/1518004246 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f47fc0666c0 msgr2=0x7f47fc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.864+0000 7f4821593640 1 --2- 172.21.15.96:0/1518004246 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f47fc0666c0 0x7f47fc068b80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f48040aa000 tx=0x7f4804001a10 comp rx=0 tx=0).stop 2024-04-18T04:54:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.864+0000 7f4821593640 1 -- 172.21.15.96:0/1518004246 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48080047d0 msgr2=0x7f481c0c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.864+0000 7f4821593640 1 --2- 172.21.15.96:0/1518004246 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48080047d0 0x7f481c0c8e70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f480c00e7c0 tx=0x7f480c00ec80 comp rx=0 tx=0).stop 2024-04-18T04:54:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.864+0000 7f4821593640 1 -- 172.21.15.96:0/1518004246 shutdown_connections 2024-04-18T04:54:38.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.864+0000 7f4821593640 1 --2- 172.21.15.96:0/1518004246 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f47fc0666c0 0x7f47fc068b80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.864+0000 7f4821593640 1 --2- 172.21.15.96:0/1518004246 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f481c1ece70 0x7f481c0c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.864+0000 7f4821593640 1 --2- 172.21.15.96:0/1518004246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f481c0ca1b0 0x7f481c142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.864+0000 7f4821593640 1 --2- 172.21.15.96:0/1518004246 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48080047d0 0x7f481c0c8e70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:38.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.864+0000 7f4821593640 1 -- 172.21.15.96:0/1518004246 >> 172.21.15.96:0/1518004246 conn(0x7f481c06c750 msgr2=0x7f481c155cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:38.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.864+0000 7f4821593640 1 -- 172.21.15.96:0/1518004246 shutdown_connections 2024-04-18T04:54:38.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:38.864+0000 7f4821593640 1 -- 172.21.15.96:0/1518004246 wait complete. 2024-04-18T04:54:38.881 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-18T04:54:38.881 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-18T04:54:39.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d0bba6640 1 Processor -- start 2024-04-18T04:54:39.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d0bba6640 1 -- start start 2024-04-18T04:54:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d0bba6640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2d04150e20 0x7f2d040c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d0bba6640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d040c6c50 con 0x7f2d040c8100 2024-04-18T04:54:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d0bba6640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d040c9610 con 0x7f2d040c9020 2024-04-18T04:54:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d0bba6640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d04151200 con 0x7f2d04150e20 2024-04-18T04:54:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d09141640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f2d040c8100 0x7f2d040c9af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39724/0 (socket says 172.21.15.96:39724) 2024-04-18T04:54:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d09141640 1 -- 172.21.15.96:0/953013739 learned_addr learned my addr 172.21.15.96:0/953013739 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d09942640 1 --2- 172.21.15.96:0/953013739 >> v2:172.21.15.139:3300/0 conn(0x7f2d04150e20 0x7f2d040c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d08940640 1 -- 172.21.15.96:0/953013739 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 934698685 0 0) 0x7f2d040c6c50 con 0x7f2d040c8100 2024-04-18T04:54:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d08940640 1 -- 172.21.15.96:0/953013739 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cf0003530 con 0x7f2d040c8100 2024-04-18T04:54:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d08940640 1 -- 172.21.15.96:0/953013739 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3914093506 0 0) 0x7f2cf0003530 con 0x7f2d040c8100 2024-04-18T04:54:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d08940640 1 -- 172.21.15.96:0/953013739 >> v2:172.21.15.139:3300/0 conn(0x7f2d04150e20 msgr2=0x7f2d040c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d08940640 1 --2- 172.21.15.96:0/953013739 >> v2:172.21.15.139:3300/0 conn(0x7f2d04150e20 0x7f2d040c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d08940640 1 -- 172.21.15.96:0/953013739 >> v1:172.21.15.139:6789/0 conn(0x7f2d040c9020 legacy=0x7f2d040c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d08940640 1 -- 172.21.15.96:0/953013739 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d040c85d0 con 0x7f2d040c8100 2024-04-18T04:54:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d08940640 1 -- 172.21.15.96:0/953013739 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f2cf4001680 con 0x7f2d040c8100 2024-04-18T04:54:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d08940640 1 -- 172.21.15.96:0/953013739 >> v1:172.21.15.96:6789/0 conn(0x7f2d040c8100 legacy=0x7f2d040c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d08940640 1 --2- 172.21.15.96:0/953013739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf0003980 0x7f2cf0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d08940640 1 --2- 172.21.15.96:0/953013739 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2cf00047d0 0x7f2cf0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d08940640 1 --2- 172.21.15.96:0/953013739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cf0005190 0x7f2cf000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d08940640 1 -- 172.21.15.96:0/953013739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d04151200 con 0x7f2cf0003980 2024-04-18T04:54:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d08940640 1 -- 172.21.15.96:0/953013739 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf000c030 con 0x7f2cf0005190 2024-04-18T04:54:39.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d08940640 1 -- 172.21.15.96:0/953013739 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf000c1f0 con 0x7f2cf00047d0 2024-04-18T04:54:39.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.008+0000 7f2d09942640 1 --2- 172.21.15.96:0/953013739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf0003980 0x7f2cf0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:39.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d09942640 1 -- 172.21.15.96:0/953013739 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2cf00047d0 msgr2=0x7f2cf0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:39.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d09942640 1 --2- 172.21.15.96:0/953013739 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2cf00047d0 0x7f2cf0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:39.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d0a143640 1 --2- 172.21.15.96:0/953013739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cf0005190 0x7f2cf000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:39.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d09942640 1 -- 172.21.15.96:0/953013739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cf0005190 msgr2=0x7f2cf000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:39.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d09942640 1 --2- 172.21.15.96:0/953013739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cf0005190 0x7f2cf000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:39.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d09942640 1 -- 172.21.15.96:0/953013739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf0003530 con 0x7f2cf0003980 2024-04-18T04:54:39.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d0a143640 1 --2- 172.21.15.96:0/953013739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cf0005190 0x7f2cf000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:39.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d0a143640 1 -- 172.21.15.96:0/953013739 reap_dead start 2024-04-18T04:54:39.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d09942640 1 --2- 172.21.15.96:0/953013739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf0003980 0x7f2cf0003da0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009ae0 tx=0x7f2d0001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93679d12a1564197 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:39.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d08940640 1 -- 172.21.15.96:0/953013739 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d000a5520 con 0x7f2cf0003980 2024-04-18T04:54:39.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d08940640 1 -- 172.21.15.96:0/953013739 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d000a5680 con 0x7f2cf0003980 2024-04-18T04:54:39.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d08940640 1 -- 172.21.15.96:0/953013739 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d000a5a30 con 0x7f2cf0003980 2024-04-18T04:54:39.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d0bba6640 1 -- 172.21.15.96:0/953013739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf0003980 msgr2=0x7f2cf0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:39.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d0bba6640 1 --2- 172.21.15.96:0/953013739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf0003980 0x7f2cf0003da0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009ae0 tx=0x7f2d0001ca40 comp rx=0 tx=0).stop 2024-04-18T04:54:39.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d0bba6640 1 -- 172.21.15.96:0/953013739 shutdown_connections 2024-04-18T04:54:39.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d0bba6640 1 --2- 172.21.15.96:0/953013739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf0003980 0x7f2cf0003da0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:39.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d0bba6640 1 -- 172.21.15.96:0/953013739 >> 172.21.15.96:0/953013739 conn(0x7f2d0406c610 msgr2=0x7f2d040ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:39.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d0bba6640 1 -- 172.21.15.96:0/953013739 shutdown_connections 2024-04-18T04:54:39.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d0bba6640 1 -- 172.21.15.96:0/953013739 wait complete. 2024-04-18T04:54:39.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.012+0000 7f2d0bba6640 1 Processor -- start 2024-04-18T04:54:39.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0bba6640 1 -- start start 2024-04-18T04:54:39.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0bba6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cf0003980 0x7f2d04149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:39.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0bba6640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d0414ed70 0x7f2d041f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:39.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0bba6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d041f5770 0x7f2d04142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:39.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0bba6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d04148760 con 0x7f2d041f5770 2024-04-18T04:54:39.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0bba6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0414f490 con 0x7f2cf0003980 2024-04-18T04:54:39.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0bba6640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d04149030 con 0x7f2d0414ed70 2024-04-18T04:54:39.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0a143640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d041f5770 0x7f2d04142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:39.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0a143640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d041f5770 0x7f2d04142d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54272/0 (socket says 172.21.15.96:54272) 2024-04-18T04:54:39.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0a143640 1 -- 172.21.15.96:0/3750083374 learned_addr learned my addr 172.21.15.96:0/3750083374 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:39.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d09141640 1 --2- 172.21.15.96:0/3750083374 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d0414ed70 0x7f2d041f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:39.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0a143640 1 -- 172.21.15.96:0/3750083374 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d0414ed70 msgr2=0x7f2d041f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:39.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0a143640 1 --2- 172.21.15.96:0/3750083374 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d0414ed70 0x7f2d041f5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:39.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0a143640 1 -- 172.21.15.96:0/3750083374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cf0003980 msgr2=0x7f2d04149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:39.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0a143640 1 --2- 172.21.15.96:0/3750083374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cf0003980 0x7f2d04149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:39.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0a143640 1 -- 172.21.15.96:0/3750083374 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d04147dd0 con 0x7f2d041f5770 2024-04-18T04:54:39.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0a143640 1 --2- 172.21.15.96:0/3750083374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d041f5770 0x7f2d04142d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00d4c0 tx=0x7f2cfc00d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:39.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2cfa7fc640 1 -- 172.21.15.96:0/3750083374 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc003d90 con 0x7f2d041f5770 2024-04-18T04:54:39.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2cfa7fc640 1 -- 172.21.15.96:0/3750083374 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc005070 con 0x7f2d041f5770 2024-04-18T04:54:39.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0bba6640 1 -- 172.21.15.96:0/3750083374 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d041f5bf0 con 0x7f2d041f5770 2024-04-18T04:54:39.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2cfa7fc640 1 -- 172.21.15.96:0/3750083374 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc005420 con 0x7f2d041f5770 2024-04-18T04:54:39.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0bba6640 1 -- 172.21.15.96:0/3750083374 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0414f960 con 0x7f2d041f5770 2024-04-18T04:54:39.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d0bba6640 1 -- 172.21.15.96:0/3750083374 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d041f4f30 con 0x7f2d041f5770 2024-04-18T04:54:39.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2cfa7fc640 1 -- 172.21.15.96:0/3750083374 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2cfc005580 con 0x7f2d041f5770 2024-04-18T04:54:39.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2cfa7fc640 1 --2- 172.21.15.96:0/3750083374 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2ce8066690 0x7f2ce8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:39.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2cfa7fc640 1 -- 172.21.15.96:0/3750083374 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2cfc0836b0 con 0x7f2d041f5770 2024-04-18T04:54:39.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d09942640 1 --2- 172.21.15.96:0/3750083374 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2ce8066690 0x7f2ce8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:39.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.016+0000 7f2d09942640 1 --2- 172.21.15.96:0/3750083374 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2ce8066690 0x7f2ce8068b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2d000af000 tx=0x7f2d00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:39.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.020+0000 7f2cfa7fc640 1 -- 172.21.15.96:0/3750083374 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2cfc050cd0 con 0x7f2d041f5770 2024-04-18T04:54:39.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.176+0000 7f2d0bba6640 1 -- 172.21.15.96:0/3750083374 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2d0415a0a0 con 0x7f2d041f5770 2024-04-18T04:54:39.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.772+0000 7f2cfa7fc640 1 -- 172.21.15.96:0/3750083374 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2cfc018020 con 0x7f2d041f5770 2024-04-18T04:54:39.775 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' created 2024-04-18T04:54:39.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.780+0000 7f2d0bba6640 1 -- 172.21.15.96:0/3750083374 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2ce8066690 msgr2=0x7f2ce8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:39.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.780+0000 7f2d0bba6640 1 --2- 172.21.15.96:0/3750083374 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2ce8066690 0x7f2ce8068b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2d000af000 tx=0x7f2d00008040 comp rx=0 tx=0).stop 2024-04-18T04:54:39.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.780+0000 7f2d0bba6640 1 -- 172.21.15.96:0/3750083374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d041f5770 msgr2=0x7f2d04142d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:39.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.780+0000 7f2d0bba6640 1 --2- 172.21.15.96:0/3750083374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d041f5770 0x7f2d04142d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00d4c0 tx=0x7f2cfc00d980 comp rx=0 tx=0).stop 2024-04-18T04:54:39.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.788+0000 7f2d0bba6640 1 -- 172.21.15.96:0/3750083374 shutdown_connections 2024-04-18T04:54:39.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.788+0000 7f2d0bba6640 1 --2- 172.21.15.96:0/3750083374 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2ce8066690 0x7f2ce8068b50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:39.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.788+0000 7f2d0bba6640 1 --2- 172.21.15.96:0/3750083374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d041f5770 0x7f2d04142d80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:39.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.788+0000 7f2d0bba6640 1 --2- 172.21.15.96:0/3750083374 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d0414ed70 0x7f2d041f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:39.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.788+0000 7f2d0bba6640 1 --2- 172.21.15.96:0/3750083374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cf0003980 0x7f2d04149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:39.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.788+0000 7f2d0bba6640 1 -- 172.21.15.96:0/3750083374 >> 172.21.15.96:0/3750083374 conn(0x7f2d0406c610 msgr2=0x7f2d0414bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:39.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.788+0000 7f2d0bba6640 1 -- 172.21.15.96:0/3750083374 shutdown_connections 2024-04-18T04:54:39.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.788+0000 7f2d0bba6640 1 -- 172.21.15.96:0/3750083374 wait complete. 2024-04-18T04:54:39.807 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-18T04:54:39.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.936+0000 7fa2aca90640 1 Processor -- start 2024-04-18T04:54:39.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.936+0000 7fa2aca90640 1 -- start start 2024-04-18T04:54:39.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.936+0000 7fa2aca90640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa2a814fc60 0x7fa2a806d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:39.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.936+0000 7fa2aca90640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa2a806dd50 0x7fa2a8155d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:39.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.936+0000 7fa2aca90640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a80c8100 con 0x7fa2a8156240 2024-04-18T04:54:39.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.936+0000 7fa2aca90640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a80c5660 con 0x7fa2a806dd50 2024-04-18T04:54:39.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.936+0000 7fa2aca90640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a8156670 con 0x7fa2a814fc60 2024-04-18T04:54:39.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.936+0000 7fa2a5d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa2a806dd50 0x7fa2a8155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:39.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.936+0000 7fa2a5d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa2a806dd50 0x7fa2a8155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54274/0 (socket says 172.21.15.96:54274) 2024-04-18T04:54:39.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.936+0000 7fa2a5d9b640 1 -- 172.21.15.96:0/2795249747 learned_addr learned my addr 172.21.15.96:0/2795249747 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:39.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.936+0000 7fa2a659c640 1 --2- 172.21.15.96:0/2795249747 >> v2:172.21.15.139:3300/0 conn(0x7fa2a814fc60 0x7fa2a806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:39.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.936+0000 7fa2a5d9b640 1 -- 172.21.15.96:0/2795249747 >> v2:172.21.15.139:3300/0 conn(0x7fa2a814fc60 msgr2=0x7fa2a806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:39.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.936+0000 7fa2a5d9b640 1 --2- 172.21.15.96:0/2795249747 >> v2:172.21.15.139:3300/0 conn(0x7fa2a814fc60 0x7fa2a806d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:39.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.936+0000 7fa2a5d9b640 1 -- 172.21.15.96:0/2795249747 >> v1:172.21.15.139:6789/0 conn(0x7fa2a8156240 legacy=0x7fa2a80c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:39.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.936+0000 7fa2a5d9b640 1 -- 172.21.15.96:0/2795249747 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a80c8350 con 0x7fa2a806dd50 2024-04-18T04:54:39.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.936+0000 7fa2a659c640 1 --2- 172.21.15.96:0/2795249747 >> v2:172.21.15.139:3300/0 conn(0x7fa2a814fc60 0x7fa2a806d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:39.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2a5d9b640 1 --2- 172.21.15.96:0/2795249747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a806dd50 0x7fa2a8155d00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa2a806e9b0 tx=0x7fa29c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2608becd79fd71 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:39.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2a559a640 1 -- 172.21.15.96:0/2795249747 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c0ab620 con 0x7fa2a806dd50 2024-04-18T04:54:39.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2a559a640 1 -- 172.21.15.96:0/2795249747 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c0ab780 con 0x7fa2a806dd50 2024-04-18T04:54:39.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2a559a640 1 -- 172.21.15.96:0/2795249747 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c0abb10 con 0x7fa2a806dd50 2024-04-18T04:54:39.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2aca90640 1 -- 172.21.15.96:0/2795249747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a806dd50 msgr2=0x7fa2a8155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:39.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2aca90640 1 --2- 172.21.15.96:0/2795249747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a806dd50 0x7fa2a8155d00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa2a806e9b0 tx=0x7fa29c01c420 comp rx=0 tx=0).stop 2024-04-18T04:54:39.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2aca90640 1 -- 172.21.15.96:0/2795249747 shutdown_connections 2024-04-18T04:54:39.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2aca90640 1 --2- 172.21.15.96:0/2795249747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a806dd50 0x7fa2a8155d00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:39.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2aca90640 1 --2- 172.21.15.96:0/2795249747 >> v2:172.21.15.139:3300/0 conn(0x7fa2a814fc60 0x7fa2a806d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:39.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2aca90640 1 -- 172.21.15.96:0/2795249747 >> 172.21.15.96:0/2795249747 conn(0x7fa2a806c610 msgr2=0x7fa2a80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:39.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2aca90640 1 -- 172.21.15.96:0/2795249747 shutdown_connections 2024-04-18T04:54:39.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2aca90640 1 -- 172.21.15.96:0/2795249747 wait complete. 2024-04-18T04:54:39.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2aca90640 1 Processor -- start 2024-04-18T04:54:39.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2aca90640 1 -- start start 2024-04-18T04:54:39.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2aca90640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa2a806dd50 0x7fa2a8071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:39.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2aca90640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2a814fc60 0x7fa2a813d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:39.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2aca90640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a8156240 0x7fa2a80c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:39.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2aca90640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a8072140 con 0x7fa2a8156240 2024-04-18T04:54:39.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2aca90640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a81550f0 con 0x7fa2a814fc60 2024-04-18T04:54:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2aca90640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a814a7a0 con 0x7fa2a806dd50 2024-04-18T04:54:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2a6d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a8156240 0x7fa2a80c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2a6d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a8156240 0x7fa2a80c9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54282/0 (socket says 172.21.15.96:54282) 2024-04-18T04:54:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2a6d9d640 1 -- 172.21.15.96:0/828631419 learned_addr learned my addr 172.21.15.96:0/828631419 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2a659c640 1 --2- 172.21.15.96:0/828631419 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa2a806dd50 0x7fa2a8071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.940+0000 7fa2a5d9b640 1 --2- 172.21.15.96:0/828631419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2a814fc60 0x7fa2a813d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa2a6d9d640 1 -- 172.21.15.96:0/828631419 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa2a806dd50 msgr2=0x7fa2a8071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa2a6d9d640 1 --2- 172.21.15.96:0/828631419 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa2a806dd50 0x7fa2a8071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa2a6d9d640 1 -- 172.21.15.96:0/828631419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2a814fc60 msgr2=0x7fa2a813d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa2a6d9d640 1 --2- 172.21.15.96:0/828631419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2a814fc60 0x7fa2a813d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa2a6d9d640 1 -- 172.21.15.96:0/828631419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c0094d0 con 0x7fa2a8156240 2024-04-18T04:54:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa2a6d9d640 1 --2- 172.21.15.96:0/828631419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a8156240 0x7fa2a80c9210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000b9c0 tx=0x7fa2a000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:39.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa296ffd640 1 -- 172.21.15.96:0/828631419 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a000cba0 con 0x7fa2a8156240 2024-04-18T04:54:39.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa296ffd640 1 -- 172.21.15.96:0/828631419 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a000cd00 con 0x7fa2a8156240 2024-04-18T04:54:39.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa2aca90640 1 -- 172.21.15.96:0/828631419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a80c42f0 con 0x7fa2a8156240 2024-04-18T04:54:39.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa296ffd640 1 -- 172.21.15.96:0/828631419 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0014680 con 0x7fa2a8156240 2024-04-18T04:54:39.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa2aca90640 1 -- 172.21.15.96:0/828631419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a813e020 con 0x7fa2a8156240 2024-04-18T04:54:39.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa2aca90640 1 -- 172.21.15.96:0/828631419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a814a910 con 0x7fa2a8156240 2024-04-18T04:54:39.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa296ffd640 1 -- 172.21.15.96:0/828631419 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa2a0007370 con 0x7fa2a8156240 2024-04-18T04:54:39.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa296ffd640 1 --2- 172.21.15.96:0/828631419 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa2880666c0 0x7fa288068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:39.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa296ffd640 1 -- 172.21.15.96:0/828631419 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa2a0083b20 con 0x7fa2a8156240 2024-04-18T04:54:39.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa2a659c640 1 --2- 172.21.15.96:0/828631419 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa2880666c0 0x7fa288068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:39.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.944+0000 7fa2a659c640 1 --2- 172.21.15.96:0/828631419 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa2880666c0 0x7fa288068b80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa29800a9a0 tx=0x7fa298008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:39.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:39.948+0000 7fa296ffd640 1 -- 172.21.15.96:0/828631419 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa2a0050fe0 con 0x7fa2a8156240 2024-04-18T04:54:40.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.096+0000 7fa2aca90640 1 -- 172.21.15.96:0/828631419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa2a8067050 con 0x7fa2a8156240 2024-04-18T04:54:40.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.776+0000 7fa296ffd640 1 -- 172.21.15.96:0/828631419 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa2a00190d0 con 0x7fa2a8156240 2024-04-18T04:54:40.776 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' created 2024-04-18T04:54:40.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.784+0000 7fa2aca90640 1 -- 172.21.15.96:0/828631419 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa2880666c0 msgr2=0x7fa288068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:40.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.784+0000 7fa2aca90640 1 --2- 172.21.15.96:0/828631419 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa2880666c0 0x7fa288068b80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa29800a9a0 tx=0x7fa298008040 comp rx=0 tx=0).stop 2024-04-18T04:54:40.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.784+0000 7fa2aca90640 1 -- 172.21.15.96:0/828631419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a8156240 msgr2=0x7fa2a80c9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:40.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.784+0000 7fa2aca90640 1 --2- 172.21.15.96:0/828631419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a8156240 0x7fa2a80c9210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000b9c0 tx=0x7fa2a000be80 comp rx=0 tx=0).stop 2024-04-18T04:54:40.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.792+0000 7fa2aca90640 1 -- 172.21.15.96:0/828631419 shutdown_connections 2024-04-18T04:54:40.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.792+0000 7fa2aca90640 1 --2- 172.21.15.96:0/828631419 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa2880666c0 0x7fa288068b80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:40.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.792+0000 7fa2aca90640 1 --2- 172.21.15.96:0/828631419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a8156240 0x7fa2a80c9210 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:40.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.792+0000 7fa2aca90640 1 --2- 172.21.15.96:0/828631419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2a814fc60 0x7fa2a813d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:40.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.792+0000 7fa2aca90640 1 --2- 172.21.15.96:0/828631419 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa2a806dd50 0x7fa2a8071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:40.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.792+0000 7fa2aca90640 1 -- 172.21.15.96:0/828631419 >> 172.21.15.96:0/828631419 conn(0x7fa2a806c610 msgr2=0x7fa2a8143cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:40.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.796+0000 7fa2aca90640 1 -- 172.21.15.96:0/828631419 shutdown_connections 2024-04-18T04:54:40.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.796+0000 7fa2aca90640 1 -- 172.21.15.96:0/828631419 wait complete. 2024-04-18T04:54:40.824 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-18T04:54:40.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.944+0000 7fc609b89640 1 Processor -- start 2024-04-18T04:54:40.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.944+0000 7fc609b89640 1 -- start start 2024-04-18T04:54:40.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc609b89640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc60406eb10 0x7fc60415ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:40.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc609b89640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60406f200 con 0x7fc6040c3610 2024-04-18T04:54:40.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc609b89640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc604151450 con 0x7fc604151070 2024-04-18T04:54:40.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc609b89640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6040c7680 con 0x7fc60406eb10 2024-04-18T04:54:40.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc602ffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc6040c3610 0x7fc60415f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39738/0 (socket says 172.21.15.96:39738) 2024-04-18T04:54:40.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc602ffd640 1 -- 172.21.15.96:0/3205966663 learned_addr learned my addr 172.21.15.96:0/3205966663 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:40.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc603fff640 1 --2- 172.21.15.96:0/3205966663 >> v2:172.21.15.139:3300/0 conn(0x7fc60406eb10 0x7fc60415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:40.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc6027fc640 1 -- 172.21.15.96:0/3205966663 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571701838 0 0) 0x7fc60406f200 con 0x7fc6040c3610 2024-04-18T04:54:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc6027fc640 1 -- 172.21.15.96:0/3205966663 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5f0003530 con 0x7fc6040c3610 2024-04-18T04:54:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc6027fc640 1 -- 172.21.15.96:0/3205966663 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3554863287 0 0) 0x7fc5f0003530 con 0x7fc6040c3610 2024-04-18T04:54:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc6027fc640 1 -- 172.21.15.96:0/3205966663 >> v2:172.21.15.139:3300/0 conn(0x7fc60406eb10 msgr2=0x7fc60415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc6027fc640 1 --2- 172.21.15.96:0/3205966663 >> v2:172.21.15.139:3300/0 conn(0x7fc60406eb10 0x7fc60415ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc6027fc640 1 -- 172.21.15.96:0/3205966663 >> v1:172.21.15.139:6789/0 conn(0x7fc604151070 legacy=0x7fc6040cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc6027fc640 1 -- 172.21.15.96:0/3205966663 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6040c70c0 con 0x7fc6040c3610 2024-04-18T04:54:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc6027fc640 1 -- 172.21.15.96:0/3205966663 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fc5ec001680 con 0x7fc6040c3610 2024-04-18T04:54:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc6027fc640 1 -- 172.21.15.96:0/3205966663 >> v1:172.21.15.96:6789/0 conn(0x7fc6040c3610 legacy=0x7fc60415f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc6027fc640 1 --2- 172.21.15.96:0/3205966663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5f0003980 0x7fc5f0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc6027fc640 1 --2- 172.21.15.96:0/3205966663 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc5f00047d0 0x7fc5f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc6027fc640 1 --2- 172.21.15.96:0/3205966663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5f0005190 0x7fc5f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc6027fc640 1 -- 172.21.15.96:0/3205966663 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040c7680 con 0x7fc5f0005190 2024-04-18T04:54:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc6027fc640 1 -- 172.21.15.96:0/3205966663 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f000c040 con 0x7fc5f0003980 2024-04-18T04:54:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc6027fc640 1 -- 172.21.15.96:0/3205966663 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f000c200 con 0x7fc5f00047d0 2024-04-18T04:54:40.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc603fff640 1 --2- 172.21.15.96:0/3205966663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5f0005190 0x7fc5f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:40.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc6037fe640 1 --2- 172.21.15.96:0/3205966663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5f0003980 0x7fc5f0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:40.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc602ffd640 1 --2- 172.21.15.96:0/3205966663 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc5f00047d0 0x7fc5f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:40.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc603fff640 1 -- 172.21.15.96:0/3205966663 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc5f00047d0 msgr2=0x7fc5f0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:40.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc603fff640 1 --2- 172.21.15.96:0/3205966663 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc5f00047d0 0x7fc5f0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:40.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc603fff640 1 -- 172.21.15.96:0/3205966663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5f0003980 msgr2=0x7fc5f0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:40.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc603fff640 1 --2- 172.21.15.96:0/3205966663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5f0003980 0x7fc5f0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:40.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc603fff640 1 -- 172.21.15.96:0/3205966663 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f0003530 con 0x7fc5f0005190 2024-04-18T04:54:40.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.948+0000 7fc602ffd640 1 --2- 172.21.15.96:0/3205966663 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc5f00047d0 0x7fc5f0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc603fff640 1 -- 172.21.15.96:0/3205966663 reap_dead start 2024-04-18T04:54:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc603fff640 1 --2- 172.21.15.96:0/3205966663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5f0005190 0x7fc5f000b990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009fc0 tx=0x7fc5fc01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b54077bc646ec5 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc6027fc640 1 -- 172.21.15.96:0/3205966663 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0a5cd0 con 0x7fc5f0005190 2024-04-18T04:54:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc6027fc640 1 -- 172.21.15.96:0/3205966663 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc00f040 con 0x7fc5f0005190 2024-04-18T04:54:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc6027fc640 1 -- 172.21.15.96:0/3205966663 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc003be0 con 0x7fc5f0005190 2024-04-18T04:54:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 -- 172.21.15.96:0/3205966663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5f0005190 msgr2=0x7fc5f000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 --2- 172.21.15.96:0/3205966663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5f0005190 0x7fc5f000b990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009fc0 tx=0x7fc5fc01ccc0 comp rx=0 tx=0).stop 2024-04-18T04:54:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 -- 172.21.15.96:0/3205966663 shutdown_connections 2024-04-18T04:54:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 --2- 172.21.15.96:0/3205966663 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5f0005190 0x7fc5f000b990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 -- 172.21.15.96:0/3205966663 >> 172.21.15.96:0/3205966663 conn(0x7fc60406a5c0 msgr2=0x7fc604065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 -- 172.21.15.96:0/3205966663 shutdown_connections 2024-04-18T04:54:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 -- 172.21.15.96:0/3205966663 wait complete. 2024-04-18T04:54:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 Processor -- start 2024-04-18T04:54:40.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 -- start start 2024-04-18T04:54:40.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5f0005190 0x7fc60414f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:40.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc6041ecdc0 0x7fc60414fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:40.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6040caec0 0x7fc6040cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040cbfb0 con 0x7fc6040caec0 2024-04-18T04:54:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60414f4a0 con 0x7fc5f0005190 2024-04-18T04:54:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60414e890 con 0x7fc6041ecdc0 2024-04-18T04:54:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc603fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6040caec0 0x7fc6040cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc603fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6040caec0 0x7fc6040cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54300/0 (socket says 172.21.15.96:54300) 2024-04-18T04:54:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc603fff640 1 -- 172.21.15.96:0/2262187753 learned_addr learned my addr 172.21.15.96:0/2262187753 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc602ffd640 1 --2- 172.21.15.96:0/2262187753 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc6041ecdc0 0x7fc60414fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc6037fe640 1 --2- 172.21.15.96:0/2262187753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5f0005190 0x7fc60414f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc603fff640 1 -- 172.21.15.96:0/2262187753 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc6041ecdc0 msgr2=0x7fc60414fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc603fff640 1 --2- 172.21.15.96:0/2262187753 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc6041ecdc0 0x7fc60414fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc603fff640 1 -- 172.21.15.96:0/2262187753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5f0005190 msgr2=0x7fc60414f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc603fff640 1 --2- 172.21.15.96:0/2262187753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5f0005190 0x7fc60414f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc603fff640 1 -- 172.21.15.96:0/2262187753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60414eb70 con 0x7fc6040caec0 2024-04-18T04:54:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc6037fe640 1 --2- 172.21.15.96:0/2262187753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5f0005190 0x7fc60414f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:40.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc603fff640 1 --2- 172.21.15.96:0/2262187753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6040caec0 0x7fc6040cb340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0987f0 tx=0x7fc5fc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:40.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc5fbfff640 1 -- 172.21.15.96:0/2262187753 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0aed40 con 0x7fc6040caec0 2024-04-18T04:54:40.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc5fbfff640 1 -- 172.21.15.96:0/2262187753 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc0aeec0 con 0x7fc6040caec0 2024-04-18T04:54:40.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 -- 172.21.15.96:0/2262187753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60414ee50 con 0x7fc6040caec0 2024-04-18T04:54:40.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc5fbfff640 1 -- 172.21.15.96:0/2262187753 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc003be0 con 0x7fc6040caec0 2024-04-18T04:54:40.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.952+0000 7fc609b89640 1 -- 172.21.15.96:0/2262187753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6040cb880 con 0x7fc6040caec0 2024-04-18T04:54:40.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.956+0000 7fc609b89640 1 -- 172.21.15.96:0/2262187753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60414f650 con 0x7fc6040caec0 2024-04-18T04:54:40.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.956+0000 7fc5fbfff640 1 -- 172.21.15.96:0/2262187753 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc5fc003d40 con 0x7fc6040caec0 2024-04-18T04:54:40.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.956+0000 7fc5fbfff640 1 --2- 172.21.15.96:0/2262187753 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5e4066690 0x7fc5e4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:40.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.956+0000 7fc5fbfff640 1 -- 172.21.15.96:0/2262187753 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fc5fc11f350 con 0x7fc6040caec0 2024-04-18T04:54:40.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.956+0000 7fc6037fe640 1 --2- 172.21.15.96:0/2262187753 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5e4066690 0x7fc5e4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:40.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.956+0000 7fc6037fe640 1 --2- 172.21.15.96:0/2262187753 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5e4066690 0x7fc5e4068b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4007fd0 tx=0x7fc5f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:40.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:40.960+0000 7fc5fbfff640 1 -- 172.21.15.96:0/2262187753 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc60414f650 con 0x7fc6040caec0 2024-04-18T04:54:41.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.152+0000 7fc609b89640 1 -- 172.21.15.96:0/2262187753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc60414f610 con 0x7fc6040caec0 2024-04-18T04:54:41.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.164+0000 7fc5fbfff640 1 -- 172.21.15.96:0/2262187753 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc5fc0be0c0 con 0x7fc6040caec0 2024-04-18T04:54:41.163 INFO:teuthology.orchestra.run.smithi096.stderr:new fs with metadata pool 2 and data pool 3 2024-04-18T04:54:41.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.168+0000 7fc609b89640 1 -- 172.21.15.96:0/2262187753 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5e4066690 msgr2=0x7fc5e4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.168+0000 7fc609b89640 1 --2- 172.21.15.96:0/2262187753 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5e4066690 0x7fc5e4068b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4007fd0 tx=0x7fc5f4009040 comp rx=0 tx=0).stop 2024-04-18T04:54:41.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.168+0000 7fc609b89640 1 -- 172.21.15.96:0/2262187753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6040caec0 msgr2=0x7fc6040cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.168+0000 7fc609b89640 1 --2- 172.21.15.96:0/2262187753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6040caec0 0x7fc6040cb340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0987f0 tx=0x7fc5fc009750 comp rx=0 tx=0).stop 2024-04-18T04:54:41.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.172+0000 7fc609b89640 1 -- 172.21.15.96:0/2262187753 shutdown_connections 2024-04-18T04:54:41.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.172+0000 7fc609b89640 1 --2- 172.21.15.96:0/2262187753 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5e4066690 0x7fc5e4068b50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.172+0000 7fc609b89640 1 --2- 172.21.15.96:0/2262187753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6040caec0 0x7fc6040cb340 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.172+0000 7fc609b89640 1 --2- 172.21.15.96:0/2262187753 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc6041ecdc0 0x7fc60414fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.172+0000 7fc609b89640 1 --2- 172.21.15.96:0/2262187753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5f0005190 0x7fc60414f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.172+0000 7fc609b89640 1 -- 172.21.15.96:0/2262187753 >> 172.21.15.96:0/2262187753 conn(0x7fc60406a5c0 msgr2=0x7fc6040af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:41.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.176+0000 7fc609b89640 1 -- 172.21.15.96:0/2262187753 shutdown_connections 2024-04-18T04:54:41.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.176+0000 7fc609b89640 1 -- 172.21.15.96:0/2262187753 wait complete. 2024-04-18T04:54:41.211 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:54:41.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.324+0000 7f56d26db640 1 Processor -- start 2024-04-18T04:54:41.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.324+0000 7f56d26db640 1 -- start start 2024-04-18T04:54:41.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56d26db640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f56cc151210 0x7f56cc0c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56d26db640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56cc15a950 0x7f56cc15adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56d26db640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc15b300 con 0x7f56cc0c1db0 2024-04-18T04:54:41.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56d26db640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56cc157150 con 0x7f56cc151210 2024-04-18T04:54:41.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56d26db640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc157430 con 0x7f56cc15a950 2024-04-18T04:54:41.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56cb7fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f56cc0c1db0 0x7f56cc0ca300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39746/0 (socket says 172.21.15.96:39746) 2024-04-18T04:54:41.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56cb7fe640 1 -- 172.21.15.96:0/2276572391 learned_addr learned my addr 172.21.15.96:0/2276572391 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:41.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56cbfff640 1 --2- 172.21.15.96:0/2276572391 >> v2:172.21.15.139:3300/0 conn(0x7f56cc151210 0x7f56cc0c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56d0c78640 1 --2- 172.21.15.96:0/2276572391 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56cc15a950 0x7f56cc15adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56caffd640 1 -- 172.21.15.96:0/2276572391 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420799165 0 0) 0x7f56cc15b300 con 0x7f56cc0c1db0 2024-04-18T04:54:41.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56caffd640 1 -- 172.21.15.96:0/2276572391 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56b4003530 con 0x7f56cc0c1db0 2024-04-18T04:54:41.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56caffd640 1 -- 172.21.15.96:0/2276572391 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 819668027 0 0) 0x7f56b4003530 con 0x7f56cc0c1db0 2024-04-18T04:54:41.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56caffd640 1 -- 172.21.15.96:0/2276572391 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56cc15a950 msgr2=0x7f56cc15adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:41.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56caffd640 1 --2- 172.21.15.96:0/2276572391 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56cc15a950 0x7f56cc15adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56caffd640 1 -- 172.21.15.96:0/2276572391 >> v2:172.21.15.139:3300/0 conn(0x7f56cc151210 msgr2=0x7f56cc0c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:41.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56caffd640 1 --2- 172.21.15.96:0/2276572391 >> v2:172.21.15.139:3300/0 conn(0x7f56cc151210 0x7f56cc0c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56caffd640 1 -- 172.21.15.96:0/2276572391 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc157710 con 0x7f56cc0c1db0 2024-04-18T04:54:41.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56caffd640 1 -- 172.21.15.96:0/2276572391 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f56c0001680 con 0x7f56cc0c1db0 2024-04-18T04:54:41.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56caffd640 1 -- 172.21.15.96:0/2276572391 >> v1:172.21.15.96:6789/0 conn(0x7f56cc0c1db0 legacy=0x7f56cc0ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56caffd640 1 --2- 172.21.15.96:0/2276572391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56b4003980 0x7f56b4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56caffd640 1 --2- 172.21.15.96:0/2276572391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56b40047d0 0x7f56b4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56caffd640 1 --2- 172.21.15.96:0/2276572391 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56cc15a950 0x7f56b4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56caffd640 1 -- 172.21.15.96:0/2276572391 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc157150 con 0x7f56b40047d0 2024-04-18T04:54:41.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56caffd640 1 -- 172.21.15.96:0/2276572391 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc157430 con 0x7f56b4003980 2024-04-18T04:54:41.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56caffd640 1 -- 172.21.15.96:0/2276572391 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b400b990 con 0x7f56cc15a950 2024-04-18T04:54:41.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56cb7fe640 1 --2- 172.21.15.96:0/2276572391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56b40047d0 0x7f56b4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56cbfff640 1 --2- 172.21.15.96:0/2276572391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56b4003980 0x7f56b4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56cb7fe640 1 -- 172.21.15.96:0/2276572391 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56cc15a950 msgr2=0x7f56b4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:41.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56cb7fe640 1 --2- 172.21.15.96:0/2276572391 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56cc15a950 0x7f56b4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56cb7fe640 1 -- 172.21.15.96:0/2276572391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56b4003980 msgr2=0x7f56b4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:41.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56cb7fe640 1 --2- 172.21.15.96:0/2276572391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56b4003980 0x7f56b4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.328+0000 7f56cb7fe640 1 -- 172.21.15.96:0/2276572391 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b4003530 con 0x7f56b40047d0 2024-04-18T04:54:41.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56cb7fe640 1 --2- 172.21.15.96:0/2276572391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56b40047d0 0x7f56b4004c50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f56c000c290 tx=0x7f56c001cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5dc706a3f73f8c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:41.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56caffd640 1 -- 172.21.15.96:0/2276572391 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c00058e0 con 0x7f56b40047d0 2024-04-18T04:54:41.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56caffd640 1 -- 172.21.15.96:0/2276572391 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c0005a40 con 0x7f56b40047d0 2024-04-18T04:54:41.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56caffd640 1 -- 172.21.15.96:0/2276572391 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0005df0 con 0x7f56b40047d0 2024-04-18T04:54:41.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d26db640 1 -- 172.21.15.96:0/2276572391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56b40047d0 msgr2=0x7f56b4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d26db640 1 --2- 172.21.15.96:0/2276572391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56b40047d0 0x7f56b4004c50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f56c000c290 tx=0x7f56c001cd00 comp rx=0 tx=0).stop 2024-04-18T04:54:41.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d0c78640 1 -- 172.21.15.96:0/2276572391 reap_dead start 2024-04-18T04:54:41.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d26db640 1 -- 172.21.15.96:0/2276572391 shutdown_connections 2024-04-18T04:54:41.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d26db640 1 -- 172.21.15.96:0/2276572391 >> 172.21.15.96:0/2276572391 conn(0x7f56cc06c750 msgr2=0x7f56cc0c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:41.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d26db640 1 -- 172.21.15.96:0/2276572391 shutdown_connections 2024-04-18T04:54:41.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d26db640 1 -- 172.21.15.96:0/2276572391 wait complete. 2024-04-18T04:54:41.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d26db640 1 Processor -- start 2024-04-18T04:54:41.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d26db640 1 -- start start 2024-04-18T04:54:41.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d26db640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56b40047d0 0x7f56cc071900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d26db640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56cc159550 0x7f56cc0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d26db640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56cc070e30 0x7f56cc1f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d26db640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc14f450 con 0x7f56cc070e30 2024-04-18T04:54:41.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d26db640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc14e960 con 0x7f56b40047d0 2024-04-18T04:54:41.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d26db640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc070460 con 0x7f56cc159550 2024-04-18T04:54:41.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d0c78640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56cc070e30 0x7f56cc1f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d0c78640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56cc070e30 0x7f56cc1f1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54324/0 (socket says 172.21.15.96:54324) 2024-04-18T04:54:41.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d0c78640 1 -- 172.21.15.96:0/909239535 learned_addr learned my addr 172.21.15.96:0/909239535 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:41.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56cb7fe640 1 --2- 172.21.15.96:0/909239535 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56cc159550 0x7f56cc0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56cbfff640 1 --2- 172.21.15.96:0/909239535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56b40047d0 0x7f56cc071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d0c78640 1 -- 172.21.15.96:0/909239535 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56cc159550 msgr2=0x7f56cc0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d0c78640 1 --2- 172.21.15.96:0/909239535 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56cc159550 0x7f56cc0708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d0c78640 1 -- 172.21.15.96:0/909239535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56b40047d0 msgr2=0x7f56cc071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d0c78640 1 --2- 172.21.15.96:0/909239535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56b40047d0 0x7f56cc071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d0c78640 1 -- 172.21.15.96:0/909239535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc14ebb0 con 0x7f56cc070e30 2024-04-18T04:54:41.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56cbfff640 1 --2- 172.21.15.96:0/909239535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56b40047d0 0x7f56cc071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:41.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d0c78640 1 --2- 172.21.15.96:0/909239535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56cc070e30 0x7f56cc1f1d10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f56cc0c7a20 tx=0x7f56c400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:41.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56c8ff9640 1 -- 172.21.15.96:0/909239535 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4010040 con 0x7f56cc070e30 2024-04-18T04:54:41.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56c8ff9640 1 -- 172.21.15.96:0/909239535 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c400bcb0 con 0x7f56cc070e30 2024-04-18T04:54:41.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d26db640 1 -- 172.21.15.96:0/909239535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc14ee90 con 0x7f56cc070e30 2024-04-18T04:54:41.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56c8ff9640 1 -- 172.21.15.96:0/909239535 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4014640 con 0x7f56cc070e30 2024-04-18T04:54:41.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.332+0000 7f56d26db640 1 -- 172.21.15.96:0/909239535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc1504c0 con 0x7f56cc070e30 2024-04-18T04:54:41.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.336+0000 7f56d26db640 1 -- 172.21.15.96:0/909239535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc070610 con 0x7f56cc070e30 2024-04-18T04:54:41.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.336+0000 7f56c8ff9640 1 -- 172.21.15.96:0/909239535 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f56c40147a0 con 0x7f56cc070e30 2024-04-18T04:54:41.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.336+0000 7f56c8ff9640 1 --2- 172.21.15.96:0/909239535 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f56b8066690 0x7f56b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.336+0000 7f56c8ff9640 1 -- 172.21.15.96:0/909239535 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56c4084810 con 0x7f56cc070e30 2024-04-18T04:54:41.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.336+0000 7f56cbfff640 1 --2- 172.21.15.96:0/909239535 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f56b8066690 0x7f56b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.336+0000 7f56cbfff640 1 --2- 172.21.15.96:0/909239535 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f56b8066690 0x7f56b8068b50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f56bc0099a0 tx=0x7f56bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:41.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.340+0000 7f56c8ff9640 1 -- 172.21.15.96:0/909239535 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f56cc070610 con 0x7f56cc070e30 2024-04-18T04:54:41.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.500+0000 7f56d26db640 1 -- 172.21.15.96:0/909239535 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56cc070610 con 0x7f56cc070e30 2024-04-18T04:54:41.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.500+0000 7f56c8ff9640 1 -- 172.21.15.96:0/909239535 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f56cc070610 con 0x7f56cc070e30 2024-04-18T04:54:41.501 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:41.501 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:54:41.158173+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:54:39.219441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:54:40.139557+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.720340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.767224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.811511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.710188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.860525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.704784+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:54:41.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.504+0000 7f56d26db640 1 -- 172.21.15.96:0/909239535 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f56b8066690 msgr2=0x7f56b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.504+0000 7f56d26db640 1 --2- 172.21.15.96:0/909239535 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f56b8066690 0x7f56b8068b50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f56bc0099a0 tx=0x7f56bc008040 comp rx=0 tx=0).stop 2024-04-18T04:54:41.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.504+0000 7f56d26db640 1 -- 172.21.15.96:0/909239535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56cc070e30 msgr2=0x7f56cc1f1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.504+0000 7f56d26db640 1 --2- 172.21.15.96:0/909239535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56cc070e30 0x7f56cc1f1d10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f56cc0c7a20 tx=0x7f56c400b480 comp rx=0 tx=0).stop 2024-04-18T04:54:41.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.504+0000 7f56d26db640 1 -- 172.21.15.96:0/909239535 shutdown_connections 2024-04-18T04:54:41.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.504+0000 7f56d26db640 1 --2- 172.21.15.96:0/909239535 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f56b8066690 0x7f56b8068b50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.504+0000 7f56d26db640 1 --2- 172.21.15.96:0/909239535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56cc070e30 0x7f56cc1f1d10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.504+0000 7f56d26db640 1 --2- 172.21.15.96:0/909239535 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56cc159550 0x7f56cc0708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.504+0000 7f56d26db640 1 --2- 172.21.15.96:0/909239535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56b40047d0 0x7f56cc071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.504+0000 7f56d26db640 1 -- 172.21.15.96:0/909239535 >> 172.21.15.96:0/909239535 conn(0x7f56cc06c750 msgr2=0x7f56cc154970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:41.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.504+0000 7f56d26db640 1 -- 172.21.15.96:0/909239535 shutdown_connections 2024-04-18T04:54:41.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.504+0000 7f56d26db640 1 -- 172.21.15.96:0/909239535 wait complete. 2024-04-18T04:54:41.520 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:54:41.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.640+0000 7f761aa55640 1 Processor -- start 2024-04-18T04:54:41.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.640+0000 7f761aa55640 1 -- start start 2024-04-18T04:54:41.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.644+0000 7f761aa55640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f76140ca300 0x7f76140ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.644+0000 7f761aa55640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f761415a950 0x7f761415adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.644+0000 7f761aa55640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761415b300 con 0x7f7614151210 2024-04-18T04:54:41.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.644+0000 7f761aa55640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7614157150 con 0x7f76140ca300 2024-04-18T04:54:41.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.644+0000 7f761aa55640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7614157430 con 0x7f761415a950 2024-04-18T04:54:41.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.644+0000 7f76137fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f76140ca300 0x7f76140ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.644+0000 7f7618ff2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f761415a950 0x7f761415adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.644+0000 7f76137fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f76140ca300 0x7f76140ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:52146/0 (socket says 172.21.15.96:52146) 2024-04-18T04:54:41.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.644+0000 7f76137fe640 1 -- 172.21.15.96:0/404940279 learned_addr learned my addr 172.21.15.96:0/404940279 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:41.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.644+0000 7f7613fff640 1 --1- 172.21.15.96:0/404940279 >> v1:172.21.15.139:6789/0 conn(0x7f7614151210 0x7f76140c1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.96:33824/0 (socket says 172.21.15.96:33824) 2024-04-18T04:54:41.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.644+0000 7f76137fe640 1 -- 172.21.15.96:0/404940279 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f761415a950 msgr2=0x7f761415adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:41.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.644+0000 7f76137fe640 1 --2- 172.21.15.96:0/404940279 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f761415a950 0x7f761415adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.644+0000 7f76137fe640 1 -- 172.21.15.96:0/404940279 >> v1:172.21.15.139:6789/0 conn(0x7f7614151210 legacy=0x7f76140c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.644+0000 7f76137fe640 1 -- 172.21.15.96:0/404940279 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7614157710 con 0x7f76140ca300 2024-04-18T04:54:41.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.644+0000 7f76137fe640 1 --2- 172.21.15.96:0/404940279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76140ca300 0x7f76140ca720 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7608009870 tx=0x7f760801ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44c9731a78232251 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:41.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f7612ffd640 1 -- 172.21.15.96:0/404940279 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76080a8a50 con 0x7f76140ca300 2024-04-18T04:54:41.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f7612ffd640 1 -- 172.21.15.96:0/404940279 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76080a8bb0 con 0x7f76140ca300 2024-04-18T04:54:41.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f7612ffd640 1 -- 172.21.15.96:0/404940279 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76080b0440 con 0x7f76140ca300 2024-04-18T04:54:41.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f761aa55640 1 -- 172.21.15.96:0/404940279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76140ca300 msgr2=0x7f76140ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f761aa55640 1 --2- 172.21.15.96:0/404940279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76140ca300 0x7f76140ca720 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7608009870 tx=0x7f760801ed50 comp rx=0 tx=0).stop 2024-04-18T04:54:41.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f761aa55640 1 -- 172.21.15.96:0/404940279 shutdown_connections 2024-04-18T04:54:41.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f761aa55640 1 --2- 172.21.15.96:0/404940279 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f761415a950 0x7f761415adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f761aa55640 1 --2- 172.21.15.96:0/404940279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76140ca300 0x7f76140ca720 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f761aa55640 1 -- 172.21.15.96:0/404940279 >> 172.21.15.96:0/404940279 conn(0x7f761406c750 msgr2=0x7f76140c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:41.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f761aa55640 1 -- 172.21.15.96:0/404940279 shutdown_connections 2024-04-18T04:54:41.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f761aa55640 1 -- 172.21.15.96:0/404940279 wait complete. 2024-04-18T04:54:41.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f761aa55640 1 Processor -- start 2024-04-18T04:54:41.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f761aa55640 1 -- start start 2024-04-18T04:54:41.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f761aa55640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76140ca300 0x7f76141e01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f761aa55640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7614151210 0x7f76141e3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f761aa55640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f761415a950 0x7f7614143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f761aa55640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76141efb60 con 0x7f76140ca300 2024-04-18T04:54:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f761aa55640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76141e2b60 con 0x7f761415a950 2024-04-18T04:54:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f761aa55640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761414c450 con 0x7f7614151210 2024-04-18T04:54:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f7613fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76140ca300 0x7f76141e01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f7613fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76140ca300 0x7f76141e01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54330/0 (socket says 172.21.15.96:54330) 2024-04-18T04:54:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f7613fff640 1 -- 172.21.15.96:0/2588823829 learned_addr learned my addr 172.21.15.96:0/2588823829 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.648+0000 7f7618ff2640 1 --2- 172.21.15.96:0/2588823829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f761415a950 0x7f7614143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f76137fe640 1 --2- 172.21.15.96:0/2588823829 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7614151210 0x7f76141e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f7613fff640 1 -- 172.21.15.96:0/2588823829 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7614151210 msgr2=0x7f76141e3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f7613fff640 1 --2- 172.21.15.96:0/2588823829 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7614151210 0x7f76141e3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f7613fff640 1 -- 172.21.15.96:0/2588823829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f761415a950 msgr2=0x7f7614143a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f7613fff640 1 --2- 172.21.15.96:0/2588823829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f761415a950 0x7f7614143a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f7613fff640 1 -- 172.21.15.96:0/2588823829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76080094d0 con 0x7f76140ca300 2024-04-18T04:54:41.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f7613fff640 1 --2- 172.21.15.96:0/2588823829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76140ca300 0x7f76141e01f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f760400c370 tx=0x7f760400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:41.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f7610ff9640 1 -- 172.21.15.96:0/2588823829 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76040074e0 con 0x7f76140ca300 2024-04-18T04:54:41.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f7610ff9640 1 -- 172.21.15.96:0/2588823829 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7604007640 con 0x7f76140ca300 2024-04-18T04:54:41.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f761aa55640 1 -- 172.21.15.96:0/2588823829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761414c6c0 con 0x7f76140ca300 2024-04-18T04:54:41.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f7610ff9640 1 -- 172.21.15.96:0/2588823829 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604004a30 con 0x7f76140ca300 2024-04-18T04:54:41.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f761aa55640 1 -- 172.21.15.96:0/2588823829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76141f0050 con 0x7f76140ca300 2024-04-18T04:54:41.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f761aa55640 1 -- 172.21.15.96:0/2588823829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7614067050 con 0x7f76140ca300 2024-04-18T04:54:41.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f7610ff9640 1 -- 172.21.15.96:0/2588823829 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7604004b90 con 0x7f76140ca300 2024-04-18T04:54:41.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f7610ff9640 1 --2- 172.21.15.96:0/2588823829 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7600066690 0x7f7600068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f7610ff9640 1 -- 172.21.15.96:0/2588823829 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76040839f0 con 0x7f76140ca300 2024-04-18T04:54:41.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f76137fe640 1 --2- 172.21.15.96:0/2588823829 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7600066690 0x7f7600068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.652+0000 7f76137fe640 1 --2- 172.21.15.96:0/2588823829 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7600066690 0x7f7600068b50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f76080b2000 tx=0x7f76080aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:41.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.656+0000 7f7610ff9640 1 -- 172.21.15.96:0/2588823829 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f7604050e10 con 0x7f76140ca300 2024-04-18T04:54:41.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.816+0000 7f761aa55640 1 -- 172.21.15.96:0/2588823829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76140c6c50 con 0x7f76140ca300 2024-04-18T04:54:41.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.816+0000 7f7610ff9640 1 -- 172.21.15.96:0/2588823829 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f7604054430 con 0x7f76140ca300 2024-04-18T04:54:41.818 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:41.818 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:54:41.158173+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:54:39.219441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:54:40.139557+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.720340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.767224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.811511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.710188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.860525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.704784+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:54:41.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.820+0000 7f761aa55640 1 -- 172.21.15.96:0/2588823829 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7600066690 msgr2=0x7f7600068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.820+0000 7f761aa55640 1 --2- 172.21.15.96:0/2588823829 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7600066690 0x7f7600068b50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f76080b2000 tx=0x7f76080aa070 comp rx=0 tx=0).stop 2024-04-18T04:54:41.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.820+0000 7f761aa55640 1 -- 172.21.15.96:0/2588823829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76140ca300 msgr2=0x7f76141e01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.820+0000 7f761aa55640 1 --2- 172.21.15.96:0/2588823829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76140ca300 0x7f76141e01f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f760400c370 tx=0x7f760400c830 comp rx=0 tx=0).stop 2024-04-18T04:54:41.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.820+0000 7f761aa55640 1 -- 172.21.15.96:0/2588823829 shutdown_connections 2024-04-18T04:54:41.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.820+0000 7f761aa55640 1 --2- 172.21.15.96:0/2588823829 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7600066690 0x7f7600068b50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.820+0000 7f761aa55640 1 --2- 172.21.15.96:0/2588823829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f761415a950 0x7f7614143a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.820+0000 7f761aa55640 1 --2- 172.21.15.96:0/2588823829 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7614151210 0x7f76141e3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.820+0000 7f761aa55640 1 --2- 172.21.15.96:0/2588823829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76140ca300 0x7f76141e01f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.820+0000 7f761aa55640 1 -- 172.21.15.96:0/2588823829 >> 172.21.15.96:0/2588823829 conn(0x7f761406c750 msgr2=0x7f76140c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:41.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.820+0000 7f761aa55640 1 -- 172.21.15.96:0/2588823829 shutdown_connections 2024-04-18T04:54:41.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.820+0000 7f761aa55640 1 -- 172.21.15.96:0/2588823829 wait complete. 2024-04-18T04:54:41.838 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-18T04:54:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.960+0000 7f81498d6640 1 Processor -- start 2024-04-18T04:54:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.960+0000 7f81498d6640 1 -- start start 2024-04-18T04:54:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.960+0000 7f81498d6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f81441532d0 0x7f8144158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.960+0000 7f81498d6640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f81440c3fd0 0x7f81440ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.960+0000 7f81498d6640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81441536b0 con 0x7f81440cacc0 2024-04-18T04:54:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.960+0000 7f81498d6640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81440c5970 con 0x7f81441532d0 2024-04-18T04:54:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.960+0000 7f81498d6640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81441594a0 con 0x7f81440c3fd0 2024-04-18T04:54:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.960+0000 7f8142ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f81441532d0 0x7f8144158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.960+0000 7f8142ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f81441532d0 0x7f8144158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54346/0 (socket says 172.21.15.96:54346) 2024-04-18T04:54:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.960+0000 7f8142ffd640 1 -- 172.21.15.96:0/1371308243 learned_addr learned my addr 172.21.15.96:0/1371308243 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.960+0000 7f81437fe640 1 --2- 172.21.15.96:0/1371308243 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f81440c3fd0 0x7f81440ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.960+0000 7f8142ffd640 1 -- 172.21.15.96:0/1371308243 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f81440c3fd0 msgr2=0x7f81440ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.960+0000 7f8142ffd640 1 --2- 172.21.15.96:0/1371308243 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f81440c3fd0 0x7f81440ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.960+0000 7f8142ffd640 1 -- 172.21.15.96:0/1371308243 >> v1:172.21.15.139:6789/0 conn(0x7f81440cacc0 legacy=0x7f814415ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.960+0000 7f8142ffd640 1 -- 172.21.15.96:0/1371308243 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8144159680 con 0x7f81441532d0 2024-04-18T04:54:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.960+0000 7f81437fe640 1 --2- 172.21.15.96:0/1371308243 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f81440c3fd0 0x7f81440ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:41.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f8142ffd640 1 --2- 172.21.15.96:0/1371308243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81441532d0 0x7f8144158f60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8134009870 tx=0x7f813401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3875c1ff14504dec server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:41.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f8141ffb640 1 -- 172.21.15.96:0/1371308243 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81340a89d0 con 0x7f81441532d0 2024-04-18T04:54:41.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f8141ffb640 1 -- 172.21.15.96:0/1371308243 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81340a8b30 con 0x7f81441532d0 2024-04-18T04:54:41.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f8141ffb640 1 -- 172.21.15.96:0/1371308243 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81340b0440 con 0x7f81441532d0 2024-04-18T04:54:41.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f81498d6640 1 -- 172.21.15.96:0/1371308243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81441532d0 msgr2=0x7f8144158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f81498d6640 1 --2- 172.21.15.96:0/1371308243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81441532d0 0x7f8144158f60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8134009870 tx=0x7f813401ed10 comp rx=0 tx=0).stop 2024-04-18T04:54:41.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f81498d6640 1 -- 172.21.15.96:0/1371308243 shutdown_connections 2024-04-18T04:54:41.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f81498d6640 1 --2- 172.21.15.96:0/1371308243 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f81440c3fd0 0x7f81440ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f81498d6640 1 --2- 172.21.15.96:0/1371308243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81441532d0 0x7f8144158f60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f81498d6640 1 -- 172.21.15.96:0/1371308243 >> 172.21.15.96:0/1371308243 conn(0x7f8144071760 msgr2=0x7f814406b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:41.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f81498d6640 1 -- 172.21.15.96:0/1371308243 shutdown_connections 2024-04-18T04:54:41.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f81498d6640 1 -- 172.21.15.96:0/1371308243 wait complete. 2024-04-18T04:54:41.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f81498d6640 1 Processor -- start 2024-04-18T04:54:41.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f81498d6640 1 -- start start 2024-04-18T04:54:41.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f81498d6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81440c3fd0 0x7f8144157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f81498d6640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f81440cacc0 0x7f8144155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f81498d6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81441532d0 0x7f81441ee9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f81498d6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8144159f20 con 0x7f81440c3fd0 2024-04-18T04:54:41.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f81498d6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8144155ac0 con 0x7f81441532d0 2024-04-18T04:54:41.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f81498d6640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81441f2ac0 con 0x7f81440cacc0 2024-04-18T04:54:41.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f8142ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81440c3fd0 0x7f8144157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f8142ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81440c3fd0 0x7f8144157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54362/0 (socket says 172.21.15.96:54362) 2024-04-18T04:54:41.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.964+0000 7f8142ffd640 1 -- 172.21.15.96:0/2726250417 learned_addr learned my addr 172.21.15.96:0/2726250417 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:41.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f81437fe640 1 --2- 172.21.15.96:0/2726250417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81441532d0 0x7f81441ee9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f81427fc640 1 --2- 172.21.15.96:0/2726250417 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f81440cacc0 0x7f8144155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f8142ffd640 1 -- 172.21.15.96:0/2726250417 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f81440cacc0 msgr2=0x7f8144155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f8142ffd640 1 --2- 172.21.15.96:0/2726250417 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f81440cacc0 0x7f8144155ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f8142ffd640 1 -- 172.21.15.96:0/2726250417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81441532d0 msgr2=0x7f81441ee9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:41.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f8142ffd640 1 --2- 172.21.15.96:0/2726250417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81441532d0 0x7f81441ee9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:41.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f8142ffd640 1 -- 172.21.15.96:0/2726250417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81340094d0 con 0x7f81440c3fd0 2024-04-18T04:54:41.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f81437fe640 1 --2- 172.21.15.96:0/2726250417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81441532d0 0x7f81441ee9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:41.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f8142ffd640 1 --2- 172.21.15.96:0/2726250417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81440c3fd0 0x7f8144157030 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f81340b3040 tx=0x7f813401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:41.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f812bfff640 1 -- 172.21.15.96:0/2726250417 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81340a89d0 con 0x7f81440c3fd0 2024-04-18T04:54:41.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f812bfff640 1 -- 172.21.15.96:0/2726250417 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81340bb480 con 0x7f81440c3fd0 2024-04-18T04:54:41.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f81498d6640 1 -- 172.21.15.96:0/2726250417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81441f1c60 con 0x7f81440c3fd0 2024-04-18T04:54:41.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f812bfff640 1 -- 172.21.15.96:0/2726250417 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81340bb850 con 0x7f81440c3fd0 2024-04-18T04:54:41.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f81498d6640 1 -- 172.21.15.96:0/2726250417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81441f2220 con 0x7f81440c3fd0 2024-04-18T04:54:41.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f81498d6640 1 -- 172.21.15.96:0/2726250417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8144067050 con 0x7f81440c3fd0 2024-04-18T04:54:41.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f812bfff640 1 -- 172.21.15.96:0/2726250417 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f81340bb9b0 con 0x7f81440c3fd0 2024-04-18T04:54:41.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f812bfff640 1 --2- 172.21.15.96:0/2726250417 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8130066690 0x7f8130068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:41.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f812bfff640 1 -- 172.21.15.96:0/2726250417 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8134122870 con 0x7f81440c3fd0 2024-04-18T04:54:41.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f81427fc640 1 --2- 172.21.15.96:0/2726250417 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8130066690 0x7f8130068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:41.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.968+0000 7f81427fc640 1 --2- 172.21.15.96:0/2726250417 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8130066690 0x7f8130068b50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f814415cbb0 tx=0x7f8138009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:41.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:41.972+0000 7f812bfff640 1 -- 172.21.15.96:0/2726250417 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f81340efbe0 con 0x7f81440c3fd0 2024-04-18T04:54:42.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:42.164+0000 7f81498d6640 1 -- 172.21.15.96:0/2726250417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8144067050 con 0x7f81440c3fd0 2024-04-18T04:54:43.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.163+0000 7f812bfff640 1 -- 172.21.15.96:0/2726250417 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f81340b5070 con 0x7f81440c3fd0 2024-04-18T04:54:43.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.167+0000 7f81498d6640 1 -- 172.21.15.96:0/2726250417 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8130066690 msgr2=0x7f8130068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:43.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.167+0000 7f81498d6640 1 --2- 172.21.15.96:0/2726250417 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8130066690 0x7f8130068b50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f814415cbb0 tx=0x7f8138009040 comp rx=0 tx=0).stop 2024-04-18T04:54:43.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.171+0000 7f81498d6640 1 -- 172.21.15.96:0/2726250417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81440c3fd0 msgr2=0x7f8144157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:43.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.171+0000 7f81498d6640 1 --2- 172.21.15.96:0/2726250417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81440c3fd0 0x7f8144157030 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f81340b3040 tx=0x7f813401bab0 comp rx=0 tx=0).stop 2024-04-18T04:54:43.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.171+0000 7f81498d6640 1 -- 172.21.15.96:0/2726250417 shutdown_connections 2024-04-18T04:54:43.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.171+0000 7f81498d6640 1 --2- 172.21.15.96:0/2726250417 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8130066690 0x7f8130068b50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:43.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.171+0000 7f81498d6640 1 --2- 172.21.15.96:0/2726250417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81441532d0 0x7f81441ee9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:43.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.171+0000 7f81498d6640 1 --2- 172.21.15.96:0/2726250417 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f81440cacc0 0x7f8144155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:43.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.171+0000 7f81498d6640 1 --2- 172.21.15.96:0/2726250417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81440c3fd0 0x7f8144157030 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:43.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.171+0000 7f81498d6640 1 -- 172.21.15.96:0/2726250417 >> 172.21.15.96:0/2726250417 conn(0x7f8144071760 msgr2=0x7f8144152260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:43.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.171+0000 7f81498d6640 1 -- 172.21.15.96:0/2726250417 shutdown_connections 2024-04-18T04:54:43.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.171+0000 7f81498d6640 1 -- 172.21.15.96:0/2726250417 wait complete. 2024-04-18T04:54:43.191 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300} 2024-04-18T04:54:43.192 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-18T04:54:43.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.315+0000 7f1a73afb640 1 Processor -- start 2024-04-18T04:54:43.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.315+0000 7f1a73afb640 1 -- start start 2024-04-18T04:54:43.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a73afb640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1a6c150e20 0x7f1a6c0c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:43.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a73afb640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a6c0c8100 0x7f1a6c0c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:43.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a73afb640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1a6c0c9020 0x7f1a6c0c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:43.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a73afb640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a6c0c6c50 con 0x7f1a6c0c9020 2024-04-18T04:54:43.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a73afb640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a6c0c9610 con 0x7f1a6c150e20 2024-04-18T04:54:43.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a73afb640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c151200 con 0x7f1a6c0c8100 2024-04-18T04:54:43.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a72098640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1a6c0c9020 0x7f1a6c0c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:43.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a72098640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1a6c0c9020 0x7f1a6c0c3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54372/0 (socket says 172.21.15.96:54372) 2024-04-18T04:54:43.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a72098640 1 -- 172.21.15.96:0/1298368960 learned_addr learned my addr 172.21.15.96:0/1298368960 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:43.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a71096640 1 --2- 172.21.15.96:0/1298368960 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a6c0c8100 0x7f1a6c0c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:43.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a71897640 1 --2- 172.21.15.96:0/1298368960 >> v2:172.21.15.139:3300/0 conn(0x7f1a6c150e20 0x7f1a6c0c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:43.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a72098640 1 -- 172.21.15.96:0/1298368960 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a6c0c8100 msgr2=0x7f1a6c0c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:43.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a72098640 1 --2- 172.21.15.96:0/1298368960 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a6c0c8100 0x7f1a6c0c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:43.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a72098640 1 -- 172.21.15.96:0/1298368960 >> v2:172.21.15.139:3300/0 conn(0x7f1a6c150e20 msgr2=0x7f1a6c0c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:43.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a72098640 1 --2- 172.21.15.96:0/1298368960 >> v2:172.21.15.139:3300/0 conn(0x7f1a6c150e20 0x7f1a6c0c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:43.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a72098640 1 -- 172.21.15.96:0/1298368960 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c0c85d0 con 0x7f1a6c0c9020 2024-04-18T04:54:43.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a71096640 1 --2- 172.21.15.96:0/1298368960 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a6c0c8100 0x7f1a6c0c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:43.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a72098640 1 --2- 172.21.15.96:0/1298368960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a6c0c9020 0x7f1a6c0c3a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0caf30 tx=0x7f1a6401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8040e8ef49f7f12f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:43.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.319+0000 7f1a70895640 1 -- 172.21.15.96:0/1298368960 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a640a56c0 con 0x7f1a6c0c9020 2024-04-18T04:54:43.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a70895640 1 -- 172.21.15.96:0/1298368960 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a640a5820 con 0x7f1a6c0c9020 2024-04-18T04:54:43.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a70895640 1 -- 172.21.15.96:0/1298368960 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a640a5bb0 con 0x7f1a6c0c9020 2024-04-18T04:54:43.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 -- 172.21.15.96:0/1298368960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a6c0c9020 msgr2=0x7f1a6c0c3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:43.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 --2- 172.21.15.96:0/1298368960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a6c0c9020 0x7f1a6c0c3a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0caf30 tx=0x7f1a6401c930 comp rx=0 tx=0).stop 2024-04-18T04:54:43.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 -- 172.21.15.96:0/1298368960 shutdown_connections 2024-04-18T04:54:43.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 --2- 172.21.15.96:0/1298368960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a6c0c9020 0x7f1a6c0c3a10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:43.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 --2- 172.21.15.96:0/1298368960 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a6c0c8100 0x7f1a6c0c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:43.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 --2- 172.21.15.96:0/1298368960 >> v2:172.21.15.139:3300/0 conn(0x7f1a6c150e20 0x7f1a6c0c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:43.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 -- 172.21.15.96:0/1298368960 >> 172.21.15.96:0/1298368960 conn(0x7f1a6c06c610 msgr2=0x7f1a6c0ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:43.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 -- 172.21.15.96:0/1298368960 shutdown_connections 2024-04-18T04:54:43.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 -- 172.21.15.96:0/1298368960 wait complete. 2024-04-18T04:54:43.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 Processor -- start 2024-04-18T04:54:43.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 -- start start 2024-04-18T04:54:43.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a6c0c8100 0x7f1a6c1f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:43.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a6c0c9020 0x7f1a6c1465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:43.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a6c150e20 0x7f1a6c146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:43.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c154b50 con 0x7f1a6c0c9020 2024-04-18T04:54:43.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c1f0e00 con 0x7f1a6c150e20 2024-04-18T04:54:43.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c150250 con 0x7f1a6c0c8100 2024-04-18T04:54:43.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a71096640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a6c0c9020 0x7f1a6c1465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:43.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a71096640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a6c0c9020 0x7f1a6c1465b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54386/0 (socket says 172.21.15.96:54386) 2024-04-18T04:54:43.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a71096640 1 -- 172.21.15.96:0/3421424401 learned_addr learned my addr 172.21.15.96:0/3421424401 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:43.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a71897640 1 --2- 172.21.15.96:0/3421424401 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a6c0c8100 0x7f1a6c1f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:43.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a71096640 1 -- 172.21.15.96:0/3421424401 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a6c0c8100 msgr2=0x7f1a6c1f2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:43.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a71096640 1 --2- 172.21.15.96:0/3421424401 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a6c0c8100 0x7f1a6c1f2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:43.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a72098640 1 --2- 172.21.15.96:0/3421424401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a6c150e20 0x7f1a6c146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:43.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a71096640 1 -- 172.21.15.96:0/3421424401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a6c150e20 msgr2=0x7f1a6c146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:43.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a71096640 1 --2- 172.21.15.96:0/3421424401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a6c150e20 0x7f1a6c146af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:43.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a71096640 1 -- 172.21.15.96:0/3421424401 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a64009b30 con 0x7f1a6c0c9020 2024-04-18T04:54:43.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a71096640 1 --2- 172.21.15.96:0/3421424401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a6c0c9020 0x7f1a6c1465b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00c7f0 tx=0x7f1a5c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:43.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a627fc640 1 -- 172.21.15.96:0/3421424401 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c004220 con 0x7f1a6c0c9020 2024-04-18T04:54:43.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a627fc640 1 -- 172.21.15.96:0/3421424401 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c004380 con 0x7f1a6c0c9020 2024-04-18T04:54:43.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 -- 172.21.15.96:0/3421424401 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a6c1504f0 con 0x7f1a6c0c9020 2024-04-18T04:54:43.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a627fc640 1 -- 172.21.15.96:0/3421424401 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c003840 con 0x7f1a6c0c9020 2024-04-18T04:54:43.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.323+0000 7f1a73afb640 1 -- 172.21.15.96:0/3421424401 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6c1f36c0 con 0x7f1a6c0c9020 2024-04-18T04:54:43.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.327+0000 7f1a73afb640 1 -- 172.21.15.96:0/3421424401 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6c1f0fb0 con 0x7f1a6c0c9020 2024-04-18T04:54:43.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.327+0000 7f1a627fc640 1 -- 172.21.15.96:0/3421424401 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1a5c003bb0 con 0x7f1a6c0c9020 2024-04-18T04:54:43.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.327+0000 7f1a627fc640 1 --2- 172.21.15.96:0/3421424401 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1a50066690 0x7f1a50068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:43.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.327+0000 7f1a627fc640 1 -- 172.21.15.96:0/3421424401 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a5c0840f0 con 0x7f1a6c0c9020 2024-04-18T04:54:43.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.327+0000 7f1a71897640 1 --2- 172.21.15.96:0/3421424401 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1a50066690 0x7f1a50068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:43.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.327+0000 7f1a71897640 1 --2- 172.21.15.96:0/3421424401 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1a50066690 0x7f1a50068b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800b950 tx=0x7f1a68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:43.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.331+0000 7f1a627fc640 1 -- 172.21.15.96:0/3421424401 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1a6c1f0fb0 con 0x7f1a6c0c9020 2024-04-18T04:54:43.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:43.523+0000 7f1a73afb640 1 -- 172.21.15.96:0/3421424401 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f1a6c1f0f70 con 0x7f1a6c0c9020 2024-04-18T04:54:44.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.171+0000 7f1a627fc640 1 -- 172.21.15.96:0/3421424401 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f1a5c059e60 con 0x7f1a6c0c9020 2024-04-18T04:54:44.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.175+0000 7f1a73afb640 1 -- 172.21.15.96:0/3421424401 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1a50066690 msgr2=0x7f1a50068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:44.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.175+0000 7f1a73afb640 1 --2- 172.21.15.96:0/3421424401 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1a50066690 0x7f1a50068b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800b950 tx=0x7f1a68008040 comp rx=0 tx=0).stop 2024-04-18T04:54:44.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.175+0000 7f1a73afb640 1 -- 172.21.15.96:0/3421424401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a6c0c9020 msgr2=0x7f1a6c1465b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:44.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.175+0000 7f1a73afb640 1 --2- 172.21.15.96:0/3421424401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a6c0c9020 0x7f1a6c1465b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00c7f0 tx=0x7f1a5c00ccb0 comp rx=0 tx=0).stop 2024-04-18T04:54:44.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.175+0000 7f1a73afb640 1 -- 172.21.15.96:0/3421424401 shutdown_connections 2024-04-18T04:54:44.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.175+0000 7f1a73afb640 1 --2- 172.21.15.96:0/3421424401 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1a50066690 0x7f1a50068b50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:44.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.175+0000 7f1a73afb640 1 --2- 172.21.15.96:0/3421424401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a6c150e20 0x7f1a6c146af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:44.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.175+0000 7f1a73afb640 1 --2- 172.21.15.96:0/3421424401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a6c0c9020 0x7f1a6c1465b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:44.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.175+0000 7f1a73afb640 1 --2- 172.21.15.96:0/3421424401 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a6c0c8100 0x7f1a6c1f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:44.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.175+0000 7f1a73afb640 1 -- 172.21.15.96:0/3421424401 >> 172.21.15.96:0/3421424401 conn(0x7f1a6c06c610 msgr2=0x7f1a6c158910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:44.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.175+0000 7f1a73afb640 1 -- 172.21.15.96:0/3421424401 shutdown_connections 2024-04-18T04:54:44.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.175+0000 7f1a73afb640 1 -- 172.21.15.96:0/3421424401 wait complete. 2024-04-18T04:54:44.202 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-18T04:54:44.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.331+0000 7efddf0ba640 1 Processor -- start 2024-04-18T04:54:44.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.331+0000 7efddf0ba640 1 -- start start 2024-04-18T04:54:44.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efddf0ba640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdd81532e0 0x7efdd80c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:44.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efddf0ba640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efdd80c9510 0x7efdd815c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:44.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efddf0ba640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7efdd815ccf0 0x7efdd80c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:44.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efddf0ba640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd8159f10 con 0x7efdd80c9510 2024-04-18T04:54:44.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efddf0ba640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd80c20a0 con 0x7efdd815ccf0 2024-04-18T04:54:44.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efddf0ba640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd81536c0 con 0x7efdd81532e0 2024-04-18T04:54:44.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efdd7fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efdd80c9510 0x7efdd815c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:44.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efdd7fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efdd80c9510 0x7efdd815c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54396/0 (socket says 172.21.15.96:54396) 2024-04-18T04:54:44.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efdd7fff640 1 -- 172.21.15.96:0/3056900298 learned_addr learned my addr 172.21.15.96:0/3056900298 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:44.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efddce56640 1 --2- 172.21.15.96:0/3056900298 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdd81532e0 0x7efdd80c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:44.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efddd657640 1 --2- 172.21.15.96:0/3056900298 >> v2:172.21.15.139:3300/0 conn(0x7efdd815ccf0 0x7efdd80c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efdd7fff640 1 -- 172.21.15.96:0/3056900298 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdd81532e0 msgr2=0x7efdd80c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efdd7fff640 1 --2- 172.21.15.96:0/3056900298 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdd81532e0 0x7efdd80c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efdd7fff640 1 -- 172.21.15.96:0/3056900298 >> v2:172.21.15.139:3300/0 conn(0x7efdd815ccf0 msgr2=0x7efdd80c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efdd7fff640 1 --2- 172.21.15.96:0/3056900298 >> v2:172.21.15.139:3300/0 conn(0x7efdd815ccf0 0x7efdd80c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efdd7fff640 1 -- 172.21.15.96:0/3056900298 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd815d180 con 0x7efdd80c9510 2024-04-18T04:54:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efddce56640 1 --2- 172.21.15.96:0/3056900298 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdd81532e0 0x7efdd80c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.335+0000 7efdd7fff640 1 --2- 172.21.15.96:0/3056900298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdd80c9510 0x7efdd815c7b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efdd806fd90 tx=0x7efdcc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a41f8abb97b7b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efdd77fe640 1 -- 172.21.15.96:0/3056900298 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc0ac600 con 0x7efdd80c9510 2024-04-18T04:54:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efdd77fe640 1 -- 172.21.15.96:0/3056900298 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc0a8050 con 0x7efdd80c9510 2024-04-18T04:54:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efdd77fe640 1 -- 172.21.15.96:0/3056900298 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc0ac980 con 0x7efdd80c9510 2024-04-18T04:54:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 -- 172.21.15.96:0/3056900298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdd80c9510 msgr2=0x7efdd815c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 --2- 172.21.15.96:0/3056900298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdd80c9510 0x7efdd815c7b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efdd806fd90 tx=0x7efdcc01c4f0 comp rx=0 tx=0).stop 2024-04-18T04:54:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 -- 172.21.15.96:0/3056900298 shutdown_connections 2024-04-18T04:54:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 --2- 172.21.15.96:0/3056900298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdd80c9510 0x7efdd815c7b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 --2- 172.21.15.96:0/3056900298 >> v2:172.21.15.139:3300/0 conn(0x7efdd815ccf0 0x7efdd80c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 --2- 172.21.15.96:0/3056900298 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdd81532e0 0x7efdd80c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 -- 172.21.15.96:0/3056900298 >> 172.21.15.96:0/3056900298 conn(0x7efdd806c610 msgr2=0x7efdd80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 -- 172.21.15.96:0/3056900298 shutdown_connections 2024-04-18T04:54:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 -- 172.21.15.96:0/3056900298 wait complete. 2024-04-18T04:54:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 Processor -- start 2024-04-18T04:54:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 -- start start 2024-04-18T04:54:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdd80c9510 0x7efdd81f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdd81532e0 0x7efdd81503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdd815ccf0 0x7efdd8071630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd8150920 con 0x7efdd815ccf0 2024-04-18T04:54:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd8154220 con 0x7efdd81532e0 2024-04-18T04:54:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddf0ba640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd81434c0 con 0x7efdd80c9510 2024-04-18T04:54:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddd657640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdd815ccf0 0x7efdd8071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddd657640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdd815ccf0 0x7efdd8071630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54398/0 (socket says 172.21.15.96:54398) 2024-04-18T04:54:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddd657640 1 -- 172.21.15.96:0/2313210210 learned_addr learned my addr 172.21.15.96:0/2313210210 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddce56640 1 --2- 172.21.15.96:0/2313210210 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdd80c9510 0x7efdd81f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efdd7fff640 1 --2- 172.21.15.96:0/2313210210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdd81532e0 0x7efdd81503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.339+0000 7efddd657640 1 -- 172.21.15.96:0/2313210210 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdd80c9510 msgr2=0x7efdd81f53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efddd657640 1 --2- 172.21.15.96:0/2313210210 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdd80c9510 0x7efdd81f53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efddd657640 1 -- 172.21.15.96:0/2313210210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdd81532e0 msgr2=0x7efdd81503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efddd657640 1 --2- 172.21.15.96:0/2313210210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdd81532e0 0x7efdd81503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efddd657640 1 -- 172.21.15.96:0/2313210210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc0094d0 con 0x7efdd815ccf0 2024-04-18T04:54:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efdd7fff640 1 --2- 172.21.15.96:0/2313210210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdd81532e0 0x7efdd81503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efddd657640 1 --2- 172.21.15.96:0/2313210210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdd815ccf0 0x7efdd8071630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efdd000cd70 tx=0x7efdd000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efdd57fa640 1 -- 172.21.15.96:0/2313210210 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0003ba0 con 0x7efdd815ccf0 2024-04-18T04:54:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efdd57fa640 1 -- 172.21.15.96:0/2313210210 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd0003d00 con 0x7efdd815ccf0 2024-04-18T04:54:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efddf0ba640 1 -- 172.21.15.96:0/2313210210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd8142ee0 con 0x7efdd815ccf0 2024-04-18T04:54:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efdd57fa640 1 -- 172.21.15.96:0/2313210210 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0004240 con 0x7efdd815ccf0 2024-04-18T04:54:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efddf0ba640 1 -- 172.21.15.96:0/2313210210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd8145680 con 0x7efdd815ccf0 2024-04-18T04:54:44.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efddf0ba640 1 -- 172.21.15.96:0/2313210210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd80c19e0 con 0x7efdd815ccf0 2024-04-18T04:54:44.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efdd57fa640 1 -- 172.21.15.96:0/2313210210 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efdd00043a0 con 0x7efdd815ccf0 2024-04-18T04:54:44.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efdd57fa640 1 --2- 172.21.15.96:0/2313210210 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7efdc40666c0 0x7efdc4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:44.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efdd57fa640 1 -- 172.21.15.96:0/2313210210 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdd0012070 con 0x7efdd815ccf0 2024-04-18T04:54:44.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efddce56640 1 --2- 172.21.15.96:0/2313210210 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7efdc40666c0 0x7efdc4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:44.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.343+0000 7efddce56640 1 --2- 172.21.15.96:0/2313210210 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7efdc40666c0 0x7efdc4068b80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efdc8006fd0 tx=0x7efdc8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:44.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.347+0000 7efdd57fa640 1 -- 172.21.15.96:0/2313210210 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7efdd0051de0 con 0x7efdd815ccf0 2024-04-18T04:54:44.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:44.539+0000 7efddf0ba640 1 -- 172.21.15.96:0/2313210210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efdd8067050 con 0x7efdd815ccf0 2024-04-18T04:54:45.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.183+0000 7efdd57fa640 1 -- 172.21.15.96:0/2313210210 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7efdd0055400 con 0x7efdd815ccf0 2024-04-18T04:54:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.183+0000 7efddf0ba640 1 -- 172.21.15.96:0/2313210210 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7efdc40666c0 msgr2=0x7efdc4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.183+0000 7efddf0ba640 1 --2- 172.21.15.96:0/2313210210 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7efdc40666c0 0x7efdc4068b80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efdc8006fd0 tx=0x7efdc8008040 comp rx=0 tx=0).stop 2024-04-18T04:54:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.183+0000 7efddf0ba640 1 -- 172.21.15.96:0/2313210210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdd815ccf0 msgr2=0x7efdd8071630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.183+0000 7efddf0ba640 1 --2- 172.21.15.96:0/2313210210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdd815ccf0 0x7efdd8071630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efdd000cd70 tx=0x7efdd000a660 comp rx=0 tx=0).stop 2024-04-18T04:54:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.183+0000 7efddf0ba640 1 -- 172.21.15.96:0/2313210210 shutdown_connections 2024-04-18T04:54:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.183+0000 7efddf0ba640 1 --2- 172.21.15.96:0/2313210210 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7efdc40666c0 0x7efdc4068b80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.183+0000 7efddf0ba640 1 --2- 172.21.15.96:0/2313210210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdd815ccf0 0x7efdd8071630 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.183+0000 7efddf0ba640 1 --2- 172.21.15.96:0/2313210210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdd81532e0 0x7efdd81503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.183+0000 7efddf0ba640 1 --2- 172.21.15.96:0/2313210210 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdd80c9510 0x7efdd81f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.183+0000 7efddf0ba640 1 -- 172.21.15.96:0/2313210210 >> 172.21.15.96:0/2313210210 conn(0x7efdd806c610 msgr2=0x7efdd80c26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.183+0000 7efddf0ba640 1 -- 172.21.15.96:0/2313210210 shutdown_connections 2024-04-18T04:54:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.183+0000 7efddf0ba640 1 -- 172.21.15.96:0/2313210210 wait complete. 2024-04-18T04:54:45.208 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-18T04:54:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38aea84640 1 Processor -- start 2024-04-18T04:54:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38aea84640 1 -- start start 2024-04-18T04:54:45.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38aea84640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f38a8150e20 0x7f38a80c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38aea84640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f38a80c8100 0x7f38a80c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38aea84640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38a80c9020 0x7f38a80c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38aea84640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a80c6c50 con 0x7f38a80c8100 2024-04-18T04:54:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38aea84640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a80c9610 con 0x7f38a8150e20 2024-04-18T04:54:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38aea84640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8151200 con 0x7f38a80c9020 2024-04-18T04:54:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38a7fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f38a80c8100 0x7f38a80c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38a7fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f38a80c8100 0x7f38a80c9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54402/0 (socket says 172.21.15.96:54402) 2024-04-18T04:54:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38a7fff640 1 -- 172.21.15.96:0/501802067 learned_addr learned my addr 172.21.15.96:0/501802067 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38ad021640 1 --2- 172.21.15.96:0/501802067 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38a80c9020 0x7f38a80c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38ac820640 1 --2- 172.21.15.96:0/501802067 >> v2:172.21.15.139:3300/0 conn(0x7f38a8150e20 0x7f38a80c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38a7fff640 1 -- 172.21.15.96:0/501802067 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38a80c9020 msgr2=0x7f38a80c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38a7fff640 1 --2- 172.21.15.96:0/501802067 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38a80c9020 0x7f38a80c3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38a7fff640 1 -- 172.21.15.96:0/501802067 >> v2:172.21.15.139:3300/0 conn(0x7f38a8150e20 msgr2=0x7f38a80c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38a7fff640 1 --2- 172.21.15.96:0/501802067 >> v2:172.21.15.139:3300/0 conn(0x7f38a8150e20 0x7f38a80c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:45.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.335+0000 7f38a7fff640 1 -- 172.21.15.96:0/501802067 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a80c85d0 con 0x7f38a80c8100 2024-04-18T04:54:45.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38a7fff640 1 --2- 172.21.15.96:0/501802067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38a80c8100 0x7f38a80c9af0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f38a80caf30 tx=0x7f389401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46dacd8bf26f5dbf server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:45.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38a77fe640 1 -- 172.21.15.96:0/501802067 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38940ab600 con 0x7f38a80c8100 2024-04-18T04:54:45.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38a77fe640 1 -- 172.21.15.96:0/501802067 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38940a7050 con 0x7f38a80c8100 2024-04-18T04:54:45.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38a77fe640 1 -- 172.21.15.96:0/501802067 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38940ab980 con 0x7f38a80c8100 2024-04-18T04:54:45.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 -- 172.21.15.96:0/501802067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38a80c8100 msgr2=0x7f38a80c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:45.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 --2- 172.21.15.96:0/501802067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38a80c8100 0x7f38a80c9af0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f38a80caf30 tx=0x7f389401c460 comp rx=0 tx=0).stop 2024-04-18T04:54:45.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 -- 172.21.15.96:0/501802067 shutdown_connections 2024-04-18T04:54:45.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 --2- 172.21.15.96:0/501802067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38a80c8100 0x7f38a80c9af0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:45.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 --2- 172.21.15.96:0/501802067 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38a80c9020 0x7f38a80c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:45.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 --2- 172.21.15.96:0/501802067 >> v2:172.21.15.139:3300/0 conn(0x7f38a8150e20 0x7f38a80c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:45.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 -- 172.21.15.96:0/501802067 >> 172.21.15.96:0/501802067 conn(0x7f38a806c610 msgr2=0x7f38a80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:45.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 -- 172.21.15.96:0/501802067 shutdown_connections 2024-04-18T04:54:45.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 -- 172.21.15.96:0/501802067 wait complete. 2024-04-18T04:54:45.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 Processor -- start 2024-04-18T04:54:45.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 -- start start 2024-04-18T04:54:45.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38a80c8100 0x7f38a81456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:45.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38a80c9020 0x7f38a81f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:45.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38a8150e20 0x7f38a8141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:45.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8159c10 con 0x7f38a8150e20 2024-04-18T04:54:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a81f51c0 con 0x7f38a80c8100 2024-04-18T04:54:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8143f00 con 0x7f38a80c9020 2024-04-18T04:54:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38ad021640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38a8150e20 0x7f38a8141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38ad021640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38a8150e20 0x7f38a8141680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54414/0 (socket says 172.21.15.96:54414) 2024-04-18T04:54:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38ad021640 1 -- 172.21.15.96:0/2104612839 learned_addr learned my addr 172.21.15.96:0/2104612839 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38a7fff640 1 --2- 172.21.15.96:0/2104612839 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38a80c9020 0x7f38a81f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38ac820640 1 --2- 172.21.15.96:0/2104612839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38a80c8100 0x7f38a81456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38ad021640 1 -- 172.21.15.96:0/2104612839 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38a80c9020 msgr2=0x7f38a81f55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38ad021640 1 --2- 172.21.15.96:0/2104612839 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38a80c9020 0x7f38a81f55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38ad021640 1 -- 172.21.15.96:0/2104612839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38a80c8100 msgr2=0x7f38a81456c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38ad021640 1 --2- 172.21.15.96:0/2104612839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38a80c8100 0x7f38a81456c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38ad021640 1 -- 172.21.15.96:0/2104612839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940094d0 con 0x7f38a8150e20 2024-04-18T04:54:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38ad021640 1 --2- 172.21.15.96:0/2104612839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38a8150e20 0x7f38a8141680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f38a0007e40 tx=0x7f38a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:45.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38a57fa640 1 -- 172.21.15.96:0/2104612839 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0014620 con 0x7f38a8150e20 2024-04-18T04:54:45.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38a57fa640 1 -- 172.21.15.96:0/2104612839 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a000ee90 con 0x7f38a8150e20 2024-04-18T04:54:45.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38aea84640 1 -- 172.21.15.96:0/2104612839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a8142dc0 con 0x7f38a8150e20 2024-04-18T04:54:45.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.339+0000 7f38a57fa640 1 -- 172.21.15.96:0/2104612839 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a00149e0 con 0x7f38a8150e20 2024-04-18T04:54:45.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.343+0000 7f38aea84640 1 -- 172.21.15.96:0/2104612839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a81f4e20 con 0x7f38a8150e20 2024-04-18T04:54:45.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.343+0000 7f38aea84640 1 -- 172.21.15.96:0/2104612839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a80673f0 con 0x7f38a8150e20 2024-04-18T04:54:45.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.343+0000 7f38a57fa640 1 -- 172.21.15.96:0/2104612839 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f38a0014b40 con 0x7f38a8150e20 2024-04-18T04:54:45.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.343+0000 7f38a57fa640 1 --2- 172.21.15.96:0/2104612839 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f388c066690 0x7f388c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:45.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.343+0000 7f38a57fa640 1 -- 172.21.15.96:0/2104612839 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38a0084bd0 con 0x7f38a8150e20 2024-04-18T04:54:45.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.343+0000 7f38ac820640 1 --2- 172.21.15.96:0/2104612839 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f388c066690 0x7f388c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:45.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.343+0000 7f38ac820640 1 --2- 172.21.15.96:0/2104612839 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f388c066690 0x7f388c068b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f389c00b950 tx=0x7f389c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:45.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.347+0000 7f38a57fa640 1 -- 172.21.15.96:0/2104612839 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f38a0051eb0 con 0x7f38a8150e20 2024-04-18T04:54:45.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:45.531+0000 7f38aea84640 1 -- 172.21.15.96:0/2104612839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f38a81f5300 con 0x7f38a8150e20 2024-04-18T04:54:46.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.187+0000 7f38a57fa640 1 -- 172.21.15.96:0/2104612839 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v8) v1 ==== 115+0+0 (secure 0 0 0) 0x7f38a00554d0 con 0x7f38a8150e20 2024-04-18T04:54:46.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.191+0000 7f38aea84640 1 -- 172.21.15.96:0/2104612839 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f388c066690 msgr2=0x7f388c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:46.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.191+0000 7f38aea84640 1 --2- 172.21.15.96:0/2104612839 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f388c066690 0x7f388c068b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f389c00b950 tx=0x7f389c008040 comp rx=0 tx=0).stop 2024-04-18T04:54:46.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.191+0000 7f38aea84640 1 -- 172.21.15.96:0/2104612839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38a8150e20 msgr2=0x7f38a8141680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:46.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.191+0000 7f38aea84640 1 --2- 172.21.15.96:0/2104612839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38a8150e20 0x7f38a8141680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f38a0007e40 tx=0x7f38a000e4b0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.191+0000 7f38aea84640 1 -- 172.21.15.96:0/2104612839 shutdown_connections 2024-04-18T04:54:46.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.191+0000 7f38aea84640 1 --2- 172.21.15.96:0/2104612839 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f388c066690 0x7f388c068b50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.191+0000 7f38aea84640 1 --2- 172.21.15.96:0/2104612839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38a8150e20 0x7f38a8141680 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.191+0000 7f38aea84640 1 --2- 172.21.15.96:0/2104612839 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38a80c9020 0x7f38a81f55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.191+0000 7f38aea84640 1 --2- 172.21.15.96:0/2104612839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38a80c8100 0x7f38a81456c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.191+0000 7f38aea84640 1 -- 172.21.15.96:0/2104612839 >> 172.21.15.96:0/2104612839 conn(0x7f38a806c610 msgr2=0x7f38a8069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:46.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.191+0000 7f38aea84640 1 -- 172.21.15.96:0/2104612839 shutdown_connections 2024-04-18T04:54:46.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.191+0000 7f38aea84640 1 -- 172.21.15.96:0/2104612839 wait complete. 2024-04-18T04:54:46.215 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-18T04:54:46.215 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:54:46.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.335+0000 7f3358fac640 1 Processor -- start 2024-04-18T04:54:46.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.335+0000 7f3358fac640 1 -- start start 2024-04-18T04:54:46.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3358fac640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3354153180 0x7f3354159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3358fac640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f33540700e0 0x7f33540707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3358fac640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f335415c580 0x7f33540ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3358fac640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3354159700 con 0x7f33540700e0 2024-04-18T04:54:46.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3358fac640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33540c6390 con 0x7f335415c580 2024-04-18T04:54:46.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3358fac640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335415cf80 con 0x7f3354153180 2024-04-18T04:54:46.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3349d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f33540700e0 0x7f33540707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3349d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f33540700e0 0x7f33540707c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54418/0 (socket says 172.21.15.96:54418) 2024-04-18T04:54:46.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3349d9b640 1 -- 172.21.15.96:0/1329968757 learned_addr learned my addr 172.21.15.96:0/1329968757 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:46.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f335259c640 1 --2- 172.21.15.96:0/1329968757 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3354153180 0x7f3354159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3352d9d640 1 --2- 172.21.15.96:0/1329968757 >> v2:172.21.15.139:3300/0 conn(0x7f335415c580 0x7f33540ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3349d9b640 1 -- 172.21.15.96:0/1329968757 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3354153180 msgr2=0x7f3354159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:46.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3349d9b640 1 --2- 172.21.15.96:0/1329968757 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3354153180 0x7f3354159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3349d9b640 1 -- 172.21.15.96:0/1329968757 >> v2:172.21.15.139:3300/0 conn(0x7f335415c580 msgr2=0x7f33540ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:46.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3349d9b640 1 --2- 172.21.15.96:0/1329968757 >> v2:172.21.15.139:3300/0 conn(0x7f335415c580 0x7f33540ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3349d9b640 1 -- 172.21.15.96:0/1329968757 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335415d220 con 0x7f33540700e0 2024-04-18T04:54:46.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3352d9d640 1 --2- 172.21.15.96:0/1329968757 >> v2:172.21.15.139:3300/0 conn(0x7f335415c580 0x7f33540ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:46.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3349d9b640 1 --2- 172.21.15.96:0/1329968757 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33540700e0 0x7f33540707c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f33540c6c00 tx=0x7f333c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2baab9ca7c6d0420 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:46.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3351d9b640 1 -- 172.21.15.96:0/1329968757 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c0a89d0 con 0x7f33540700e0 2024-04-18T04:54:46.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3351d9b640 1 -- 172.21.15.96:0/1329968757 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333c0a8b30 con 0x7f33540700e0 2024-04-18T04:54:46.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3351d9b640 1 -- 172.21.15.96:0/1329968757 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c0b0440 con 0x7f33540700e0 2024-04-18T04:54:46.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3358fac640 1 -- 172.21.15.96:0/1329968757 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33540700e0 msgr2=0x7f33540707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:46.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3358fac640 1 --2- 172.21.15.96:0/1329968757 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33540700e0 0x7f33540707c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f33540c6c00 tx=0x7f333c01ed10 comp rx=0 tx=0).stop 2024-04-18T04:54:46.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3358fac640 1 -- 172.21.15.96:0/1329968757 shutdown_connections 2024-04-18T04:54:46.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3358fac640 1 --2- 172.21.15.96:0/1329968757 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33540700e0 0x7f33540707c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3358fac640 1 --2- 172.21.15.96:0/1329968757 >> v2:172.21.15.139:3300/0 conn(0x7f335415c580 0x7f33540ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3358fac640 1 --2- 172.21.15.96:0/1329968757 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3354153180 0x7f3354159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3358fac640 1 -- 172.21.15.96:0/1329968757 >> 172.21.15.96:0/1329968757 conn(0x7f335406c750 msgr2=0x7f33540c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:46.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3358fac640 1 -- 172.21.15.96:0/1329968757 shutdown_connections 2024-04-18T04:54:46.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.339+0000 7f3358fac640 1 -- 172.21.15.96:0/1329968757 wait complete. 2024-04-18T04:54:46.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3358fac640 1 Processor -- start 2024-04-18T04:54:46.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3358fac640 1 -- start start 2024-04-18T04:54:46.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3358fac640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f33540700e0 0x7f33541555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3358fac640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3354153180 0x7f33540c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3358fac640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f335415c580 0x7f33540c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3358fac640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33540c2eb0 con 0x7f335415c580 2024-04-18T04:54:46.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3358fac640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33540c2880 con 0x7f3354153180 2024-04-18T04:54:46.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3358fac640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335415a160 con 0x7f33540700e0 2024-04-18T04:54:46.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3352d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f335415c580 0x7f33540c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3352d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f335415c580 0x7f33540c32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54434/0 (socket says 172.21.15.96:54434) 2024-04-18T04:54:46.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3352d9d640 1 -- 172.21.15.96:0/3358317278 learned_addr learned my addr 172.21.15.96:0/3358317278 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:46.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f335259c640 1 --2- 172.21.15.96:0/3358317278 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f33540700e0 0x7f33541555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3349d9b640 1 --2- 172.21.15.96:0/3358317278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3354153180 0x7f33540c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3352d9d640 1 -- 172.21.15.96:0/3358317278 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f33540700e0 msgr2=0x7f33541555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:46.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3352d9d640 1 --2- 172.21.15.96:0/3358317278 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f33540700e0 0x7f33541555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3352d9d640 1 -- 172.21.15.96:0/3358317278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3354153180 msgr2=0x7f33540c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:46.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3352d9d640 1 --2- 172.21.15.96:0/3358317278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3354153180 0x7f33540c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3352d9d640 1 -- 172.21.15.96:0/3358317278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c0094d0 con 0x7f335415c580 2024-04-18T04:54:46.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3352d9d640 1 --2- 172.21.15.96:0/3358317278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f335415c580 0x7f33540c32d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f334c00cd50 tx=0x7f334c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:46.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f334b7fe640 1 -- 172.21.15.96:0/3358317278 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c00f680 con 0x7f335415c580 2024-04-18T04:54:46.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f334b7fe640 1 -- 172.21.15.96:0/3358317278 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c00f800 con 0x7f335415c580 2024-04-18T04:54:46.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3358fac640 1 -- 172.21.15.96:0/3358317278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3354155bd0 con 0x7f335415c580 2024-04-18T04:54:46.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f334b7fe640 1 -- 172.21.15.96:0/3358317278 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c00fbb0 con 0x7f335415c580 2024-04-18T04:54:46.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3358fac640 1 -- 172.21.15.96:0/3358317278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3354153bb0 con 0x7f335415c580 2024-04-18T04:54:46.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.343+0000 7f3358fac640 1 -- 172.21.15.96:0/3358317278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33540c2ff0 con 0x7f335415c580 2024-04-18T04:54:46.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.347+0000 7f334b7fe640 1 -- 172.21.15.96:0/3358317278 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f334c00b040 con 0x7f335415c580 2024-04-18T04:54:46.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.347+0000 7f334b7fe640 1 --2- 172.21.15.96:0/3358317278 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3334066690 0x7f3334068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.347+0000 7f334b7fe640 1 -- 172.21.15.96:0/3358317278 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f334c084a90 con 0x7f335415c580 2024-04-18T04:54:46.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.347+0000 7f335259c640 1 --2- 172.21.15.96:0/3358317278 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3334066690 0x7f3334068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.347+0000 7f335259c640 1 --2- 172.21.15.96:0/3358317278 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3334066690 0x7f3334068b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f334400a970 tx=0x7f3344008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:46.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.351+0000 7f334b7fe640 1 -- 172.21.15.96:0/3358317278 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f33540c2ff0 con 0x7f335415c580 2024-04-18T04:54:46.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.543+0000 7f3358fac640 1 -- 172.21.15.96:0/3358317278 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33540c2ff0 con 0x7f335415c580 2024-04-18T04:54:46.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.543+0000 7f334b7fe640 1 -- 172.21.15.96:0/3358317278 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6252 (secure 0 0 0) 0x7f33540c2ff0 con 0x7f335415c580 2024-04-18T04:54:46.546 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:46.546 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/4225147900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":4225147900},{"type":"v1","addr":"172.21.15.96:6839","nonce":4225147900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/2054604275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2054604275},{"type":"v1","addr":"172.21.15.139:6836","nonce":2054604275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2105821790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":2105821790},{"type":"v1","addr":"172.21.15.139:6837","nonce":2105821790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1188672263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1188672263},{"type":"v1","addr":"172.21.15.96:6835","nonce":1188672263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/4278976485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":4278976485},{"type":"v1","addr":"172.21.15.96:6837","nonce":4278976485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:54:41.158866+0000","modified":"2024-04-18T04:54:46.183477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"f","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.139:6833/3935291095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":3935291095},{"type":"v1","addr":"172.21.15.139:6833","nonce":3935291095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:54:46.546 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 8 2024-04-18T04:54:46.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.547+0000 7f3358fac640 1 -- 172.21.15.96:0/3358317278 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3334066690 msgr2=0x7f3334068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:46.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.547+0000 7f3358fac640 1 --2- 172.21.15.96:0/3358317278 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3334066690 0x7f3334068b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f334400a970 tx=0x7f3344008040 comp rx=0 tx=0).stop 2024-04-18T04:54:46.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.547+0000 7f3358fac640 1 -- 172.21.15.96:0/3358317278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f335415c580 msgr2=0x7f33540c32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:46.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.547+0000 7f3358fac640 1 --2- 172.21.15.96:0/3358317278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f335415c580 0x7f33540c32d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f334c00cd50 tx=0x7f334c00a650 comp rx=0 tx=0).stop 2024-04-18T04:54:46.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.547+0000 7f3358fac640 1 -- 172.21.15.96:0/3358317278 shutdown_connections 2024-04-18T04:54:46.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.547+0000 7f3358fac640 1 --2- 172.21.15.96:0/3358317278 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3334066690 0x7f3334068b50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.547+0000 7f3358fac640 1 --2- 172.21.15.96:0/3358317278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f335415c580 0x7f33540c32d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.547+0000 7f3358fac640 1 --2- 172.21.15.96:0/3358317278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3354153180 0x7f33540c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.547+0000 7f3358fac640 1 --2- 172.21.15.96:0/3358317278 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f33540700e0 0x7f33541555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.547+0000 7f3358fac640 1 -- 172.21.15.96:0/3358317278 >> 172.21.15.96:0/3358317278 conn(0x7f335406c750 msgr2=0x7f335415a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:46.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.547+0000 7f3358fac640 1 -- 172.21.15.96:0/3358317278 shutdown_connections 2024-04-18T04:54:46.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.547+0000 7f3358fac640 1 -- 172.21.15.96:0/3358317278 wait complete. 2024-04-18T04:54:46.564 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:54:46.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.675+0000 7f14baf23640 1 Processor -- start 2024-04-18T04:54:46.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.675+0000 7f14baf23640 1 -- start start 2024-04-18T04:54:46.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14baf23640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f14b406d930 0x7f14b4070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14baf23640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f14b40c1870 0x7f14b4156050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14baf23640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f14b406dd10 0x7f14b40c4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14baf23640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b40721e0 con 0x7f14b406dd10 2024-04-18T04:54:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14baf23640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b406e1c0 con 0x7f14b406d930 2024-04-18T04:54:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14baf23640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4070730 con 0x7f14b40c1870 2024-04-18T04:54:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14b94c0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f14b406dd10 0x7f14b40c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14b94c0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f14b406dd10 0x7f14b40c4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54436/0 (socket says 172.21.15.96:54436) 2024-04-18T04:54:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14b94c0640 1 -- 172.21.15.96:0/1344661233 learned_addr learned my addr 172.21.15.96:0/1344661233 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14b3fff640 1 --2- 172.21.15.96:0/1344661233 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f14b40c1870 0x7f14b4156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14b8cbf640 1 --2- 172.21.15.96:0/1344661233 >> v2:172.21.15.139:3300/0 conn(0x7f14b406d930 0x7f14b4070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14b94c0640 1 -- 172.21.15.96:0/1344661233 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f14b40c1870 msgr2=0x7f14b4156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14b94c0640 1 --2- 172.21.15.96:0/1344661233 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f14b40c1870 0x7f14b4156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14b94c0640 1 -- 172.21.15.96:0/1344661233 >> v2:172.21.15.139:3300/0 conn(0x7f14b406d930 msgr2=0x7f14b4070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:46.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14b94c0640 1 --2- 172.21.15.96:0/1344661233 >> v2:172.21.15.139:3300/0 conn(0x7f14b406d930 0x7f14b4070fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14b94c0640 1 -- 172.21.15.96:0/1344661233 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b4070a10 con 0x7f14b406dd10 2024-04-18T04:54:46.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14b3fff640 1 --2- 172.21.15.96:0/1344661233 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f14b40c1870 0x7f14b4156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:46.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14b8cbf640 1 --2- 172.21.15.96:0/1344661233 >> v2:172.21.15.139:3300/0 conn(0x7f14b406d930 0x7f14b4070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:46.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14b94c0640 1 --2- 172.21.15.96:0/1344661233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b406dd10 0x7f14b40c4190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14b40c7c10 tx=0x7f14ac01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b47f525d5410546 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:46.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14b37fe640 1 -- 172.21.15.96:0/1344661233 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0af400 con 0x7f14b406dd10 2024-04-18T04:54:46.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.679+0000 7f14b37fe640 1 -- 172.21.15.96:0/1344661233 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac0ab050 con 0x7f14b406dd10 2024-04-18T04:54:46.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14b37fe640 1 -- 172.21.15.96:0/1344661233 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0af780 con 0x7f14b406dd10 2024-04-18T04:54:46.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 -- 172.21.15.96:0/1344661233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b406dd10 msgr2=0x7f14b40c4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:46.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 --2- 172.21.15.96:0/1344661233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b406dd10 0x7f14b40c4190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14b40c7c10 tx=0x7f14ac01f1e0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 -- 172.21.15.96:0/1344661233 shutdown_connections 2024-04-18T04:54:46.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 --2- 172.21.15.96:0/1344661233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b406dd10 0x7f14b40c4190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 --2- 172.21.15.96:0/1344661233 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f14b40c1870 0x7f14b4156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 --2- 172.21.15.96:0/1344661233 >> v2:172.21.15.139:3300/0 conn(0x7f14b406d930 0x7f14b4070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 -- 172.21.15.96:0/1344661233 >> 172.21.15.96:0/1344661233 conn(0x7f14b406c750 msgr2=0x7f14b40c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:46.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 -- 172.21.15.96:0/1344661233 shutdown_connections 2024-04-18T04:54:46.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 -- 172.21.15.96:0/1344661233 wait complete. 2024-04-18T04:54:46.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 Processor -- start 2024-04-18T04:54:46.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 -- start start 2024-04-18T04:54:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14b406d930 0x7f14b4152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f14b406dd10 0x7f14b41487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b40c1870 0x7f14b4148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b41ec9f0 con 0x7f14b40c1870 2024-04-18T04:54:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b41ecc50 con 0x7f14b406d930 2024-04-18T04:54:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b41ecef0 con 0x7f14b406dd10 2024-04-18T04:54:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14b94c0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b40c1870 0x7f14b4148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14b94c0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b40c1870 0x7f14b4148ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54448/0 (socket says 172.21.15.96:54448) 2024-04-18T04:54:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14b94c0640 1 -- 172.21.15.96:0/2966247133 learned_addr learned my addr 172.21.15.96:0/2966247133 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14b3fff640 1 --2- 172.21.15.96:0/2966247133 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f14b406dd10 0x7f14b41487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14b94c0640 1 -- 172.21.15.96:0/2966247133 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f14b406dd10 msgr2=0x7f14b41487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14b8cbf640 1 --2- 172.21.15.96:0/2966247133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14b406d930 0x7f14b4152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14b94c0640 1 --2- 172.21.15.96:0/2966247133 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f14b406dd10 0x7f14b41487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14b94c0640 1 -- 172.21.15.96:0/2966247133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14b406d930 msgr2=0x7f14b4152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14b94c0640 1 --2- 172.21.15.96:0/2966247133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14b406d930 0x7f14b4152550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14b94c0640 1 -- 172.21.15.96:0/2966247133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac009b30 con 0x7f14b40c1870 2024-04-18T04:54:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14b3fff640 1 --2- 172.21.15.96:0/2966247133 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f14b406dd10 0x7f14b41487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14b94c0640 1 --2- 172.21.15.96:0/2966247133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b40c1870 0x7f14b4148ce0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0b2040 tx=0x7f14ac01bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14b17fa640 1 -- 172.21.15.96:0/2966247133 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0afdc0 con 0x7f14b40c1870 2024-04-18T04:54:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14b17fa640 1 -- 172.21.15.96:0/2966247133 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac009510 con 0x7f14b40c1870 2024-04-18T04:54:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 -- 172.21.15.96:0/2966247133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b41479e0 con 0x7f14b40c1870 2024-04-18T04:54:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14b17fa640 1 -- 172.21.15.96:0/2966247133 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0b8640 con 0x7f14b40c1870 2024-04-18T04:54:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.683+0000 7f14baf23640 1 -- 172.21.15.96:0/2966247133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b4147fa0 con 0x7f14b40c1870 2024-04-18T04:54:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.687+0000 7f14baf23640 1 -- 172.21.15.96:0/2966247133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b4067050 con 0x7f14b40c1870 2024-04-18T04:54:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.687+0000 7f14b17fa640 1 -- 172.21.15.96:0/2966247133 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f14ac0b6040 con 0x7f14b40c1870 2024-04-18T04:54:46.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.687+0000 7f14b17fa640 1 --2- 172.21.15.96:0/2966247133 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f14980666c0 0x7f1498068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.687+0000 7f14b17fa640 1 -- 172.21.15.96:0/2966247133 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14ac122160 con 0x7f14b40c1870 2024-04-18T04:54:46.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.687+0000 7f14b8cbf640 1 --2- 172.21.15.96:0/2966247133 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f14980666c0 0x7f1498068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.687+0000 7f14b8cbf640 1 --2- 172.21.15.96:0/2966247133 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f14980666c0 0x7f1498068b80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f14a800b820 tx=0x7f14a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:46.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.691+0000 7f14b17fa640 1 -- 172.21.15.96:0/2966247133 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f14ac0ef560 con 0x7f14b40c1870 2024-04-18T04:54:46.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.839+0000 7f14baf23640 1 -- 172.21.15.96:0/2966247133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14b4147510 con 0x7f14b40c1870 2024-04-18T04:54:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.843+0000 7f14b17fa640 1 -- 172.21.15.96:0/2966247133 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f14ac0f2b80 con 0x7f14b40c1870 2024-04-18T04:54:46.844 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:46.844 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":21,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:54:42.161552+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:54:39.219441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:54:40.139557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.720340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.767224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.811511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.710188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.860525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.704784+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:54:46.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.843+0000 7f14baf23640 1 -- 172.21.15.96:0/2966247133 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f14980666c0 msgr2=0x7f1498068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:46.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.843+0000 7f14baf23640 1 --2- 172.21.15.96:0/2966247133 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f14980666c0 0x7f1498068b80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f14a800b820 tx=0x7f14a8008040 comp rx=0 tx=0).stop 2024-04-18T04:54:46.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.843+0000 7f14baf23640 1 -- 172.21.15.96:0/2966247133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b40c1870 msgr2=0x7f14b4148ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:46.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.843+0000 7f14baf23640 1 --2- 172.21.15.96:0/2966247133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b40c1870 0x7f14b4148ce0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0b2040 tx=0x7f14ac01bf80 comp rx=0 tx=0).stop 2024-04-18T04:54:46.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.843+0000 7f14baf23640 1 -- 172.21.15.96:0/2966247133 shutdown_connections 2024-04-18T04:54:46.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.843+0000 7f14baf23640 1 --2- 172.21.15.96:0/2966247133 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f14980666c0 0x7f1498068b80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.843+0000 7f14baf23640 1 --2- 172.21.15.96:0/2966247133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14b40c1870 0x7f14b4148ce0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.843+0000 7f14baf23640 1 --2- 172.21.15.96:0/2966247133 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f14b406dd10 0x7f14b41487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.843+0000 7f14baf23640 1 --2- 172.21.15.96:0/2966247133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14b406d930 0x7f14b4152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.843+0000 7f14baf23640 1 -- 172.21.15.96:0/2966247133 >> 172.21.15.96:0/2966247133 conn(0x7f14b406c750 msgr2=0x7f14b4153390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:46.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.843+0000 7f14baf23640 1 -- 172.21.15.96:0/2966247133 shutdown_connections 2024-04-18T04:54:46.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.843+0000 7f14baf23640 1 -- 172.21.15.96:0/2966247133 wait complete. 2024-04-18T04:54:46.861 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-18T04:54:46.861 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:54:46.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.967+0000 7fca88215640 1 Processor -- start 2024-04-18T04:54:46.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.967+0000 7fca88215640 1 -- start start 2024-04-18T04:54:46.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.967+0000 7fca88215640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca80153180 0x7fca80159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.967+0000 7fca88215640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca80159700 con 0x7fca800700e0 2024-04-18T04:54:46.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.967+0000 7fca88215640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca80070be0 con 0x7fca800707c0 2024-04-18T04:54:46.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.967+0000 7fca88215640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca800c6390 con 0x7fca80153180 2024-04-18T04:54:46.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca85fb1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca80153180 0x7fca80159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca85fb1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca80153180 0x7fca80159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54460/0 (socket says 172.21.15.96:54460) 2024-04-18T04:54:46.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca85fb1640 1 -- 172.21.15.96:0/2870003478 learned_addr learned my addr 172.21.15.96:0/2870003478 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:46.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca85fb1640 1 -- 172.21.15.96:0/2870003478 >> v1:172.21.15.139:6789/0 conn(0x7fca800707c0 legacy=0x7fca800ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:46.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca85fb1640 1 -- 172.21.15.96:0/2870003478 >> v1:172.21.15.96:6789/0 conn(0x7fca800700e0 legacy=0x7fca8015c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:46.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca85fb1640 1 -- 172.21.15.96:0/2870003478 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8015cf80 con 0x7fca80153180 2024-04-18T04:54:46.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca84faf640 1 -- 172.21.15.96:0/2870003478 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844405149 0 0) 0x7fca80159700 con 0x7fca800700e0 2024-04-18T04:54:46.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca85fb1640 1 --2- 172.21.15.96:0/2870003478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca80153180 0x7fca80159b90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009870 tx=0x7fca7c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6088246f94c508 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:46.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca84faf640 1 -- 172.21.15.96:0/2870003478 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0a8a10 con 0x7fca80153180 2024-04-18T04:54:46.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca84faf640 1 -- 172.21.15.96:0/2870003478 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c0a8b70 con 0x7fca80153180 2024-04-18T04:54:46.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca84faf640 1 -- 172.21.15.96:0/2870003478 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0b0440 con 0x7fca80153180 2024-04-18T04:54:46.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca88215640 1 -- 172.21.15.96:0/2870003478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca80153180 msgr2=0x7fca80159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:46.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca88215640 1 --2- 172.21.15.96:0/2870003478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca80153180 0x7fca80159b90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009870 tx=0x7fca7c01ed10 comp rx=0 tx=0).stop 2024-04-18T04:54:46.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca88215640 1 -- 172.21.15.96:0/2870003478 shutdown_connections 2024-04-18T04:54:46.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca88215640 1 --2- 172.21.15.96:0/2870003478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca80153180 0x7fca80159b90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca88215640 1 -- 172.21.15.96:0/2870003478 >> 172.21.15.96:0/2870003478 conn(0x7fca8006c750 msgr2=0x7fca800c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:46.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca88215640 1 -- 172.21.15.96:0/2870003478 shutdown_connections 2024-04-18T04:54:46.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.971+0000 7fca88215640 1 -- 172.21.15.96:0/2870003478 wait complete. 2024-04-18T04:54:46.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca88215640 1 Processor -- start 2024-04-18T04:54:46.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca88215640 1 -- start start 2024-04-18T04:54:46.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca88215640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca800700e0 0x7fca80148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca88215640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca800707c0 0x7fca80149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca88215640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca80153180 0x7fca80155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca88215640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca801557f0 con 0x7fca800707c0 2024-04-18T04:54:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca88215640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8015c510 con 0x7fca80153180 2024-04-18T04:54:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca88215640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca80154db0 con 0x7fca800700e0 2024-04-18T04:54:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca857b0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca800707c0 0x7fca80149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca857b0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca800707c0 0x7fca80149140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54472/0 (socket says 172.21.15.96:54472) 2024-04-18T04:54:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca857b0640 1 -- 172.21.15.96:0/2494139104 learned_addr learned my addr 172.21.15.96:0/2494139104 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca857b0640 1 -- 172.21.15.96:0/2494139104 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca800700e0 msgr2=0x7fca80148c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca857b0640 1 --2- 172.21.15.96:0/2494139104 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca800700e0 0x7fca80148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca857b0640 1 -- 172.21.15.96:0/2494139104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca80153180 msgr2=0x7fca80155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca857b0640 1 --2- 172.21.15.96:0/2494139104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca80153180 0x7fca80155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca857b0640 1 -- 172.21.15.96:0/2494139104 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c0094d0 con 0x7fca800707c0 2024-04-18T04:54:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca857b0640 1 --2- 172.21.15.96:0/2494139104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca800707c0 0x7fca80149140 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fca7000c480 tx=0x7fca7000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca767fc640 1 -- 172.21.15.96:0/2494139104 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70005480 con 0x7fca800707c0 2024-04-18T04:54:46.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca767fc640 1 -- 172.21.15.96:0/2494139104 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca70003600 con 0x7fca800707c0 2024-04-18T04:54:46.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca88215640 1 -- 172.21.15.96:0/2494139104 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8015c720 con 0x7fca800707c0 2024-04-18T04:54:46.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca767fc640 1 -- 172.21.15.96:0/2494139104 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca700039b0 con 0x7fca800707c0 2024-04-18T04:54:46.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca88215640 1 -- 172.21.15.96:0/2494139104 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca80155410 con 0x7fca800707c0 2024-04-18T04:54:46.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca88215640 1 -- 172.21.15.96:0/2494139104 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca80067050 con 0x7fca800707c0 2024-04-18T04:54:46.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca767fc640 1 -- 172.21.15.96:0/2494139104 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fca70003b10 con 0x7fca800707c0 2024-04-18T04:54:46.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca767fc640 1 --2- 172.21.15.96:0/2494139104 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca640666c0 0x7fca64068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:46.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca85fb1640 1 --2- 172.21.15.96:0/2494139104 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca640666c0 0x7fca64068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:46.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.975+0000 7fca767fc640 1 -- 172.21.15.96:0/2494139104 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca70083ce0 con 0x7fca800707c0 2024-04-18T04:54:46.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.979+0000 7fca85fb1640 1 --2- 172.21.15.96:0/2494139104 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca640666c0 0x7fca64068b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0b2000 tx=0x7fca7c004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:46.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:46.979+0000 7fca767fc640 1 -- 172.21.15.96:0/2494139104 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fca70051050 con 0x7fca800707c0 2024-04-18T04:54:47.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.131+0000 7fca88215640 1 -- 172.21.15.96:0/2494139104 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca801590f0 con 0x7fca640666c0 2024-04-18T04:54:47.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.147+0000 7fca767fc640 1 -- 172.21.15.96:0/2494139104 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264572 (secure 0 0 0) 0x7fca7c0a8910 con 0x7fca640666c0 2024-04-18T04:54:47.150 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:47.155 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T04:54:47.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.151+0000 7fca88215640 1 -- 172.21.15.96:0/2494139104 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca640666c0 msgr2=0x7fca64068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:47.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.151+0000 7fca88215640 1 --2- 172.21.15.96:0/2494139104 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca640666c0 0x7fca64068b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0b2000 tx=0x7fca7c004740 comp rx=0 tx=0).stop 2024-04-18T04:54:47.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.151+0000 7fca88215640 1 -- 172.21.15.96:0/2494139104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca800707c0 msgr2=0x7fca80149140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:47.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.151+0000 7fca88215640 1 --2- 172.21.15.96:0/2494139104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca800707c0 0x7fca80149140 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fca7000c480 tx=0x7fca7000c940 comp rx=0 tx=0).stop 2024-04-18T04:54:47.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.151+0000 7fca88215640 1 -- 172.21.15.96:0/2494139104 shutdown_connections 2024-04-18T04:54:47.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.151+0000 7fca88215640 1 --2- 172.21.15.96:0/2494139104 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca640666c0 0x7fca64068b80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.151+0000 7fca88215640 1 --2- 172.21.15.96:0/2494139104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca80153180 0x7fca80155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.151+0000 7fca88215640 1 --2- 172.21.15.96:0/2494139104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca800707c0 0x7fca80149140 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.151+0000 7fca88215640 1 --2- 172.21.15.96:0/2494139104 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca800700e0 0x7fca80148c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.151+0000 7fca88215640 1 -- 172.21.15.96:0/2494139104 >> 172.21.15.96:0/2494139104 conn(0x7fca8006c750 msgr2=0x7fca80157580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:47.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.151+0000 7fca88215640 1 -- 172.21.15.96:0/2494139104 shutdown_connections 2024-04-18T04:54:47.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.151+0000 7fca88215640 1 -- 172.21.15.96:0/2494139104 wait complete. 2024-04-18T04:54:47.170 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-18T04:54:46.569186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217932,"kb_used_data":1760,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756788,"statfs":{"total":773094113280,"available":772870950912,"internally_reserved":0,"allocated":1802240,"data_stored":1765448,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.795443"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323999+0000","last_change":"2024-04-18T04:54:41.199306+0000","last_active":"2024-04-18T04:54:42.323999+0000","last_peered":"2024-04-18T04:54:42.323999+0000","last_clean":"2024-04-18T04:54:42.323999+0000","last_became_active":"2024-04-18T04:54:41.199046+0000","last_became_peered":"2024-04-18T04:54:41.199046+0000","last_unstale":"2024-04-18T04:54:42.323999+0000","last_undegraded":"2024-04-18T04:54:42.323999+0000","last_fullsized":"2024-04-18T04:54:42.323999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169848+0000","last_change":"2024-04-18T04:54:41.200447+0000","last_active":"2024-04-18T04:54:42.169848+0000","last_peered":"2024-04-18T04:54:42.169848+0000","last_clean":"2024-04-18T04:54:42.169848+0000","last_became_active":"2024-04-18T04:54:41.200136+0000","last_became_peered":"2024-04-18T04:54:41.200136+0000","last_unstale":"2024-04-18T04:54:42.169848+0000","last_undegraded":"2024-04-18T04:54:42.169848+0000","last_fullsized":"2024-04-18T04:54:42.169848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169517+0000","last_change":"2024-04-18T04:54:41.185987+0000","last_active":"2024-04-18T04:54:42.169517+0000","last_peered":"2024-04-18T04:54:42.169517+0000","last_clean":"2024-04-18T04:54:42.169517+0000","last_became_active":"2024-04-18T04:54:41.185206+0000","last_became_peered":"2024-04-18T04:54:41.185206+0000","last_unstale":"2024-04-18T04:54:42.169517+0000","last_undegraded":"2024-04-18T04:54:42.169517+0000","last_fullsized":"2024-04-18T04:54:42.169517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453954+0000","last_change":"2024-04-18T04:54:41.177487+0000","last_active":"2024-04-18T04:54:42.453954+0000","last_peered":"2024-04-18T04:54:42.453954+0000","last_clean":"2024-04-18T04:54:42.453954+0000","last_became_active":"2024-04-18T04:54:41.177217+0000","last_became_peered":"2024-04-18T04:54:41.177217+0000","last_unstale":"2024-04-18T04:54:42.453954+0000","last_undegraded":"2024-04-18T04:54:42.453954+0000","last_fullsized":"2024-04-18T04:54:42.453954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:08.067252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323329+0000","last_change":"2024-04-18T04:54:41.186573+0000","last_active":"2024-04-18T04:54:42.323329+0000","last_peered":"2024-04-18T04:54:42.323329+0000","last_clean":"2024-04-18T04:54:42.323329+0000","last_became_active":"2024-04-18T04:54:41.186027+0000","last_became_peered":"2024-04-18T04:54:41.186027+0000","last_unstale":"2024-04-18T04:54:42.323329+0000","last_undegraded":"2024-04-18T04:54:42.323329+0000","last_fullsized":"2024-04-18T04:54:42.323329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453454+0000","last_change":"2024-04-18T04:54:41.177550+0000","last_active":"2024-04-18T04:54:42.453454+0000","last_peered":"2024-04-18T04:54:42.453454+0000","last_clean":"2024-04-18T04:54:42.453454+0000","last_became_active":"2024-04-18T04:54:41.177215+0000","last_became_peered":"2024-04-18T04:54:41.177215+0000","last_unstale":"2024-04-18T04:54:42.453454+0000","last_undegraded":"2024-04-18T04:54:42.453454+0000","last_fullsized":"2024-04-18T04:54:42.453454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:26.266600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323158+0000","last_change":"2024-04-18T04:54:41.178605+0000","last_active":"2024-04-18T04:54:42.323158+0000","last_peered":"2024-04-18T04:54:42.323158+0000","last_clean":"2024-04-18T04:54:42.323158+0000","last_became_active":"2024-04-18T04:54:41.178094+0000","last_became_peered":"2024-04-18T04:54:41.178094+0000","last_unstale":"2024-04-18T04:54:42.323158+0000","last_undegraded":"2024-04-18T04:54:42.323158+0000","last_fullsized":"2024-04-18T04:54:42.323158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169250+0000","last_change":"2024-04-18T04:54:41.193174+0000","last_active":"2024-04-18T04:54:42.169250+0000","last_peered":"2024-04-18T04:54:42.169250+0000","last_clean":"2024-04-18T04:54:42.169250+0000","last_became_active":"2024-04-18T04:54:41.192678+0000","last_became_peered":"2024-04-18T04:54:41.192678+0000","last_unstale":"2024-04-18T04:54:42.169250+0000","last_undegraded":"2024-04-18T04:54:42.169250+0000","last_fullsized":"2024-04-18T04:54:42.169250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167601+0000","last_change":"2024-04-18T04:54:41.198121+0000","last_active":"2024-04-18T04:54:42.167601+0000","last_peered":"2024-04-18T04:54:42.167601+0000","last_clean":"2024-04-18T04:54:42.167601+0000","last_became_active":"2024-04-18T04:54:41.197832+0000","last_became_peered":"2024-04-18T04:54:41.197832+0000","last_unstale":"2024-04-18T04:54:42.167601+0000","last_undegraded":"2024-04-18T04:54:42.167601+0000","last_fullsized":"2024-04-18T04:54:42.167601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.835581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323925+0000","last_change":"2024-04-18T04:54:41.183032+0000","last_active":"2024-04-18T04:54:42.323925+0000","last_peered":"2024-04-18T04:54:42.323925+0000","last_clean":"2024-04-18T04:54:42.323925+0000","last_became_active":"2024-04-18T04:54:41.182698+0000","last_became_peered":"2024-04-18T04:54:41.182698+0000","last_unstale":"2024-04-18T04:54:42.323925+0000","last_undegraded":"2024-04-18T04:54:42.323925+0000","last_fullsized":"2024-04-18T04:54:42.323925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323788+0000","last_change":"2024-04-18T04:54:41.187831+0000","last_active":"2024-04-18T04:54:42.323788+0000","last_peered":"2024-04-18T04:54:42.323788+0000","last_clean":"2024-04-18T04:54:42.323788+0000","last_became_active":"2024-04-18T04:54:41.187360+0000","last_became_peered":"2024-04-18T04:54:41.187360+0000","last_unstale":"2024-04-18T04:54:42.323788+0000","last_undegraded":"2024-04-18T04:54:42.323788+0000","last_fullsized":"2024-04-18T04:54:42.323788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323367+0000","last_change":"2024-04-18T04:54:41.188641+0000","last_active":"2024-04-18T04:54:42.323367+0000","last_peered":"2024-04-18T04:54:42.323367+0000","last_clean":"2024-04-18T04:54:42.323367+0000","last_became_active":"2024-04-18T04:54:41.188281+0000","last_became_peered":"2024-04-18T04:54:41.188281+0000","last_unstale":"2024-04-18T04:54:42.323367+0000","last_undegraded":"2024-04-18T04:54:42.323367+0000","last_fullsized":"2024-04-18T04:54:42.323367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455946+0000","last_change":"2024-04-18T04:54:41.194578+0000","last_active":"2024-04-18T04:54:42.455946+0000","last_peered":"2024-04-18T04:54:42.455946+0000","last_clean":"2024-04-18T04:54:42.455946+0000","last_became_active":"2024-04-18T04:54:41.190882+0000","last_became_peered":"2024-04-18T04:54:41.190882+0000","last_unstale":"2024-04-18T04:54:42.455946+0000","last_undegraded":"2024-04-18T04:54:42.455946+0000","last_fullsized":"2024-04-18T04:54:42.455946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:45:52.041196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455376+0000","last_change":"2024-04-18T04:54:41.190210+0000","last_active":"2024-04-18T04:54:42.455376+0000","last_peered":"2024-04-18T04:54:42.455376+0000","last_clean":"2024-04-18T04:54:42.455376+0000","last_became_active":"2024-04-18T04:54:41.189813+0000","last_became_peered":"2024-04-18T04:54:41.189813+0000","last_unstale":"2024-04-18T04:54:42.455376+0000","last_undegraded":"2024-04-18T04:54:42.455376+0000","last_fullsized":"2024-04-18T04:54:42.455376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:38:02.632458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169188+0000","last_change":"2024-04-18T04:54:41.183027+0000","last_active":"2024-04-18T04:54:42.169188+0000","last_peered":"2024-04-18T04:54:42.169188+0000","last_clean":"2024-04-18T04:54:42.169188+0000","last_became_active":"2024-04-18T04:54:41.182713+0000","last_became_peered":"2024-04-18T04:54:41.182713+0000","last_unstale":"2024-04-18T04:54:42.169188+0000","last_undegraded":"2024-04-18T04:54:42.169188+0000","last_fullsized":"2024-04-18T04:54:42.169188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453959+0000","last_change":"2024-04-18T04:54:41.186060+0000","last_active":"2024-04-18T04:54:42.453959+0000","last_peered":"2024-04-18T04:54:42.453959+0000","last_clean":"2024-04-18T04:54:42.453959+0000","last_became_active":"2024-04-18T04:54:41.185803+0000","last_became_peered":"2024-04-18T04:54:41.185803+0000","last_unstale":"2024-04-18T04:54:42.453959+0000","last_undegraded":"2024-04-18T04:54:42.453959+0000","last_fullsized":"2024-04-18T04:54:42.453959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:48:04.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455728+0000","last_change":"2024-04-18T04:54:41.200802+0000","last_active":"2024-04-18T04:54:42.455728+0000","last_peered":"2024-04-18T04:54:42.455728+0000","last_clean":"2024-04-18T04:54:42.455728+0000","last_became_active":"2024-04-18T04:54:41.198404+0000","last_became_peered":"2024-04-18T04:54:41.198404+0000","last_unstale":"2024-04-18T04:54:42.455728+0000","last_undegraded":"2024-04-18T04:54:42.455728+0000","last_fullsized":"2024-04-18T04:54:42.455728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:56.686481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454830+0000","last_change":"2024-04-18T04:54:41.189568+0000","last_active":"2024-04-18T04:54:42.454830+0000","last_peered":"2024-04-18T04:54:42.454830+0000","last_clean":"2024-04-18T04:54:42.454830+0000","last_became_active":"2024-04-18T04:54:41.188139+0000","last_became_peered":"2024-04-18T04:54:41.188139+0000","last_unstale":"2024-04-18T04:54:42.454830+0000","last_undegraded":"2024-04-18T04:54:42.454830+0000","last_fullsized":"2024-04-18T04:54:42.454830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455410+0000","last_change":"2024-04-18T04:54:41.197901+0000","last_active":"2024-04-18T04:54:42.455410+0000","last_peered":"2024-04-18T04:54:42.455410+0000","last_clean":"2024-04-18T04:54:42.455410+0000","last_became_active":"2024-04-18T04:54:41.197235+0000","last_became_peered":"2024-04-18T04:54:41.197235+0000","last_unstale":"2024-04-18T04:54:42.455410+0000","last_undegraded":"2024-04-18T04:54:42.455410+0000","last_fullsized":"2024-04-18T04:54:42.455410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:41:20.213202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323339+0000","last_change":"2024-04-18T04:54:41.188440+0000","last_active":"2024-04-18T04:54:42.323339+0000","last_peered":"2024-04-18T04:54:42.323339+0000","last_clean":"2024-04-18T04:54:42.323339+0000","last_became_active":"2024-04-18T04:54:41.187925+0000","last_became_peered":"2024-04-18T04:54:41.187925+0000","last_unstale":"2024-04-18T04:54:42.323339+0000","last_undegraded":"2024-04-18T04:54:42.323339+0000","last_fullsized":"2024-04-18T04:54:42.323339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170212+0000","last_change":"2024-04-18T04:54:41.179672+0000","last_active":"2024-04-18T04:54:42.170212+0000","last_peered":"2024-04-18T04:54:42.170212+0000","last_clean":"2024-04-18T04:54:42.170212+0000","last_became_active":"2024-04-18T04:54:41.178963+0000","last_became_peered":"2024-04-18T04:54:41.178963+0000","last_unstale":"2024-04-18T04:54:42.170212+0000","last_undegraded":"2024-04-18T04:54:42.170212+0000","last_fullsized":"2024-04-18T04:54:42.170212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:56:31.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167152+0000","last_change":"2024-04-18T04:54:41.182902+0000","last_active":"2024-04-18T04:54:42.167152+0000","last_peered":"2024-04-18T04:54:42.167152+0000","last_clean":"2024-04-18T04:54:42.167152+0000","last_became_active":"2024-04-18T04:54:41.182664+0000","last_became_peered":"2024-04-18T04:54:41.182664+0000","last_unstale":"2024-04-18T04:54:42.167152+0000","last_undegraded":"2024-04-18T04:54:42.167152+0000","last_fullsized":"2024-04-18T04:54:42.167152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:56.408926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169624+0000","last_change":"2024-04-18T04:54:41.187578+0000","last_active":"2024-04-18T04:54:42.169624+0000","last_peered":"2024-04-18T04:54:42.169624+0000","last_clean":"2024-04-18T04:54:42.169624+0000","last_became_active":"2024-04-18T04:54:41.186881+0000","last_became_peered":"2024-04-18T04:54:41.186881+0000","last_unstale":"2024-04-18T04:54:42.169624+0000","last_undegraded":"2024-04-18T04:54:42.169624+0000","last_fullsized":"2024-04-18T04:54:42.169624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:27.817916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454216+0000","last_change":"2024-04-18T04:54:41.193206+0000","last_active":"2024-04-18T04:54:42.454216+0000","last_peered":"2024-04-18T04:54:42.454216+0000","last_clean":"2024-04-18T04:54:42.454216+0000","last_became_active":"2024-04-18T04:54:41.192740+0000","last_became_peered":"2024-04-18T04:54:41.192740+0000","last_unstale":"2024-04-18T04:54:42.454216+0000","last_undegraded":"2024-04-18T04:54:42.454216+0000","last_fullsized":"2024-04-18T04:54:42.454216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:51:34.311826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169844+0000","last_change":"2024-04-18T04:54:41.192785+0000","last_active":"2024-04-18T04:54:42.169844+0000","last_peered":"2024-04-18T04:54:42.169844+0000","last_clean":"2024-04-18T04:54:42.169844+0000","last_became_active":"2024-04-18T04:54:41.192280+0000","last_became_peered":"2024-04-18T04:54:41.192280+0000","last_unstale":"2024-04-18T04:54:42.169844+0000","last_undegraded":"2024-04-18T04:54:42.169844+0000","last_fullsized":"2024-04-18T04:54:42.169844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454615+0000","last_change":"2024-04-18T04:54:41.193920+0000","last_active":"2024-04-18T04:54:42.454615+0000","last_peered":"2024-04-18T04:54:42.454615+0000","last_clean":"2024-04-18T04:54:42.454615+0000","last_became_active":"2024-04-18T04:54:41.193660+0000","last_became_peered":"2024-04-18T04:54:41.193660+0000","last_unstale":"2024-04-18T04:54:42.454615+0000","last_undegraded":"2024-04-18T04:54:42.454615+0000","last_fullsized":"2024-04-18T04:54:42.454615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:22.072498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.456447+0000","last_change":"2024-04-18T04:54:41.190298+0000","last_active":"2024-04-18T04:54:42.456447+0000","last_peered":"2024-04-18T04:54:42.456447+0000","last_clean":"2024-04-18T04:54:42.456447+0000","last_became_active":"2024-04-18T04:54:41.189374+0000","last_became_peered":"2024-04-18T04:54:41.189374+0000","last_unstale":"2024-04-18T04:54:42.456447+0000","last_undegraded":"2024-04-18T04:54:42.456447+0000","last_fullsized":"2024-04-18T04:54:42.456447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455999+0000","last_change":"2024-04-18T04:54:41.190403+0000","last_active":"2024-04-18T04:54:42.455999+0000","last_peered":"2024-04-18T04:54:42.455999+0000","last_clean":"2024-04-18T04:54:42.455999+0000","last_became_active":"2024-04-18T04:54:41.189660+0000","last_became_peered":"2024-04-18T04:54:41.189660+0000","last_unstale":"2024-04-18T04:54:42.455999+0000","last_undegraded":"2024-04-18T04:54:42.455999+0000","last_fullsized":"2024-04-18T04:54:42.455999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:34.259279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169947+0000","last_change":"2024-04-18T04:54:41.187370+0000","last_active":"2024-04-18T04:54:42.169947+0000","last_peered":"2024-04-18T04:54:42.169947+0000","last_clean":"2024-04-18T04:54:42.169947+0000","last_became_active":"2024-04-18T04:54:41.186901+0000","last_became_peered":"2024-04-18T04:54:41.186901+0000","last_unstale":"2024-04-18T04:54:42.169947+0000","last_undegraded":"2024-04-18T04:54:42.169947+0000","last_fullsized":"2024-04-18T04:54:42.169947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454539+0000","last_change":"2024-04-18T04:54:41.192719+0000","last_active":"2024-04-18T04:54:42.454539+0000","last_peered":"2024-04-18T04:54:42.454539+0000","last_clean":"2024-04-18T04:54:42.454539+0000","last_became_active":"2024-04-18T04:54:41.192114+0000","last_became_peered":"2024-04-18T04:54:41.192114+0000","last_unstale":"2024-04-18T04:54:42.454539+0000","last_undegraded":"2024-04-18T04:54:42.454539+0000","last_fullsized":"2024-04-18T04:54:42.454539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:33:21.965783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454128+0000","last_change":"2024-04-18T04:54:41.186276+0000","last_active":"2024-04-18T04:54:42.454128+0000","last_peered":"2024-04-18T04:54:42.454128+0000","last_clean":"2024-04-18T04:54:42.454128+0000","last_became_active":"2024-04-18T04:54:41.185915+0000","last_became_peered":"2024-04-18T04:54:41.185915+0000","last_unstale":"2024-04-18T04:54:42.454128+0000","last_undegraded":"2024-04-18T04:54:42.454128+0000","last_fullsized":"2024-04-18T04:54:42.454128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453190+0000","last_change":"2024-04-18T04:54:41.190283+0000","last_active":"2024-04-18T04:54:42.453190+0000","last_peered":"2024-04-18T04:54:42.453190+0000","last_clean":"2024-04-18T04:54:42.453190+0000","last_became_active":"2024-04-18T04:54:41.189892+0000","last_became_peered":"2024-04-18T04:54:41.189892+0000","last_unstale":"2024-04-18T04:54:42.453190+0000","last_undegraded":"2024-04-18T04:54:42.453190+0000","last_fullsized":"2024-04-18T04:54:42.453190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:53.175178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167307+0000","last_change":"2024-04-18T04:54:41.187326+0000","last_active":"2024-04-18T04:54:42.167307+0000","last_peered":"2024-04-18T04:54:42.167307+0000","last_clean":"2024-04-18T04:54:42.167307+0000","last_became_active":"2024-04-18T04:54:41.187001+0000","last_became_peered":"2024-04-18T04:54:41.187001+0000","last_unstale":"2024-04-18T04:54:42.167307+0000","last_undegraded":"2024-04-18T04:54:42.167307+0000","last_fullsized":"2024-04-18T04:54:42.167307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.178455+0000","last_change":"2024-04-18T04:54:40.824658+0000","last_active":"2024-04-18T04:54:41.178455+0000","last_peered":"2024-04-18T04:54:41.178455+0000","last_clean":"2024-04-18T04:54:41.178455+0000","last_became_active":"2024-04-18T04:54:40.823652+0000","last_became_peered":"2024-04-18T04:54:40.823652+0000","last_unstale":"2024-04-18T04:54:41.178455+0000","last_undegraded":"2024-04-18T04:54:41.178455+0000","last_fullsized":"2024-04-18T04:54:41.178455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170634+0000","last_change":"2024-04-18T04:54:41.184497+0000","last_active":"2024-04-18T04:54:42.170634+0000","last_peered":"2024-04-18T04:54:42.170634+0000","last_clean":"2024-04-18T04:54:42.170634+0000","last_became_active":"2024-04-18T04:54:41.182180+0000","last_became_peered":"2024-04-18T04:54:41.182180+0000","last_unstale":"2024-04-18T04:54:42.170634+0000","last_undegraded":"2024-04-18T04:54:42.170634+0000","last_fullsized":"2024-04-18T04:54:42.170634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:25:15.707596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.179171+0000","last_change":"2024-04-18T04:54:40.803244+0000","last_active":"2024-04-18T04:54:41.179171+0000","last_peered":"2024-04-18T04:54:41.179171+0000","last_clean":"2024-04-18T04:54:41.179171+0000","last_became_active":"2024-04-18T04:54:40.802672+0000","last_became_peered":"2024-04-18T04:54:40.802672+0000","last_unstale":"2024-04-18T04:54:41.179171+0000","last_undegraded":"2024-04-18T04:54:41.179171+0000","last_fullsized":"2024-04-18T04:54:41.179171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:56.851301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.171919+0000","last_change":"2024-04-18T04:54:40.823675+0000","last_active":"2024-04-18T04:54:41.171919+0000","last_peered":"2024-04-18T04:54:41.171919+0000","last_clean":"2024-04-18T04:54:41.171919+0000","last_became_active":"2024-04-18T04:54:40.823091+0000","last_became_peered":"2024-04-18T04:54:40.823091+0000","last_unstale":"2024-04-18T04:54:41.171919+0000","last_undegraded":"2024-04-18T04:54:41.171919+0000","last_fullsized":"2024-04-18T04:54:41.171919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169532+0000","last_change":"2024-04-18T04:54:41.200326+0000","last_active":"2024-04-18T04:54:42.169532+0000","last_peered":"2024-04-18T04:54:42.169532+0000","last_clean":"2024-04-18T04:54:42.169532+0000","last_became_active":"2024-04-18T04:54:41.199690+0000","last_became_peered":"2024-04-18T04:54:41.199690+0000","last_unstale":"2024-04-18T04:54:42.169532+0000","last_undegraded":"2024-04-18T04:54:42.169532+0000","last_fullsized":"2024-04-18T04:54:42.169532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.185487+0000","last_change":"2024-04-18T04:54:40.805264+0000","last_active":"2024-04-18T04:54:41.185487+0000","last_peered":"2024-04-18T04:54:41.185487+0000","last_clean":"2024-04-18T04:54:41.185487+0000","last_became_active":"2024-04-18T04:54:40.804605+0000","last_became_peered":"2024-04-18T04:54:40.804605+0000","last_unstale":"2024-04-18T04:54:41.185487+0000","last_undegraded":"2024-04-18T04:54:41.185487+0000","last_fullsized":"2024-04-18T04:54:41.185487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:48.991270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.171188+0000","last_change":"2024-04-18T04:54:41.175359+0000","last_active":"2024-04-18T04:54:42.171188+0000","last_peered":"2024-04-18T04:54:42.171188+0000","last_clean":"2024-04-18T04:54:42.171188+0000","last_became_active":"2024-04-18T04:54:41.175137+0000","last_became_peered":"2024-04-18T04:54:41.175137+0000","last_unstale":"2024-04-18T04:54:42.171188+0000","last_undegraded":"2024-04-18T04:54:42.171188+0000","last_fullsized":"2024-04-18T04:54:42.171188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:06:24.271204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.164938+0000","last_change":"2024-04-18T04:54:40.798936+0000","last_active":"2024-04-18T04:54:41.164938+0000","last_peered":"2024-04-18T04:54:41.164938+0000","last_clean":"2024-04-18T04:54:41.164938+0000","last_became_active":"2024-04-18T04:54:40.798572+0000","last_became_peered":"2024-04-18T04:54:40.798572+0000","last_unstale":"2024-04-18T04:54:41.164938+0000","last_undegraded":"2024-04-18T04:54:41.164938+0000","last_fullsized":"2024-04-18T04:54:41.164938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454742+0000","last_change":"2024-04-18T04:54:41.188280+0000","last_active":"2024-04-18T04:54:42.454742+0000","last_peered":"2024-04-18T04:54:42.454742+0000","last_clean":"2024-04-18T04:54:42.454742+0000","last_became_active":"2024-04-18T04:54:41.188012+0000","last_became_peered":"2024-04-18T04:54:41.188012+0000","last_unstale":"2024-04-18T04:54:42.454742+0000","last_undegraded":"2024-04-18T04:54:42.454742+0000","last_fullsized":"2024-04-18T04:54:42.454742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:11.319118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.174130+0000","last_change":"2024-04-18T04:54:40.802894+0000","last_active":"2024-04-18T04:54:41.174130+0000","last_peered":"2024-04-18T04:54:41.174130+0000","last_clean":"2024-04-18T04:54:41.174130+0000","last_became_active":"2024-04-18T04:54:40.801406+0000","last_became_peered":"2024-04-18T04:54:40.801406+0000","last_unstale":"2024-04-18T04:54:41.174130+0000","last_undegraded":"2024-04-18T04:54:41.174130+0000","last_fullsized":"2024-04-18T04:54:41.174130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170319+0000","last_change":"2024-04-18T04:54:41.203407+0000","last_active":"2024-04-18T04:54:42.170319+0000","last_peered":"2024-04-18T04:54:42.170319+0000","last_clean":"2024-04-18T04:54:42.170319+0000","last_became_active":"2024-04-18T04:54:41.203186+0000","last_became_peered":"2024-04-18T04:54:41.203186+0000","last_unstale":"2024-04-18T04:54:42.170319+0000","last_undegraded":"2024-04-18T04:54:42.170319+0000","last_fullsized":"2024-04-18T04:54:42.170319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:23:50.107054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.183760+0000","last_change":"2024-04-18T04:54:40.822014+0000","last_active":"2024-04-18T04:54:41.183760+0000","last_peered":"2024-04-18T04:54:41.183760+0000","last_clean":"2024-04-18T04:54:41.183760+0000","last_became_active":"2024-04-18T04:54:40.820920+0000","last_became_peered":"2024-04-18T04:54:40.820920+0000","last_unstale":"2024-04-18T04:54:41.183760+0000","last_undegraded":"2024-04-18T04:54:41.183760+0000","last_fullsized":"2024-04-18T04:54:41.183760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455233+0000","last_change":"2024-04-18T04:54:41.197254+0000","last_active":"2024-04-18T04:54:42.455233+0000","last_peered":"2024-04-18T04:54:42.455233+0000","last_clean":"2024-04-18T04:54:42.455233+0000","last_became_active":"2024-04-18T04:54:41.196927+0000","last_became_peered":"2024-04-18T04:54:41.196927+0000","last_unstale":"2024-04-18T04:54:42.455233+0000","last_undegraded":"2024-04-18T04:54:42.455233+0000","last_fullsized":"2024-04-18T04:54:42.455233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:01:45.182766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454178+0000","last_change":"2024-04-18T04:54:40.801789+0000","last_active":"2024-04-18T04:54:42.454178+0000","last_peered":"2024-04-18T04:54:42.454178+0000","last_clean":"2024-04-18T04:54:42.454178+0000","last_became_active":"2024-04-18T04:54:40.801403+0000","last_became_peered":"2024-04-18T04:54:40.801403+0000","last_unstale":"2024-04-18T04:54:42.454178+0000","last_undegraded":"2024-04-18T04:54:42.454178+0000","last_fullsized":"2024-04-18T04:54:42.454178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:15:11.220095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323817+0000","last_change":"2024-04-18T04:54:41.195518+0000","last_active":"2024-04-18T04:54:42.323817+0000","last_peered":"2024-04-18T04:54:42.323817+0000","last_clean":"2024-04-18T04:54:42.323817+0000","last_became_active":"2024-04-18T04:54:41.195172+0000","last_became_peered":"2024-04-18T04:54:41.195172+0000","last_unstale":"2024-04-18T04:54:42.323817+0000","last_undegraded":"2024-04-18T04:54:42.323817+0000","last_fullsized":"2024-04-18T04:54:42.323817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.184139+0000","last_change":"2024-04-18T04:54:40.818390+0000","last_active":"2024-04-18T04:54:41.184139+0000","last_peered":"2024-04-18T04:54:41.184139+0000","last_clean":"2024-04-18T04:54:41.184139+0000","last_became_active":"2024-04-18T04:54:40.817681+0000","last_became_peered":"2024-04-18T04:54:40.817681+0000","last_unstale":"2024-04-18T04:54:41.184139+0000","last_undegraded":"2024-04-18T04:54:41.184139+0000","last_fullsized":"2024-04-18T04:54:41.184139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455448+0000","last_change":"2024-04-18T04:54:41.194807+0000","last_active":"2024-04-18T04:54:42.455448+0000","last_peered":"2024-04-18T04:54:42.455448+0000","last_clean":"2024-04-18T04:54:42.455448+0000","last_became_active":"2024-04-18T04:54:41.194499+0000","last_became_peered":"2024-04-18T04:54:41.194499+0000","last_unstale":"2024-04-18T04:54:42.455448+0000","last_undegraded":"2024-04-18T04:54:42.455448+0000","last_fullsized":"2024-04-18T04:54:42.455448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.179340+0000","last_change":"2024-04-18T04:54:40.817631+0000","last_active":"2024-04-18T04:54:41.179340+0000","last_peered":"2024-04-18T04:54:41.179340+0000","last_clean":"2024-04-18T04:54:41.179340+0000","last_became_active":"2024-04-18T04:54:40.817370+0000","last_became_peered":"2024-04-18T04:54:40.817370+0000","last_unstale":"2024-04-18T04:54:41.179340+0000","last_undegraded":"2024-04-18T04:54:41.179340+0000","last_fullsized":"2024-04-18T04:54:41.179340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454210+0000","last_change":"2024-04-18T04:54:41.193363+0000","last_active":"2024-04-18T04:54:42.454210+0000","last_peered":"2024-04-18T04:54:42.454210+0000","last_clean":"2024-04-18T04:54:42.454210+0000","last_became_active":"2024-04-18T04:54:41.192889+0000","last_became_peered":"2024-04-18T04:54:41.192889+0000","last_unstale":"2024-04-18T04:54:42.454210+0000","last_undegraded":"2024-04-18T04:54:42.454210+0000","last_fullsized":"2024-04-18T04:54:42.454210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.173292+0000","last_change":"2024-04-18T04:54:40.806633+0000","last_active":"2024-04-18T04:54:41.173292+0000","last_peered":"2024-04-18T04:54:41.173292+0000","last_clean":"2024-04-18T04:54:41.173292+0000","last_became_active":"2024-04-18T04:54:40.805965+0000","last_became_peered":"2024-04-18T04:54:40.805965+0000","last_unstale":"2024-04-18T04:54:41.173292+0000","last_undegraded":"2024-04-18T04:54:41.173292+0000","last_fullsized":"2024-04-18T04:54:41.173292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167013+0000","last_change":"2024-04-18T04:54:41.184321+0000","last_active":"2024-04-18T04:54:42.167013+0000","last_peered":"2024-04-18T04:54:42.167013+0000","last_clean":"2024-04-18T04:54:42.167013+0000","last_became_active":"2024-04-18T04:54:41.183838+0000","last_became_peered":"2024-04-18T04:54:41.183838+0000","last_unstale":"2024-04-18T04:54:42.167013+0000","last_undegraded":"2024-04-18T04:54:42.167013+0000","last_fullsized":"2024-04-18T04:54:42.167013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170348+0000","last_change":"2024-04-18T04:54:40.818954+0000","last_active":"2024-04-18T04:54:42.170348+0000","last_peered":"2024-04-18T04:54:42.170348+0000","last_clean":"2024-04-18T04:54:42.170348+0000","last_became_active":"2024-04-18T04:54:40.818227+0000","last_became_peered":"2024-04-18T04:54:40.818227+0000","last_unstale":"2024-04-18T04:54:42.170348+0000","last_undegraded":"2024-04-18T04:54:42.170348+0000","last_fullsized":"2024-04-18T04:54:42.170348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:25.263089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454553+0000","last_change":"2024-04-18T04:54:41.192227+0000","last_active":"2024-04-18T04:54:42.454553+0000","last_peered":"2024-04-18T04:54:42.454553+0000","last_clean":"2024-04-18T04:54:42.454553+0000","last_became_active":"2024-04-18T04:54:41.187002+0000","last_became_peered":"2024-04-18T04:54:41.187002+0000","last_unstale":"2024-04-18T04:54:42.454553+0000","last_undegraded":"2024-04-18T04:54:42.454553+0000","last_fullsized":"2024-04-18T04:54:42.454553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.175190+0000","last_change":"2024-04-18T04:54:40.805795+0000","last_active":"2024-04-18T04:54:41.175190+0000","last_peered":"2024-04-18T04:54:41.175190+0000","last_clean":"2024-04-18T04:54:41.175190+0000","last_became_active":"2024-04-18T04:54:40.802550+0000","last_became_peered":"2024-04-18T04:54:40.802550+0000","last_unstale":"2024-04-18T04:54:41.175190+0000","last_undegraded":"2024-04-18T04:54:41.175190+0000","last_fullsized":"2024-04-18T04:54:41.175190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454849+0000","last_change":"2024-04-18T04:54:41.180426+0000","last_active":"2024-04-18T04:54:42.454849+0000","last_peered":"2024-04-18T04:54:42.454849+0000","last_clean":"2024-04-18T04:54:42.454849+0000","last_became_active":"2024-04-18T04:54:41.179540+0000","last_became_peered":"2024-04-18T04:54:41.179540+0000","last_unstale":"2024-04-18T04:54:42.454849+0000","last_undegraded":"2024-04-18T04:54:42.454849+0000","last_fullsized":"2024-04-18T04:54:42.454849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:38:25.074053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.171008+0000","last_change":"2024-04-18T04:54:40.804284+0000","last_active":"2024-04-18T04:54:42.171008+0000","last_peered":"2024-04-18T04:54:42.171008+0000","last_clean":"2024-04-18T04:54:42.171008+0000","last_became_active":"2024-04-18T04:54:40.803464+0000","last_became_peered":"2024-04-18T04:54:40.803464+0000","last_unstale":"2024-04-18T04:54:42.171008+0000","last_undegraded":"2024-04-18T04:54:42.171008+0000","last_fullsized":"2024-04-18T04:54:42.171008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:52.171667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.324196+0000","last_change":"2024-04-18T04:54:41.188591+0000","last_active":"2024-04-18T04:54:42.324196+0000","last_peered":"2024-04-18T04:54:42.324196+0000","last_clean":"2024-04-18T04:54:42.324196+0000","last_became_active":"2024-04-18T04:54:41.188152+0000","last_became_peered":"2024-04-18T04:54:41.188152+0000","last_unstale":"2024-04-18T04:54:42.324196+0000","last_undegraded":"2024-04-18T04:54:42.324196+0000","last_fullsized":"2024-04-18T04:54:42.324196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.179595+0000","last_change":"2024-04-18T04:54:40.814901+0000","last_active":"2024-04-18T04:54:41.179595+0000","last_peered":"2024-04-18T04:54:41.179595+0000","last_clean":"2024-04-18T04:54:41.179595+0000","last_became_active":"2024-04-18T04:54:40.814207+0000","last_became_peered":"2024-04-18T04:54:40.814207+0000","last_unstale":"2024-04-18T04:54:41.179595+0000","last_undegraded":"2024-04-18T04:54:41.179595+0000","last_fullsized":"2024-04-18T04:54:41.179595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323473+0000","last_change":"2024-04-18T04:54:41.188664+0000","last_active":"2024-04-18T04:54:42.323473+0000","last_peered":"2024-04-18T04:54:42.323473+0000","last_clean":"2024-04-18T04:54:42.323473+0000","last_became_active":"2024-04-18T04:54:41.188249+0000","last_became_peered":"2024-04-18T04:54:41.188249+0000","last_unstale":"2024-04-18T04:54:42.323473+0000","last_undegraded":"2024-04-18T04:54:42.323473+0000","last_fullsized":"2024-04-18T04:54:42.323473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.173221+0000","last_change":"2024-04-18T04:54:40.828447+0000","last_active":"2024-04-18T04:54:41.173221+0000","last_peered":"2024-04-18T04:54:41.173221+0000","last_clean":"2024-04-18T04:54:41.173221+0000","last_became_active":"2024-04-18T04:54:40.823755+0000","last_became_peered":"2024-04-18T04:54:40.823755+0000","last_unstale":"2024-04-18T04:54:41.173221+0000","last_undegraded":"2024-04-18T04:54:41.173221+0000","last_fullsized":"2024-04-18T04:54:41.173221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455365+0000","last_change":"2024-04-18T04:54:41.186523+0000","last_active":"2024-04-18T04:54:42.455365+0000","last_peered":"2024-04-18T04:54:42.455365+0000","last_clean":"2024-04-18T04:54:42.455365+0000","last_became_active":"2024-04-18T04:54:41.186149+0000","last_became_peered":"2024-04-18T04:54:41.186149+0000","last_unstale":"2024-04-18T04:54:42.455365+0000","last_undegraded":"2024-04-18T04:54:42.455365+0000","last_fullsized":"2024-04-18T04:54:42.455365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.164056+0000","last_change":"2024-04-18T04:54:35.674328+0000","last_active":"2024-04-18T04:54:41.164056+0000","last_peered":"2024-04-18T04:54:41.164056+0000","last_clean":"2024-04-18T04:54:41.164056+0000","last_became_active":"2024-04-18T04:54:35.672457+0000","last_became_peered":"2024-04-18T04:54:35.672457+0000","last_unstale":"2024-04-18T04:54:41.164056+0000","last_undegraded":"2024-04-18T04:54:41.164056+0000","last_fullsized":"2024-04-18T04:54:41.164056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_clean_scrub_stamp":"2024-04-18T04:54:33.597974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:02:10.966568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.178915+0000","last_change":"2024-04-18T04:54:40.802422+0000","last_active":"2024-04-18T04:54:41.178915+0000","last_peered":"2024-04-18T04:54:41.178915+0000","last_clean":"2024-04-18T04:54:41.178915+0000","last_became_active":"2024-04-18T04:54:40.801083+0000","last_became_peered":"2024-04-18T04:54:40.801083+0000","last_unstale":"2024-04-18T04:54:41.178915+0000","last_undegraded":"2024-04-18T04:54:41.178915+0000","last_fullsized":"2024-04-18T04:54:41.178915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170437+0000","last_change":"2024-04-18T04:54:41.174658+0000","last_active":"2024-04-18T04:54:42.170437+0000","last_peered":"2024-04-18T04:54:42.170437+0000","last_clean":"2024-04-18T04:54:42.170437+0000","last_became_active":"2024-04-18T04:54:41.174391+0000","last_became_peered":"2024-04-18T04:54:41.174391+0000","last_unstale":"2024-04-18T04:54:42.170437+0000","last_undegraded":"2024-04-18T04:54:42.170437+0000","last_fullsized":"2024-04-18T04:54:42.170437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:28:24.015964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.185583+0000","last_change":"2024-04-18T04:54:40.813770+0000","last_active":"2024-04-18T04:54:41.185583+0000","last_peered":"2024-04-18T04:54:41.185583+0000","last_clean":"2024-04-18T04:54:41.185583+0000","last_became_active":"2024-04-18T04:54:40.813396+0000","last_became_peered":"2024-04-18T04:54:40.813396+0000","last_unstale":"2024-04-18T04:54:41.185583+0000","last_undegraded":"2024-04-18T04:54:41.185583+0000","last_fullsized":"2024-04-18T04:54:41.185583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455360+0000","last_change":"2024-04-18T04:54:41.195440+0000","last_active":"2024-04-18T04:54:42.455360+0000","last_peered":"2024-04-18T04:54:42.455360+0000","last_clean":"2024-04-18T04:54:42.455360+0000","last_became_active":"2024-04-18T04:54:41.195152+0000","last_became_peered":"2024-04-18T04:54:41.195152+0000","last_unstale":"2024-04-18T04:54:42.455360+0000","last_undegraded":"2024-04-18T04:54:42.455360+0000","last_fullsized":"2024-04-18T04:54:42.455360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.178775+0000","last_change":"2024-04-18T04:54:40.818806+0000","last_active":"2024-04-18T04:54:41.178775+0000","last_peered":"2024-04-18T04:54:41.178775+0000","last_clean":"2024-04-18T04:54:41.178775+0000","last_became_active":"2024-04-18T04:54:40.818113+0000","last_became_peered":"2024-04-18T04:54:40.818113+0000","last_unstale":"2024-04-18T04:54:41.178775+0000","last_undegraded":"2024-04-18T04:54:41.178775+0000","last_fullsized":"2024-04-18T04:54:41.178775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169410+0000","last_change":"2024-04-18T04:54:41.192576+0000","last_active":"2024-04-18T04:54:42.169410+0000","last_peered":"2024-04-18T04:54:42.169410+0000","last_clean":"2024-04-18T04:54:42.169410+0000","last_became_active":"2024-04-18T04:54:41.192187+0000","last_became_peered":"2024-04-18T04:54:41.192187+0000","last_unstale":"2024-04-18T04:54:42.169410+0000","last_undegraded":"2024-04-18T04:54:42.169410+0000","last_fullsized":"2024-04-18T04:54:42.169410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.179509+0000","last_change":"2024-04-18T04:54:40.820531+0000","last_active":"2024-04-18T04:54:41.179509+0000","last_peered":"2024-04-18T04:54:41.179509+0000","last_clean":"2024-04-18T04:54:41.179509+0000","last_became_active":"2024-04-18T04:54:40.820025+0000","last_became_peered":"2024-04-18T04:54:40.820025+0000","last_unstale":"2024-04-18T04:54:41.179509+0000","last_undegraded":"2024-04-18T04:54:41.179509+0000","last_fullsized":"2024-04-18T04:54:41.179509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:35.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323461+0000","last_change":"2024-04-18T04:54:41.186361+0000","last_active":"2024-04-18T04:54:42.323461+0000","last_peered":"2024-04-18T04:54:42.323461+0000","last_clean":"2024-04-18T04:54:42.323461+0000","last_became_active":"2024-04-18T04:54:41.185257+0000","last_became_peered":"2024-04-18T04:54:41.185257+0000","last_unstale":"2024-04-18T04:54:42.323461+0000","last_undegraded":"2024-04-18T04:54:42.323461+0000","last_fullsized":"2024-04-18T04:54:42.323461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.179191+0000","last_change":"2024-04-18T04:54:40.824668+0000","last_active":"2024-04-18T04:54:41.179191+0000","last_peered":"2024-04-18T04:54:41.179191+0000","last_clean":"2024-04-18T04:54:41.179191+0000","last_became_active":"2024-04-18T04:54:40.824206+0000","last_became_peered":"2024-04-18T04:54:40.824206+0000","last_unstale":"2024-04-18T04:54:41.179191+0000","last_undegraded":"2024-04-18T04:54:41.179191+0000","last_fullsized":"2024-04-18T04:54:41.179191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453990+0000","last_change":"2024-04-18T04:54:41.195487+0000","last_active":"2024-04-18T04:54:42.453990+0000","last_peered":"2024-04-18T04:54:42.453990+0000","last_clean":"2024-04-18T04:54:42.453990+0000","last_became_active":"2024-04-18T04:54:41.195177+0000","last_became_peered":"2024-04-18T04:54:41.195177+0000","last_unstale":"2024-04-18T04:54:42.453990+0000","last_undegraded":"2024-04-18T04:54:42.453990+0000","last_fullsized":"2024-04-18T04:54:42.453990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:25.853413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.185102+0000","last_change":"2024-04-18T04:54:40.803387+0000","last_active":"2024-04-18T04:54:41.185102+0000","last_peered":"2024-04-18T04:54:41.185102+0000","last_clean":"2024-04-18T04:54:41.185102+0000","last_became_active":"2024-04-18T04:54:40.802902+0000","last_became_peered":"2024-04-18T04:54:40.802902+0000","last_unstale":"2024-04-18T04:54:41.185102+0000","last_undegraded":"2024-04-18T04:54:41.185102+0000","last_fullsized":"2024-04-18T04:54:41.185102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.456062+0000","last_change":"2024-04-18T04:54:41.195382+0000","last_active":"2024-04-18T04:54:42.456062+0000","last_peered":"2024-04-18T04:54:42.456062+0000","last_clean":"2024-04-18T04:54:42.456062+0000","last_became_active":"2024-04-18T04:54:41.194965+0000","last_became_peered":"2024-04-18T04:54:41.194965+0000","last_unstale":"2024-04-18T04:54:42.456062+0000","last_undegraded":"2024-04-18T04:54:42.456062+0000","last_fullsized":"2024-04-18T04:54:42.456062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:39:50.932794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.171218+0000","last_change":"2024-04-18T04:54:40.800651+0000","last_active":"2024-04-18T04:54:42.171218+0000","last_peered":"2024-04-18T04:54:42.171218+0000","last_clean":"2024-04-18T04:54:42.171218+0000","last_became_active":"2024-04-18T04:54:40.798574+0000","last_became_peered":"2024-04-18T04:54:40.798574+0000","last_unstale":"2024-04-18T04:54:42.171218+0000","last_undegraded":"2024-04-18T04:54:42.171218+0000","last_fullsized":"2024-04-18T04:54:42.171218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:55.712985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170747+0000","last_change":"2024-04-18T04:54:41.191679+0000","last_active":"2024-04-18T04:54:42.170747+0000","last_peered":"2024-04-18T04:54:42.170747+0000","last_clean":"2024-04-18T04:54:42.170747+0000","last_became_active":"2024-04-18T04:54:41.191124+0000","last_became_peered":"2024-04-18T04:54:41.191124+0000","last_unstale":"2024-04-18T04:54:42.170747+0000","last_undegraded":"2024-04-18T04:54:42.170747+0000","last_fullsized":"2024-04-18T04:54:42.170747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.296860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.196985+0000","last_change":"2024-04-18T04:54:40.804085+0000","last_active":"2024-04-18T04:54:41.196985+0000","last_peered":"2024-04-18T04:54:41.196985+0000","last_clean":"2024-04-18T04:54:41.196985+0000","last_became_active":"2024-04-18T04:54:40.803616+0000","last_became_peered":"2024-04-18T04:54:40.803616+0000","last_unstale":"2024-04-18T04:54:41.196985+0000","last_undegraded":"2024-04-18T04:54:41.196985+0000","last_fullsized":"2024-04-18T04:54:41.196985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:55.405415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170788+0000","last_change":"2024-04-18T04:54:41.185453+0000","last_active":"2024-04-18T04:54:42.170788+0000","last_peered":"2024-04-18T04:54:42.170788+0000","last_clean":"2024-04-18T04:54:42.170788+0000","last_became_active":"2024-04-18T04:54:41.185217+0000","last_became_peered":"2024-04-18T04:54:41.185217+0000","last_unstale":"2024-04-18T04:54:42.170788+0000","last_undegraded":"2024-04-18T04:54:42.170788+0000","last_fullsized":"2024-04-18T04:54:42.170788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:44:42.484978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.173081+0000","last_change":"2024-04-18T04:54:40.801317+0000","last_active":"2024-04-18T04:54:41.173081+0000","last_peered":"2024-04-18T04:54:41.173081+0000","last_clean":"2024-04-18T04:54:41.173081+0000","last_became_active":"2024-04-18T04:54:40.800598+0000","last_became_peered":"2024-04-18T04:54:40.800598+0000","last_unstale":"2024-04-18T04:54:41.173081+0000","last_undegraded":"2024-04-18T04:54:41.173081+0000","last_fullsized":"2024-04-18T04:54:41.173081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454296+0000","last_change":"2024-04-18T04:54:41.197813+0000","last_active":"2024-04-18T04:54:42.454296+0000","last_peered":"2024-04-18T04:54:42.454296+0000","last_clean":"2024-04-18T04:54:42.454296+0000","last_became_active":"2024-04-18T04:54:41.197201+0000","last_became_peered":"2024-04-18T04:54:41.197201+0000","last_unstale":"2024-04-18T04:54:42.454296+0000","last_undegraded":"2024-04-18T04:54:42.454296+0000","last_fullsized":"2024-04-18T04:54:42.454296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.171356+0000","last_change":"2024-04-18T04:54:40.800416+0000","last_active":"2024-04-18T04:54:42.171356+0000","last_peered":"2024-04-18T04:54:42.171356+0000","last_clean":"2024-04-18T04:54:42.171356+0000","last_became_active":"2024-04-18T04:54:40.797471+0000","last_became_peered":"2024-04-18T04:54:40.797471+0000","last_unstale":"2024-04-18T04:54:42.171356+0000","last_undegraded":"2024-04-18T04:54:42.171356+0000","last_fullsized":"2024-04-18T04:54:42.171356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:33.118670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170092+0000","last_change":"2024-04-18T04:54:41.192024+0000","last_active":"2024-04-18T04:54:42.170092+0000","last_peered":"2024-04-18T04:54:42.170092+0000","last_clean":"2024-04-18T04:54:42.170092+0000","last_became_active":"2024-04-18T04:54:41.191488+0000","last_became_peered":"2024-04-18T04:54:41.191488+0000","last_unstale":"2024-04-18T04:54:42.170092+0000","last_undegraded":"2024-04-18T04:54:42.170092+0000","last_fullsized":"2024-04-18T04:54:42.170092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:39:31.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.172821+0000","last_change":"2024-04-18T04:54:40.823863+0000","last_active":"2024-04-18T04:54:41.172821+0000","last_peered":"2024-04-18T04:54:41.172821+0000","last_clean":"2024-04-18T04:54:41.172821+0000","last_became_active":"2024-04-18T04:54:40.823277+0000","last_became_peered":"2024-04-18T04:54:40.823277+0000","last_unstale":"2024-04-18T04:54:41.172821+0000","last_undegraded":"2024-04-18T04:54:41.172821+0000","last_fullsized":"2024-04-18T04:54:41.172821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454635+0000","last_change":"2024-04-18T04:54:41.199981+0000","last_active":"2024-04-18T04:54:42.454635+0000","last_peered":"2024-04-18T04:54:42.454635+0000","last_clean":"2024-04-18T04:54:42.454635+0000","last_became_active":"2024-04-18T04:54:41.199700+0000","last_became_peered":"2024-04-18T04:54:41.199700+0000","last_unstale":"2024-04-18T04:54:42.454635+0000","last_undegraded":"2024-04-18T04:54:42.454635+0000","last_fullsized":"2024-04-18T04:54:42.454635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.178744+0000","last_change":"2024-04-18T04:54:40.800740+0000","last_active":"2024-04-18T04:54:41.178744+0000","last_peered":"2024-04-18T04:54:41.178744+0000","last_clean":"2024-04-18T04:54:41.178744+0000","last_became_active":"2024-04-18T04:54:40.800405+0000","last_became_peered":"2024-04-18T04:54:40.800405+0000","last_unstale":"2024-04-18T04:54:41.178744+0000","last_undegraded":"2024-04-18T04:54:41.178744+0000","last_fullsized":"2024-04-18T04:54:41.178744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454668+0000","last_change":"2024-04-18T04:54:41.192487+0000","last_active":"2024-04-18T04:54:42.454668+0000","last_peered":"2024-04-18T04:54:42.454668+0000","last_clean":"2024-04-18T04:54:42.454668+0000","last_became_active":"2024-04-18T04:54:41.186301+0000","last_became_peered":"2024-04-18T04:54:41.186301+0000","last_unstale":"2024-04-18T04:54:42.454668+0000","last_undegraded":"2024-04-18T04:54:42.454668+0000","last_fullsized":"2024-04-18T04:54:42.454668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455262+0000","last_change":"2024-04-18T04:54:41.193260+0000","last_active":"2024-04-18T04:54:42.455262+0000","last_peered":"2024-04-18T04:54:42.455262+0000","last_clean":"2024-04-18T04:54:42.455262+0000","last_became_active":"2024-04-18T04:54:41.192941+0000","last_became_peered":"2024-04-18T04:54:41.192941+0000","last_unstale":"2024-04-18T04:54:42.455262+0000","last_undegraded":"2024-04-18T04:54:42.455262+0000","last_fullsized":"2024-04-18T04:54:42.455262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.174110+0000","last_change":"2024-04-18T04:54:40.800162+0000","last_active":"2024-04-18T04:54:41.174110+0000","last_peered":"2024-04-18T04:54:41.174110+0000","last_clean":"2024-04-18T04:54:41.174110+0000","last_became_active":"2024-04-18T04:54:40.799517+0000","last_became_peered":"2024-04-18T04:54:40.799517+0000","last_unstale":"2024-04-18T04:54:41.174110+0000","last_undegraded":"2024-04-18T04:54:41.174110+0000","last_fullsized":"2024-04-18T04:54:41.174110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167393+0000","last_change":"2024-04-18T04:54:41.179695+0000","last_active":"2024-04-18T04:54:42.167393+0000","last_peered":"2024-04-18T04:54:42.167393+0000","last_clean":"2024-04-18T04:54:42.167393+0000","last_became_active":"2024-04-18T04:54:41.179359+0000","last_became_peered":"2024-04-18T04:54:41.179359+0000","last_unstale":"2024-04-18T04:54:42.167393+0000","last_undegraded":"2024-04-18T04:54:42.167393+0000","last_fullsized":"2024-04-18T04:54:42.167393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.174292+0000","last_change":"2024-04-18T04:54:40.801178+0000","last_active":"2024-04-18T04:54:41.174292+0000","last_peered":"2024-04-18T04:54:41.174292+0000","last_clean":"2024-04-18T04:54:41.174292+0000","last_became_active":"2024-04-18T04:54:40.800660+0000","last_became_peered":"2024-04-18T04:54:40.800660+0000","last_unstale":"2024-04-18T04:54:41.174292+0000","last_undegraded":"2024-04-18T04:54:41.174292+0000","last_fullsized":"2024-04-18T04:54:41.174292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170091+0000","last_change":"2024-04-18T04:54:41.190055+0000","last_active":"2024-04-18T04:54:42.170091+0000","last_peered":"2024-04-18T04:54:42.170091+0000","last_clean":"2024-04-18T04:54:42.170091+0000","last_became_active":"2024-04-18T04:54:41.189344+0000","last_became_peered":"2024-04-18T04:54:41.189344+0000","last_unstale":"2024-04-18T04:54:42.170091+0000","last_undegraded":"2024-04-18T04:54:42.170091+0000","last_fullsized":"2024-04-18T04:54:42.170091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.175599+0000","last_change":"2024-04-18T04:54:40.813931+0000","last_active":"2024-04-18T04:54:41.175599+0000","last_peered":"2024-04-18T04:54:41.175599+0000","last_clean":"2024-04-18T04:54:41.175599+0000","last_became_active":"2024-04-18T04:54:40.813290+0000","last_became_peered":"2024-04-18T04:54:40.813290+0000","last_unstale":"2024-04-18T04:54:41.175599+0000","last_undegraded":"2024-04-18T04:54:41.175599+0000","last_fullsized":"2024-04-18T04:54:41.175599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170238+0000","last_change":"2024-04-18T04:54:41.192913+0000","last_active":"2024-04-18T04:54:42.170238+0000","last_peered":"2024-04-18T04:54:42.170238+0000","last_clean":"2024-04-18T04:54:42.170238+0000","last_became_active":"2024-04-18T04:54:41.192096+0000","last_became_peered":"2024-04-18T04:54:41.192096+0000","last_unstale":"2024-04-18T04:54:42.170238+0000","last_undegraded":"2024-04-18T04:54:42.170238+0000","last_fullsized":"2024-04-18T04:54:42.170238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:37:53.082409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170973+0000","last_change":"2024-04-18T04:54:40.805596+0000","last_active":"2024-04-18T04:54:42.170973+0000","last_peered":"2024-04-18T04:54:42.170973+0000","last_clean":"2024-04-18T04:54:42.170973+0000","last_became_active":"2024-04-18T04:54:40.804913+0000","last_became_peered":"2024-04-18T04:54:40.804913+0000","last_unstale":"2024-04-18T04:54:42.170973+0000","last_undegraded":"2024-04-18T04:54:42.170973+0000","last_fullsized":"2024-04-18T04:54:42.170973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:44.772589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509443,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":663457,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]}]},{"osd":1,"up_from":15,"seq":64424509443,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":663457,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:54:47.174 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:54:47.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.315+0000 7f2cb260b640 1 Processor -- start 2024-04-18T04:54:47.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.315+0000 7f2cb260b640 1 -- start start 2024-04-18T04:54:47.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cb260b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2cac0c1870 0x7f2cac070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cb260b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cac1564c0 con 0x7f2cac06d930 2024-04-18T04:54:47.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cb260b640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cac0721e0 con 0x7f2cac156050 2024-04-18T04:54:47.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cb260b640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cac0c48a0 con 0x7f2cac0c1870 2024-04-18T04:54:47.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cabfff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f2cac06d930 0x7f2cac0c4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39754/0 (socket says 172.21.15.96:39754) 2024-04-18T04:54:47.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cabfff640 1 -- 172.21.15.96:0/2114859823 learned_addr learned my addr 172.21.15.96:0/2114859823 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:47.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2ca3fff640 1 --2- 172.21.15.96:0/2114859823 >> v2:172.21.15.139:3300/0 conn(0x7f2cac0c1870 0x7f2cac070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:47.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 -- 172.21.15.96:0/2114859823 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373533601 0 0) 0x7f2cac1564c0 con 0x7f2cac06d930 2024-04-18T04:54:47.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 -- 172.21.15.96:0/2114859823 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c98004640 con 0x7f2cac06d930 2024-04-18T04:54:47.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 -- 172.21.15.96:0/2114859823 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1877754350 0 0) 0x7f2c98004640 con 0x7f2cac06d930 2024-04-18T04:54:47.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 -- 172.21.15.96:0/2114859823 >> v2:172.21.15.139:3300/0 conn(0x7f2cac0c1870 msgr2=0x7f2cac070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:47.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 --2- 172.21.15.96:0/2114859823 >> v2:172.21.15.139:3300/0 conn(0x7f2cac0c1870 0x7f2cac070fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 -- 172.21.15.96:0/2114859823 >> v1:172.21.15.139:6789/0 conn(0x7f2cac156050 legacy=0x7f2cac15fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:47.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 -- 172.21.15.96:0/2114859823 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac070730 con 0x7f2cac06d930 2024-04-18T04:54:47.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 -- 172.21.15.96:0/2114859823 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f2c9c001680 con 0x7f2cac06d930 2024-04-18T04:54:47.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 -- 172.21.15.96:0/2114859823 >> v1:172.21.15.96:6789/0 conn(0x7f2cac06d930 legacy=0x7f2cac0c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:47.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 --2- 172.21.15.96:0/2114859823 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c98004a90 0x7f2c98004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 --2- 172.21.15.96:0/2114859823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980058e0 0x7f2c98005d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 --2- 172.21.15.96:0/2114859823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c980062a0 0x7f2c9800caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 -- 172.21.15.96:0/2114859823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9800d120 con 0x7f2c980058e0 2024-04-18T04:54:47.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 -- 172.21.15.96:0/2114859823 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9800d290 con 0x7f2c980062a0 2024-04-18T04:54:47.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 -- 172.21.15.96:0/2114859823 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9800d450 con 0x7f2c98004a90 2024-04-18T04:54:47.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2ca3fff640 1 --2- 172.21.15.96:0/2114859823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980058e0 0x7f2c98005d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:47.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cabfff640 1 --2- 172.21.15.96:0/2114859823 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c98004a90 0x7f2c98004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:47.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2ca3fff640 1 -- 172.21.15.96:0/2114859823 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c98004a90 msgr2=0x7f2c98004eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:47.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2ca3fff640 1 --2- 172.21.15.96:0/2114859823 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c98004a90 0x7f2c98004eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2ca3fff640 1 -- 172.21.15.96:0/2114859823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c980062a0 msgr2=0x7f2c9800caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:47.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2ca3fff640 1 --2- 172.21.15.96:0/2114859823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c980062a0 0x7f2c9800caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cb0ba8640 1 -- 172.21.15.96:0/2114859823 reap_dead start 2024-04-18T04:54:47.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2ca3fff640 1 -- 172.21.15.96:0/2114859823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c98004640 con 0x7f2c980058e0 2024-04-18T04:54:47.323 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:54:47.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2ca3fff640 1 --2- 172.21.15.96:0/2114859823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980058e0 0x7f2c98005d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009ab0 tx=0x7f2c9401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2af2a48a9480685 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:47.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 -- 172.21.15.96:0/2114859823 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c940a5680 con 0x7f2c980058e0 2024-04-18T04:54:47.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 -- 172.21.15.96:0/2114859823 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c940a57e0 con 0x7f2c980058e0 2024-04-18T04:54:47.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.319+0000 7f2cab7fe640 1 -- 172.21.15.96:0/2114859823 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c940a5b90 con 0x7f2c980058e0 2024-04-18T04:54:47.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 -- 172.21.15.96:0/2114859823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980058e0 msgr2=0x7f2c98005d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:47.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 --2- 172.21.15.96:0/2114859823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980058e0 0x7f2c98005d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009ab0 tx=0x7f2c9401ca90 comp rx=0 tx=0).stop 2024-04-18T04:54:47.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 -- 172.21.15.96:0/2114859823 shutdown_connections 2024-04-18T04:54:47.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 --2- 172.21.15.96:0/2114859823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980058e0 0x7f2c98005d60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 -- 172.21.15.96:0/2114859823 >> 172.21.15.96:0/2114859823 conn(0x7f2cac06c750 msgr2=0x7f2cac0c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:47.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 -- 172.21.15.96:0/2114859823 shutdown_connections 2024-04-18T04:54:47.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 -- 172.21.15.96:0/2114859823 wait complete. 2024-04-18T04:54:47.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 Processor -- start 2024-04-18T04:54:47.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 -- start start 2024-04-18T04:54:47.326 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:54:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980058e0 0x7f2cac1535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2cac151ee0 0x7f2cac152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cac1f03e0 0x7f2cac1f0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac1effc0 con 0x7f2c980058e0 2024-04-18T04:54:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac152f20 con 0x7f2cac1f03e0 2024-04-18T04:54:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac1f0da0 con 0x7f2cac151ee0 2024-04-18T04:54:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cabfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980058e0 0x7f2cac1535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cabfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980058e0 0x7f2cac1535f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54492/0 (socket says 172.21.15.96:54492) 2024-04-18T04:54:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cabfff640 1 -- 172.21.15.96:0/3101042190 learned_addr learned my addr 172.21.15.96:0/3101042190 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2ca3fff640 1 --2- 172.21.15.96:0/3101042190 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2cac151ee0 0x7f2cac152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb0ba8640 1 --2- 172.21.15.96:0/3101042190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cac1f03e0 0x7f2cac1f0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cabfff640 1 -- 172.21.15.96:0/3101042190 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2cac151ee0 msgr2=0x7f2cac152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cabfff640 1 --2- 172.21.15.96:0/3101042190 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2cac151ee0 0x7f2cac152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cabfff640 1 -- 172.21.15.96:0/3101042190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cac1f03e0 msgr2=0x7f2cac1f0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cabfff640 1 --2- 172.21.15.96:0/3101042190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cac1f03e0 0x7f2cac1f0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cabfff640 1 -- 172.21.15.96:0/3101042190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac151560 con 0x7f2c980058e0 2024-04-18T04:54:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2ca3fff640 1 --2- 172.21.15.96:0/3101042190 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2cac151ee0 0x7f2cac152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cabfff640 1 --2- 172.21.15.96:0/3101042190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980058e0 0x7f2cac1535f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00d8d0 tx=0x7f2c9c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2ca97fa640 1 -- 172.21.15.96:0/3101042190 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c0074e0 con 0x7f2c980058e0 2024-04-18T04:54:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2ca97fa640 1 -- 172.21.15.96:0/3101042190 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c007640 con 0x7f2c980058e0 2024-04-18T04:54:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2ca97fa640 1 -- 172.21.15.96:0/3101042190 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c004a10 con 0x7f2c980058e0 2024-04-18T04:54:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 -- 172.21.15.96:0/3101042190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cac1512a0 con 0x7f2c980058e0 2024-04-18T04:54:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.323+0000 7f2cb260b640 1 -- 172.21.15.96:0/3101042190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cac1ef900 con 0x7f2c980058e0 2024-04-18T04:54:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.327+0000 7f2cb260b640 1 -- 172.21.15.96:0/3101042190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cac1f0100 con 0x7f2c980058e0 2024-04-18T04:54:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.327+0000 7f2ca97fa640 1 -- 172.21.15.96:0/3101042190 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2c9c004b70 con 0x7f2c980058e0 2024-04-18T04:54:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.327+0000 7f2ca97fa640 1 --2- 172.21.15.96:0/3101042190 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2c8c066690 0x7f2c8c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.327+0000 7f2ca97fa640 1 -- 172.21.15.96:0/3101042190 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c9c083c00 con 0x7f2c980058e0 2024-04-18T04:54:47.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.327+0000 7f2ca3fff640 1 --2- 172.21.15.96:0/3101042190 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2c8c066690 0x7f2c8c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:47.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.327+0000 7f2ca3fff640 1 --2- 172.21.15.96:0/3101042190 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2c8c066690 0x7f2c8c068b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2c940af000 tx=0x7f2c94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:47.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.331+0000 7f2ca97fa640 1 -- 172.21.15.96:0/3101042190 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2cac1f0100 con 0x7f2c980058e0 2024-04-18T04:54:47.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.475+0000 7f2cb260b640 1 -- 172.21.15.96:0/3101042190 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2cac1ef780 con 0x7f2c8c066690 2024-04-18T04:54:47.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.483+0000 7f2ca97fa640 1 -- 172.21.15.96:0/3101042190 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264572 (secure 0 0 0) 0x7f2c940a59d0 con 0x7f2c8c066690 2024-04-18T04:54:47.489 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:47.491 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T04:54:47.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.487+0000 7f2cb260b640 1 -- 172.21.15.96:0/3101042190 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2c8c066690 msgr2=0x7f2c8c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:47.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.487+0000 7f2cb260b640 1 --2- 172.21.15.96:0/3101042190 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2c8c066690 0x7f2c8c068b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2c940af000 tx=0x7f2c94008040 comp rx=0 tx=0).stop 2024-04-18T04:54:47.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.487+0000 7f2cb260b640 1 -- 172.21.15.96:0/3101042190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980058e0 msgr2=0x7f2cac1535f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:47.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.487+0000 7f2cb260b640 1 --2- 172.21.15.96:0/3101042190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980058e0 0x7f2cac1535f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00d8d0 tx=0x7f2c9c00dd90 comp rx=0 tx=0).stop 2024-04-18T04:54:47.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.487+0000 7f2cb260b640 1 -- 172.21.15.96:0/3101042190 shutdown_connections 2024-04-18T04:54:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.487+0000 7f2cb260b640 1 --2- 172.21.15.96:0/3101042190 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2c8c066690 0x7f2c8c068b50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.487+0000 7f2cb260b640 1 --2- 172.21.15.96:0/3101042190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cac1f03e0 0x7f2cac1f0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.487+0000 7f2cb260b640 1 --2- 172.21.15.96:0/3101042190 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2cac151ee0 0x7f2cac152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.487+0000 7f2cb260b640 1 --2- 172.21.15.96:0/3101042190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980058e0 0x7f2cac1535f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.487+0000 7f2cb260b640 1 -- 172.21.15.96:0/3101042190 >> 172.21.15.96:0/3101042190 conn(0x7f2cac06c750 msgr2=0x7f2cac154a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.491+0000 7f2cb260b640 1 -- 172.21.15.96:0/3101042190 shutdown_connections 2024-04-18T04:54:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.491+0000 7f2cb260b640 1 -- 172.21.15.96:0/3101042190 wait complete. 2024-04-18T04:54:47.505 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-18T04:54:46.569186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217932,"kb_used_data":1760,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756788,"statfs":{"total":773094113280,"available":772870950912,"internally_reserved":0,"allocated":1802240,"data_stored":1765448,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.795443"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323999+0000","last_change":"2024-04-18T04:54:41.199306+0000","last_active":"2024-04-18T04:54:42.323999+0000","last_peered":"2024-04-18T04:54:42.323999+0000","last_clean":"2024-04-18T04:54:42.323999+0000","last_became_active":"2024-04-18T04:54:41.199046+0000","last_became_peered":"2024-04-18T04:54:41.199046+0000","last_unstale":"2024-04-18T04:54:42.323999+0000","last_undegraded":"2024-04-18T04:54:42.323999+0000","last_fullsized":"2024-04-18T04:54:42.323999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169848+0000","last_change":"2024-04-18T04:54:41.200447+0000","last_active":"2024-04-18T04:54:42.169848+0000","last_peered":"2024-04-18T04:54:42.169848+0000","last_clean":"2024-04-18T04:54:42.169848+0000","last_became_active":"2024-04-18T04:54:41.200136+0000","last_became_peered":"2024-04-18T04:54:41.200136+0000","last_unstale":"2024-04-18T04:54:42.169848+0000","last_undegraded":"2024-04-18T04:54:42.169848+0000","last_fullsized":"2024-04-18T04:54:42.169848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169517+0000","last_change":"2024-04-18T04:54:41.185987+0000","last_active":"2024-04-18T04:54:42.169517+0000","last_peered":"2024-04-18T04:54:42.169517+0000","last_clean":"2024-04-18T04:54:42.169517+0000","last_became_active":"2024-04-18T04:54:41.185206+0000","last_became_peered":"2024-04-18T04:54:41.185206+0000","last_unstale":"2024-04-18T04:54:42.169517+0000","last_undegraded":"2024-04-18T04:54:42.169517+0000","last_fullsized":"2024-04-18T04:54:42.169517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453954+0000","last_change":"2024-04-18T04:54:41.177487+0000","last_active":"2024-04-18T04:54:42.453954+0000","last_peered":"2024-04-18T04:54:42.453954+0000","last_clean":"2024-04-18T04:54:42.453954+0000","last_became_active":"2024-04-18T04:54:41.177217+0000","last_became_peered":"2024-04-18T04:54:41.177217+0000","last_unstale":"2024-04-18T04:54:42.453954+0000","last_undegraded":"2024-04-18T04:54:42.453954+0000","last_fullsized":"2024-04-18T04:54:42.453954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:08.067252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323329+0000","last_change":"2024-04-18T04:54:41.186573+0000","last_active":"2024-04-18T04:54:42.323329+0000","last_peered":"2024-04-18T04:54:42.323329+0000","last_clean":"2024-04-18T04:54:42.323329+0000","last_became_active":"2024-04-18T04:54:41.186027+0000","last_became_peered":"2024-04-18T04:54:41.186027+0000","last_unstale":"2024-04-18T04:54:42.323329+0000","last_undegraded":"2024-04-18T04:54:42.323329+0000","last_fullsized":"2024-04-18T04:54:42.323329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453454+0000","last_change":"2024-04-18T04:54:41.177550+0000","last_active":"2024-04-18T04:54:42.453454+0000","last_peered":"2024-04-18T04:54:42.453454+0000","last_clean":"2024-04-18T04:54:42.453454+0000","last_became_active":"2024-04-18T04:54:41.177215+0000","last_became_peered":"2024-04-18T04:54:41.177215+0000","last_unstale":"2024-04-18T04:54:42.453454+0000","last_undegraded":"2024-04-18T04:54:42.453454+0000","last_fullsized":"2024-04-18T04:54:42.453454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:26.266600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323158+0000","last_change":"2024-04-18T04:54:41.178605+0000","last_active":"2024-04-18T04:54:42.323158+0000","last_peered":"2024-04-18T04:54:42.323158+0000","last_clean":"2024-04-18T04:54:42.323158+0000","last_became_active":"2024-04-18T04:54:41.178094+0000","last_became_peered":"2024-04-18T04:54:41.178094+0000","last_unstale":"2024-04-18T04:54:42.323158+0000","last_undegraded":"2024-04-18T04:54:42.323158+0000","last_fullsized":"2024-04-18T04:54:42.323158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169250+0000","last_change":"2024-04-18T04:54:41.193174+0000","last_active":"2024-04-18T04:54:42.169250+0000","last_peered":"2024-04-18T04:54:42.169250+0000","last_clean":"2024-04-18T04:54:42.169250+0000","last_became_active":"2024-04-18T04:54:41.192678+0000","last_became_peered":"2024-04-18T04:54:41.192678+0000","last_unstale":"2024-04-18T04:54:42.169250+0000","last_undegraded":"2024-04-18T04:54:42.169250+0000","last_fullsized":"2024-04-18T04:54:42.169250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167601+0000","last_change":"2024-04-18T04:54:41.198121+0000","last_active":"2024-04-18T04:54:42.167601+0000","last_peered":"2024-04-18T04:54:42.167601+0000","last_clean":"2024-04-18T04:54:42.167601+0000","last_became_active":"2024-04-18T04:54:41.197832+0000","last_became_peered":"2024-04-18T04:54:41.197832+0000","last_unstale":"2024-04-18T04:54:42.167601+0000","last_undegraded":"2024-04-18T04:54:42.167601+0000","last_fullsized":"2024-04-18T04:54:42.167601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.835581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323925+0000","last_change":"2024-04-18T04:54:41.183032+0000","last_active":"2024-04-18T04:54:42.323925+0000","last_peered":"2024-04-18T04:54:42.323925+0000","last_clean":"2024-04-18T04:54:42.323925+0000","last_became_active":"2024-04-18T04:54:41.182698+0000","last_became_peered":"2024-04-18T04:54:41.182698+0000","last_unstale":"2024-04-18T04:54:42.323925+0000","last_undegraded":"2024-04-18T04:54:42.323925+0000","last_fullsized":"2024-04-18T04:54:42.323925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323788+0000","last_change":"2024-04-18T04:54:41.187831+0000","last_active":"2024-04-18T04:54:42.323788+0000","last_peered":"2024-04-18T04:54:42.323788+0000","last_clean":"2024-04-18T04:54:42.323788+0000","last_became_active":"2024-04-18T04:54:41.187360+0000","last_became_peered":"2024-04-18T04:54:41.187360+0000","last_unstale":"2024-04-18T04:54:42.323788+0000","last_undegraded":"2024-04-18T04:54:42.323788+0000","last_fullsized":"2024-04-18T04:54:42.323788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323367+0000","last_change":"2024-04-18T04:54:41.188641+0000","last_active":"2024-04-18T04:54:42.323367+0000","last_peered":"2024-04-18T04:54:42.323367+0000","last_clean":"2024-04-18T04:54:42.323367+0000","last_became_active":"2024-04-18T04:54:41.188281+0000","last_became_peered":"2024-04-18T04:54:41.188281+0000","last_unstale":"2024-04-18T04:54:42.323367+0000","last_undegraded":"2024-04-18T04:54:42.323367+0000","last_fullsized":"2024-04-18T04:54:42.323367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455946+0000","last_change":"2024-04-18T04:54:41.194578+0000","last_active":"2024-04-18T04:54:42.455946+0000","last_peered":"2024-04-18T04:54:42.455946+0000","last_clean":"2024-04-18T04:54:42.455946+0000","last_became_active":"2024-04-18T04:54:41.190882+0000","last_became_peered":"2024-04-18T04:54:41.190882+0000","last_unstale":"2024-04-18T04:54:42.455946+0000","last_undegraded":"2024-04-18T04:54:42.455946+0000","last_fullsized":"2024-04-18T04:54:42.455946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:45:52.041196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455376+0000","last_change":"2024-04-18T04:54:41.190210+0000","last_active":"2024-04-18T04:54:42.455376+0000","last_peered":"2024-04-18T04:54:42.455376+0000","last_clean":"2024-04-18T04:54:42.455376+0000","last_became_active":"2024-04-18T04:54:41.189813+0000","last_became_peered":"2024-04-18T04:54:41.189813+0000","last_unstale":"2024-04-18T04:54:42.455376+0000","last_undegraded":"2024-04-18T04:54:42.455376+0000","last_fullsized":"2024-04-18T04:54:42.455376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:38:02.632458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169188+0000","last_change":"2024-04-18T04:54:41.183027+0000","last_active":"2024-04-18T04:54:42.169188+0000","last_peered":"2024-04-18T04:54:42.169188+0000","last_clean":"2024-04-18T04:54:42.169188+0000","last_became_active":"2024-04-18T04:54:41.182713+0000","last_became_peered":"2024-04-18T04:54:41.182713+0000","last_unstale":"2024-04-18T04:54:42.169188+0000","last_undegraded":"2024-04-18T04:54:42.169188+0000","last_fullsized":"2024-04-18T04:54:42.169188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453959+0000","last_change":"2024-04-18T04:54:41.186060+0000","last_active":"2024-04-18T04:54:42.453959+0000","last_peered":"2024-04-18T04:54:42.453959+0000","last_clean":"2024-04-18T04:54:42.453959+0000","last_became_active":"2024-04-18T04:54:41.185803+0000","last_became_peered":"2024-04-18T04:54:41.185803+0000","last_unstale":"2024-04-18T04:54:42.453959+0000","last_undegraded":"2024-04-18T04:54:42.453959+0000","last_fullsized":"2024-04-18T04:54:42.453959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:48:04.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455728+0000","last_change":"2024-04-18T04:54:41.200802+0000","last_active":"2024-04-18T04:54:42.455728+0000","last_peered":"2024-04-18T04:54:42.455728+0000","last_clean":"2024-04-18T04:54:42.455728+0000","last_became_active":"2024-04-18T04:54:41.198404+0000","last_became_peered":"2024-04-18T04:54:41.198404+0000","last_unstale":"2024-04-18T04:54:42.455728+0000","last_undegraded":"2024-04-18T04:54:42.455728+0000","last_fullsized":"2024-04-18T04:54:42.455728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:56.686481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454830+0000","last_change":"2024-04-18T04:54:41.189568+0000","last_active":"2024-04-18T04:54:42.454830+0000","last_peered":"2024-04-18T04:54:42.454830+0000","last_clean":"2024-04-18T04:54:42.454830+0000","last_became_active":"2024-04-18T04:54:41.188139+0000","last_became_peered":"2024-04-18T04:54:41.188139+0000","last_unstale":"2024-04-18T04:54:42.454830+0000","last_undegraded":"2024-04-18T04:54:42.454830+0000","last_fullsized":"2024-04-18T04:54:42.454830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455410+0000","last_change":"2024-04-18T04:54:41.197901+0000","last_active":"2024-04-18T04:54:42.455410+0000","last_peered":"2024-04-18T04:54:42.455410+0000","last_clean":"2024-04-18T04:54:42.455410+0000","last_became_active":"2024-04-18T04:54:41.197235+0000","last_became_peered":"2024-04-18T04:54:41.197235+0000","last_unstale":"2024-04-18T04:54:42.455410+0000","last_undegraded":"2024-04-18T04:54:42.455410+0000","last_fullsized":"2024-04-18T04:54:42.455410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:41:20.213202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323339+0000","last_change":"2024-04-18T04:54:41.188440+0000","last_active":"2024-04-18T04:54:42.323339+0000","last_peered":"2024-04-18T04:54:42.323339+0000","last_clean":"2024-04-18T04:54:42.323339+0000","last_became_active":"2024-04-18T04:54:41.187925+0000","last_became_peered":"2024-04-18T04:54:41.187925+0000","last_unstale":"2024-04-18T04:54:42.323339+0000","last_undegraded":"2024-04-18T04:54:42.323339+0000","last_fullsized":"2024-04-18T04:54:42.323339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170212+0000","last_change":"2024-04-18T04:54:41.179672+0000","last_active":"2024-04-18T04:54:42.170212+0000","last_peered":"2024-04-18T04:54:42.170212+0000","last_clean":"2024-04-18T04:54:42.170212+0000","last_became_active":"2024-04-18T04:54:41.178963+0000","last_became_peered":"2024-04-18T04:54:41.178963+0000","last_unstale":"2024-04-18T04:54:42.170212+0000","last_undegraded":"2024-04-18T04:54:42.170212+0000","last_fullsized":"2024-04-18T04:54:42.170212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:56:31.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167152+0000","last_change":"2024-04-18T04:54:41.182902+0000","last_active":"2024-04-18T04:54:42.167152+0000","last_peered":"2024-04-18T04:54:42.167152+0000","last_clean":"2024-04-18T04:54:42.167152+0000","last_became_active":"2024-04-18T04:54:41.182664+0000","last_became_peered":"2024-04-18T04:54:41.182664+0000","last_unstale":"2024-04-18T04:54:42.167152+0000","last_undegraded":"2024-04-18T04:54:42.167152+0000","last_fullsized":"2024-04-18T04:54:42.167152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:56.408926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169624+0000","last_change":"2024-04-18T04:54:41.187578+0000","last_active":"2024-04-18T04:54:42.169624+0000","last_peered":"2024-04-18T04:54:42.169624+0000","last_clean":"2024-04-18T04:54:42.169624+0000","last_became_active":"2024-04-18T04:54:41.186881+0000","last_became_peered":"2024-04-18T04:54:41.186881+0000","last_unstale":"2024-04-18T04:54:42.169624+0000","last_undegraded":"2024-04-18T04:54:42.169624+0000","last_fullsized":"2024-04-18T04:54:42.169624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:27.817916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454216+0000","last_change":"2024-04-18T04:54:41.193206+0000","last_active":"2024-04-18T04:54:42.454216+0000","last_peered":"2024-04-18T04:54:42.454216+0000","last_clean":"2024-04-18T04:54:42.454216+0000","last_became_active":"2024-04-18T04:54:41.192740+0000","last_became_peered":"2024-04-18T04:54:41.192740+0000","last_unstale":"2024-04-18T04:54:42.454216+0000","last_undegraded":"2024-04-18T04:54:42.454216+0000","last_fullsized":"2024-04-18T04:54:42.454216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:51:34.311826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169844+0000","last_change":"2024-04-18T04:54:41.192785+0000","last_active":"2024-04-18T04:54:42.169844+0000","last_peered":"2024-04-18T04:54:42.169844+0000","last_clean":"2024-04-18T04:54:42.169844+0000","last_became_active":"2024-04-18T04:54:41.192280+0000","last_became_peered":"2024-04-18T04:54:41.192280+0000","last_unstale":"2024-04-18T04:54:42.169844+0000","last_undegraded":"2024-04-18T04:54:42.169844+0000","last_fullsized":"2024-04-18T04:54:42.169844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454615+0000","last_change":"2024-04-18T04:54:41.193920+0000","last_active":"2024-04-18T04:54:42.454615+0000","last_peered":"2024-04-18T04:54:42.454615+0000","last_clean":"2024-04-18T04:54:42.454615+0000","last_became_active":"2024-04-18T04:54:41.193660+0000","last_became_peered":"2024-04-18T04:54:41.193660+0000","last_unstale":"2024-04-18T04:54:42.454615+0000","last_undegraded":"2024-04-18T04:54:42.454615+0000","last_fullsized":"2024-04-18T04:54:42.454615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:22.072498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.456447+0000","last_change":"2024-04-18T04:54:41.190298+0000","last_active":"2024-04-18T04:54:42.456447+0000","last_peered":"2024-04-18T04:54:42.456447+0000","last_clean":"2024-04-18T04:54:42.456447+0000","last_became_active":"2024-04-18T04:54:41.189374+0000","last_became_peered":"2024-04-18T04:54:41.189374+0000","last_unstale":"2024-04-18T04:54:42.456447+0000","last_undegraded":"2024-04-18T04:54:42.456447+0000","last_fullsized":"2024-04-18T04:54:42.456447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455999+0000","last_change":"2024-04-18T04:54:41.190403+0000","last_active":"2024-04-18T04:54:42.455999+0000","last_peered":"2024-04-18T04:54:42.455999+0000","last_clean":"2024-04-18T04:54:42.455999+0000","last_became_active":"2024-04-18T04:54:41.189660+0000","last_became_peered":"2024-04-18T04:54:41.189660+0000","last_unstale":"2024-04-18T04:54:42.455999+0000","last_undegraded":"2024-04-18T04:54:42.455999+0000","last_fullsized":"2024-04-18T04:54:42.455999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:34.259279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169947+0000","last_change":"2024-04-18T04:54:41.187370+0000","last_active":"2024-04-18T04:54:42.169947+0000","last_peered":"2024-04-18T04:54:42.169947+0000","last_clean":"2024-04-18T04:54:42.169947+0000","last_became_active":"2024-04-18T04:54:41.186901+0000","last_became_peered":"2024-04-18T04:54:41.186901+0000","last_unstale":"2024-04-18T04:54:42.169947+0000","last_undegraded":"2024-04-18T04:54:42.169947+0000","last_fullsized":"2024-04-18T04:54:42.169947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454539+0000","last_change":"2024-04-18T04:54:41.192719+0000","last_active":"2024-04-18T04:54:42.454539+0000","last_peered":"2024-04-18T04:54:42.454539+0000","last_clean":"2024-04-18T04:54:42.454539+0000","last_became_active":"2024-04-18T04:54:41.192114+0000","last_became_peered":"2024-04-18T04:54:41.192114+0000","last_unstale":"2024-04-18T04:54:42.454539+0000","last_undegraded":"2024-04-18T04:54:42.454539+0000","last_fullsized":"2024-04-18T04:54:42.454539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:33:21.965783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454128+0000","last_change":"2024-04-18T04:54:41.186276+0000","last_active":"2024-04-18T04:54:42.454128+0000","last_peered":"2024-04-18T04:54:42.454128+0000","last_clean":"2024-04-18T04:54:42.454128+0000","last_became_active":"2024-04-18T04:54:41.185915+0000","last_became_peered":"2024-04-18T04:54:41.185915+0000","last_unstale":"2024-04-18T04:54:42.454128+0000","last_undegraded":"2024-04-18T04:54:42.454128+0000","last_fullsized":"2024-04-18T04:54:42.454128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453190+0000","last_change":"2024-04-18T04:54:41.190283+0000","last_active":"2024-04-18T04:54:42.453190+0000","last_peered":"2024-04-18T04:54:42.453190+0000","last_clean":"2024-04-18T04:54:42.453190+0000","last_became_active":"2024-04-18T04:54:41.189892+0000","last_became_peered":"2024-04-18T04:54:41.189892+0000","last_unstale":"2024-04-18T04:54:42.453190+0000","last_undegraded":"2024-04-18T04:54:42.453190+0000","last_fullsized":"2024-04-18T04:54:42.453190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:53.175178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167307+0000","last_change":"2024-04-18T04:54:41.187326+0000","last_active":"2024-04-18T04:54:42.167307+0000","last_peered":"2024-04-18T04:54:42.167307+0000","last_clean":"2024-04-18T04:54:42.167307+0000","last_became_active":"2024-04-18T04:54:41.187001+0000","last_became_peered":"2024-04-18T04:54:41.187001+0000","last_unstale":"2024-04-18T04:54:42.167307+0000","last_undegraded":"2024-04-18T04:54:42.167307+0000","last_fullsized":"2024-04-18T04:54:42.167307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.178455+0000","last_change":"2024-04-18T04:54:40.824658+0000","last_active":"2024-04-18T04:54:41.178455+0000","last_peered":"2024-04-18T04:54:41.178455+0000","last_clean":"2024-04-18T04:54:41.178455+0000","last_became_active":"2024-04-18T04:54:40.823652+0000","last_became_peered":"2024-04-18T04:54:40.823652+0000","last_unstale":"2024-04-18T04:54:41.178455+0000","last_undegraded":"2024-04-18T04:54:41.178455+0000","last_fullsized":"2024-04-18T04:54:41.178455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170634+0000","last_change":"2024-04-18T04:54:41.184497+0000","last_active":"2024-04-18T04:54:42.170634+0000","last_peered":"2024-04-18T04:54:42.170634+0000","last_clean":"2024-04-18T04:54:42.170634+0000","last_became_active":"2024-04-18T04:54:41.182180+0000","last_became_peered":"2024-04-18T04:54:41.182180+0000","last_unstale":"2024-04-18T04:54:42.170634+0000","last_undegraded":"2024-04-18T04:54:42.170634+0000","last_fullsized":"2024-04-18T04:54:42.170634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:25:15.707596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.179171+0000","last_change":"2024-04-18T04:54:40.803244+0000","last_active":"2024-04-18T04:54:41.179171+0000","last_peered":"2024-04-18T04:54:41.179171+0000","last_clean":"2024-04-18T04:54:41.179171+0000","last_became_active":"2024-04-18T04:54:40.802672+0000","last_became_peered":"2024-04-18T04:54:40.802672+0000","last_unstale":"2024-04-18T04:54:41.179171+0000","last_undegraded":"2024-04-18T04:54:41.179171+0000","last_fullsized":"2024-04-18T04:54:41.179171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:56.851301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.171919+0000","last_change":"2024-04-18T04:54:40.823675+0000","last_active":"2024-04-18T04:54:41.171919+0000","last_peered":"2024-04-18T04:54:41.171919+0000","last_clean":"2024-04-18T04:54:41.171919+0000","last_became_active":"2024-04-18T04:54:40.823091+0000","last_became_peered":"2024-04-18T04:54:40.823091+0000","last_unstale":"2024-04-18T04:54:41.171919+0000","last_undegraded":"2024-04-18T04:54:41.171919+0000","last_fullsized":"2024-04-18T04:54:41.171919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169532+0000","last_change":"2024-04-18T04:54:41.200326+0000","last_active":"2024-04-18T04:54:42.169532+0000","last_peered":"2024-04-18T04:54:42.169532+0000","last_clean":"2024-04-18T04:54:42.169532+0000","last_became_active":"2024-04-18T04:54:41.199690+0000","last_became_peered":"2024-04-18T04:54:41.199690+0000","last_unstale":"2024-04-18T04:54:42.169532+0000","last_undegraded":"2024-04-18T04:54:42.169532+0000","last_fullsized":"2024-04-18T04:54:42.169532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.185487+0000","last_change":"2024-04-18T04:54:40.805264+0000","last_active":"2024-04-18T04:54:41.185487+0000","last_peered":"2024-04-18T04:54:41.185487+0000","last_clean":"2024-04-18T04:54:41.185487+0000","last_became_active":"2024-04-18T04:54:40.804605+0000","last_became_peered":"2024-04-18T04:54:40.804605+0000","last_unstale":"2024-04-18T04:54:41.185487+0000","last_undegraded":"2024-04-18T04:54:41.185487+0000","last_fullsized":"2024-04-18T04:54:41.185487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:48.991270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.171188+0000","last_change":"2024-04-18T04:54:41.175359+0000","last_active":"2024-04-18T04:54:42.171188+0000","last_peered":"2024-04-18T04:54:42.171188+0000","last_clean":"2024-04-18T04:54:42.171188+0000","last_became_active":"2024-04-18T04:54:41.175137+0000","last_became_peered":"2024-04-18T04:54:41.175137+0000","last_unstale":"2024-04-18T04:54:42.171188+0000","last_undegraded":"2024-04-18T04:54:42.171188+0000","last_fullsized":"2024-04-18T04:54:42.171188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:06:24.271204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.164938+0000","last_change":"2024-04-18T04:54:40.798936+0000","last_active":"2024-04-18T04:54:41.164938+0000","last_peered":"2024-04-18T04:54:41.164938+0000","last_clean":"2024-04-18T04:54:41.164938+0000","last_became_active":"2024-04-18T04:54:40.798572+0000","last_became_peered":"2024-04-18T04:54:40.798572+0000","last_unstale":"2024-04-18T04:54:41.164938+0000","last_undegraded":"2024-04-18T04:54:41.164938+0000","last_fullsized":"2024-04-18T04:54:41.164938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454742+0000","last_change":"2024-04-18T04:54:41.188280+0000","last_active":"2024-04-18T04:54:42.454742+0000","last_peered":"2024-04-18T04:54:42.454742+0000","last_clean":"2024-04-18T04:54:42.454742+0000","last_became_active":"2024-04-18T04:54:41.188012+0000","last_became_peered":"2024-04-18T04:54:41.188012+0000","last_unstale":"2024-04-18T04:54:42.454742+0000","last_undegraded":"2024-04-18T04:54:42.454742+0000","last_fullsized":"2024-04-18T04:54:42.454742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:11.319118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.174130+0000","last_change":"2024-04-18T04:54:40.802894+0000","last_active":"2024-04-18T04:54:41.174130+0000","last_peered":"2024-04-18T04:54:41.174130+0000","last_clean":"2024-04-18T04:54:41.174130+0000","last_became_active":"2024-04-18T04:54:40.801406+0000","last_became_peered":"2024-04-18T04:54:40.801406+0000","last_unstale":"2024-04-18T04:54:41.174130+0000","last_undegraded":"2024-04-18T04:54:41.174130+0000","last_fullsized":"2024-04-18T04:54:41.174130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170319+0000","last_change":"2024-04-18T04:54:41.203407+0000","last_active":"2024-04-18T04:54:42.170319+0000","last_peered":"2024-04-18T04:54:42.170319+0000","last_clean":"2024-04-18T04:54:42.170319+0000","last_became_active":"2024-04-18T04:54:41.203186+0000","last_became_peered":"2024-04-18T04:54:41.203186+0000","last_unstale":"2024-04-18T04:54:42.170319+0000","last_undegraded":"2024-04-18T04:54:42.170319+0000","last_fullsized":"2024-04-18T04:54:42.170319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:23:50.107054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.183760+0000","last_change":"2024-04-18T04:54:40.822014+0000","last_active":"2024-04-18T04:54:41.183760+0000","last_peered":"2024-04-18T04:54:41.183760+0000","last_clean":"2024-04-18T04:54:41.183760+0000","last_became_active":"2024-04-18T04:54:40.820920+0000","last_became_peered":"2024-04-18T04:54:40.820920+0000","last_unstale":"2024-04-18T04:54:41.183760+0000","last_undegraded":"2024-04-18T04:54:41.183760+0000","last_fullsized":"2024-04-18T04:54:41.183760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455233+0000","last_change":"2024-04-18T04:54:41.197254+0000","last_active":"2024-04-18T04:54:42.455233+0000","last_peered":"2024-04-18T04:54:42.455233+0000","last_clean":"2024-04-18T04:54:42.455233+0000","last_became_active":"2024-04-18T04:54:41.196927+0000","last_became_peered":"2024-04-18T04:54:41.196927+0000","last_unstale":"2024-04-18T04:54:42.455233+0000","last_undegraded":"2024-04-18T04:54:42.455233+0000","last_fullsized":"2024-04-18T04:54:42.455233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:01:45.182766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454178+0000","last_change":"2024-04-18T04:54:40.801789+0000","last_active":"2024-04-18T04:54:42.454178+0000","last_peered":"2024-04-18T04:54:42.454178+0000","last_clean":"2024-04-18T04:54:42.454178+0000","last_became_active":"2024-04-18T04:54:40.801403+0000","last_became_peered":"2024-04-18T04:54:40.801403+0000","last_unstale":"2024-04-18T04:54:42.454178+0000","last_undegraded":"2024-04-18T04:54:42.454178+0000","last_fullsized":"2024-04-18T04:54:42.454178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:15:11.220095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323817+0000","last_change":"2024-04-18T04:54:41.195518+0000","last_active":"2024-04-18T04:54:42.323817+0000","last_peered":"2024-04-18T04:54:42.323817+0000","last_clean":"2024-04-18T04:54:42.323817+0000","last_became_active":"2024-04-18T04:54:41.195172+0000","last_became_peered":"2024-04-18T04:54:41.195172+0000","last_unstale":"2024-04-18T04:54:42.323817+0000","last_undegraded":"2024-04-18T04:54:42.323817+0000","last_fullsized":"2024-04-18T04:54:42.323817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.184139+0000","last_change":"2024-04-18T04:54:40.818390+0000","last_active":"2024-04-18T04:54:41.184139+0000","last_peered":"2024-04-18T04:54:41.184139+0000","last_clean":"2024-04-18T04:54:41.184139+0000","last_became_active":"2024-04-18T04:54:40.817681+0000","last_became_peered":"2024-04-18T04:54:40.817681+0000","last_unstale":"2024-04-18T04:54:41.184139+0000","last_undegraded":"2024-04-18T04:54:41.184139+0000","last_fullsized":"2024-04-18T04:54:41.184139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455448+0000","last_change":"2024-04-18T04:54:41.194807+0000","last_active":"2024-04-18T04:54:42.455448+0000","last_peered":"2024-04-18T04:54:42.455448+0000","last_clean":"2024-04-18T04:54:42.455448+0000","last_became_active":"2024-04-18T04:54:41.194499+0000","last_became_peered":"2024-04-18T04:54:41.194499+0000","last_unstale":"2024-04-18T04:54:42.455448+0000","last_undegraded":"2024-04-18T04:54:42.455448+0000","last_fullsized":"2024-04-18T04:54:42.455448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.179340+0000","last_change":"2024-04-18T04:54:40.817631+0000","last_active":"2024-04-18T04:54:41.179340+0000","last_peered":"2024-04-18T04:54:41.179340+0000","last_clean":"2024-04-18T04:54:41.179340+0000","last_became_active":"2024-04-18T04:54:40.817370+0000","last_became_peered":"2024-04-18T04:54:40.817370+0000","last_unstale":"2024-04-18T04:54:41.179340+0000","last_undegraded":"2024-04-18T04:54:41.179340+0000","last_fullsized":"2024-04-18T04:54:41.179340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454210+0000","last_change":"2024-04-18T04:54:41.193363+0000","last_active":"2024-04-18T04:54:42.454210+0000","last_peered":"2024-04-18T04:54:42.454210+0000","last_clean":"2024-04-18T04:54:42.454210+0000","last_became_active":"2024-04-18T04:54:41.192889+0000","last_became_peered":"2024-04-18T04:54:41.192889+0000","last_unstale":"2024-04-18T04:54:42.454210+0000","last_undegraded":"2024-04-18T04:54:42.454210+0000","last_fullsized":"2024-04-18T04:54:42.454210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.173292+0000","last_change":"2024-04-18T04:54:40.806633+0000","last_active":"2024-04-18T04:54:41.173292+0000","last_peered":"2024-04-18T04:54:41.173292+0000","last_clean":"2024-04-18T04:54:41.173292+0000","last_became_active":"2024-04-18T04:54:40.805965+0000","last_became_peered":"2024-04-18T04:54:40.805965+0000","last_unstale":"2024-04-18T04:54:41.173292+0000","last_undegraded":"2024-04-18T04:54:41.173292+0000","last_fullsized":"2024-04-18T04:54:41.173292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167013+0000","last_change":"2024-04-18T04:54:41.184321+0000","last_active":"2024-04-18T04:54:42.167013+0000","last_peered":"2024-04-18T04:54:42.167013+0000","last_clean":"2024-04-18T04:54:42.167013+0000","last_became_active":"2024-04-18T04:54:41.183838+0000","last_became_peered":"2024-04-18T04:54:41.183838+0000","last_unstale":"2024-04-18T04:54:42.167013+0000","last_undegraded":"2024-04-18T04:54:42.167013+0000","last_fullsized":"2024-04-18T04:54:42.167013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170348+0000","last_change":"2024-04-18T04:54:40.818954+0000","last_active":"2024-04-18T04:54:42.170348+0000","last_peered":"2024-04-18T04:54:42.170348+0000","last_clean":"2024-04-18T04:54:42.170348+0000","last_became_active":"2024-04-18T04:54:40.818227+0000","last_became_peered":"2024-04-18T04:54:40.818227+0000","last_unstale":"2024-04-18T04:54:42.170348+0000","last_undegraded":"2024-04-18T04:54:42.170348+0000","last_fullsized":"2024-04-18T04:54:42.170348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:25.263089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454553+0000","last_change":"2024-04-18T04:54:41.192227+0000","last_active":"2024-04-18T04:54:42.454553+0000","last_peered":"2024-04-18T04:54:42.454553+0000","last_clean":"2024-04-18T04:54:42.454553+0000","last_became_active":"2024-04-18T04:54:41.187002+0000","last_became_peered":"2024-04-18T04:54:41.187002+0000","last_unstale":"2024-04-18T04:54:42.454553+0000","last_undegraded":"2024-04-18T04:54:42.454553+0000","last_fullsized":"2024-04-18T04:54:42.454553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.175190+0000","last_change":"2024-04-18T04:54:40.805795+0000","last_active":"2024-04-18T04:54:41.175190+0000","last_peered":"2024-04-18T04:54:41.175190+0000","last_clean":"2024-04-18T04:54:41.175190+0000","last_became_active":"2024-04-18T04:54:40.802550+0000","last_became_peered":"2024-04-18T04:54:40.802550+0000","last_unstale":"2024-04-18T04:54:41.175190+0000","last_undegraded":"2024-04-18T04:54:41.175190+0000","last_fullsized":"2024-04-18T04:54:41.175190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454849+0000","last_change":"2024-04-18T04:54:41.180426+0000","last_active":"2024-04-18T04:54:42.454849+0000","last_peered":"2024-04-18T04:54:42.454849+0000","last_clean":"2024-04-18T04:54:42.454849+0000","last_became_active":"2024-04-18T04:54:41.179540+0000","last_became_peered":"2024-04-18T04:54:41.179540+0000","last_unstale":"2024-04-18T04:54:42.454849+0000","last_undegraded":"2024-04-18T04:54:42.454849+0000","last_fullsized":"2024-04-18T04:54:42.454849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:38:25.074053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.171008+0000","last_change":"2024-04-18T04:54:40.804284+0000","last_active":"2024-04-18T04:54:42.171008+0000","last_peered":"2024-04-18T04:54:42.171008+0000","last_clean":"2024-04-18T04:54:42.171008+0000","last_became_active":"2024-04-18T04:54:40.803464+0000","last_became_peered":"2024-04-18T04:54:40.803464+0000","last_unstale":"2024-04-18T04:54:42.171008+0000","last_undegraded":"2024-04-18T04:54:42.171008+0000","last_fullsized":"2024-04-18T04:54:42.171008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:52.171667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.324196+0000","last_change":"2024-04-18T04:54:41.188591+0000","last_active":"2024-04-18T04:54:42.324196+0000","last_peered":"2024-04-18T04:54:42.324196+0000","last_clean":"2024-04-18T04:54:42.324196+0000","last_became_active":"2024-04-18T04:54:41.188152+0000","last_became_peered":"2024-04-18T04:54:41.188152+0000","last_unstale":"2024-04-18T04:54:42.324196+0000","last_undegraded":"2024-04-18T04:54:42.324196+0000","last_fullsized":"2024-04-18T04:54:42.324196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.179595+0000","last_change":"2024-04-18T04:54:40.814901+0000","last_active":"2024-04-18T04:54:41.179595+0000","last_peered":"2024-04-18T04:54:41.179595+0000","last_clean":"2024-04-18T04:54:41.179595+0000","last_became_active":"2024-04-18T04:54:40.814207+0000","last_became_peered":"2024-04-18T04:54:40.814207+0000","last_unstale":"2024-04-18T04:54:41.179595+0000","last_undegraded":"2024-04-18T04:54:41.179595+0000","last_fullsized":"2024-04-18T04:54:41.179595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323473+0000","last_change":"2024-04-18T04:54:41.188664+0000","last_active":"2024-04-18T04:54:42.323473+0000","last_peered":"2024-04-18T04:54:42.323473+0000","last_clean":"2024-04-18T04:54:42.323473+0000","last_became_active":"2024-04-18T04:54:41.188249+0000","last_became_peered":"2024-04-18T04:54:41.188249+0000","last_unstale":"2024-04-18T04:54:42.323473+0000","last_undegraded":"2024-04-18T04:54:42.323473+0000","last_fullsized":"2024-04-18T04:54:42.323473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.173221+0000","last_change":"2024-04-18T04:54:40.828447+0000","last_active":"2024-04-18T04:54:41.173221+0000","last_peered":"2024-04-18T04:54:41.173221+0000","last_clean":"2024-04-18T04:54:41.173221+0000","last_became_active":"2024-04-18T04:54:40.823755+0000","last_became_peered":"2024-04-18T04:54:40.823755+0000","last_unstale":"2024-04-18T04:54:41.173221+0000","last_undegraded":"2024-04-18T04:54:41.173221+0000","last_fullsized":"2024-04-18T04:54:41.173221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455365+0000","last_change":"2024-04-18T04:54:41.186523+0000","last_active":"2024-04-18T04:54:42.455365+0000","last_peered":"2024-04-18T04:54:42.455365+0000","last_clean":"2024-04-18T04:54:42.455365+0000","last_became_active":"2024-04-18T04:54:41.186149+0000","last_became_peered":"2024-04-18T04:54:41.186149+0000","last_unstale":"2024-04-18T04:54:42.455365+0000","last_undegraded":"2024-04-18T04:54:42.455365+0000","last_fullsized":"2024-04-18T04:54:42.455365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.164056+0000","last_change":"2024-04-18T04:54:35.674328+0000","last_active":"2024-04-18T04:54:41.164056+0000","last_peered":"2024-04-18T04:54:41.164056+0000","last_clean":"2024-04-18T04:54:41.164056+0000","last_became_active":"2024-04-18T04:54:35.672457+0000","last_became_peered":"2024-04-18T04:54:35.672457+0000","last_unstale":"2024-04-18T04:54:41.164056+0000","last_undegraded":"2024-04-18T04:54:41.164056+0000","last_fullsized":"2024-04-18T04:54:41.164056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_clean_scrub_stamp":"2024-04-18T04:54:33.597974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:02:10.966568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.178915+0000","last_change":"2024-04-18T04:54:40.802422+0000","last_active":"2024-04-18T04:54:41.178915+0000","last_peered":"2024-04-18T04:54:41.178915+0000","last_clean":"2024-04-18T04:54:41.178915+0000","last_became_active":"2024-04-18T04:54:40.801083+0000","last_became_peered":"2024-04-18T04:54:40.801083+0000","last_unstale":"2024-04-18T04:54:41.178915+0000","last_undegraded":"2024-04-18T04:54:41.178915+0000","last_fullsized":"2024-04-18T04:54:41.178915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170437+0000","last_change":"2024-04-18T04:54:41.174658+0000","last_active":"2024-04-18T04:54:42.170437+0000","last_peered":"2024-04-18T04:54:42.170437+0000","last_clean":"2024-04-18T04:54:42.170437+0000","last_became_active":"2024-04-18T04:54:41.174391+0000","last_became_peered":"2024-04-18T04:54:41.174391+0000","last_unstale":"2024-04-18T04:54:42.170437+0000","last_undegraded":"2024-04-18T04:54:42.170437+0000","last_fullsized":"2024-04-18T04:54:42.170437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:28:24.015964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.185583+0000","last_change":"2024-04-18T04:54:40.813770+0000","last_active":"2024-04-18T04:54:41.185583+0000","last_peered":"2024-04-18T04:54:41.185583+0000","last_clean":"2024-04-18T04:54:41.185583+0000","last_became_active":"2024-04-18T04:54:40.813396+0000","last_became_peered":"2024-04-18T04:54:40.813396+0000","last_unstale":"2024-04-18T04:54:41.185583+0000","last_undegraded":"2024-04-18T04:54:41.185583+0000","last_fullsized":"2024-04-18T04:54:41.185583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455360+0000","last_change":"2024-04-18T04:54:41.195440+0000","last_active":"2024-04-18T04:54:42.455360+0000","last_peered":"2024-04-18T04:54:42.455360+0000","last_clean":"2024-04-18T04:54:42.455360+0000","last_became_active":"2024-04-18T04:54:41.195152+0000","last_became_peered":"2024-04-18T04:54:41.195152+0000","last_unstale":"2024-04-18T04:54:42.455360+0000","last_undegraded":"2024-04-18T04:54:42.455360+0000","last_fullsized":"2024-04-18T04:54:42.455360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.178775+0000","last_change":"2024-04-18T04:54:40.818806+0000","last_active":"2024-04-18T04:54:41.178775+0000","last_peered":"2024-04-18T04:54:41.178775+0000","last_clean":"2024-04-18T04:54:41.178775+0000","last_became_active":"2024-04-18T04:54:40.818113+0000","last_became_peered":"2024-04-18T04:54:40.818113+0000","last_unstale":"2024-04-18T04:54:41.178775+0000","last_undegraded":"2024-04-18T04:54:41.178775+0000","last_fullsized":"2024-04-18T04:54:41.178775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169410+0000","last_change":"2024-04-18T04:54:41.192576+0000","last_active":"2024-04-18T04:54:42.169410+0000","last_peered":"2024-04-18T04:54:42.169410+0000","last_clean":"2024-04-18T04:54:42.169410+0000","last_became_active":"2024-04-18T04:54:41.192187+0000","last_became_peered":"2024-04-18T04:54:41.192187+0000","last_unstale":"2024-04-18T04:54:42.169410+0000","last_undegraded":"2024-04-18T04:54:42.169410+0000","last_fullsized":"2024-04-18T04:54:42.169410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.179509+0000","last_change":"2024-04-18T04:54:40.820531+0000","last_active":"2024-04-18T04:54:41.179509+0000","last_peered":"2024-04-18T04:54:41.179509+0000","last_clean":"2024-04-18T04:54:41.179509+0000","last_became_active":"2024-04-18T04:54:40.820025+0000","last_became_peered":"2024-04-18T04:54:40.820025+0000","last_unstale":"2024-04-18T04:54:41.179509+0000","last_undegraded":"2024-04-18T04:54:41.179509+0000","last_fullsized":"2024-04-18T04:54:41.179509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:35.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323461+0000","last_change":"2024-04-18T04:54:41.186361+0000","last_active":"2024-04-18T04:54:42.323461+0000","last_peered":"2024-04-18T04:54:42.323461+0000","last_clean":"2024-04-18T04:54:42.323461+0000","last_became_active":"2024-04-18T04:54:41.185257+0000","last_became_peered":"2024-04-18T04:54:41.185257+0000","last_unstale":"2024-04-18T04:54:42.323461+0000","last_undegraded":"2024-04-18T04:54:42.323461+0000","last_fullsized":"2024-04-18T04:54:42.323461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.179191+0000","last_change":"2024-04-18T04:54:40.824668+0000","last_active":"2024-04-18T04:54:41.179191+0000","last_peered":"2024-04-18T04:54:41.179191+0000","last_clean":"2024-04-18T04:54:41.179191+0000","last_became_active":"2024-04-18T04:54:40.824206+0000","last_became_peered":"2024-04-18T04:54:40.824206+0000","last_unstale":"2024-04-18T04:54:41.179191+0000","last_undegraded":"2024-04-18T04:54:41.179191+0000","last_fullsized":"2024-04-18T04:54:41.179191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453990+0000","last_change":"2024-04-18T04:54:41.195487+0000","last_active":"2024-04-18T04:54:42.453990+0000","last_peered":"2024-04-18T04:54:42.453990+0000","last_clean":"2024-04-18T04:54:42.453990+0000","last_became_active":"2024-04-18T04:54:41.195177+0000","last_became_peered":"2024-04-18T04:54:41.195177+0000","last_unstale":"2024-04-18T04:54:42.453990+0000","last_undegraded":"2024-04-18T04:54:42.453990+0000","last_fullsized":"2024-04-18T04:54:42.453990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:25.853413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.185102+0000","last_change":"2024-04-18T04:54:40.803387+0000","last_active":"2024-04-18T04:54:41.185102+0000","last_peered":"2024-04-18T04:54:41.185102+0000","last_clean":"2024-04-18T04:54:41.185102+0000","last_became_active":"2024-04-18T04:54:40.802902+0000","last_became_peered":"2024-04-18T04:54:40.802902+0000","last_unstale":"2024-04-18T04:54:41.185102+0000","last_undegraded":"2024-04-18T04:54:41.185102+0000","last_fullsized":"2024-04-18T04:54:41.185102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.456062+0000","last_change":"2024-04-18T04:54:41.195382+0000","last_active":"2024-04-18T04:54:42.456062+0000","last_peered":"2024-04-18T04:54:42.456062+0000","last_clean":"2024-04-18T04:54:42.456062+0000","last_became_active":"2024-04-18T04:54:41.194965+0000","last_became_peered":"2024-04-18T04:54:41.194965+0000","last_unstale":"2024-04-18T04:54:42.456062+0000","last_undegraded":"2024-04-18T04:54:42.456062+0000","last_fullsized":"2024-04-18T04:54:42.456062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:39:50.932794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.171218+0000","last_change":"2024-04-18T04:54:40.800651+0000","last_active":"2024-04-18T04:54:42.171218+0000","last_peered":"2024-04-18T04:54:42.171218+0000","last_clean":"2024-04-18T04:54:42.171218+0000","last_became_active":"2024-04-18T04:54:40.798574+0000","last_became_peered":"2024-04-18T04:54:40.798574+0000","last_unstale":"2024-04-18T04:54:42.171218+0000","last_undegraded":"2024-04-18T04:54:42.171218+0000","last_fullsized":"2024-04-18T04:54:42.171218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:55.712985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170747+0000","last_change":"2024-04-18T04:54:41.191679+0000","last_active":"2024-04-18T04:54:42.170747+0000","last_peered":"2024-04-18T04:54:42.170747+0000","last_clean":"2024-04-18T04:54:42.170747+0000","last_became_active":"2024-04-18T04:54:41.191124+0000","last_became_peered":"2024-04-18T04:54:41.191124+0000","last_unstale":"2024-04-18T04:54:42.170747+0000","last_undegraded":"2024-04-18T04:54:42.170747+0000","last_fullsized":"2024-04-18T04:54:42.170747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.296860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.196985+0000","last_change":"2024-04-18T04:54:40.804085+0000","last_active":"2024-04-18T04:54:41.196985+0000","last_peered":"2024-04-18T04:54:41.196985+0000","last_clean":"2024-04-18T04:54:41.196985+0000","last_became_active":"2024-04-18T04:54:40.803616+0000","last_became_peered":"2024-04-18T04:54:40.803616+0000","last_unstale":"2024-04-18T04:54:41.196985+0000","last_undegraded":"2024-04-18T04:54:41.196985+0000","last_fullsized":"2024-04-18T04:54:41.196985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:55.405415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170788+0000","last_change":"2024-04-18T04:54:41.185453+0000","last_active":"2024-04-18T04:54:42.170788+0000","last_peered":"2024-04-18T04:54:42.170788+0000","last_clean":"2024-04-18T04:54:42.170788+0000","last_became_active":"2024-04-18T04:54:41.185217+0000","last_became_peered":"2024-04-18T04:54:41.185217+0000","last_unstale":"2024-04-18T04:54:42.170788+0000","last_undegraded":"2024-04-18T04:54:42.170788+0000","last_fullsized":"2024-04-18T04:54:42.170788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:44:42.484978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.173081+0000","last_change":"2024-04-18T04:54:40.801317+0000","last_active":"2024-04-18T04:54:41.173081+0000","last_peered":"2024-04-18T04:54:41.173081+0000","last_clean":"2024-04-18T04:54:41.173081+0000","last_became_active":"2024-04-18T04:54:40.800598+0000","last_became_peered":"2024-04-18T04:54:40.800598+0000","last_unstale":"2024-04-18T04:54:41.173081+0000","last_undegraded":"2024-04-18T04:54:41.173081+0000","last_fullsized":"2024-04-18T04:54:41.173081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454296+0000","last_change":"2024-04-18T04:54:41.197813+0000","last_active":"2024-04-18T04:54:42.454296+0000","last_peered":"2024-04-18T04:54:42.454296+0000","last_clean":"2024-04-18T04:54:42.454296+0000","last_became_active":"2024-04-18T04:54:41.197201+0000","last_became_peered":"2024-04-18T04:54:41.197201+0000","last_unstale":"2024-04-18T04:54:42.454296+0000","last_undegraded":"2024-04-18T04:54:42.454296+0000","last_fullsized":"2024-04-18T04:54:42.454296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.171356+0000","last_change":"2024-04-18T04:54:40.800416+0000","last_active":"2024-04-18T04:54:42.171356+0000","last_peered":"2024-04-18T04:54:42.171356+0000","last_clean":"2024-04-18T04:54:42.171356+0000","last_became_active":"2024-04-18T04:54:40.797471+0000","last_became_peered":"2024-04-18T04:54:40.797471+0000","last_unstale":"2024-04-18T04:54:42.171356+0000","last_undegraded":"2024-04-18T04:54:42.171356+0000","last_fullsized":"2024-04-18T04:54:42.171356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:33.118670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170092+0000","last_change":"2024-04-18T04:54:41.192024+0000","last_active":"2024-04-18T04:54:42.170092+0000","last_peered":"2024-04-18T04:54:42.170092+0000","last_clean":"2024-04-18T04:54:42.170092+0000","last_became_active":"2024-04-18T04:54:41.191488+0000","last_became_peered":"2024-04-18T04:54:41.191488+0000","last_unstale":"2024-04-18T04:54:42.170092+0000","last_undegraded":"2024-04-18T04:54:42.170092+0000","last_fullsized":"2024-04-18T04:54:42.170092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:39:31.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.172821+0000","last_change":"2024-04-18T04:54:40.823863+0000","last_active":"2024-04-18T04:54:41.172821+0000","last_peered":"2024-04-18T04:54:41.172821+0000","last_clean":"2024-04-18T04:54:41.172821+0000","last_became_active":"2024-04-18T04:54:40.823277+0000","last_became_peered":"2024-04-18T04:54:40.823277+0000","last_unstale":"2024-04-18T04:54:41.172821+0000","last_undegraded":"2024-04-18T04:54:41.172821+0000","last_fullsized":"2024-04-18T04:54:41.172821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454635+0000","last_change":"2024-04-18T04:54:41.199981+0000","last_active":"2024-04-18T04:54:42.454635+0000","last_peered":"2024-04-18T04:54:42.454635+0000","last_clean":"2024-04-18T04:54:42.454635+0000","last_became_active":"2024-04-18T04:54:41.199700+0000","last_became_peered":"2024-04-18T04:54:41.199700+0000","last_unstale":"2024-04-18T04:54:42.454635+0000","last_undegraded":"2024-04-18T04:54:42.454635+0000","last_fullsized":"2024-04-18T04:54:42.454635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.178744+0000","last_change":"2024-04-18T04:54:40.800740+0000","last_active":"2024-04-18T04:54:41.178744+0000","last_peered":"2024-04-18T04:54:41.178744+0000","last_clean":"2024-04-18T04:54:41.178744+0000","last_became_active":"2024-04-18T04:54:40.800405+0000","last_became_peered":"2024-04-18T04:54:40.800405+0000","last_unstale":"2024-04-18T04:54:41.178744+0000","last_undegraded":"2024-04-18T04:54:41.178744+0000","last_fullsized":"2024-04-18T04:54:41.178744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454668+0000","last_change":"2024-04-18T04:54:41.192487+0000","last_active":"2024-04-18T04:54:42.454668+0000","last_peered":"2024-04-18T04:54:42.454668+0000","last_clean":"2024-04-18T04:54:42.454668+0000","last_became_active":"2024-04-18T04:54:41.186301+0000","last_became_peered":"2024-04-18T04:54:41.186301+0000","last_unstale":"2024-04-18T04:54:42.454668+0000","last_undegraded":"2024-04-18T04:54:42.454668+0000","last_fullsized":"2024-04-18T04:54:42.454668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455262+0000","last_change":"2024-04-18T04:54:41.193260+0000","last_active":"2024-04-18T04:54:42.455262+0000","last_peered":"2024-04-18T04:54:42.455262+0000","last_clean":"2024-04-18T04:54:42.455262+0000","last_became_active":"2024-04-18T04:54:41.192941+0000","last_became_peered":"2024-04-18T04:54:41.192941+0000","last_unstale":"2024-04-18T04:54:42.455262+0000","last_undegraded":"2024-04-18T04:54:42.455262+0000","last_fullsized":"2024-04-18T04:54:42.455262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.174110+0000","last_change":"2024-04-18T04:54:40.800162+0000","last_active":"2024-04-18T04:54:41.174110+0000","last_peered":"2024-04-18T04:54:41.174110+0000","last_clean":"2024-04-18T04:54:41.174110+0000","last_became_active":"2024-04-18T04:54:40.799517+0000","last_became_peered":"2024-04-18T04:54:40.799517+0000","last_unstale":"2024-04-18T04:54:41.174110+0000","last_undegraded":"2024-04-18T04:54:41.174110+0000","last_fullsized":"2024-04-18T04:54:41.174110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167393+0000","last_change":"2024-04-18T04:54:41.179695+0000","last_active":"2024-04-18T04:54:42.167393+0000","last_peered":"2024-04-18T04:54:42.167393+0000","last_clean":"2024-04-18T04:54:42.167393+0000","last_became_active":"2024-04-18T04:54:41.179359+0000","last_became_peered":"2024-04-18T04:54:41.179359+0000","last_unstale":"2024-04-18T04:54:42.167393+0000","last_undegraded":"2024-04-18T04:54:42.167393+0000","last_fullsized":"2024-04-18T04:54:42.167393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.174292+0000","last_change":"2024-04-18T04:54:40.801178+0000","last_active":"2024-04-18T04:54:41.174292+0000","last_peered":"2024-04-18T04:54:41.174292+0000","last_clean":"2024-04-18T04:54:41.174292+0000","last_became_active":"2024-04-18T04:54:40.800660+0000","last_became_peered":"2024-04-18T04:54:40.800660+0000","last_unstale":"2024-04-18T04:54:41.174292+0000","last_undegraded":"2024-04-18T04:54:41.174292+0000","last_fullsized":"2024-04-18T04:54:41.174292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170091+0000","last_change":"2024-04-18T04:54:41.190055+0000","last_active":"2024-04-18T04:54:42.170091+0000","last_peered":"2024-04-18T04:54:42.170091+0000","last_clean":"2024-04-18T04:54:42.170091+0000","last_became_active":"2024-04-18T04:54:41.189344+0000","last_became_peered":"2024-04-18T04:54:41.189344+0000","last_unstale":"2024-04-18T04:54:42.170091+0000","last_undegraded":"2024-04-18T04:54:42.170091+0000","last_fullsized":"2024-04-18T04:54:42.170091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.175599+0000","last_change":"2024-04-18T04:54:40.813931+0000","last_active":"2024-04-18T04:54:41.175599+0000","last_peered":"2024-04-18T04:54:41.175599+0000","last_clean":"2024-04-18T04:54:41.175599+0000","last_became_active":"2024-04-18T04:54:40.813290+0000","last_became_peered":"2024-04-18T04:54:40.813290+0000","last_unstale":"2024-04-18T04:54:41.175599+0000","last_undegraded":"2024-04-18T04:54:41.175599+0000","last_fullsized":"2024-04-18T04:54:41.175599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170238+0000","last_change":"2024-04-18T04:54:41.192913+0000","last_active":"2024-04-18T04:54:42.170238+0000","last_peered":"2024-04-18T04:54:42.170238+0000","last_clean":"2024-04-18T04:54:42.170238+0000","last_became_active":"2024-04-18T04:54:41.192096+0000","last_became_peered":"2024-04-18T04:54:41.192096+0000","last_unstale":"2024-04-18T04:54:42.170238+0000","last_undegraded":"2024-04-18T04:54:42.170238+0000","last_fullsized":"2024-04-18T04:54:42.170238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:37:53.082409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170973+0000","last_change":"2024-04-18T04:54:40.805596+0000","last_active":"2024-04-18T04:54:42.170973+0000","last_peered":"2024-04-18T04:54:42.170973+0000","last_clean":"2024-04-18T04:54:42.170973+0000","last_became_active":"2024-04-18T04:54:40.804913+0000","last_became_peered":"2024-04-18T04:54:40.804913+0000","last_unstale":"2024-04-18T04:54:42.170973+0000","last_undegraded":"2024-04-18T04:54:42.170973+0000","last_fullsized":"2024-04-18T04:54:42.170973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:44.772589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509443,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":663457,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]}]},{"osd":1,"up_from":15,"seq":64424509443,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":663457,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:54:47.509 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-18T04:54:47.510 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-18T04:54:47.510 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-18T04:54:47.510 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-18T04:54:47.510 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-18T04:54:47.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.659+0000 7fc620727640 1 Processor -- start 2024-04-18T04:54:47.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc620727640 1 -- start start 2024-04-18T04:54:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc620727640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc61806d930 0x7fc618070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc620727640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc6180c1870 0x7fc618156050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc620727640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6180721e0 con 0x7fc61806dd10 2024-04-18T04:54:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc620727640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6180c48a0 con 0x7fc6180c1870 2024-04-18T04:54:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc620727640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61806e1c0 con 0x7fc61806d930 2024-04-18T04:54:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61ecc4640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc61806dd10 0x7fc6180c4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39764/0 (socket says 172.21.15.96:39764) 2024-04-18T04:54:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61ecc4640 1 -- 172.21.15.96:0/234082333 learned_addr learned my addr 172.21.15.96:0/234082333 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61d4c1640 1 -- 172.21.15.96:0/234082333 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263490299 0 0) 0x7fc6180721e0 con 0x7fc61806dd10 2024-04-18T04:54:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61d4c1640 1 -- 172.21.15.96:0/234082333 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc604003530 con 0x7fc61806dd10 2024-04-18T04:54:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61e4c3640 1 --2- 172.21.15.96:0/234082333 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc61806d930 0x7fc618070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61dcc2640 1 --2- 172.21.15.96:0/234082333 >> v2:172.21.15.139:3300/0 conn(0x7fc6180c1870 0x7fc618156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61d4c1640 1 -- 172.21.15.96:0/234082333 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3282996542 0 0) 0x7fc604003530 con 0x7fc61806dd10 2024-04-18T04:54:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61d4c1640 1 -- 172.21.15.96:0/234082333 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc61806d930 msgr2=0x7fc618070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61d4c1640 1 --2- 172.21.15.96:0/234082333 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc61806d930 0x7fc618070fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61d4c1640 1 -- 172.21.15.96:0/234082333 >> v2:172.21.15.139:3300/0 conn(0x7fc6180c1870 msgr2=0x7fc618156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61d4c1640 1 --2- 172.21.15.96:0/234082333 >> v2:172.21.15.139:3300/0 conn(0x7fc6180c1870 0x7fc618156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61d4c1640 1 -- 172.21.15.96:0/234082333 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc618070730 con 0x7fc61806dd10 2024-04-18T04:54:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61d4c1640 1 -- 172.21.15.96:0/234082333 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fc610001a00 con 0x7fc61806dd10 2024-04-18T04:54:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61d4c1640 1 -- 172.21.15.96:0/234082333 >> v1:172.21.15.96:6789/0 conn(0x7fc61806dd10 legacy=0x7fc6180c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61d4c1640 1 --2- 172.21.15.96:0/234082333 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc61806d930 0x7fc604003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61d4c1640 1 --2- 172.21.15.96:0/234082333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc604004000 0x7fc6040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61d4c1640 1 --2- 172.21.15.96:0/234082333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc604004d10 0x7fc604005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61d4c1640 1 -- 172.21.15.96:0/234082333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61806e1c0 con 0x7fc604004d10 2024-04-18T04:54:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61d4c1640 1 -- 172.21.15.96:0/234082333 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60400bb00 con 0x7fc604004000 2024-04-18T04:54:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61d4c1640 1 -- 172.21.15.96:0/234082333 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60400bcc0 con 0x7fc61806d930 2024-04-18T04:54:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61ecc4640 1 --2- 172.21.15.96:0/234082333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc604004d10 0x7fc604005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61e4c3640 1 --2- 172.21.15.96:0/234082333 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc61806d930 0x7fc604003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61dcc2640 1 --2- 172.21.15.96:0/234082333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc604004000 0x7fc6040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61ecc4640 1 -- 172.21.15.96:0/234082333 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc61806d930 msgr2=0x7fc604003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61ecc4640 1 --2- 172.21.15.96:0/234082333 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc61806d930 0x7fc604003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61ecc4640 1 -- 172.21.15.96:0/234082333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc604004000 msgr2=0x7fc6040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61ecc4640 1 --2- 172.21.15.96:0/234082333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc604004000 0x7fc6040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61ecc4640 1 -- 172.21.15.96:0/234082333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604003530 con 0x7fc604004d10 2024-04-18T04:54:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61dcc2640 1 --2- 172.21.15.96:0/234082333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc604004000 0x7fc6040047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.663+0000 7fc61e4c3640 1 --2- 172.21.15.96:0/234082333 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc61806d930 0x7fc604003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:47.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61ecc4640 1 --2- 172.21.15.96:0/234082333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc604004d10 0x7fc604005190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc61000a780 tx=0x7fc61001d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef49e9c67e01ee77 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:47.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61d4c1640 1 -- 172.21.15.96:0/234082333 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6100ad630 con 0x7fc604004d10 2024-04-18T04:54:47.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61d4c1640 1 -- 172.21.15.96:0/234082333 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6100a8070 con 0x7fc604004d10 2024-04-18T04:54:47.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61d4c1640 1 -- 172.21.15.96:0/234082333 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6100ada10 con 0x7fc604004d10 2024-04-18T04:54:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc620727640 1 -- 172.21.15.96:0/234082333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc604004d10 msgr2=0x7fc604005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc620727640 1 --2- 172.21.15.96:0/234082333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc604004d10 0x7fc604005190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc61000a780 tx=0x7fc61001d2a0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61ecc4640 1 -- 172.21.15.96:0/234082333 reap_dead start 2024-04-18T04:54:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc620727640 1 -- 172.21.15.96:0/234082333 shutdown_connections 2024-04-18T04:54:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc620727640 1 -- 172.21.15.96:0/234082333 >> 172.21.15.96:0/234082333 conn(0x7fc61806c750 msgr2=0x7fc6180c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc620727640 1 -- 172.21.15.96:0/234082333 shutdown_connections 2024-04-18T04:54:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc620727640 1 -- 172.21.15.96:0/234082333 wait complete. 2024-04-18T04:54:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc620727640 1 Processor -- start 2024-04-18T04:54:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc620727640 1 -- start start 2024-04-18T04:54:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc620727640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6181536f0 0x7fc618153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc620727640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc618154010 0x7fc618140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc620727640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc6180c6ff0 0x7fc618141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc620727640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc618155260 con 0x7fc6181536f0 2024-04-18T04:54:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc620727640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61814e950 con 0x7fc618154010 2024-04-18T04:54:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc620727640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6181ef370 con 0x7fc6180c6ff0 2024-04-18T04:54:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61e4c3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6181536f0 0x7fc618153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61e4c3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6181536f0 0x7fc618153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54516/0 (socket says 172.21.15.96:54516) 2024-04-18T04:54:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61e4c3640 1 -- 172.21.15.96:0/4060944706 learned_addr learned my addr 172.21.15.96:0/4060944706 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61ecc4640 1 --2- 172.21.15.96:0/4060944706 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc6180c6ff0 0x7fc618141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61dcc2640 1 --2- 172.21.15.96:0/4060944706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc618154010 0x7fc618140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61e4c3640 1 -- 172.21.15.96:0/4060944706 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc6180c6ff0 msgr2=0x7fc618141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61e4c3640 1 --2- 172.21.15.96:0/4060944706 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc6180c6ff0 0x7fc618141280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61e4c3640 1 -- 172.21.15.96:0/4060944706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc618154010 msgr2=0x7fc618140d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61e4c3640 1 --2- 172.21.15.96:0/4060944706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc618154010 0x7fc618140d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61e4c3640 1 -- 172.21.15.96:0/4060944706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61814e670 con 0x7fc6181536f0 2024-04-18T04:54:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61dcc2640 1 --2- 172.21.15.96:0/4060944706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc618154010 0x7fc618140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc61e4c3640 1 --2- 172.21.15.96:0/4060944706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6181536f0 0x7fc618153ad0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc61400e810 tx=0x7fc61400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc60effd640 1 -- 172.21.15.96:0/4060944706 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61400c6d0 con 0x7fc6181536f0 2024-04-18T04:54:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc60effd640 1 -- 172.21.15.96:0/4060944706 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61400c830 con 0x7fc6181536f0 2024-04-18T04:54:47.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc60effd640 1 -- 172.21.15.96:0/4060944706 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61400cba0 con 0x7fc6181536f0 2024-04-18T04:54:47.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc620727640 1 -- 172.21.15.96:0/4060944706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc618154ef0 con 0x7fc6181536f0 2024-04-18T04:54:47.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.667+0000 7fc620727640 1 -- 172.21.15.96:0/4060944706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc618154990 con 0x7fc6181536f0 2024-04-18T04:54:47.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.671+0000 7fc620727640 1 -- 172.21.15.96:0/4060944706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc618067050 con 0x7fc6181536f0 2024-04-18T04:54:47.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.671+0000 7fc60effd640 1 -- 172.21.15.96:0/4060944706 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc61400cd00 con 0x7fc6181536f0 2024-04-18T04:54:47.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.671+0000 7fc60effd640 1 --2- 172.21.15.96:0/4060944706 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5fc066690 0x7fc5fc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:47.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.671+0000 7fc60effd640 1 -- 172.21.15.96:0/4060944706 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc614083f20 con 0x7fc6181536f0 2024-04-18T04:54:47.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.671+0000 7fc61dcc2640 1 --2- 172.21.15.96:0/4060944706 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5fc066690 0x7fc5fc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:47.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.671+0000 7fc61dcc2640 1 --2- 172.21.15.96:0/4060944706 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5fc066690 0x7fc5fc068b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc6180c6320 tx=0x7fc608008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:47.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.675+0000 7fc60effd640 1 -- 172.21.15.96:0/4060944706 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc614051290 con 0x7fc6181536f0 2024-04-18T04:54:47.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.855+0000 7fc620727640 1 -- 172.21.15.96:0/4060944706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc6180c68c0 con 0x7fc6181536f0 2024-04-18T04:54:47.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.863+0000 7fc60effd640 1 -- 172.21.15.96:0/4060944706 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164885 (secure 0 0 0) 0x7fc6140548b0 con 0x7fc6181536f0 2024-04-18T04:54:47.865 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:47.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.863+0000 7fc620727640 1 -- 172.21.15.96:0/4060944706 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5fc066690 msgr2=0x7fc5fc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:47.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.863+0000 7fc620727640 1 --2- 172.21.15.96:0/4060944706 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5fc066690 0x7fc5fc068b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc6180c6320 tx=0x7fc608008040 comp rx=0 tx=0).stop 2024-04-18T04:54:47.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.863+0000 7fc620727640 1 -- 172.21.15.96:0/4060944706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6181536f0 msgr2=0x7fc618153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:47.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.863+0000 7fc620727640 1 --2- 172.21.15.96:0/4060944706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6181536f0 0x7fc618153ad0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc61400e810 tx=0x7fc61400ecd0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.863+0000 7fc620727640 1 -- 172.21.15.96:0/4060944706 shutdown_connections 2024-04-18T04:54:47.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.863+0000 7fc620727640 1 --2- 172.21.15.96:0/4060944706 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5fc066690 0x7fc5fc068b50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.863+0000 7fc620727640 1 --2- 172.21.15.96:0/4060944706 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc6180c6ff0 0x7fc618141280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.863+0000 7fc620727640 1 --2- 172.21.15.96:0/4060944706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc618154010 0x7fc618140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.863+0000 7fc620727640 1 --2- 172.21.15.96:0/4060944706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6181536f0 0x7fc618153ad0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:47.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.863+0000 7fc620727640 1 -- 172.21.15.96:0/4060944706 >> 172.21.15.96:0/4060944706 conn(0x7fc61806c750 msgr2=0x7fc618147bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:47.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.863+0000 7fc620727640 1 -- 172.21.15.96:0/4060944706 shutdown_connections 2024-04-18T04:54:47.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.863+0000 7fc620727640 1 -- 172.21.15.96:0/4060944706 wait complete. 2024-04-18T04:54:47.881 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":27400},{"type":"v1","addr":"172.21.15.96:6833","nonce":27400}]},"active_addr":"172.21.15.96:6833/27400","active_change":"2024-04-18T04:54:28.555927+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":3479041354}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":1192077462}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":2200696387}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":2016343510}]}]} 2024-04-18T04:54:47.885 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-18T04:54:47.885 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-18T04:54:47.885 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:54:48.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.999+0000 7f1bca7b3640 1 Processor -- start 2024-04-18T04:54:48.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.999+0000 7f1bca7b3640 1 -- start start 2024-04-18T04:54:48.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.999+0000 7f1bca7b3640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1bc4070a40 0x7f1bc4156130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.999+0000 7f1bca7b3640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc4159380 con 0x7f1bc40c60e0 2024-04-18T04:54:48.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.999+0000 7f1bca7b3640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc4159620 con 0x7f1bc4150260 2024-04-18T04:54:48.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.999+0000 7f1bca7b3640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc415a1a0 con 0x7f1bc4070a40 2024-04-18T04:54:48.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.999+0000 7f1bc3fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1bc40c60e0 0x7f1bc414fb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39778/0 (socket says 172.21.15.96:39778) 2024-04-18T04:54:48.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.999+0000 7f1bc3fff640 1 -- 172.21.15.96:0/2430352484 learned_addr learned my addr 172.21.15.96:0/2430352484 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:48.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.999+0000 7f1bbb7fe640 1 --2- 172.21.15.96:0/2430352484 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1bc4070a40 0x7f1bc4156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.999+0000 7f1bc37fe640 1 -- 172.21.15.96:0/2430352484 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349585083 0 0) 0x7f1bc4159380 con 0x7f1bc40c60e0 2024-04-18T04:54:48.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:47.999+0000 7f1bc37fe640 1 -- 172.21.15.96:0/2430352484 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bb0003530 con 0x7f1bc40c60e0 2024-04-18T04:54:48.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc37fe640 1 -- 172.21.15.96:0/2430352484 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3799122798 0 0) 0x7f1bb0003530 con 0x7f1bc40c60e0 2024-04-18T04:54:48.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc37fe640 1 -- 172.21.15.96:0/2430352484 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1bc4070a40 msgr2=0x7f1bc4156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc37fe640 1 --2- 172.21.15.96:0/2430352484 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1bc4070a40 0x7f1bc4156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc37fe640 1 -- 172.21.15.96:0/2430352484 >> v1:172.21.15.139:6789/0 conn(0x7f1bc4150260 legacy=0x7f1bc4160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc37fe640 1 -- 172.21.15.96:0/2430352484 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc4159900 con 0x7f1bc40c60e0 2024-04-18T04:54:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc37fe640 1 -- 172.21.15.96:0/2430352484 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f1bac001680 con 0x7f1bc40c60e0 2024-04-18T04:54:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc37fe640 1 -- 172.21.15.96:0/2430352484 >> v1:172.21.15.96:6789/0 conn(0x7f1bc40c60e0 legacy=0x7f1bc414fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc37fe640 1 --2- 172.21.15.96:0/2430352484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00039b0 0x7f1bb0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc37fe640 1 --2- 172.21.15.96:0/2430352484 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1bb00047d0 0x7f1bb0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc37fe640 1 --2- 172.21.15.96:0/2430352484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1bb0005150 0x7f1bb000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc37fe640 1 -- 172.21.15.96:0/2430352484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc415a1a0 con 0x7f1bb00039b0 2024-04-18T04:54:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc37fe640 1 -- 172.21.15.96:0/2430352484 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb000bed0 con 0x7f1bb0005150 2024-04-18T04:54:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc37fe640 1 -- 172.21.15.96:0/2430352484 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb000c010 con 0x7f1bb00047d0 2024-04-18T04:54:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc3fff640 1 --2- 172.21.15.96:0/2430352484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00039b0 0x7f1bb0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc8d50640 1 --2- 172.21.15.96:0/2430352484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1bb0005150 0x7f1bb000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc3fff640 1 -- 172.21.15.96:0/2430352484 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1bb00047d0 msgr2=0x7f1bb0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc3fff640 1 --2- 172.21.15.96:0/2430352484 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1bb00047d0 0x7f1bb0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc3fff640 1 -- 172.21.15.96:0/2430352484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1bb0005150 msgr2=0x7f1bb000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc3fff640 1 --2- 172.21.15.96:0/2430352484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1bb0005150 0x7f1bb000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc3fff640 1 -- 172.21.15.96:0/2430352484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb0003530 con 0x7f1bb00039b0 2024-04-18T04:54:48.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc3fff640 1 --2- 172.21.15.96:0/2430352484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00039b0 0x7f1bb0003dd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00c240 tx=0x7f1bac01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d93112b2e5f82b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc37fe640 1 -- 172.21.15.96:0/2430352484 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac005ae0 con 0x7f1bb00039b0 2024-04-18T04:54:48.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc37fe640 1 -- 172.21.15.96:0/2430352484 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bac005c40 con 0x7f1bb00039b0 2024-04-18T04:54:48.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc37fe640 1 -- 172.21.15.96:0/2430352484 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0a5830 con 0x7f1bb00039b0 2024-04-18T04:54:48.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bca7b3640 1 -- 172.21.15.96:0/2430352484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00039b0 msgr2=0x7f1bb0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bca7b3640 1 --2- 172.21.15.96:0/2430352484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00039b0 0x7f1bb0003dd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00c240 tx=0x7f1bac01cc60 comp rx=0 tx=0).stop 2024-04-18T04:54:48.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bc8d50640 1 -- 172.21.15.96:0/2430352484 reap_dead start 2024-04-18T04:54:48.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bca7b3640 1 -- 172.21.15.96:0/2430352484 shutdown_connections 2024-04-18T04:54:48.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bca7b3640 1 -- 172.21.15.96:0/2430352484 >> 172.21.15.96:0/2430352484 conn(0x7f1bc406c750 msgr2=0x7f1bc40c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bca7b3640 1 -- 172.21.15.96:0/2430352484 shutdown_connections 2024-04-18T04:54:48.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.003+0000 7f1bca7b3640 1 -- 172.21.15.96:0/2430352484 wait complete. 2024-04-18T04:54:48.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bca7b3640 1 Processor -- start 2024-04-18T04:54:48.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bca7b3640 1 -- start start 2024-04-18T04:54:48.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bca7b3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00039b0 0x7f1bc414f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bca7b3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1bc414d460 0x7f1bc40c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bca7b3640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1bc4139ba0 0x7f1bc413a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bca7b3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc414ded0 con 0x7f1bb00039b0 2024-04-18T04:54:48.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bca7b3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc4144880 con 0x7f1bc414d460 2024-04-18T04:54:48.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bca7b3640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc4144220 con 0x7f1bc4139ba0 2024-04-18T04:54:48.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bc3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00039b0 0x7f1bc414f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bc3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00039b0 0x7f1bc414f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54536/0 (socket says 172.21.15.96:54536) 2024-04-18T04:54:48.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bc3fff640 1 -- 172.21.15.96:0/674755259 learned_addr learned my addr 172.21.15.96:0/674755259 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:48.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bbb7fe640 1 --2- 172.21.15.96:0/674755259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1bc414d460 0x7f1bc40c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bc8d50640 1 --2- 172.21.15.96:0/674755259 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1bc4139ba0 0x7f1bc413a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bc3fff640 1 -- 172.21.15.96:0/674755259 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1bc4139ba0 msgr2=0x7f1bc413a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bc3fff640 1 --2- 172.21.15.96:0/674755259 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1bc4139ba0 0x7f1bc413a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bc3fff640 1 -- 172.21.15.96:0/674755259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1bc414d460 msgr2=0x7f1bc40c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bc3fff640 1 --2- 172.21.15.96:0/674755259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1bc414d460 0x7f1bc40c4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bc3fff640 1 -- 172.21.15.96:0/674755259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc415b810 con 0x7f1bb00039b0 2024-04-18T04:54:48.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bc3fff640 1 --2- 172.21.15.96:0/674755259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00039b0 0x7f1bc414f130 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1bac001940 tx=0x7f1bb0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bc17fa640 1 -- 172.21.15.96:0/674755259 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0b4070 con 0x7f1bb00039b0 2024-04-18T04:54:48.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bc17fa640 1 -- 172.21.15.96:0/674755259 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bac005e70 con 0x7f1bb00039b0 2024-04-18T04:54:48.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bca7b3640 1 -- 172.21.15.96:0/674755259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc40caa00 con 0x7f1bb00039b0 2024-04-18T04:54:48.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bc17fa640 1 -- 172.21.15.96:0/674755259 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac001640 con 0x7f1bb00039b0 2024-04-18T04:54:48.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bca7b3640 1 -- 172.21.15.96:0/674755259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc40cafc0 con 0x7f1bb00039b0 2024-04-18T04:54:48.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bca7b3640 1 -- 172.21.15.96:0/674755259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc414dc30 con 0x7f1bb00039b0 2024-04-18T04:54:48.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bc17fa640 1 -- 172.21.15.96:0/674755259 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1bac0a5830 con 0x7f1bb00039b0 2024-04-18T04:54:48.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bc17fa640 1 --2- 172.21.15.96:0/674755259 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1ba40666c0 0x7f1ba4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bc17fa640 1 -- 172.21.15.96:0/674755259 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1bac11d120 con 0x7f1bb00039b0 2024-04-18T04:54:48.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.007+0000 7f1bbb7fe640 1 --2- 172.21.15.96:0/674755259 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1ba40666c0 0x7f1ba4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.011+0000 7f1bbb7fe640 1 --2- 172.21.15.96:0/674755259 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1ba40666c0 0x7f1ba4068b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40c6cc0 tx=0x7f1bb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.015+0000 7f1bc17fa640 1 -- 172.21.15.96:0/674755259 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1bc414dc30 con 0x7f1bb00039b0 2024-04-18T04:54:48.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.159+0000 7f1bca7b3640 1 -- 172.21.15.96:0/674755259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bc414dc30 con 0x7f1bb00039b0 2024-04-18T04:54:48.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.159+0000 7f1bc17fa640 1 -- 172.21.15.96:0/674755259 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f1bc414dc30 con 0x7f1bb00039b0 2024-04-18T04:54:48.163 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:48.163 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":21,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:54:42.161552+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:54:39.219441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:54:40.139557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.720340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.767224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.811511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.710188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.860525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.704784+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:54:48.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.163+0000 7f1bca7b3640 1 -- 172.21.15.96:0/674755259 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1ba40666c0 msgr2=0x7f1ba4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.163+0000 7f1bca7b3640 1 --2- 172.21.15.96:0/674755259 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1ba40666c0 0x7f1ba4068b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40c6cc0 tx=0x7f1bb4008040 comp rx=0 tx=0).stop 2024-04-18T04:54:48.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.163+0000 7f1bca7b3640 1 -- 172.21.15.96:0/674755259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00039b0 msgr2=0x7f1bc414f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.163+0000 7f1bca7b3640 1 --2- 172.21.15.96:0/674755259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00039b0 0x7f1bc414f130 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1bac001940 tx=0x7f1bb0005800 comp rx=0 tx=0).stop 2024-04-18T04:54:48.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.163+0000 7f1bca7b3640 1 -- 172.21.15.96:0/674755259 shutdown_connections 2024-04-18T04:54:48.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.163+0000 7f1bca7b3640 1 --2- 172.21.15.96:0/674755259 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1ba40666c0 0x7f1ba4068b80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.163+0000 7f1bca7b3640 1 --2- 172.21.15.96:0/674755259 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1bc4139ba0 0x7f1bc413a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.163+0000 7f1bca7b3640 1 --2- 172.21.15.96:0/674755259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1bc414d460 0x7f1bc40c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.163+0000 7f1bca7b3640 1 --2- 172.21.15.96:0/674755259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00039b0 0x7f1bc414f130 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.163+0000 7f1bca7b3640 1 -- 172.21.15.96:0/674755259 >> 172.21.15.96:0/674755259 conn(0x7f1bc406c750 msgr2=0x7f1bc4155590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.163+0000 7f1bca7b3640 1 -- 172.21.15.96:0/674755259 shutdown_connections 2024-04-18T04:54:48.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.163+0000 7f1bca7b3640 1 -- 172.21.15.96:0/674755259 wait complete. 2024-04-18T04:54:48.180 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-18T04:54:48.180 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:54:48.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5afc95d640 1 Processor -- start 2024-04-18T04:54:48.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5afc95d640 1 -- start start 2024-04-18T04:54:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5afc95d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5af8151080 0x7f5af815ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5afc95d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5af815b070 0x7f5af80c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5afc95d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af80c6c20 con 0x7f5af8156ea0 2024-04-18T04:54:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5afc95d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af80c41b0 con 0x7f5af8151080 2024-04-18T04:54:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5afc95d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af815a6a0 con 0x7f5af815b070 2024-04-18T04:54:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5af659c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5af8151080 0x7f5af815ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5af659c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5af8151080 0x7f5af815ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54548/0 (socket says 172.21.15.96:54548) 2024-04-18T04:54:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5af659c640 1 -- 172.21.15.96:0/203765637 learned_addr learned my addr 172.21.15.96:0/203765637 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5af6d9d640 1 --2- 172.21.15.96:0/203765637 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5af815b070 0x7f5af80c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5af659c640 1 -- 172.21.15.96:0/203765637 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5af815b070 msgr2=0x7f5af80c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5af659c640 1 --2- 172.21.15.96:0/203765637 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5af815b070 0x7f5af80c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5af659c640 1 -- 172.21.15.96:0/203765637 >> v1:172.21.15.96:6789/0 conn(0x7f5af8156ea0 legacy=0x7f5af80c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5af559a640 1 -- 172.21.15.96:0/203765637 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436240935 0 0) 0x7f5af80c6c20 con 0x7f5af8156ea0 2024-04-18T04:54:48.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5af659c640 1 -- 172.21.15.96:0/203765637 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af81573e0 con 0x7f5af8151080 2024-04-18T04:54:48.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5af6d9d640 1 --2- 172.21.15.96:0/203765637 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5af815b070 0x7f5af80c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:48.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5af659c640 1 --2- 172.21.15.96:0/203765637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5af8151080 0x7f5af815ab30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009870 tx=0x7f5ae801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360da06619054a3a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.299+0000 7f5af559a640 1 -- 172.21.15.96:0/203765637 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80ab670 con 0x7f5af8151080 2024-04-18T04:54:48.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5af559a640 1 -- 172.21.15.96:0/203765637 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae80ab7d0 con 0x7f5af8151080 2024-04-18T04:54:48.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5af559a640 1 -- 172.21.15.96:0/203765637 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80abb60 con 0x7f5af8151080 2024-04-18T04:54:48.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 -- 172.21.15.96:0/203765637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5af8151080 msgr2=0x7f5af815ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 --2- 172.21.15.96:0/203765637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5af8151080 0x7f5af815ab30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009870 tx=0x7f5ae801c560 comp rx=0 tx=0).stop 2024-04-18T04:54:48.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 -- 172.21.15.96:0/203765637 shutdown_connections 2024-04-18T04:54:48.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 --2- 172.21.15.96:0/203765637 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5af815b070 0x7f5af80c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 --2- 172.21.15.96:0/203765637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5af8151080 0x7f5af815ab30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 -- 172.21.15.96:0/203765637 >> 172.21.15.96:0/203765637 conn(0x7f5af806c750 msgr2=0x7f5af80c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 -- 172.21.15.96:0/203765637 shutdown_connections 2024-04-18T04:54:48.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 -- 172.21.15.96:0/203765637 wait complete. 2024-04-18T04:54:48.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 Processor -- start 2024-04-18T04:54:48.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 -- start start 2024-04-18T04:54:48.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5af8151080 0x7f5af8159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5af8156ea0 0x7f5af815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5af815b070 0x7f5af81ef670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af815c090 con 0x7f5af815b070 2024-04-18T04:54:48.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af81f2be0 con 0x7f5af8156ea0 2024-04-18T04:54:48.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af81f2ec0 con 0x7f5af8151080 2024-04-18T04:54:48.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5af6d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5af815b070 0x7f5af81ef670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5af6d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5af815b070 0x7f5af81ef670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54560/0 (socket says 172.21.15.96:54560) 2024-04-18T04:54:48.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5af6d9d640 1 -- 172.21.15.96:0/1242931941 learned_addr learned my addr 172.21.15.96:0/1242931941 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:48.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5af5d9b640 1 --2- 172.21.15.96:0/1242931941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5af8156ea0 0x7f5af815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5af659c640 1 --2- 172.21.15.96:0/1242931941 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5af8151080 0x7f5af8159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5af6d9d640 1 -- 172.21.15.96:0/1242931941 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5af8151080 msgr2=0x7f5af8159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5af6d9d640 1 --2- 172.21.15.96:0/1242931941 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5af8151080 0x7f5af8159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5af6d9d640 1 -- 172.21.15.96:0/1242931941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5af8156ea0 msgr2=0x7f5af815b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5af6d9d640 1 --2- 172.21.15.96:0/1242931941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5af8156ea0 0x7f5af815b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5af6d9d640 1 -- 172.21.15.96:0/1242931941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae80094d0 con 0x7f5af815b070 2024-04-18T04:54:48.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5af6d9d640 1 --2- 172.21.15.96:0/1242931941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5af815b070 0x7f5af81ef670 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5af000cd50 tx=0x7f5af000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5aeeffd640 1 -- 172.21.15.96:0/1242931941 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000f680 con 0x7f5af815b070 2024-04-18T04:54:48.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5aeeffd640 1 -- 172.21.15.96:0/1242931941 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af000f800 con 0x7f5af815b070 2024-04-18T04:54:48.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 -- 172.21.15.96:0/1242931941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af81f31a0 con 0x7f5af815b070 2024-04-18T04:54:48.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5aeeffd640 1 -- 172.21.15.96:0/1242931941 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000fbb0 con 0x7f5af815b070 2024-04-18T04:54:48.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.303+0000 7f5afc95d640 1 -- 172.21.15.96:0/1242931941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af81f3760 con 0x7f5af815b070 2024-04-18T04:54:48.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.307+0000 7f5afc95d640 1 -- 172.21.15.96:0/1242931941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af806cce0 con 0x7f5af815b070 2024-04-18T04:54:48.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.307+0000 7f5aeeffd640 1 -- 172.21.15.96:0/1242931941 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5af000b040 con 0x7f5af815b070 2024-04-18T04:54:48.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.307+0000 7f5aeeffd640 1 --2- 172.21.15.96:0/1242931941 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ad8066690 0x7f5ad8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.307+0000 7f5aeeffd640 1 -- 172.21.15.96:0/1242931941 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5af0084b30 con 0x7f5af815b070 2024-04-18T04:54:48.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.307+0000 7f5af659c640 1 --2- 172.21.15.96:0/1242931941 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ad8066690 0x7f5ad8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.307+0000 7f5af659c640 1 --2- 172.21.15.96:0/1242931941 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ad8066690 0x7f5ad8068b50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80af000 tx=0x7f5ae80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.311+0000 7f5aeeffd640 1 -- 172.21.15.96:0/1242931941 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f5af0051f30 con 0x7f5af815b070 2024-04-18T04:54:48.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.455+0000 7f5afc95d640 1 -- 172.21.15.96:0/1242931941 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5af8067050 con 0x7f5af815b070 2024-04-18T04:54:48.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.459+0000 7f5aeeffd640 1 -- 172.21.15.96:0/1242931941 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f5af0055550 con 0x7f5af815b070 2024-04-18T04:54:48.459 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:48.459 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":21,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:54:42.161552+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:54:39.219441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:54:40.139557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.720340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.767224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.811511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.710188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.860525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.704784+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:54:48.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.459+0000 7f5afc95d640 1 -- 172.21.15.96:0/1242931941 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ad8066690 msgr2=0x7f5ad8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.459+0000 7f5afc95d640 1 --2- 172.21.15.96:0/1242931941 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ad8066690 0x7f5ad8068b50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80af000 tx=0x7f5ae80a7000 comp rx=0 tx=0).stop 2024-04-18T04:54:48.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.459+0000 7f5afc95d640 1 -- 172.21.15.96:0/1242931941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5af815b070 msgr2=0x7f5af81ef670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.459+0000 7f5afc95d640 1 --2- 172.21.15.96:0/1242931941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5af815b070 0x7f5af81ef670 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5af000cd50 tx=0x7f5af000a650 comp rx=0 tx=0).stop 2024-04-18T04:54:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.459+0000 7f5afc95d640 1 -- 172.21.15.96:0/1242931941 shutdown_connections 2024-04-18T04:54:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.459+0000 7f5afc95d640 1 --2- 172.21.15.96:0/1242931941 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ad8066690 0x7f5ad8068b50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.459+0000 7f5afc95d640 1 --2- 172.21.15.96:0/1242931941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5af815b070 0x7f5af81ef670 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.459+0000 7f5afc95d640 1 --2- 172.21.15.96:0/1242931941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5af8156ea0 0x7f5af815b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.459+0000 7f5afc95d640 1 --2- 172.21.15.96:0/1242931941 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5af8151080 0x7f5af8159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.459+0000 7f5afc95d640 1 -- 172.21.15.96:0/1242931941 >> 172.21.15.96:0/1242931941 conn(0x7f5af806c750 msgr2=0x7f5af80c5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.459+0000 7f5afc95d640 1 -- 172.21.15.96:0/1242931941 shutdown_connections 2024-04-18T04:54:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.459+0000 7f5afc95d640 1 -- 172.21.15.96:0/1242931941 wait complete. 2024-04-18T04:54:48.477 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-18T04:54:48.477 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-18T04:54:48.478 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-18T04:54:48.478 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-18T04:54:48.479 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-18T04:54:48.479 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-18T04:54:48.479 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-18T04:54:48.480 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-18T04:54:48.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07f09df640 1 Processor -- start 2024-04-18T04:54:48.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07f09df640 1 -- start start 2024-04-18T04:54:48.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f645c825640 1 Processor -- start 2024-04-18T04:54:48.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f645c825640 1 -- start start 2024-04-18T04:54:48.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07f09df640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f07ec0c1290 0x7f07ec0c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07f09df640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f07ec06d750 0x7f07ec06dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07f09df640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ec0c2ef0 con 0x7f07ec150d70 2024-04-18T04:54:48.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07f09df640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ec0c0db0 con 0x7f07ec0c1290 2024-04-18T04:54:48.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07f09df640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ec0c1910 con 0x7f07ec06d750 2024-04-18T04:54:48.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07ea59c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f07ec150d70 0x7f07ec156ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39796/0 (socket says 172.21.15.96:39796) 2024-04-18T04:54:48.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07ea59c640 1 -- 172.21.15.96:0/2723294549 learned_addr learned my addr 172.21.15.96:0/2723294549 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:48.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07ead9d640 1 --2- 172.21.15.96:0/2723294549 >> v2:172.21.15.139:3300/0 conn(0x7f07ec06d750 0x7f07ec06dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07e9d9b640 1 --2- 172.21.15.96:0/2723294549 >> v2:172.21.15.96:3300/0 conn(0x7f07ec0c1290 0x7f07ec0c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f645c825640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6458157210 0x7f64580cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f645c825640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6458071a90 0x7f645815d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f645c825640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64580c8000 con 0x7f64580cb8e0 2024-04-18T04:54:48.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f645c825640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64580cbe50 con 0x7f6458071a90 2024-04-18T04:54:48.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f645c825640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64580c82e0 con 0x7f6458157210 2024-04-18T04:54:48.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07e959a640 1 -- 172.21.15.96:0/2723294549 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014362945 0 0) 0x7f07ec0c2ef0 con 0x7f07ec150d70 2024-04-18T04:54:48.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f6457fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6458071a90 0x7f645815d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f6457fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6458071a90 0x7f645815d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54574/0 (socket says 172.21.15.96:54574) 2024-04-18T04:54:48.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f6457fff640 1 -- 172.21.15.96:0/175209929 learned_addr learned my addr 172.21.15.96:0/175209929 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:48.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07e959a640 1 -- 172.21.15.96:0/2723294549 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07d8003530 con 0x7f07ec150d70 2024-04-18T04:54:48.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07ead9d640 1 -- 172.21.15.96:0/2723294549 >> v2:172.21.15.96:3300/0 conn(0x7f07ec0c1290 msgr2=0x7f07ec0c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07ead9d640 1 --2- 172.21.15.96:0/2723294549 >> v2:172.21.15.96:3300/0 conn(0x7f07ec0c1290 0x7f07ec0c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07ead9d640 1 -- 172.21.15.96:0/2723294549 >> v1:172.21.15.96:6789/0 conn(0x7f07ec150d70 legacy=0x7f07ec156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f07ead9d640 1 -- 172.21.15.96:0/2723294549 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec0c1bf0 con 0x7f07ec06d750 2024-04-18T04:54:48.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f6457fff640 1 -- 172.21.15.96:0/175209929 >> v2:172.21.15.139:3300/0 conn(0x7f6458157210 msgr2=0x7f64580cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f64577fe640 1 --2- 172.21.15.96:0/175209929 >> v2:172.21.15.139:3300/0 conn(0x7f6458157210 0x7f64580cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f6457fff640 1 --2- 172.21.15.96:0/175209929 >> v2:172.21.15.139:3300/0 conn(0x7f6458157210 0x7f64580cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f6457fff640 1 -- 172.21.15.96:0/175209929 >> v1:172.21.15.96:6789/0 conn(0x7f64580cb8e0 legacy=0x7f645806a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f6457fff640 1 -- 172.21.15.96:0/175209929 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64580c85c0 con 0x7f6458071a90 2024-04-18T04:54:48.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f64577fe640 1 --2- 172.21.15.96:0/175209929 >> v2:172.21.15.139:3300/0 conn(0x7f6458157210 0x7f64580cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:48.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f9abd8bb640 1 Processor -- start 2024-04-18T04:54:48.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f9abd8bb640 1 -- start start 2024-04-18T04:54:48.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f9abd8bb640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9ab80c7ea0 0x7f9ab80c4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f9abd8bb640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab808abf0 con 0x7f9ab806fc60 2024-04-18T04:54:48.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f9abd8bb640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab8071140 con 0x7f9ab808a810 2024-04-18T04:54:48.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f9abd8bb640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80c82b0 con 0x7f9ab80c7ea0 2024-04-18T04:54:48.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f9ab7fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f9ab806fc60 0x7f9ab816e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39822/0 (socket says 172.21.15.96:39822) 2024-04-18T04:54:48.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f9ab7fff640 1 -- 172.21.15.96:0/4113699335 learned_addr learned my addr 172.21.15.96:0/4113699335 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:48.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f9abd0ba640 1 --2- 172.21.15.96:0/4113699335 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9ab80c7ea0 0x7f9ab80c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f9ab77fe640 1 -- 172.21.15.96:0/4113699335 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927182463 0 0) 0x7f9ab8071140 con 0x7f9ab808a810 2024-04-18T04:54:48.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f9ab77fe640 1 -- 172.21.15.96:0/4113699335 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aa0003510 con 0x7f9ab808a810 2024-04-18T04:54:48.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f9ab77fe640 1 -- 172.21.15.96:0/4113699335 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233814890 0 0) 0x7f9ab808abf0 con 0x7f9ab806fc60 2024-04-18T04:54:48.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.655+0000 7f9ab77fe640 1 -- 172.21.15.96:0/4113699335 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ab8071140 con 0x7f9ab806fc60 2024-04-18T04:54:48.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9ab77fe640 1 -- 172.21.15.96:0/4113699335 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1799694762 0 0) 0x7f9ab8071140 con 0x7f9ab806fc60 2024-04-18T04:54:48.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9ab77fe640 1 -- 172.21.15.96:0/4113699335 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9ab80c7ea0 msgr2=0x7f9ab80c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9ab77fe640 1 --2- 172.21.15.96:0/4113699335 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9ab80c7ea0 0x7f9ab80c4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9ab77fe640 1 -- 172.21.15.96:0/4113699335 >> v1:172.21.15.139:6789/0 conn(0x7f9ab808a810 legacy=0x7f9ab8069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9ab77fe640 1 -- 172.21.15.96:0/4113699335 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab8071420 con 0x7f9ab806fc60 2024-04-18T04:54:48.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9ab77fe640 1 -- 172.21.15.96:0/4113699335 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f9ab0001a00 con 0x7f9ab806fc60 2024-04-18T04:54:48.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9ab77fe640 1 -- 172.21.15.96:0/4113699335 >> v1:172.21.15.96:6789/0 conn(0x7f9ab806fc60 legacy=0x7f9ab816e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9ab77fe640 1 --2- 172.21.15.96:0/4113699335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa0004d80 0x7f9aa00038a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9ab77fe640 1 --2- 172.21.15.96:0/4113699335 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9aa0003ef0 0x7f9aa0004370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7ff9ec073640 1 Processor -- start 2024-04-18T04:54:48.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9ab77fe640 1 --2- 172.21.15.96:0/4113699335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa0009240 0x7f9aa000b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f6457fff640 1 --2- 172.21.15.96:0/175209929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6458071a90 0x7f645815d220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f64580c8fb0 tx=0x7f645001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afeab347f3986c73 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7ff9ec073640 1 -- start start 2024-04-18T04:54:48.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9ab77fe640 1 -- 172.21.15.96:0/4113699335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80c82b0 con 0x7f9aa0004d80 2024-04-18T04:54:48.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9ab77fe640 1 -- 172.21.15.96:0/4113699335 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa000bf10 con 0x7f9aa0009240 2024-04-18T04:54:48.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9ab77fe640 1 -- 172.21.15.96:0/4113699335 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa000c0d0 con 0x7f9aa0003ef0 2024-04-18T04:54:48.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9abc8b9640 1 --2- 172.21.15.96:0/4113699335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa0004d80 0x7f9aa00038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9ab7fff640 1 --2- 172.21.15.96:0/4113699335 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9aa0003ef0 0x7f9aa0004370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f07ead9d640 1 --2- 172.21.15.96:0/2723294549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07ec06d750 0x7f07ec06dbc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07ec072680 tx=0x7f07d401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc2a007662649a8c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9abd0ba640 1 --2- 172.21.15.96:0/4113699335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa0009240 0x7f9aa000b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9abc8b9640 1 -- 172.21.15.96:0/4113699335 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9aa0003ef0 msgr2=0x7f9aa0004370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9abc8b9640 1 --2- 172.21.15.96:0/4113699335 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9aa0003ef0 0x7f9aa0004370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9abc8b9640 1 -- 172.21.15.96:0/4113699335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa0009240 msgr2=0x7f9aa000b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9abc8b9640 1 --2- 172.21.15.96:0/4113699335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa0009240 0x7f9aa000b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f9abc8b9640 1 -- 172.21.15.96:0/4113699335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab8071140 con 0x7f9aa0004d80 2024-04-18T04:54:48.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f7a3d7bc640 1 Processor -- start 2024-04-18T04:54:48.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f1dda064640 1 Processor -- start 2024-04-18T04:54:48.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f7a3d7bc640 1 -- start start 2024-04-18T04:54:48.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f07e959a640 1 -- 172.21.15.96:0/2723294549 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40ab600 con 0x7f07ec06d750 2024-04-18T04:54:48.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f07e959a640 1 -- 172.21.15.96:0/2723294549 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d40a7050 con 0x7f07ec06d750 2024-04-18T04:54:48.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f07e959a640 1 -- 172.21.15.96:0/2723294549 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40ab980 con 0x7f07ec06d750 2024-04-18T04:54:48.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7ff9ec073640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff9dc0dd6e0 0x7ff9dc0e3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7ff9ec073640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff9dc0e6900 0x7ff9dc006ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7ff9ec073640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9dc0071e0 0x7ff9dc04e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7ff9ec073640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9dc04dbe0 con 0x7ff9dc0e6900 2024-04-18T04:54:48.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7ff9ec073640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9dc0ddac0 con 0x7ff9dc0dd6e0 2024-04-18T04:54:48.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7ff9ec073640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc0e39b0 con 0x7ff9dc0071e0 2024-04-18T04:54:48.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f7a3d7bc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7a38153150 0x7f7a38071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f7a3d7bc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7a3815c170 0x7f7a3815c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f7a3d7bc640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a38159bd0 con 0x7f7a38152d70 2024-04-18T04:54:48.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f7a3d7bc640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a380cbea0 con 0x7f7a3815c170 2024-04-18T04:54:48.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f7a3d7bc640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a38158c00 con 0x7f7a38153150 2024-04-18T04:54:48.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f07f09df640 1 -- 172.21.15.96:0/2723294549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07ec06d750 msgr2=0x7f07ec06dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f07f09df640 1 --2- 172.21.15.96:0/2723294549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07ec06d750 0x7f07ec06dbc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07ec072680 tx=0x7f07d401c3f0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f1dda064640 1 -- start start 2024-04-18T04:54:48.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f07f09df640 1 -- 172.21.15.96:0/2723294549 shutdown_connections 2024-04-18T04:54:48.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f07f09df640 1 --2- 172.21.15.96:0/2723294549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07ec06d750 0x7f07ec06dbc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f07f09df640 1 --2- 172.21.15.96:0/2723294549 >> v2:172.21.15.96:3300/0 conn(0x7f07ec0c1290 0x7f07ec0c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f07f09df640 1 -- 172.21.15.96:0/2723294549 >> 172.21.15.96:0/2723294549 conn(0x7f07ec069e60 msgr2=0x7f07ec06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f1dda064640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dcc034700 0x7f1dcc0dac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f7a3cfbb640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7a3815c170 0x7f7a3815c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f07f09df640 1 -- 172.21.15.96:0/2723294549 shutdown_connections 2024-04-18T04:54:48.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f07f09df640 1 -- 172.21.15.96:0/2723294549 wait complete. 2024-04-18T04:54:48.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f1dda064640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc0dba60 con 0x7f1dcc050c10 2024-04-18T04:54:48.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f1dda064640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc04b8f0 con 0x7f1dcc0d4f60 2024-04-18T04:54:48.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f1dda064640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc04beb0 con 0x7f1dcc034700 2024-04-18T04:54:48.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f7a377fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7a38153150 0x7f7a38071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f7a3cfbb640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7a3815c170 0x7f7a3815c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:52426/0 (socket says 172.21.15.96:52426) 2024-04-18T04:54:48.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f7a3cfbb640 1 -- 172.21.15.96:0/661348341 learned_addr learned my addr 172.21.15.96:0/661348341 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:48.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7ff9e9e0f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff9dc0dd6e0 0x7ff9dc0e3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f1dd2ffd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dcc034700 0x7f1dcc0dac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f1dd2ffd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dcc034700 0x7f1dcc0dac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:52750/0 (socket says 172.21.15.96:52750) 2024-04-18T04:54:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7f1dd2ffd640 1 -- 172.21.15.96:0/1059176884 learned_addr learned my addr 172.21.15.96:0/1059176884 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7ff9ea610640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9dc0071e0 0x7ff9dc04e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7ff9e9e0f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff9dc0dd6e0 0x7ff9dc0e3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:52422/0 (socket says 172.21.15.96:52422) 2024-04-18T04:54:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7ff9e9e0f640 1 -- 172.21.15.96:0/3971320790 learned_addr learned my addr 172.21.15.96:0/3971320790 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:48.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f64567fc640 1 -- 172.21.15.96:0/175209929 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64500af400 con 0x7f6458071a90 2024-04-18T04:54:48.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f64567fc640 1 -- 172.21.15.96:0/175209929 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64500ab050 con 0x7f6458071a90 2024-04-18T04:54:48.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f64567fc640 1 -- 172.21.15.96:0/175209929 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64500af780 con 0x7f6458071a90 2024-04-18T04:54:48.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7ff9e960e640 1 --2- 172.21.15.96:0/3971320790 >> v2:172.21.15.96:3300/0 conn(0x7ff9dc0e6900 0x7ff9dc006ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7fdffad1e640 1 Processor -- start 2024-04-18T04:54:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7fdffad1e640 1 -- start start 2024-04-18T04:54:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7fdffad1e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdfec0dd490 0x7fdfec005e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7fdffad1e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfec0063b0 con 0x7fdfec04c670 2024-04-18T04:54:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7fdffad1e640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfec0dd870 con 0x7fdfec045910 2024-04-18T04:54:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.659+0000 7fdffad1e640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfec006640 con 0x7fdfec0dd490 2024-04-18T04:54:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f47a2049640 1 Processor -- start 2024-04-18T04:54:48.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff951b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fdfec04c670 0x7fdfec045200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39850/0 (socket says 172.21.15.96:39850) 2024-04-18T04:54:48.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff951b640 1 -- 172.21.15.96:0/853776222 learned_addr learned my addr 172.21.15.96:0/853776222 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:48.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff9d1c640 1 --2- 172.21.15.96:0/853776222 >> v2:172.21.15.139:3300/0 conn(0x7fdfec0dd490 0x7fdfec005e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff8d1a640 1 -- 172.21.15.96:0/853776222 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200649315 0 0) 0x7fdfec0063b0 con 0x7fdfec04c670 2024-04-18T04:54:48.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff8d1a640 1 -- 172.21.15.96:0/853776222 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfe0003530 con 0x7fdfec04c670 2024-04-18T04:54:48.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f9abc8b9640 1 --2- 172.21.15.96:0/4113699335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa0004d80 0x7f9aa00038a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9aac001910 tx=0x7f9aac01c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c899baa0aa14e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f645c825640 1 -- 172.21.15.96:0/175209929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6458071a90 msgr2=0x7f645815d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f645c825640 1 --2- 172.21.15.96:0/175209929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6458071a90 0x7f645815d220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f64580c8fb0 tx=0x7f645001f1e0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f645c825640 1 -- 172.21.15.96:0/175209929 shutdown_connections 2024-04-18T04:54:48.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f645c825640 1 --2- 172.21.15.96:0/175209929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6458071a90 0x7f645815d220 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f645c825640 1 --2- 172.21.15.96:0/175209929 >> v2:172.21.15.139:3300/0 conn(0x7f6458157210 0x7f64580cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f645c825640 1 -- 172.21.15.96:0/175209929 >> 172.21.15.96:0/175209929 conn(0x7f645806af70 msgr2=0x7f645806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07f09df640 1 Processor -- start 2024-04-18T04:54:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07f09df640 1 -- start start 2024-04-18T04:54:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f7a3cfbb640 1 -- 172.21.15.96:0/661348341 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7a38153150 msgr2=0x7f7a38071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f7a3cfbb640 1 --2- 172.21.15.96:0/661348341 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7a38153150 0x7f7a38071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f7a3cfbb640 1 -- 172.21.15.96:0/661348341 >> v1:172.21.15.96:6789/0 conn(0x7f7a38152d70 legacy=0x7f7a380cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f7a3cfbb640 1 -- 172.21.15.96:0/661348341 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a380cbbc0 con 0x7f7a3815c170 2024-04-18T04:54:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f9ab77fe640 1 -- 172.21.15.96:0/4113699335 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac005330 con 0x7f9aa0004d80 2024-04-18T04:54:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f9ab77fe640 1 -- 172.21.15.96:0/4113699335 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac005490 con 0x7f9aa0004d80 2024-04-18T04:54:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f9ab77fe640 1 -- 172.21.15.96:0/4113699335 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac003800 con 0x7f9aa0004d80 2024-04-18T04:54:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f9abd8bb640 1 -- 172.21.15.96:0/4113699335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa0004d80 msgr2=0x7f9aa00038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f9abd8bb640 1 --2- 172.21.15.96:0/4113699335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa0004d80 0x7f9aa00038a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9aac001910 tx=0x7f9aac01c5c0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f9abd0ba640 1 -- 172.21.15.96:0/4113699335 reap_dead start 2024-04-18T04:54:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f9abd8bb640 1 -- 172.21.15.96:0/4113699335 shutdown_connections 2024-04-18T04:54:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f9abd8bb640 1 -- 172.21.15.96:0/4113699335 >> 172.21.15.96:0/4113699335 conn(0x7f9ab806c1f0 msgr2=0x7f9ab8065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f645c825640 1 -- 172.21.15.96:0/175209929 shutdown_connections 2024-04-18T04:54:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07f09df640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f07ec06d750 0x7f07ec152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07f09df640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07ec0c1290 0x7f07ec14b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07f09df640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07ec150d70 0x7f07ec14bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07f09df640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec153690 con 0x7f07ec150d70 2024-04-18T04:54:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07f09df640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec14a450 con 0x7f07ec0c1290 2024-04-18T04:54:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07f09df640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec1538c0 con 0x7f07ec06d750 2024-04-18T04:54:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07ead9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07ec150d70 0x7f07ec14bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07ead9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07ec150d70 0x7f07ec14bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54604/0 (socket says 172.21.15.96:54604) 2024-04-18T04:54:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07ead9d640 1 -- 172.21.15.96:0/1157151695 learned_addr learned my addr 172.21.15.96:0/1157151695 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07ea59c640 1 --2- 172.21.15.96:0/1157151695 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f07ec06d750 0x7f07ec152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07e9d9b640 1 --2- 172.21.15.96:0/1157151695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07ec0c1290 0x7f07ec14b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7ff9e9e0f640 1 -- 172.21.15.96:0/3971320790 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9dc0071e0 msgr2=0x7ff9dc04e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7ff9e9e0f640 1 --2- 172.21.15.96:0/3971320790 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9dc0071e0 0x7ff9dc04e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7ff9e9e0f640 1 -- 172.21.15.96:0/3971320790 >> v2:172.21.15.96:3300/0 conn(0x7ff9dc0e6900 msgr2=0x7ff9dc006ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7ff9e9e0f640 1 --2- 172.21.15.96:0/3971320790 >> v2:172.21.15.96:3300/0 conn(0x7ff9dc0e6900 0x7ff9dc006ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7ff9e9e0f640 1 -- 172.21.15.96:0/3971320790 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc0e3c90 con 0x7ff9dc0dd6e0 2024-04-18T04:54:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff8d1a640 1 -- 172.21.15.96:0/853776222 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3691892931 0 0) 0x7fdfe0003530 con 0x7fdfec04c670 2024-04-18T04:54:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff8d1a640 1 -- 172.21.15.96:0/853776222 >> v2:172.21.15.139:3300/0 conn(0x7fdfec0dd490 msgr2=0x7fdfec005e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff8d1a640 1 --2- 172.21.15.96:0/853776222 >> v2:172.21.15.139:3300/0 conn(0x7fdfec0dd490 0x7fdfec005e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff8d1a640 1 -- 172.21.15.96:0/853776222 >> v1:172.21.15.139:6789/0 conn(0x7fdfec045910 legacy=0x7fdfec0e3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff8d1a640 1 -- 172.21.15.96:0/853776222 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec006920 con 0x7fdfec04c670 2024-04-18T04:54:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff8d1a640 1 -- 172.21.15.96:0/853776222 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fdfe4001680 con 0x7fdfec04c670 2024-04-18T04:54:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff8d1a640 1 -- 172.21.15.96:0/853776222 >> v1:172.21.15.96:6789/0 conn(0x7fdfec04c670 legacy=0x7fdfec045200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff8d1a640 1 --2- 172.21.15.96:0/853776222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe0003980 0x7fdfe0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff8d1a640 1 --2- 172.21.15.96:0/853776222 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdfe00047d0 0x7fdfe0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff8d1a640 1 --2- 172.21.15.96:0/853776222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfe0005190 0x7fdfe000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff8d1a640 1 -- 172.21.15.96:0/853776222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec006640 con 0x7fdfe0003980 2024-04-18T04:54:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff8d1a640 1 -- 172.21.15.96:0/853776222 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe000c040 con 0x7fdfe0005190 2024-04-18T04:54:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff8d1a640 1 -- 172.21.15.96:0/853776222 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe000c200 con 0x7fdfe00047d0 2024-04-18T04:54:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdffa51d640 1 --2- 172.21.15.96:0/853776222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfe0005190 0x7fdfe000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff9d1c640 1 --2- 172.21.15.96:0/853776222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe0003980 0x7fdfe0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff951b640 1 --2- 172.21.15.96:0/853776222 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdfe00047d0 0x7fdfe0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff9d1c640 1 -- 172.21.15.96:0/853776222 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdfe00047d0 msgr2=0x7fdfe0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff9d1c640 1 --2- 172.21.15.96:0/853776222 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdfe00047d0 0x7fdfe0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff9d1c640 1 -- 172.21.15.96:0/853776222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfe0005190 msgr2=0x7fdfe000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff9d1c640 1 --2- 172.21.15.96:0/853776222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfe0005190 0x7fdfe000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff9d1c640 1 -- 172.21.15.96:0/853776222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec006920 con 0x7fdfe0003980 2024-04-18T04:54:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdffa51d640 1 --2- 172.21.15.96:0/853776222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfe0005190 0x7fdfe000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:54:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdffa51d640 1 -- 172.21.15.96:0/853776222 reap_dead start 2024-04-18T04:54:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7fdff951b640 1 --2- 172.21.15.96:0/853776222 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdfe00047d0 0x7fdfe0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:54:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f47a2049640 1 -- start start 2024-04-18T04:54:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f47a2049640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f479c14f080 0x7f479c06fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f47a2049640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c158710 con 0x7f479c06a2b0 2024-04-18T04:54:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f47a2049640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c1589f0 con 0x7f479c0701a0 2024-04-18T04:54:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f47a2049640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c159290 con 0x7f479c14f080 2024-04-18T04:54:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f47a1848640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f479c06a2b0 0x7f479c15f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39854/0 (socket says 172.21.15.96:39854) 2024-04-18T04:54:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f47a1848640 1 -- 172.21.15.96:0/2750032780 learned_addr learned my addr 172.21.15.96:0/2750032780 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f47a1047640 1 --2- 172.21.15.96:0/2750032780 >> v2:172.21.15.139:3300/0 conn(0x7f479c14f080 0x7f479c06fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f4793fff640 1 -- 172.21.15.96:0/2750032780 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912441093 0 0) 0x7f479c158710 con 0x7f479c06a2b0 2024-04-18T04:54:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f4793fff640 1 -- 172.21.15.96:0/2750032780 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4788003530 con 0x7f479c06a2b0 2024-04-18T04:54:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f4793fff640 1 -- 172.21.15.96:0/2750032780 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2461443969 0 0) 0x7f4788003530 con 0x7f479c06a2b0 2024-04-18T04:54:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f4793fff640 1 -- 172.21.15.96:0/2750032780 >> v2:172.21.15.139:3300/0 conn(0x7f479c14f080 msgr2=0x7f479c06fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f4793fff640 1 --2- 172.21.15.96:0/2750032780 >> v2:172.21.15.139:3300/0 conn(0x7f479c14f080 0x7f479c06fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f4793fff640 1 -- 172.21.15.96:0/2750032780 >> v1:172.21.15.139:6789/0 conn(0x7f479c0701a0 legacy=0x7f479c155410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:54:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f4793fff640 1 -- 172.21.15.96:0/2750032780 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c158cd0 con 0x7f479c06a2b0 2024-04-18T04:54:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f4793fff640 1 -- 172.21.15.96:0/2750032780 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f47940051f0 con 0x7f479c06a2b0 2024-04-18T04:54:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f4793fff640 1 -- 172.21.15.96:0/2750032780 >> v1:172.21.15.96:6789/0 conn(0x7f479c06a2b0 legacy=0x7f479c15f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f4793fff640 1 --2- 172.21.15.96:0/2750032780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4788003980 0x7f4788003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f4793fff640 1 --2- 172.21.15.96:0/2750032780 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f47880047d0 0x7f4788004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f4793fff640 1 --2- 172.21.15.96:0/2750032780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4788005190 0x7f478800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f4793fff640 1 -- 172.21.15.96:0/2750032780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c159290 con 0x7f4788005190 2024-04-18T04:54:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f4793fff640 1 -- 172.21.15.96:0/2750032780 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4788014820 con 0x7f4788003980 2024-04-18T04:54:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f4793fff640 1 -- 172.21.15.96:0/2750032780 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47880149e0 con 0x7f47880047d0 2024-04-18T04:54:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f1dd2ffd640 1 -- 172.21.15.96:0/1059176884 >> v1:172.21.15.139:6789/0 conn(0x7f1dcc0d4f60 legacy=0x7f1dcc04c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f1dd2ffd640 1 -- 172.21.15.96:0/1059176884 >> v1:172.21.15.96:6789/0 conn(0x7f1dcc050c10 legacy=0x7f1dcc0e5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f1dd2ffd640 1 -- 172.21.15.96:0/1059176884 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc04bbd0 con 0x7f1dcc034700 2024-04-18T04:54:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07ead9d640 1 -- 172.21.15.96:0/1157151695 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f07ec06d750 msgr2=0x7f07ec152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07ead9d640 1 --2- 172.21.15.96:0/1157151695 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f07ec06d750 0x7f07ec152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07ead9d640 1 -- 172.21.15.96:0/1157151695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07ec0c1290 msgr2=0x7f07ec14b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07ead9d640 1 --2- 172.21.15.96:0/1157151695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07ec0c1290 0x7f07ec14b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07ead9d640 1 -- 172.21.15.96:0/1157151695 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d4009420 con 0x7f07ec150d70 2024-04-18T04:54:48.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f47a1848640 1 --2- 172.21.15.96:0/2750032780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4788005190 0x7f478800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f47a0846640 1 --2- 172.21.15.96:0/2750032780 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f47880047d0 0x7f4788004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f7a3cfbb640 1 --2- 172.21.15.96:0/661348341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a3815c170 0x7f7a3815c5e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7a30009e50 tx=0x7f7a3001f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0b5cafb9b6e21a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f645c825640 1 -- 172.21.15.96:0/175209929 wait complete. 2024-04-18T04:54:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.663+0000 7f07ead9d640 1 --2- 172.21.15.96:0/1157151695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07ec150d70 0x7f07ec14bd40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f07d40ae040 tx=0x7f07d4019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f9abd8bb640 1 -- 172.21.15.96:0/4113699335 shutdown_connections 2024-04-18T04:54:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7ff9e9e0f640 1 --2- 172.21.15.96:0/3971320790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9dc0dd6e0 0x7ff9dc0e3390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4068ab0 tx=0x7ff9e40969d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b839ea0c6384d746 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f07e2ffd640 1 -- 172.21.15.96:0/1157151695 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40abe10 con 0x7f07ec150d70 2024-04-18T04:54:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f47a1848640 1 -- 172.21.15.96:0/2750032780 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f47880047d0 msgr2=0x7f4788004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f47a1848640 1 --2- 172.21.15.96:0/2750032780 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f47880047d0 0x7f4788004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f47a1848640 1 -- 172.21.15.96:0/2750032780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4788003980 msgr2=0x7f4788003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f47a1848640 1 --2- 172.21.15.96:0/2750032780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4788003980 0x7f4788003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f47a1848640 1 -- 172.21.15.96:0/2750032780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c158cd0 con 0x7f4788005190 2024-04-18T04:54:48.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f07e2ffd640 1 -- 172.21.15.96:0/1157151695 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d40b4430 con 0x7f07ec150d70 2024-04-18T04:54:48.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f07f09df640 1 -- 172.21.15.96:0/1157151695 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ec148dc0 con 0x7f07ec150d70 2024-04-18T04:54:48.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f07e2ffd640 1 -- 172.21.15.96:0/1157151695 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40b47c0 con 0x7f07ec150d70 2024-04-18T04:54:48.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f07f09df640 1 -- 172.21.15.96:0/1157151695 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ec147650 con 0x7f07ec150d70 2024-04-18T04:54:48.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7ff9e8e0d640 1 -- 172.21.15.96:0/3971320790 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4120750 con 0x7ff9dc0dd6e0 2024-04-18T04:54:48.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7ff9e8e0d640 1 -- 172.21.15.96:0/3971320790 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e41208b0 con 0x7ff9dc0dd6e0 2024-04-18T04:54:48.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7ff9e8e0d640 1 -- 172.21.15.96:0/3971320790 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4120ce0 con 0x7ff9dc0dd6e0 2024-04-18T04:54:48.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7ff9ec073640 1 -- 172.21.15.96:0/3971320790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9dc0dd6e0 msgr2=0x7ff9dc0e3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7ff9ec073640 1 --2- 172.21.15.96:0/3971320790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9dc0dd6e0 0x7ff9dc0e3390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4068ab0 tx=0x7ff9e40969d0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7fdff9d1c640 1 --2- 172.21.15.96:0/853776222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe0003980 0x7fdfe0003da0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009650 tx=0x7fdff003ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599a45c0d84b4f4c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f1dd2ffd640 1 --2- 172.21.15.96:0/1059176884 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dcc034700 0x7f1dcc0dac90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800bb20 tx=0x7f1dc801e990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5bb591ac6c40ef1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f9abd8bb640 1 -- 172.21.15.96:0/4113699335 wait complete. 2024-04-18T04:54:48.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f9abd8bb640 1 Processor -- start 2024-04-18T04:54:48.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7ff9ec073640 1 -- 172.21.15.96:0/3971320790 shutdown_connections 2024-04-18T04:54:48.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7ff9ec073640 1 --2- 172.21.15.96:0/3971320790 >> v2:172.21.15.96:3300/0 conn(0x7ff9dc0e6900 0x7ff9dc006ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7ff9ec073640 1 --2- 172.21.15.96:0/3971320790 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9dc0071e0 0x7ff9dc04e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7ff9ec073640 1 --2- 172.21.15.96:0/3971320790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9dc0dd6e0 0x7ff9dc0e3390 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4068ab0 tx=0x7ff9e40969d0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7ff9ec073640 1 -- 172.21.15.96:0/3971320790 >> 172.21.15.96:0/3971320790 conn(0x7ff9dc006180 msgr2=0x7ff9dc006590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f7a36ffd640 1 -- 172.21.15.96:0/661348341 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a300af400 con 0x7f7a3815c170 2024-04-18T04:54:48.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f7a36ffd640 1 -- 172.21.15.96:0/661348341 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a300ab050 con 0x7f7a3815c170 2024-04-18T04:54:48.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f645c825640 1 Processor -- start 2024-04-18T04:54:48.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f7a36ffd640 1 -- 172.21.15.96:0/661348341 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a300af780 con 0x7f7a3815c170 2024-04-18T04:54:48.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f7a3d7bc640 1 -- 172.21.15.96:0/661348341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a3815c170 msgr2=0x7f7a3815c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f7a3d7bc640 1 --2- 172.21.15.96:0/661348341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a3815c170 0x7f7a3815c5e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7a30009e50 tx=0x7f7a3001f1e0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f07f09df640 1 -- 172.21.15.96:0/1157151695 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f07ec0c1ed0 con 0x7f07ec150d70 2024-04-18T04:54:48.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7fdff8d1a640 1 -- 172.21.15.96:0/853776222 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff00c7570 con 0x7fdfe0003980 2024-04-18T04:54:48.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7fdff8d1a640 1 -- 172.21.15.96:0/853776222 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff00c76d0 con 0x7fdfe0003980 2024-04-18T04:54:48.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7fdff8d1a640 1 -- 172.21.15.96:0/853776222 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff00c7a60 con 0x7fdfe0003980 2024-04-18T04:54:48.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f1dd27fc640 1 -- 172.21.15.96:0/1059176884 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8004230 con 0x7f1dcc034700 2024-04-18T04:54:48.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f645c825640 1 -- start start 2024-04-18T04:54:48.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f1dd27fc640 1 -- 172.21.15.96:0/1059176884 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc80ab070 con 0x7f1dcc034700 2024-04-18T04:54:48.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f1dd27fc640 1 -- 172.21.15.96:0/1059176884 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8003620 con 0x7f1dcc034700 2024-04-18T04:54:48.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f07e2ffd640 1 -- 172.21.15.96:0/1157151695 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f07d40b2040 con 0x7f07ec150d70 2024-04-18T04:54:48.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f9abd8bb640 1 -- start start 2024-04-18T04:54:48.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7ff9ec073640 1 -- 172.21.15.96:0/3971320790 shutdown_connections 2024-04-18T04:54:48.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7fdffad1e640 1 -- 172.21.15.96:0/853776222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe0003980 msgr2=0x7fdfe0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7fdffad1e640 1 --2- 172.21.15.96:0/853776222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe0003980 0x7fdfe0003da0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009650 tx=0x7fdff003ea80 comp rx=0 tx=0).stop 2024-04-18T04:54:48.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f9abd8bb640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9ab80c5e90 0x7f9ab81edf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f9abd8bb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab80c6270 0x7f9ab81ec230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f9abd8bb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ab81ee8f0 0x7f9ab81ec770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f9abd8bb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab81ed4c0 con 0x7f9ab80c6270 2024-04-18T04:54:48.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f9abd8bb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab81fe4d0 con 0x7f9ab81ee8f0 2024-04-18T04:54:48.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f9abd8bb640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab81ebda0 con 0x7f9ab80c5e90 2024-04-18T04:54:48.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f47a1848640 1 -- 172.21.15.96:0/2750032780 reap_dead start 2024-04-18T04:54:48.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f645c825640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6458071a90 0x7f64581e9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f645c825640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64580cb8e0 0x7f64580c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f645c825640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6458157210 0x7f64581518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f645c825640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645815a4a0 con 0x7f6458071a90 2024-04-18T04:54:48.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f645c825640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6458155460 con 0x7f6458157210 2024-04-18T04:54:48.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f645c825640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64581e31b0 con 0x7f64580cb8e0 2024-04-18T04:54:48.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f07e2ffd640 1 --2- 172.21.15.96:0/1157151695 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f07cc0666e0 0x7f07cc068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f07e2ffd640 1 -- 172.21.15.96:0/1157151695 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07d411dd20 con 0x7f07ec150d70 2024-04-18T04:54:48.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f07ea59c640 1 --2- 172.21.15.96:0/1157151695 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f07cc0666e0 0x7f07cc068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f07e2ffd640 1 --2- 172.21.15.96:0/1157151695 >> [v2:172.21.15.96:6811/27481,v1:172.21.15.96:6815/27481] conn(0x7f07cc06e880 0x7f07cc070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f07e2ffd640 1 -- 172.21.15.96:0/1157151695 --> [v2:172.21.15.96:6811/27481,v1:172.21.15.96:6815/27481] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f07cc071350 con 0x7f07cc06e880 2024-04-18T04:54:48.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f47a1848640 1 --2- 172.21.15.96:0/2750032780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4788005190 0x7f478800b990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4794001750 tx=0x7f479401d060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea973ee7351f2ea server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7ff9ec073640 1 -- 172.21.15.96:0/3971320790 wait complete. 2024-04-18T04:54:48.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f1dda064640 1 -- 172.21.15.96:0/1059176884 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dcc034700 msgr2=0x7f1dcc0dac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f1dda064640 1 --2- 172.21.15.96:0/1059176884 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dcc034700 0x7f1dcc0dac90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800bb20 tx=0x7f1dc801e990 comp rx=0 tx=0).stop 2024-04-18T04:54:48.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f6457fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6458157210 0x7f64581518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f6456ffd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64580cb8e0 0x7f64580c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f6456ffd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64580cb8e0 0x7f64580c6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:52796/0 (socket says 172.21.15.96:52796) 2024-04-18T04:54:48.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f6456ffd640 1 -- 172.21.15.96:0/2738770490 learned_addr learned my addr 172.21.15.96:0/2738770490 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:48.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f64577fe640 1 --2- 172.21.15.96:0/2738770490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6458071a90 0x7f64581e9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f1dda064640 1 -- 172.21.15.96:0/1059176884 shutdown_connections 2024-04-18T04:54:48.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f1dda064640 1 --2- 172.21.15.96:0/1059176884 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dcc034700 0x7f1dcc0dac90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f1dda064640 1 -- 172.21.15.96:0/1059176884 >> 172.21.15.96:0/1059176884 conn(0x7f1dcc0500f0 msgr2=0x7f1dcc050500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f9abd0ba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ab81ee8f0 0x7f9ab81ec770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f9abd0ba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ab81ee8f0 0x7f9ab81ec770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:52476/0 (socket says 172.21.15.96:52476) 2024-04-18T04:54:48.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f9abd0ba640 1 -- 172.21.15.96:0/3035999949 learned_addr learned my addr 172.21.15.96:0/3035999949 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:48.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f9ab7fff640 1 --2- 172.21.15.96:0/3035999949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab80c6270 0x7f9ab81ec230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f9abc8b9640 1 --2- 172.21.15.96:0/3035999949 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9ab80c5e90 0x7f9ab81edf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f07ea59c640 1 --2- 172.21.15.96:0/1157151695 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f07cc0666e0 0x7f07cc068ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0011f0 tx=0x7f07dc007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f7a3d7bc640 1 -- 172.21.15.96:0/661348341 shutdown_connections 2024-04-18T04:54:48.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f7a3d7bc640 1 --2- 172.21.15.96:0/661348341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a3815c170 0x7f7a3815c5e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f7a3d7bc640 1 --2- 172.21.15.96:0/661348341 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7a38153150 0x7f7a38071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f7a3d7bc640 1 -- 172.21.15.96:0/661348341 >> 172.21.15.96:0/661348341 conn(0x7f7a3806af70 msgr2=0x7f7a3806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7fdffad1e640 1 -- 172.21.15.96:0/853776222 shutdown_connections 2024-04-18T04:54:48.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7fdffad1e640 1 --2- 172.21.15.96:0/853776222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfe0003980 0x7fdfe0003da0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7fdffad1e640 1 -- 172.21.15.96:0/853776222 >> 172.21.15.96:0/853776222 conn(0x7fdfec050160 msgr2=0x7fdfec050570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f07e9d9b640 1 --2- 172.21.15.96:0/1157151695 >> [v2:172.21.15.96:6811/27481,v1:172.21.15.96:6815/27481] conn(0x7f07cc06e880 0x7f07cc070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f64577fe640 1 -- 172.21.15.96:0/2738770490 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64580cb8e0 msgr2=0x7f64580c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f64577fe640 1 --2- 172.21.15.96:0/2738770490 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64580cb8e0 0x7f64580c6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f64577fe640 1 -- 172.21.15.96:0/2738770490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6458157210 msgr2=0x7f64581518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f64577fe640 1 --2- 172.21.15.96:0/2738770490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6458157210 0x7f64581518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f64577fe640 1 -- 172.21.15.96:0/2738770490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6450009b30 con 0x7f6458071a90 2024-04-18T04:54:48.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7fdffad1e640 1 -- 172.21.15.96:0/853776222 shutdown_connections 2024-04-18T04:54:48.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9ec073640 1 Processor -- start 2024-04-18T04:54:48.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f1dda064640 1 -- 172.21.15.96:0/1059176884 shutdown_connections 2024-04-18T04:54:48.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f6457fff640 1 --2- 172.21.15.96:0/2738770490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6458157210 0x7f64581518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:54:48.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f07e2ffd640 1 -- 172.21.15.96:0/1157151695 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07d40eb1a0 con 0x7f07ec150d70 2024-04-18T04:54:48.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f9ab7fff640 1 -- 172.21.15.96:0/3035999949 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9ab80c5e90 msgr2=0x7f9ab81edf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f9ab7fff640 1 --2- 172.21.15.96:0/3035999949 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9ab80c5e90 0x7f9ab81edf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f9ab7fff640 1 -- 172.21.15.96:0/3035999949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ab81ee8f0 msgr2=0x7f9ab81ec770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f9ab7fff640 1 --2- 172.21.15.96:0/3035999949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ab81ee8f0 0x7f9ab81ec770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f9ab7fff640 1 -- 172.21.15.96:0/3035999949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab81ff310 con 0x7f9ab80c6270 2024-04-18T04:54:48.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f9ab7fff640 1 --2- 172.21.15.96:0/3035999949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab80c6270 0x7f9ab81ec230 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0007660 tx=0x7f9ab0007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f64577fe640 1 --2- 172.21.15.96:0/2738770490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6458071a90 0x7f64581e9b10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f644000c7c0 tx=0x7f644000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f4793fff640 1 -- 172.21.15.96:0/2750032780 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794008270 con 0x7f4788005190 2024-04-18T04:54:48.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f4793fff640 1 -- 172.21.15.96:0/2750032780 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47940a8070 con 0x7f4788005190 2024-04-18T04:54:48.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.667+0000 7f4793fff640 1 -- 172.21.15.96:0/2750032780 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794006730 con 0x7f4788005190 2024-04-18T04:54:48.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f47a2049640 1 -- 172.21.15.96:0/2750032780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4788005190 msgr2=0x7f478800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f47a2049640 1 --2- 172.21.15.96:0/2750032780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4788005190 0x7f478800b990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4794001750 tx=0x7f479401d060 comp rx=0 tx=0).stop 2024-04-18T04:54:48.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f7a3d7bc640 1 -- 172.21.15.96:0/661348341 shutdown_connections 2024-04-18T04:54:48.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f7a3d7bc640 1 -- 172.21.15.96:0/661348341 wait complete. 2024-04-18T04:54:48.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f9ab57fa640 1 -- 172.21.15.96:0/3035999949 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00158d0 con 0x7f9ab80c6270 2024-04-18T04:54:48.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f9ab57fa640 1 -- 172.21.15.96:0/3035999949 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab0015a30 con 0x7f9ab80c6270 2024-04-18T04:54:48.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f47a2049640 1 -- 172.21.15.96:0/2750032780 shutdown_connections 2024-04-18T04:54:48.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f47a2049640 1 --2- 172.21.15.96:0/2750032780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4788005190 0x7f478800b990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f47a2049640 1 -- 172.21.15.96:0/2750032780 >> 172.21.15.96:0/2750032780 conn(0x7f479c06c1f0 msgr2=0x7f479c065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f9abd8bb640 1 -- 172.21.15.96:0/3035999949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab81fe700 con 0x7f9ab80c6270 2024-04-18T04:54:48.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f9ab57fa640 1 -- 172.21.15.96:0/3035999949 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0015da0 con 0x7f9ab80c6270 2024-04-18T04:54:48.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f9abd8bb640 1 -- 172.21.15.96:0/3035999949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab81fecc0 con 0x7f9ab80c6270 2024-04-18T04:54:48.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9ec073640 1 -- start start 2024-04-18T04:54:48.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9ec073640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9dc0071e0 0x7ff9dc0e24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9ec073640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9dc0e6900 0x7ff9dc17c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9ec073640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9dc0df120 0x7ff9dc17c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9ec073640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc0d8930 con 0x7ff9dc0e6900 2024-04-18T04:54:48.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9ec073640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc17be00 con 0x7ff9dc0071e0 2024-04-18T04:54:48.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9ec073640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc0e0ca0 con 0x7ff9dc0df120 2024-04-18T04:54:48.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f47a2049640 1 -- 172.21.15.96:0/2750032780 shutdown_connections 2024-04-18T04:54:48.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9e9e0f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9dc0071e0 0x7ff9dc0e24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9e9e0f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9dc0071e0 0x7ff9dc0e24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:52490/0 (socket says 172.21.15.96:52490) 2024-04-18T04:54:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9e9e0f640 1 -- 172.21.15.96:0/97415453 learned_addr learned my addr 172.21.15.96:0/97415453 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9ea610640 1 --2- 172.21.15.96:0/97415453 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9dc0df120 0x7ff9dc17c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9e960e640 1 --2- 172.21.15.96:0/97415453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9dc0e6900 0x7ff9dc17c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9e9e0f640 1 -- 172.21.15.96:0/97415453 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9dc0df120 msgr2=0x7ff9dc17c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9e9e0f640 1 --2- 172.21.15.96:0/97415453 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9dc0df120 0x7ff9dc17c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9e9e0f640 1 -- 172.21.15.96:0/97415453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9dc0e6900 msgr2=0x7ff9dc17c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9e9e0f640 1 --2- 172.21.15.96:0/97415453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9dc0e6900 0x7ff9dc17c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9e9e0f640 1 -- 172.21.15.96:0/97415453 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e406ae70 con 0x7ff9dc0071e0 2024-04-18T04:54:48.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f7a3d7bc640 1 Processor -- start 2024-04-18T04:54:48.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f644ffff640 1 -- 172.21.15.96:0/2738770490 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440007820 con 0x7f6458071a90 2024-04-18T04:54:48.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f644ffff640 1 -- 172.21.15.96:0/2738770490 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6440007980 con 0x7f6458071a90 2024-04-18T04:54:48.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f644ffff640 1 -- 172.21.15.96:0/2738770490 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440007d10 con 0x7f6458071a90 2024-04-18T04:54:48.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9e9e0f640 1 --2- 172.21.15.96:0/97415453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9dc0071e0 0x7ff9dc0e24b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4067c50 tx=0x7ff9e40937c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f1dda064640 1 -- 172.21.15.96:0/1059176884 wait complete. 2024-04-18T04:54:48.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f1dda064640 1 Processor -- start 2024-04-18T04:54:48.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9da7fc640 1 -- 172.21.15.96:0/97415453 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4121680 con 0x7ff9dc0071e0 2024-04-18T04:54:48.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f9abd8bb640 1 -- 172.21.15.96:0/3035999949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ab80c8ca0 con 0x7f9ab80c6270 2024-04-18T04:54:48.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7fdffad1e640 1 -- 172.21.15.96:0/853776222 wait complete. 2024-04-18T04:54:48.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7fdffad1e640 1 Processor -- start 2024-04-18T04:54:48.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f47a2049640 1 -- 172.21.15.96:0/2750032780 wait complete. 2024-04-18T04:54:48.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f47a2049640 1 Processor -- start 2024-04-18T04:54:48.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f1dda064640 1 -- start start 2024-04-18T04:54:48.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f7a3d7bc640 1 -- start start 2024-04-18T04:54:48.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9ec073640 1 -- 172.21.15.96:0/97415453 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9dc0e09c0 con 0x7ff9dc0071e0 2024-04-18T04:54:48.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9ec073640 1 -- 172.21.15.96:0/97415453 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9dc0d8650 con 0x7ff9dc0071e0 2024-04-18T04:54:48.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9da7fc640 1 -- 172.21.15.96:0/97415453 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e41217e0 con 0x7ff9dc0071e0 2024-04-18T04:54:48.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7ff9da7fc640 1 -- 172.21.15.96:0/97415453 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4121b90 con 0x7ff9dc0071e0 2024-04-18T04:54:48.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dda064640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dcc034700 0x7f1dcc034ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dda064640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dcc050c10 0x7f1dcc035020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dda064640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dcc0d4f60 0x7f1dcc0d7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dda064640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0d5e40 con 0x7f1dcc050c10 2024-04-18T04:54:48.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dda064640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0da200 con 0x7f1dcc034700 2024-04-18T04:54:48.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7ff9ec073640 1 -- 172.21.15.96:0/97415453 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff9dc011070 con 0x7ff9dc0071e0 2024-04-18T04:54:48.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dda064640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0daa10 con 0x7f1dcc0d4f60 2024-04-18T04:54:48.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dd2ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dcc050c10 0x7f1dcc035020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dd2ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dcc050c10 0x7f1dcc035020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54638/0 (socket says 172.21.15.96:54638) 2024-04-18T04:54:48.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dd2ffd640 1 -- 172.21.15.96:0/4023272282 learned_addr learned my addr 172.21.15.96:0/4023272282 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:48.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dd3fff640 1 --2- 172.21.15.96:0/4023272282 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dcc0d4f60 0x7f1dcc0d7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dd2ffd640 1 -- 172.21.15.96:0/4023272282 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dcc0d4f60 msgr2=0x7f1dcc0d7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dd2ffd640 1 --2- 172.21.15.96:0/4023272282 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dcc0d4f60 0x7f1dcc0d7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dd2ffd640 1 -- 172.21.15.96:0/4023272282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dcc034700 msgr2=0x7f1dcc034ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dd2ffd640 1 --2- 172.21.15.96:0/4023272282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dcc034700 0x7f1dcc034ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f645c825640 1 -- 172.21.15.96:0/2738770490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6458159ee0 con 0x7f6458071a90 2024-04-18T04:54:48.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f645c825640 1 -- 172.21.15.96:0/2738770490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64581e3450 con 0x7f6458071a90 2024-04-18T04:54:48.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dd2ffd640 1 -- 172.21.15.96:0/4023272282 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc800b780 con 0x7f1dcc050c10 2024-04-18T04:54:48.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7fdffad1e640 1 -- start start 2024-04-18T04:54:48.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f645c825640 1 -- 172.21.15.96:0/2738770490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64580c8b80 con 0x7f6458071a90 2024-04-18T04:54:48.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdffad1e640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdfe0003980 0x7fdfec0e69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f07e9d9b640 1 --2- 172.21.15.96:0/1157151695 >> [v2:172.21.15.96:6811/27481,v1:172.21.15.96:6815/27481] conn(0x7f07cc06e880 0x7f07cc070ca0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f9ab57fa640 1 -- 172.21.15.96:0/3035999949 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ab001f460 con 0x7f9ab80c6270 2024-04-18T04:54:48.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f9ab57fa640 1 --2- 172.21.15.96:0/3035999949 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9aa40666c0 0x7f9aa4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f9ab57fa640 1 -- 172.21.15.96:0/3035999949 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ab0086f70 con 0x7f9ab80c6270 2024-04-18T04:54:48.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f9ab57fa640 1 --2- 172.21.15.96:0/3035999949 >> [v2:172.21.15.96:6800/27478,v1:172.21.15.96:6801/27478] conn(0x7f9aa406e860 0x7f9aa4070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f9ab57fa640 1 -- 172.21.15.96:0/3035999949 --> [v2:172.21.15.96:6800/27478,v1:172.21.15.96:6801/27478] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9aa4071330 con 0x7f9aa406e860 2024-04-18T04:54:48.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f9ab57fa640 1 -- 172.21.15.96:0/3035999949 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ab0089630 con 0x7f9ab80c6270 2024-04-18T04:54:48.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f9abc8b9640 1 --2- 172.21.15.96:0/3035999949 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9aa40666c0 0x7f9aa4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f9abd0ba640 1 --2- 172.21.15.96:0/3035999949 >> [v2:172.21.15.96:6800/27478,v1:172.21.15.96:6801/27478] conn(0x7f9aa406e860 0x7f9aa4070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a3d7bc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a38152d70 0x7f7a38148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a3d7bc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a38153150 0x7f7a38148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a3d7bc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7a3815c170 0x7f7a380ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a3d7bc640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a380c9bb0 con 0x7f7a38152d70 2024-04-18T04:54:48.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a3d7bc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a381e1f50 con 0x7f7a38153150 2024-04-18T04:54:48.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a3d7bc640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3814ec60 con 0x7f7a3815c170 2024-04-18T04:54:48.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a38152d70 0x7f7a38148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a38152d70 0x7f7a38148560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54648/0 (socket says 172.21.15.96:54648) 2024-04-18T04:54:48.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a37fff640 1 -- 172.21.15.96:0/1564232420 learned_addr learned my addr 172.21.15.96:0/1564232420 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:48.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.671+0000 7f47a2049640 1 -- start start 2024-04-18T04:54:48.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a2049640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4788005190 0x7f479c1544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a2049640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f479c14d060 0x7f479c151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a2049640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f479c153400 0x7f479c151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a2049640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c151070 con 0x7f479c153400 2024-04-18T04:54:48.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a2049640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c14f690 con 0x7f4788005190 2024-04-18T04:54:48.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a2049640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c14f930 con 0x7f479c14d060 2024-04-18T04:54:48.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a1047640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4788005190 0x7f479c1544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a1047640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4788005190 0x7f479c1544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:52508/0 (socket says 172.21.15.96:52508) 2024-04-18T04:54:48.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a1047640 1 -- 172.21.15.96:0/2722133707 learned_addr learned my addr 172.21.15.96:0/2722133707 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:48.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a3cfbb640 1 --2- 172.21.15.96:0/1564232420 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7a3815c170 0x7f7a380ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a0846640 1 --2- 172.21.15.96:0/2722133707 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f479c14d060 0x7f479c151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a377fe640 1 --2- 172.21.15.96:0/1564232420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a38153150 0x7f7a38148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f9abd0ba640 1 --2- 172.21.15.96:0/3035999949 >> [v2:172.21.15.96:6800/27478,v1:172.21.15.96:6801/27478] conn(0x7f9aa406e860 0x7f9aa4070c80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a37fff640 1 -- 172.21.15.96:0/1564232420 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7a3815c170 msgr2=0x7f7a380ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a37fff640 1 --2- 172.21.15.96:0/1564232420 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7a3815c170 0x7f7a380ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a37fff640 1 -- 172.21.15.96:0/1564232420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a38153150 msgr2=0x7f7a38148aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a37fff640 1 --2- 172.21.15.96:0/1564232420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a38153150 0x7f7a38148aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a37fff640 1 -- 172.21.15.96:0/1564232420 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a30009b30 con 0x7f7a38152d70 2024-04-18T04:54:48.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdffad1e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfec0e2e10 0x7fdfec04ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdffad1e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfec04b340 0x7fdfec0e3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdffad1e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec173a20 con 0x7fdfec04b340 2024-04-18T04:54:48.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdffad1e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec0c96d0 con 0x7fdfec0e2e10 2024-04-18T04:54:48.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdffad1e640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec172b90 con 0x7fdfe0003980 2024-04-18T04:54:48.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a1047640 1 -- 172.21.15.96:0/2722133707 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f479c14d060 msgr2=0x7f479c151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a1047640 1 --2- 172.21.15.96:0/2722133707 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f479c14d060 0x7f479c151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a1047640 1 -- 172.21.15.96:0/2722133707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f479c153400 msgr2=0x7f479c151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a1047640 1 --2- 172.21.15.96:0/2722133707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f479c153400 0x7f479c151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a1047640 1 -- 172.21.15.96:0/2722133707 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c143310 con 0x7f4788005190 2024-04-18T04:54:48.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a0846640 1 --2- 172.21.15.96:0/2722133707 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f479c14d060 0x7f479c151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:54:48.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f07e2ffd640 1 -- 172.21.15.96:0/1157151695 <== osd.2 v2:172.21.15.96:6811/27481 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f07cc071350 con 0x7f07cc06e880 2024-04-18T04:54:48.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f9abc8b9640 1 --2- 172.21.15.96:0/3035999949 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9aa40666c0 0x7f9aa4068b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0018e0 tx=0x7f9aac001350 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dd2ffd640 1 --2- 172.21.15.96:0/4023272282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dcc050c10 0x7f1dcc035020 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8000c10 tx=0x7f1dc801b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a1047640 1 --2- 172.21.15.96:0/2722133707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4788005190 0x7f479c1544e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f479800f900 tx=0x7f479800fdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f4791ffb640 1 -- 172.21.15.96:0/2722133707 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800c070 con 0x7f4788005190 2024-04-18T04:54:48.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f4791ffb640 1 -- 172.21.15.96:0/2722133707 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479800dc70 con 0x7f4788005190 2024-04-18T04:54:48.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f9ab57fa640 1 -- 172.21.15.96:0/3035999949 <== osd.0 v2:172.21.15.96:6800/27478 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f9aa4071330 con 0x7f9aa406e860 2024-04-18T04:54:48.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f7a37fff640 1 --2- 172.21.15.96:0/1564232420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a38152d70 0x7f7a38148560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00c490 tx=0x7f7a2c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dbffff640 1 -- 172.21.15.96:0/4023272282 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80a8aa0 con 0x7f1dcc050c10 2024-04-18T04:54:48.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a2049640 1 -- 172.21.15.96:0/2722133707 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c1435f0 con 0x7f4788005190 2024-04-18T04:54:48.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f47a2049640 1 -- 172.21.15.96:0/2722133707 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c14c500 con 0x7f4788005190 2024-04-18T04:54:48.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f4791ffb640 1 -- 172.21.15.96:0/2722133707 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798012460 con 0x7f4788005190 2024-04-18T04:54:48.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7ff9da7fc640 1 -- 172.21.15.96:0/97415453 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff9e4121cf0 con 0x7ff9dc0071e0 2024-04-18T04:54:48.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7ff9da7fc640 1 --2- 172.21.15.96:0/97415453 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff9c8066690 0x7ff9c8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7ff9da7fc640 1 -- 172.21.15.96:0/97415453 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9e4198860 con 0x7ff9dc0071e0 2024-04-18T04:54:48.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7ff9da7fc640 1 --2- 172.21.15.96:0/97415453 >> [v2:172.21.15.96:6809/27480,v1:172.21.15.96:6812/27480] conn(0x7ff9c806e8b0 0x7ff9c8070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7ff9da7fc640 1 -- 172.21.15.96:0/97415453 --> [v2:172.21.15.96:6809/27480,v1:172.21.15.96:6812/27480] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff9c8071380 con 0x7ff9c806e8b0 2024-04-18T04:54:48.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7ff9da7fc640 1 -- 172.21.15.96:0/97415453 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9e4198c10 con 0x7ff9dc0071e0 2024-04-18T04:54:48.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dbffff640 1 -- 172.21.15.96:0/4023272282 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc80a8c00 con 0x7f1dcc050c10 2024-04-18T04:54:48.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dbffff640 1 -- 172.21.15.96:0/4023272282 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8003620 con 0x7f1dcc050c10 2024-04-18T04:54:48.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dda064640 1 -- 172.21.15.96:0/4023272282 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc0d5b80 con 0x7f1dcc050c10 2024-04-18T04:54:48.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7f1dda064640 1 -- 172.21.15.96:0/4023272282 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc0da730 con 0x7f1dcc050c10 2024-04-18T04:54:48.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7ff9e960e640 1 --2- 172.21.15.96:0/97415453 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff9c8066690 0x7ff9c8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7ff9ea610640 1 --2- 172.21.15.96:0/97415453 >> [v2:172.21.15.96:6809/27480,v1:172.21.15.96:6812/27480] conn(0x7ff9c806e8b0 0x7ff9c8070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdff951b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfec0e2e10 0x7fdfec04ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdff951b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfec0e2e10 0x7fdfec04ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:52532/0 (socket says 172.21.15.96:52532) 2024-04-18T04:54:48.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdff951b640 1 -- 172.21.15.96:0/85796807 learned_addr learned my addr 172.21.15.96:0/85796807 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:48.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdffa51d640 1 --2- 172.21.15.96:0/85796807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfec04b340 0x7fdfec0e3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdff951b640 1 -- 172.21.15.96:0/85796807 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdfe0003980 msgr2=0x7fdfec0e69f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:54:48.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdff951b640 1 --2- 172.21.15.96:0/85796807 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdfe0003980 0x7fdfec0e69f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdff951b640 1 -- 172.21.15.96:0/85796807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfec04b340 msgr2=0x7fdfec0e3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdff951b640 1 --2- 172.21.15.96:0/85796807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfec04b340 0x7fdfec0e3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdff951b640 1 -- 172.21.15.96:0/85796807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec172da0 con 0x7fdfec0e2e10 2024-04-18T04:54:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdff951b640 1 --2- 172.21.15.96:0/85796807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfec0e2e10 0x7fdfec04ae00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40017b0 tx=0x7fdfe4011bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdfea7fc640 1 -- 172.21.15.96:0/85796807 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe400f890 con 0x7fdfec0e2e10 2024-04-18T04:54:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdfea7fc640 1 -- 172.21.15.96:0/85796807 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe400f9f0 con 0x7fdfec0e2e10 2024-04-18T04:54:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.675+0000 7fdfea7fc640 1 -- 172.21.15.96:0/85796807 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe400fda0 con 0x7fdfec0e2e10 2024-04-18T04:54:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7fdffad1e640 1 -- 172.21.15.96:0/85796807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfec173080 con 0x7fdfec0e2e10 2024-04-18T04:54:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7fdffad1e640 1 -- 172.21.15.96:0/85796807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfec173640 con 0x7fdfec0e2e10 2024-04-18T04:54:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7ff9e960e640 1 --2- 172.21.15.96:0/97415453 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff9c8066690 0x7ff9c8068b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00edd0 tx=0x7ff9e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7fdffad1e640 1 -- 172.21.15.96:0/85796807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdfec0071c0 con 0x7fdfec0e2e10 2024-04-18T04:54:48.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f47a2049640 1 -- 172.21.15.96:0/2722133707 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f479c070a70 con 0x7f4788005190 2024-04-18T04:54:48.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7ff9ea610640 1 --2- 172.21.15.96:0/97415453 >> [v2:172.21.15.96:6809/27480,v1:172.21.15.96:6812/27480] conn(0x7ff9c806e8b0 0x7ff9c8070cd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f644ffff640 1 -- 172.21.15.96:0/2738770490 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f64400113f0 con 0x7f6458071a90 2024-04-18T04:54:48.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f644ffff640 1 --2- 172.21.15.96:0/2738770490 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6438066760 0x7f6438068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f644ffff640 1 -- 172.21.15.96:0/2738770490 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6440084700 con 0x7f6458071a90 2024-04-18T04:54:48.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f644ffff640 1 --2- 172.21.15.96:0/2738770490 >> [v2:172.21.15.96:6808/27479,v1:172.21.15.96:6810/27479] conn(0x7f643806e980 0x7f6438070da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f644ffff640 1 -- 172.21.15.96:0/2738770490 --> [v2:172.21.15.96:6808/27479,v1:172.21.15.96:6810/27479] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6438071450 con 0x7f643806e980 2024-04-18T04:54:48.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f644ffff640 1 -- 172.21.15.96:0/2738770490 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6440084ab0 con 0x7f6458071a90 2024-04-18T04:54:48.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f6456ffd640 1 --2- 172.21.15.96:0/2738770490 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6438066760 0x7f6438068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f6457fff640 1 --2- 172.21.15.96:0/2738770490 >> [v2:172.21.15.96:6808/27479,v1:172.21.15.96:6810/27479] conn(0x7f643806e980 0x7f6438070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f7a34ff9640 1 -- 172.21.15.96:0/1564232420 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c003600 con 0x7f7a38152d70 2024-04-18T04:54:48.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f7a34ff9640 1 -- 172.21.15.96:0/1564232420 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c003780 con 0x7f7a38152d70 2024-04-18T04:54:48.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f7a34ff9640 1 -- 172.21.15.96:0/1564232420 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c003b70 con 0x7f7a38152d70 2024-04-18T04:54:48.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f7a3d7bc640 1 -- 172.21.15.96:0/1564232420 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a3814e0e0 con 0x7f7a38152d70 2024-04-18T04:54:48.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f7a3d7bc640 1 -- 172.21.15.96:0/1564232420 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3814e6a0 con 0x7f7a38152d70 2024-04-18T04:54:48.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f6456ffd640 1 --2- 172.21.15.96:0/2738770490 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6438066760 0x7f6438068c20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6458071890 tx=0x7f6448009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f1dbffff640 1 -- 172.21.15.96:0/4023272282 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1dc8003780 con 0x7f1dcc050c10 2024-04-18T04:54:48.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f1dbffff640 1 --2- 172.21.15.96:0/4023272282 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1db8066760 0x7f1db8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f1dbffff640 1 -- 172.21.15.96:0/4023272282 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dc811e910 con 0x7f1dcc050c10 2024-04-18T04:54:48.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f6457fff640 1 --2- 172.21.15.96:0/2738770490 >> [v2:172.21.15.96:6808/27479,v1:172.21.15.96:6810/27479] conn(0x7f643806e980 0x7f6438070da0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f1dd37fe640 1 --2- 172.21.15.96:0/4023272282 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1db8066760 0x7f1db8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f7a3d7bc640 1 -- 172.21.15.96:0/1564232420 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7a381593d0 con 0x7f7a38152d70 2024-04-18T04:54:48.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f644ffff640 1 -- 172.21.15.96:0/2738770490 <== osd.1 v2:172.21.15.96:6808/27479 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f6438071450 con 0x7f643806e980 2024-04-18T04:54:48.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7ff9da7fc640 1 -- 172.21.15.96:0/97415453 <== osd.3 v2:172.21.15.96:6809/27480 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7ff9c8071380 con 0x7ff9c806e8b0 2024-04-18T04:54:48.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.679+0000 7f4791ffb640 1 -- 172.21.15.96:0/2722133707 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f47980125c0 con 0x7f4788005190 2024-04-18T04:54:48.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f4791ffb640 1 --2- 172.21.15.96:0/2722133707 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4780066690 0x7f4780068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f4791ffb640 1 -- 172.21.15.96:0/2722133707 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4798084240 con 0x7f4788005190 2024-04-18T04:54:48.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f4791ffb640 1 --2- 172.21.15.96:0/2722133707 >> [v2:172.21.15.139:6804/27647,v1:172.21.15.139:6806/27647] conn(0x7f478006e830 0x7f4780070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f4791ffb640 1 -- 172.21.15.96:0/2722133707 --> [v2:172.21.15.139:6804/27647,v1:172.21.15.139:6806/27647] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4780071300 con 0x7f478006e830 2024-04-18T04:54:48.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f47a0846640 1 --2- 172.21.15.96:0/2722133707 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4780066690 0x7f4780068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7fdfea7fc640 1 -- 172.21.15.96:0/85796807 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdfe4020460 con 0x7fdfec0e2e10 2024-04-18T04:54:48.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f4791ffb640 1 -- 172.21.15.96:0/2722133707 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4798009190 con 0x7f4788005190 2024-04-18T04:54:48.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f47a0846640 1 --2- 172.21.15.96:0/2722133707 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4780066690 0x7f4780068b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f479c0ca4a0 tx=0x7f478c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f47a1848640 1 --2- 172.21.15.96:0/2722133707 >> [v2:172.21.15.139:6804/27647,v1:172.21.15.139:6806/27647] conn(0x7f478006e830 0x7f4780070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7fdfea7fc640 1 --2- 172.21.15.96:0/85796807 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdfd8066690 0x7fdfd8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7fdfea7fc640 1 -- 172.21.15.96:0/85796807 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfe4087d30 con 0x7fdfec0e2e10 2024-04-18T04:54:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7fdff9d1c640 1 --2- 172.21.15.96:0/85796807 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdfd8066690 0x7fdfd8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7fdfea7fc640 1 --2- 172.21.15.96:0/85796807 >> [v2:172.21.15.139:6824/27649,v1:172.21.15.139:6825/27649] conn(0x7fdfd806e830 0x7fdfd8070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7fdfea7fc640 1 -- 172.21.15.96:0/85796807 --> [v2:172.21.15.139:6824/27649,v1:172.21.15.139:6825/27649] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdfd8071300 con 0x7fdfd806e830 2024-04-18T04:54:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7fdfea7fc640 1 -- 172.21.15.96:0/85796807 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfe4088180 con 0x7fdfec0e2e10 2024-04-18T04:54:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7fdffa51d640 1 --2- 172.21.15.96:0/85796807 >> [v2:172.21.15.139:6824/27649,v1:172.21.15.139:6825/27649] conn(0x7fdfd806e830 0x7fdfd8070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7fdff9d1c640 1 --2- 172.21.15.96:0/85796807 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdfd8066690 0x7fdfd8068b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdff00d1000 tx=0x7fdff00046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f7a34ff9640 1 -- 172.21.15.96:0/1564232420 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7a2c003cd0 con 0x7f7a38152d70 2024-04-18T04:54:48.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f7a34ff9640 1 --2- 172.21.15.96:0/1564232420 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7a24066760 0x7f7a24068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f7a34ff9640 1 -- 172.21.15.96:0/1564232420 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a2c083f30 con 0x7f7a38152d70 2024-04-18T04:54:48.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f7a34ff9640 1 --2- 172.21.15.96:0/1564232420 >> [v2:172.21.15.139:6800/27648,v1:172.21.15.139:6801/27648] conn(0x7f7a2406e980 0x7f7a24070da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f7a34ff9640 1 -- 172.21.15.96:0/1564232420 --> [v2:172.21.15.139:6800/27648,v1:172.21.15.139:6801/27648] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a24071450 con 0x7f7a2406e980 2024-04-18T04:54:48.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f7a34ff9640 1 -- 172.21.15.96:0/1564232420 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a2c0842e0 con 0x7f7a38152d70 2024-04-18T04:54:48.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f7a377fe640 1 --2- 172.21.15.96:0/1564232420 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7a24066760 0x7f7a24068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f1dd37fe640 1 --2- 172.21.15.96:0/4023272282 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1db8066760 0x7f1db8068c20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009670 tx=0x7f1dc0006bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f7a3cfbb640 1 --2- 172.21.15.96:0/1564232420 >> [v2:172.21.15.139:6800/27648,v1:172.21.15.139:6801/27648] conn(0x7f7a2406e980 0x7f7a24070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7fdffa51d640 1 --2- 172.21.15.96:0/85796807 >> [v2:172.21.15.139:6824/27649,v1:172.21.15.139:6825/27649] conn(0x7fdfd806e830 0x7fdfd8070c50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f7a377fe640 1 --2- 172.21.15.96:0/1564232420 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7a24066760 0x7f7a24068c20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a3806dba0 tx=0x7f7a28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.683+0000 7f7a3cfbb640 1 --2- 172.21.15.96:0/1564232420 >> [v2:172.21.15.139:6800/27648,v1:172.21.15.139:6801/27648] conn(0x7f7a2406e980 0x7f7a24070da0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.687+0000 7fdfea7fc640 1 -- 172.21.15.96:0/85796807 <== osd.4 v2:172.21.15.139:6824/27649 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fdfd8071300 con 0x7fdfd806e830 2024-04-18T04:54:48.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.687+0000 7f1dda064640 1 --2- 172.21.15.96:0/4023272282 >> [v2:172.21.15.139:6816/27650,v1:172.21.15.139:6817/27650] conn(0x7f1dcc0d5600 0x7f1dcc0d3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.687+0000 7f1dda064640 1 -- 172.21.15.96:0/4023272282 --> [v2:172.21.15.139:6816/27650,v1:172.21.15.139:6817/27650] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1dcc006c90 con 0x7f1dcc0d5600 2024-04-18T04:54:48.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.687+0000 7f7a34ff9640 1 -- 172.21.15.96:0/1564232420 <== osd.7 v2:172.21.15.139:6800/27648 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f7a24071450 con 0x7f7a2406e980 2024-04-18T04:54:48.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.687+0000 7f1dd3fff640 1 --2- 172.21.15.96:0/4023272282 >> [v2:172.21.15.139:6816/27650,v1:172.21.15.139:6817/27650] conn(0x7f1dcc0d5600 0x7f1dcc0d3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.687+0000 7f1dd3fff640 1 --2- 172.21.15.96:0/4023272282 >> [v2:172.21.15.139:6816/27650,v1:172.21.15.139:6817/27650] conn(0x7f1dcc0d5600 0x7f1dcc0d3ca0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.691+0000 7f1dbffff640 1 -- 172.21.15.96:0/4023272282 <== osd.6 v2:172.21.15.139:6816/27650 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f1dd40673c0 con 0x7f1dcc0d5600 2024-04-18T04:54:48.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.691+0000 7f07f09df640 1 -- 172.21.15.96:0/1157151695 --> [v2:172.21.15.96:6811/27481,v1:172.21.15.96:6815/27481] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f07ec0c2b80 con 0x7f07cc06e880 2024-04-18T04:54:48.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.691+0000 7f07e2ffd640 1 -- 172.21.15.96:0/1157151695 <== osd.2 v2:172.21.15.96:6811/27481 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f07e400f040 con 0x7f07cc06e880 2024-04-18T04:54:48.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.691+0000 7f07f09df640 1 -- 172.21.15.96:0/1157151695 >> [v2:172.21.15.96:6811/27481,v1:172.21.15.96:6815/27481] conn(0x7f07cc06e880 msgr2=0x7f07cc070ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.691+0000 7f07f09df640 1 --2- 172.21.15.96:0/1157151695 >> [v2:172.21.15.96:6811/27481,v1:172.21.15.96:6815/27481] conn(0x7f07cc06e880 0x7f07cc070ca0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.691+0000 7f07f09df640 1 -- 172.21.15.96:0/1157151695 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f07cc0666e0 msgr2=0x7f07cc068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.691+0000 7f07f09df640 1 --2- 172.21.15.96:0/1157151695 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f07cc0666e0 0x7f07cc068ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0011f0 tx=0x7f07dc007d40 comp rx=0 tx=0).stop 2024-04-18T04:54:48.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.691+0000 7f07f09df640 1 -- 172.21.15.96:0/1157151695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07ec150d70 msgr2=0x7f07ec14bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.691+0000 7f07f09df640 1 --2- 172.21.15.96:0/1157151695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07ec150d70 0x7f07ec14bd40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f07d40ae040 tx=0x7f07d4019190 comp rx=0 tx=0).stop 2024-04-18T04:54:48.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.691+0000 7f07ead9d640 1 -- 172.21.15.96:0/1157151695 reap_dead start 2024-04-18T04:54:48.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.691+0000 7f07f09df640 1 -- 172.21.15.96:0/1157151695 shutdown_connections 2024-04-18T04:54:48.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.691+0000 7f07f09df640 1 -- 172.21.15.96:0/1157151695 >> 172.21.15.96:0/1157151695 conn(0x7f07ec069e60 msgr2=0x7f07ec0ca890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.691+0000 7f07f09df640 1 -- 172.21.15.96:0/1157151695 shutdown_connections 2024-04-18T04:54:48.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.691+0000 7f07f09df640 1 -- 172.21.15.96:0/1157151695 wait complete. 2024-04-18T04:54:48.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.687+0000 7f47a1848640 1 --2- 172.21.15.96:0/2722133707 >> [v2:172.21.15.139:6804/27647,v1:172.21.15.139:6806/27647] conn(0x7f478006e830 0x7f4780070c50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.703+0000 7f645c825640 1 -- 172.21.15.96:0/2738770490 --> [v2:172.21.15.96:6808/27479,v1:172.21.15.96:6810/27479] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f64580675e0 con 0x7f643806e980 2024-04-18T04:54:48.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f644ffff640 1 -- 172.21.15.96:0/2738770490 <== osd.1 v2:172.21.15.96:6808/27479 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f64580675e0 con 0x7f643806e980 2024-04-18T04:54:48.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f645c825640 1 -- 172.21.15.96:0/2738770490 >> [v2:172.21.15.96:6808/27479,v1:172.21.15.96:6810/27479] conn(0x7f643806e980 msgr2=0x7f6438070da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f645c825640 1 --2- 172.21.15.96:0/2738770490 >> [v2:172.21.15.96:6808/27479,v1:172.21.15.96:6810/27479] conn(0x7f643806e980 0x7f6438070da0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f645c825640 1 -- 172.21.15.96:0/2738770490 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6438066760 msgr2=0x7f6438068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f645c825640 1 --2- 172.21.15.96:0/2738770490 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6438066760 0x7f6438068c20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6458071890 tx=0x7f6448009040 comp rx=0 tx=0).stop 2024-04-18T04:54:48.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f645c825640 1 -- 172.21.15.96:0/2738770490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6458071a90 msgr2=0x7f64581e9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f645c825640 1 --2- 172.21.15.96:0/2738770490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6458071a90 0x7f64581e9b10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f644000c7c0 tx=0x7f644000cc80 comp rx=0 tx=0).stop 2024-04-18T04:54:48.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f9abd8bb640 1 -- 172.21.15.96:0/3035999949 --> [v2:172.21.15.96:6800/27478,v1:172.21.15.96:6801/27478] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9ab80c89c0 con 0x7f9aa406e860 2024-04-18T04:54:48.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.699+0000 7f4791ffb640 1 -- 172.21.15.96:0/2722133707 <== osd.5 v2:172.21.15.139:6804/27647 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f4780071300 con 0x7f478006e830 2024-04-18T04:54:48.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f6457fff640 1 -- 172.21.15.96:0/2738770490 reap_dead start 2024-04-18T04:54:48.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f645c825640 1 -- 172.21.15.96:0/2738770490 shutdown_connections 2024-04-18T04:54:48.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f645c825640 1 -- 172.21.15.96:0/2738770490 >> 172.21.15.96:0/2738770490 conn(0x7f645806af70 msgr2=0x7f645806f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f645c825640 1 -- 172.21.15.96:0/2738770490 shutdown_connections 2024-04-18T04:54:48.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f9ab57fa640 1 -- 172.21.15.96:0/3035999949 <== osd.0 v2:172.21.15.96:6800/27478 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9aa800f040 con 0x7f9aa406e860 2024-04-18T04:54:48.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f645c825640 1 -- 172.21.15.96:0/2738770490 wait complete. 2024-04-18T04:54:48.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f9a9effd640 1 -- 172.21.15.96:0/3035999949 >> [v2:172.21.15.96:6800/27478,v1:172.21.15.96:6801/27478] conn(0x7f9aa406e860 msgr2=0x7f9aa4070c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f9a9effd640 1 --2- 172.21.15.96:0/3035999949 >> [v2:172.21.15.96:6800/27478,v1:172.21.15.96:6801/27478] conn(0x7f9aa406e860 0x7f9aa4070c80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f9a9effd640 1 -- 172.21.15.96:0/3035999949 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9aa40666c0 msgr2=0x7f9aa4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f9a9effd640 1 --2- 172.21.15.96:0/3035999949 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9aa40666c0 0x7f9aa4068b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0018e0 tx=0x7f9aac001350 comp rx=0 tx=0).stop 2024-04-18T04:54:48.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f9a9effd640 1 -- 172.21.15.96:0/3035999949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab80c6270 msgr2=0x7f9ab81ec230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f9a9effd640 1 --2- 172.21.15.96:0/3035999949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab80c6270 0x7f9ab81ec230 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0007660 tx=0x7f9ab0007750 comp rx=0 tx=0).stop 2024-04-18T04:54:48.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f9abd0ba640 1 -- 172.21.15.96:0/3035999949 reap_dead start 2024-04-18T04:54:48.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f9a9effd640 1 -- 172.21.15.96:0/3035999949 shutdown_connections 2024-04-18T04:54:48.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f9a9effd640 1 -- 172.21.15.96:0/3035999949 >> 172.21.15.96:0/3035999949 conn(0x7f9ab806c1f0 msgr2=0x7f9ab8070460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f9a9effd640 1 -- 172.21.15.96:0/3035999949 shutdown_connections 2024-04-18T04:54:48.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.707+0000 7f9a9effd640 1 -- 172.21.15.96:0/3035999949 wait complete. 2024-04-18T04:54:48.756 INFO:teuthology.orchestra.run.smithi096.stdout:55834574854 2024-04-18T04:54:48.757 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T04:54:48.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.711+0000 7fdffad1e640 1 -- 172.21.15.96:0/85796807 --> [v2:172.21.15.139:6824/27649,v1:172.21.15.139:6825/27649] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdfec006ee0 con 0x7fdfd806e830 2024-04-18T04:54:48.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7fdfea7fc640 1 -- 172.21.15.96:0/85796807 <== osd.4 v2:172.21.15.139:6824/27649 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdff404e9c0 con 0x7fdfd806e830 2024-04-18T04:54:48.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7fdffad1e640 1 -- 172.21.15.96:0/85796807 >> [v2:172.21.15.139:6824/27649,v1:172.21.15.139:6825/27649] conn(0x7fdfd806e830 msgr2=0x7fdfd8070c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7fdffad1e640 1 --2- 172.21.15.96:0/85796807 >> [v2:172.21.15.139:6824/27649,v1:172.21.15.139:6825/27649] conn(0x7fdfd806e830 0x7fdfd8070c50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7fdffad1e640 1 -- 172.21.15.96:0/85796807 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdfd8066690 msgr2=0x7fdfd8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7fdffad1e640 1 --2- 172.21.15.96:0/85796807 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdfd8066690 0x7fdfd8068b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdff00d1000 tx=0x7fdff00046d0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7fdffad1e640 1 -- 172.21.15.96:0/85796807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfec0e2e10 msgr2=0x7fdfec04ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7fdffad1e640 1 --2- 172.21.15.96:0/85796807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfec0e2e10 0x7fdfec04ae00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40017b0 tx=0x7fdfe4011bb0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7fdffa51d640 1 -- 172.21.15.96:0/85796807 reap_dead start 2024-04-18T04:54:48.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7fdffad1e640 1 -- 172.21.15.96:0/85796807 shutdown_connections 2024-04-18T04:54:48.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7fdffad1e640 1 -- 172.21.15.96:0/85796807 >> 172.21.15.96:0/85796807 conn(0x7fdfec050160 msgr2=0x7fdfec04f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7fdffad1e640 1 -- 172.21.15.96:0/85796807 shutdown_connections 2024-04-18T04:54:48.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7fdffad1e640 1 -- 172.21.15.96:0/85796807 wait complete. 2024-04-18T04:54:48.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7f1dda064640 1 -- 172.21.15.96:0/4023272282 --> [v2:172.21.15.139:6816/27650,v1:172.21.15.139:6817/27650] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1dcc045090 con 0x7f1dcc0d5600 2024-04-18T04:54:48.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7ff9ec073640 1 -- 172.21.15.96:0/97415453 --> [v2:172.21.15.96:6809/27480,v1:172.21.15.96:6812/27480] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff9dc17bf40 con 0x7ff9c806e8b0 2024-04-18T04:54:48.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7f1dbffff640 1 -- 172.21.15.96:0/4023272282 <== osd.6 v2:172.21.15.139:6816/27650 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1dd4065bc0 con 0x7f1dcc0d5600 2024-04-18T04:54:48.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7ff9da7fc640 1 -- 172.21.15.96:0/97415453 <== osd.3 v2:172.21.15.96:6809/27480 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff9d4004260 con 0x7ff9c806e8b0 2024-04-18T04:54:48.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7f1dda064640 1 -- 172.21.15.96:0/4023272282 >> [v2:172.21.15.139:6816/27650,v1:172.21.15.139:6817/27650] conn(0x7f1dcc0d5600 msgr2=0x7f1dcc0d3ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.715+0000 7f1dda064640 1 --2- 172.21.15.96:0/4023272282 >> [v2:172.21.15.139:6816/27650,v1:172.21.15.139:6817/27650] conn(0x7f1dcc0d5600 0x7f1dcc0d3ca0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f1dda064640 1 -- 172.21.15.96:0/4023272282 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1db8066760 msgr2=0x7f1db8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f1dda064640 1 --2- 172.21.15.96:0/4023272282 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1db8066760 0x7f1db8068c20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009670 tx=0x7f1dc0006bd0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f1dda064640 1 -- 172.21.15.96:0/4023272282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dcc050c10 msgr2=0x7f1dcc035020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f1dda064640 1 --2- 172.21.15.96:0/4023272282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dcc050c10 0x7f1dcc035020 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8000c10 tx=0x7f1dc801b730 comp rx=0 tx=0).stop 2024-04-18T04:54:48.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f7a3d7bc640 1 -- 172.21.15.96:0/1564232420 --> [v2:172.21.15.139:6800/27648,v1:172.21.15.139:6801/27648] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7a381590f0 con 0x7f7a2406e980 2024-04-18T04:54:48.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7ff9c7fff640 1 -- 172.21.15.96:0/97415453 >> [v2:172.21.15.96:6809/27480,v1:172.21.15.96:6812/27480] conn(0x7ff9c806e8b0 msgr2=0x7ff9c8070cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7ff9c7fff640 1 --2- 172.21.15.96:0/97415453 >> [v2:172.21.15.96:6809/27480,v1:172.21.15.96:6812/27480] conn(0x7ff9c806e8b0 0x7ff9c8070cd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7ff9c7fff640 1 -- 172.21.15.96:0/97415453 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff9c8066690 msgr2=0x7ff9c8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7ff9c7fff640 1 --2- 172.21.15.96:0/97415453 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff9c8066690 0x7ff9c8068b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00edd0 tx=0x7ff9e0008040 comp rx=0 tx=0).stop 2024-04-18T04:54:48.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7ff9c7fff640 1 -- 172.21.15.96:0/97415453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9dc0071e0 msgr2=0x7ff9dc0e24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7ff9c7fff640 1 --2- 172.21.15.96:0/97415453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9dc0071e0 0x7ff9dc0e24b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4067c50 tx=0x7ff9e40937c0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f1dd3fff640 1 -- 172.21.15.96:0/4023272282 reap_dead start 2024-04-18T04:54:48.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f1dda064640 1 -- 172.21.15.96:0/4023272282 shutdown_connections 2024-04-18T04:54:48.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f1dda064640 1 -- 172.21.15.96:0/4023272282 >> 172.21.15.96:0/4023272282 conn(0x7f1dcc0500f0 msgr2=0x7f1dcc04f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f1dda064640 1 -- 172.21.15.96:0/4023272282 shutdown_connections 2024-04-18T04:54:48.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f1dda064640 1 -- 172.21.15.96:0/4023272282 wait complete. 2024-04-18T04:54:48.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7ff9ea610640 1 -- 172.21.15.96:0/97415453 reap_dead start 2024-04-18T04:54:48.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7ff9c7fff640 1 -- 172.21.15.96:0/97415453 shutdown_connections 2024-04-18T04:54:48.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7ff9c7fff640 1 -- 172.21.15.96:0/97415453 >> 172.21.15.96:0/97415453 conn(0x7ff9dc006180 msgr2=0x7ff9dc0539a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7ff9c7fff640 1 -- 172.21.15.96:0/97415453 shutdown_connections 2024-04-18T04:54:48.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7ff9c7fff640 1 -- 172.21.15.96:0/97415453 wait complete. 2024-04-18T04:54:48.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f7a34ff9640 1 -- 172.21.15.96:0/1564232420 <== osd.7 v2:172.21.15.139:6800/27648 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7a300091f0 con 0x7f7a2406e980 2024-04-18T04:54:48.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f7a3d7bc640 1 -- 172.21.15.96:0/1564232420 >> [v2:172.21.15.139:6800/27648,v1:172.21.15.139:6801/27648] conn(0x7f7a2406e980 msgr2=0x7f7a24070da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f7a3d7bc640 1 --2- 172.21.15.96:0/1564232420 >> [v2:172.21.15.139:6800/27648,v1:172.21.15.139:6801/27648] conn(0x7f7a2406e980 0x7f7a24070da0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f7a3d7bc640 1 -- 172.21.15.96:0/1564232420 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7a24066760 msgr2=0x7f7a24068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f7a3d7bc640 1 --2- 172.21.15.96:0/1564232420 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7a24066760 0x7f7a24068c20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a3806dba0 tx=0x7f7a28008040 comp rx=0 tx=0).stop 2024-04-18T04:54:48.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f7a3d7bc640 1 -- 172.21.15.96:0/1564232420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a38152d70 msgr2=0x7f7a38148560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f7a3d7bc640 1 --2- 172.21.15.96:0/1564232420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a38152d70 0x7f7a38148560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00c490 tx=0x7f7a2c001e80 comp rx=0 tx=0).stop 2024-04-18T04:54:48.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f7a3cfbb640 1 -- 172.21.15.96:0/1564232420 reap_dead start 2024-04-18T04:54:48.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f7a3d7bc640 1 -- 172.21.15.96:0/1564232420 shutdown_connections 2024-04-18T04:54:48.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f7a3d7bc640 1 -- 172.21.15.96:0/1564232420 >> 172.21.15.96:0/1564232420 conn(0x7f7a3806af70 msgr2=0x7f7a3806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f7a3d7bc640 1 -- 172.21.15.96:0/1564232420 shutdown_connections 2024-04-18T04:54:48.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.719+0000 7f7a3d7bc640 1 -- 172.21.15.96:0/1564232420 wait complete. 2024-04-18T04:54:48.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.723+0000 7f47a2049640 1 -- 172.21.15.96:0/2722133707 --> [v2:172.21.15.139:6804/27647,v1:172.21.15.139:6806/27647] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f479c154ef0 con 0x7f478006e830 2024-04-18T04:54:48.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.723+0000 7f4791ffb640 1 -- 172.21.15.96:0/2722133707 <== osd.5 v2:172.21.15.139:6804/27647 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4794008070 con 0x7f478006e830 2024-04-18T04:54:48.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.727+0000 7f47a2049640 1 -- 172.21.15.96:0/2722133707 >> [v2:172.21.15.139:6804/27647,v1:172.21.15.139:6806/27647] conn(0x7f478006e830 msgr2=0x7f4780070c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.727+0000 7f47a2049640 1 --2- 172.21.15.96:0/2722133707 >> [v2:172.21.15.139:6804/27647,v1:172.21.15.139:6806/27647] conn(0x7f478006e830 0x7f4780070c50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.727+0000 7f47a2049640 1 -- 172.21.15.96:0/2722133707 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4780066690 msgr2=0x7f4780068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.727+0000 7f47a2049640 1 --2- 172.21.15.96:0/2722133707 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4780066690 0x7f4780068b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f479c0ca4a0 tx=0x7f478c008040 comp rx=0 tx=0).stop 2024-04-18T04:54:48.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.727+0000 7f47a2049640 1 -- 172.21.15.96:0/2722133707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4788005190 msgr2=0x7f479c1544e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.727+0000 7f47a2049640 1 --2- 172.21.15.96:0/2722133707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4788005190 0x7f479c1544e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f479800f900 tx=0x7f479800fdc0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.727+0000 7f47a1848640 1 -- 172.21.15.96:0/2722133707 reap_dead start 2024-04-18T04:54:48.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.727+0000 7f47a2049640 1 -- 172.21.15.96:0/2722133707 shutdown_connections 2024-04-18T04:54:48.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.727+0000 7f47a2049640 1 -- 172.21.15.96:0/2722133707 >> 172.21.15.96:0/2722133707 conn(0x7f479c06c1f0 msgr2=0x7f479c070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:48.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.727+0000 7f47a2049640 1 -- 172.21.15.96:0/2722133707 shutdown_connections 2024-04-18T04:54:48.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.727+0000 7f47a2049640 1 -- 172.21.15.96:0/2722133707 wait complete. 2024-04-18T04:54:48.768 INFO:teuthology.orchestra.run.smithi096.stdout:64424509444 2024-04-18T04:54:48.768 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T04:54:48.768 INFO:teuthology.orchestra.run.smithi096.stdout:64424509446 2024-04-18T04:54:48.769 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T04:54:48.769 INFO:teuthology.orchestra.run.smithi096.stdout:64424509445 2024-04-18T04:54:48.770 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-18T04:54:48.770 INFO:teuthology.orchestra.run.smithi096.stdout:55834574854 2024-04-18T04:54:48.771 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-18T04:54:48.771 INFO:teuthology.orchestra.run.smithi096.stdout:64424509445 2024-04-18T04:54:48.772 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T04:54:48.772 INFO:teuthology.orchestra.run.smithi096.stdout:64424509444 2024-04-18T04:54:48.772 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-18T04:54:48.773 INFO:teuthology.orchestra.run.smithi096.stdout:64424509445 2024-04-18T04:54:48.774 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-18T04:54:48.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7fe34deeb640 1 Processor -- start 2024-04-18T04:54:48.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7fe34deeb640 1 -- start start 2024-04-18T04:54:48.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7fd76bfff640 1 Processor -- start 2024-04-18T04:54:48.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7f28d0fbb640 1 Processor -- start 2024-04-18T04:54:48.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7f28d0fbb640 1 -- start start 2024-04-18T04:54:48.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7fd76bfff640 1 -- start start 2024-04-18T04:54:48.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7f28d0fbb640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f28cc157260 0x7f28cc0cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7f28d0fbb640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f28cc0c9250 0x7f28cc160620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7f28d0fbb640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28cc070fa0 con 0x7f28cc0c4170 2024-04-18T04:54:48.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7f28d0fbb640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28cc0717b0 con 0x7f28cc157260 2024-04-18T04:54:48.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7f28d0fbb640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28cc0711f0 con 0x7f28cc0c9250 2024-04-18T04:54:48.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7fd76bfff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd76c157210 0x7fd76c0c6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7fd76bfff640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76c1610a0 con 0x7fd76c1575f0 2024-04-18T04:54:48.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7fd76bfff640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76c0c7440 con 0x7fd76c0c6c60 2024-04-18T04:54:48.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7fd76bfff640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76c0c2b20 con 0x7fd76c157210 2024-04-18T04:54:48.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7f28cb7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f28cc157260 0x7f28cc0cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7f28cb7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f28cc157260 0x7f28cc0cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38550/0 (socket says 172.21.15.96:38550) 2024-04-18T04:54:48.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7f28cb7fe640 1 -- 172.21.15.96:0/1154391543 learned_addr learned my addr 172.21.15.96:0/1154391543 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:48.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7fd76a7fc640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd76c1575f0 0x7fd76c15d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46258/0 (socket says 172.21.15.96:46258) 2024-04-18T04:54:48.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7fd76a7fc640 1 -- 172.21.15.96:0/3584657243 learned_addr learned my addr 172.21.15.96:0/3584657243 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:48.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe34deeb640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe34815ae00 0x7fe3480c1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe34deeb640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3480c1d40 con 0x7fe348150ce0 2024-04-18T04:54:48.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe34deeb640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3480c4810 con 0x7fe3481510c0 2024-04-18T04:54:48.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe3477fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe348150ce0 0x7fe348156b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46274/0 (socket says 172.21.15.96:46274) 2024-04-18T04:54:48.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe3477fe640 1 -- 172.21.15.96:0/78246726 learned_addr learned my addr 172.21.15.96:0/78246726 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:48.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe34deeb640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe348157620 con 0x7fe34815ae00 2024-04-18T04:54:48.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.979+0000 7f50f97ed640 1 Processor -- start 2024-04-18T04:54:48.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f50f97ed640 1 -- start start 2024-04-18T04:54:48.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f28cbfff640 1 --2- 172.21.15.96:0/1154391543 >> v2:172.21.15.139:3300/0 conn(0x7f28cc0c9250 0x7f28cc160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fd76affd640 1 --2- 172.21.15.96:0/3584657243 >> v2:172.21.15.139:3300/0 conn(0x7fd76c157210 0x7fd76c0c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f50f97ed640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50f406b460 0x7f50f41645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f50f97ed640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f40c41d0 con 0x7f50f4152f30 2024-04-18T04:54:48.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fd769ffb640 1 -- 172.21.15.96:0/3584657243 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354183739 0 0) 0x7fd76c0c7440 con 0x7fd76c0c6c60 2024-04-18T04:54:48.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fd769ffb640 1 -- 172.21.15.96:0/3584657243 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd754003530 con 0x7fd76c0c6c60 2024-04-18T04:54:48.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fd769ffb640 1 -- 172.21.15.96:0/3584657243 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885373618 0 0) 0x7fd76c1610a0 con 0x7fd76c1575f0 2024-04-18T04:54:48.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fd769ffb640 1 -- 172.21.15.96:0/3584657243 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd76c0c7440 con 0x7fd76c1575f0 2024-04-18T04:54:48.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe0569aa640 1 Processor -- start 2024-04-18T04:54:48.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe0569aa640 1 -- start start 2024-04-18T04:54:48.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f50f97ed640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f40c35c0 con 0x7f50f415cc50 2024-04-18T04:54:48.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f50f97ed640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f415d1b0 con 0x7f50f406b460 2024-04-18T04:54:48.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe347fff640 1 --2- 172.21.15.96:0/78246726 >> v2:172.21.15.139:3300/0 conn(0x7fe34815ae00 0x7fe3480c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe3467fc640 1 -- 172.21.15.96:0/78246726 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750659096 0 0) 0x7fe3480c1d40 con 0x7fe348150ce0 2024-04-18T04:54:48.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe3467fc640 1 -- 172.21.15.96:0/78246726 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe330007940 con 0x7fe348150ce0 2024-04-18T04:54:48.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe3467fc640 1 -- 172.21.15.96:0/78246726 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960339878 0 0) 0x7fe3480c4810 con 0x7fe3481510c0 2024-04-18T04:54:48.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe3467fc640 1 -- 172.21.15.96:0/78246726 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3480c1d40 con 0x7fe3481510c0 2024-04-18T04:54:48.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe3467fc640 1 -- 172.21.15.96:0/78246726 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2795230031 0 0) 0x7fe330007940 con 0x7fe348150ce0 2024-04-18T04:54:48.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe347fff640 1 -- 172.21.15.96:0/78246726 >> v1:172.21.15.139:6789/0 conn(0x7fe3481510c0 legacy=0x7fe3480c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe347fff640 1 -- 172.21.15.96:0/78246726 >> v1:172.21.15.96:6789/0 conn(0x7fe348150ce0 legacy=0x7fe348156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe347fff640 1 -- 172.21.15.96:0/78246726 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe348157900 con 0x7fe34815ae00 2024-04-18T04:54:48.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f50f37fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f50f415cc50 0x7f50f406ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.96:49318/0 (socket says 172.21.15.96:49318) 2024-04-18T04:54:48.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f50f37fe640 1 -- 172.21.15.96:0/829455631 learned_addr learned my addr 172.21.15.96:0/829455631 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:48.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f50f8fec640 1 --2- 172.21.15.96:0/829455631 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50f406b460 0x7f50f41645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe0569aa640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0480074f0 0x7fe048006810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe0569aa640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe048049fb0 con 0x7fe0480d9260 2024-04-18T04:54:48.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe0569aa640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04804a290 con 0x7fe04804f7a0 2024-04-18T04:54:48.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe0569aa640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04804a850 con 0x7fe0480074f0 2024-04-18T04:54:48.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe054f47640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fe04804f7a0 0x7fe0480e96e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.96:49330/0 (socket says 172.21.15.96:49330) 2024-04-18T04:54:48.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe054f47640 1 -- 172.21.15.96:0/478453053 learned_addr learned my addr 172.21.15.96:0/478453053 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:48.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f50f8fec640 1 -- 172.21.15.96:0/829455631 >> v1:172.21.15.139:6789/0 conn(0x7f50f415cc50 legacy=0x7f50f406ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f50f8fec640 1 -- 172.21.15.96:0/829455631 >> v1:172.21.15.96:6789/0 conn(0x7f50f4152f30 legacy=0x7f50f40c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f50f8fec640 1 -- 172.21.15.96:0/829455631 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f40c38a0 con 0x7f50f406b460 2024-04-18T04:54:48.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f28cb7fe640 1 -- 172.21.15.96:0/1154391543 >> v2:172.21.15.139:3300/0 conn(0x7f28cc0c9250 msgr2=0x7f28cc160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f28cb7fe640 1 --2- 172.21.15.96:0/1154391543 >> v2:172.21.15.139:3300/0 conn(0x7f28cc0c9250 0x7f28cc160620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f28cb7fe640 1 -- 172.21.15.96:0/1154391543 >> v1:172.21.15.139:6789/0 conn(0x7f28cc0c4170 legacy=0x7f28cc069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f28cb7fe640 1 -- 172.21.15.96:0/1154391543 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc0714d0 con 0x7f28cc157260 2024-04-18T04:54:48.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7faf8ce83640 1 Processor -- start 2024-04-18T04:54:48.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f28cb7fe640 1 --2- 172.21.15.96:0/1154391543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28cc157260 0x7f28cc0cac10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f28cc06af20 tx=0x7f28b401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6999ec4a4a9deea server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f28caffd640 1 -- 172.21.15.96:0/1154391543 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b40aa640 con 0x7f28cc157260 2024-04-18T04:54:48.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f28caffd640 1 -- 172.21.15.96:0/1154391543 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b40aa7a0 con 0x7f28cc157260 2024-04-18T04:54:48.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f28caffd640 1 -- 172.21.15.96:0/1154391543 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b40aab30 con 0x7f28cc157260 2024-04-18T04:54:48.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe04effd640 1 -- 172.21.15.96:0/478453053 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215003905 0 0) 0x7fe04804a290 con 0x7fe04804f7a0 2024-04-18T04:54:48.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe04effd640 1 -- 172.21.15.96:0/478453053 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe040003530 con 0x7fe04804f7a0 2024-04-18T04:54:48.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7faf8ce83640 1 -- start start 2024-04-18T04:54:48.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe04f7fe640 1 --2- 172.21.15.96:0/478453053 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0480074f0 0x7fe048006810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:48.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe04effd640 1 -- 172.21.15.96:0/478453053 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4023280219 0 0) 0x7fe040003530 con 0x7fe04804f7a0 2024-04-18T04:54:48.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe04effd640 1 -- 172.21.15.96:0/478453053 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0480074f0 msgr2=0x7fe048006810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe04effd640 1 --2- 172.21.15.96:0/478453053 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0480074f0 0x7fe048006810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe04effd640 1 -- 172.21.15.96:0/478453053 >> v1:172.21.15.96:6789/0 conn(0x7fe0480d9260 legacy=0x7fe0480e2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:48.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fe04effd640 1 -- 172.21.15.96:0/478453053 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04804a570 con 0x7fe04804f7a0 2024-04-18T04:54:48.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7f5ee3d74640 1 Processor -- start 2024-04-18T04:54:48.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe04effd640 1 -- 172.21.15.96:0/478453053 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fe03c001680 con 0x7fe04804f7a0 2024-04-18T04:54:48.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee3d74640 1 -- start start 2024-04-18T04:54:48.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe04effd640 1 -- 172.21.15.96:0/478453053 >> v1:172.21.15.139:6789/0 conn(0x7fe04804f7a0 legacy=0x7fe0480e96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe04effd640 1 --2- 172.21.15.96:0/478453053 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0480074f0 0x7fe040003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe04effd640 1 --2- 172.21.15.96:0/478453053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe040004050 0x7fe0400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe347fff640 1 --2- 172.21.15.96:0/78246726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe34815ae00 0x7fe3480c1800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe3380097c0 tx=0x7fe33801c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcc0cf9679fbc6d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:48.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe04effd640 1 --2- 172.21.15.96:0/478453053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe040004d10 0x7fe040005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:48.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe04effd640 1 -- 172.21.15.96:0/478453053 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04804a850 con 0x7fe040004d10 2024-04-18T04:54:48.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe04effd640 1 -- 172.21.15.96:0/478453053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04000bbe0 con 0x7fe040004050 2024-04-18T04:54:48.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe04effd640 1 -- 172.21.15.96:0/478453053 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04000bda0 con 0x7fe0480074f0 2024-04-18T04:54:48.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f28d0fbb640 1 -- 172.21.15.96:0/1154391543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28cc157260 msgr2=0x7f28cc0cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:48.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f28d0fbb640 1 --2- 172.21.15.96:0/1154391543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28cc157260 0x7f28cc0cac10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f28cc06af20 tx=0x7f28b401c4e0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f28d0fbb640 1 -- 172.21.15.96:0/1154391543 shutdown_connections 2024-04-18T04:54:48.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f28d0fbb640 1 --2- 172.21.15.96:0/1154391543 >> v2:172.21.15.139:3300/0 conn(0x7f28cc0c9250 0x7f28cc160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f28d0fbb640 1 --2- 172.21.15.96:0/1154391543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28cc157260 0x7f28cc0cac10 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f28cc06af20 tx=0x7f28b401c4e0 comp rx=0 tx=0).stop 2024-04-18T04:54:48.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f28d0fbb640 1 -- 172.21.15.96:0/1154391543 >> 172.21.15.96:0/1154391543 conn(0x7f28cc06c1f0 msgr2=0x7f28cc065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:49.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fd76affd640 1 -- 172.21.15.96:0/3584657243 >> v1:172.21.15.139:6789/0 conn(0x7fd76c0c6c60 legacy=0x7fd76c0cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fd76affd640 1 -- 172.21.15.96:0/3584657243 >> v1:172.21.15.96:6789/0 conn(0x7fd76c1575f0 legacy=0x7fd76c15d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.983+0000 7fd76affd640 1 -- 172.21.15.96:0/3584657243 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c0c5f30 con 0x7fd76c157210 2024-04-18T04:54:49.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe04ffff640 1 --2- 172.21.15.96:0/478453053 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0480074f0 0x7fe040003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe3467fc640 1 -- 172.21.15.96:0/78246726 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c001680 con 0x7fe34815ae00 2024-04-18T04:54:49.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe3467fc640 1 -- 172.21.15.96:0/78246726 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3380ac440 con 0x7fe34815ae00 2024-04-18T04:54:49.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe3467fc640 1 -- 172.21.15.96:0/78246726 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3380ac5b0 con 0x7fe34815ae00 2024-04-18T04:54:49.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7faf8ce83640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf88152e80 0x7faf880c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7faf8ce83640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf880c7030 con 0x7faf880c6ba0 2024-04-18T04:54:49.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7faf8ce83640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf88066850 con 0x7faf88159270 2024-04-18T04:54:49.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7faf8ce83640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf88158d90 con 0x7faf88152e80 2024-04-18T04:54:49.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe054f47640 1 --2- 172.21.15.96:0/478453053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe040004d10 0x7fe040005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f28d0fbb640 1 -- 172.21.15.96:0/1154391543 shutdown_connections 2024-04-18T04:54:49.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fd76affd640 1 --2- 172.21.15.96:0/3584657243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd76c157210 0x7fd76c0c6720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0097c0 tx=0x7fd75c01ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=275f6f6237960403 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7faf87fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7faf880c6ba0 0x7faf88163570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46284/0 (socket says 172.21.15.96:46284) 2024-04-18T04:54:49.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7faf87fff640 1 -- 172.21.15.96:0/3151136987 learned_addr learned my addr 172.21.15.96:0/3151136987 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:49.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7faf877fe640 1 --2- 172.21.15.96:0/3151136987 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf88152e80 0x7faf880c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe04f7fe640 1 --2- 172.21.15.96:0/478453053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe040004050 0x7fe0400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe04ffff640 1 -- 172.21.15.96:0/478453053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe040004050 msgr2=0x7fe0400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:49.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe04ffff640 1 --2- 172.21.15.96:0/478453053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe040004050 0x7fe0400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe04ffff640 1 -- 172.21.15.96:0/478453053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe040004d10 msgr2=0x7fe040005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:49.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe04ffff640 1 --2- 172.21.15.96:0/478453053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe040004d10 0x7fe040005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe04ffff640 1 -- 172.21.15.96:0/478453053 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe040003530 con 0x7fe0480074f0 2024-04-18T04:54:49.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee3d74640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5edc14d440 0x7f5edc06df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee130f640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5edc0c12e0 0x7f5edc0c7db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46294/0 (socket says 172.21.15.96:46294) 2024-04-18T04:54:49.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee130f640 1 -- 172.21.15.96:0/965580795 learned_addr learned my addr 172.21.15.96:0/965580795 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:49.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee3d74640 1 -- 172.21.15.96:0/965580795 --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc0c6cc0 con 0x7f5edc0c12e0 2024-04-18T04:54:49.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee3d74640 1 -- 172.21.15.96:0/965580795 --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc06e470 con 0x7f5edc0c1af0 2024-04-18T04:54:49.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee3d74640 1 -- 172.21.15.96:0/965580795 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc0c84c0 con 0x7f5edc14d440 2024-04-18T04:54:49.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fd769ffb640 1 -- 172.21.15.96:0/3584657243 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c0a89b0 con 0x7fd76c157210 2024-04-18T04:54:49.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe34deeb640 1 -- 172.21.15.96:0/78246726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe34815ae00 msgr2=0x7fe3480c1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe34deeb640 1 --2- 172.21.15.96:0/78246726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe34815ae00 0x7fe3480c1800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe3380097c0 tx=0x7fe33801c390 comp rx=0 tx=0).stop 2024-04-18T04:54:49.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe34deeb640 1 -- 172.21.15.96:0/78246726 shutdown_connections 2024-04-18T04:54:49.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe34deeb640 1 --2- 172.21.15.96:0/78246726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe34815ae00 0x7fe3480c1800 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe34deeb640 1 -- 172.21.15.96:0/78246726 >> 172.21.15.96:0/78246726 conn(0x7fe348069e60 msgr2=0x7fe34806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:49.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe054f47640 1 --2- 172.21.15.96:0/478453053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe040004d10 0x7fe040005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:54:49.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee1b10640 1 --2- 172.21.15.96:0/965580795 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5edc14d440 0x7f5edc06df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee0b0e640 1 -- 172.21.15.96:0/965580795 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102180905 0 0) 0x7f5edc0c6cc0 con 0x7f5edc0c12e0 2024-04-18T04:54:49.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee0b0e640 1 -- 172.21.15.96:0/965580795 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ec8003530 con 0x7f5edc0c12e0 2024-04-18T04:54:49.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fde02491640 1 Processor -- start 2024-04-18T04:54:49.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fde02491640 1 -- start start 2024-04-18T04:54:49.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe34deeb640 1 -- 172.21.15.96:0/78246726 shutdown_connections 2024-04-18T04:54:49.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f50f8fec640 1 --2- 172.21.15.96:0/829455631 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50f406b460 0x7f50f41645e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009dc0 tx=0x7f50ec01c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8603c410aa6d7347 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7faf867fc640 1 -- 172.21.15.96:0/3151136987 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296753288 0 0) 0x7faf880c7030 con 0x7faf880c6ba0 2024-04-18T04:54:49.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7faf867fc640 1 -- 172.21.15.96:0/3151136987 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf70003530 con 0x7faf880c6ba0 2024-04-18T04:54:49.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7faf877fe640 1 -- 172.21.15.96:0/3151136987 >> v1:172.21.15.139:6789/0 conn(0x7faf88159270 legacy=0x7faf880c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7faf877fe640 1 -- 172.21.15.96:0/3151136987 >> v1:172.21.15.96:6789/0 conn(0x7faf880c6ba0 legacy=0x7faf88163570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7faf877fe640 1 -- 172.21.15.96:0/3151136987 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf88065cd0 con 0x7faf88152e80 2024-04-18T04:54:49.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee0b0e640 1 -- 172.21.15.96:0/965580795 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1785568935 0 0) 0x7f5ec8003530 con 0x7f5edc0c12e0 2024-04-18T04:54:49.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee0b0e640 1 -- 172.21.15.96:0/965580795 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5edc14d440 msgr2=0x7f5edc06df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:49.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee0b0e640 1 --2- 172.21.15.96:0/965580795 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5edc14d440 0x7f5edc06df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee0b0e640 1 -- 172.21.15.96:0/965580795 >> v1:172.21.15.139:6789/0 conn(0x7f5edc0c1af0 legacy=0x7f5edc161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee0b0e640 1 -- 172.21.15.96:0/965580795 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc157340 con 0x7f5edc0c12e0 2024-04-18T04:54:49.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee0b0e640 1 -- 172.21.15.96:0/965580795 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f5ecc001680 con 0x7f5edc0c12e0 2024-04-18T04:54:49.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee0b0e640 1 -- 172.21.15.96:0/965580795 >> v1:172.21.15.96:6789/0 conn(0x7f5edc0c12e0 legacy=0x7f5edc0c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee0b0e640 1 --2- 172.21.15.96:0/965580795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ec80039b0 0x7f5ec8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee0b0e640 1 --2- 172.21.15.96:0/965580795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ec80047d0 0x7f5ec8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee0b0e640 1 --2- 172.21.15.96:0/965580795 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5ec8005190 0x7f5ec8014590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee0b0e640 1 -- 172.21.15.96:0/965580795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc0c84c0 con 0x7f5ec80047d0 2024-04-18T04:54:49.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee0b0e640 1 -- 172.21.15.96:0/965580795 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec8009b90 con 0x7f5ec80039b0 2024-04-18T04:54:49.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee0b0e640 1 -- 172.21.15.96:0/965580795 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec8014ad0 con 0x7f5ec8005190 2024-04-18T04:54:49.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f28d0fbb640 1 -- 172.21.15.96:0/1154391543 wait complete. 2024-04-18T04:54:49.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f28d0fbb640 1 Processor -- start 2024-04-18T04:54:49.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee130f640 1 --2- 172.21.15.96:0/965580795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ec80047d0 0x7f5ec8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f50f2ffd640 1 -- 172.21.15.96:0/829455631 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec0a5850 con 0x7f50f406b460 2024-04-18T04:54:49.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7fe34deeb640 1 -- 172.21.15.96:0/78246726 wait complete. 2024-04-18T04:54:49.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee2311640 1 --2- 172.21.15.96:0/965580795 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5ec8005190 0x7f5ec8014590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee130f640 1 -- 172.21.15.96:0/965580795 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5ec8005190 msgr2=0x7f5ec8014590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:49.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee130f640 1 --2- 172.21.15.96:0/965580795 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5ec8005190 0x7f5ec8014590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee130f640 1 -- 172.21.15.96:0/965580795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ec80039b0 msgr2=0x7f5ec8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:49.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee130f640 1 --2- 172.21.15.96:0/965580795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ec80039b0 0x7f5ec8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f5ee130f640 1 -- 172.21.15.96:0/965580795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc157340 con 0x7f5ec80047d0 2024-04-18T04:54:49.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f28d0fbb640 1 -- start start 2024-04-18T04:54:49.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f50f2ffd640 1 -- 172.21.15.96:0/829455631 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec0a59b0 con 0x7f50f406b460 2024-04-18T04:54:49.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.987+0000 7f50f2ffd640 1 -- 172.21.15.96:0/829455631 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec0a5d40 con 0x7f50f406b460 2024-04-18T04:54:49.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe34deeb640 1 Processor -- start 2024-04-18T04:54:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fde02491640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fddf40dd650 0x7fddf4005e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fde02491640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fddf404ace0 0x7fddf40467b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fde02491640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf404b1d0 con 0x7fddf404bc10 2024-04-18T04:54:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fde02491640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf404c220 con 0x7fddf40dd650 2024-04-18T04:54:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fde02491640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf404c500 con 0x7fddf404ace0 2024-04-18T04:54:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28d0fbb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28cc0c4170 0x7f28cc15f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28d0fbb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28cc0c9250 0x7f28cc1ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28d0fbb640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28cc160210 0x7f28cc1efc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28d0fbb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc1ef290 con 0x7f28cc0c4170 2024-04-18T04:54:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28d0fbb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc14f6e0 con 0x7f28cc0c9250 2024-04-18T04:54:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28d0fbb640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc1f6890 con 0x7f28cc160210 2024-04-18T04:54:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe04ffff640 1 --2- 172.21.15.96:0/478453053 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0480074f0 0x7fe040003980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe044001650 tx=0x7fe04401c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad9ea050dbe689b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fde0148f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fddf40dd650 0x7fddf4005e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fde0148f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fddf40dd650 0x7fddf4005e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38574/0 (socket says 172.21.15.96:38574) 2024-04-18T04:54:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fde0148f640 1 -- 172.21.15.96:0/2890946123 learned_addr learned my addr 172.21.15.96:0/2890946123 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28cb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28cc0c4170 0x7f28cc15f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28cb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28cc0c4170 0x7f28cc15f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38586/0 (socket says 172.21.15.96:38586) 2024-04-18T04:54:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28cb7fe640 1 -- 172.21.15.96:0/3121704052 learned_addr learned my addr 172.21.15.96:0/3121704052 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe04effd640 1 -- 172.21.15.96:0/478453053 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044005270 con 0x7fe0480074f0 2024-04-18T04:54:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f50f97ed640 1 -- 172.21.15.96:0/829455631 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50f406b460 msgr2=0x7f50f41645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f50f97ed640 1 --2- 172.21.15.96:0/829455631 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50f406b460 0x7f50f41645e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009dc0 tx=0x7f50ec01c810 comp rx=0 tx=0).stop 2024-04-18T04:54:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fde00c8e640 1 --2- 172.21.15.96:0/2890946123 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fddf404ace0 0x7fddf40467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe34deeb640 1 -- start start 2024-04-18T04:54:49.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe04effd640 1 -- 172.21.15.96:0/478453053 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0440a7070 con 0x7fe0480074f0 2024-04-18T04:54:49.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe04effd640 1 -- 172.21.15.96:0/478453053 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044003620 con 0x7fe0480074f0 2024-04-18T04:54:49.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28cbfff640 1 --2- 172.21.15.96:0/3121704052 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28cc160210 0x7f28cc1efc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28c3fff640 1 --2- 172.21.15.96:0/3121704052 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28cc0c9250 0x7f28cc1ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f50f97ed640 1 -- 172.21.15.96:0/829455631 shutdown_connections 2024-04-18T04:54:49.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f50f97ed640 1 --2- 172.21.15.96:0/829455631 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50f406b460 0x7f50f41645e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f50f97ed640 1 -- 172.21.15.96:0/829455631 >> 172.21.15.96:0/829455631 conn(0x7f50f4071760 msgr2=0x7f50f4065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:49.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f50f97ed640 1 -- 172.21.15.96:0/829455631 shutdown_connections 2024-04-18T04:54:49.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f50f97ed640 1 -- 172.21.15.96:0/829455631 wait complete. 2024-04-18T04:54:49.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fde0148f640 1 -- 172.21.15.96:0/2890946123 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fddf404ace0 msgr2=0x7fddf40467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:49.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fde0148f640 1 --2- 172.21.15.96:0/2890946123 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fddf404ace0 0x7fddf40467b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fde0148f640 1 -- 172.21.15.96:0/2890946123 >> v1:172.21.15.96:6789/0 conn(0x7fddf404bc10 legacy=0x7fddf40e3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fde0148f640 1 -- 172.21.15.96:0/2890946123 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf404c7e0 con 0x7fddf40dd650 2024-04-18T04:54:49.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fd769ffb640 1 -- 172.21.15.96:0/3584657243 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c0a8b10 con 0x7fd76c157210 2024-04-18T04:54:49.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fd769ffb640 1 -- 172.21.15.96:0/3584657243 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c0a8e80 con 0x7fd76c157210 2024-04-18T04:54:49.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f5ee130f640 1 --2- 172.21.15.96:0/965580795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ec80047d0 0x7f5ec8004c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00c260 tx=0x7f5ecc01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b869c485707502 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f5ee0b0e640 1 -- 172.21.15.96:0/965580795 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc0a5b80 con 0x7f5ec80047d0 2024-04-18T04:54:49.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe34deeb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe348150ce0 0x7fe3481568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe34deeb640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3481510c0 0x7fe34814c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe34deeb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe34815ae00 0x7fe34813cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe34deeb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe348143500 con 0x7fe34815ae00 2024-04-18T04:54:49.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe34deeb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe348147bb0 con 0x7fe348150ce0 2024-04-18T04:54:49.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe34deeb640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe348143220 con 0x7fe3481510c0 2024-04-18T04:54:49.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f5ee0b0e640 1 -- 172.21.15.96:0/965580795 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc0a5ce0 con 0x7f5ec80047d0 2024-04-18T04:54:49.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe0569aa640 1 -- 172.21.15.96:0/478453053 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0480074f0 msgr2=0x7fe040003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe0569aa640 1 --2- 172.21.15.96:0/478453053 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0480074f0 0x7fe040003980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe044001650 tx=0x7fe04401c300 comp rx=0 tx=0).stop 2024-04-18T04:54:49.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f5ee0b0e640 1 -- 172.21.15.96:0/965580795 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc005b20 con 0x7f5ec80047d0 2024-04-18T04:54:49.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe054f47640 1 -- 172.21.15.96:0/478453053 reap_dead start 2024-04-18T04:54:49.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe346ffd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3481510c0 0x7fe34814c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe3477fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe348150ce0 0x7fe3481568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe3477fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe348150ce0 0x7fe3481568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:44054/0 (socket says 172.21.15.96:44054) 2024-04-18T04:54:49.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe3477fe640 1 -- 172.21.15.96:0/115713429 learned_addr learned my addr 172.21.15.96:0/115713429 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:49.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f50f97ed640 1 Processor -- start 2024-04-18T04:54:49.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe0569aa640 1 -- 172.21.15.96:0/478453053 shutdown_connections 2024-04-18T04:54:49.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe0569aa640 1 -- 172.21.15.96:0/478453053 >> 172.21.15.96:0/478453053 conn(0x7fe04800ee20 msgr2=0x7fe048010270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:49.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fd76bfff640 1 -- 172.21.15.96:0/3584657243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd76c157210 msgr2=0x7fd76c0c6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fd76bfff640 1 --2- 172.21.15.96:0/3584657243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd76c157210 0x7fd76c0c6720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0097c0 tx=0x7fd75c01ecb0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7faf877fe640 1 --2- 172.21.15.96:0/3151136987 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf88152e80 0x7faf880c5af0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faf780097f0 tx=0x7faf7801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42189b2fb28774a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe347fff640 1 --2- 172.21.15.96:0/115713429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe34815ae00 0x7fe34813cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f50f97ed640 1 -- start start 2024-04-18T04:54:49.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28cbfff640 1 -- 172.21.15.96:0/3121704052 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28cc0c9250 msgr2=0x7f28cc1ef6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28cbfff640 1 --2- 172.21.15.96:0/3121704052 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28cc0c9250 0x7f28cc1ef6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28cbfff640 1 -- 172.21.15.96:0/3121704052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28cc0c4170 msgr2=0x7f28cc15f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28cbfff640 1 --2- 172.21.15.96:0/3121704052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28cc0c4170 0x7f28cc15f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28cbfff640 1 -- 172.21.15.96:0/3121704052 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b40094d0 con 0x7f28cc160210 2024-04-18T04:54:49.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28cbfff640 1 --2- 172.21.15.96:0/3121704052 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28cc160210 0x7f28cc1efc20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f28c4007dc0 tx=0x7f28c400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7faf867fc640 1 -- 172.21.15.96:0/3151136987 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf780aa640 con 0x7faf88152e80 2024-04-18T04:54:49.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28cb7fe640 1 --2- 172.21.15.96:0/3121704052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28cc0c4170 0x7f28cc15f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:54:49.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7faf867fc640 1 -- 172.21.15.96:0/3151136987 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf780aa7a0 con 0x7faf88152e80 2024-04-18T04:54:49.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7faf867fc640 1 -- 172.21.15.96:0/3151136987 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf780aab30 con 0x7faf88152e80 2024-04-18T04:54:49.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f5ee3d74640 1 -- 172.21.15.96:0/965580795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ec80047d0 msgr2=0x7f5ec8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f5ee3d74640 1 --2- 172.21.15.96:0/965580795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ec80047d0 0x7f5ec8004c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00c260 tx=0x7f5ecc01cc80 comp rx=0 tx=0).stop 2024-04-18T04:54:49.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f5ee2311640 1 -- 172.21.15.96:0/965580795 reap_dead start 2024-04-18T04:54:49.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe3477fe640 1 -- 172.21.15.96:0/115713429 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3481510c0 msgr2=0x7fe34814c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe3477fe640 1 --2- 172.21.15.96:0/115713429 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3481510c0 0x7fe34814c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe3477fe640 1 -- 172.21.15.96:0/115713429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe34815ae00 msgr2=0x7fe34813cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe3477fe640 1 --2- 172.21.15.96:0/115713429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe34815ae00 0x7fe34813cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe3477fe640 1 -- 172.21.15.96:0/115713429 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe338009420 con 0x7fe348150ce0 2024-04-18T04:54:49.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f5ee3d74640 1 -- 172.21.15.96:0/965580795 shutdown_connections 2024-04-18T04:54:49.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f5ee3d74640 1 -- 172.21.15.96:0/965580795 >> 172.21.15.96:0/965580795 conn(0x7f5edc06fa60 msgr2=0x7f5edc06fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:49.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28c8ff9640 1 -- 172.21.15.96:0/3121704052 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4018070 con 0x7f28cc160210 2024-04-18T04:54:49.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28c8ff9640 1 -- 172.21.15.96:0/3121704052 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c400ed70 con 0x7f28cc160210 2024-04-18T04:54:49.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f28c8ff9640 1 -- 172.21.15.96:0/3121704052 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c400eee0 con 0x7f28cc160210 2024-04-18T04:54:49.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe0569aa640 1 -- 172.21.15.96:0/478453053 shutdown_connections 2024-04-18T04:54:49.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f5ee3d74640 1 -- 172.21.15.96:0/965580795 shutdown_connections 2024-04-18T04:54:49.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f50f97ed640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50f406b460 0x7f50f4140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f50f97ed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50f4152f30 0x7f50f40b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f50f97ed640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50f415cc50 0x7f50f40b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f50f97ed640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40ccc00 con 0x7f50f415cc50 2024-04-18T04:54:49.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f50f97ed640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f415bd70 con 0x7f50f4152f30 2024-04-18T04:54:49.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f50f97ed640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f415b630 con 0x7f50f406b460 2024-04-18T04:54:49.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7faf8ce83640 1 -- 172.21.15.96:0/3151136987 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf88152e80 msgr2=0x7faf880c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7faf8ce83640 1 --2- 172.21.15.96:0/3151136987 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf88152e80 0x7faf880c5af0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faf780097f0 tx=0x7faf7801c4e0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f50f37fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50f4152f30 0x7f50f40b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f50f3fff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50f406b460 0x7f50f4140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f50f37fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50f4152f30 0x7f50f40b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:44058/0 (socket says 172.21.15.96:44058) 2024-04-18T04:54:49.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f50f37fe640 1 -- 172.21.15.96:0/88956557 learned_addr learned my addr 172.21.15.96:0/88956557 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:49.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7faf8ce83640 1 -- 172.21.15.96:0/3151136987 shutdown_connections 2024-04-18T04:54:49.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7faf8ce83640 1 --2- 172.21.15.96:0/3151136987 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf88152e80 0x7faf880c5af0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7faf8ce83640 1 -- 172.21.15.96:0/3151136987 >> 172.21.15.96:0/3151136987 conn(0x7faf880c7c10 msgr2=0x7faf880c7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:49.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7faf8ce83640 1 -- 172.21.15.96:0/3151136987 shutdown_connections 2024-04-18T04:54:49.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7f5ee3d74640 1 -- 172.21.15.96:0/965580795 wait complete. 2024-04-18T04:54:49.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee3d74640 1 Processor -- start 2024-04-18T04:54:49.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f50f37fe640 1 -- 172.21.15.96:0/88956557 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50f406b460 msgr2=0x7f50f4140700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f50f37fe640 1 --2- 172.21.15.96:0/88956557 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50f406b460 0x7f50f4140700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f50f37fe640 1 -- 172.21.15.96:0/88956557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50f415cc50 msgr2=0x7f50f40b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f50f37fe640 1 --2- 172.21.15.96:0/88956557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50f415cc50 0x7f50f40b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f50f37fe640 1 -- 172.21.15.96:0/88956557 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec009a70 con 0x7f50f4152f30 2024-04-18T04:54:49.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe3477fe640 1 --2- 172.21.15.96:0/115713429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe348150ce0 0x7fe3481568b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00c780 tx=0x7fe33c00cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe32ffff640 1 -- 172.21.15.96:0/115713429 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c005cf0 con 0x7fe348150ce0 2024-04-18T04:54:49.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe32ffff640 1 -- 172.21.15.96:0/115713429 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c005e70 con 0x7fe348150ce0 2024-04-18T04:54:49.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe32ffff640 1 -- 172.21.15.96:0/115713429 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c007270 con 0x7fe348150ce0 2024-04-18T04:54:49.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe34deeb640 1 -- 172.21.15.96:0/115713429 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe348147e50 con 0x7fe348150ce0 2024-04-18T04:54:49.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe34deeb640 1 -- 172.21.15.96:0/115713429 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe348159e90 con 0x7fe348150ce0 2024-04-18T04:54:49.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.991+0000 7fe0569aa640 1 -- 172.21.15.96:0/478453053 wait complete. 2024-04-18T04:54:49.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe0569aa640 1 Processor -- start 2024-04-18T04:54:49.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fd76bfff640 1 -- 172.21.15.96:0/3584657243 shutdown_connections 2024-04-18T04:54:49.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fd76bfff640 1 --2- 172.21.15.96:0/3584657243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd76c157210 0x7fd76c0c6720 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fd76bfff640 1 -- 172.21.15.96:0/3584657243 >> 172.21.15.96:0/3584657243 conn(0x7fd76c06af70 msgr2=0x7fd76c06b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:49.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f28d0fbb640 1 -- 172.21.15.96:0/3121704052 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28cc14ee40 con 0x7f28cc160210 2024-04-18T04:54:49.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f28d0fbb640 1 -- 172.21.15.96:0/3121704052 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28cc14f400 con 0x7f28cc160210 2024-04-18T04:54:49.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f28d0fbb640 1 -- 172.21.15.96:0/3121704052 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28cc1ef060 con 0x7f28cc160210 2024-04-18T04:54:49.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fd76bfff640 1 -- 172.21.15.96:0/3584657243 shutdown_connections 2024-04-18T04:54:49.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fd76bfff640 1 -- 172.21.15.96:0/3584657243 wait complete. 2024-04-18T04:54:49.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe34deeb640 1 -- 172.21.15.96:0/115713429 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe348066ed0 con 0x7fe348150ce0 2024-04-18T04:54:49.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7faf8ce83640 1 -- 172.21.15.96:0/3151136987 wait complete. 2024-04-18T04:54:49.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee3d74640 1 -- start start 2024-04-18T04:54:49.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee3d74640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5edc0cc090 0x7f5edc0ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee3d74640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5edc0cc470 0x7f5edc1ff0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee3d74640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5edc1fb910 0x7f5edc1fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee3d74640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc1ff630 con 0x7f5edc1fb910 2024-04-18T04:54:49.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee3d74640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc1ec5e0 con 0x7f5edc0cc470 2024-04-18T04:54:49.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee3d74640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc1fb170 con 0x7f5edc0cc090 2024-04-18T04:54:49.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f50f37fe640 1 --2- 172.21.15.96:0/88956557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50f4152f30 0x7f50f40b2f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f50e400c7b0 tx=0x7f50e400cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe0569aa640 1 -- start start 2024-04-18T04:54:49.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee1b10640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5edc0cc090 0x7f5edc0ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee1b10640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5edc0cc090 0x7f5edc0ca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:55082/0 (socket says 172.21.15.96:55082) 2024-04-18T04:54:49.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee1b10640 1 -- 172.21.15.96:0/381563598 learned_addr learned my addr 172.21.15.96:0/381563598 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:49.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee2311640 1 --2- 172.21.15.96:0/381563598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5edc1fb910 0x7f5edc1fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee2311640 1 -- 172.21.15.96:0/381563598 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5edc0cc090 msgr2=0x7f5edc0ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee2311640 1 --2- 172.21.15.96:0/381563598 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5edc0cc090 0x7f5edc0ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee2311640 1 -- 172.21.15.96:0/381563598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5edc0cc470 msgr2=0x7f5edc1ff0f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:54:49.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee2311640 1 --2- 172.21.15.96:0/381563598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5edc0cc470 0x7f5edc1ff0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee2311640 1 -- 172.21.15.96:0/381563598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc0ca6e0 con 0x7f5edc1fb910 2024-04-18T04:54:49.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fd76bfff640 1 Processor -- start 2024-04-18T04:54:49.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe32ffff640 1 -- 172.21.15.96:0/115713429 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe33c0073d0 con 0x7fe348150ce0 2024-04-18T04:54:49.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee2311640 1 --2- 172.21.15.96:0/381563598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5edc1fb910 0x7f5edc1fbd90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8003980 tx=0x7f5ed400e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fde0148f640 1 --2- 172.21.15.96:0/2890946123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40dd650 0x7fddf4005e70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009870 tx=0x7fddf801c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ffc0535b5bcf0c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe32ffff640 1 --2- 172.21.15.96:0/115713429 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe3340666e0 0x7fe334068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe32ffff640 1 -- 172.21.15.96:0/115713429 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe33c0848c0 con 0x7fe348150ce0 2024-04-18T04:54:49.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7faf8ce83640 1 Processor -- start 2024-04-18T04:54:49.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe0569aa640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0480074f0 0x7fe0481813f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe0569aa640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0480dff20 0x7fe048176f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe0569aa640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe048173280 0x7fe048173700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe0569aa640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0481774b0 con 0x7fe048173280 2024-04-18T04:54:49.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe0569aa640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe048173c40 con 0x7fe0480074f0 2024-04-18T04:54:49.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe0569aa640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe048176ae0 con 0x7fe0480dff20 2024-04-18T04:54:49.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe054f47640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe048173280 0x7fe048173700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe054f47640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe048173280 0x7fe048173700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38610/0 (socket says 172.21.15.96:38610) 2024-04-18T04:54:49.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe054f47640 1 -- 172.21.15.96:0/1098775014 learned_addr learned my addr 172.21.15.96:0/1098775014 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:49.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe04f7fe640 1 --2- 172.21.15.96:0/1098775014 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0480dff20 0x7fe048176f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fe04ffff640 1 --2- 172.21.15.96:0/1098775014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0480074f0 0x7fe0481813f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ed27fc640 1 -- 172.21.15.96:0/381563598 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4003b90 con 0x7f5edc1fb910 2024-04-18T04:54:49.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ed27fc640 1 -- 172.21.15.96:0/381563598 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed4003cf0 con 0x7f5edc1fb910 2024-04-18T04:54:49.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ed27fc640 1 -- 172.21.15.96:0/381563598 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed40052d0 con 0x7f5edc1fb910 2024-04-18T04:54:49.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee3d74640 1 -- 172.21.15.96:0/381563598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5edc0c5590 con 0x7f5edc1fb910 2024-04-18T04:54:49.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7f5ee3d74640 1 -- 172.21.15.96:0/381563598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5edc0c5b50 con 0x7f5edc1fb910 2024-04-18T04:54:49.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7f28c8ff9640 1 -- 172.21.15.96:0/3121704052 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f28c4003be0 con 0x7f28cc160210 2024-04-18T04:54:49.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7f28c8ff9640 1 --2- 172.21.15.96:0/3121704052 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f28ac066760 0x7f28ac068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7f28c8ff9640 1 -- 172.21.15.96:0/3121704052 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28c4085070 con 0x7f28cc160210 2024-04-18T04:54:49.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.995+0000 7fd76bfff640 1 -- start start 2024-04-18T04:54:49.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd76c0c6c60 0x7fd76c0716d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76bfff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd76c157210 0x7fd76c158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd76c1575f0 0x7fd76c159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76bfff640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c1579f0 con 0x7fd76c1575f0 2024-04-18T04:54:49.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76bfff640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c150cd0 con 0x7fd76c0c6c60 2024-04-18T04:54:49.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76bfff640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c150fb0 con 0x7fd76c157210 2024-04-18T04:54:49.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fe346ffd640 1 --2- 172.21.15.96:0/115713429 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe3340666e0 0x7fe334068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fe04ffff640 1 -- 172.21.15.96:0/1098775014 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0480dff20 msgr2=0x7fe048176f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fe04ffff640 1 --2- 172.21.15.96:0/1098775014 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0480dff20 0x7fe048176f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fe04ffff640 1 -- 172.21.15.96:0/1098775014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe048173280 msgr2=0x7fe048173700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fe04ffff640 1 --2- 172.21.15.96:0/1098775014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe048173280 0x7fe048173700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fe04ffff640 1 -- 172.21.15.96:0/1098775014 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe048175930 con 0x7fe0480074f0 2024-04-18T04:54:49.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fe04ffff640 1 --2- 172.21.15.96:0/1098775014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0480074f0 0x7fe0481813f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe04000bf30 tx=0x7fe040005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7f5ee3d74640 1 -- 172.21.15.96:0/381563598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5edc0c5d40 con 0x7f5edc1fb910 2024-04-18T04:54:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fddf3fff640 1 -- 172.21.15.96:0/2890946123 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40e40b0 con 0x7fddf40dd650 2024-04-18T04:54:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fddf3fff640 1 -- 172.21.15.96:0/2890946123 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf80a9640 con 0x7fddf40dd650 2024-04-18T04:54:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fddf3fff640 1 -- 172.21.15.96:0/2890946123 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf80a99d0 con 0x7fddf40dd650 2024-04-18T04:54:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fde02491640 1 -- 172.21.15.96:0/2890946123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40dd650 msgr2=0x7fddf4005e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fde02491640 1 --2- 172.21.15.96:0/2890946123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40dd650 0x7fddf4005e70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009870 tx=0x7fddf801c5a0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fde02491640 1 -- 172.21.15.96:0/2890946123 shutdown_connections 2024-04-18T04:54:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fde02491640 1 --2- 172.21.15.96:0/2890946123 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fddf404ace0 0x7fddf40467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fde02491640 1 --2- 172.21.15.96:0/2890946123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf40dd650 0x7fddf4005e70 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009870 tx=0x7fddf801c5a0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fde02491640 1 -- 172.21.15.96:0/2890946123 >> 172.21.15.96:0/2890946123 conn(0x7fddf4050160 msgr2=0x7fddf4050570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:49.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7f28cb7fe640 1 --2- 172.21.15.96:0/3121704052 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f28ac066760 0x7f28ac068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7f28cb7fe640 1 --2- 172.21.15.96:0/3121704052 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f28ac066760 0x7f28ac068c20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f28b401c520 tx=0x7f28b40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd76c0c6c60 0x7fd76c0716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd76c0c6c60 0x7fd76c0716d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:44078/0 (socket says 172.21.15.96:44078) 2024-04-18T04:54:49.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76affd640 1 -- 172.21.15.96:0/1597976885 learned_addr learned my addr 172.21.15.96:0/1597976885 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:49.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76a7fc640 1 --2- 172.21.15.96:0/1597976885 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd76c157210 0x7fd76c158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76b7fe640 1 --2- 172.21.15.96:0/1597976885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd76c1575f0 0x7fd76c159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76affd640 1 -- 172.21.15.96:0/1597976885 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd76c157210 msgr2=0x7fd76c158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76affd640 1 --2- 172.21.15.96:0/1597976885 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd76c157210 0x7fd76c158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76affd640 1 -- 172.21.15.96:0/1597976885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd76c1575f0 msgr2=0x7fd76c159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76affd640 1 --2- 172.21.15.96:0/1597976885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd76c1575f0 0x7fd76c159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76affd640 1 -- 172.21.15.96:0/1597976885 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c009420 con 0x7fd76c0c6c60 2024-04-18T04:54:49.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fd76affd640 1 --2- 172.21.15.96:0/1597976885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd76c0c6c60 0x7fd76c0716d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd75c000c10 tx=0x7fd75c01ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fe346ffd640 1 --2- 172.21.15.96:0/115713429 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe3340666e0 0x7fe334068ba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe348156df0 tx=0x7fe340009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf8ce83640 1 -- start start 2024-04-18T04:54:49.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf8ce83640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf880c6ba0 0x7faf880c3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf8ce83640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf88152e80 0x7faf881ff020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf8ce83640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf88159270 0x7faf8815a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf8ce83640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8815b9d0 con 0x7faf88152e80 2024-04-18T04:54:49.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf8ce83640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf88155d30 con 0x7faf880c6ba0 2024-04-18T04:54:49.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf8ce83640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf881fe560 con 0x7faf88159270 2024-04-18T04:54:49.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf877fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf880c6ba0 0x7faf880c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fde02491640 1 -- 172.21.15.96:0/2890946123 shutdown_connections 2024-04-18T04:54:49.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf877fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf880c6ba0 0x7faf880c3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:44080/0 (socket says 172.21.15.96:44080) 2024-04-18T04:54:49.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf877fe640 1 -- 172.21.15.96:0/688053637 learned_addr learned my addr 172.21.15.96:0/688053637 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:49.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf87fff640 1 --2- 172.21.15.96:0/688053637 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf88159270 0x7faf8815a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf86ffd640 1 --2- 172.21.15.96:0/688053637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf88152e80 0x7faf881ff020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf877fe640 1 -- 172.21.15.96:0/688053637 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf88159270 msgr2=0x7faf8815a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf877fe640 1 --2- 172.21.15.96:0/688053637 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf88159270 0x7faf8815a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf877fe640 1 -- 172.21.15.96:0/688053637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf88152e80 msgr2=0x7faf881ff020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf877fe640 1 --2- 172.21.15.96:0/688053637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf88152e80 0x7faf881ff020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf877fe640 1 -- 172.21.15.96:0/688053637 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf78009420 con 0x7faf880c6ba0 2024-04-18T04:54:49.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7f5ed27fc640 1 -- 172.21.15.96:0/381563598 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ed4005430 con 0x7f5edc1fb910 2024-04-18T04:54:49.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7f5ed27fc640 1 --2- 172.21.15.96:0/381563598 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ec00666e0 0x7f5ec0068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7fde02491640 1 -- 172.21.15.96:0/2890946123 wait complete. 2024-04-18T04:54:49.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7f5ee1b10640 1 --2- 172.21.15.96:0/381563598 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ec00666e0 0x7f5ec0068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7f5ed27fc640 1 -- 172.21.15.96:0/381563598 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ed4084990 con 0x7f5edc1fb910 2024-04-18T04:54:49.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7faf877fe640 1 --2- 172.21.15.96:0/688053637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf880c6ba0 0x7faf880c3050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faf780097f0 tx=0x7faf7801ad20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:48.999+0000 7f5ee1b10640 1 --2- 172.21.15.96:0/381563598 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ec00666e0 0x7f5ec0068ba0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80047a0 tx=0x7f5ed8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde02491640 1 Processor -- start 2024-04-18T04:54:49.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde02491640 1 -- start start 2024-04-18T04:54:49.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde02491640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf404ace0 0x7fddf40e2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde02491640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fddf404bc10 0x7fddf40e11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde02491640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fddf40d9540 0x7fddf40d6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde02491640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40d9aa0 con 0x7fddf404ace0 2024-04-18T04:54:49.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde02491640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf417b420 con 0x7fddf404bc10 2024-04-18T04:54:49.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde02491640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf417b6c0 con 0x7fddf40d9540 2024-04-18T04:54:49.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde0148f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf404ace0 0x7fddf40e2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde0148f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf404ace0 0x7fddf40e2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38652/0 (socket says 172.21.15.96:38652) 2024-04-18T04:54:49.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde0148f640 1 -- 172.21.15.96:0/3068023794 learned_addr learned my addr 172.21.15.96:0/3068023794 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:49.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde00c8e640 1 --2- 172.21.15.96:0/3068023794 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fddf404bc10 0x7fddf40e11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde01c90640 1 --2- 172.21.15.96:0/3068023794 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fddf40d9540 0x7fddf40d6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde0148f640 1 -- 172.21.15.96:0/3068023794 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fddf40d9540 msgr2=0x7fddf40d6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde0148f640 1 --2- 172.21.15.96:0/3068023794 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fddf40d9540 0x7fddf40d6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde0148f640 1 -- 172.21.15.96:0/3068023794 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fddf404bc10 msgr2=0x7fddf40e11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde0148f640 1 --2- 172.21.15.96:0/3068023794 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fddf404bc10 0x7fddf40e11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde0148f640 1 -- 172.21.15.96:0/3068023794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80094d0 con 0x7fddf404ace0 2024-04-18T04:54:49.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde0148f640 1 --2- 172.21.15.96:0/3068023794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf404ace0 0x7fddf40e2ca0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fddf80ab040 tx=0x7fddf801ade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fddf1ffb640 1 -- 172.21.15.96:0/3068023794 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf80b1600 con 0x7fddf404ace0 2024-04-18T04:54:49.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fddf1ffb640 1 -- 172.21.15.96:0/3068023794 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf80b1780 con 0x7fddf404ace0 2024-04-18T04:54:49.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.007+0000 7f5ed27fc640 1 -- 172.21.15.96:0/381563598 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f5ed4055760 con 0x7f5edc1fb910 2024-04-18T04:54:49.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fddf1ffb640 1 -- 172.21.15.96:0/3068023794 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf80b1b30 con 0x7fddf404ace0 2024-04-18T04:54:49.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.003+0000 7fde02491640 1 -- 172.21.15.96:0/3068023794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf417b9a0 con 0x7fddf404ace0 2024-04-18T04:54:49.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.007+0000 7fde02491640 1 -- 172.21.15.96:0/3068023794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf40e0db0 con 0x7fddf404ace0 2024-04-18T04:54:49.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.007+0000 7fdddf7fe640 1 -- 172.21.15.96:0/3068023794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd8005260 con 0x7fddf404ace0 2024-04-18T04:54:49.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.007+0000 7fddf1ffb640 1 -- 172.21.15.96:0/3068023794 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fddf80a7070 con 0x7fddf404ace0 2024-04-18T04:54:49.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.007+0000 7fddf1ffb640 1 --2- 172.21.15.96:0/3068023794 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdde00666c0 0x7fdde0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.007+0000 7fddf1ffb640 1 -- 172.21.15.96:0/3068023794 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddf811ec80 con 0x7fddf404ace0 2024-04-18T04:54:49.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.007+0000 7fde00c8e640 1 --2- 172.21.15.96:0/3068023794 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdde00666c0 0x7fdde0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.007+0000 7fde00c8e640 1 --2- 172.21.15.96:0/3068023794 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdde00666c0 0x7fdde0068b80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fddf40e1b60 tx=0x7fddec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.011+0000 7fddf1ffb640 1 -- 172.21.15.96:0/3068023794 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fddf80ebf50 con 0x7fddf404ace0 2024-04-18T04:54:49.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.019+0000 7fd753fff640 1 -- 172.21.15.96:0/1597976885 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c0be070 con 0x7fd76c0c6c60 2024-04-18T04:54:49.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.019+0000 7fe04cff9640 1 -- 172.21.15.96:0/1098775014 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0440b3070 con 0x7fe0480074f0 2024-04-18T04:54:49.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.019+0000 7fe0569aa640 1 -- 172.21.15.96:0/1098775014 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe048175bf0 con 0x7fe0480074f0 2024-04-18T04:54:49.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.019+0000 7fe0569aa640 1 -- 172.21.15.96:0/1098775014 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0481761b0 con 0x7fe0480074f0 2024-04-18T04:54:49.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.019+0000 7fe32ffff640 1 -- 172.21.15.96:0/115713429 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe33c051d30 con 0x7fe348150ce0 2024-04-18T04:54:49.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.019+0000 7faf6ffff640 1 -- 172.21.15.96:0/688053637 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf780be410 con 0x7faf880c6ba0 2024-04-18T04:54:49.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.019+0000 7faf8ce83640 1 -- 172.21.15.96:0/688053637 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf88155f80 con 0x7faf880c6ba0 2024-04-18T04:54:49.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.019+0000 7f50f0ff9640 1 -- 172.21.15.96:0/88956557 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e40072d0 con 0x7f50f4152f30 2024-04-18T04:54:49.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.019+0000 7f50f0ff9640 1 -- 172.21.15.96:0/88956557 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e4007450 con 0x7f50f4152f30 2024-04-18T04:54:49.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.019+0000 7f50f0ff9640 1 -- 172.21.15.96:0/88956557 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e40047f0 con 0x7f50f4152f30 2024-04-18T04:54:49.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.019+0000 7faf6ffff640 1 -- 172.21.15.96:0/688053637 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf780be570 con 0x7faf880c6ba0 2024-04-18T04:54:49.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.019+0000 7faf6ffff640 1 -- 172.21.15.96:0/688053637 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf780be900 con 0x7faf880c6ba0 2024-04-18T04:54:49.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.019+0000 7faf8ce83640 1 -- 172.21.15.96:0/688053637 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf881fe820 con 0x7faf880c6ba0 2024-04-18T04:54:49.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7fe04cff9640 1 -- 172.21.15.96:0/1098775014 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe044003990 con 0x7fe0480074f0 2024-04-18T04:54:49.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7fe04cff9640 1 -- 172.21.15.96:0/1098775014 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044003d00 con 0x7fe0480074f0 2024-04-18T04:54:49.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.019+0000 7f50f97ed640 1 -- 172.21.15.96:0/88956557 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f415bf60 con 0x7f50f4152f30 2024-04-18T04:54:49.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.019+0000 7f50f97ed640 1 -- 172.21.15.96:0/88956557 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f40cc820 con 0x7f50f4152f30 2024-04-18T04:54:49.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7f28c8ff9640 1 -- 172.21.15.96:0/3121704052 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f28c40523c0 con 0x7f28cc160210 2024-04-18T04:54:49.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7fd76bfff640 1 -- 172.21.15.96:0/1597976885 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76c157c40 con 0x7fd76c0c6c60 2024-04-18T04:54:49.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7fd76bfff640 1 -- 172.21.15.96:0/1597976885 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76c071c10 con 0x7fd76c0c6c60 2024-04-18T04:54:49.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7faf8ce83640 1 -- 172.21.15.96:0/688053637 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8806a540 con 0x7faf880c6ba0 2024-04-18T04:54:49.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7f50f97ed640 1 -- 172.21.15.96:0/88956557 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d4005260 con 0x7f50f4152f30 2024-04-18T04:54:49.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7fd753fff640 1 -- 172.21.15.96:0/1597976885 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c003620 con 0x7fd76c0c6c60 2024-04-18T04:54:49.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7fe0569aa640 1 -- 172.21.15.96:0/1098775014 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe030005260 con 0x7fe0480074f0 2024-04-18T04:54:49.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7fd753fff640 1 -- 172.21.15.96:0/1597976885 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c003990 con 0x7fd76c0c6c60 2024-04-18T04:54:49.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7faf6ffff640 1 -- 172.21.15.96:0/688053637 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf780a8050 con 0x7faf880c6ba0 2024-04-18T04:54:49.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7faf6ffff640 1 --2- 172.21.15.96:0/688053637 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faf74066690 0x7faf74068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7faf6ffff640 1 -- 172.21.15.96:0/688053637 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf7811ed40 con 0x7faf880c6ba0 2024-04-18T04:54:49.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7fd76bfff640 1 -- 172.21.15.96:0/1597976885 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd74c005260 con 0x7fd76c0c6c60 2024-04-18T04:54:49.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7fe04cff9640 1 -- 172.21.15.96:0/1098775014 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe0440a9020 con 0x7fe0480074f0 2024-04-18T04:54:49.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7faf86ffd640 1 --2- 172.21.15.96:0/688053637 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faf74066690 0x7faf74068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7fe04cff9640 1 --2- 172.21.15.96:0/1098775014 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe034066690 0x7fe034068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.023+0000 7fe04cff9640 1 -- 172.21.15.96:0/1098775014 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe04411d960 con 0x7fe0480074f0 2024-04-18T04:54:49.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.027+0000 7fe04f7fe640 1 --2- 172.21.15.96:0/1098775014 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe034066690 0x7fe034068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.027+0000 7fd753fff640 1 -- 172.21.15.96:0/1597976885 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd75c0b7040 con 0x7fd76c0c6c60 2024-04-18T04:54:49.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.027+0000 7faf86ffd640 1 --2- 172.21.15.96:0/688053637 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faf74066690 0x7faf74068b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf880718e0 tx=0x7faf80009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.027+0000 7fe04f7fe640 1 --2- 172.21.15.96:0/1098775014 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe034066690 0x7fe034068b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe0500685e0 tx=0x7fe05006c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.027+0000 7fd753fff640 1 --2- 172.21.15.96:0/1597976885 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd758066690 0x7fd758068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.027+0000 7fd76a7fc640 1 --2- 172.21.15.96:0/1597976885 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd758066690 0x7fd758068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.027+0000 7fd76a7fc640 1 --2- 172.21.15.96:0/1597976885 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd758066690 0x7fd758068b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd76c152030 tx=0x7fd764009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.027+0000 7f50f0ff9640 1 -- 172.21.15.96:0/88956557 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50e4004950 con 0x7f50f4152f30 2024-04-18T04:54:49.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.027+0000 7f50f0ff9640 1 --2- 172.21.15.96:0/88956557 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f50e00666e0 0x7f50e0068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:49.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.027+0000 7f50f0ff9640 1 -- 172.21.15.96:0/88956557 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50e4083cf0 con 0x7f50f4152f30 2024-04-18T04:54:49.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.027+0000 7f50f3fff640 1 --2- 172.21.15.96:0/88956557 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f50e00666e0 0x7f50e0068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:49.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.027+0000 7f50f3fff640 1 --2- 172.21.15.96:0/88956557 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f50e00666e0 0x7f50e0068ba0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f50e8007fd0 tx=0x7f50e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:49.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.035+0000 7faf6ffff640 1 -- 172.21.15.96:0/688053637 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7faf780ec140 con 0x7faf880c6ba0 2024-04-18T04:54:49.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.047+0000 7f50f0ff9640 1 -- 172.21.15.96:0/88956557 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f50e4051180 con 0x7f50f4152f30 2024-04-18T04:54:49.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.059+0000 7fd753fff640 1 -- 172.21.15.96:0/1597976885 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd75c0f3580 con 0x7fd76c0c6c60 2024-04-18T04:54:49.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.059+0000 7fe04cff9640 1 -- 172.21.15.96:0/1098775014 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe0440eadf0 con 0x7fe0480074f0 2024-04-18T04:54:49.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.067+0000 7fd753fff640 1 -- 172.21.15.96:0/1597976885 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd75c0ef1c0 con 0x7fd76c0c6c60 2024-04-18T04:54:49.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.271+0000 7f5ee3d74640 1 -- 172.21.15.96:0/381563598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5edc0675e0 con 0x7f5edc1fb910 2024-04-18T04:54:49.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.271+0000 7f5ed27fc640 1 -- 172.21.15.96:0/381563598 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ed4003e60 con 0x7f5edc1fb910 2024-04-18T04:54:49.275 INFO:teuthology.orchestra.run.smithi096.stdout:64424509444 2024-04-18T04:54:49.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.279+0000 7f5ebffff640 1 -- 172.21.15.96:0/381563598 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ec00666e0 msgr2=0x7f5ec0068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.279+0000 7f5ebffff640 1 --2- 172.21.15.96:0/381563598 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ec00666e0 0x7f5ec0068ba0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80047a0 tx=0x7f5ed8008040 comp rx=0 tx=0).stop 2024-04-18T04:54:49.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.279+0000 7f5ebffff640 1 -- 172.21.15.96:0/381563598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5edc1fb910 msgr2=0x7f5edc1fbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.279+0000 7f5ebffff640 1 --2- 172.21.15.96:0/381563598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5edc1fb910 0x7f5edc1fbd90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8003980 tx=0x7f5ed400e9e0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.279+0000 7f5ebffff640 1 -- 172.21.15.96:0/381563598 shutdown_connections 2024-04-18T04:54:49.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.279+0000 7f5ebffff640 1 --2- 172.21.15.96:0/381563598 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ec00666e0 0x7f5ec0068ba0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.279+0000 7f5ebffff640 1 --2- 172.21.15.96:0/381563598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5edc1fb910 0x7f5edc1fbd90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.279+0000 7f5ebffff640 1 --2- 172.21.15.96:0/381563598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5edc0cc470 0x7f5edc1ff0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.279+0000 7f5ebffff640 1 --2- 172.21.15.96:0/381563598 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5edc0cc090 0x7f5edc0ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.279+0000 7f5ebffff640 1 -- 172.21.15.96:0/381563598 >> 172.21.15.96:0/381563598 conn(0x7f5edc06fa60 msgr2=0x7f5edc14ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:49.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.279+0000 7f5ebffff640 1 -- 172.21.15.96:0/381563598 shutdown_connections 2024-04-18T04:54:49.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.279+0000 7f5ebffff640 1 -- 172.21.15.96:0/381563598 wait complete. 2024-04-18T04:54:49.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.3 2024-04-18T04:54:49.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.303+0000 7fdddf7fe640 1 -- 172.21.15.96:0/3068023794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fddd80057e0 con 0x7fddf404ace0 2024-04-18T04:54:49.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.303+0000 7fddf1ffb640 1 -- 172.21.15.96:0/3068023794 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddf80ef570 con 0x7fddf404ace0 2024-04-18T04:54:49.307 INFO:teuthology.orchestra.run.smithi096.stdout:64424509444 2024-04-18T04:54:49.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.307+0000 7fdddf7fe640 1 -- 172.21.15.96:0/3068023794 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdde00666c0 msgr2=0x7fdde0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.307+0000 7fdddf7fe640 1 --2- 172.21.15.96:0/3068023794 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdde00666c0 0x7fdde0068b80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fddf40e1b60 tx=0x7fddec008040 comp rx=0 tx=0).stop 2024-04-18T04:54:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.307+0000 7fdddf7fe640 1 -- 172.21.15.96:0/3068023794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf404ace0 msgr2=0x7fddf40e2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.307+0000 7fdddf7fe640 1 --2- 172.21.15.96:0/3068023794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf404ace0 0x7fddf40e2ca0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fddf80ab040 tx=0x7fddf801ade0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.307+0000 7fdddf7fe640 1 -- 172.21.15.96:0/3068023794 shutdown_connections 2024-04-18T04:54:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.307+0000 7fdddf7fe640 1 --2- 172.21.15.96:0/3068023794 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fdde00666c0 0x7fdde0068b80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.307+0000 7fdddf7fe640 1 --2- 172.21.15.96:0/3068023794 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fddf40d9540 0x7fddf40d6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.307+0000 7fdddf7fe640 1 --2- 172.21.15.96:0/3068023794 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fddf404bc10 0x7fddf40e11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.307+0000 7fdddf7fe640 1 --2- 172.21.15.96:0/3068023794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf404ace0 0x7fddf40e2ca0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.307+0000 7fdddf7fe640 1 -- 172.21.15.96:0/3068023794 >> 172.21.15.96:0/3068023794 conn(0x7fddf4050160 msgr2=0x7fddf4005580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.307+0000 7fdddf7fe640 1 -- 172.21.15.96:0/3068023794 shutdown_connections 2024-04-18T04:54:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.307+0000 7fdddf7fe640 1 -- 172.21.15.96:0/3068023794 wait complete. 2024-04-18T04:54:49.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.7 2024-04-18T04:54:49.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.339+0000 7faf8ce83640 1 -- 172.21.15.96:0/688053637 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7faf88066ed0 con 0x7faf880c6ba0 2024-04-18T04:54:49.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.339+0000 7faf6ffff640 1 -- 172.21.15.96:0/688053637 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf780ef760 con 0x7faf880c6ba0 2024-04-18T04:54:49.341 INFO:teuthology.orchestra.run.smithi096.stdout:64424509444 2024-04-18T04:54:49.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.339+0000 7fe34deeb640 1 -- 172.21.15.96:0/115713429 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe348157240 con 0x7fe348150ce0 2024-04-18T04:54:49.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7fe32ffff640 1 -- 172.21.15.96:0/115713429 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe33c055350 con 0x7fe348150ce0 2024-04-18T04:54:49.343 INFO:teuthology.orchestra.run.smithi096.stdout:64424509445 2024-04-18T04:54:49.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7faf8ce83640 1 -- 172.21.15.96:0/688053637 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faf74066690 msgr2=0x7faf74068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7faf8ce83640 1 --2- 172.21.15.96:0/688053637 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faf74066690 0x7faf74068b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf880718e0 tx=0x7faf80009040 comp rx=0 tx=0).stop 2024-04-18T04:54:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7faf8ce83640 1 -- 172.21.15.96:0/688053637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf880c6ba0 msgr2=0x7faf880c3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7faf8ce83640 1 --2- 172.21.15.96:0/688053637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf880c6ba0 0x7faf880c3050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faf780097f0 tx=0x7faf7801ad20 comp rx=0 tx=0).stop 2024-04-18T04:54:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7faf8ce83640 1 -- 172.21.15.96:0/688053637 shutdown_connections 2024-04-18T04:54:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7faf8ce83640 1 --2- 172.21.15.96:0/688053637 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faf74066690 0x7faf74068b50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7faf8ce83640 1 --2- 172.21.15.96:0/688053637 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf88159270 0x7faf8815a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7faf8ce83640 1 --2- 172.21.15.96:0/688053637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf88152e80 0x7faf881ff020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7faf8ce83640 1 --2- 172.21.15.96:0/688053637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf880c6ba0 0x7faf880c3050 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7faf8ce83640 1 -- 172.21.15.96:0/688053637 >> 172.21.15.96:0/688053637 conn(0x7faf880c7c10 msgr2=0x7faf88151a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7faf8ce83640 1 -- 172.21.15.96:0/688053637 shutdown_connections 2024-04-18T04:54:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7faf8ce83640 1 -- 172.21.15.96:0/688053637 wait complete. 2024-04-18T04:54:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7fe34deeb640 1 -- 172.21.15.96:0/115713429 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe3340666e0 msgr2=0x7fe334068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7fe34deeb640 1 --2- 172.21.15.96:0/115713429 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe3340666e0 0x7fe334068ba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe348156df0 tx=0x7fe340009040 comp rx=0 tx=0).stop 2024-04-18T04:54:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7fe34deeb640 1 -- 172.21.15.96:0/115713429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe348150ce0 msgr2=0x7fe3481568b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7fe34deeb640 1 --2- 172.21.15.96:0/115713429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe348150ce0 0x7fe3481568b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00c780 tx=0x7fe33c00cc40 comp rx=0 tx=0).stop 2024-04-18T04:54:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7fe34deeb640 1 -- 172.21.15.96:0/115713429 shutdown_connections 2024-04-18T04:54:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7fe34deeb640 1 --2- 172.21.15.96:0/115713429 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe3340666e0 0x7fe334068ba0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7fe34deeb640 1 --2- 172.21.15.96:0/115713429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe34815ae00 0x7fe34813cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7fe34deeb640 1 --2- 172.21.15.96:0/115713429 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3481510c0 0x7fe34814c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7fe34deeb640 1 --2- 172.21.15.96:0/115713429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe348150ce0 0x7fe3481568b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.343+0000 7fe34deeb640 1 -- 172.21.15.96:0/115713429 >> 172.21.15.96:0/115713429 conn(0x7fe348069e60 msgr2=0x7fe3480c1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:49.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.347+0000 7fe34deeb640 1 -- 172.21.15.96:0/115713429 shutdown_connections 2024-04-18T04:54:49.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.347+0000 7f28d0fbb640 1 -- 172.21.15.96:0/3121704052 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f28cc1ef400 con 0x7f28cc160210 2024-04-18T04:54:49.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.347+0000 7f28c8ff9640 1 -- 172.21.15.96:0/3121704052 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f28cc1ef400 con 0x7f28cc160210 2024-04-18T04:54:49.350 INFO:teuthology.orchestra.run.smithi096.stdout:64424509443 2024-04-18T04:54:49.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.347+0000 7fe34deeb640 1 -- 172.21.15.96:0/115713429 wait complete. 2024-04-18T04:54:49.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.351+0000 7f28d0fbb640 1 -- 172.21.15.96:0/3121704052 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f28ac066760 msgr2=0x7f28ac068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.351+0000 7f28d0fbb640 1 --2- 172.21.15.96:0/3121704052 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f28ac066760 0x7f28ac068c20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f28b401c520 tx=0x7f28b40a7000 comp rx=0 tx=0).stop 2024-04-18T04:54:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.351+0000 7f28d0fbb640 1 -- 172.21.15.96:0/3121704052 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28cc160210 msgr2=0x7f28cc1efc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.351+0000 7f28d0fbb640 1 --2- 172.21.15.96:0/3121704052 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28cc160210 0x7f28cc1efc20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f28c4007dc0 tx=0x7f28c400e4b0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.351+0000 7f28d0fbb640 1 -- 172.21.15.96:0/3121704052 shutdown_connections 2024-04-18T04:54:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.351+0000 7f28d0fbb640 1 --2- 172.21.15.96:0/3121704052 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f28ac066760 0x7f28ac068c20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.351+0000 7f28d0fbb640 1 --2- 172.21.15.96:0/3121704052 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28cc160210 0x7f28cc1efc20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.351+0000 7f28d0fbb640 1 --2- 172.21.15.96:0/3121704052 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28cc0c9250 0x7f28cc1ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.351+0000 7f28d0fbb640 1 --2- 172.21.15.96:0/3121704052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28cc0c4170 0x7f28cc15f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.351+0000 7f28d0fbb640 1 -- 172.21.15.96:0/3121704052 >> 172.21.15.96:0/3121704052 conn(0x7f28cc06c1f0 msgr2=0x7f28cc070460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.351+0000 7f28d0fbb640 1 -- 172.21.15.96:0/3121704052 shutdown_connections 2024-04-18T04:54:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.351+0000 7f28d0fbb640 1 -- 172.21.15.96:0/3121704052 wait complete. 2024-04-18T04:54:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.351+0000 7fd76bfff640 1 -- 172.21.15.96:0/1597976885 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd74c0057e0 con 0x7fd76c0c6c60 2024-04-18T04:54:49.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.351+0000 7fd753fff640 1 -- 172.21.15.96:0/1597976885 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd75c0f27e0 con 0x7fd76c0c6c60 2024-04-18T04:54:49.355 INFO:teuthology.orchestra.run.smithi096.stdout:55834574852 2024-04-18T04:54:49.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.355+0000 7f50f97ed640 1 -- 172.21.15.96:0/88956557 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f50d40057e0 con 0x7f50f4152f30 2024-04-18T04:54:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.355+0000 7fd76bfff640 1 -- 172.21.15.96:0/1597976885 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd758066690 msgr2=0x7fd758068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.355+0000 7fd76bfff640 1 --2- 172.21.15.96:0/1597976885 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd758066690 0x7fd758068b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd76c152030 tx=0x7fd764009040 comp rx=0 tx=0).stop 2024-04-18T04:54:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.355+0000 7fd76bfff640 1 -- 172.21.15.96:0/1597976885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd76c0c6c60 msgr2=0x7fd76c0716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.355+0000 7fd76bfff640 1 --2- 172.21.15.96:0/1597976885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd76c0c6c60 0x7fd76c0716d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd75c000c10 tx=0x7fd75c01ba50 comp rx=0 tx=0).stop 2024-04-18T04:54:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.355+0000 7f50f0ff9640 1 -- 172.21.15.96:0/88956557 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50e4018070 con 0x7f50f4152f30 2024-04-18T04:54:49.358 INFO:teuthology.orchestra.run.smithi096.stdout:64424509443 2024-04-18T04:54:49.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.355+0000 7fd76bfff640 1 -- 172.21.15.96:0/1597976885 shutdown_connections 2024-04-18T04:54:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.355+0000 7fd76bfff640 1 --2- 172.21.15.96:0/1597976885 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd758066690 0x7fd758068b50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.355+0000 7fd76bfff640 1 --2- 172.21.15.96:0/1597976885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd76c1575f0 0x7fd76c159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.355+0000 7fd76bfff640 1 --2- 172.21.15.96:0/1597976885 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd76c157210 0x7fd76c158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.355+0000 7fd76bfff640 1 --2- 172.21.15.96:0/1597976885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd76c0c6c60 0x7fd76c0716d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.355+0000 7fd76bfff640 1 -- 172.21.15.96:0/1597976885 >> 172.21.15.96:0/1597976885 conn(0x7fd76c06af70 msgr2=0x7fd76c0c5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.355+0000 7fd76bfff640 1 -- 172.21.15.96:0/1597976885 shutdown_connections 2024-04-18T04:54:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.355+0000 7fd76bfff640 1 -- 172.21.15.96:0/1597976885 wait complete. 2024-04-18T04:54:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.359+0000 7f50f97ed640 1 -- 172.21.15.96:0/88956557 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f50e00666e0 msgr2=0x7f50e0068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.359+0000 7f50f97ed640 1 --2- 172.21.15.96:0/88956557 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f50e00666e0 0x7f50e0068ba0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f50e8007fd0 tx=0x7f50e8009040 comp rx=0 tx=0).stop 2024-04-18T04:54:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.359+0000 7f50f97ed640 1 -- 172.21.15.96:0/88956557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50f4152f30 msgr2=0x7f50f40b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.359+0000 7f50f97ed640 1 --2- 172.21.15.96:0/88956557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50f4152f30 0x7f50f40b2f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f50e400c7b0 tx=0x7f50e400cc70 comp rx=0 tx=0).stop 2024-04-18T04:54:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.359+0000 7f50f97ed640 1 -- 172.21.15.96:0/88956557 shutdown_connections 2024-04-18T04:54:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.359+0000 7f50f97ed640 1 --2- 172.21.15.96:0/88956557 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f50e00666e0 0x7f50e0068ba0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.359+0000 7f50f97ed640 1 --2- 172.21.15.96:0/88956557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50f415cc50 0x7f50f40b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.359+0000 7f50f97ed640 1 --2- 172.21.15.96:0/88956557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50f4152f30 0x7f50f40b2f30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.359+0000 7f50f97ed640 1 --2- 172.21.15.96:0/88956557 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50f406b460 0x7f50f4140700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.359+0000 7f50f97ed640 1 -- 172.21.15.96:0/88956557 >> 172.21.15.96:0/88956557 conn(0x7f50f4071760 msgr2=0x7f50f4066320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.359+0000 7f50f97ed640 1 -- 172.21.15.96:0/88956557 shutdown_connections 2024-04-18T04:54:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.359+0000 7f50f97ed640 1 -- 172.21.15.96:0/88956557 wait complete. 2024-04-18T04:54:49.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.6 2024-04-18T04:54:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.375+0000 7fe0569aa640 1 -- 172.21.15.96:0/1098775014 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe0300057e0 con 0x7fe0480074f0 2024-04-18T04:54:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.375+0000 7fe04cff9640 1 -- 172.21.15.96:0/1098775014 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe0440bc070 con 0x7fe0480074f0 2024-04-18T04:54:49.378 INFO:teuthology.orchestra.run.smithi096.stdout:55834574852 2024-04-18T04:54:49.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.2 2024-04-18T04:54:49.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.379+0000 7fe0569aa640 1 -- 172.21.15.96:0/1098775014 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe034066690 msgr2=0x7fe034068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.379+0000 7fe0569aa640 1 --2- 172.21.15.96:0/1098775014 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe034066690 0x7fe034068b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe0500685e0 tx=0x7fe05006c040 comp rx=0 tx=0).stop 2024-04-18T04:54:49.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.379+0000 7fe0569aa640 1 -- 172.21.15.96:0/1098775014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0480074f0 msgr2=0x7fe0481813f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:49.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.379+0000 7fe0569aa640 1 --2- 172.21.15.96:0/1098775014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0480074f0 0x7fe0481813f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe04000bf30 tx=0x7fe040005800 comp rx=0 tx=0).stop 2024-04-18T04:54:49.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.379+0000 7fe0569aa640 1 -- 172.21.15.96:0/1098775014 shutdown_connections 2024-04-18T04:54:49.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.379+0000 7fe0569aa640 1 --2- 172.21.15.96:0/1098775014 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe034066690 0x7fe034068b50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.379+0000 7fe0569aa640 1 --2- 172.21.15.96:0/1098775014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe048173280 0x7fe048173700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.379+0000 7fe0569aa640 1 --2- 172.21.15.96:0/1098775014 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0480dff20 0x7fe048176f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.379+0000 7fe0569aa640 1 --2- 172.21.15.96:0/1098775014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0480074f0 0x7fe0481813f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:49.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.379+0000 7fe0569aa640 1 -- 172.21.15.96:0/1098775014 >> 172.21.15.96:0/1098775014 conn(0x7fe04800ee20 msgr2=0x7fe0480537e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:49.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.379+0000 7fe0569aa640 1 -- 172.21.15.96:0/1098775014 shutdown_connections 2024-04-18T04:54:49.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:49.379+0000 7fe0569aa640 1 -- 172.21.15.96:0/1098775014 wait complete. 2024-04-18T04:54:49.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.0 2024-04-18T04:54:49.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.5 2024-04-18T04:54:49.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.1 2024-04-18T04:54:49.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.4 2024-04-18T04:54:50.303 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T04:54:50.332 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-18T04:54:50.378 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-18T04:54:50.381 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T04:54:50.384 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T04:54:50.384 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-18T04:54:50.385 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T04:54:50.396 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-18T04:54:50.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.451+0000 7fcadae67640 1 Processor -- start 2024-04-18T04:54:50.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.451+0000 7fcadae67640 1 -- start start 2024-04-18T04:54:50.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.451+0000 7fcadae67640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcad4157510 0x7fcad41613c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.451+0000 7fcadae67640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad4161900 con 0x7fcad41578f0 2024-04-18T04:54:50.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.451+0000 7fcadae67640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad40c56c0 con 0x7fcad40700a0 2024-04-18T04:54:50.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.451+0000 7fcadae67640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad40c69d0 con 0x7fcad4157510 2024-04-18T04:54:50.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.451+0000 7fcad8c03640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcad4157510 0x7fcad41613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.451+0000 7fcad8c03640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcad4157510 0x7fcad41613c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38668/0 (socket says 172.21.15.96:38668) 2024-04-18T04:54:50.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.451+0000 7fcad8c03640 1 -- 172.21.15.96:0/3853234226 learned_addr learned my addr 172.21.15.96:0/3853234226 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:50.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.451+0000 7fcad8c03640 1 -- 172.21.15.96:0/3853234226 >> v1:172.21.15.139:6789/0 conn(0x7fcad40700a0 legacy=0x7fcad406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:50.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.451+0000 7fcad8c03640 1 -- 172.21.15.96:0/3853234226 >> v1:172.21.15.96:6789/0 conn(0x7fcad41578f0 legacy=0x7fcad415dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.451+0000 7fcad8c03640 1 -- 172.21.15.96:0/3853234226 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad40c5100 con 0x7fcad4157510 2024-04-18T04:54:50.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.455+0000 7fcad8c03640 1 --2- 172.21.15.96:0/3853234226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad4157510 0x7fcad41613c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009e50 tx=0x7fcacc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83192053c102248 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.455+0000 7fcad37fe640 1 -- 172.21.15.96:0/3853234226 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0a5690 con 0x7fcad4157510 2024-04-18T04:54:50.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.455+0000 7fcad37fe640 1 -- 172.21.15.96:0/3853234226 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc0a57f0 con 0x7fcad4157510 2024-04-18T04:54:50.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.459+0000 7fcadae67640 1 -- 172.21.15.96:0/3853234226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad4157510 msgr2=0x7fcad41613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.459+0000 7fcadae67640 1 --2- 172.21.15.96:0/3853234226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad4157510 0x7fcad41613c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009e50 tx=0x7fcacc01c9f0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.459+0000 7fcadae67640 1 -- 172.21.15.96:0/3853234226 shutdown_connections 2024-04-18T04:54:50.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.459+0000 7fcadae67640 1 --2- 172.21.15.96:0/3853234226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad4157510 0x7fcad41613c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.459+0000 7fcadae67640 1 -- 172.21.15.96:0/3853234226 >> 172.21.15.96:0/3853234226 conn(0x7fcad406a8e0 msgr2=0x7fcad40c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:50.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.459+0000 7fcadae67640 1 -- 172.21.15.96:0/3853234226 shutdown_connections 2024-04-18T04:54:50.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.459+0000 7fcadae67640 1 -- 172.21.15.96:0/3853234226 wait complete. 2024-04-18T04:54:50.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.459+0000 7fcadae67640 1 Processor -- start 2024-04-18T04:54:50.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.459+0000 7fcadae67640 1 -- start start 2024-04-18T04:54:50.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.459+0000 7fcadae67640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcad40700a0 0x7fcad415f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.459+0000 7fcadae67640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcad4157510 0x7fcad40c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.459+0000 7fcadae67640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad41578f0 0x7fcad40c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.459+0000 7fcadae67640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad415a8e0 con 0x7fcad41578f0 2024-04-18T04:54:50.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.459+0000 7fcadae67640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad4130c50 con 0x7fcad4157510 2024-04-18T04:54:50.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.459+0000 7fcadae67640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad4140db0 con 0x7fcad40700a0 2024-04-18T04:54:50.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.463+0000 7fcad9404640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad41578f0 0x7fcad40c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.463+0000 7fcad9404640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad41578f0 0x7fcad40c4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38676/0 (socket says 172.21.15.96:38676) 2024-04-18T04:54:50.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.463+0000 7fcad9404640 1 -- 172.21.15.96:0/1777254252 learned_addr learned my addr 172.21.15.96:0/1777254252 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:50.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.463+0000 7fcad3fff640 1 --2- 172.21.15.96:0/1777254252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcad4157510 0x7fcad40c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.463+0000 7fcad8c03640 1 --2- 172.21.15.96:0/1777254252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcad40700a0 0x7fcad415f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.463+0000 7fcad9404640 1 -- 172.21.15.96:0/1777254252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcad40700a0 msgr2=0x7fcad415f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.463+0000 7fcad9404640 1 --2- 172.21.15.96:0/1777254252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcad40700a0 0x7fcad415f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.463+0000 7fcad9404640 1 -- 172.21.15.96:0/1777254252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcad4157510 msgr2=0x7fcad40c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.463+0000 7fcad9404640 1 --2- 172.21.15.96:0/1777254252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcad4157510 0x7fcad40c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.463+0000 7fcad9404640 1 -- 172.21.15.96:0/1777254252 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc009b30 con 0x7fcad41578f0 2024-04-18T04:54:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.463+0000 7fcad9404640 1 --2- 172.21.15.96:0/1777254252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad41578f0 0x7fcad40c4060 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcac400b440 tx=0x7fcac400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.463+0000 7fcad17fa640 1 -- 172.21.15.96:0/1777254252 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4011830 con 0x7fcad41578f0 2024-04-18T04:54:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.463+0000 7fcadae67640 1 -- 172.21.15.96:0/1777254252 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad4140850 con 0x7fcad41578f0 2024-04-18T04:54:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.463+0000 7fcadae67640 1 -- 172.21.15.96:0/1777254252 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad415b0e0 con 0x7fcad41578f0 2024-04-18T04:54:50.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.467+0000 7fcad17fa640 1 -- 172.21.15.96:0/1777254252 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac40119b0 con 0x7fcad41578f0 2024-04-18T04:54:50.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.467+0000 7fcad17fa640 1 -- 172.21.15.96:0/1777254252 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4011d60 con 0x7fcad41578f0 2024-04-18T04:54:50.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.467+0000 7fcad17fa640 1 -- 172.21.15.96:0/1777254252 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcac40193b0 con 0x7fcad41578f0 2024-04-18T04:54:50.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.467+0000 7fcad17fa640 1 --2- 172.21.15.96:0/1777254252 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcabc066980 0x7fcabc068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.467+0000 7fcad17fa640 1 -- 172.21.15.96:0/1777254252 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcac4084120 con 0x7fcad41578f0 2024-04-18T04:54:50.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.467+0000 7fcad8c03640 1 --2- 172.21.15.96:0/1777254252 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcabc066980 0x7fcabc068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.467+0000 7fcad8c03640 1 --2- 172.21.15.96:0/1777254252 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcabc066980 0x7fcabc068e40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0ae000 tx=0x7fcacc0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.471+0000 7fcadae67640 1 -- 172.21.15.96:0/1777254252 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab0005260 con 0x7fcad41578f0 2024-04-18T04:54:50.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.479+0000 7fcad17fa640 1 -- 172.21.15.96:0/1777254252 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fcac4051470 con 0x7fcad41578f0 2024-04-18T04:54:50.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.507+0000 7f01ada7a640 1 Processor -- start 2024-04-18T04:54:50.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.507+0000 7f01ada7a640 1 -- start start 2024-04-18T04:54:50.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.511+0000 7f01ada7a640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f01a814f060 0x7f01a80c5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.511+0000 7f01ada7a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f01a80c5ab0 0x7f01a80701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.511+0000 7f01ada7a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a814f440 con 0x7f01a8070720 2024-04-18T04:54:50.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.511+0000 7f01ada7a640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a80c2340 con 0x7f01a80c5ab0 2024-04-18T04:54:50.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.511+0000 7f01ada7a640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a8158f50 con 0x7f01a814f060 2024-04-18T04:54:50.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.511+0000 7f01a7fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f01a8070720 0x7f01a8154c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46326/0 (socket says 172.21.15.96:46326) 2024-04-18T04:54:50.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.511+0000 7f01a6ffd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f01a80c5ab0 0x7f01a80701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.511+0000 7f01a6ffd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f01a80c5ab0 0x7f01a80701e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:44104/0 (socket says 172.21.15.96:44104) 2024-04-18T04:54:50.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.511+0000 7f01a6ffd640 1 -- 172.21.15.96:0/3408437843 learned_addr learned my addr 172.21.15.96:0/3408437843 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:50.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.511+0000 7f01a77fe640 1 --2- 172.21.15.96:0/3408437843 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f01a814f060 0x7f01a80c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.511+0000 7f01a6ffd640 1 -- 172.21.15.96:0/3408437843 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f01a814f060 msgr2=0x7f01a80c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:50.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.511+0000 7f01a6ffd640 1 --2- 172.21.15.96:0/3408437843 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f01a814f060 0x7f01a80c5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.511+0000 7f01a6ffd640 1 -- 172.21.15.96:0/3408437843 >> v1:172.21.15.96:6789/0 conn(0x7f01a8070720 legacy=0x7f01a8154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.511+0000 7f01a6ffd640 1 -- 172.21.15.96:0/3408437843 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8158380 con 0x7f01a80c5ab0 2024-04-18T04:54:50.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.515+0000 7f01a6ffd640 1 --2- 172.21.15.96:0/3408437843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a80c5ab0 0x7f01a80701e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009bd0 tx=0x7f01a001ddf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c9872d7c6d8269c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.515+0000 7f01a67fc640 1 -- 172.21.15.96:0/3408437843 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a00a6c10 con 0x7f01a80c5ab0 2024-04-18T04:54:50.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.515+0000 7f01a67fc640 1 -- 172.21.15.96:0/3408437843 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a00a6d70 con 0x7f01a80c5ab0 2024-04-18T04:54:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.515+0000 7f01ada7a640 1 -- 172.21.15.96:0/3408437843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a80c5ab0 msgr2=0x7f01a80701e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.515+0000 7f01ada7a640 1 --2- 172.21.15.96:0/3408437843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a80c5ab0 0x7f01a80701e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009bd0 tx=0x7f01a001ddf0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.515+0000 7f01ada7a640 1 -- 172.21.15.96:0/3408437843 shutdown_connections 2024-04-18T04:54:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.515+0000 7f01ada7a640 1 --2- 172.21.15.96:0/3408437843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a80c5ab0 0x7f01a80701e0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009bd0 tx=0x7f01a001ddf0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.515+0000 7f01ada7a640 1 --2- 172.21.15.96:0/3408437843 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f01a814f060 0x7f01a80c5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.515+0000 7f01ada7a640 1 -- 172.21.15.96:0/3408437843 >> 172.21.15.96:0/3408437843 conn(0x7f01a8069e60 msgr2=0x7f01a806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.515+0000 7f01ada7a640 1 -- 172.21.15.96:0/3408437843 shutdown_connections 2024-04-18T04:54:50.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.515+0000 7f01ada7a640 1 -- 172.21.15.96:0/3408437843 wait complete. 2024-04-18T04:54:50.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.519+0000 7f01ada7a640 1 Processor -- start 2024-04-18T04:54:50.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.519+0000 7f01ada7a640 1 -- start start 2024-04-18T04:54:50.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.519+0000 7f01ada7a640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f01a8070720 0x7f01a81486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.519+0000 7f01ada7a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a814f060 0x7f01a8154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.519+0000 7f01ada7a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01a80c9830 0x7f01a8154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.519+0000 7f01ada7a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81f2530 con 0x7f01a80c9830 2024-04-18T04:54:50.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.519+0000 7f01ada7a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a814e350 con 0x7f01a814f060 2024-04-18T04:54:50.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.519+0000 7f01ada7a640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81f3330 con 0x7f01a8070720 2024-04-18T04:54:50.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.519+0000 7f01a7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01a80c9830 0x7f01a8154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.519+0000 7f01a7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01a80c9830 0x7f01a8154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38688/0 (socket says 172.21.15.96:38688) 2024-04-18T04:54:50.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.519+0000 7f01a7fff640 1 -- 172.21.15.96:0/2593471444 learned_addr learned my addr 172.21.15.96:0/2593471444 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:50.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.519+0000 7f01a6ffd640 1 --2- 172.21.15.96:0/2593471444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a814f060 0x7f01a8154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.523+0000 7f01a7fff640 1 -- 172.21.15.96:0/2593471444 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f01a8070720 msgr2=0x7f01a81486d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:54:50.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.523+0000 7f01a7fff640 1 --2- 172.21.15.96:0/2593471444 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f01a8070720 0x7f01a81486d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.523+0000 7f01a7fff640 1 -- 172.21.15.96:0/2593471444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a814f060 msgr2=0x7f01a8154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.523+0000 7f01a7fff640 1 --2- 172.21.15.96:0/2593471444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a814f060 0x7f01a8154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.523+0000 7f01a7fff640 1 -- 172.21.15.96:0/2593471444 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a0009830 con 0x7f01a80c9830 2024-04-18T04:54:50.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.523+0000 7f01a7fff640 1 --2- 172.21.15.96:0/2593471444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01a80c9830 0x7f01a8154540 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f019c00faf0 tx=0x7f019c005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.531+0000 7f018ffff640 1 -- 172.21.15.96:0/2593471444 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c00a4e0 con 0x7f01a80c9830 2024-04-18T04:54:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.531+0000 7f01ada7a640 1 -- 172.21.15.96:0/2593471444 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a81f27b0 con 0x7f01a80c9830 2024-04-18T04:54:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.531+0000 7f01ada7a640 1 -- 172.21.15.96:0/2593471444 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a81f2d70 con 0x7f01a80c9830 2024-04-18T04:54:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.531+0000 7f018ffff640 1 -- 172.21.15.96:0/2593471444 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c00a640 con 0x7f01a80c9830 2024-04-18T04:54:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.531+0000 7f018ffff640 1 -- 172.21.15.96:0/2593471444 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c007a50 con 0x7f01a80c9830 2024-04-18T04:54:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.531+0000 7f01ada7a640 1 -- 172.21.15.96:0/2593471444 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0188005260 con 0x7f01a80c9830 2024-04-18T04:54:50.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.531+0000 7f018ffff640 1 -- 172.21.15.96:0/2593471444 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f019c007bb0 con 0x7f01a80c9830 2024-04-18T04:54:50.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.535+0000 7f018ffff640 1 --2- 172.21.15.96:0/2593471444 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f01940666e0 0x7f0194068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.535+0000 7f018ffff640 1 -- 172.21.15.96:0/2593471444 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f019c086e20 con 0x7f01a80c9830 2024-04-18T04:54:50.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.535+0000 7f01a77fe640 1 --2- 172.21.15.96:0/2593471444 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f01940666e0 0x7f0194068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.535+0000 7f01a77fe640 1 --2- 172.21.15.96:0/2593471444 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f01940666e0 0x7f0194068ba0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0198009970 tx=0x7f0198009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.543+0000 7f018ffff640 1 -- 172.21.15.96:0/2593471444 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f019c0540e0 con 0x7f01a80c9830 2024-04-18T04:54:50.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7f2d23fff640 1 Processor -- start 2024-04-18T04:54:50.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7f2d23fff640 1 -- start start 2024-04-18T04:54:50.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7f2d23fff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d1c0d6e90 0x7f2d1c0dd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7f2d23fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2d1c047670 0x7f2d1c04eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7f2d23fff640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1c0ddae0 con 0x7f2d1c047250 2024-04-18T04:54:50.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7f2d23fff640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1c035f30 con 0x7f2d1c047670 2024-04-18T04:54:50.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7f2d23fff640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c0e1030 con 0x7f2d1c0d6e90 2024-04-18T04:54:50.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7ff7e56c1640 1 Processor -- start 2024-04-18T04:54:50.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7f2d237fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2d1c047670 0x7f2d1c04eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7f2d237fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2d1c047670 0x7f2d1c04eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:44112/0 (socket says 172.21.15.96:44112) 2024-04-18T04:54:50.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7f2d237fe640 1 -- 172.21.15.96:0/3720136754 learned_addr learned my addr 172.21.15.96:0/3720136754 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:50.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7f2d237fe640 1 -- 172.21.15.96:0/3720136754 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d1c0d6e90 msgr2=0x7f2d1c0dd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:50.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7f2d237fe640 1 --2- 172.21.15.96:0/3720136754 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d1c0d6e90 0x7f2d1c0dd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7f2d237fe640 1 -- 172.21.15.96:0/3720136754 >> v1:172.21.15.139:6789/0 conn(0x7f2d1c047250 legacy=0x7f2d1c04e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7f2d237fe640 1 -- 172.21.15.96:0/3720136754 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c0d7270 con 0x7f2d1c047670 2024-04-18T04:54:50.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7ff7e56c1640 1 -- start start 2024-04-18T04:54:50.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7ff7e56c1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff7d80dd290 0x7ff7d80e66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7ff7e56c1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff7d80e6c00 0x7ff7d804ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7ff7e56c1640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d804c660 con 0x7ff7d80e71c0 2024-04-18T04:54:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7ff7e56c1640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d80454b0 con 0x7ff7d80dd290 2024-04-18T04:54:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7ff7e56c1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d8045790 con 0x7ff7d80e6c00 2024-04-18T04:54:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7ff7dffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff7d80dd290 0x7ff7d80e66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7ff7dffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff7d80dd290 0x7ff7d80e66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38702/0 (socket says 172.21.15.96:38702) 2024-04-18T04:54:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7ff7dffff640 1 -- 172.21.15.96:0/1106774194 learned_addr learned my addr 172.21.15.96:0/1106774194 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7ff7dffff640 1 -- 172.21.15.96:0/1106774194 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff7d80e6c00 msgr2=0x7ff7d804ba40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:54:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7ff7dffff640 1 --2- 172.21.15.96:0/1106774194 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff7d80e6c00 0x7ff7d804ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7ff7dffff640 1 -- 172.21.15.96:0/1106774194 >> v1:172.21.15.139:6789/0 conn(0x7ff7d80e71c0 legacy=0x7ff7d8046270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7ff7dffff640 1 -- 172.21.15.96:0/1106774194 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d8045a70 con 0x7ff7d80dd290 2024-04-18T04:54:50.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f2d237fe640 1 --2- 172.21.15.96:0/3720136754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d1c047670 0x7f2d1c04eff0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0d7460 tx=0x7f2d24096940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18ede7a4724e7e46 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f2d21ffb640 1 -- 172.21.15.96:0/3720136754 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24120730 con 0x7f2d1c047670 2024-04-18T04:54:50.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f2d21ffb640 1 -- 172.21.15.96:0/3720136754 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d24120890 con 0x7f2d1c047670 2024-04-18T04:54:50.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f2d21ffb640 1 -- 172.21.15.96:0/3720136754 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24120cc0 con 0x7f2d1c047670 2024-04-18T04:54:50.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7ff7dffff640 1 --2- 172.21.15.96:0/1106774194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7d80dd290 0x7ff7d80e66c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009870 tx=0x7ff7cc01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db43ffae2d81a558 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7ff7deffd640 1 -- 172.21.15.96:0/1106774194 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0a8a50 con 0x7ff7d80dd290 2024-04-18T04:54:50.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7ff7deffd640 1 -- 172.21.15.96:0/1106774194 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc0a8bb0 con 0x7ff7d80dd290 2024-04-18T04:54:50.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7ff7deffd640 1 -- 172.21.15.96:0/1106774194 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0b0440 con 0x7ff7d80dd290 2024-04-18T04:54:50.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f2d23fff640 1 -- 172.21.15.96:0/3720136754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d1c047670 msgr2=0x7f2d1c04eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f2d23fff640 1 --2- 172.21.15.96:0/3720136754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d1c047670 0x7f2d1c04eff0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0d7460 tx=0x7f2d24096940 comp rx=0 tx=0).stop 2024-04-18T04:54:50.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f2d23fff640 1 -- 172.21.15.96:0/3720136754 shutdown_connections 2024-04-18T04:54:50.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f2d23fff640 1 --2- 172.21.15.96:0/3720136754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d1c047670 0x7f2d1c04eff0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f2d23fff640 1 --2- 172.21.15.96:0/3720136754 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d1c0d6e90 0x7f2d1c0dd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f2d23fff640 1 -- 172.21.15.96:0/3720136754 >> 172.21.15.96:0/3720136754 conn(0x7f2d1c00e0a0 msgr2=0x7f2d1c00e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:50.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f2d23fff640 1 -- 172.21.15.96:0/3720136754 shutdown_connections 2024-04-18T04:54:50.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7ff7e56c1640 1 -- 172.21.15.96:0/1106774194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7d80dd290 msgr2=0x7ff7d80e66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7ff7e56c1640 1 --2- 172.21.15.96:0/1106774194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7d80dd290 0x7ff7d80e66c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009870 tx=0x7ff7cc01ed50 comp rx=0 tx=0).stop 2024-04-18T04:54:50.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7f71ab176640 1 Processor -- start 2024-04-18T04:54:50.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.559+0000 7f71ab176640 1 -- start start 2024-04-18T04:54:50.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f71ab176640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f71a406b9e0 0x7f71a406be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f71ab176640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71a4166060 0x7f71a4166490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f71ab176640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a408ad00 con 0x7f71a415fee0 2024-04-18T04:54:50.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f71ab176640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a41669d0 con 0x7f71a406b9e0 2024-04-18T04:54:50.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f71ab176640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a4169560 con 0x7f71a4166060 2024-04-18T04:54:50.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f71a8f12640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f71a415fee0 0x7f71a408a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.96:49380/0 (socket says 172.21.15.96:49380) 2024-04-18T04:54:50.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f71a8f12640 1 -- 172.21.15.96:0/1268222252 learned_addr learned my addr 172.21.15.96:0/1268222252 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f71a3fff640 1 --2- 172.21.15.96:0/1268222252 >> v2:172.21.15.139:3300/0 conn(0x7f71a406b9e0 0x7f71a406be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f71a9713640 1 --2- 172.21.15.96:0/1268222252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71a4166060 0x7f71a4166490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f71a37fe640 1 -- 172.21.15.96:0/1268222252 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474616883 0 0) 0x7f71a408ad00 con 0x7f71a415fee0 2024-04-18T04:54:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a37fe640 1 -- 172.21.15.96:0/1268222252 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7194003510 con 0x7f71a415fee0 2024-04-18T04:54:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a37fe640 1 -- 172.21.15.96:0/1268222252 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3132969087 0 0) 0x7f7194003510 con 0x7f71a415fee0 2024-04-18T04:54:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a37fe640 1 -- 172.21.15.96:0/1268222252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71a4166060 msgr2=0x7f71a4166490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a37fe640 1 --2- 172.21.15.96:0/1268222252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71a4166060 0x7f71a4166490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a37fe640 1 -- 172.21.15.96:0/1268222252 >> v2:172.21.15.139:3300/0 conn(0x7f71a406b9e0 msgr2=0x7f71a406be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a37fe640 1 --2- 172.21.15.96:0/1268222252 >> v2:172.21.15.139:3300/0 conn(0x7f71a406b9e0 0x7f71a406be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a37fe640 1 -- 172.21.15.96:0/1268222252 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a4169840 con 0x7f71a415fee0 2024-04-18T04:54:50.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.563+0000 7f2d23fff640 1 -- 172.21.15.96:0/3720136754 wait complete. 2024-04-18T04:54:50.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d23fff640 1 Processor -- start 2024-04-18T04:54:50.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7ff7e56c1640 1 -- 172.21.15.96:0/1106774194 shutdown_connections 2024-04-18T04:54:50.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7ff7e56c1640 1 --2- 172.21.15.96:0/1106774194 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff7d80e6c00 0x7ff7d804ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7ff7e56c1640 1 --2- 172.21.15.96:0/1106774194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7d80dd290 0x7ff7d80e66c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7ff7e56c1640 1 -- 172.21.15.96:0/1106774194 >> 172.21.15.96:0/1106774194 conn(0x7ff7d8050160 msgr2=0x7ff7d8050570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:50.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a37fe640 1 -- 172.21.15.96:0/1268222252 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f7198001680 con 0x7f71a415fee0 2024-04-18T04:54:50.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d23fff640 1 -- start start 2024-04-18T04:54:50.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d23fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d1c047250 0x7f2d1c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d23fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d1c047670 0x7f2d1c0dbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d23fff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d1c0d6e90 0x7f2d1c0d5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d23fff640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c0d4b80 con 0x7f2d1c047250 2024-04-18T04:54:50.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d23fff640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c04f0d0 con 0x7f2d1c047670 2024-04-18T04:54:50.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d23fff640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c0dc580 con 0x7f2d1c0d6e90 2024-04-18T04:54:50.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7ff7e56c1640 1 -- 172.21.15.96:0/1106774194 shutdown_connections 2024-04-18T04:54:50.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d22ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d1c047250 0x7f2d1c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d22ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d1c047250 0x7f2d1c0c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38722/0 (socket says 172.21.15.96:38722) 2024-04-18T04:54:50.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d22ffd640 1 -- 172.21.15.96:0/2275692392 learned_addr learned my addr 172.21.15.96:0/2275692392 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:50.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7ff7e56c1640 1 -- 172.21.15.96:0/1106774194 wait complete. 2024-04-18T04:54:50.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a37fe640 1 -- 172.21.15.96:0/1268222252 >> v1:172.21.15.139:6789/0 conn(0x7f71a415fee0 legacy=0x7f71a408a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a37fe640 1 --2- 172.21.15.96:0/1268222252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7194003ab0 0x7f7194003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a37fe640 1 --2- 172.21.15.96:0/1268222252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7194004510 0x7f7194004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a37fe640 1 --2- 172.21.15.96:0/1268222252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7194004fb0 0x7f719400b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a37fe640 1 -- 172.21.15.96:0/1268222252 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a41669d0 con 0x7f7194003ab0 2024-04-18T04:54:50.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a37fe640 1 -- 172.21.15.96:0/1268222252 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a4169560 con 0x7f7194004fb0 2024-04-18T04:54:50.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a37fe640 1 -- 172.21.15.96:0/1268222252 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719400bee0 con 0x7f7194004510 2024-04-18T04:54:50.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a3fff640 1 --2- 172.21.15.96:0/1268222252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7194004510 0x7f7194004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a9713640 1 --2- 172.21.15.96:0/1268222252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7194004fb0 0x7f719400b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a8f12640 1 --2- 172.21.15.96:0/1268222252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7194003ab0 0x7f7194003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a3fff640 1 -- 172.21.15.96:0/1268222252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7194004fb0 msgr2=0x7f719400b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:50.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a3fff640 1 --2- 172.21.15.96:0/1268222252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7194004fb0 0x7f719400b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a3fff640 1 -- 172.21.15.96:0/1268222252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7194003ab0 msgr2=0x7f7194003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:50.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a3fff640 1 --2- 172.21.15.96:0/1268222252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7194003ab0 0x7f7194003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f71a3fff640 1 -- 172.21.15.96:0/1268222252 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a4169840 con 0x7f7194004510 2024-04-18T04:54:50.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7ff7e56c1640 1 Processor -- start 2024-04-18T04:54:50.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d227fc640 1 --2- 172.21.15.96:0/2275692392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d1c047670 0x7f2d1c0dbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d237fe640 1 --2- 172.21.15.96:0/2275692392 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d1c0d6e90 0x7f2d1c0d5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d22ffd640 1 -- 172.21.15.96:0/2275692392 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d1c0d6e90 msgr2=0x7f2d1c0d5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d22ffd640 1 --2- 172.21.15.96:0/2275692392 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d1c0d6e90 0x7f2d1c0d5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d22ffd640 1 -- 172.21.15.96:0/2275692392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d1c047670 msgr2=0x7f2d1c0dbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d22ffd640 1 --2- 172.21.15.96:0/2275692392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d1c047670 0x7f2d1c0dbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7f2d22ffd640 1 -- 172.21.15.96:0/2275692392 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2406ae70 con 0x7f2d1c047250 2024-04-18T04:54:50.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f2d22ffd640 1 --2- 172.21.15.96:0/2275692392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d1c047250 0x7f2d1c0c7bb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400b550 tx=0x7f2d1400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f2d0b7fe640 1 -- 172.21.15.96:0/2275692392 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14010870 con 0x7f2d1c047250 2024-04-18T04:54:50.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f2d0b7fe640 1 -- 172.21.15.96:0/2275692392 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d140109f0 con 0x7f2d1c047250 2024-04-18T04:54:50.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f2d0b7fe640 1 -- 172.21.15.96:0/2275692392 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14010da0 con 0x7f2d1c047250 2024-04-18T04:54:50.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f2d23fff640 1 -- 172.21.15.96:0/2275692392 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1c0dc860 con 0x7f2d1c047250 2024-04-18T04:54:50.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.567+0000 7ff7e56c1640 1 -- start start 2024-04-18T04:54:50.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e56c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7d80dd290 0x7ff7d80c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e56c1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff7d80e6c00 0x7ff7d80e5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e56c1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7d80e71c0 0x7ff7d8047e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e56c1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d8049460 con 0x7ff7d80e71c0 2024-04-18T04:54:50.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e56c1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80e4340 con 0x7ff7d80dd290 2024-04-18T04:54:50.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e56c1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80c6f80 con 0x7ff7d80e6c00 2024-04-18T04:54:50.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f2d23fff640 1 -- 172.21.15.96:0/2275692392 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1c0d4810 con 0x7f2d1c047250 2024-04-18T04:54:50.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e4ec0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7d80e71c0 0x7ff7d8047e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e4ec0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7d80e71c0 0x7ff7d8047e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38728/0 (socket says 172.21.15.96:38728) 2024-04-18T04:54:50.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e4ec0640 1 -- 172.21.15.96:0/1977588223 learned_addr learned my addr 172.21.15.96:0/1977588223 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:50.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7dffff640 1 --2- 172.21.15.96:0/1977588223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7d80dd290 0x7ff7d80c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7df7fe640 1 --2- 172.21.15.96:0/1977588223 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff7d80e6c00 0x7ff7d80e5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e4ec0640 1 -- 172.21.15.96:0/1977588223 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff7d80e6c00 msgr2=0x7ff7d80e5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e4ec0640 1 --2- 172.21.15.96:0/1977588223 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff7d80e6c00 0x7ff7d80e5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e4ec0640 1 -- 172.21.15.96:0/1977588223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7d80dd290 msgr2=0x7ff7d80c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e4ec0640 1 --2- 172.21.15.96:0/1977588223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7d80dd290 0x7ff7d80c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e4ec0640 1 -- 172.21.15.96:0/1977588223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc0094d0 con 0x7ff7d80e71c0 2024-04-18T04:54:50.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7dffff640 1 --2- 172.21.15.96:0/1977588223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7d80dd290 0x7ff7d80c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:54:50.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e4ec0640 1 --2- 172.21.15.96:0/1977588223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7d80e71c0 0x7ff7d8047e80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff7e002c920 tx=0x7ff7e00742e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f71a3fff640 1 --2- 172.21.15.96:0/1268222252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7194004510 0x7f7194004990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f719000d310 tx=0x7f719002d700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1da0aacfc8060a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f2d23fff640 1 -- 172.21.15.96:0/2275692392 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d04005260 con 0x7f2d1c047250 2024-04-18T04:54:50.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7dcff9640 1 -- 172.21.15.96:0/1977588223 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0072460 con 0x7ff7d80e71c0 2024-04-18T04:54:50.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7dcff9640 1 -- 172.21.15.96:0/1977588223 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e004f170 con 0x7ff7d80e71c0 2024-04-18T04:54:50.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7dcff9640 1 -- 172.21.15.96:0/1977588223 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00725c0 con 0x7ff7d80e71c0 2024-04-18T04:54:50.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e56c1640 1 -- 172.21.15.96:0/1977588223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d80cf4a0 con 0x7ff7d80e71c0 2024-04-18T04:54:50.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7ff7e56c1640 1 -- 172.21.15.96:0/1977588223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d80e4060 con 0x7ff7d80e71c0 2024-04-18T04:54:50.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f95a62cd640 1 Processor -- start 2024-04-18T04:54:50.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f95a62cd640 1 -- start start 2024-04-18T04:54:50.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f71a37fe640 1 -- 172.21.15.96:0/1268222252 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71900bb680 con 0x7f7194004510 2024-04-18T04:54:50.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f71a37fe640 1 -- 172.21.15.96:0/1268222252 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71900bb7e0 con 0x7f7194004510 2024-04-18T04:54:50.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f71a37fe640 1 -- 172.21.15.96:0/1268222252 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71900bbbd0 con 0x7f7194004510 2024-04-18T04:54:50.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f2d0b7fe640 1 -- 172.21.15.96:0/2275692392 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2d1400f3c0 con 0x7f2d1c047250 2024-04-18T04:54:50.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f2d0b7fe640 1 --2- 172.21.15.96:0/2275692392 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2d100666e0 0x7f2d10068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f2d227fc640 1 --2- 172.21.15.96:0/2275692392 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2d100666e0 0x7f2d10068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f71ab176640 1 -- 172.21.15.96:0/1268222252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7194004510 msgr2=0x7f7194004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f2d0b7fe640 1 -- 172.21.15.96:0/2275692392 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d14083fe0 con 0x7f2d1c047250 2024-04-18T04:54:50.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7f71ab176640 1 --2- 172.21.15.96:0/1268222252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7194004510 0x7f7194004990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f719000d310 tx=0x7f719002d700 comp rx=0 tx=0).stop 2024-04-18T04:54:50.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7f71a9713640 1 -- 172.21.15.96:0/1268222252 reap_dead start 2024-04-18T04:54:50.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7f2d227fc640 1 --2- 172.21.15.96:0/2275692392 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2d100666e0 0x7f2d10068ba0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0d68b0 tx=0x7f2d18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7ff7dcff9640 1 -- 172.21.15.96:0/1977588223 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff7e006f850 con 0x7ff7d80e71c0 2024-04-18T04:54:50.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f95a62cd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f959804c6a0 0x7f9598045230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f95a62cd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9598045770 0x7f95980e3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f95a62cd640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9598045be0 con 0x7f95980dd4c0 2024-04-18T04:54:50.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f95a62cd640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95980dd8a0 con 0x7f9598045770 2024-04-18T04:54:50.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f95a62cd640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9598006670 con 0x7f959804c6a0 2024-04-18T04:54:50.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f95a486a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9598045770 0x7f95980e3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f95a486a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9598045770 0x7f95980e3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38730/0 (socket says 172.21.15.96:38730) 2024-04-18T04:54:50.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.571+0000 7f95a486a640 1 -- 172.21.15.96:0/1402612281 learned_addr learned my addr 172.21.15.96:0/1402612281 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:50.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7f95a486a640 1 -- 172.21.15.96:0/1402612281 >> v2:172.21.15.139:3300/0 conn(0x7f959804c6a0 msgr2=0x7f9598045230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:54:50.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7f95a486a640 1 --2- 172.21.15.96:0/1402612281 >> v2:172.21.15.139:3300/0 conn(0x7f959804c6a0 0x7f9598045230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7f95a486a640 1 -- 172.21.15.96:0/1402612281 >> v1:172.21.15.96:6789/0 conn(0x7f95980dd4c0 legacy=0x7f9598005ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:50.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7f95a486a640 1 -- 172.21.15.96:0/1402612281 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9598006950 con 0x7f9598045770 2024-04-18T04:54:50.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7ff7dcff9640 1 --2- 172.21.15.96:0/1977588223 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff7c4066710 0x7ff7c4068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7ff7dffff640 1 --2- 172.21.15.96:0/1977588223 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff7c4066710 0x7ff7c4068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7ff7dcff9640 1 -- 172.21.15.96:0/1977588223 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7e00cf770 con 0x7ff7d80e71c0 2024-04-18T04:54:50.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7f71ab176640 1 -- 172.21.15.96:0/1268222252 shutdown_connections 2024-04-18T04:54:50.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7f71ab176640 1 -- 172.21.15.96:0/1268222252 >> 172.21.15.96:0/1268222252 conn(0x7f71a406a8e0 msgr2=0x7f71a40c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:50.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7ff7dffff640 1 --2- 172.21.15.96:0/1977588223 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff7c4066710 0x7ff7c4068bd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0b2000 tx=0x7ff7cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7f71ab176640 1 -- 172.21.15.96:0/1268222252 shutdown_connections 2024-04-18T04:54:50.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7f71ab176640 1 -- 172.21.15.96:0/1268222252 wait complete. 2024-04-18T04:54:50.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7f95a486a640 1 --2- 172.21.15.96:0/1402612281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9598045770 0x7f95980e3150 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f95a0068ab0 tx=0x7f95a0099450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2665063c4b652c06 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7ff7e56c1640 1 -- 172.21.15.96:0/1977588223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c0005260 con 0x7ff7d80e71c0 2024-04-18T04:54:50.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7fddeaed1640 1 Processor -- start 2024-04-18T04:54:50.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7fddeaed1640 1 -- start start 2024-04-18T04:54:50.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7f71ab176640 1 Processor -- start 2024-04-18T04:54:50.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.575+0000 7f71ab176640 1 -- start start 2024-04-18T04:54:50.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7fddeaed1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdddc0d6d90 0x7fdddc047310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7fddeaed1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdddc0dcb10 0x7fdddc0dcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7fddeaed1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdddc0e0100 con 0x7fdddc047850 2024-04-18T04:54:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7fddeaed1640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdddc0e0c90 con 0x7fdddc0dcb10 2024-04-18T04:54:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7fddeaed1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc047c30 con 0x7fdddc0d6d90 2024-04-18T04:54:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7fdde96ce640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fdddc047850 0x7fdddc04d360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46346/0 (socket says 172.21.15.96:46346) 2024-04-18T04:54:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7fdde96ce640 1 -- 172.21.15.96:0/496251607 learned_addr learned my addr 172.21.15.96:0/496251607 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7fdde9ecf640 1 --2- 172.21.15.96:0/496251607 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdddc0d6d90 0x7fdddc047310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7fddea6d0640 1 --2- 172.21.15.96:0/496251607 >> v2:172.21.15.139:3300/0 conn(0x7fdddc0dcb10 0x7fdddc0dcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7fdde9ecf640 1 -- 172.21.15.96:0/496251607 >> v2:172.21.15.139:3300/0 conn(0x7fdddc0dcb10 msgr2=0x7fdddc0dcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7fdde9ecf640 1 --2- 172.21.15.96:0/496251607 >> v2:172.21.15.139:3300/0 conn(0x7fdddc0dcb10 0x7fdddc0dcf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71ab176640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7194004510 0x7f71a4162d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7fdde9ecf640 1 -- 172.21.15.96:0/496251607 >> v1:172.21.15.96:6789/0 conn(0x7fdddc047850 legacy=0x7fdddc04d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7fdde9ecf640 1 -- 172.21.15.96:0/496251607 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc0dd8f0 con 0x7fdddc0d6d90 2024-04-18T04:54:50.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7fddea6d0640 1 --2- 172.21.15.96:0/496251607 >> v2:172.21.15.139:3300/0 conn(0x7fdddc0dcb10 0x7fdddc0dcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:54:50.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71ab176640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71a4201b60 0x7f71a4163260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71ab176640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71a40c8550 0x7f71a40c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71ab176640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a40c8100 con 0x7f71a4201b60 2024-04-18T04:54:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71ab176640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a41fe5f0 con 0x7f71a40c8550 2024-04-18T04:54:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71ab176640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a40c8f10 con 0x7f7194004510 2024-04-18T04:54:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71a3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71a4201b60 0x7f71a4163260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71a8f12640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7194004510 0x7f71a4162d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71a3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71a4201b60 0x7f71a4163260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38734/0 (socket says 172.21.15.96:38734) 2024-04-18T04:54:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71a3fff640 1 -- 172.21.15.96:0/103365629 learned_addr learned my addr 172.21.15.96:0/103365629 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71a9713640 1 --2- 172.21.15.96:0/103365629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71a40c8550 0x7f71a40c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71a3fff640 1 -- 172.21.15.96:0/103365629 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7194004510 msgr2=0x7f71a4162d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71a3fff640 1 --2- 172.21.15.96:0/103365629 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7194004510 0x7f71a4162d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71a3fff640 1 -- 172.21.15.96:0/103365629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71a40c8550 msgr2=0x7f71a40c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71a3fff640 1 --2- 172.21.15.96:0/103365629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71a40c8550 0x7f71a40c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71a3fff640 1 -- 172.21.15.96:0/103365629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a41fe820 con 0x7f71a4201b60 2024-04-18T04:54:50.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.579+0000 7f71a3fff640 1 --2- 172.21.15.96:0/103365629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71a4201b60 0x7f71a4163260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f719002d530 tx=0x7f719000d5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.583+0000 7f71a17fa640 1 -- 172.21.15.96:0/103365629 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71900bb950 con 0x7f71a4201b60 2024-04-18T04:54:50.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.583+0000 7f71ab176640 1 -- 172.21.15.96:0/103365629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a41feb00 con 0x7f71a4201b60 2024-04-18T04:54:50.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.583+0000 7f71ab176640 1 -- 172.21.15.96:0/103365629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a41ff0c0 con 0x7f71a4201b60 2024-04-18T04:54:50.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.583+0000 7fdde9ecf640 1 --2- 172.21.15.96:0/496251607 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdddc0d6d90 0x7fdddc047310 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdddc047d70 tx=0x7fdde4096b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f641cfbadc771d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.583+0000 7f959effd640 1 -- 172.21.15.96:0/1402612281 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0129600 con 0x7f9598045770 2024-04-18T04:54:50.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.583+0000 7f2d0b7fe640 1 -- 172.21.15.96:0/2275692392 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2d14054f70 con 0x7f2d1c047250 2024-04-18T04:54:50.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.583+0000 7fdde8ecd640 1 -- 172.21.15.96:0/496251607 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4120760 con 0x7fdddc0d6d90 2024-04-18T04:54:50.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.583+0000 7f71ab176640 1 -- 172.21.15.96:0/103365629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a40670f0 con 0x7f71a4201b60 2024-04-18T04:54:50.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.583+0000 7fdde8ecd640 1 -- 172.21.15.96:0/496251607 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde41208c0 con 0x7fdddc0d6d90 2024-04-18T04:54:50.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.587+0000 7fdde8ecd640 1 -- 172.21.15.96:0/496251607 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4120cf0 con 0x7fdddc0d6d90 2024-04-18T04:54:50.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.587+0000 7fddeaed1640 1 -- 172.21.15.96:0/496251607 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdddc0d6d90 msgr2=0x7fdddc047310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.587+0000 7fddeaed1640 1 --2- 172.21.15.96:0/496251607 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdddc0d6d90 0x7fdddc047310 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdddc047d70 tx=0x7fdde4096b50 comp rx=0 tx=0).stop 2024-04-18T04:54:50.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.587+0000 7fddeaed1640 1 -- 172.21.15.96:0/496251607 shutdown_connections 2024-04-18T04:54:50.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.587+0000 7fddeaed1640 1 --2- 172.21.15.96:0/496251607 >> v2:172.21.15.139:3300/0 conn(0x7fdddc0dcb10 0x7fdddc0dcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.587+0000 7fddeaed1640 1 --2- 172.21.15.96:0/496251607 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdddc0d6d90 0x7fdddc047310 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.587+0000 7fddeaed1640 1 -- 172.21.15.96:0/496251607 >> 172.21.15.96:0/496251607 conn(0x7fdddc00e060 msgr2=0x7fdddc00e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:50.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.587+0000 7fddeaed1640 1 -- 172.21.15.96:0/496251607 shutdown_connections 2024-04-18T04:54:50.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.587+0000 7fddeaed1640 1 -- 172.21.15.96:0/496251607 wait complete. 2024-04-18T04:54:50.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.587+0000 7ff7dcff9640 1 -- 172.21.15.96:0/1977588223 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff7e008f080 con 0x7ff7d80e71c0 2024-04-18T04:54:50.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.587+0000 7fddeaed1640 1 Processor -- start 2024-04-18T04:54:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.587+0000 7f71a17fa640 1 -- 172.21.15.96:0/103365629 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71900ca070 con 0x7f71a4201b60 2024-04-18T04:54:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.587+0000 7fddeaed1640 1 -- start start 2024-04-18T04:54:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fddeaed1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdddc047850 0x7fdddc0db0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fddeaed1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdddc0d6d90 0x7fdddc0df190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.587+0000 7f959effd640 1 -- 172.21.15.96:0/1402612281 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a0125050 con 0x7f9598045770 2024-04-18T04:54:50.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.587+0000 7f959effd640 1 -- 172.21.15.96:0/1402612281 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0129a20 con 0x7f9598045770 2024-04-18T04:54:50.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7f95a62cd640 1 -- 172.21.15.96:0/1402612281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9598045770 msgr2=0x7f95980e3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7f95a62cd640 1 --2- 172.21.15.96:0/1402612281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9598045770 0x7f95980e3150 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f95a0068ab0 tx=0x7f95a0099450 comp rx=0 tx=0).stop 2024-04-18T04:54:50.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7f71a17fa640 1 -- 172.21.15.96:0/103365629 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71900bbcb0 con 0x7f71a4201b60 2024-04-18T04:54:50.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fdde9ecf640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdddc047850 0x7fdddc0db0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fdde9ecf640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdddc047850 0x7fdddc0db0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38746/0 (socket says 172.21.15.96:38746) 2024-04-18T04:54:50.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fdde96ce640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdddc0d6d90 0x7fdddc0df190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fdde96ce640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdddc0d6d90 0x7fdddc0df190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:55184/0 (socket says 172.21.15.96:55184) 2024-04-18T04:54:50.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fdde9ecf640 1 -- 172.21.15.96:0/1902299780 learned_addr learned my addr 172.21.15.96:0/1902299780 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:50.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fddeaed1640 1 --2- 172.21.15.96:0/1902299780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdddc0dcb10 0x7fdddc0d8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fddeaed1640 1 -- 172.21.15.96:0/1902299780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc17c510 con 0x7fdddc047850 2024-04-18T04:54:50.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fddeaed1640 1 -- 172.21.15.96:0/1902299780 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0db6d0 con 0x7fdddc0dcb10 2024-04-18T04:54:50.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fddeaed1640 1 -- 172.21.15.96:0/1902299780 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0518f0 con 0x7fdddc0d6d90 2024-04-18T04:54:50.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fdde9ecf640 1 -- 172.21.15.96:0/1902299780 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdddc0d6d90 msgr2=0x7fdddc0df190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fdde9ecf640 1 --2- 172.21.15.96:0/1902299780 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdddc0d6d90 0x7fdddc0df190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fdde9ecf640 1 -- 172.21.15.96:0/1902299780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdddc0dcb10 msgr2=0x7fdddc0d8ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:54:50.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fdde9ecf640 1 --2- 172.21.15.96:0/1902299780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdddc0dcb10 0x7fdddc0d8ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fdde9ecf640 1 -- 172.21.15.96:0/1902299780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd4009420 con 0x7fdddc047850 2024-04-18T04:54:50.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fdde9ecf640 1 --2- 172.21.15.96:0/1902299780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdddc047850 0x7fdddc0db0f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdde4069a00 tx=0x7fdde40938f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fddda7fc640 1 -- 172.21.15.96:0/1902299780 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4121480 con 0x7fdddc047850 2024-04-18T04:54:50.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fddeaed1640 1 -- 172.21.15.96:0/1902299780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde406ae70 con 0x7fdddc047850 2024-04-18T04:54:50.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7fddeaed1640 1 -- 172.21.15.96:0/1902299780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc17bbe0 con 0x7fdddc047850 2024-04-18T04:54:50.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7f71a17fa640 1 -- 172.21.15.96:0/103365629 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f71900cc030 con 0x7f71a4201b60 2024-04-18T04:54:50.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.591+0000 7f71a17fa640 1 --2- 172.21.15.96:0/103365629 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f71880666c0 0x7f7188068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f71a8f12640 1 --2- 172.21.15.96:0/103365629 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f71880666c0 0x7f7188068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f95a62cd640 1 -- 172.21.15.96:0/1402612281 shutdown_connections 2024-04-18T04:54:50.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f95a62cd640 1 --2- 172.21.15.96:0/1402612281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9598045770 0x7f95980e3150 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f95a62cd640 1 --2- 172.21.15.96:0/1402612281 >> v2:172.21.15.139:3300/0 conn(0x7f959804c6a0 0x7f9598045230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f95a62cd640 1 -- 172.21.15.96:0/1402612281 >> 172.21.15.96:0/1402612281 conn(0x7f9598050190 msgr2=0x7f95980505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:50.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f95a62cd640 1 -- 172.21.15.96:0/1402612281 shutdown_connections 2024-04-18T04:54:50.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f71a8f12640 1 --2- 172.21.15.96:0/103365629 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f71880666c0 0x7f7188068b80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7198000fc0 tx=0x7f7198007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f71a17fa640 1 -- 172.21.15.96:0/103365629 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7190101830 con 0x7f71a4201b60 2024-04-18T04:54:50.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f95a62cd640 1 -- 172.21.15.96:0/1402612281 wait complete. 2024-04-18T04:54:50.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7fddeaed1640 1 -- 172.21.15.96:0/1902299780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc0355f0 con 0x7fdddc047850 2024-04-18T04:54:50.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f95a62cd640 1 Processor -- start 2024-04-18T04:54:50.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f95a62cd640 1 -- start start 2024-04-18T04:54:50.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f95a62cd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9598045770 0x7f95980e3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f95a62cd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f959804c6a0 0x7f959817f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f95a62cd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f95980dd4c0 0x7f959817fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f95a62cd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95980e0fc0 con 0x7f959804c6a0 2024-04-18T04:54:50.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f95a62cd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95980e2d90 con 0x7f9598045770 2024-04-18T04:54:50.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f95a62cd640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959817f320 con 0x7f95980dd4c0 2024-04-18T04:54:50.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f959f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f959804c6a0 0x7f959817f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f959f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f959804c6a0 0x7f959817f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38756/0 (socket says 172.21.15.96:38756) 2024-04-18T04:54:50.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f959f7fe640 1 -- 172.21.15.96:0/3824837676 learned_addr learned my addr 172.21.15.96:0/3824837676 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:50.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f959ffff640 1 --2- 172.21.15.96:0/3824837676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9598045770 0x7f95980e3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.595+0000 7f95a486a640 1 --2- 172.21.15.96:0/3824837676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f95980dd4c0 0x7f959817fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.599+0000 7f959f7fe640 1 -- 172.21.15.96:0/3824837676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f95980dd4c0 msgr2=0x7f959817fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.599+0000 7f959f7fe640 1 --2- 172.21.15.96:0/3824837676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f95980dd4c0 0x7f959817fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.599+0000 7f959f7fe640 1 -- 172.21.15.96:0/3824837676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9598045770 msgr2=0x7f95980e3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.599+0000 7f959f7fe640 1 --2- 172.21.15.96:0/3824837676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9598045770 0x7f95980e3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.599+0000 7f959f7fe640 1 -- 172.21.15.96:0/3824837676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a006ae70 con 0x7f959804c6a0 2024-04-18T04:54:50.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.599+0000 7f959ffff640 1 --2- 172.21.15.96:0/3824837676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9598045770 0x7f95980e3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:54:50.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.599+0000 7f95a486a640 1 --2- 172.21.15.96:0/3824837676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f95980dd4c0 0x7f959817fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:54:50.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.599+0000 7f959f7fe640 1 --2- 172.21.15.96:0/3824837676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f959804c6a0 0x7f959817f7b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f958c00b4a0 tx=0x7f958c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.603+0000 7fddda7fc640 1 -- 172.21.15.96:0/1902299780 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde41215e0 con 0x7fdddc047850 2024-04-18T04:54:50.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.603+0000 7fddda7fc640 1 -- 172.21.15.96:0/1902299780 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4121950 con 0x7fdddc047850 2024-04-18T04:54:50.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.603+0000 7f71a17fa640 1 -- 172.21.15.96:0/103365629 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f71900fd470 con 0x7f71a4201b60 2024-04-18T04:54:50.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.603+0000 7f959cff9640 1 -- 172.21.15.96:0/3824837676 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c010610 con 0x7f959804c6a0 2024-04-18T04:54:50.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.603+0000 7f95a62cd640 1 -- 172.21.15.96:0/3824837676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95980e1210 con 0x7f959804c6a0 2024-04-18T04:54:50.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.603+0000 7f95a62cd640 1 -- 172.21.15.96:0/3824837676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95980e2ab0 con 0x7f959804c6a0 2024-04-18T04:54:50.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.603+0000 7f95a62cd640 1 -- 172.21.15.96:0/3824837676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959817f4d0 con 0x7f959804c6a0 2024-04-18T04:54:50.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.603+0000 7f959cff9640 1 -- 172.21.15.96:0/3824837676 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c010770 con 0x7f959804c6a0 2024-04-18T04:54:50.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.603+0000 7f959cff9640 1 -- 172.21.15.96:0/3824837676 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c010b00 con 0x7f959804c6a0 2024-04-18T04:54:50.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.603+0000 7fddda7fc640 1 -- 172.21.15.96:0/1902299780 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdde4121ab0 con 0x7fdddc047850 2024-04-18T04:54:50.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.607+0000 7fddda7fc640 1 --2- 172.21.15.96:0/1902299780 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fddc8066690 0x7fddc8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.607+0000 7fdde96ce640 1 --2- 172.21.15.96:0/1902299780 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fddc8066690 0x7fddc8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.607+0000 7fdde96ce640 1 --2- 172.21.15.96:0/1902299780 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fddc8066690 0x7fddc8068b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdddc0dfaa0 tx=0x7fdde0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.607+0000 7f959cff9640 1 -- 172.21.15.96:0/3824837676 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f958c010c60 con 0x7f959804c6a0 2024-04-18T04:54:50.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.607+0000 7fddda7fc640 1 -- 172.21.15.96:0/1902299780 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdde4169890 con 0x7fdddc047850 2024-04-18T04:54:50.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.607+0000 7f959cff9640 1 --2- 172.21.15.96:0/3824837676 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9584066690 0x7f9584068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.607+0000 7f959ffff640 1 --2- 172.21.15.96:0/3824837676 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9584066690 0x7f9584068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.607+0000 7f959ffff640 1 --2- 172.21.15.96:0/3824837676 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9584066690 0x7f9584068b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9594003ec0 tx=0x7f9594009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.615+0000 7fddda7fc640 1 -- 172.21.15.96:0/1902299780 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fdde4165bd0 con 0x7fdddc047850 2024-04-18T04:54:50.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.615+0000 7f959cff9640 1 -- 172.21.15.96:0/3824837676 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f958c055a50 con 0x7f959804c6a0 2024-04-18T04:54:50.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.627+0000 7f959cff9640 1 -- 172.21.15.96:0/3824837676 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f958c051690 con 0x7f959804c6a0 2024-04-18T04:54:50.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.647+0000 7fa705839640 1 Processor -- start 2024-04-18T04:54:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.647+0000 7fa705839640 1 -- start start 2024-04-18T04:54:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.647+0000 7fa705839640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7000b4370 0x7fa7000c4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.647+0000 7fa705839640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa7000cb200 0x7fa700157070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.647+0000 7fa705839640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7000c8f90 con 0x7fa7000b3f90 2024-04-18T04:54:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.647+0000 7fa705839640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7000c47d0 con 0x7fa7000cb200 2024-04-18T04:54:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.647+0000 7fa705839640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7000c4ab0 con 0x7fa7000b4370 2024-04-18T04:54:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.647+0000 7fa704837640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa7000b3f90 0x7fa7001611a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46350/0 (socket says 172.21.15.96:46350) 2024-04-18T04:54:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.647+0000 7fa704837640 1 -- 172.21.15.96:0/2957482768 learned_addr learned my addr 172.21.15.96:0/2957482768 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:50.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.647+0000 7fa6ff7fe640 1 -- 172.21.15.96:0/2957482768 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366242738 0 0) 0x7fa7000c8f90 con 0x7fa7000b3f90 2024-04-18T04:54:50.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.647+0000 7fa6ff7fe640 1 -- 172.21.15.96:0/2957482768 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6e8003530 con 0x7fa7000b3f90 2024-04-18T04:54:50.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.647+0000 7fa6fffff640 1 --2- 172.21.15.96:0/2957482768 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7000b4370 0x7fa7000c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.647+0000 7fa705038640 1 --2- 172.21.15.96:0/2957482768 >> v2:172.21.15.139:3300/0 conn(0x7fa7000cb200 0x7fa700157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.647+0000 7fa6ff7fe640 1 -- 172.21.15.96:0/2957482768 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1506897513 0 0) 0x7fa6e8003530 con 0x7fa7000b3f90 2024-04-18T04:54:50.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.647+0000 7fa6ff7fe640 1 -- 172.21.15.96:0/2957482768 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7000b4370 msgr2=0x7fa7000c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:50.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.647+0000 7fa6ff7fe640 1 --2- 172.21.15.96:0/2957482768 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7000b4370 0x7fa7000c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa6ff7fe640 1 -- 172.21.15.96:0/2957482768 >> v2:172.21.15.139:3300/0 conn(0x7fa7000cb200 msgr2=0x7fa700157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:50.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa6ff7fe640 1 --2- 172.21.15.96:0/2957482768 >> v2:172.21.15.139:3300/0 conn(0x7fa7000cb200 0x7fa700157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa6ff7fe640 1 -- 172.21.15.96:0/2957482768 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7000c4d90 con 0x7fa7000b3f90 2024-04-18T04:54:50.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa705038640 1 --2- 172.21.15.96:0/2957482768 >> v2:172.21.15.139:3300/0 conn(0x7fa7000cb200 0x7fa700157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:54:50.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa6ff7fe640 1 -- 172.21.15.96:0/2957482768 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fa6f0001680 con 0x7fa7000b3f90 2024-04-18T04:54:50.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa6ff7fe640 1 -- 172.21.15.96:0/2957482768 >> v1:172.21.15.96:6789/0 conn(0x7fa7000b3f90 legacy=0x7fa7001611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa6ff7fe640 1 --2- 172.21.15.96:0/2957482768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6e8003a00 0x7fa6e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa704837640 1 --2- 172.21.15.96:0/2957482768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6e8003a00 0x7fa6e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa6ff7fe640 1 --2- 172.21.15.96:0/2957482768 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7000b4370 0x7fa6e80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa6ff7fe640 1 --2- 172.21.15.96:0/2957482768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e8004d10 0x7fa6e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa6ff7fe640 1 -- 172.21.15.96:0/2957482768 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7000c47d0 con 0x7fa6e8003a00 2024-04-18T04:54:50.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa6ff7fe640 1 -- 172.21.15.96:0/2957482768 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7000c4ab0 con 0x7fa6e8004d10 2024-04-18T04:54:50.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa6ff7fe640 1 -- 172.21.15.96:0/2957482768 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e800bb50 con 0x7fa7000b4370 2024-04-18T04:54:50.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa6fffff640 1 --2- 172.21.15.96:0/2957482768 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7000b4370 0x7fa6e80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa705038640 1 --2- 172.21.15.96:0/2957482768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e8004d10 0x7fa6e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa704837640 1 -- 172.21.15.96:0/2957482768 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7000b4370 msgr2=0x7fa6e80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:50.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa704837640 1 --2- 172.21.15.96:0/2957482768 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7000b4370 0x7fa6e80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa704837640 1 -- 172.21.15.96:0/2957482768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e8004d10 msgr2=0x7fa6e8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:50.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa704837640 1 --2- 172.21.15.96:0/2957482768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e8004d10 0x7fa6e8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.651+0000 7fa704837640 1 -- 172.21.15.96:0/2957482768 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e8003530 con 0x7fa6e8003a00 2024-04-18T04:54:50.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.655+0000 7fa704837640 1 --2- 172.21.15.96:0/2957482768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6e8003a00 0x7fa6e8003de0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0001ec0 tx=0x7fa6f001f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b904b516e65d5d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.655+0000 7fa6ff7fe640 1 -- 172.21.15.96:0/2957482768 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0005ae0 con 0x7fa6e8003a00 2024-04-18T04:54:50.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.655+0000 7fa6ff7fe640 1 -- 172.21.15.96:0/2957482768 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f0005c60 con 0x7fa6e8003a00 2024-04-18T04:54:50.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.655+0000 7fa705839640 1 -- 172.21.15.96:0/2957482768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6e8003a00 msgr2=0x7fa6e8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.655+0000 7fa705839640 1 --2- 172.21.15.96:0/2957482768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6e8003a00 0x7fa6e8003de0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0001ec0 tx=0x7fa6f001f890 comp rx=0 tx=0).stop 2024-04-18T04:54:50.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.655+0000 7fa705038640 1 -- 172.21.15.96:0/2957482768 reap_dead start 2024-04-18T04:54:50.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.655+0000 7fa705839640 1 -- 172.21.15.96:0/2957482768 shutdown_connections 2024-04-18T04:54:50.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.655+0000 7fa705839640 1 -- 172.21.15.96:0/2957482768 >> 172.21.15.96:0/2957482768 conn(0x7fa700065bc0 msgr2=0x7fa700065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:50.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.659+0000 7fa705839640 1 -- 172.21.15.96:0/2957482768 shutdown_connections 2024-04-18T04:54:50.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.659+0000 7fa705839640 1 -- 172.21.15.96:0/2957482768 wait complete. 2024-04-18T04:54:50.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.659+0000 7fa705839640 1 Processor -- start 2024-04-18T04:54:50.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.659+0000 7fa705839640 1 -- start start 2024-04-18T04:54:50.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.659+0000 7fa705839640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7000cd6a0 0x7fa70013fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.659+0000 7fa705839640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7000cda80 0x7fa7001fe850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.659+0000 7fa705839640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa700158230 0x7fa7001fed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.659+0000 7fa705839640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70013e770 con 0x7fa7000cd6a0 2024-04-18T04:54:50.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.659+0000 7fa705839640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa700140180 con 0x7fa700158230 2024-04-18T04:54:50.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.659+0000 7fa705839640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa700143d20 con 0x7fa7000cda80 2024-04-18T04:54:50.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.659+0000 7fa704837640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7000cd6a0 0x7fa70013fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.659+0000 7fa704837640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7000cd6a0 0x7fa70013fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38762/0 (socket says 172.21.15.96:38762) 2024-04-18T04:54:50.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.659+0000 7fa704837640 1 -- 172.21.15.96:0/1050635251 learned_addr learned my addr 172.21.15.96:0/1050635251 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:50.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.659+0000 7fa6fffff640 1 --2- 172.21.15.96:0/1050635251 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7000cda80 0x7fa7001fe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.659+0000 7fa705038640 1 --2- 172.21.15.96:0/1050635251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa700158230 0x7fa7001fed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.663+0000 7fa6fffff640 1 -- 172.21.15.96:0/1050635251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa700158230 msgr2=0x7fa7001fed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.663+0000 7fa6fffff640 1 --2- 172.21.15.96:0/1050635251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa700158230 0x7fa7001fed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.663+0000 7fa6fffff640 1 -- 172.21.15.96:0/1050635251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7000cd6a0 msgr2=0x7fa70013fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.663+0000 7fa6fffff640 1 --2- 172.21.15.96:0/1050635251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7000cd6a0 0x7fa70013fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.663+0000 7fa6fffff640 1 -- 172.21.15.96:0/1050635251 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa700144000 con 0x7fa7000cda80 2024-04-18T04:54:50.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.663+0000 7fa6fffff640 1 --2- 172.21.15.96:0/1050635251 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7000cda80 0x7fa7001fe850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8007d60 tx=0x7fa6f8010530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.663+0000 7fa6fd7fa640 1 -- 172.21.15.96:0/1050635251 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80039a0 con 0x7fa7000cda80 2024-04-18T04:54:50.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.663+0000 7fa705839640 1 -- 172.21.15.96:0/1050635251 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70013e960 con 0x7fa7000cda80 2024-04-18T04:54:50.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.663+0000 7fa705839640 1 -- 172.21.15.96:0/1050635251 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70013ef20 con 0x7fa7000cda80 2024-04-18T04:54:50.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.663+0000 7fa6fd7fa640 1 -- 172.21.15.96:0/1050635251 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f8003b00 con 0x7fa7000cda80 2024-04-18T04:54:50.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.663+0000 7fa6fd7fa640 1 -- 172.21.15.96:0/1050635251 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8003e90 con 0x7fa7000cda80 2024-04-18T04:54:50.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.663+0000 7fa6fd7fa640 1 -- 172.21.15.96:0/1050635251 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa6f8004030 con 0x7fa7000cda80 2024-04-18T04:54:50.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.667+0000 7fa6fd7fa640 1 --2- 172.21.15.96:0/1050635251 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa6ec066690 0x7fa6ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:50.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.667+0000 7fa6fd7fa640 1 -- 172.21.15.96:0/1050635251 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6f8084a50 con 0x7fa7000cda80 2024-04-18T04:54:50.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.667+0000 7fa704837640 1 --2- 172.21.15.96:0/1050635251 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa6ec066690 0x7fa6ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:50.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.667+0000 7fa705839640 1 -- 172.21.15.96:0/1050635251 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e0005260 con 0x7fa7000cda80 2024-04-18T04:54:50.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.667+0000 7fa704837640 1 --2- 172.21.15.96:0/1050635251 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa6ec066690 0x7fa6ec068b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00080e0 tx=0x7fa6f00ab000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.679+0000 7fa6fd7fa640 1 -- 172.21.15.96:0/1050635251 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa6f801c020 con 0x7fa7000cda80 2024-04-18T04:54:50.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.807+0000 7fcadae67640 1 -- 172.21.15.96:0/1777254252 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcab0005510 con 0x7fcad41578f0 2024-04-18T04:54:50.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.807+0000 7fcad17fa640 1 -- 172.21.15.96:0/1777254252 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcac4015020 con 0x7fcad41578f0 2024-04-18T04:54:50.811 INFO:teuthology.orchestra.run.smithi096.stdout:64424509444 2024-04-18T04:54:50.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.811+0000 7fcadae67640 1 -- 172.21.15.96:0/1777254252 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcabc066980 msgr2=0x7fcabc068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.811+0000 7fcadae67640 1 --2- 172.21.15.96:0/1777254252 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcabc066980 0x7fcabc068e40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0ae000 tx=0x7fcacc0a7070 comp rx=0 tx=0).stop 2024-04-18T04:54:50.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.811+0000 7fcadae67640 1 -- 172.21.15.96:0/1777254252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad41578f0 msgr2=0x7fcad40c4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.811+0000 7fcadae67640 1 --2- 172.21.15.96:0/1777254252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad41578f0 0x7fcad40c4060 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcac400b440 tx=0x7fcac400b900 comp rx=0 tx=0).stop 2024-04-18T04:54:50.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.811+0000 7fcadae67640 1 -- 172.21.15.96:0/1777254252 shutdown_connections 2024-04-18T04:54:50.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.811+0000 7fcadae67640 1 --2- 172.21.15.96:0/1777254252 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcabc066980 0x7fcabc068e40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.811+0000 7fcadae67640 1 --2- 172.21.15.96:0/1777254252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcad41578f0 0x7fcad40c4060 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.811+0000 7fcadae67640 1 --2- 172.21.15.96:0/1777254252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcad4157510 0x7fcad40c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.811+0000 7fcadae67640 1 --2- 172.21.15.96:0/1777254252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcad40700a0 0x7fcad415f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.811+0000 7fcadae67640 1 -- 172.21.15.96:0/1777254252 >> 172.21.15.96:0/1777254252 conn(0x7fcad406a8e0 msgr2=0x7fcad4152a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:50.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.811+0000 7fcadae67640 1 -- 172.21.15.96:0/1777254252 shutdown_connections 2024-04-18T04:54:50.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.811+0000 7fcadae67640 1 -- 172.21.15.96:0/1777254252 wait complete. 2024-04-18T04:54:50.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.3 2024-04-18T04:54:50.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.859+0000 7f01ada7a640 1 -- 172.21.15.96:0/2593471444 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f01880050d0 con 0x7f01a80c9830 2024-04-18T04:54:50.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.859+0000 7f018ffff640 1 -- 172.21.15.96:0/2593471444 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f019c007e60 con 0x7f01a80c9830 2024-04-18T04:54:50.860 INFO:teuthology.orchestra.run.smithi096.stdout:64424509444 2024-04-18T04:54:50.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.863+0000 7f01ada7a640 1 -- 172.21.15.96:0/2593471444 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f01940666e0 msgr2=0x7f0194068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.863+0000 7f01ada7a640 1 --2- 172.21.15.96:0/2593471444 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f01940666e0 0x7f0194068ba0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0198009970 tx=0x7f0198009190 comp rx=0 tx=0).stop 2024-04-18T04:54:50.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.863+0000 7f01ada7a640 1 -- 172.21.15.96:0/2593471444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01a80c9830 msgr2=0x7f01a8154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.863+0000 7f01ada7a640 1 --2- 172.21.15.96:0/2593471444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01a80c9830 0x7f01a8154540 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f019c00faf0 tx=0x7f019c005790 comp rx=0 tx=0).stop 2024-04-18T04:54:50.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.863+0000 7f01ada7a640 1 -- 172.21.15.96:0/2593471444 shutdown_connections 2024-04-18T04:54:50.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.863+0000 7f01ada7a640 1 --2- 172.21.15.96:0/2593471444 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f01940666e0 0x7f0194068ba0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.863+0000 7f01ada7a640 1 --2- 172.21.15.96:0/2593471444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01a80c9830 0x7f01a8154540 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.863+0000 7f01ada7a640 1 --2- 172.21.15.96:0/2593471444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a814f060 0x7f01a8154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.863+0000 7f01ada7a640 1 --2- 172.21.15.96:0/2593471444 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f01a8070720 0x7f01a81486d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.863+0000 7f01ada7a640 1 -- 172.21.15.96:0/2593471444 >> 172.21.15.96:0/2593471444 conn(0x7f01a8069e60 msgr2=0x7f01a80c8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:50.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.863+0000 7f01ada7a640 1 -- 172.21.15.96:0/2593471444 shutdown_connections 2024-04-18T04:54:50.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.863+0000 7f01ada7a640 1 -- 172.21.15.96:0/2593471444 wait complete. 2024-04-18T04:54:50.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.863+0000 7ff7e56c1640 1 -- 172.21.15.96:0/1977588223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff7c0005510 con 0x7ff7d80e71c0 2024-04-18T04:54:50.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.863+0000 7ff7dcff9640 1 -- 172.21.15.96:0/1977588223 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff7e0099020 con 0x7ff7d80e71c0 2024-04-18T04:54:50.866 INFO:teuthology.orchestra.run.smithi096.stdout:55834574852 2024-04-18T04:54:50.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.867+0000 7ff7e56c1640 1 -- 172.21.15.96:0/1977588223 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff7c4066710 msgr2=0x7ff7c4068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.867+0000 7ff7e56c1640 1 --2- 172.21.15.96:0/1977588223 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff7c4066710 0x7ff7c4068bd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0b2000 tx=0x7ff7cc008040 comp rx=0 tx=0).stop 2024-04-18T04:54:50.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.867+0000 7ff7e56c1640 1 -- 172.21.15.96:0/1977588223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7d80e71c0 msgr2=0x7ff7d8047e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.867+0000 7ff7e56c1640 1 --2- 172.21.15.96:0/1977588223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7d80e71c0 0x7ff7d8047e80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff7e002c920 tx=0x7ff7e00742e0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.867+0000 7ff7e56c1640 1 -- 172.21.15.96:0/1977588223 shutdown_connections 2024-04-18T04:54:50.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.867+0000 7ff7e56c1640 1 --2- 172.21.15.96:0/1977588223 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff7c4066710 0x7ff7c4068bd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.867+0000 7ff7e56c1640 1 --2- 172.21.15.96:0/1977588223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7d80e71c0 0x7ff7d8047e80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.867+0000 7ff7e56c1640 1 --2- 172.21.15.96:0/1977588223 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff7d80e6c00 0x7ff7d80e5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.867+0000 7ff7e56c1640 1 --2- 172.21.15.96:0/1977588223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7d80dd290 0x7ff7d80c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.867+0000 7ff7e56c1640 1 -- 172.21.15.96:0/1977588223 >> 172.21.15.96:0/1977588223 conn(0x7ff7d8050160 msgr2=0x7ff7d80dc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:50.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.867+0000 7ff7e56c1640 1 -- 172.21.15.96:0/1977588223 shutdown_connections 2024-04-18T04:54:50.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.867+0000 7ff7e56c1640 1 -- 172.21.15.96:0/1977588223 wait complete. 2024-04-18T04:54:50.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.7 2024-04-18T04:54:50.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.2 2024-04-18T04:54:50.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.891+0000 7fddeaed1640 1 -- 172.21.15.96:0/1902299780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fdddc0057c0 con 0x7fdddc047850 2024-04-18T04:54:50.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.895+0000 7fddda7fc640 1 -- 172.21.15.96:0/1902299780 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdde4137030 con 0x7fdddc047850 2024-04-18T04:54:50.895 INFO:teuthology.orchestra.run.smithi096.stdout:64424509443 2024-04-18T04:54:50.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.895+0000 7fddeaed1640 1 -- 172.21.15.96:0/1902299780 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fddc8066690 msgr2=0x7fddc8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.895+0000 7fddeaed1640 1 --2- 172.21.15.96:0/1902299780 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fddc8066690 0x7fddc8068b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdddc0dfaa0 tx=0x7fdde0009040 comp rx=0 tx=0).stop 2024-04-18T04:54:50.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.895+0000 7fddeaed1640 1 -- 172.21.15.96:0/1902299780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdddc047850 msgr2=0x7fdddc0db0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.895+0000 7fddeaed1640 1 --2- 172.21.15.96:0/1902299780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdddc047850 0x7fdddc0db0f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdde4069a00 tx=0x7fdde40938f0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.895+0000 7fddeaed1640 1 -- 172.21.15.96:0/1902299780 shutdown_connections 2024-04-18T04:54:50.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.895+0000 7fddeaed1640 1 --2- 172.21.15.96:0/1902299780 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fddc8066690 0x7fddc8068b50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.895+0000 7fddeaed1640 1 --2- 172.21.15.96:0/1902299780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdddc0dcb10 0x7fdddc0d8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.895+0000 7fddeaed1640 1 --2- 172.21.15.96:0/1902299780 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdddc0d6d90 0x7fdddc0df190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.895+0000 7fddeaed1640 1 --2- 172.21.15.96:0/1902299780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdddc047850 0x7fdddc0db0f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.895+0000 7fddeaed1640 1 -- 172.21.15.96:0/1902299780 >> 172.21.15.96:0/1902299780 conn(0x7fdddc00e060 msgr2=0x7fdddc04d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:50.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.895+0000 7fddeaed1640 1 -- 172.21.15.96:0/1902299780 shutdown_connections 2024-04-18T04:54:50.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.895+0000 7fddeaed1640 1 -- 172.21.15.96:0/1902299780 wait complete. 2024-04-18T04:54:50.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.911+0000 7f2d23fff640 1 -- 172.21.15.96:0/2275692392 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2d040057e0 con 0x7f2d1c047250 2024-04-18T04:54:50.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.5 2024-04-18T04:54:50.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.911+0000 7f2d0b7fe640 1 -- 172.21.15.96:0/2275692392 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2d1401e020 con 0x7f2d1c047250 2024-04-18T04:54:50.912 INFO:teuthology.orchestra.run.smithi096.stdout:64424509444 2024-04-18T04:54:50.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.911+0000 7f71ab176640 1 -- 172.21.15.96:0/103365629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f71a41642b0 con 0x7f71a4201b60 2024-04-18T04:54:50.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.911+0000 7f71a17fa640 1 -- 172.21.15.96:0/103365629 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7190100a90 con 0x7f71a4201b60 2024-04-18T04:54:50.914 INFO:teuthology.orchestra.run.smithi096.stdout:64424509445 2024-04-18T04:54:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.911+0000 7f2d23fff640 1 -- 172.21.15.96:0/2275692392 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2d100666e0 msgr2=0x7f2d10068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.911+0000 7f2d23fff640 1 --2- 172.21.15.96:0/2275692392 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2d100666e0 0x7f2d10068ba0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0d68b0 tx=0x7f2d18009040 comp rx=0 tx=0).stop 2024-04-18T04:54:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.911+0000 7f2d23fff640 1 -- 172.21.15.96:0/2275692392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d1c047250 msgr2=0x7f2d1c0c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.911+0000 7f2d23fff640 1 --2- 172.21.15.96:0/2275692392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d1c047250 0x7f2d1c0c7bb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400b550 tx=0x7f2d1400ba10 comp rx=0 tx=0).stop 2024-04-18T04:54:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.911+0000 7f2d23fff640 1 -- 172.21.15.96:0/2275692392 shutdown_connections 2024-04-18T04:54:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.911+0000 7f2d23fff640 1 --2- 172.21.15.96:0/2275692392 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2d100666e0 0x7f2d10068ba0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.911+0000 7f2d23fff640 1 --2- 172.21.15.96:0/2275692392 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d1c0d6e90 0x7f2d1c0d5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.911+0000 7f2d23fff640 1 --2- 172.21.15.96:0/2275692392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d1c047670 0x7f2d1c0dbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.911+0000 7f2d23fff640 1 --2- 172.21.15.96:0/2275692392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d1c047250 0x7f2d1c0c7bb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.911+0000 7f2d23fff640 1 -- 172.21.15.96:0/2275692392 >> 172.21.15.96:0/2275692392 conn(0x7f2d1c00e0a0 msgr2=0x7f2d1c04e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:50.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.911+0000 7f2d23fff640 1 -- 172.21.15.96:0/2275692392 shutdown_connections 2024-04-18T04:54:50.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.911+0000 7f2d23fff640 1 -- 172.21.15.96:0/2275692392 wait complete. 2024-04-18T04:54:50.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.915+0000 7f71ab176640 1 -- 172.21.15.96:0/103365629 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f71880666c0 msgr2=0x7f7188068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.915+0000 7f71ab176640 1 --2- 172.21.15.96:0/103365629 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f71880666c0 0x7f7188068b80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7198000fc0 tx=0x7f7198007900 comp rx=0 tx=0).stop 2024-04-18T04:54:50.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.915+0000 7f71ab176640 1 -- 172.21.15.96:0/103365629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71a4201b60 msgr2=0x7f71a4163260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.915+0000 7f71ab176640 1 --2- 172.21.15.96:0/103365629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71a4201b60 0x7f71a4163260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f719002d530 tx=0x7f719000d5a0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.915+0000 7f71ab176640 1 -- 172.21.15.96:0/103365629 shutdown_connections 2024-04-18T04:54:50.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.915+0000 7f71ab176640 1 --2- 172.21.15.96:0/103365629 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f71880666c0 0x7f7188068b80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.915+0000 7f71ab176640 1 --2- 172.21.15.96:0/103365629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71a40c8550 0x7f71a40c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.915+0000 7f71ab176640 1 --2- 172.21.15.96:0/103365629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71a4201b60 0x7f71a4163260 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.915+0000 7f71ab176640 1 --2- 172.21.15.96:0/103365629 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7194004510 0x7f71a4162d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.915+0000 7f71ab176640 1 -- 172.21.15.96:0/103365629 >> 172.21.15.96:0/103365629 conn(0x7f71a406a8e0 msgr2=0x7f71a406be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:50.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.915+0000 7f71ab176640 1 -- 172.21.15.96:0/103365629 shutdown_connections 2024-04-18T04:54:50.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.915+0000 7f71ab176640 1 -- 172.21.15.96:0/103365629 wait complete. 2024-04-18T04:54:50.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.6 2024-04-18T04:54:50.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.0 2024-04-18T04:54:50.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.939+0000 7f95a62cd640 1 -- 172.21.15.96:0/3824837676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f95980053a0 con 0x7f959804c6a0 2024-04-18T04:54:50.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.939+0000 7f959cff9640 1 -- 172.21.15.96:0/3824837676 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f958c01e070 con 0x7f959804c6a0 2024-04-18T04:54:50.941 INFO:teuthology.orchestra.run.smithi096.stdout:64424509443 2024-04-18T04:54:50.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.943+0000 7f95a62cd640 1 -- 172.21.15.96:0/3824837676 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9584066690 msgr2=0x7f9584068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.943+0000 7f95a62cd640 1 --2- 172.21.15.96:0/3824837676 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9584066690 0x7f9584068b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9594003ec0 tx=0x7f9594009040 comp rx=0 tx=0).stop 2024-04-18T04:54:50.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.943+0000 7f95a62cd640 1 -- 172.21.15.96:0/3824837676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f959804c6a0 msgr2=0x7f959817f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.943+0000 7f95a62cd640 1 --2- 172.21.15.96:0/3824837676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f959804c6a0 0x7f959817f7b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f958c00b4a0 tx=0x7f958c00b960 comp rx=0 tx=0).stop 2024-04-18T04:54:50.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.943+0000 7f95a62cd640 1 -- 172.21.15.96:0/3824837676 shutdown_connections 2024-04-18T04:54:50.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.943+0000 7f95a62cd640 1 --2- 172.21.15.96:0/3824837676 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9584066690 0x7f9584068b50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.943+0000 7f95a62cd640 1 --2- 172.21.15.96:0/3824837676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f95980dd4c0 0x7f959817fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.943+0000 7f95a62cd640 1 --2- 172.21.15.96:0/3824837676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f959804c6a0 0x7f959817f7b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.943+0000 7f95a62cd640 1 --2- 172.21.15.96:0/3824837676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9598045770 0x7f95980e3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.943+0000 7f95a62cd640 1 -- 172.21.15.96:0/3824837676 >> 172.21.15.96:0/3824837676 conn(0x7f9598050190 msgr2=0x7f95980d8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:50.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.943+0000 7f95a62cd640 1 -- 172.21.15.96:0/3824837676 shutdown_connections 2024-04-18T04:54:50.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.943+0000 7f95a62cd640 1 -- 172.21.15.96:0/3824837676 wait complete. 2024-04-18T04:54:50.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.1 2024-04-18T04:54:50.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.967+0000 7fa705839640 1 -- 172.21.15.96:0/1050635251 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa6e0005510 con 0x7fa7000cda80 2024-04-18T04:54:50.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.967+0000 7fa6fd7fa640 1 -- 172.21.15.96:0/1050635251 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa6f8051d40 con 0x7fa7000cda80 2024-04-18T04:54:50.970 INFO:teuthology.orchestra.run.smithi096.stdout:55834574852 2024-04-18T04:54:50.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.971+0000 7fa705839640 1 -- 172.21.15.96:0/1050635251 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa6ec066690 msgr2=0x7fa6ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.971+0000 7fa705839640 1 --2- 172.21.15.96:0/1050635251 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa6ec066690 0x7fa6ec068b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00080e0 tx=0x7fa6f00ab000 comp rx=0 tx=0).stop 2024-04-18T04:54:50.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.971+0000 7fa705839640 1 -- 172.21.15.96:0/1050635251 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7000cda80 msgr2=0x7fa7001fe850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:50.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.971+0000 7fa705839640 1 --2- 172.21.15.96:0/1050635251 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7000cda80 0x7fa7001fe850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8007d60 tx=0x7fa6f8010530 comp rx=0 tx=0).stop 2024-04-18T04:54:50.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.971+0000 7fa705839640 1 -- 172.21.15.96:0/1050635251 shutdown_connections 2024-04-18T04:54:50.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.971+0000 7fa705839640 1 --2- 172.21.15.96:0/1050635251 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa6ec066690 0x7fa6ec068b50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.971+0000 7fa705839640 1 --2- 172.21.15.96:0/1050635251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa700158230 0x7fa7001fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.971+0000 7fa705839640 1 --2- 172.21.15.96:0/1050635251 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7000cda80 0x7fa7001fe850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.971+0000 7fa705839640 1 --2- 172.21.15.96:0/1050635251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7000cd6a0 0x7fa70013fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:50.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.971+0000 7fa705839640 1 -- 172.21.15.96:0/1050635251 >> 172.21.15.96:0/1050635251 conn(0x7fa700065bc0 msgr2=0x7fa7001550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:50.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.971+0000 7fa705839640 1 -- 172.21.15.96:0/1050635251 shutdown_connections 2024-04-18T04:54:50.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:50.971+0000 7fa705839640 1 -- 172.21.15.96:0/1050635251 wait complete. 2024-04-18T04:54:50.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.4 2024-04-18T04:54:51.836 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T04:54:51.890 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-18T04:54:51.893 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T04:54:51.913 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-18T04:54:51.939 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-18T04:54:51.941 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T04:54:51.959 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T04:54:51.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.959+0000 7f92d089c640 1 Processor -- start 2024-04-18T04:54:51.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.959+0000 7f92d089c640 1 -- start start 2024-04-18T04:54:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.959+0000 7f92d089c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f92cc150bf0 0x7f92cc0c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.959+0000 7f92d089c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f92cc06cc30 0x7f92cc156f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.959+0000 7f92d089c640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92cc0c56b0 con 0x7f92cc06d460 2024-04-18T04:54:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.959+0000 7f92d089c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92cc0c5000 con 0x7f92cc150bf0 2024-04-18T04:54:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.959+0000 7f92d089c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0c68c0 con 0x7f92cc06cc30 2024-04-18T04:54:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.959+0000 7f92ca59c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f92cc150bf0 0x7f92cc0c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.959+0000 7f92ca59c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f92cc150bf0 0x7f92cc0c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38778/0 (socket says 172.21.15.96:38778) 2024-04-18T04:54:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.959+0000 7f92ca59c640 1 -- 172.21.15.96:0/2287046546 learned_addr learned my addr 172.21.15.96:0/2287046546 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:51.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.959+0000 7f92ca59c640 1 -- 172.21.15.96:0/2287046546 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f92cc06cc30 msgr2=0x7f92cc156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:51.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.959+0000 7f92cad9d640 1 --2- 172.21.15.96:0/2287046546 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f92cc06cc30 0x7f92cc156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:51.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.959+0000 7f92ca59c640 1 --2- 172.21.15.96:0/2287046546 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f92cc06cc30 0x7f92cc156f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:51.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.959+0000 7f92ca59c640 1 -- 172.21.15.96:0/2287046546 >> v1:172.21.15.139:6789/0 conn(0x7f92cc06d460 legacy=0x7f92cc06ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:51.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.959+0000 7f92ca59c640 1 -- 172.21.15.96:0/2287046546 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc0c6ba0 con 0x7f92cc150bf0 2024-04-18T04:54:51.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.963+0000 7f92ca59c640 1 --2- 172.21.15.96:0/2287046546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92cc150bf0 0x7f92cc0c49e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009870 tx=0x7f92bc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46fa467e966c29e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:51.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.963+0000 7f92c959a640 1 -- 172.21.15.96:0/2287046546 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0aa610 con 0x7f92cc150bf0 2024-04-18T04:54:51.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.963+0000 7f92c959a640 1 -- 172.21.15.96:0/2287046546 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc0a6040 con 0x7f92cc150bf0 2024-04-18T04:54:51.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.963+0000 7f92c959a640 1 -- 172.21.15.96:0/2287046546 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0aa990 con 0x7f92cc150bf0 2024-04-18T04:54:51.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.967+0000 7f92d089c640 1 -- 172.21.15.96:0/2287046546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92cc150bf0 msgr2=0x7f92cc0c49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:51.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.967+0000 7f92d089c640 1 --2- 172.21.15.96:0/2287046546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92cc150bf0 0x7f92cc0c49e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009870 tx=0x7f92bc01c4f0 comp rx=0 tx=0).stop 2024-04-18T04:54:51.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.967+0000 7f92d089c640 1 -- 172.21.15.96:0/2287046546 shutdown_connections 2024-04-18T04:54:51.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.967+0000 7f92d089c640 1 --2- 172.21.15.96:0/2287046546 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f92cc06cc30 0x7f92cc156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:51.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.967+0000 7f92d089c640 1 --2- 172.21.15.96:0/2287046546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92cc150bf0 0x7f92cc0c49e0 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009870 tx=0x7f92bc01c4f0 comp rx=0 tx=0).stop 2024-04-18T04:54:51.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.967+0000 7f92d089c640 1 -- 172.21.15.96:0/2287046546 >> 172.21.15.96:0/2287046546 conn(0x7f92cc0cb570 msgr2=0x7f92cc0c76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:51.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.967+0000 7f92d089c640 1 -- 172.21.15.96:0/2287046546 shutdown_connections 2024-04-18T04:54:51.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.967+0000 7f92d089c640 1 -- 172.21.15.96:0/2287046546 wait complete. 2024-04-18T04:54:51.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.967+0000 7f92d089c640 1 Processor -- start 2024-04-18T04:54:51.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.967+0000 7f92d089c640 1 -- start start 2024-04-18T04:54:51.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92d089c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f92cc06cc30 0x7f92cc144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:51.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92d089c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92cc06d460 0x7f92cc0c0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:51.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92d089c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92cc151790 0x7f92cc156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:51.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92d089c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0c3d70 con 0x7f92cc06d460 2024-04-18T04:54:51.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92d089c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc1f6670 con 0x7f92cc151790 2024-04-18T04:54:51.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92d089c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0c4010 con 0x7f92cc06cc30 2024-04-18T04:54:51.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92c9d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92cc06d460 0x7f92cc0c0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:51.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92c9d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92cc06d460 0x7f92cc0c0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38790/0 (socket says 172.21.15.96:38790) 2024-04-18T04:54:51.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92c9d9b640 1 -- 172.21.15.96:0/2048075210 learned_addr learned my addr 172.21.15.96:0/2048075210 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:51.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92cad9d640 1 --2- 172.21.15.96:0/2048075210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92cc151790 0x7f92cc156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:51.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92cad9d640 1 -- 172.21.15.96:0/2048075210 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f92cc06cc30 msgr2=0x7f92cc144730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:54:51.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92cad9d640 1 --2- 172.21.15.96:0/2048075210 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f92cc06cc30 0x7f92cc144730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:51.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92cad9d640 1 -- 172.21.15.96:0/2048075210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92cc06d460 msgr2=0x7f92cc0c0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:51.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92cad9d640 1 --2- 172.21.15.96:0/2048075210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92cc06d460 0x7f92cc0c0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:51.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92cad9d640 1 -- 172.21.15.96:0/2048075210 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc0094d0 con 0x7f92cc151790 2024-04-18T04:54:51.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92c9d9b640 1 --2- 172.21.15.96:0/2048075210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92cc06d460 0x7f92cc0c0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:54:51.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92cad9d640 1 --2- 172.21.15.96:0/2048075210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92cc151790 0x7f92cc156100 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f92c400ccb0 tx=0x7f92c400a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:51.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92baffd640 1 -- 172.21.15.96:0/2048075210 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4003ba0 con 0x7f92cc151790 2024-04-18T04:54:51.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92d089c640 1 -- 172.21.15.96:0/2048075210 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92cc1f6950 con 0x7f92cc151790 2024-04-18T04:54:51.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92d089c640 1 -- 172.21.15.96:0/2048075210 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92cc0c1460 con 0x7f92cc151790 2024-04-18T04:54:51.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92baffd640 1 -- 172.21.15.96:0/2048075210 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c400ae90 con 0x7f92cc151790 2024-04-18T04:54:51.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92baffd640 1 -- 172.21.15.96:0/2048075210 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4004020 con 0x7f92cc151790 2024-04-18T04:54:51.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.971+0000 7f92d089c640 1 -- 172.21.15.96:0/2048075210 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b0005260 con 0x7f92cc151790 2024-04-18T04:54:51.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.975+0000 7f92baffd640 1 -- 172.21.15.96:0/2048075210 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f92c4004180 con 0x7f92cc151790 2024-04-18T04:54:51.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.975+0000 7f92baffd640 1 --2- 172.21.15.96:0/2048075210 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f92ac0666c0 0x7f92ac068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:51.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.975+0000 7f92baffd640 1 -- 172.21.15.96:0/2048075210 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92c4012070 con 0x7f92cc151790 2024-04-18T04:54:51.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.975+0000 7f92ca59c640 1 --2- 172.21.15.96:0/2048075210 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f92ac0666c0 0x7f92ac068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:51.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.975+0000 7f92ca59c640 1 --2- 172.21.15.96:0/2048075210 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f92ac0666c0 0x7f92ac068b80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0ae000 tx=0x7f92bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:51.987 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-18T04:54:51.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:51.987+0000 7f92baffd640 1 -- 172.21.15.96:0/2048075210 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f92c4052340 con 0x7f92cc151790 2024-04-18T04:54:52.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.031+0000 7fd6e3717640 1 Processor -- start 2024-04-18T04:54:52.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.031+0000 7fd6e3717640 1 -- start start 2024-04-18T04:54:52.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.035+0000 7fd6e3717640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd6dc0701e0 0x7fd6dc070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.035+0000 7fd6e3717640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6dc154c60 0x7fd6dc155090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.035+0000 7fd6e3717640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6dc14f440 con 0x7fd6dc14f060 2024-04-18T04:54:52.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.035+0000 7fd6e3717640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc0c2340 con 0x7fd6dc0701e0 2024-04-18T04:54:52.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.035+0000 7fd6e3717640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc158f50 con 0x7fd6dc154c60 2024-04-18T04:54:52.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.035+0000 7fd6e0cb2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd6dc0701e0 0x7fd6dc070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.035+0000 7fd6e0cb2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd6dc0701e0 0x7fd6dc070670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38796/0 (socket says 172.21.15.96:38796) 2024-04-18T04:54:52.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.035+0000 7fd6e0cb2640 1 -- 172.21.15.96:0/4091298996 learned_addr learned my addr 172.21.15.96:0/4091298996 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:52.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.035+0000 7fd6e0cb2640 1 -- 172.21.15.96:0/4091298996 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6dc154c60 msgr2=0x7fd6dc155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:52.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.035+0000 7fd6e0cb2640 1 --2- 172.21.15.96:0/4091298996 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6dc154c60 0x7fd6dc155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.035+0000 7fd6e0cb2640 1 -- 172.21.15.96:0/4091298996 >> v1:172.21.15.96:6789/0 conn(0x7fd6dc14f060 legacy=0x7fd6dc0c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:52.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.035+0000 7fd6e0cb2640 1 -- 172.21.15.96:0/4091298996 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc070bb0 con 0x7fd6dc0701e0 2024-04-18T04:54:52.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.039+0000 7fd6e0cb2640 1 --2- 172.21.15.96:0/4091298996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6dc0701e0 0x7fd6dc070670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc072480 tx=0x7fd6d401eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5878788338b82e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.039+0000 7fd6d3fff640 1 -- 172.21.15.96:0/4091298996 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40a7c90 con 0x7fd6dc0701e0 2024-04-18T04:54:52.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.039+0000 7fd6d3fff640 1 -- 172.21.15.96:0/4091298996 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d40a7df0 con 0x7fd6dc0701e0 2024-04-18T04:54:52.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.039+0000 7fd6e3717640 1 -- 172.21.15.96:0/4091298996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6dc0701e0 msgr2=0x7fd6dc070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.039+0000 7fd6e3717640 1 --2- 172.21.15.96:0/4091298996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6dc0701e0 0x7fd6dc070670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc072480 tx=0x7fd6d401eef0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.039+0000 7fd6e3717640 1 -- 172.21.15.96:0/4091298996 shutdown_connections 2024-04-18T04:54:52.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.039+0000 7fd6e3717640 1 --2- 172.21.15.96:0/4091298996 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6dc154c60 0x7fd6dc155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.039+0000 7fd6e3717640 1 --2- 172.21.15.96:0/4091298996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6dc0701e0 0x7fd6dc070670 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.039+0000 7fd6e3717640 1 -- 172.21.15.96:0/4091298996 >> 172.21.15.96:0/4091298996 conn(0x7fd6dc069e60 msgr2=0x7fd6dc06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.043+0000 7fd6e3717640 1 -- 172.21.15.96:0/4091298996 shutdown_connections 2024-04-18T04:54:52.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.043+0000 7fd6e3717640 1 -- 172.21.15.96:0/4091298996 wait complete. 2024-04-18T04:54:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.043+0000 7fd6e3717640 1 Processor -- start 2024-04-18T04:54:52.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.043+0000 7fd6e3717640 1 -- start start 2024-04-18T04:54:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.043+0000 7fd6e3717640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6dc0701e0 0x7fd6dc13bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.043+0000 7fd6e3717640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6dc14f060 0x7fd6dc153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.043+0000 7fd6e3717640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6dc154c60 0x7fd6dc154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.043+0000 7fd6e3717640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc1f6420 con 0x7fd6dc0701e0 2024-04-18T04:54:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.043+0000 7fd6e3717640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc1f5590 con 0x7fd6dc14f060 2024-04-18T04:54:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.043+0000 7fd6e3717640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc13c4b0 con 0x7fd6dc154c60 2024-04-18T04:54:52.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.043+0000 7fd6e1cb4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6dc154c60 0x7fd6dc154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.043+0000 7fd6e14b3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6dc0701e0 0x7fd6dc13bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.043+0000 7fd6e14b3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6dc0701e0 0x7fd6dc13bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38806/0 (socket says 172.21.15.96:38806) 2024-04-18T04:54:52.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.043+0000 7fd6e14b3640 1 -- 172.21.15.96:0/989060316 learned_addr learned my addr 172.21.15.96:0/989060316 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:52.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.043+0000 7fd6e0cb2640 1 --2- 172.21.15.96:0/989060316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6dc14f060 0x7fd6dc153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.047+0000 7fd6e0cb2640 1 -- 172.21.15.96:0/989060316 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6dc154c60 msgr2=0x7fd6dc154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.047+0000 7fd6e0cb2640 1 --2- 172.21.15.96:0/989060316 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6dc154c60 0x7fd6dc154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.047+0000 7fd6e0cb2640 1 -- 172.21.15.96:0/989060316 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6dc0701e0 msgr2=0x7fd6dc13bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.047+0000 7fd6e0cb2640 1 --2- 172.21.15.96:0/989060316 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6dc0701e0 0x7fd6dc13bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.047+0000 7fd6e0cb2640 1 -- 172.21.15.96:0/989060316 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d400c3d0 con 0x7fd6dc14f060 2024-04-18T04:54:52.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.047+0000 7fd6e0cb2640 1 --2- 172.21.15.96:0/989060316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6dc14f060 0x7fd6dc153c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0cb3c0 tx=0x7fd6d401bc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.047+0000 7fd6d1ffb640 1 -- 172.21.15.96:0/989060316 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40102b0 con 0x7fd6dc14f060 2024-04-18T04:54:52.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.047+0000 7fd6e3717640 1 -- 172.21.15.96:0/989060316 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc156ae0 con 0x7fd6dc14f060 2024-04-18T04:54:52.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.047+0000 7fd6e3717640 1 -- 172.21.15.96:0/989060316 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6dc1f5a80 con 0x7fd6dc14f060 2024-04-18T04:54:52.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.047+0000 7fd6d1ffb640 1 -- 172.21.15.96:0/989060316 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d40af610 con 0x7fd6dc14f060 2024-04-18T04:54:52.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.047+0000 7fd6d1ffb640 1 -- 172.21.15.96:0/989060316 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4010410 con 0x7fd6dc14f060 2024-04-18T04:54:52.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.047+0000 7fd6e3717640 1 -- 172.21.15.96:0/989060316 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6bc005260 con 0x7fd6dc14f060 2024-04-18T04:54:52.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.051+0000 7fd6d1ffb640 1 -- 172.21.15.96:0/989060316 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd6d400e430 con 0x7fd6dc14f060 2024-04-18T04:54:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.051+0000 7fd6d1ffb640 1 --2- 172.21.15.96:0/989060316 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd6c0066690 0x7fd6c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.051+0000 7fd6d1ffb640 1 -- 172.21.15.96:0/989060316 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6d411eb50 con 0x7fd6dc14f060 2024-04-18T04:54:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.051+0000 7fd6e14b3640 1 --2- 172.21.15.96:0/989060316 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd6c0066690 0x7fd6c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.051+0000 7fd6e14b3640 1 --2- 172.21.15.96:0/989060316 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd6c0066690 0x7fd6c0068b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0050b0 tx=0x7fd6cc003700 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.063+0000 7fd6d1ffb640 1 -- 172.21.15.96:0/989060316 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd6d40ec010 con 0x7fd6dc14f060 2024-04-18T04:54:52.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.095+0000 7f490ba4c640 1 Processor -- start 2024-04-18T04:54:52.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.095+0000 7f490ba4c640 1 -- start start 2024-04-18T04:54:52.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f490ba4c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f490414f170 0x7f49040c5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f490ba4c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49041590c0 con 0x7f49040c2a60 2024-04-18T04:54:52.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f490ba4c640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49040c5ae0 con 0x7f4904155830 2024-04-18T04:54:52.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f490ba4c640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490414f550 con 0x7f490414f170 2024-04-18T04:54:52.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f4909fe9640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f49040c2a60 0x7f49040c2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46382/0 (socket says 172.21.15.96:46382) 2024-04-18T04:54:52.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f4909fe9640 1 -- 172.21.15.96:0/2814962962 learned_addr learned my addr 172.21.15.96:0/2814962962 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:52.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f49097e8640 1 --2- 172.21.15.96:0/2814962962 >> v2:172.21.15.139:3300/0 conn(0x7f490414f170 0x7f49040c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f48fbfff640 1 -- 172.21.15.96:0/2814962962 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201074145 0 0) 0x7f49041590c0 con 0x7f49040c2a60 2024-04-18T04:54:52.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f48fbfff640 1 -- 172.21.15.96:0/2814962962 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48f0003530 con 0x7f49040c2a60 2024-04-18T04:54:52.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f3f8d4c2640 1 Processor -- start 2024-04-18T04:54:52.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f49097e8640 1 -- 172.21.15.96:0/2814962962 >> v1:172.21.15.139:6789/0 conn(0x7f4904155830 legacy=0x7f490406b9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:54:52.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f49097e8640 1 -- 172.21.15.96:0/2814962962 >> v1:172.21.15.96:6789/0 conn(0x7f49040c2a60 legacy=0x7f49040c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f49097e8640 1 -- 172.21.15.96:0/2814962962 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49041584b0 con 0x7f490414f170 2024-04-18T04:54:52.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f3f8d4c2640 1 -- start start 2024-04-18T04:54:52.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f3f8d4c2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3f881578f0 0x7f3f8806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f3f8d4c2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8815d6f0 con 0x7f3f88157510 2024-04-18T04:54:52.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f3f8d4c2640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f880705f0 con 0x7f3f88070180 2024-04-18T04:54:52.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.099+0000 7f3f8d4c2640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8815d3a0 con 0x7f3f881578f0 2024-04-18T04:54:52.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f3f86ffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f3f88157510 0x7f3f880c6590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46386/0 (socket says 172.21.15.96:46386) 2024-04-18T04:54:52.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f3f86ffd640 1 -- 172.21.15.96:0/3548238260 learned_addr learned my addr 172.21.15.96:0/3548238260 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:52.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f3f877fe640 1 --2- 172.21.15.96:0/3548238260 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3f881578f0 0x7f3f8806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f3f85ffb640 1 -- 172.21.15.96:0/3548238260 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818974902 0 0) 0x7f3f880705f0 con 0x7f3f88070180 2024-04-18T04:54:52.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f3f85ffb640 1 -- 172.21.15.96:0/3548238260 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f70003530 con 0x7f3f88070180 2024-04-18T04:54:52.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f49097e8640 1 --2- 172.21.15.96:0/2814962962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f490414f170 0x7f49040c5500 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f490000a8c0 tx=0x7f490001d4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c69c54d3689bda4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f48fbfff640 1 -- 172.21.15.96:0/2814962962 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49000ab640 con 0x7f490414f170 2024-04-18T04:54:52.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f48fbfff640 1 -- 172.21.15.96:0/2814962962 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49000ab7a0 con 0x7f490414f170 2024-04-18T04:54:52.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f490ba4c640 1 -- 172.21.15.96:0/2814962962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f490414f170 msgr2=0x7f49040c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f490ba4c640 1 --2- 172.21.15.96:0/2814962962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f490414f170 0x7f49040c5500 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f490000a8c0 tx=0x7f490001d4f0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f490ba4c640 1 -- 172.21.15.96:0/2814962962 shutdown_connections 2024-04-18T04:54:52.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f490ba4c640 1 --2- 172.21.15.96:0/2814962962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f490414f170 0x7f49040c5500 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f490ba4c640 1 -- 172.21.15.96:0/2814962962 >> 172.21.15.96:0/2814962962 conn(0x7f490406a8e0 msgr2=0x7f49040c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f490ba4c640 1 -- 172.21.15.96:0/2814962962 shutdown_connections 2024-04-18T04:54:52.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f3f877fe640 1 -- 172.21.15.96:0/3548238260 >> v1:172.21.15.139:6789/0 conn(0x7f3f88070180 legacy=0x7f3f8815db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f3f877fe640 1 -- 172.21.15.96:0/3548238260 >> v1:172.21.15.96:6789/0 conn(0x7f3f88157510 legacy=0x7f3f880c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f3f877fe640 1 -- 172.21.15.96:0/3548238260 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f88160ef0 con 0x7f3f881578f0 2024-04-18T04:54:52.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f3f877fe640 1 --2- 172.21.15.96:0/3548238260 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3f881578f0 0x7f3f8806b9e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0097f0 tx=0x7f3f7c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25d21532ef93e3d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f3f85ffb640 1 -- 172.21.15.96:0/3548238260 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c0ab600 con 0x7f3f881578f0 2024-04-18T04:54:52.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f3f85ffb640 1 -- 172.21.15.96:0/3548238260 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c0a7050 con 0x7f3f881578f0 2024-04-18T04:54:52.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f3f85ffb640 1 -- 172.21.15.96:0/3548238260 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c0ab960 con 0x7f3f881578f0 2024-04-18T04:54:52.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.103+0000 7f490ba4c640 1 -- 172.21.15.96:0/2814962962 wait complete. 2024-04-18T04:54:52.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f490ba4c640 1 Processor -- start 2024-04-18T04:54:52.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f3f8d4c2640 1 -- 172.21.15.96:0/3548238260 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3f881578f0 msgr2=0x7f3f8806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f3f8d4c2640 1 --2- 172.21.15.96:0/3548238260 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3f881578f0 0x7f3f8806b9e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0097f0 tx=0x7f3f7c01c3e0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f3f8d4c2640 1 -- 172.21.15.96:0/3548238260 shutdown_connections 2024-04-18T04:54:52.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f3f8d4c2640 1 --2- 172.21.15.96:0/3548238260 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3f881578f0 0x7f3f8806b9e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f3f8d4c2640 1 -- 172.21.15.96:0/3548238260 >> 172.21.15.96:0/3548238260 conn(0x7f3f8806a8e0 msgr2=0x7f3f880c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f3f8d4c2640 1 -- 172.21.15.96:0/3548238260 shutdown_connections 2024-04-18T04:54:52.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f3f8d4c2640 1 -- 172.21.15.96:0/3548238260 wait complete. 2024-04-18T04:54:52.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f490ba4c640 1 -- start start 2024-04-18T04:54:52.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f490ba4c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49040c2a60 0x7f49041479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f490ba4c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f490414f170 0x7f4904147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f490ba4c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4904155830 0x7f49041f70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f490ba4c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49041f6590 con 0x7f4904155830 2024-04-18T04:54:52.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f490ba4c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49041f6c10 con 0x7f49040c2a60 2024-04-18T04:54:52.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f490ba4c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49041f62b0 con 0x7f490414f170 2024-04-18T04:54:52.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f4908fe7640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f490414f170 0x7f4904147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f4908fe7640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f490414f170 0x7f4904147f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:55244/0 (socket says 172.21.15.96:55244) 2024-04-18T04:54:52.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f4908fe7640 1 -- 172.21.15.96:0/672252275 learned_addr learned my addr 172.21.15.96:0/672252275 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:52.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f49097e8640 1 --2- 172.21.15.96:0/672252275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49040c2a60 0x7f49041479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f4909fe9640 1 --2- 172.21.15.96:0/672252275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4904155830 0x7f49041f70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f4908fe7640 1 -- 172.21.15.96:0/672252275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49040c2a60 msgr2=0x7f49041479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.107+0000 7f4908fe7640 1 --2- 172.21.15.96:0/672252275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49040c2a60 0x7f49041479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f4908fe7640 1 -- 172.21.15.96:0/672252275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4904155830 msgr2=0x7f49041f70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f4908fe7640 1 --2- 172.21.15.96:0/672252275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4904155830 0x7f49041f70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f4908fe7640 1 -- 172.21.15.96:0/672252275 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490000a520 con 0x7f490414f170 2024-04-18T04:54:52.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f8d4c2640 1 Processor -- start 2024-04-18T04:54:52.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f4908fe7640 1 --2- 172.21.15.96:0/672252275 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f490414f170 0x7f4904147f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f48f400b410 tx=0x7f48f400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f48f9ffb640 1 -- 172.21.15.96:0/672252275 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4011830 con 0x7f490414f170 2024-04-18T04:54:52.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f48f9ffb640 1 -- 172.21.15.96:0/672252275 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f4011990 con 0x7f490414f170 2024-04-18T04:54:52.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f490ba4c640 1 -- 172.21.15.96:0/672252275 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490414bfb0 con 0x7f490414f170 2024-04-18T04:54:52.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f48f9ffb640 1 -- 172.21.15.96:0/672252275 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4011d40 con 0x7f490414f170 2024-04-18T04:54:52.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f490ba4c640 1 -- 172.21.15.96:0/672252275 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49041f5fa0 con 0x7f490414f170 2024-04-18T04:54:52.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f8d4c2640 1 -- start start 2024-04-18T04:54:52.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f8d4c2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f88070180 0x7f3f88158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f8d4c2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3f88157510 0x7f3f88146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f8d4c2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f881578f0 0x7f3f881f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f8d4c2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f88145220 con 0x7f3f88070180 2024-04-18T04:54:52.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f8d4c2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8815acf0 con 0x7f3f881578f0 2024-04-18T04:54:52.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f8d4c2640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f88158c40 con 0x7f3f88157510 2024-04-18T04:54:52.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f86ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f88070180 0x7f3f88158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f86ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f88070180 0x7f3f88158700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38828/0 (socket says 172.21.15.96:38828) 2024-04-18T04:54:52.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f86ffd640 1 -- 172.21.15.96:0/870220758 learned_addr learned my addr 172.21.15.96:0/870220758 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:52.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f877fe640 1 --2- 172.21.15.96:0/870220758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f881578f0 0x7f3f881f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f86ffd640 1 -- 172.21.15.96:0/870220758 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3f88157510 msgr2=0x7f3f88146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f86ffd640 1 --2- 172.21.15.96:0/870220758 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3f88157510 0x7f3f88146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f86ffd640 1 -- 172.21.15.96:0/870220758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f881578f0 msgr2=0x7f3f881f79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f86ffd640 1 --2- 172.21.15.96:0/870220758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f881578f0 0x7f3f881f79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f86ffd640 1 -- 172.21.15.96:0/870220758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c009420 con 0x7f3f88070180 2024-04-18T04:54:52.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f86ffd640 1 --2- 172.21.15.96:0/870220758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f88070180 0x7f3f88158700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000cbd0 tx=0x7f3f8000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f490ba4c640 1 -- 172.21.15.96:0/672252275 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49041f69e0 con 0x7f490414f170 2024-04-18T04:54:52.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f48f9ffb640 1 -- 172.21.15.96:0/672252275 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f48f401a400 con 0x7f490414f170 2024-04-18T04:54:52.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f6f7fe640 1 -- 172.21.15.96:0/870220758 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8000ad40 con 0x7f3f88070180 2024-04-18T04:54:52.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f6f7fe640 1 -- 172.21.15.96:0/870220758 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f80012400 con 0x7f3f88070180 2024-04-18T04:54:52.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f6f7fe640 1 -- 172.21.15.96:0/870220758 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8000aea0 con 0x7f3f88070180 2024-04-18T04:54:52.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f8d4c2640 1 -- 172.21.15.96:0/870220758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f88158eb0 con 0x7f3f88070180 2024-04-18T04:54:52.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.111+0000 7f3f8d4c2640 1 -- 172.21.15.96:0/870220758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8815a3c0 con 0x7f3f88070180 2024-04-18T04:54:52.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.115+0000 7f48f9ffb640 1 --2- 172.21.15.96:0/672252275 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f48e8066690 0x7f48e8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.115+0000 7f48f9ffb640 1 -- 172.21.15.96:0/672252275 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48f4084240 con 0x7f490414f170 2024-04-18T04:54:52.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.115+0000 7f49097e8640 1 --2- 172.21.15.96:0/672252275 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f48e8066690 0x7f48e8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.115+0000 7f49097e8640 1 --2- 172.21.15.96:0/672252275 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f48e8066690 0x7f48e8068b50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f49000af000 tx=0x7f4900009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.115+0000 7f3f6f7fe640 1 -- 172.21.15.96:0/870220758 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3f80012770 con 0x7f3f88070180 2024-04-18T04:54:52.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.115+0000 7f3f6f7fe640 1 --2- 172.21.15.96:0/870220758 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3f74066690 0x7f3f74068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.115+0000 7f3f6f7fe640 1 -- 172.21.15.96:0/870220758 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f80084250 con 0x7f3f88070180 2024-04-18T04:54:52.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.115+0000 7f3f867fc640 1 --2- 172.21.15.96:0/870220758 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3f74066690 0x7f3f74068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.115+0000 7f3f867fc640 1 --2- 172.21.15.96:0/870220758 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3f74066690 0x7f3f74068b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3f78007fd0 tx=0x7f3f78007960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.115+0000 7f3f8d4c2640 1 -- 172.21.15.96:0/870220758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f68005260 con 0x7f3f88070180 2024-04-18T04:54:52.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f48f9ffb640 1 -- 172.21.15.96:0/672252275 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f49041f69e0 con 0x7f490414f170 2024-04-18T04:54:52.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f3f6f7fe640 1 -- 172.21.15.96:0/870220758 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f3f80089060 con 0x7f3f88070180 2024-04-18T04:54:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f418ac35640 1 Processor -- start 2024-04-18T04:54:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f418ac35640 1 -- start start 2024-04-18T04:54:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f418ac35640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4184153170 0x7f418406e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f418ac35640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41840cc330 0x7f41840cc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f418ac35640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f418415acf0 0x7f418415b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f418ac35640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4184159ef0 con 0x7f418415acf0 2024-04-18T04:54:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f418ac35640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418406e7c0 con 0x7f4184153170 2024-04-18T04:54:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f418ac35640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418415b6c0 con 0x7f41840cc330 2024-04-18T04:54:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f4189432640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41840cc330 0x7f41840cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f4189c33640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4184153170 0x7f418406e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f4189c33640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4184153170 0x7f418406e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:44274/0 (socket says 172.21.15.96:44274) 2024-04-18T04:54:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f4189c33640 1 -- 172.21.15.96:0/2696324447 learned_addr learned my addr 172.21.15.96:0/2696324447 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f4189c33640 1 -- 172.21.15.96:0/2696324447 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41840cc330 msgr2=0x7f41840cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f4189c33640 1 --2- 172.21.15.96:0/2696324447 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41840cc330 0x7f41840cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f4189c33640 1 -- 172.21.15.96:0/2696324447 >> v2:172.21.15.96:3300/0 conn(0x7f418415acf0 msgr2=0x7f418415b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f4189c33640 1 --2- 172.21.15.96:0/2696324447 >> v2:172.21.15.96:3300/0 conn(0x7f418415acf0 0x7f418415b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f4189c33640 1 -- 172.21.15.96:0/2696324447 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41841593b0 con 0x7f4184153170 2024-04-18T04:54:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f4189432640 1 --2- 172.21.15.96:0/2696324447 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41840cc330 0x7f41840cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:54:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f830b55c640 1 Processor -- start 2024-04-18T04:54:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.127+0000 7f830b55c640 1 -- start start 2024-04-18T04:54:52.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.131+0000 7f830b55c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8304150e50 0x7f830415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.131+0000 7f830b55c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f83040c7090 0x7f8304161590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.131+0000 7f830b55c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83040c8e10 con 0x7f83040c16b0 2024-04-18T04:54:52.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.131+0000 7f830b55c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83041571e0 con 0x7f8304150e50 2024-04-18T04:54:52.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.131+0000 7f830b55c640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83041574c0 con 0x7f83040c7090 2024-04-18T04:54:52.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.131+0000 7f8309af9640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f83040c7090 0x7f8304161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.131+0000 7f8309af9640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f83040c7090 0x7f8304161590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:44288/0 (socket says 172.21.15.96:44288) 2024-04-18T04:54:52.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.131+0000 7f8309af9640 1 -- 172.21.15.96:0/4086734122 learned_addr learned my addr 172.21.15.96:0/4086734122 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:52.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.131+0000 7f83092f8640 1 --2- 172.21.15.96:0/4086734122 >> v2:172.21.15.96:3300/0 conn(0x7f8304150e50 0x7f830415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.131+0000 7f8309af9640 1 -- 172.21.15.96:0/4086734122 >> v2:172.21.15.96:3300/0 conn(0x7f8304150e50 msgr2=0x7f830415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:52.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.131+0000 7f8309af9640 1 --2- 172.21.15.96:0/4086734122 >> v2:172.21.15.96:3300/0 conn(0x7f8304150e50 0x7f830415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.131+0000 7f8309af9640 1 -- 172.21.15.96:0/4086734122 >> v1:172.21.15.96:6789/0 conn(0x7f83040c16b0 legacy=0x7f83040c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:52.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.131+0000 7f8309af9640 1 -- 172.21.15.96:0/4086734122 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83041577a0 con 0x7f83040c7090 2024-04-18T04:54:52.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.135+0000 7f8309af9640 1 --2- 172.21.15.96:0/4086734122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83040c7090 0x7f8304161590 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f83040b2a00 tx=0x7f82fc01f1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ca73ddddd02e867 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.135+0000 7f82fbfff640 1 -- 172.21.15.96:0/4086734122 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0af400 con 0x7f83040c7090 2024-04-18T04:54:52.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.135+0000 7f82fbfff640 1 -- 172.21.15.96:0/4086734122 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82fc0ab050 con 0x7f83040c7090 2024-04-18T04:54:52.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.135+0000 7f82fbfff640 1 -- 172.21.15.96:0/4086734122 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0af780 con 0x7f83040c7090 2024-04-18T04:54:52.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.135+0000 7f830b55c640 1 -- 172.21.15.96:0/4086734122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83040c7090 msgr2=0x7f8304161590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.135+0000 7f830b55c640 1 --2- 172.21.15.96:0/4086734122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83040c7090 0x7f8304161590 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f83040b2a00 tx=0x7f82fc01f1a0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.135+0000 7f830b55c640 1 -- 172.21.15.96:0/4086734122 shutdown_connections 2024-04-18T04:54:52.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.135+0000 7f830b55c640 1 --2- 172.21.15.96:0/4086734122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83040c7090 0x7f8304161590 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.135+0000 7f830b55c640 1 --2- 172.21.15.96:0/4086734122 >> v2:172.21.15.96:3300/0 conn(0x7f8304150e50 0x7f830415aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.135+0000 7f830b55c640 1 -- 172.21.15.96:0/4086734122 >> 172.21.15.96:0/4086734122 conn(0x7f830406fd10 msgr2=0x7f8304070120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.135+0000 7f830b55c640 1 -- 172.21.15.96:0/4086734122 shutdown_connections 2024-04-18T04:54:52.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.135+0000 7f830b55c640 1 -- 172.21.15.96:0/4086734122 wait complete. 2024-04-18T04:54:52.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7fc271cad640 1 Processor -- start 2024-04-18T04:54:52.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f4189c33640 1 --2- 172.21.15.96:0/2696324447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4184153170 0x7f418406e950 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4184066850 tx=0x7f417401c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba257dc57e3537b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f4188c31640 1 -- 172.21.15.96:0/2696324447 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740ab600 con 0x7f4184153170 2024-04-18T04:54:52.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f4188c31640 1 -- 172.21.15.96:0/2696324447 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41740a7050 con 0x7f4184153170 2024-04-18T04:54:52.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f418ac35640 1 -- 172.21.15.96:0/2696324447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4184153170 msgr2=0x7f418406e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f830b55c640 1 Processor -- start 2024-04-18T04:54:52.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7fc271cad640 1 -- start start 2024-04-18T04:54:52.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7fc271cad640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc26c0c90d0 0x7fc26c15d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7fc271cad640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc26c0b4100 0x7fc26c0cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7fc271cad640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26c0ca990 con 0x7fc26c0c94b0 2024-04-18T04:54:52.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7fc271cad640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26c15d7c0 con 0x7fc26c0c90d0 2024-04-18T04:54:52.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7fc271cad640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c15daa0 con 0x7fc26c0b4100 2024-04-18T04:54:52.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f4188c31640 1 -- 172.21.15.96:0/2696324447 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740ab980 con 0x7f4184153170 2024-04-18T04:54:52.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f418ac35640 1 --2- 172.21.15.96:0/2696324447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4184153170 0x7f418406e950 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4184066850 tx=0x7f417401c490 comp rx=0 tx=0).stop 2024-04-18T04:54:52.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f418ac35640 1 -- 172.21.15.96:0/2696324447 shutdown_connections 2024-04-18T04:54:52.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f418ac35640 1 --2- 172.21.15.96:0/2696324447 >> v2:172.21.15.96:3300/0 conn(0x7f418415acf0 0x7f418415b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f418ac35640 1 --2- 172.21.15.96:0/2696324447 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41840cc330 0x7f41840cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f418ac35640 1 --2- 172.21.15.96:0/2696324447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4184153170 0x7f418406e950 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4184066850 tx=0x7f417401c490 comp rx=0 tx=0).stop 2024-04-18T04:54:52.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f418ac35640 1 -- 172.21.15.96:0/2696324447 >> 172.21.15.96:0/2696324447 conn(0x7f4184065bc0 msgr2=0x7f4184065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f418ac35640 1 -- 172.21.15.96:0/2696324447 shutdown_connections 2024-04-18T04:54:52.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f418ac35640 1 -- 172.21.15.96:0/2696324447 wait complete. 2024-04-18T04:54:52.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f418ac35640 1 Processor -- start 2024-04-18T04:54:52.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7fc26b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc26c0c90d0 0x7fc26c15d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7fc26b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc26c0c90d0 0x7fc26c15d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38848/0 (socket says 172.21.15.96:38848) 2024-04-18T04:54:52.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7fc26b7fe640 1 -- 172.21.15.96:0/828722943 learned_addr learned my addr 172.21.15.96:0/828722943 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:52.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7fc26b7fe640 1 -- 172.21.15.96:0/828722943 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc26c0b4100 msgr2=0x7fc26c0cb150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:54:52.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7fc26b7fe640 1 --2- 172.21.15.96:0/828722943 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc26c0b4100 0x7fc26c0cb150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7fc26b7fe640 1 -- 172.21.15.96:0/828722943 >> v1:172.21.15.139:6789/0 conn(0x7fc26c0c94b0 legacy=0x7fc26c0c5ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:54:52.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7fc26b7fe640 1 -- 172.21.15.96:0/828722943 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c15dd80 con 0x7fc26c0c90d0 2024-04-18T04:54:52.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f830b55c640 1 -- start start 2024-04-18T04:54:52.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f830b55c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83040c16b0 0x7f8304156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f830b55c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f83040c7090 0x7f83041edf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f830b55c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8304150e50 0x7f830406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f830b55c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83040cbe70 con 0x7f8304150e50 2024-04-18T04:54:52.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f830b55c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83041edac0 con 0x7f83040c16b0 2024-04-18T04:54:52.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f830b55c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83041ed7c0 con 0x7f83040c7090 2024-04-18T04:54:52.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f8309af9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8304150e50 0x7f830406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f8309af9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8304150e50 0x7f830406c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38850/0 (socket says 172.21.15.96:38850) 2024-04-18T04:54:52.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f8309af9640 1 -- 172.21.15.96:0/2054765925 learned_addr learned my addr 172.21.15.96:0/2054765925 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:52.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f8308af7640 1 --2- 172.21.15.96:0/2054765925 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f83040c7090 0x7f83041edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f83092f8640 1 --2- 172.21.15.96:0/2054765925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83040c16b0 0x7f8304156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f8309af9640 1 -- 172.21.15.96:0/2054765925 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f83040c7090 msgr2=0x7f83041edf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f8309af9640 1 --2- 172.21.15.96:0/2054765925 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f83040c7090 0x7f83041edf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f8309af9640 1 -- 172.21.15.96:0/2054765925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83040c16b0 msgr2=0x7f8304156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f8309af9640 1 --2- 172.21.15.96:0/2054765925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83040c16b0 0x7f8304156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f8309af9640 1 -- 172.21.15.96:0/2054765925 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc009b30 con 0x7f8304150e50 2024-04-18T04:54:52.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.139+0000 7f83092f8640 1 --2- 172.21.15.96:0/2054765925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83040c16b0 0x7f8304156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:54:52.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f418ac35640 1 -- start start 2024-04-18T04:54:52.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f8309af9640 1 --2- 172.21.15.96:0/2054765925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8304150e50 0x7f830406c2d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f82fc01cdd0 tx=0x7f82fc01bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f82f9ffb640 1 -- 172.21.15.96:0/2054765925 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0afd50 con 0x7f8304150e50 2024-04-18T04:54:52.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f830b55c640 1 -- 172.21.15.96:0/2054765925 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8304156f40 con 0x7f8304150e50 2024-04-18T04:54:52.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f82f9ffb640 1 -- 172.21.15.96:0/2054765925 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82fc009510 con 0x7f8304150e50 2024-04-18T04:54:52.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f82f9ffb640 1 -- 172.21.15.96:0/2054765925 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0ba660 con 0x7f8304150e50 2024-04-18T04:54:52.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f830b55c640 1 -- 172.21.15.96:0/2054765925 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83040cc080 con 0x7f8304150e50 2024-04-18T04:54:52.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f418ac35640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41840cc330 0x7f41841538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f830b55c640 1 -- 172.21.15.96:0/2054765925 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83041edc30 con 0x7f8304150e50 2024-04-18T04:54:52.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f418ac35640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f418415acf0 0x7f41840c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f4189432640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f418415acf0 0x7f41840c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f4189432640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f418415acf0 0x7f41840c5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38854/0 (socket says 172.21.15.96:38854) 2024-04-18T04:54:52.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f4189432640 1 -- 172.21.15.96:0/2541976321 learned_addr learned my addr 172.21.15.96:0/2541976321 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:52.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7fc26b7fe640 1 --2- 172.21.15.96:0/828722943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc26c0c90d0 0x7fc26c15d180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc26400b1a0 tx=0x7fc26401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b2354ceacba2c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f418ac35640 1 --2- 172.21.15.96:0/2541976321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41840c1020 0x7f41840c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f418ac35640 1 -- 172.21.15.96:0/2541976321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418415d810 con 0x7f418415acf0 2024-04-18T04:54:52.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f4189c33640 1 --2- 172.21.15.96:0/2541976321 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41840cc330 0x7f41841538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f418ac35640 1 -- 172.21.15.96:0/2541976321 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41841fec00 con 0x7f41840c1020 2024-04-18T04:54:52.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f418ac35640 1 -- 172.21.15.96:0/2541976321 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41840c0e40 con 0x7f41840cc330 2024-04-18T04:54:52.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f418a434640 1 --2- 172.21.15.96:0/2541976321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41840c1020 0x7f41840c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f4189432640 1 -- 172.21.15.96:0/2541976321 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41840cc330 msgr2=0x7f41841538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f4189432640 1 --2- 172.21.15.96:0/2541976321 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41840cc330 0x7f41841538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f4189432640 1 -- 172.21.15.96:0/2541976321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41840c1020 msgr2=0x7f41840c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f4189432640 1 --2- 172.21.15.96:0/2541976321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41840c1020 0x7f41840c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f4189432640 1 -- 172.21.15.96:0/2541976321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4180009420 con 0x7f418415acf0 2024-04-18T04:54:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7f4189432640 1 --2- 172.21.15.96:0/2541976321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f418415acf0 0x7f41840c5970 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f418000ec10 tx=0x7f418000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7f4189c33640 1 --2- 172.21.15.96:0/2541976321 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41840cc330 0x7f41841538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7fc26a7fc640 1 -- 172.21.15.96:0/828722943 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2640a59c0 con 0x7fc26c0c90d0 2024-04-18T04:54:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7fc26a7fc640 1 -- 172.21.15.96:0/828722943 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2640a5b20 con 0x7fc26c0c90d0 2024-04-18T04:54:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7fc26a7fc640 1 -- 172.21.15.96:0/828722943 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2640ad3f0 con 0x7fc26c0c90d0 2024-04-18T04:54:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7fc271cad640 1 -- 172.21.15.96:0/828722943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc26c0c90d0 msgr2=0x7fc26c15d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.143+0000 7fc271cad640 1 --2- 172.21.15.96:0/828722943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc26c0c90d0 0x7fc26c15d180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc26400b1a0 tx=0x7fc26401cc20 comp rx=0 tx=0).stop 2024-04-18T04:54:52.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7f82f9ffb640 1 -- 172.21.15.96:0/2054765925 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f82fc0b6040 con 0x7f8304150e50 2024-04-18T04:54:52.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc271cad640 1 -- 172.21.15.96:0/828722943 shutdown_connections 2024-04-18T04:54:52.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc271cad640 1 --2- 172.21.15.96:0/828722943 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc26c0b4100 0x7fc26c0cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc271cad640 1 --2- 172.21.15.96:0/828722943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc26c0c90d0 0x7fc26c15d180 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc271cad640 1 -- 172.21.15.96:0/828722943 >> 172.21.15.96:0/828722943 conn(0x7fc26c065bc0 msgr2=0x7fc26c065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7f417a7fc640 1 -- 172.21.15.96:0/2541976321 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418000cc30 con 0x7f418415acf0 2024-04-18T04:54:52.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7f418ac35640 1 -- 172.21.15.96:0/2541976321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41740094d0 con 0x7f418415acf0 2024-04-18T04:54:52.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7f418ac35640 1 -- 172.21.15.96:0/2541976321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418415ce70 con 0x7f418415acf0 2024-04-18T04:54:52.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc271cad640 1 -- 172.21.15.96:0/828722943 shutdown_connections 2024-04-18T04:54:52.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc271cad640 1 -- 172.21.15.96:0/828722943 wait complete. 2024-04-18T04:54:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc271cad640 1 Processor -- start 2024-04-18T04:54:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc271cad640 1 -- start start 2024-04-18T04:54:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc271cad640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc26c0b4100 0x7fc26c0cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc271cad640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc26c0c90d0 0x7fc26c145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc271cad640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc26c0c94b0 0x7fc26c0bf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc271cad640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c15a890 con 0x7fc26c0c90d0 2024-04-18T04:54:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc271cad640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c0c1100 con 0x7fc26c0b4100 2024-04-18T04:54:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc271cad640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c158210 con 0x7fc26c0c94b0 2024-04-18T04:54:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc26b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc26c0b4100 0x7fc26c0cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc26b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc26c0b4100 0x7fc26c0cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:44316/0 (socket says 172.21.15.96:44316) 2024-04-18T04:54:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7fc26b7fe640 1 -- 172.21.15.96:0/2242558360 learned_addr learned my addr 172.21.15.96:0/2242558360 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7fc26bfff640 1 --2- 172.21.15.96:0/2242558360 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc26c0c94b0 0x7fc26c0bf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7fc26b7fe640 1 -- 172.21.15.96:0/2242558360 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc26c0c94b0 msgr2=0x7fc26c0bf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7fc26b7fe640 1 --2- 172.21.15.96:0/2242558360 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc26c0c94b0 0x7fc26c0bf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7fc26b7fe640 1 -- 172.21.15.96:0/2242558360 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc26c0c90d0 msgr2=0x7fc26c145fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7fc26b7fe640 1 --2- 172.21.15.96:0/2242558360 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc26c0c90d0 0x7fc26c145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7fc26b7fe640 1 -- 172.21.15.96:0/2242558360 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc264009b30 con 0x7fc26c0b4100 2024-04-18T04:54:52.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7f82f9ffb640 1 --2- 172.21.15.96:0/2054765925 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f82e8066690 0x7f82e8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7f82f9ffb640 1 -- 172.21.15.96:0/2054765925 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82fc122460 con 0x7f8304150e50 2024-04-18T04:54:52.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7f83092f8640 1 --2- 172.21.15.96:0/2054765925 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f82e8066690 0x7f82e8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.147+0000 7f83092f8640 1 --2- 172.21.15.96:0/2054765925 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f82e8066690 0x7f82e8068b50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8300009bb0 tx=0x7f8300008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7fc26b7fe640 1 --2- 172.21.15.96:0/2242558360 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc26c0b4100 0x7fc26c0cc2d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc26401b2d0 tx=0x7fc2640199c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7fc257fff640 1 -- 172.21.15.96:0/2242558360 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264009510 con 0x7fc26c0b4100 2024-04-18T04:54:52.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7fc271cad640 1 -- 172.21.15.96:0/2242558360 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26c0c9d30 con 0x7fc26c0b4100 2024-04-18T04:54:52.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7fc271cad640 1 -- 172.21.15.96:0/2242558360 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26c1584f0 con 0x7fc26c0b4100 2024-04-18T04:54:52.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7fc257fff640 1 -- 172.21.15.96:0/2242558360 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2640090d0 con 0x7fc26c0b4100 2024-04-18T04:54:52.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7fc257fff640 1 -- 172.21.15.96:0/2242558360 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2640b86b0 con 0x7fc26c0b4100 2024-04-18T04:54:52.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7f417a7fc640 1 -- 172.21.15.96:0/2541976321 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418000cd90 con 0x7f418415acf0 2024-04-18T04:54:52.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7f417a7fc640 1 -- 172.21.15.96:0/2541976321 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4180004220 con 0x7f418415acf0 2024-04-18T04:54:52.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7f417a7fc640 1 -- 172.21.15.96:0/2541976321 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4180004380 con 0x7f418415acf0 2024-04-18T04:54:52.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7f417a7fc640 1 --2- 172.21.15.96:0/2541976321 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4168066710 0x7f4168068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7f417a7fc640 1 -- 172.21.15.96:0/2541976321 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41800841e0 con 0x7f418415acf0 2024-04-18T04:54:52.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7f4189c33640 1 --2- 172.21.15.96:0/2541976321 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4168066710 0x7f4168068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7f4189c33640 1 --2- 172.21.15.96:0/2541976321 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4168066710 0x7f4168068bd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f418406e400 tx=0x7f4174008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7fc271cad640 1 -- 172.21.15.96:0/2242558360 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26c0675e0 con 0x7fc26c0b4100 2024-04-18T04:54:52.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7fc257fff640 1 -- 172.21.15.96:0/2242558360 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc2640b8810 con 0x7fc26c0b4100 2024-04-18T04:54:52.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.151+0000 7fc257fff640 1 --2- 172.21.15.96:0/2242558360 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc250066690 0x7fc250068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.155+0000 7f418ac35640 1 -- 172.21.15.96:0/2541976321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416c005260 con 0x7f418415acf0 2024-04-18T04:54:52.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.155+0000 7fc257fff640 1 -- 172.21.15.96:0/2242558360 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc26411fbd0 con 0x7fc26c0b4100 2024-04-18T04:54:52.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.155+0000 7fc26affd640 1 --2- 172.21.15.96:0/2242558360 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc250066690 0x7fc250068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.155+0000 7fc26affd640 1 --2- 172.21.15.96:0/2242558360 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc250066690 0x7fc250068b50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc26c146950 tx=0x7fc260006c50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.155+0000 7f82f9ffb640 1 -- 172.21.15.96:0/2054765925 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f82fc0ef730 con 0x7f8304150e50 2024-04-18T04:54:52.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.159+0000 7f417a7fc640 1 -- 172.21.15.96:0/2541976321 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f4180021080 con 0x7f418415acf0 2024-04-18T04:54:52.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.167+0000 7fc257fff640 1 -- 172.21.15.96:0/2242558360 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc2640ed090 con 0x7fc26c0b4100 2024-04-18T04:54:52.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f018569f640 1 Processor -- start 2024-04-18T04:54:52.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f018569f640 1 -- start start 2024-04-18T04:54:52.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f018569f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f018006ae70 0x7f018006b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f018569f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0180155490 0x7f0180155920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f018569f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01800c9cb0 con 0x7f01800c4a80 2024-04-18T04:54:52.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f018569f640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f018006b790 con 0x7f0180155490 2024-04-18T04:54:52.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f018569f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01800c6ae0 con 0x7f018006ae70 2024-04-18T04:54:52.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f017f7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0180155490 0x7f0180155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f017effd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f018006ae70 0x7f018006b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f017f7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0180155490 0x7f0180155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:44332/0 (socket says 172.21.15.96:44332) 2024-04-18T04:54:52.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f017f7fe640 1 -- 172.21.15.96:0/2101272507 learned_addr learned my addr 172.21.15.96:0/2101272507 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:52.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f017e7fc640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f01800c4a80 0x7f01800c95a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46398/0 (socket says 172.21.15.96:46398) 2024-04-18T04:54:52.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f017effd640 1 -- 172.21.15.96:0/2101272507 >> v2:172.21.15.139:3300/0 conn(0x7f0180155490 msgr2=0x7f0180155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:52.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f017effd640 1 --2- 172.21.15.96:0/2101272507 >> v2:172.21.15.139:3300/0 conn(0x7f0180155490 0x7f0180155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f017effd640 1 -- 172.21.15.96:0/2101272507 >> v1:172.21.15.96:6789/0 conn(0x7f01800c4a80 legacy=0x7f01800c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f017effd640 1 -- 172.21.15.96:0/2101272507 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01800c5d00 con 0x7f018006ae70 2024-04-18T04:54:52.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.191+0000 7f017f7fe640 1 --2- 172.21.15.96:0/2101272507 >> v2:172.21.15.139:3300/0 conn(0x7f0180155490 0x7f0180155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:54:52.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.195+0000 7f017effd640 1 --2- 172.21.15.96:0/2101272507 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f018006ae70 0x7f018006b250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f01700097c0 tx=0x7f017001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7335cc0dd52adf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.195+0000 7f017dffb640 1 -- 172.21.15.96:0/2101272507 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01700ab600 con 0x7f018006ae70 2024-04-18T04:54:52.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.195+0000 7f017dffb640 1 -- 172.21.15.96:0/2101272507 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01700a7050 con 0x7f018006ae70 2024-04-18T04:54:52.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.195+0000 7f017dffb640 1 -- 172.21.15.96:0/2101272507 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01700ab980 con 0x7f018006ae70 2024-04-18T04:54:52.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.195+0000 7f018569f640 1 -- 172.21.15.96:0/2101272507 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f018006ae70 msgr2=0x7f018006b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.195+0000 7f018569f640 1 --2- 172.21.15.96:0/2101272507 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f018006ae70 0x7f018006b250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f01700097c0 tx=0x7f017001c3c0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f018569f640 1 -- 172.21.15.96:0/2101272507 shutdown_connections 2024-04-18T04:54:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f018569f640 1 --2- 172.21.15.96:0/2101272507 >> v2:172.21.15.139:3300/0 conn(0x7f0180155490 0x7f0180155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f018569f640 1 --2- 172.21.15.96:0/2101272507 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f018006ae70 0x7f018006b250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f018569f640 1 -- 172.21.15.96:0/2101272507 >> 172.21.15.96:0/2101272507 conn(0x7f01800cb570 msgr2=0x7f01800c76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f018569f640 1 -- 172.21.15.96:0/2101272507 shutdown_connections 2024-04-18T04:54:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f018569f640 1 -- 172.21.15.96:0/2101272507 wait complete. 2024-04-18T04:54:52.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f018569f640 1 Processor -- start 2024-04-18T04:54:52.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f018569f640 1 -- start start 2024-04-18T04:54:52.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f018569f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f018006ae70 0x7f0180152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f018569f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f01800c4a80 0x7f018014e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f018569f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0180155490 0x7f01800bf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f017effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f018006ae70 0x7f0180152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f017effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f018006ae70 0x7f0180152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38882/0 (socket says 172.21.15.96:38882) 2024-04-18T04:54:52.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f017effd640 1 -- 172.21.15.96:0/2394974680 learned_addr learned my addr 172.21.15.96:0/2394974680 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:52.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f018569f640 1 -- 172.21.15.96:0/2394974680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0180152b20 con 0x7f018006ae70 2024-04-18T04:54:52.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f018569f640 1 -- 172.21.15.96:0/2394974680 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0180153320 con 0x7f0180155490 2024-04-18T04:54:52.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f018569f640 1 -- 172.21.15.96:0/2394974680 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01801501d0 con 0x7f01800c4a80 2024-04-18T04:54:52.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.199+0000 7f017e7fc640 1 --2- 172.21.15.96:0/2394974680 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f01800c4a80 0x7f018014e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.203+0000 7f017effd640 1 -- 172.21.15.96:0/2394974680 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f01800c4a80 msgr2=0x7f018014e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.203+0000 7f017effd640 1 --2- 172.21.15.96:0/2394974680 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f01800c4a80 0x7f018014e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.203+0000 7f017effd640 1 -- 172.21.15.96:0/2394974680 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0180155490 msgr2=0x7f01800bf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.203+0000 7f017f7fe640 1 --2- 172.21.15.96:0/2394974680 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0180155490 0x7f01800bf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.203+0000 7f017effd640 1 --2- 172.21.15.96:0/2394974680 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0180155490 0x7f01800bf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.203+0000 7f017effd640 1 -- 172.21.15.96:0/2394974680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017800ab50 con 0x7f018006ae70 2024-04-18T04:54:52.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.203+0000 7f017f7fe640 1 --2- 172.21.15.96:0/2394974680 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0180155490 0x7f01800bf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:52.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.203+0000 7f017effd640 1 --2- 172.21.15.96:0/2394974680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f018006ae70 0x7f0180152de0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f01700ae040 tx=0x7f0170019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.211+0000 7f016f7fe640 1 -- 172.21.15.96:0/2394974680 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01700ba070 con 0x7f018006ae70 2024-04-18T04:54:52.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.211+0000 7f016f7fe640 1 -- 172.21.15.96:0/2394974680 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01700b4620 con 0x7f018006ae70 2024-04-18T04:54:52.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.211+0000 7f018569f640 1 -- 172.21.15.96:0/2394974680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0170009420 con 0x7f018006ae70 2024-04-18T04:54:52.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.211+0000 7f016f7fe640 1 -- 172.21.15.96:0/2394974680 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01700b49f0 con 0x7f018006ae70 2024-04-18T04:54:52.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.211+0000 7f018569f640 1 -- 172.21.15.96:0/2394974680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0180150470 con 0x7f018006ae70 2024-04-18T04:54:52.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.215+0000 7f018569f640 1 -- 172.21.15.96:0/2394974680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01800c5f80 con 0x7f018006ae70 2024-04-18T04:54:52.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.215+0000 7f016f7fe640 1 -- 172.21.15.96:0/2394974680 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f01700b2040 con 0x7f018006ae70 2024-04-18T04:54:52.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.215+0000 7f016f7fe640 1 --2- 172.21.15.96:0/2394974680 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0164066760 0x7f0164068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.215+0000 7f016f7fe640 1 -- 172.21.15.96:0/2394974680 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f017011dae0 con 0x7f018006ae70 2024-04-18T04:54:52.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.215+0000 7f017e7fc640 1 --2- 172.21.15.96:0/2394974680 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0164066760 0x7f0164068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.215+0000 7f017e7fc640 1 --2- 172.21.15.96:0/2394974680 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0164066760 0x7f0164068c20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0174000c10 tx=0x7f0174005110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.227+0000 7f016f7fe640 1 -- 172.21.15.96:0/2394974680 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f01700eaec0 con 0x7f018006ae70 2024-04-18T04:54:52.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.299+0000 7f92d089c640 1 -- 172.21.15.96:0/2048075210 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f92b00050d0 con 0x7f92cc151790 2024-04-18T04:54:52.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.303+0000 7f92baffd640 1 -- 172.21.15.96:0/2048075210 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f92c4055960 con 0x7f92cc151790 2024-04-18T04:54:52.306 INFO:teuthology.orchestra.run.smithi096.stdout:64424509445 2024-04-18T04:54:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.303+0000 7f92b8ff9640 1 -- 172.21.15.96:0/2048075210 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f92ac0666c0 msgr2=0x7f92ac068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.303+0000 7f92b8ff9640 1 --2- 172.21.15.96:0/2048075210 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f92ac0666c0 0x7f92ac068b80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0ae000 tx=0x7f92bc008040 comp rx=0 tx=0).stop 2024-04-18T04:54:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.303+0000 7f92b8ff9640 1 -- 172.21.15.96:0/2048075210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92cc151790 msgr2=0x7f92cc156100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.303+0000 7f92b8ff9640 1 --2- 172.21.15.96:0/2048075210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92cc151790 0x7f92cc156100 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f92c400ccb0 tx=0x7f92c400a660 comp rx=0 tx=0).stop 2024-04-18T04:54:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.303+0000 7f92b8ff9640 1 -- 172.21.15.96:0/2048075210 shutdown_connections 2024-04-18T04:54:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.303+0000 7f92b8ff9640 1 --2- 172.21.15.96:0/2048075210 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f92ac0666c0 0x7f92ac068b80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.303+0000 7f92b8ff9640 1 --2- 172.21.15.96:0/2048075210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92cc151790 0x7f92cc156100 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.303+0000 7f92b8ff9640 1 --2- 172.21.15.96:0/2048075210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92cc06d460 0x7f92cc0c0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.303+0000 7f92b8ff9640 1 --2- 172.21.15.96:0/2048075210 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f92cc06cc30 0x7f92cc144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.303+0000 7f92b8ff9640 1 -- 172.21.15.96:0/2048075210 >> 172.21.15.96:0/2048075210 conn(0x7f92cc0cb570 msgr2=0x7f92cc160850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.303+0000 7f92b8ff9640 1 -- 172.21.15.96:0/2048075210 shutdown_connections 2024-04-18T04:54:52.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.303+0000 7f92b8ff9640 1 -- 172.21.15.96:0/2048075210 wait complete. 2024-04-18T04:54:52.329 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.3 2024-04-18T04:54:52.330 DEBUG:teuthology.parallel:result is None 2024-04-18T04:54:52.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.355+0000 7fd6e3717640 1 -- 172.21.15.96:0/989060316 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd6bc0057e0 con 0x7fd6dc14f060 2024-04-18T04:54:52.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.355+0000 7fd6d1ffb640 1 -- 172.21.15.96:0/989060316 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd6d411e070 con 0x7fd6dc14f060 2024-04-18T04:54:52.357 INFO:teuthology.orchestra.run.smithi096.stdout:64424509445 2024-04-18T04:54:52.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.359+0000 7fd6e3717640 1 -- 172.21.15.96:0/989060316 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd6c0066690 msgr2=0x7fd6c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.359+0000 7fd6e3717640 1 --2- 172.21.15.96:0/989060316 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd6c0066690 0x7fd6c0068b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0050b0 tx=0x7fd6cc003700 comp rx=0 tx=0).stop 2024-04-18T04:54:52.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.359+0000 7fd6e3717640 1 -- 172.21.15.96:0/989060316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6dc14f060 msgr2=0x7fd6dc153c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.359+0000 7fd6e3717640 1 --2- 172.21.15.96:0/989060316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6dc14f060 0x7fd6dc153c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0cb3c0 tx=0x7fd6d401bc90 comp rx=0 tx=0).stop 2024-04-18T04:54:52.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.359+0000 7fd6e3717640 1 -- 172.21.15.96:0/989060316 shutdown_connections 2024-04-18T04:54:52.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.359+0000 7fd6e3717640 1 --2- 172.21.15.96:0/989060316 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd6c0066690 0x7fd6c0068b50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.359+0000 7fd6e3717640 1 --2- 172.21.15.96:0/989060316 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6dc154c60 0x7fd6dc154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.359+0000 7fd6e3717640 1 --2- 172.21.15.96:0/989060316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6dc14f060 0x7fd6dc153c50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.359+0000 7fd6e3717640 1 --2- 172.21.15.96:0/989060316 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6dc0701e0 0x7fd6dc13bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.359+0000 7fd6e3717640 1 -- 172.21.15.96:0/989060316 >> 172.21.15.96:0/989060316 conn(0x7fd6dc069e60 msgr2=0x7fd6dc0c98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.359+0000 7fd6e3717640 1 -- 172.21.15.96:0/989060316 shutdown_connections 2024-04-18T04:54:52.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.359+0000 7fd6e3717640 1 -- 172.21.15.96:0/989060316 wait complete. 2024-04-18T04:54:52.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.7 2024-04-18T04:54:52.375 DEBUG:teuthology.parallel:result is None 2024-04-18T04:54:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.451+0000 7f490ba4c640 1 -- 172.21.15.96:0/672252275 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f49041f69e0 con 0x7f490414f170 2024-04-18T04:54:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.451+0000 7f48f9ffb640 1 -- 172.21.15.96:0/672252275 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f49041f69e0 con 0x7f490414f170 2024-04-18T04:54:52.454 INFO:teuthology.orchestra.run.smithi096.stdout:64424509444 2024-04-18T04:54:52.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.455+0000 7f490ba4c640 1 -- 172.21.15.96:0/672252275 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f48e8066690 msgr2=0x7f48e8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.455+0000 7f490ba4c640 1 --2- 172.21.15.96:0/672252275 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f48e8066690 0x7f48e8068b50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f49000af000 tx=0x7f4900009040 comp rx=0 tx=0).stop 2024-04-18T04:54:52.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.455+0000 7f490ba4c640 1 -- 172.21.15.96:0/672252275 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f490414f170 msgr2=0x7f4904147f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.455+0000 7f490ba4c640 1 --2- 172.21.15.96:0/672252275 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f490414f170 0x7f4904147f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f48f400b410 tx=0x7f48f400b8d0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.455+0000 7f490ba4c640 1 -- 172.21.15.96:0/672252275 shutdown_connections 2024-04-18T04:54:52.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.455+0000 7f490ba4c640 1 --2- 172.21.15.96:0/672252275 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f48e8066690 0x7f48e8068b50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.455+0000 7f490ba4c640 1 --2- 172.21.15.96:0/672252275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4904155830 0x7f49041f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.455+0000 7f490ba4c640 1 --2- 172.21.15.96:0/672252275 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f490414f170 0x7f4904147f20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.455+0000 7f490ba4c640 1 --2- 172.21.15.96:0/672252275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49040c2a60 0x7f49041479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.455+0000 7f490ba4c640 1 -- 172.21.15.96:0/672252275 >> 172.21.15.96:0/672252275 conn(0x7f490406a8e0 msgr2=0x7f49040c3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.455+0000 7f490ba4c640 1 -- 172.21.15.96:0/672252275 shutdown_connections 2024-04-18T04:54:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.455+0000 7f490ba4c640 1 -- 172.21.15.96:0/672252275 wait complete. 2024-04-18T04:54:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.463+0000 7fc271cad640 1 -- 172.21.15.96:0/2242558360 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc26c0c88e0 con 0x7fc26c0b4100 2024-04-18T04:54:52.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.463+0000 7f3f8d4c2640 1 -- 172.21.15.96:0/870220758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3f680050d0 con 0x7f3f88070180 2024-04-18T04:54:52.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.463+0000 7fc257fff640 1 -- 172.21.15.96:0/2242558360 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc2640bc020 con 0x7fc26c0b4100 2024-04-18T04:54:52.466 INFO:teuthology.orchestra.run.smithi096.stdout:64424509446 2024-04-18T04:54:52.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.463+0000 7f3f6f7fe640 1 -- 172.21.15.96:0/870220758 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f80017090 con 0x7f3f88070180 2024-04-18T04:54:52.466 INFO:teuthology.orchestra.run.smithi096.stdout:55834574854 2024-04-18T04:54:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7f3f8d4c2640 1 -- 172.21.15.96:0/870220758 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3f74066690 msgr2=0x7f3f74068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7f3f8d4c2640 1 --2- 172.21.15.96:0/870220758 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3f74066690 0x7f3f74068b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3f78007fd0 tx=0x7f3f78007960 comp rx=0 tx=0).stop 2024-04-18T04:54:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7f3f8d4c2640 1 -- 172.21.15.96:0/870220758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f88070180 msgr2=0x7f3f88158700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7f3f8d4c2640 1 --2- 172.21.15.96:0/870220758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f88070180 0x7f3f88158700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000cbd0 tx=0x7f3f8000a430 comp rx=0 tx=0).stop 2024-04-18T04:54:52.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7f3f8d4c2640 1 -- 172.21.15.96:0/870220758 shutdown_connections 2024-04-18T04:54:52.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7f3f8d4c2640 1 --2- 172.21.15.96:0/870220758 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3f74066690 0x7f3f74068b50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7f3f8d4c2640 1 --2- 172.21.15.96:0/870220758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f881578f0 0x7f3f881f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7f3f8d4c2640 1 --2- 172.21.15.96:0/870220758 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3f88157510 0x7f3f88146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7f3f8d4c2640 1 --2- 172.21.15.96:0/870220758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f88070180 0x7f3f88158700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7f3f8d4c2640 1 -- 172.21.15.96:0/870220758 >> 172.21.15.96:0/870220758 conn(0x7f3f8806a8e0 msgr2=0x7f3f88156180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7f3f8d4c2640 1 -- 172.21.15.96:0/870220758 shutdown_connections 2024-04-18T04:54:52.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7f3f8d4c2640 1 -- 172.21.15.96:0/870220758 wait complete. 2024-04-18T04:54:52.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7fc271cad640 1 -- 172.21.15.96:0/2242558360 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc250066690 msgr2=0x7fc250068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7fc271cad640 1 --2- 172.21.15.96:0/2242558360 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc250066690 0x7fc250068b50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc26c146950 tx=0x7fc260006c50 comp rx=0 tx=0).stop 2024-04-18T04:54:52.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7fc271cad640 1 -- 172.21.15.96:0/2242558360 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc26c0b4100 msgr2=0x7fc26c0cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7fc271cad640 1 --2- 172.21.15.96:0/2242558360 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc26c0b4100 0x7fc26c0cc2d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc26401b2d0 tx=0x7fc2640199c0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7fc271cad640 1 -- 172.21.15.96:0/2242558360 shutdown_connections 2024-04-18T04:54:52.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7fc271cad640 1 --2- 172.21.15.96:0/2242558360 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc250066690 0x7fc250068b50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7fc271cad640 1 --2- 172.21.15.96:0/2242558360 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc26c0c94b0 0x7fc26c0bf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7fc271cad640 1 --2- 172.21.15.96:0/2242558360 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc26c0c90d0 0x7fc26c145fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7fc271cad640 1 --2- 172.21.15.96:0/2242558360 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc26c0b4100 0x7fc26c0cc2d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7fc271cad640 1 -- 172.21.15.96:0/2242558360 >> 172.21.15.96:0/2242558360 conn(0x7fc26c065bc0 msgr2=0x7fc26c15caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7fc271cad640 1 -- 172.21.15.96:0/2242558360 shutdown_connections 2024-04-18T04:54:52.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.467+0000 7fc271cad640 1 -- 172.21.15.96:0/2242558360 wait complete. 2024-04-18T04:54:52.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.5 2024-04-18T04:54:52.473 DEBUG:teuthology.parallel:result is None 2024-04-18T04:54:52.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-04-18T04:54:52.486 DEBUG:teuthology.parallel:result is None 2024-04-18T04:54:52.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.487+0000 7f418ac35640 1 -- 172.21.15.96:0/2541976321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f416c005510 con 0x7f418415acf0 2024-04-18T04:54:52.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.487+0000 7f417a7fc640 1 -- 172.21.15.96:0/2541976321 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4180057090 con 0x7f418415acf0 2024-04-18T04:54:52.491 INFO:teuthology.orchestra.run.smithi096.stdout:64424509445 2024-04-18T04:54:52.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.491+0000 7f418ac35640 1 -- 172.21.15.96:0/2541976321 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4168066710 msgr2=0x7f4168068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.491+0000 7f418ac35640 1 --2- 172.21.15.96:0/2541976321 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4168066710 0x7f4168068bd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f418406e400 tx=0x7f4174008040 comp rx=0 tx=0).stop 2024-04-18T04:54:52.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.491+0000 7f418ac35640 1 -- 172.21.15.96:0/2541976321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f418415acf0 msgr2=0x7f41840c5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.491+0000 7f418ac35640 1 --2- 172.21.15.96:0/2541976321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f418415acf0 0x7f41840c5970 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f418000ec10 tx=0x7f418000c520 comp rx=0 tx=0).stop 2024-04-18T04:54:52.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-04-18T04:54:52.496 DEBUG:teuthology.parallel:result is None 2024-04-18T04:54:52.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.491+0000 7f418ac35640 1 -- 172.21.15.96:0/2541976321 shutdown_connections 2024-04-18T04:54:52.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.491+0000 7f418ac35640 1 --2- 172.21.15.96:0/2541976321 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4168066710 0x7f4168068bd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.491+0000 7f418ac35640 1 --2- 172.21.15.96:0/2541976321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41840c1020 0x7f41840c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.491+0000 7f418ac35640 1 --2- 172.21.15.96:0/2541976321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f418415acf0 0x7f41840c5970 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.491+0000 7f418ac35640 1 --2- 172.21.15.96:0/2541976321 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41840cc330 0x7f41841538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.491+0000 7f418ac35640 1 -- 172.21.15.96:0/2541976321 >> 172.21.15.96:0/2541976321 conn(0x7f4184065bc0 msgr2=0x7f4184156d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.491+0000 7f418ac35640 1 -- 172.21.15.96:0/2541976321 shutdown_connections 2024-04-18T04:54:52.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.491+0000 7f418ac35640 1 -- 172.21.15.96:0/2541976321 wait complete. 2024-04-18T04:54:52.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.499+0000 7f830b55c640 1 -- 172.21.15.96:0/2054765925 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f83040670f0 con 0x7f8304150e50 2024-04-18T04:54:52.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.499+0000 7f82f9ffb640 1 -- 172.21.15.96:0/2054765925 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f82fc0f2d50 con 0x7f8304150e50 2024-04-18T04:54:52.500 INFO:teuthology.orchestra.run.smithi096.stdout:64424509444 2024-04-18T04:54:52.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.499+0000 7f830b55c640 1 -- 172.21.15.96:0/2054765925 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f82e8066690 msgr2=0x7f82e8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.499+0000 7f830b55c640 1 --2- 172.21.15.96:0/2054765925 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f82e8066690 0x7f82e8068b50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8300009bb0 tx=0x7f8300008040 comp rx=0 tx=0).stop 2024-04-18T04:54:52.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.499+0000 7f830b55c640 1 -- 172.21.15.96:0/2054765925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8304150e50 msgr2=0x7f830406c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.499+0000 7f830b55c640 1 --2- 172.21.15.96:0/2054765925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8304150e50 0x7f830406c2d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f82fc01cdd0 tx=0x7f82fc01bf40 comp rx=0 tx=0).stop 2024-04-18T04:54:52.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.499+0000 7f830b55c640 1 -- 172.21.15.96:0/2054765925 shutdown_connections 2024-04-18T04:54:52.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.499+0000 7f830b55c640 1 --2- 172.21.15.96:0/2054765925 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f82e8066690 0x7f82e8068b50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.499+0000 7f830b55c640 1 --2- 172.21.15.96:0/2054765925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8304150e50 0x7f830406c2d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.499+0000 7f830b55c640 1 --2- 172.21.15.96:0/2054765925 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f83040c7090 0x7f83041edf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.499+0000 7f830b55c640 1 --2- 172.21.15.96:0/2054765925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83040c16b0 0x7f8304156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.499+0000 7f830b55c640 1 -- 172.21.15.96:0/2054765925 >> 172.21.15.96:0/2054765925 conn(0x7f830406fd10 msgr2=0x7f830414f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.499+0000 7f830b55c640 1 -- 172.21.15.96:0/2054765925 shutdown_connections 2024-04-18T04:54:52.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.499+0000 7f830b55c640 1 -- 172.21.15.96:0/2054765925 wait complete. 2024-04-18T04:54:52.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.6 2024-04-18T04:54:52.511 DEBUG:teuthology.parallel:result is None 2024-04-18T04:54:52.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.1 2024-04-18T04:54:52.524 DEBUG:teuthology.parallel:result is None 2024-04-18T04:54:52.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.531+0000 7f018569f640 1 -- 172.21.15.96:0/2394974680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f01800670f0 con 0x7f018006ae70 2024-04-18T04:54:52.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.531+0000 7f016f7fe640 1 -- 172.21.15.96:0/2394974680 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f01700ee4e0 con 0x7f018006ae70 2024-04-18T04:54:52.532 INFO:teuthology.orchestra.run.smithi096.stdout:55834574854 2024-04-18T04:54:52.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.531+0000 7f018569f640 1 -- 172.21.15.96:0/2394974680 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0164066760 msgr2=0x7f0164068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.531+0000 7f018569f640 1 --2- 172.21.15.96:0/2394974680 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0164066760 0x7f0164068c20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0174000c10 tx=0x7f0174005110 comp rx=0 tx=0).stop 2024-04-18T04:54:52.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.531+0000 7f018569f640 1 -- 172.21.15.96:0/2394974680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f018006ae70 msgr2=0x7f0180152de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.531+0000 7f018569f640 1 --2- 172.21.15.96:0/2394974680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f018006ae70 0x7f0180152de0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f01700ae040 tx=0x7f0170019160 comp rx=0 tx=0).stop 2024-04-18T04:54:52.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.531+0000 7f018569f640 1 -- 172.21.15.96:0/2394974680 shutdown_connections 2024-04-18T04:54:52.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.531+0000 7f018569f640 1 --2- 172.21.15.96:0/2394974680 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0164066760 0x7f0164068c20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.531+0000 7f018569f640 1 --2- 172.21.15.96:0/2394974680 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0180155490 0x7f01800bf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.531+0000 7f018569f640 1 --2- 172.21.15.96:0/2394974680 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f01800c4a80 0x7f018014e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.531+0000 7f018569f640 1 --2- 172.21.15.96:0/2394974680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f018006ae70 0x7f0180152de0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.531+0000 7f018569f640 1 -- 172.21.15.96:0/2394974680 >> 172.21.15.96:0/2394974680 conn(0x7f01800cb570 msgr2=0x7f0180154c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.531+0000 7f018569f640 1 -- 172.21.15.96:0/2394974680 shutdown_connections 2024-04-18T04:54:52.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.531+0000 7f018569f640 1 -- 172.21.15.96:0/2394974680 wait complete. 2024-04-18T04:54:52.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-04-18T04:54:52.548 DEBUG:teuthology.parallel:result is None 2024-04-18T04:54:52.548 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T04:54:52.548 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:54:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.691+0000 7f134fd13640 1 Processor -- start 2024-04-18T04:54:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.691+0000 7f134fd13640 1 -- start start 2024-04-18T04:54:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134fd13640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f13481532d0 0x7f1348158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134fd13640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f13480cacc0 0x7f134815ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134fd13640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134815d3b0 con 0x7f13480c3fd0 2024-04-18T04:54:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134fd13640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13480c5970 con 0x7f13480cacc0 2024-04-18T04:54:52.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134fd13640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13481594a0 con 0x7f13481532d0 2024-04-18T04:54:52.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134d2ae640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f13480cacc0 0x7f134815ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134d2ae640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f13480cacc0 0x7f134815ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38898/0 (socket says 172.21.15.96:38898) 2024-04-18T04:54:52.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134d2ae640 1 -- 172.21.15.96:0/1011996851 learned_addr learned my addr 172.21.15.96:0/1011996851 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:52.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134d2ae640 1 -- 172.21.15.96:0/1011996851 >> v2:172.21.15.139:3300/0 conn(0x7f13481532d0 msgr2=0x7f1348158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:52.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134daaf640 1 --2- 172.21.15.96:0/1011996851 >> v2:172.21.15.139:3300/0 conn(0x7f13481532d0 0x7f1348158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134d2ae640 1 --2- 172.21.15.96:0/1011996851 >> v2:172.21.15.139:3300/0 conn(0x7f13481532d0 0x7f1348158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134d2ae640 1 -- 172.21.15.96:0/1011996851 >> v1:172.21.15.139:6789/0 conn(0x7f13480c3fd0 legacy=0x7f13480ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:52.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134d2ae640 1 -- 172.21.15.96:0/1011996851 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13481536b0 con 0x7f13480cacc0 2024-04-18T04:54:52.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134d2ae640 1 --2- 172.21.15.96:0/1011996851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13480cacc0 0x7f134815ce70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f13480cc2d0 tx=0x7f133801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686057af78bcee6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134caad640 1 -- 172.21.15.96:0/1011996851 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380a89d0 con 0x7f13480cacc0 2024-04-18T04:54:52.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134caad640 1 -- 172.21.15.96:0/1011996851 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13380a8b30 con 0x7f13480cacc0 2024-04-18T04:54:52.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134caad640 1 -- 172.21.15.96:0/1011996851 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380b0440 con 0x7f13480cacc0 2024-04-18T04:54:52.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134fd13640 1 -- 172.21.15.96:0/1011996851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13480cacc0 msgr2=0x7f134815ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134fd13640 1 --2- 172.21.15.96:0/1011996851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13480cacc0 0x7f134815ce70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f13480cc2d0 tx=0x7f133801ecd0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134fd13640 1 -- 172.21.15.96:0/1011996851 shutdown_connections 2024-04-18T04:54:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134fd13640 1 --2- 172.21.15.96:0/1011996851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13480cacc0 0x7f134815ce70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134fd13640 1 --2- 172.21.15.96:0/1011996851 >> v2:172.21.15.139:3300/0 conn(0x7f13481532d0 0x7f1348158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134fd13640 1 -- 172.21.15.96:0/1011996851 >> 172.21.15.96:0/1011996851 conn(0x7f1348071760 msgr2=0x7f134806b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134fd13640 1 -- 172.21.15.96:0/1011996851 shutdown_connections 2024-04-18T04:54:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.695+0000 7f134fd13640 1 -- 172.21.15.96:0/1011996851 wait complete. 2024-04-18T04:54:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134fd13640 1 Processor -- start 2024-04-18T04:54:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134fd13640 1 -- start start 2024-04-18T04:54:52.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134fd13640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13480c3fd0 0x7f134814ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134fd13640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f13480cacc0 0x7f1348146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134fd13640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13481532d0 0x7f13481ee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134fd13640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1348159f20 con 0x7f13481532d0 2024-04-18T04:54:52.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134fd13640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1348158d20 con 0x7f13480c3fd0 2024-04-18T04:54:52.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134fd13640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1348158710 con 0x7f13480cacc0 2024-04-18T04:54:52.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134e2b0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13481532d0 0x7f13481ee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134e2b0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13481532d0 0x7f13481ee5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38914/0 (socket says 172.21.15.96:38914) 2024-04-18T04:54:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134e2b0640 1 -- 172.21.15.96:0/223683641 learned_addr learned my addr 172.21.15.96:0/223683641 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134daaf640 1 --2- 172.21.15.96:0/223683641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13480c3fd0 0x7f134814ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134d2ae640 1 --2- 172.21.15.96:0/223683641 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f13480cacc0 0x7f1348146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134e2b0640 1 -- 172.21.15.96:0/223683641 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f13480cacc0 msgr2=0x7f1348146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134e2b0640 1 --2- 172.21.15.96:0/223683641 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f13480cacc0 0x7f1348146450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134e2b0640 1 -- 172.21.15.96:0/223683641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13480c3fd0 msgr2=0x7f134814ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134e2b0640 1 --2- 172.21.15.96:0/223683641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13480c3fd0 0x7f134814ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134e2b0640 1 -- 172.21.15.96:0/223683641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13380094d0 con 0x7f13481532d0 2024-04-18T04:54:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134e2b0640 1 --2- 172.21.15.96:0/223683641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13481532d0 0x7f13481ee5f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f134000b990 tx=0x7f134000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f133e7fc640 1 -- 172.21.15.96:0/223683641 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134000cba0 con 0x7f13481532d0 2024-04-18T04:54:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f133e7fc640 1 -- 172.21.15.96:0/223683641 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134000cd00 con 0x7f13481532d0 2024-04-18T04:54:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134fd13640 1 -- 172.21.15.96:0/223683641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134814b370 con 0x7f13481532d0 2024-04-18T04:54:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f133e7fc640 1 -- 172.21.15.96:0/223683641 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340014680 con 0x7f13481532d0 2024-04-18T04:54:52.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134fd13640 1 -- 172.21.15.96:0/223683641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13480b4700 con 0x7f13481532d0 2024-04-18T04:54:52.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134fd13640 1 -- 172.21.15.96:0/223683641 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1348067050 con 0x7f13481532d0 2024-04-18T04:54:52.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f133e7fc640 1 -- 172.21.15.96:0/223683641 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f134001d3b0 con 0x7f13481532d0 2024-04-18T04:54:52.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f133e7fc640 1 --2- 172.21.15.96:0/223683641 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f132c0666c0 0x7f132c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:52.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f133e7fc640 1 -- 172.21.15.96:0/223683641 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13400840e0 con 0x7f13481532d0 2024-04-18T04:54:52.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.699+0000 7f134daaf640 1 --2- 172.21.15.96:0/223683641 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f132c0666c0 0x7f132c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:52.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.703+0000 7f134daaf640 1 --2- 172.21.15.96:0/223683641 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f132c0666c0 0x7f132c068b80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f134400b800 tx=0x7f1344008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.703+0000 7f133e7fc640 1 -- 172.21.15.96:0/223683641 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1340051450 con 0x7f13481532d0 2024-04-18T04:54:52.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.851+0000 7f134fd13640 1 -- 172.21.15.96:0/223683641 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1348159c40 con 0x7f132c0666c0 2024-04-18T04:54:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.855+0000 7f133e7fc640 1 -- 172.21.15.96:0/223683641 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264598 (secure 0 0 0) 0x7f134400c040 con 0x7f132c0666c0 2024-04-18T04:54:52.863 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:52.866 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T04:54:52.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.859+0000 7f134fd13640 1 -- 172.21.15.96:0/223683641 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f132c0666c0 msgr2=0x7f132c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.859+0000 7f134fd13640 1 --2- 172.21.15.96:0/223683641 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f132c0666c0 0x7f132c068b80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f134400b800 tx=0x7f1344008040 comp rx=0 tx=0).stop 2024-04-18T04:54:52.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.859+0000 7f134fd13640 1 -- 172.21.15.96:0/223683641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13481532d0 msgr2=0x7f13481ee5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:52.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.859+0000 7f134fd13640 1 --2- 172.21.15.96:0/223683641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13481532d0 0x7f13481ee5f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f134000b990 tx=0x7f134000be50 comp rx=0 tx=0).stop 2024-04-18T04:54:52.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.859+0000 7f134fd13640 1 -- 172.21.15.96:0/223683641 shutdown_connections 2024-04-18T04:54:52.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.859+0000 7f134fd13640 1 --2- 172.21.15.96:0/223683641 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f132c0666c0 0x7f132c068b80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.859+0000 7f134fd13640 1 --2- 172.21.15.96:0/223683641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13481532d0 0x7f13481ee5f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.859+0000 7f134fd13640 1 --2- 172.21.15.96:0/223683641 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f13480cacc0 0x7f1348146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.859+0000 7f134fd13640 1 --2- 172.21.15.96:0/223683641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13480c3fd0 0x7f134814ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:52.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.859+0000 7f134fd13640 1 -- 172.21.15.96:0/223683641 >> 172.21.15.96:0/223683641 conn(0x7f1348071760 msgr2=0x7f13480ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:52.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.859+0000 7f134fd13640 1 -- 172.21.15.96:0/223683641 shutdown_connections 2024-04-18T04:54:52.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:52.859+0000 7f134fd13640 1 -- 172.21.15.96:0/223683641 wait complete. 2024-04-18T04:54:52.878 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-18T04:54:52.570984+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217956,"kb_used_data":1824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756764,"statfs":{"total":773094113280,"available":772870926336,"internally_reserved":0,"allocated":1867776,"data_stored":1770172,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.406305"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323999+0000","last_change":"2024-04-18T04:54:41.199306+0000","last_active":"2024-04-18T04:54:42.323999+0000","last_peered":"2024-04-18T04:54:42.323999+0000","last_clean":"2024-04-18T04:54:42.323999+0000","last_became_active":"2024-04-18T04:54:41.199046+0000","last_became_peered":"2024-04-18T04:54:41.199046+0000","last_unstale":"2024-04-18T04:54:42.323999+0000","last_undegraded":"2024-04-18T04:54:42.323999+0000","last_fullsized":"2024-04-18T04:54:42.323999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169848+0000","last_change":"2024-04-18T04:54:41.200447+0000","last_active":"2024-04-18T04:54:42.169848+0000","last_peered":"2024-04-18T04:54:42.169848+0000","last_clean":"2024-04-18T04:54:42.169848+0000","last_became_active":"2024-04-18T04:54:41.200136+0000","last_became_peered":"2024-04-18T04:54:41.200136+0000","last_unstale":"2024-04-18T04:54:42.169848+0000","last_undegraded":"2024-04-18T04:54:42.169848+0000","last_fullsized":"2024-04-18T04:54:42.169848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169517+0000","last_change":"2024-04-18T04:54:41.185987+0000","last_active":"2024-04-18T04:54:42.169517+0000","last_peered":"2024-04-18T04:54:42.169517+0000","last_clean":"2024-04-18T04:54:42.169517+0000","last_became_active":"2024-04-18T04:54:41.185206+0000","last_became_peered":"2024-04-18T04:54:41.185206+0000","last_unstale":"2024-04-18T04:54:42.169517+0000","last_undegraded":"2024-04-18T04:54:42.169517+0000","last_fullsized":"2024-04-18T04:54:42.169517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453954+0000","last_change":"2024-04-18T04:54:41.177487+0000","last_active":"2024-04-18T04:54:42.453954+0000","last_peered":"2024-04-18T04:54:42.453954+0000","last_clean":"2024-04-18T04:54:42.453954+0000","last_became_active":"2024-04-18T04:54:41.177217+0000","last_became_peered":"2024-04-18T04:54:41.177217+0000","last_unstale":"2024-04-18T04:54:42.453954+0000","last_undegraded":"2024-04-18T04:54:42.453954+0000","last_fullsized":"2024-04-18T04:54:42.453954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:08.067252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323329+0000","last_change":"2024-04-18T04:54:41.186573+0000","last_active":"2024-04-18T04:54:42.323329+0000","last_peered":"2024-04-18T04:54:42.323329+0000","last_clean":"2024-04-18T04:54:42.323329+0000","last_became_active":"2024-04-18T04:54:41.186027+0000","last_became_peered":"2024-04-18T04:54:41.186027+0000","last_unstale":"2024-04-18T04:54:42.323329+0000","last_undegraded":"2024-04-18T04:54:42.323329+0000","last_fullsized":"2024-04-18T04:54:42.323329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453454+0000","last_change":"2024-04-18T04:54:41.177550+0000","last_active":"2024-04-18T04:54:42.453454+0000","last_peered":"2024-04-18T04:54:42.453454+0000","last_clean":"2024-04-18T04:54:42.453454+0000","last_became_active":"2024-04-18T04:54:41.177215+0000","last_became_peered":"2024-04-18T04:54:41.177215+0000","last_unstale":"2024-04-18T04:54:42.453454+0000","last_undegraded":"2024-04-18T04:54:42.453454+0000","last_fullsized":"2024-04-18T04:54:42.453454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:26.266600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323158+0000","last_change":"2024-04-18T04:54:41.178605+0000","last_active":"2024-04-18T04:54:42.323158+0000","last_peered":"2024-04-18T04:54:42.323158+0000","last_clean":"2024-04-18T04:54:42.323158+0000","last_became_active":"2024-04-18T04:54:41.178094+0000","last_became_peered":"2024-04-18T04:54:41.178094+0000","last_unstale":"2024-04-18T04:54:42.323158+0000","last_undegraded":"2024-04-18T04:54:42.323158+0000","last_fullsized":"2024-04-18T04:54:42.323158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169250+0000","last_change":"2024-04-18T04:54:41.193174+0000","last_active":"2024-04-18T04:54:42.169250+0000","last_peered":"2024-04-18T04:54:42.169250+0000","last_clean":"2024-04-18T04:54:42.169250+0000","last_became_active":"2024-04-18T04:54:41.192678+0000","last_became_peered":"2024-04-18T04:54:41.192678+0000","last_unstale":"2024-04-18T04:54:42.169250+0000","last_undegraded":"2024-04-18T04:54:42.169250+0000","last_fullsized":"2024-04-18T04:54:42.169250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167601+0000","last_change":"2024-04-18T04:54:41.198121+0000","last_active":"2024-04-18T04:54:42.167601+0000","last_peered":"2024-04-18T04:54:42.167601+0000","last_clean":"2024-04-18T04:54:42.167601+0000","last_became_active":"2024-04-18T04:54:41.197832+0000","last_became_peered":"2024-04-18T04:54:41.197832+0000","last_unstale":"2024-04-18T04:54:42.167601+0000","last_undegraded":"2024-04-18T04:54:42.167601+0000","last_fullsized":"2024-04-18T04:54:42.167601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.835581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323925+0000","last_change":"2024-04-18T04:54:41.183032+0000","last_active":"2024-04-18T04:54:42.323925+0000","last_peered":"2024-04-18T04:54:42.323925+0000","last_clean":"2024-04-18T04:54:42.323925+0000","last_became_active":"2024-04-18T04:54:41.182698+0000","last_became_peered":"2024-04-18T04:54:41.182698+0000","last_unstale":"2024-04-18T04:54:42.323925+0000","last_undegraded":"2024-04-18T04:54:42.323925+0000","last_fullsized":"2024-04-18T04:54:42.323925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323788+0000","last_change":"2024-04-18T04:54:41.187831+0000","last_active":"2024-04-18T04:54:42.323788+0000","last_peered":"2024-04-18T04:54:42.323788+0000","last_clean":"2024-04-18T04:54:42.323788+0000","last_became_active":"2024-04-18T04:54:41.187360+0000","last_became_peered":"2024-04-18T04:54:41.187360+0000","last_unstale":"2024-04-18T04:54:42.323788+0000","last_undegraded":"2024-04-18T04:54:42.323788+0000","last_fullsized":"2024-04-18T04:54:42.323788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323367+0000","last_change":"2024-04-18T04:54:41.188641+0000","last_active":"2024-04-18T04:54:42.323367+0000","last_peered":"2024-04-18T04:54:42.323367+0000","last_clean":"2024-04-18T04:54:42.323367+0000","last_became_active":"2024-04-18T04:54:41.188281+0000","last_became_peered":"2024-04-18T04:54:41.188281+0000","last_unstale":"2024-04-18T04:54:42.323367+0000","last_undegraded":"2024-04-18T04:54:42.323367+0000","last_fullsized":"2024-04-18T04:54:42.323367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455946+0000","last_change":"2024-04-18T04:54:41.194578+0000","last_active":"2024-04-18T04:54:42.455946+0000","last_peered":"2024-04-18T04:54:42.455946+0000","last_clean":"2024-04-18T04:54:42.455946+0000","last_became_active":"2024-04-18T04:54:41.190882+0000","last_became_peered":"2024-04-18T04:54:41.190882+0000","last_unstale":"2024-04-18T04:54:42.455946+0000","last_undegraded":"2024-04-18T04:54:42.455946+0000","last_fullsized":"2024-04-18T04:54:42.455946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:45:52.041196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455376+0000","last_change":"2024-04-18T04:54:41.190210+0000","last_active":"2024-04-18T04:54:42.455376+0000","last_peered":"2024-04-18T04:54:42.455376+0000","last_clean":"2024-04-18T04:54:42.455376+0000","last_became_active":"2024-04-18T04:54:41.189813+0000","last_became_peered":"2024-04-18T04:54:41.189813+0000","last_unstale":"2024-04-18T04:54:42.455376+0000","last_undegraded":"2024-04-18T04:54:42.455376+0000","last_fullsized":"2024-04-18T04:54:42.455376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:38:02.632458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169188+0000","last_change":"2024-04-18T04:54:41.183027+0000","last_active":"2024-04-18T04:54:42.169188+0000","last_peered":"2024-04-18T04:54:42.169188+0000","last_clean":"2024-04-18T04:54:42.169188+0000","last_became_active":"2024-04-18T04:54:41.182713+0000","last_became_peered":"2024-04-18T04:54:41.182713+0000","last_unstale":"2024-04-18T04:54:42.169188+0000","last_undegraded":"2024-04-18T04:54:42.169188+0000","last_fullsized":"2024-04-18T04:54:42.169188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453959+0000","last_change":"2024-04-18T04:54:41.186060+0000","last_active":"2024-04-18T04:54:42.453959+0000","last_peered":"2024-04-18T04:54:42.453959+0000","last_clean":"2024-04-18T04:54:42.453959+0000","last_became_active":"2024-04-18T04:54:41.185803+0000","last_became_peered":"2024-04-18T04:54:41.185803+0000","last_unstale":"2024-04-18T04:54:42.453959+0000","last_undegraded":"2024-04-18T04:54:42.453959+0000","last_fullsized":"2024-04-18T04:54:42.453959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:48:04.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455728+0000","last_change":"2024-04-18T04:54:41.200802+0000","last_active":"2024-04-18T04:54:42.455728+0000","last_peered":"2024-04-18T04:54:42.455728+0000","last_clean":"2024-04-18T04:54:42.455728+0000","last_became_active":"2024-04-18T04:54:41.198404+0000","last_became_peered":"2024-04-18T04:54:41.198404+0000","last_unstale":"2024-04-18T04:54:42.455728+0000","last_undegraded":"2024-04-18T04:54:42.455728+0000","last_fullsized":"2024-04-18T04:54:42.455728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:56.686481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454830+0000","last_change":"2024-04-18T04:54:41.189568+0000","last_active":"2024-04-18T04:54:42.454830+0000","last_peered":"2024-04-18T04:54:42.454830+0000","last_clean":"2024-04-18T04:54:42.454830+0000","last_became_active":"2024-04-18T04:54:41.188139+0000","last_became_peered":"2024-04-18T04:54:41.188139+0000","last_unstale":"2024-04-18T04:54:42.454830+0000","last_undegraded":"2024-04-18T04:54:42.454830+0000","last_fullsized":"2024-04-18T04:54:42.454830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455410+0000","last_change":"2024-04-18T04:54:41.197901+0000","last_active":"2024-04-18T04:54:42.455410+0000","last_peered":"2024-04-18T04:54:42.455410+0000","last_clean":"2024-04-18T04:54:42.455410+0000","last_became_active":"2024-04-18T04:54:41.197235+0000","last_became_peered":"2024-04-18T04:54:41.197235+0000","last_unstale":"2024-04-18T04:54:42.455410+0000","last_undegraded":"2024-04-18T04:54:42.455410+0000","last_fullsized":"2024-04-18T04:54:42.455410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:41:20.213202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323339+0000","last_change":"2024-04-18T04:54:41.188440+0000","last_active":"2024-04-18T04:54:42.323339+0000","last_peered":"2024-04-18T04:54:42.323339+0000","last_clean":"2024-04-18T04:54:42.323339+0000","last_became_active":"2024-04-18T04:54:41.187925+0000","last_became_peered":"2024-04-18T04:54:41.187925+0000","last_unstale":"2024-04-18T04:54:42.323339+0000","last_undegraded":"2024-04-18T04:54:42.323339+0000","last_fullsized":"2024-04-18T04:54:42.323339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170212+0000","last_change":"2024-04-18T04:54:41.179672+0000","last_active":"2024-04-18T04:54:42.170212+0000","last_peered":"2024-04-18T04:54:42.170212+0000","last_clean":"2024-04-18T04:54:42.170212+0000","last_became_active":"2024-04-18T04:54:41.178963+0000","last_became_peered":"2024-04-18T04:54:41.178963+0000","last_unstale":"2024-04-18T04:54:42.170212+0000","last_undegraded":"2024-04-18T04:54:42.170212+0000","last_fullsized":"2024-04-18T04:54:42.170212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:56:31.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167152+0000","last_change":"2024-04-18T04:54:41.182902+0000","last_active":"2024-04-18T04:54:42.167152+0000","last_peered":"2024-04-18T04:54:42.167152+0000","last_clean":"2024-04-18T04:54:42.167152+0000","last_became_active":"2024-04-18T04:54:41.182664+0000","last_became_peered":"2024-04-18T04:54:41.182664+0000","last_unstale":"2024-04-18T04:54:42.167152+0000","last_undegraded":"2024-04-18T04:54:42.167152+0000","last_fullsized":"2024-04-18T04:54:42.167152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:56.408926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169624+0000","last_change":"2024-04-18T04:54:41.187578+0000","last_active":"2024-04-18T04:54:42.169624+0000","last_peered":"2024-04-18T04:54:42.169624+0000","last_clean":"2024-04-18T04:54:42.169624+0000","last_became_active":"2024-04-18T04:54:41.186881+0000","last_became_peered":"2024-04-18T04:54:41.186881+0000","last_unstale":"2024-04-18T04:54:42.169624+0000","last_undegraded":"2024-04-18T04:54:42.169624+0000","last_fullsized":"2024-04-18T04:54:42.169624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:27.817916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454216+0000","last_change":"2024-04-18T04:54:41.193206+0000","last_active":"2024-04-18T04:54:42.454216+0000","last_peered":"2024-04-18T04:54:42.454216+0000","last_clean":"2024-04-18T04:54:42.454216+0000","last_became_active":"2024-04-18T04:54:41.192740+0000","last_became_peered":"2024-04-18T04:54:41.192740+0000","last_unstale":"2024-04-18T04:54:42.454216+0000","last_undegraded":"2024-04-18T04:54:42.454216+0000","last_fullsized":"2024-04-18T04:54:42.454216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:51:34.311826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169844+0000","last_change":"2024-04-18T04:54:41.192785+0000","last_active":"2024-04-18T04:54:42.169844+0000","last_peered":"2024-04-18T04:54:42.169844+0000","last_clean":"2024-04-18T04:54:42.169844+0000","last_became_active":"2024-04-18T04:54:41.192280+0000","last_became_peered":"2024-04-18T04:54:41.192280+0000","last_unstale":"2024-04-18T04:54:42.169844+0000","last_undegraded":"2024-04-18T04:54:42.169844+0000","last_fullsized":"2024-04-18T04:54:42.169844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454615+0000","last_change":"2024-04-18T04:54:41.193920+0000","last_active":"2024-04-18T04:54:42.454615+0000","last_peered":"2024-04-18T04:54:42.454615+0000","last_clean":"2024-04-18T04:54:42.454615+0000","last_became_active":"2024-04-18T04:54:41.193660+0000","last_became_peered":"2024-04-18T04:54:41.193660+0000","last_unstale":"2024-04-18T04:54:42.454615+0000","last_undegraded":"2024-04-18T04:54:42.454615+0000","last_fullsized":"2024-04-18T04:54:42.454615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:22.072498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.456447+0000","last_change":"2024-04-18T04:54:41.190298+0000","last_active":"2024-04-18T04:54:42.456447+0000","last_peered":"2024-04-18T04:54:42.456447+0000","last_clean":"2024-04-18T04:54:42.456447+0000","last_became_active":"2024-04-18T04:54:41.189374+0000","last_became_peered":"2024-04-18T04:54:41.189374+0000","last_unstale":"2024-04-18T04:54:42.456447+0000","last_undegraded":"2024-04-18T04:54:42.456447+0000","last_fullsized":"2024-04-18T04:54:42.456447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455999+0000","last_change":"2024-04-18T04:54:41.190403+0000","last_active":"2024-04-18T04:54:42.455999+0000","last_peered":"2024-04-18T04:54:42.455999+0000","last_clean":"2024-04-18T04:54:42.455999+0000","last_became_active":"2024-04-18T04:54:41.189660+0000","last_became_peered":"2024-04-18T04:54:41.189660+0000","last_unstale":"2024-04-18T04:54:42.455999+0000","last_undegraded":"2024-04-18T04:54:42.455999+0000","last_fullsized":"2024-04-18T04:54:42.455999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:34.259279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169947+0000","last_change":"2024-04-18T04:54:41.187370+0000","last_active":"2024-04-18T04:54:42.169947+0000","last_peered":"2024-04-18T04:54:42.169947+0000","last_clean":"2024-04-18T04:54:42.169947+0000","last_became_active":"2024-04-18T04:54:41.186901+0000","last_became_peered":"2024-04-18T04:54:41.186901+0000","last_unstale":"2024-04-18T04:54:42.169947+0000","last_undegraded":"2024-04-18T04:54:42.169947+0000","last_fullsized":"2024-04-18T04:54:42.169947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454539+0000","last_change":"2024-04-18T04:54:41.192719+0000","last_active":"2024-04-18T04:54:42.454539+0000","last_peered":"2024-04-18T04:54:42.454539+0000","last_clean":"2024-04-18T04:54:42.454539+0000","last_became_active":"2024-04-18T04:54:41.192114+0000","last_became_peered":"2024-04-18T04:54:41.192114+0000","last_unstale":"2024-04-18T04:54:42.454539+0000","last_undegraded":"2024-04-18T04:54:42.454539+0000","last_fullsized":"2024-04-18T04:54:42.454539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:33:21.965783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454128+0000","last_change":"2024-04-18T04:54:41.186276+0000","last_active":"2024-04-18T04:54:42.454128+0000","last_peered":"2024-04-18T04:54:42.454128+0000","last_clean":"2024-04-18T04:54:42.454128+0000","last_became_active":"2024-04-18T04:54:41.185915+0000","last_became_peered":"2024-04-18T04:54:41.185915+0000","last_unstale":"2024-04-18T04:54:42.454128+0000","last_undegraded":"2024-04-18T04:54:42.454128+0000","last_fullsized":"2024-04-18T04:54:42.454128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453190+0000","last_change":"2024-04-18T04:54:41.190283+0000","last_active":"2024-04-18T04:54:42.453190+0000","last_peered":"2024-04-18T04:54:42.453190+0000","last_clean":"2024-04-18T04:54:42.453190+0000","last_became_active":"2024-04-18T04:54:41.189892+0000","last_became_peered":"2024-04-18T04:54:41.189892+0000","last_unstale":"2024-04-18T04:54:42.453190+0000","last_undegraded":"2024-04-18T04:54:42.453190+0000","last_fullsized":"2024-04-18T04:54:42.453190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:53.175178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167307+0000","last_change":"2024-04-18T04:54:41.187326+0000","last_active":"2024-04-18T04:54:42.167307+0000","last_peered":"2024-04-18T04:54:42.167307+0000","last_clean":"2024-04-18T04:54:42.167307+0000","last_became_active":"2024-04-18T04:54:41.187001+0000","last_became_peered":"2024-04-18T04:54:41.187001+0000","last_unstale":"2024-04-18T04:54:42.167307+0000","last_undegraded":"2024-04-18T04:54:42.167307+0000","last_fullsized":"2024-04-18T04:54:42.167307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170150+0000","last_change":"2024-04-18T04:54:40.824658+0000","last_active":"2024-04-18T04:54:42.170150+0000","last_peered":"2024-04-18T04:54:42.170150+0000","last_clean":"2024-04-18T04:54:42.170150+0000","last_became_active":"2024-04-18T04:54:40.823652+0000","last_became_peered":"2024-04-18T04:54:40.823652+0000","last_unstale":"2024-04-18T04:54:42.170150+0000","last_undegraded":"2024-04-18T04:54:42.170150+0000","last_fullsized":"2024-04-18T04:54:42.170150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170634+0000","last_change":"2024-04-18T04:54:41.184497+0000","last_active":"2024-04-18T04:54:42.170634+0000","last_peered":"2024-04-18T04:54:42.170634+0000","last_clean":"2024-04-18T04:54:42.170634+0000","last_became_active":"2024-04-18T04:54:41.182180+0000","last_became_peered":"2024-04-18T04:54:41.182180+0000","last_unstale":"2024-04-18T04:54:42.170634+0000","last_undegraded":"2024-04-18T04:54:42.170634+0000","last_fullsized":"2024-04-18T04:54:42.170634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:25:15.707596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454777+0000","last_change":"2024-04-18T04:54:40.803244+0000","last_active":"2024-04-18T04:54:42.454777+0000","last_peered":"2024-04-18T04:54:42.454777+0000","last_clean":"2024-04-18T04:54:42.454777+0000","last_became_active":"2024-04-18T04:54:40.802672+0000","last_became_peered":"2024-04-18T04:54:40.802672+0000","last_unstale":"2024-04-18T04:54:42.454777+0000","last_undegraded":"2024-04-18T04:54:42.454777+0000","last_fullsized":"2024-04-18T04:54:42.454777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:56.851301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.171919+0000","last_change":"2024-04-18T04:54:40.823675+0000","last_active":"2024-04-18T04:54:41.171919+0000","last_peered":"2024-04-18T04:54:41.171919+0000","last_clean":"2024-04-18T04:54:41.171919+0000","last_became_active":"2024-04-18T04:54:40.823091+0000","last_became_peered":"2024-04-18T04:54:40.823091+0000","last_unstale":"2024-04-18T04:54:41.171919+0000","last_undegraded":"2024-04-18T04:54:41.171919+0000","last_fullsized":"2024-04-18T04:54:41.171919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169532+0000","last_change":"2024-04-18T04:54:41.200326+0000","last_active":"2024-04-18T04:54:42.169532+0000","last_peered":"2024-04-18T04:54:42.169532+0000","last_clean":"2024-04-18T04:54:42.169532+0000","last_became_active":"2024-04-18T04:54:41.199690+0000","last_became_peered":"2024-04-18T04:54:41.199690+0000","last_unstale":"2024-04-18T04:54:42.169532+0000","last_undegraded":"2024-04-18T04:54:42.169532+0000","last_fullsized":"2024-04-18T04:54:42.169532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.185487+0000","last_change":"2024-04-18T04:54:40.805264+0000","last_active":"2024-04-18T04:54:41.185487+0000","last_peered":"2024-04-18T04:54:41.185487+0000","last_clean":"2024-04-18T04:54:41.185487+0000","last_became_active":"2024-04-18T04:54:40.804605+0000","last_became_peered":"2024-04-18T04:54:40.804605+0000","last_unstale":"2024-04-18T04:54:41.185487+0000","last_undegraded":"2024-04-18T04:54:41.185487+0000","last_fullsized":"2024-04-18T04:54:41.185487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:48.991270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.171188+0000","last_change":"2024-04-18T04:54:41.175359+0000","last_active":"2024-04-18T04:54:42.171188+0000","last_peered":"2024-04-18T04:54:42.171188+0000","last_clean":"2024-04-18T04:54:42.171188+0000","last_became_active":"2024-04-18T04:54:41.175137+0000","last_became_peered":"2024-04-18T04:54:41.175137+0000","last_unstale":"2024-04-18T04:54:42.171188+0000","last_undegraded":"2024-04-18T04:54:42.171188+0000","last_fullsized":"2024-04-18T04:54:42.171188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:06:24.271204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.164938+0000","last_change":"2024-04-18T04:54:40.798936+0000","last_active":"2024-04-18T04:54:41.164938+0000","last_peered":"2024-04-18T04:54:41.164938+0000","last_clean":"2024-04-18T04:54:41.164938+0000","last_became_active":"2024-04-18T04:54:40.798572+0000","last_became_peered":"2024-04-18T04:54:40.798572+0000","last_unstale":"2024-04-18T04:54:41.164938+0000","last_undegraded":"2024-04-18T04:54:41.164938+0000","last_fullsized":"2024-04-18T04:54:41.164938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454742+0000","last_change":"2024-04-18T04:54:41.188280+0000","last_active":"2024-04-18T04:54:42.454742+0000","last_peered":"2024-04-18T04:54:42.454742+0000","last_clean":"2024-04-18T04:54:42.454742+0000","last_became_active":"2024-04-18T04:54:41.188012+0000","last_became_peered":"2024-04-18T04:54:41.188012+0000","last_unstale":"2024-04-18T04:54:42.454742+0000","last_undegraded":"2024-04-18T04:54:42.454742+0000","last_fullsized":"2024-04-18T04:54:42.454742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:11.319118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.174130+0000","last_change":"2024-04-18T04:54:40.802894+0000","last_active":"2024-04-18T04:54:41.174130+0000","last_peered":"2024-04-18T04:54:41.174130+0000","last_clean":"2024-04-18T04:54:41.174130+0000","last_became_active":"2024-04-18T04:54:40.801406+0000","last_became_peered":"2024-04-18T04:54:40.801406+0000","last_unstale":"2024-04-18T04:54:41.174130+0000","last_undegraded":"2024-04-18T04:54:41.174130+0000","last_fullsized":"2024-04-18T04:54:41.174130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170319+0000","last_change":"2024-04-18T04:54:41.203407+0000","last_active":"2024-04-18T04:54:42.170319+0000","last_peered":"2024-04-18T04:54:42.170319+0000","last_clean":"2024-04-18T04:54:42.170319+0000","last_became_active":"2024-04-18T04:54:41.203186+0000","last_became_peered":"2024-04-18T04:54:41.203186+0000","last_unstale":"2024-04-18T04:54:42.170319+0000","last_undegraded":"2024-04-18T04:54:42.170319+0000","last_fullsized":"2024-04-18T04:54:42.170319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:23:50.107054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.186282+0000","last_change":"2024-04-18T04:54:40.822014+0000","last_active":"2024-04-18T04:54:46.186282+0000","last_peered":"2024-04-18T04:54:46.186282+0000","last_clean":"2024-04-18T04:54:46.186282+0000","last_became_active":"2024-04-18T04:54:40.820920+0000","last_became_peered":"2024-04-18T04:54:40.820920+0000","last_unstale":"2024-04-18T04:54:46.186282+0000","last_undegraded":"2024-04-18T04:54:46.186282+0000","last_fullsized":"2024-04-18T04:54:46.186282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455233+0000","last_change":"2024-04-18T04:54:41.197254+0000","last_active":"2024-04-18T04:54:42.455233+0000","last_peered":"2024-04-18T04:54:42.455233+0000","last_clean":"2024-04-18T04:54:42.455233+0000","last_became_active":"2024-04-18T04:54:41.196927+0000","last_became_peered":"2024-04-18T04:54:41.196927+0000","last_unstale":"2024-04-18T04:54:42.455233+0000","last_undegraded":"2024-04-18T04:54:42.455233+0000","last_fullsized":"2024-04-18T04:54:42.455233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:01:45.182766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.188149+0000","last_change":"2024-04-18T04:54:40.801789+0000","last_active":"2024-04-18T04:54:46.188149+0000","last_peered":"2024-04-18T04:54:46.188149+0000","last_clean":"2024-04-18T04:54:46.188149+0000","last_became_active":"2024-04-18T04:54:40.801403+0000","last_became_peered":"2024-04-18T04:54:40.801403+0000","last_unstale":"2024-04-18T04:54:46.188149+0000","last_undegraded":"2024-04-18T04:54:46.188149+0000","last_fullsized":"2024-04-18T04:54:46.188149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:15:11.220095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323817+0000","last_change":"2024-04-18T04:54:41.195518+0000","last_active":"2024-04-18T04:54:42.323817+0000","last_peered":"2024-04-18T04:54:42.323817+0000","last_clean":"2024-04-18T04:54:42.323817+0000","last_became_active":"2024-04-18T04:54:41.195172+0000","last_became_peered":"2024-04-18T04:54:41.195172+0000","last_unstale":"2024-04-18T04:54:42.323817+0000","last_undegraded":"2024-04-18T04:54:42.323817+0000","last_fullsized":"2024-04-18T04:54:42.323817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.182275+0000","last_change":"2024-04-18T04:54:40.818390+0000","last_active":"2024-04-18T04:54:46.182275+0000","last_peered":"2024-04-18T04:54:46.182275+0000","last_clean":"2024-04-18T04:54:46.182275+0000","last_became_active":"2024-04-18T04:54:40.817681+0000","last_became_peered":"2024-04-18T04:54:40.817681+0000","last_unstale":"2024-04-18T04:54:46.182275+0000","last_undegraded":"2024-04-18T04:54:46.182275+0000","last_fullsized":"2024-04-18T04:54:46.182275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455448+0000","last_change":"2024-04-18T04:54:41.194807+0000","last_active":"2024-04-18T04:54:42.455448+0000","last_peered":"2024-04-18T04:54:42.455448+0000","last_clean":"2024-04-18T04:54:42.455448+0000","last_became_active":"2024-04-18T04:54:41.194499+0000","last_became_peered":"2024-04-18T04:54:41.194499+0000","last_unstale":"2024-04-18T04:54:42.455448+0000","last_undegraded":"2024-04-18T04:54:42.455448+0000","last_fullsized":"2024-04-18T04:54:42.455448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.179340+0000","last_change":"2024-04-18T04:54:40.817631+0000","last_active":"2024-04-18T04:54:41.179340+0000","last_peered":"2024-04-18T04:54:41.179340+0000","last_clean":"2024-04-18T04:54:41.179340+0000","last_became_active":"2024-04-18T04:54:40.817370+0000","last_became_peered":"2024-04-18T04:54:40.817370+0000","last_unstale":"2024-04-18T04:54:41.179340+0000","last_undegraded":"2024-04-18T04:54:41.179340+0000","last_fullsized":"2024-04-18T04:54:41.179340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454210+0000","last_change":"2024-04-18T04:54:41.193363+0000","last_active":"2024-04-18T04:54:42.454210+0000","last_peered":"2024-04-18T04:54:42.454210+0000","last_clean":"2024-04-18T04:54:42.454210+0000","last_became_active":"2024-04-18T04:54:41.192889+0000","last_became_peered":"2024-04-18T04:54:41.192889+0000","last_unstale":"2024-04-18T04:54:42.454210+0000","last_undegraded":"2024-04-18T04:54:42.454210+0000","last_fullsized":"2024-04-18T04:54:42.454210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.173292+0000","last_change":"2024-04-18T04:54:40.806633+0000","last_active":"2024-04-18T04:54:41.173292+0000","last_peered":"2024-04-18T04:54:41.173292+0000","last_clean":"2024-04-18T04:54:41.173292+0000","last_became_active":"2024-04-18T04:54:40.805965+0000","last_became_peered":"2024-04-18T04:54:40.805965+0000","last_unstale":"2024-04-18T04:54:41.173292+0000","last_undegraded":"2024-04-18T04:54:41.173292+0000","last_fullsized":"2024-04-18T04:54:41.173292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167013+0000","last_change":"2024-04-18T04:54:41.184321+0000","last_active":"2024-04-18T04:54:42.167013+0000","last_peered":"2024-04-18T04:54:42.167013+0000","last_clean":"2024-04-18T04:54:42.167013+0000","last_became_active":"2024-04-18T04:54:41.183838+0000","last_became_peered":"2024-04-18T04:54:41.183838+0000","last_unstale":"2024-04-18T04:54:42.167013+0000","last_undegraded":"2024-04-18T04:54:42.167013+0000","last_fullsized":"2024-04-18T04:54:42.167013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.187534+0000","last_change":"2024-04-18T04:54:40.818954+0000","last_active":"2024-04-18T04:54:46.187534+0000","last_peered":"2024-04-18T04:54:46.187534+0000","last_clean":"2024-04-18T04:54:46.187534+0000","last_became_active":"2024-04-18T04:54:40.818227+0000","last_became_peered":"2024-04-18T04:54:40.818227+0000","last_unstale":"2024-04-18T04:54:46.187534+0000","last_undegraded":"2024-04-18T04:54:46.187534+0000","last_fullsized":"2024-04-18T04:54:46.187534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:25.263089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454553+0000","last_change":"2024-04-18T04:54:41.192227+0000","last_active":"2024-04-18T04:54:42.454553+0000","last_peered":"2024-04-18T04:54:42.454553+0000","last_clean":"2024-04-18T04:54:42.454553+0000","last_became_active":"2024-04-18T04:54:41.187002+0000","last_became_peered":"2024-04-18T04:54:41.187002+0000","last_unstale":"2024-04-18T04:54:42.454553+0000","last_undegraded":"2024-04-18T04:54:42.454553+0000","last_fullsized":"2024-04-18T04:54:42.454553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.324159+0000","last_change":"2024-04-18T04:54:40.805795+0000","last_active":"2024-04-18T04:54:42.324159+0000","last_peered":"2024-04-18T04:54:42.324159+0000","last_clean":"2024-04-18T04:54:42.324159+0000","last_became_active":"2024-04-18T04:54:40.802550+0000","last_became_peered":"2024-04-18T04:54:40.802550+0000","last_unstale":"2024-04-18T04:54:42.324159+0000","last_undegraded":"2024-04-18T04:54:42.324159+0000","last_fullsized":"2024-04-18T04:54:42.324159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454849+0000","last_change":"2024-04-18T04:54:41.180426+0000","last_active":"2024-04-18T04:54:42.454849+0000","last_peered":"2024-04-18T04:54:42.454849+0000","last_clean":"2024-04-18T04:54:42.454849+0000","last_became_active":"2024-04-18T04:54:41.179540+0000","last_became_peered":"2024-04-18T04:54:41.179540+0000","last_unstale":"2024-04-18T04:54:42.454849+0000","last_undegraded":"2024-04-18T04:54:42.454849+0000","last_fullsized":"2024-04-18T04:54:42.454849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:38:25.074053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.180573+0000","last_change":"2024-04-18T04:54:40.804284+0000","last_active":"2024-04-18T04:54:46.180573+0000","last_peered":"2024-04-18T04:54:46.180573+0000","last_clean":"2024-04-18T04:54:46.180573+0000","last_became_active":"2024-04-18T04:54:40.803464+0000","last_became_peered":"2024-04-18T04:54:40.803464+0000","last_unstale":"2024-04-18T04:54:46.180573+0000","last_undegraded":"2024-04-18T04:54:46.180573+0000","last_fullsized":"2024-04-18T04:54:46.180573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:52.171667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.324196+0000","last_change":"2024-04-18T04:54:41.188591+0000","last_active":"2024-04-18T04:54:42.324196+0000","last_peered":"2024-04-18T04:54:42.324196+0000","last_clean":"2024-04-18T04:54:42.324196+0000","last_became_active":"2024-04-18T04:54:41.188152+0000","last_became_peered":"2024-04-18T04:54:41.188152+0000","last_unstale":"2024-04-18T04:54:42.324196+0000","last_undegraded":"2024-04-18T04:54:42.324196+0000","last_fullsized":"2024-04-18T04:54:42.324196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169752+0000","last_change":"2024-04-18T04:54:40.814901+0000","last_active":"2024-04-18T04:54:42.169752+0000","last_peered":"2024-04-18T04:54:42.169752+0000","last_clean":"2024-04-18T04:54:42.169752+0000","last_became_active":"2024-04-18T04:54:40.814207+0000","last_became_peered":"2024-04-18T04:54:40.814207+0000","last_unstale":"2024-04-18T04:54:42.169752+0000","last_undegraded":"2024-04-18T04:54:42.169752+0000","last_fullsized":"2024-04-18T04:54:42.169752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323473+0000","last_change":"2024-04-18T04:54:41.188664+0000","last_active":"2024-04-18T04:54:42.323473+0000","last_peered":"2024-04-18T04:54:42.323473+0000","last_clean":"2024-04-18T04:54:42.323473+0000","last_became_active":"2024-04-18T04:54:41.188249+0000","last_became_peered":"2024-04-18T04:54:41.188249+0000","last_unstale":"2024-04-18T04:54:42.323473+0000","last_undegraded":"2024-04-18T04:54:42.323473+0000","last_fullsized":"2024-04-18T04:54:42.323473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.173221+0000","last_change":"2024-04-18T04:54:40.828447+0000","last_active":"2024-04-18T04:54:41.173221+0000","last_peered":"2024-04-18T04:54:41.173221+0000","last_clean":"2024-04-18T04:54:41.173221+0000","last_became_active":"2024-04-18T04:54:40.823755+0000","last_became_peered":"2024-04-18T04:54:40.823755+0000","last_unstale":"2024-04-18T04:54:41.173221+0000","last_undegraded":"2024-04-18T04:54:41.173221+0000","last_fullsized":"2024-04-18T04:54:41.173221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455365+0000","last_change":"2024-04-18T04:54:41.186523+0000","last_active":"2024-04-18T04:54:42.455365+0000","last_peered":"2024-04-18T04:54:42.455365+0000","last_clean":"2024-04-18T04:54:42.455365+0000","last_became_active":"2024-04-18T04:54:41.186149+0000","last_became_peered":"2024-04-18T04:54:41.186149+0000","last_unstale":"2024-04-18T04:54:42.455365+0000","last_undegraded":"2024-04-18T04:54:42.455365+0000","last_fullsized":"2024-04-18T04:54:42.455365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.164056+0000","last_change":"2024-04-18T04:54:35.674328+0000","last_active":"2024-04-18T04:54:41.164056+0000","last_peered":"2024-04-18T04:54:41.164056+0000","last_clean":"2024-04-18T04:54:41.164056+0000","last_became_active":"2024-04-18T04:54:35.672457+0000","last_became_peered":"2024-04-18T04:54:35.672457+0000","last_unstale":"2024-04-18T04:54:41.164056+0000","last_undegraded":"2024-04-18T04:54:41.164056+0000","last_fullsized":"2024-04-18T04:54:41.164056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_clean_scrub_stamp":"2024-04-18T04:54:33.597974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:02:10.966568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.178915+0000","last_change":"2024-04-18T04:54:40.802422+0000","last_active":"2024-04-18T04:54:41.178915+0000","last_peered":"2024-04-18T04:54:41.178915+0000","last_clean":"2024-04-18T04:54:41.178915+0000","last_became_active":"2024-04-18T04:54:40.801083+0000","last_became_peered":"2024-04-18T04:54:40.801083+0000","last_unstale":"2024-04-18T04:54:41.178915+0000","last_undegraded":"2024-04-18T04:54:41.178915+0000","last_fullsized":"2024-04-18T04:54:41.178915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170437+0000","last_change":"2024-04-18T04:54:41.174658+0000","last_active":"2024-04-18T04:54:42.170437+0000","last_peered":"2024-04-18T04:54:42.170437+0000","last_clean":"2024-04-18T04:54:42.170437+0000","last_became_active":"2024-04-18T04:54:41.174391+0000","last_became_peered":"2024-04-18T04:54:41.174391+0000","last_unstale":"2024-04-18T04:54:42.170437+0000","last_undegraded":"2024-04-18T04:54:42.170437+0000","last_fullsized":"2024-04-18T04:54:42.170437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:28:24.015964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.185583+0000","last_change":"2024-04-18T04:54:40.813770+0000","last_active":"2024-04-18T04:54:41.185583+0000","last_peered":"2024-04-18T04:54:41.185583+0000","last_clean":"2024-04-18T04:54:41.185583+0000","last_became_active":"2024-04-18T04:54:40.813396+0000","last_became_peered":"2024-04-18T04:54:40.813396+0000","last_unstale":"2024-04-18T04:54:41.185583+0000","last_undegraded":"2024-04-18T04:54:41.185583+0000","last_fullsized":"2024-04-18T04:54:41.185583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455360+0000","last_change":"2024-04-18T04:54:41.195440+0000","last_active":"2024-04-18T04:54:42.455360+0000","last_peered":"2024-04-18T04:54:42.455360+0000","last_clean":"2024-04-18T04:54:42.455360+0000","last_became_active":"2024-04-18T04:54:41.195152+0000","last_became_peered":"2024-04-18T04:54:41.195152+0000","last_unstale":"2024-04-18T04:54:42.455360+0000","last_undegraded":"2024-04-18T04:54:42.455360+0000","last_fullsized":"2024-04-18T04:54:42.455360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.178775+0000","last_change":"2024-04-18T04:54:40.818806+0000","last_active":"2024-04-18T04:54:41.178775+0000","last_peered":"2024-04-18T04:54:41.178775+0000","last_clean":"2024-04-18T04:54:41.178775+0000","last_became_active":"2024-04-18T04:54:40.818113+0000","last_became_peered":"2024-04-18T04:54:40.818113+0000","last_unstale":"2024-04-18T04:54:41.178775+0000","last_undegraded":"2024-04-18T04:54:41.178775+0000","last_fullsized":"2024-04-18T04:54:41.178775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169410+0000","last_change":"2024-04-18T04:54:41.192576+0000","last_active":"2024-04-18T04:54:42.169410+0000","last_peered":"2024-04-18T04:54:42.169410+0000","last_clean":"2024-04-18T04:54:42.169410+0000","last_became_active":"2024-04-18T04:54:41.192187+0000","last_became_peered":"2024-04-18T04:54:41.192187+0000","last_unstale":"2024-04-18T04:54:42.169410+0000","last_undegraded":"2024-04-18T04:54:42.169410+0000","last_fullsized":"2024-04-18T04:54:42.169410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.179509+0000","last_change":"2024-04-18T04:54:40.820531+0000","last_active":"2024-04-18T04:54:41.179509+0000","last_peered":"2024-04-18T04:54:41.179509+0000","last_clean":"2024-04-18T04:54:41.179509+0000","last_became_active":"2024-04-18T04:54:40.820025+0000","last_became_peered":"2024-04-18T04:54:40.820025+0000","last_unstale":"2024-04-18T04:54:41.179509+0000","last_undegraded":"2024-04-18T04:54:41.179509+0000","last_fullsized":"2024-04-18T04:54:41.179509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:35.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323461+0000","last_change":"2024-04-18T04:54:41.186361+0000","last_active":"2024-04-18T04:54:42.323461+0000","last_peered":"2024-04-18T04:54:42.323461+0000","last_clean":"2024-04-18T04:54:42.323461+0000","last_became_active":"2024-04-18T04:54:41.185257+0000","last_became_peered":"2024-04-18T04:54:41.185257+0000","last_unstale":"2024-04-18T04:54:42.323461+0000","last_undegraded":"2024-04-18T04:54:42.323461+0000","last_fullsized":"2024-04-18T04:54:42.323461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.179191+0000","last_change":"2024-04-18T04:54:40.824668+0000","last_active":"2024-04-18T04:54:41.179191+0000","last_peered":"2024-04-18T04:54:41.179191+0000","last_clean":"2024-04-18T04:54:41.179191+0000","last_became_active":"2024-04-18T04:54:40.824206+0000","last_became_peered":"2024-04-18T04:54:40.824206+0000","last_unstale":"2024-04-18T04:54:41.179191+0000","last_undegraded":"2024-04-18T04:54:41.179191+0000","last_fullsized":"2024-04-18T04:54:41.179191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453990+0000","last_change":"2024-04-18T04:54:41.195487+0000","last_active":"2024-04-18T04:54:42.453990+0000","last_peered":"2024-04-18T04:54:42.453990+0000","last_clean":"2024-04-18T04:54:42.453990+0000","last_became_active":"2024-04-18T04:54:41.195177+0000","last_became_peered":"2024-04-18T04:54:41.195177+0000","last_unstale":"2024-04-18T04:54:42.453990+0000","last_undegraded":"2024-04-18T04:54:42.453990+0000","last_fullsized":"2024-04-18T04:54:42.453990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:25.853413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.185102+0000","last_change":"2024-04-18T04:54:40.803387+0000","last_active":"2024-04-18T04:54:41.185102+0000","last_peered":"2024-04-18T04:54:41.185102+0000","last_clean":"2024-04-18T04:54:41.185102+0000","last_became_active":"2024-04-18T04:54:40.802902+0000","last_became_peered":"2024-04-18T04:54:40.802902+0000","last_unstale":"2024-04-18T04:54:41.185102+0000","last_undegraded":"2024-04-18T04:54:41.185102+0000","last_fullsized":"2024-04-18T04:54:41.185102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.456062+0000","last_change":"2024-04-18T04:54:41.195382+0000","last_active":"2024-04-18T04:54:42.456062+0000","last_peered":"2024-04-18T04:54:42.456062+0000","last_clean":"2024-04-18T04:54:42.456062+0000","last_became_active":"2024-04-18T04:54:41.194965+0000","last_became_peered":"2024-04-18T04:54:41.194965+0000","last_unstale":"2024-04-18T04:54:42.456062+0000","last_undegraded":"2024-04-18T04:54:42.456062+0000","last_fullsized":"2024-04-18T04:54:42.456062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:39:50.932794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.171218+0000","last_change":"2024-04-18T04:54:40.800651+0000","last_active":"2024-04-18T04:54:42.171218+0000","last_peered":"2024-04-18T04:54:42.171218+0000","last_clean":"2024-04-18T04:54:42.171218+0000","last_became_active":"2024-04-18T04:54:40.798574+0000","last_became_peered":"2024-04-18T04:54:40.798574+0000","last_unstale":"2024-04-18T04:54:42.171218+0000","last_undegraded":"2024-04-18T04:54:42.171218+0000","last_fullsized":"2024-04-18T04:54:42.171218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:55.712985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170747+0000","last_change":"2024-04-18T04:54:41.191679+0000","last_active":"2024-04-18T04:54:42.170747+0000","last_peered":"2024-04-18T04:54:42.170747+0000","last_clean":"2024-04-18T04:54:42.170747+0000","last_became_active":"2024-04-18T04:54:41.191124+0000","last_became_peered":"2024-04-18T04:54:41.191124+0000","last_unstale":"2024-04-18T04:54:42.170747+0000","last_undegraded":"2024-04-18T04:54:42.170747+0000","last_fullsized":"2024-04-18T04:54:42.170747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.296860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.181701+0000","last_change":"2024-04-18T04:54:40.804085+0000","last_active":"2024-04-18T04:54:46.181701+0000","last_peered":"2024-04-18T04:54:46.181701+0000","last_clean":"2024-04-18T04:54:46.181701+0000","last_became_active":"2024-04-18T04:54:40.803616+0000","last_became_peered":"2024-04-18T04:54:40.803616+0000","last_unstale":"2024-04-18T04:54:46.181701+0000","last_undegraded":"2024-04-18T04:54:46.181701+0000","last_fullsized":"2024-04-18T04:54:46.181701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:55.405415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170788+0000","last_change":"2024-04-18T04:54:41.185453+0000","last_active":"2024-04-18T04:54:42.170788+0000","last_peered":"2024-04-18T04:54:42.170788+0000","last_clean":"2024-04-18T04:54:42.170788+0000","last_became_active":"2024-04-18T04:54:41.185217+0000","last_became_peered":"2024-04-18T04:54:41.185217+0000","last_unstale":"2024-04-18T04:54:42.170788+0000","last_undegraded":"2024-04-18T04:54:42.170788+0000","last_fullsized":"2024-04-18T04:54:42.170788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:44:42.484978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.173081+0000","last_change":"2024-04-18T04:54:40.801317+0000","last_active":"2024-04-18T04:54:41.173081+0000","last_peered":"2024-04-18T04:54:41.173081+0000","last_clean":"2024-04-18T04:54:41.173081+0000","last_became_active":"2024-04-18T04:54:40.800598+0000","last_became_peered":"2024-04-18T04:54:40.800598+0000","last_unstale":"2024-04-18T04:54:41.173081+0000","last_undegraded":"2024-04-18T04:54:41.173081+0000","last_fullsized":"2024-04-18T04:54:41.173081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454296+0000","last_change":"2024-04-18T04:54:41.197813+0000","last_active":"2024-04-18T04:54:42.454296+0000","last_peered":"2024-04-18T04:54:42.454296+0000","last_clean":"2024-04-18T04:54:42.454296+0000","last_became_active":"2024-04-18T04:54:41.197201+0000","last_became_peered":"2024-04-18T04:54:41.197201+0000","last_unstale":"2024-04-18T04:54:42.454296+0000","last_undegraded":"2024-04-18T04:54:42.454296+0000","last_fullsized":"2024-04-18T04:54:42.454296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.171356+0000","last_change":"2024-04-18T04:54:40.800416+0000","last_active":"2024-04-18T04:54:42.171356+0000","last_peered":"2024-04-18T04:54:42.171356+0000","last_clean":"2024-04-18T04:54:42.171356+0000","last_became_active":"2024-04-18T04:54:40.797471+0000","last_became_peered":"2024-04-18T04:54:40.797471+0000","last_unstale":"2024-04-18T04:54:42.171356+0000","last_undegraded":"2024-04-18T04:54:42.171356+0000","last_fullsized":"2024-04-18T04:54:42.171356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:33.118670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170092+0000","last_change":"2024-04-18T04:54:41.192024+0000","last_active":"2024-04-18T04:54:42.170092+0000","last_peered":"2024-04-18T04:54:42.170092+0000","last_clean":"2024-04-18T04:54:42.170092+0000","last_became_active":"2024-04-18T04:54:41.191488+0000","last_became_peered":"2024-04-18T04:54:41.191488+0000","last_unstale":"2024-04-18T04:54:42.170092+0000","last_undegraded":"2024-04-18T04:54:42.170092+0000","last_fullsized":"2024-04-18T04:54:42.170092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:39:31.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.172821+0000","last_change":"2024-04-18T04:54:40.823863+0000","last_active":"2024-04-18T04:54:41.172821+0000","last_peered":"2024-04-18T04:54:41.172821+0000","last_clean":"2024-04-18T04:54:41.172821+0000","last_became_active":"2024-04-18T04:54:40.823277+0000","last_became_peered":"2024-04-18T04:54:40.823277+0000","last_unstale":"2024-04-18T04:54:41.172821+0000","last_undegraded":"2024-04-18T04:54:41.172821+0000","last_fullsized":"2024-04-18T04:54:41.172821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454635+0000","last_change":"2024-04-18T04:54:41.199981+0000","last_active":"2024-04-18T04:54:42.454635+0000","last_peered":"2024-04-18T04:54:42.454635+0000","last_clean":"2024-04-18T04:54:42.454635+0000","last_became_active":"2024-04-18T04:54:41.199700+0000","last_became_peered":"2024-04-18T04:54:41.199700+0000","last_unstale":"2024-04-18T04:54:42.454635+0000","last_undegraded":"2024-04-18T04:54:42.454635+0000","last_fullsized":"2024-04-18T04:54:42.454635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.181520+0000","last_change":"2024-04-18T04:54:40.800740+0000","last_active":"2024-04-18T04:54:46.181520+0000","last_peered":"2024-04-18T04:54:46.181520+0000","last_clean":"2024-04-18T04:54:46.181520+0000","last_became_active":"2024-04-18T04:54:40.800405+0000","last_became_peered":"2024-04-18T04:54:40.800405+0000","last_unstale":"2024-04-18T04:54:46.181520+0000","last_undegraded":"2024-04-18T04:54:46.181520+0000","last_fullsized":"2024-04-18T04:54:46.181520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454668+0000","last_change":"2024-04-18T04:54:41.192487+0000","last_active":"2024-04-18T04:54:42.454668+0000","last_peered":"2024-04-18T04:54:42.454668+0000","last_clean":"2024-04-18T04:54:42.454668+0000","last_became_active":"2024-04-18T04:54:41.186301+0000","last_became_peered":"2024-04-18T04:54:41.186301+0000","last_unstale":"2024-04-18T04:54:42.454668+0000","last_undegraded":"2024-04-18T04:54:42.454668+0000","last_fullsized":"2024-04-18T04:54:42.454668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455262+0000","last_change":"2024-04-18T04:54:41.193260+0000","last_active":"2024-04-18T04:54:42.455262+0000","last_peered":"2024-04-18T04:54:42.455262+0000","last_clean":"2024-04-18T04:54:42.455262+0000","last_became_active":"2024-04-18T04:54:41.192941+0000","last_became_peered":"2024-04-18T04:54:41.192941+0000","last_unstale":"2024-04-18T04:54:42.455262+0000","last_undegraded":"2024-04-18T04:54:42.455262+0000","last_fullsized":"2024-04-18T04:54:42.455262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.181037+0000","last_change":"2024-04-18T04:54:40.800162+0000","last_active":"2024-04-18T04:54:46.181037+0000","last_peered":"2024-04-18T04:54:46.181037+0000","last_clean":"2024-04-18T04:54:46.181037+0000","last_became_active":"2024-04-18T04:54:40.799517+0000","last_became_peered":"2024-04-18T04:54:40.799517+0000","last_unstale":"2024-04-18T04:54:46.181037+0000","last_undegraded":"2024-04-18T04:54:46.181037+0000","last_fullsized":"2024-04-18T04:54:46.181037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167393+0000","last_change":"2024-04-18T04:54:41.179695+0000","last_active":"2024-04-18T04:54:42.167393+0000","last_peered":"2024-04-18T04:54:42.167393+0000","last_clean":"2024-04-18T04:54:42.167393+0000","last_became_active":"2024-04-18T04:54:41.179359+0000","last_became_peered":"2024-04-18T04:54:41.179359+0000","last_unstale":"2024-04-18T04:54:42.167393+0000","last_undegraded":"2024-04-18T04:54:42.167393+0000","last_fullsized":"2024-04-18T04:54:42.167393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.179935+0000","last_change":"2024-04-18T04:54:40.801178+0000","last_active":"2024-04-18T04:54:46.179935+0000","last_peered":"2024-04-18T04:54:46.179935+0000","last_clean":"2024-04-18T04:54:46.179935+0000","last_became_active":"2024-04-18T04:54:40.800660+0000","last_became_peered":"2024-04-18T04:54:40.800660+0000","last_unstale":"2024-04-18T04:54:46.179935+0000","last_undegraded":"2024-04-18T04:54:46.179935+0000","last_fullsized":"2024-04-18T04:54:46.179935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170091+0000","last_change":"2024-04-18T04:54:41.190055+0000","last_active":"2024-04-18T04:54:42.170091+0000","last_peered":"2024-04-18T04:54:42.170091+0000","last_clean":"2024-04-18T04:54:42.170091+0000","last_became_active":"2024-04-18T04:54:41.189344+0000","last_became_peered":"2024-04-18T04:54:41.189344+0000","last_unstale":"2024-04-18T04:54:42.170091+0000","last_undegraded":"2024-04-18T04:54:42.170091+0000","last_fullsized":"2024-04-18T04:54:42.170091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170428+0000","last_change":"2024-04-18T04:54:40.813931+0000","last_active":"2024-04-18T04:54:42.170428+0000","last_peered":"2024-04-18T04:54:42.170428+0000","last_clean":"2024-04-18T04:54:42.170428+0000","last_became_active":"2024-04-18T04:54:40.813290+0000","last_became_peered":"2024-04-18T04:54:40.813290+0000","last_unstale":"2024-04-18T04:54:42.170428+0000","last_undegraded":"2024-04-18T04:54:42.170428+0000","last_fullsized":"2024-04-18T04:54:42.170428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170238+0000","last_change":"2024-04-18T04:54:41.192913+0000","last_active":"2024-04-18T04:54:42.170238+0000","last_peered":"2024-04-18T04:54:42.170238+0000","last_clean":"2024-04-18T04:54:42.170238+0000","last_became_active":"2024-04-18T04:54:41.192096+0000","last_became_peered":"2024-04-18T04:54:41.192096+0000","last_unstale":"2024-04-18T04:54:42.170238+0000","last_undegraded":"2024-04-18T04:54:42.170238+0000","last_fullsized":"2024-04-18T04:54:42.170238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:37:53.082409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.183325+0000","last_change":"2024-04-18T04:54:40.805596+0000","last_active":"2024-04-18T04:54:46.183325+0000","last_peered":"2024-04-18T04:54:46.183325+0000","last_clean":"2024-04-18T04:54:46.183325+0000","last_became_active":"2024-04-18T04:54:40.804913+0000","last_became_peered":"2024-04-18T04:54:40.804913+0000","last_unstale":"2024-04-18T04:54:46.183325+0000","last_undegraded":"2024-04-18T04:54:46.183325+0000","last_fullsized":"2024-04-18T04:54:46.183325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:44.772589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":73213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":663549,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":73671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":663527,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":73145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":75325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":74653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:54:52.883 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:54:53.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.023+0000 7fd4c1994640 1 Processor -- start 2024-04-18T04:54:53.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.023+0000 7fd4c1994640 1 -- start start 2024-04-18T04:54:53.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4c1994640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd4bc151210 0x7fd4bc0c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:53.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4c1994640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd4bc0c1db0 0x7fd4bc0ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:53.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4c1994640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc157150 con 0x7fd4bc0ca840 2024-04-18T04:54:53.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4c1994640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc157430 con 0x7fd4bc0c1db0 2024-04-18T04:54:53.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4c1994640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc157710 con 0x7fd4bc151210 2024-04-18T04:54:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4ba7fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd4bc0c1db0 0x7fd4bc0ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4ba7fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd4bc0c1db0 0x7fd4bc0ca300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38920/0 (socket says 172.21.15.96:38920) 2024-04-18T04:54:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4bb7fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd4bc0ca840 0x7fd4bc15a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46406/0 (socket says 172.21.15.96:46406) 2024-04-18T04:54:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4ba7fc640 1 -- 172.21.15.96:0/1433513662 learned_addr learned my addr 172.21.15.96:0/1433513662 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4baffd640 1 --2- 172.21.15.96:0/1433513662 >> v2:172.21.15.139:3300/0 conn(0x7fd4bc151210 0x7fd4bc0c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4ba7fc640 1 -- 172.21.15.96:0/1433513662 >> v2:172.21.15.139:3300/0 conn(0x7fd4bc151210 msgr2=0x7fd4bc0c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4ba7fc640 1 --2- 172.21.15.96:0/1433513662 >> v2:172.21.15.139:3300/0 conn(0x7fd4bc151210 0x7fd4bc0c1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4ba7fc640 1 -- 172.21.15.96:0/1433513662 >> v1:172.21.15.96:6789/0 conn(0x7fd4bc0ca840 legacy=0x7fd4bc15a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4ba7fc640 1 -- 172.21.15.96:0/1433513662 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc1579f0 con 0x7fd4bc0c1db0 2024-04-18T04:54:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4b9ffb640 1 -- 172.21.15.96:0/1433513662 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969569961 0 0) 0x7fd4bc157150 con 0x7fd4bc0ca840 2024-04-18T04:54:53.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4ba7fc640 1 --2- 172.21.15.96:0/1433513662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4bc0c1db0 0x7fd4bc0ca300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc0c7b80 tx=0x7fd4b001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c282e22135373c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:53.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4b9ffb640 1 -- 172.21.15.96:0/1433513662 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00a8a10 con 0x7fd4bc0c1db0 2024-04-18T04:54:53.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4b9ffb640 1 -- 172.21.15.96:0/1433513662 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b00a8b70 con 0x7fd4bc0c1db0 2024-04-18T04:54:53.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4b9ffb640 1 -- 172.21.15.96:0/1433513662 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00b0440 con 0x7fd4bc0c1db0 2024-04-18T04:54:53.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4c1994640 1 -- 172.21.15.96:0/1433513662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4bc0c1db0 msgr2=0x7fd4bc0ca300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:53.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4c1994640 1 --2- 172.21.15.96:0/1433513662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4bc0c1db0 0x7fd4bc0ca300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc0c7b80 tx=0x7fd4b001ed10 comp rx=0 tx=0).stop 2024-04-18T04:54:53.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4c1994640 1 -- 172.21.15.96:0/1433513662 shutdown_connections 2024-04-18T04:54:53.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4c1994640 1 --2- 172.21.15.96:0/1433513662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4bc0c1db0 0x7fd4bc0ca300 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4c1994640 1 --2- 172.21.15.96:0/1433513662 >> v2:172.21.15.139:3300/0 conn(0x7fd4bc151210 0x7fd4bc0c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4c1994640 1 -- 172.21.15.96:0/1433513662 >> 172.21.15.96:0/1433513662 conn(0x7fd4bc06c750 msgr2=0x7fd4bc0c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:53.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4c1994640 1 -- 172.21.15.96:0/1433513662 shutdown_connections 2024-04-18T04:54:53.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.027+0000 7fd4c1994640 1 -- 172.21.15.96:0/1433513662 wait complete. 2024-04-18T04:54:53.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4c1994640 1 Processor -- start 2024-04-18T04:54:53.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4c1994640 1 -- start start 2024-04-18T04:54:53.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4c1994640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4bc0c1db0 0x7fd4bc142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:53.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4c1994640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4bc0ca840 0x7fd4bc1527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:53.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4c1994640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4bc151210 0x7fd4bc152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:53.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4c1994640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc151920 con 0x7fd4bc0ca840 2024-04-18T04:54:53.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4c1994640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc152210 con 0x7fd4bc151210 2024-04-18T04:54:53.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4c1994640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc14d680 con 0x7fd4bc0c1db0 2024-04-18T04:54:53.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4ba7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4bc0ca840 0x7fd4bc1527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4ba7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4bc0ca840 0x7fd4bc1527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38932/0 (socket says 172.21.15.96:38932) 2024-04-18T04:54:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4ba7fc640 1 -- 172.21.15.96:0/241403218 learned_addr learned my addr 172.21.15.96:0/241403218 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4bb7fe640 1 --2- 172.21.15.96:0/241403218 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4bc151210 0x7fd4bc152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4baffd640 1 --2- 172.21.15.96:0/241403218 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4bc0c1db0 0x7fd4bc142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4ba7fc640 1 -- 172.21.15.96:0/241403218 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4bc0c1db0 msgr2=0x7fd4bc142a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4ba7fc640 1 --2- 172.21.15.96:0/241403218 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4bc0c1db0 0x7fd4bc142a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4ba7fc640 1 -- 172.21.15.96:0/241403218 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4bc151210 msgr2=0x7fd4bc152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4ba7fc640 1 --2- 172.21.15.96:0/241403218 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4bc151210 0x7fd4bc152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4ba7fc640 1 -- 172.21.15.96:0/241403218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b00094d0 con 0x7fd4bc0ca840 2024-04-18T04:54:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4bb7fe640 1 --2- 172.21.15.96:0/241403218 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4bc151210 0x7fd4bc152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4ba7fc640 1 --2- 172.21.15.96:0/241403218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4bc0ca840 0x7fd4bc1527d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009930 tx=0x7fd4b001d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4a3fff640 1 -- 172.21.15.96:0/241403218 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00a8a10 con 0x7fd4bc0ca840 2024-04-18T04:54:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4a3fff640 1 -- 172.21.15.96:0/241403218 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b0004030 con 0x7fd4bc0ca840 2024-04-18T04:54:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4a3fff640 1 -- 172.21.15.96:0/241403218 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00043a0 con 0x7fd4bc0ca840 2024-04-18T04:54:53.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4c1994640 1 -- 172.21.15.96:0/241403218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4bc156f20 con 0x7fd4bc0ca840 2024-04-18T04:54:53.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4c1994640 1 -- 172.21.15.96:0/241403218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc1efa50 con 0x7fd4bc0ca840 2024-04-18T04:54:53.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4c1994640 1 -- 172.21.15.96:0/241403218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc067050 con 0x7fd4bc0ca840 2024-04-18T04:54:53.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.031+0000 7fd4a3fff640 1 -- 172.21.15.96:0/241403218 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd4b00b7040 con 0x7fd4bc0ca840 2024-04-18T04:54:53.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.035+0000 7fd4a3fff640 1 --2- 172.21.15.96:0/241403218 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd4a8066690 0x7fd4a8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:53.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.035+0000 7fd4a3fff640 1 -- 172.21.15.96:0/241403218 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4b0121720 con 0x7fd4bc0ca840 2024-04-18T04:54:53.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.035+0000 7fd4baffd640 1 --2- 172.21.15.96:0/241403218 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd4a8066690 0x7fd4a8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:53.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.035+0000 7fd4baffd640 1 --2- 172.21.15.96:0/241403218 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd4a8066690 0x7fd4a8068b50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00b7c0 tx=0x7fd4ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:53.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.039+0000 7fd4a3fff640 1 -- 172.21.15.96:0/241403218 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd4b00eea00 con 0x7fd4bc0ca840 2024-04-18T04:54:53.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.183+0000 7fd4c1994640 1 -- 172.21.15.96:0/241403218 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4bc156da0 con 0x7fd4a8066690 2024-04-18T04:54:53.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.187+0000 7fd4a3fff640 1 -- 172.21.15.96:0/241403218 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264598 (secure 0 0 0) 0x7fd4ac00c040 con 0x7fd4a8066690 2024-04-18T04:54:53.193 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:53.194 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T04:54:53.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.191+0000 7fd4c1994640 1 -- 172.21.15.96:0/241403218 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd4a8066690 msgr2=0x7fd4a8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:53.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.191+0000 7fd4c1994640 1 --2- 172.21.15.96:0/241403218 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd4a8066690 0x7fd4a8068b50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00b7c0 tx=0x7fd4ac008040 comp rx=0 tx=0).stop 2024-04-18T04:54:53.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.191+0000 7fd4c1994640 1 -- 172.21.15.96:0/241403218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4bc0ca840 msgr2=0x7fd4bc1527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:53.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.191+0000 7fd4c1994640 1 --2- 172.21.15.96:0/241403218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4bc0ca840 0x7fd4bc1527d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009930 tx=0x7fd4b001d550 comp rx=0 tx=0).stop 2024-04-18T04:54:53.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.191+0000 7fd4c1994640 1 -- 172.21.15.96:0/241403218 shutdown_connections 2024-04-18T04:54:53.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.191+0000 7fd4c1994640 1 --2- 172.21.15.96:0/241403218 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd4a8066690 0x7fd4a8068b50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.191+0000 7fd4c1994640 1 --2- 172.21.15.96:0/241403218 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4bc151210 0x7fd4bc152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.191+0000 7fd4c1994640 1 --2- 172.21.15.96:0/241403218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4bc0ca840 0x7fd4bc1527d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.191+0000 7fd4c1994640 1 --2- 172.21.15.96:0/241403218 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4bc0c1db0 0x7fd4bc142a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.191+0000 7fd4c1994640 1 -- 172.21.15.96:0/241403218 >> 172.21.15.96:0/241403218 conn(0x7fd4bc06c750 msgr2=0x7fd4bc14d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:53.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.191+0000 7fd4c1994640 1 -- 172.21.15.96:0/241403218 shutdown_connections 2024-04-18T04:54:53.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.191+0000 7fd4c1994640 1 -- 172.21.15.96:0/241403218 wait complete. 2024-04-18T04:54:53.209 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-18T04:54:52.570984+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217956,"kb_used_data":1824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756764,"statfs":{"total":773094113280,"available":772870926336,"internally_reserved":0,"allocated":1867776,"data_stored":1770172,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.406305"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323999+0000","last_change":"2024-04-18T04:54:41.199306+0000","last_active":"2024-04-18T04:54:42.323999+0000","last_peered":"2024-04-18T04:54:42.323999+0000","last_clean":"2024-04-18T04:54:42.323999+0000","last_became_active":"2024-04-18T04:54:41.199046+0000","last_became_peered":"2024-04-18T04:54:41.199046+0000","last_unstale":"2024-04-18T04:54:42.323999+0000","last_undegraded":"2024-04-18T04:54:42.323999+0000","last_fullsized":"2024-04-18T04:54:42.323999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169848+0000","last_change":"2024-04-18T04:54:41.200447+0000","last_active":"2024-04-18T04:54:42.169848+0000","last_peered":"2024-04-18T04:54:42.169848+0000","last_clean":"2024-04-18T04:54:42.169848+0000","last_became_active":"2024-04-18T04:54:41.200136+0000","last_became_peered":"2024-04-18T04:54:41.200136+0000","last_unstale":"2024-04-18T04:54:42.169848+0000","last_undegraded":"2024-04-18T04:54:42.169848+0000","last_fullsized":"2024-04-18T04:54:42.169848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169517+0000","last_change":"2024-04-18T04:54:41.185987+0000","last_active":"2024-04-18T04:54:42.169517+0000","last_peered":"2024-04-18T04:54:42.169517+0000","last_clean":"2024-04-18T04:54:42.169517+0000","last_became_active":"2024-04-18T04:54:41.185206+0000","last_became_peered":"2024-04-18T04:54:41.185206+0000","last_unstale":"2024-04-18T04:54:42.169517+0000","last_undegraded":"2024-04-18T04:54:42.169517+0000","last_fullsized":"2024-04-18T04:54:42.169517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453954+0000","last_change":"2024-04-18T04:54:41.177487+0000","last_active":"2024-04-18T04:54:42.453954+0000","last_peered":"2024-04-18T04:54:42.453954+0000","last_clean":"2024-04-18T04:54:42.453954+0000","last_became_active":"2024-04-18T04:54:41.177217+0000","last_became_peered":"2024-04-18T04:54:41.177217+0000","last_unstale":"2024-04-18T04:54:42.453954+0000","last_undegraded":"2024-04-18T04:54:42.453954+0000","last_fullsized":"2024-04-18T04:54:42.453954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:08.067252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323329+0000","last_change":"2024-04-18T04:54:41.186573+0000","last_active":"2024-04-18T04:54:42.323329+0000","last_peered":"2024-04-18T04:54:42.323329+0000","last_clean":"2024-04-18T04:54:42.323329+0000","last_became_active":"2024-04-18T04:54:41.186027+0000","last_became_peered":"2024-04-18T04:54:41.186027+0000","last_unstale":"2024-04-18T04:54:42.323329+0000","last_undegraded":"2024-04-18T04:54:42.323329+0000","last_fullsized":"2024-04-18T04:54:42.323329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453454+0000","last_change":"2024-04-18T04:54:41.177550+0000","last_active":"2024-04-18T04:54:42.453454+0000","last_peered":"2024-04-18T04:54:42.453454+0000","last_clean":"2024-04-18T04:54:42.453454+0000","last_became_active":"2024-04-18T04:54:41.177215+0000","last_became_peered":"2024-04-18T04:54:41.177215+0000","last_unstale":"2024-04-18T04:54:42.453454+0000","last_undegraded":"2024-04-18T04:54:42.453454+0000","last_fullsized":"2024-04-18T04:54:42.453454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:26.266600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323158+0000","last_change":"2024-04-18T04:54:41.178605+0000","last_active":"2024-04-18T04:54:42.323158+0000","last_peered":"2024-04-18T04:54:42.323158+0000","last_clean":"2024-04-18T04:54:42.323158+0000","last_became_active":"2024-04-18T04:54:41.178094+0000","last_became_peered":"2024-04-18T04:54:41.178094+0000","last_unstale":"2024-04-18T04:54:42.323158+0000","last_undegraded":"2024-04-18T04:54:42.323158+0000","last_fullsized":"2024-04-18T04:54:42.323158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169250+0000","last_change":"2024-04-18T04:54:41.193174+0000","last_active":"2024-04-18T04:54:42.169250+0000","last_peered":"2024-04-18T04:54:42.169250+0000","last_clean":"2024-04-18T04:54:42.169250+0000","last_became_active":"2024-04-18T04:54:41.192678+0000","last_became_peered":"2024-04-18T04:54:41.192678+0000","last_unstale":"2024-04-18T04:54:42.169250+0000","last_undegraded":"2024-04-18T04:54:42.169250+0000","last_fullsized":"2024-04-18T04:54:42.169250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167601+0000","last_change":"2024-04-18T04:54:41.198121+0000","last_active":"2024-04-18T04:54:42.167601+0000","last_peered":"2024-04-18T04:54:42.167601+0000","last_clean":"2024-04-18T04:54:42.167601+0000","last_became_active":"2024-04-18T04:54:41.197832+0000","last_became_peered":"2024-04-18T04:54:41.197832+0000","last_unstale":"2024-04-18T04:54:42.167601+0000","last_undegraded":"2024-04-18T04:54:42.167601+0000","last_fullsized":"2024-04-18T04:54:42.167601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.835581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323925+0000","last_change":"2024-04-18T04:54:41.183032+0000","last_active":"2024-04-18T04:54:42.323925+0000","last_peered":"2024-04-18T04:54:42.323925+0000","last_clean":"2024-04-18T04:54:42.323925+0000","last_became_active":"2024-04-18T04:54:41.182698+0000","last_became_peered":"2024-04-18T04:54:41.182698+0000","last_unstale":"2024-04-18T04:54:42.323925+0000","last_undegraded":"2024-04-18T04:54:42.323925+0000","last_fullsized":"2024-04-18T04:54:42.323925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323788+0000","last_change":"2024-04-18T04:54:41.187831+0000","last_active":"2024-04-18T04:54:42.323788+0000","last_peered":"2024-04-18T04:54:42.323788+0000","last_clean":"2024-04-18T04:54:42.323788+0000","last_became_active":"2024-04-18T04:54:41.187360+0000","last_became_peered":"2024-04-18T04:54:41.187360+0000","last_unstale":"2024-04-18T04:54:42.323788+0000","last_undegraded":"2024-04-18T04:54:42.323788+0000","last_fullsized":"2024-04-18T04:54:42.323788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323367+0000","last_change":"2024-04-18T04:54:41.188641+0000","last_active":"2024-04-18T04:54:42.323367+0000","last_peered":"2024-04-18T04:54:42.323367+0000","last_clean":"2024-04-18T04:54:42.323367+0000","last_became_active":"2024-04-18T04:54:41.188281+0000","last_became_peered":"2024-04-18T04:54:41.188281+0000","last_unstale":"2024-04-18T04:54:42.323367+0000","last_undegraded":"2024-04-18T04:54:42.323367+0000","last_fullsized":"2024-04-18T04:54:42.323367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455946+0000","last_change":"2024-04-18T04:54:41.194578+0000","last_active":"2024-04-18T04:54:42.455946+0000","last_peered":"2024-04-18T04:54:42.455946+0000","last_clean":"2024-04-18T04:54:42.455946+0000","last_became_active":"2024-04-18T04:54:41.190882+0000","last_became_peered":"2024-04-18T04:54:41.190882+0000","last_unstale":"2024-04-18T04:54:42.455946+0000","last_undegraded":"2024-04-18T04:54:42.455946+0000","last_fullsized":"2024-04-18T04:54:42.455946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:45:52.041196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455376+0000","last_change":"2024-04-18T04:54:41.190210+0000","last_active":"2024-04-18T04:54:42.455376+0000","last_peered":"2024-04-18T04:54:42.455376+0000","last_clean":"2024-04-18T04:54:42.455376+0000","last_became_active":"2024-04-18T04:54:41.189813+0000","last_became_peered":"2024-04-18T04:54:41.189813+0000","last_unstale":"2024-04-18T04:54:42.455376+0000","last_undegraded":"2024-04-18T04:54:42.455376+0000","last_fullsized":"2024-04-18T04:54:42.455376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:38:02.632458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169188+0000","last_change":"2024-04-18T04:54:41.183027+0000","last_active":"2024-04-18T04:54:42.169188+0000","last_peered":"2024-04-18T04:54:42.169188+0000","last_clean":"2024-04-18T04:54:42.169188+0000","last_became_active":"2024-04-18T04:54:41.182713+0000","last_became_peered":"2024-04-18T04:54:41.182713+0000","last_unstale":"2024-04-18T04:54:42.169188+0000","last_undegraded":"2024-04-18T04:54:42.169188+0000","last_fullsized":"2024-04-18T04:54:42.169188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453959+0000","last_change":"2024-04-18T04:54:41.186060+0000","last_active":"2024-04-18T04:54:42.453959+0000","last_peered":"2024-04-18T04:54:42.453959+0000","last_clean":"2024-04-18T04:54:42.453959+0000","last_became_active":"2024-04-18T04:54:41.185803+0000","last_became_peered":"2024-04-18T04:54:41.185803+0000","last_unstale":"2024-04-18T04:54:42.453959+0000","last_undegraded":"2024-04-18T04:54:42.453959+0000","last_fullsized":"2024-04-18T04:54:42.453959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:48:04.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455728+0000","last_change":"2024-04-18T04:54:41.200802+0000","last_active":"2024-04-18T04:54:42.455728+0000","last_peered":"2024-04-18T04:54:42.455728+0000","last_clean":"2024-04-18T04:54:42.455728+0000","last_became_active":"2024-04-18T04:54:41.198404+0000","last_became_peered":"2024-04-18T04:54:41.198404+0000","last_unstale":"2024-04-18T04:54:42.455728+0000","last_undegraded":"2024-04-18T04:54:42.455728+0000","last_fullsized":"2024-04-18T04:54:42.455728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:56.686481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454830+0000","last_change":"2024-04-18T04:54:41.189568+0000","last_active":"2024-04-18T04:54:42.454830+0000","last_peered":"2024-04-18T04:54:42.454830+0000","last_clean":"2024-04-18T04:54:42.454830+0000","last_became_active":"2024-04-18T04:54:41.188139+0000","last_became_peered":"2024-04-18T04:54:41.188139+0000","last_unstale":"2024-04-18T04:54:42.454830+0000","last_undegraded":"2024-04-18T04:54:42.454830+0000","last_fullsized":"2024-04-18T04:54:42.454830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455410+0000","last_change":"2024-04-18T04:54:41.197901+0000","last_active":"2024-04-18T04:54:42.455410+0000","last_peered":"2024-04-18T04:54:42.455410+0000","last_clean":"2024-04-18T04:54:42.455410+0000","last_became_active":"2024-04-18T04:54:41.197235+0000","last_became_peered":"2024-04-18T04:54:41.197235+0000","last_unstale":"2024-04-18T04:54:42.455410+0000","last_undegraded":"2024-04-18T04:54:42.455410+0000","last_fullsized":"2024-04-18T04:54:42.455410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:41:20.213202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323339+0000","last_change":"2024-04-18T04:54:41.188440+0000","last_active":"2024-04-18T04:54:42.323339+0000","last_peered":"2024-04-18T04:54:42.323339+0000","last_clean":"2024-04-18T04:54:42.323339+0000","last_became_active":"2024-04-18T04:54:41.187925+0000","last_became_peered":"2024-04-18T04:54:41.187925+0000","last_unstale":"2024-04-18T04:54:42.323339+0000","last_undegraded":"2024-04-18T04:54:42.323339+0000","last_fullsized":"2024-04-18T04:54:42.323339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170212+0000","last_change":"2024-04-18T04:54:41.179672+0000","last_active":"2024-04-18T04:54:42.170212+0000","last_peered":"2024-04-18T04:54:42.170212+0000","last_clean":"2024-04-18T04:54:42.170212+0000","last_became_active":"2024-04-18T04:54:41.178963+0000","last_became_peered":"2024-04-18T04:54:41.178963+0000","last_unstale":"2024-04-18T04:54:42.170212+0000","last_undegraded":"2024-04-18T04:54:42.170212+0000","last_fullsized":"2024-04-18T04:54:42.170212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:56:31.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167152+0000","last_change":"2024-04-18T04:54:41.182902+0000","last_active":"2024-04-18T04:54:42.167152+0000","last_peered":"2024-04-18T04:54:42.167152+0000","last_clean":"2024-04-18T04:54:42.167152+0000","last_became_active":"2024-04-18T04:54:41.182664+0000","last_became_peered":"2024-04-18T04:54:41.182664+0000","last_unstale":"2024-04-18T04:54:42.167152+0000","last_undegraded":"2024-04-18T04:54:42.167152+0000","last_fullsized":"2024-04-18T04:54:42.167152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:56.408926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169624+0000","last_change":"2024-04-18T04:54:41.187578+0000","last_active":"2024-04-18T04:54:42.169624+0000","last_peered":"2024-04-18T04:54:42.169624+0000","last_clean":"2024-04-18T04:54:42.169624+0000","last_became_active":"2024-04-18T04:54:41.186881+0000","last_became_peered":"2024-04-18T04:54:41.186881+0000","last_unstale":"2024-04-18T04:54:42.169624+0000","last_undegraded":"2024-04-18T04:54:42.169624+0000","last_fullsized":"2024-04-18T04:54:42.169624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:27.817916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454216+0000","last_change":"2024-04-18T04:54:41.193206+0000","last_active":"2024-04-18T04:54:42.454216+0000","last_peered":"2024-04-18T04:54:42.454216+0000","last_clean":"2024-04-18T04:54:42.454216+0000","last_became_active":"2024-04-18T04:54:41.192740+0000","last_became_peered":"2024-04-18T04:54:41.192740+0000","last_unstale":"2024-04-18T04:54:42.454216+0000","last_undegraded":"2024-04-18T04:54:42.454216+0000","last_fullsized":"2024-04-18T04:54:42.454216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:51:34.311826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169844+0000","last_change":"2024-04-18T04:54:41.192785+0000","last_active":"2024-04-18T04:54:42.169844+0000","last_peered":"2024-04-18T04:54:42.169844+0000","last_clean":"2024-04-18T04:54:42.169844+0000","last_became_active":"2024-04-18T04:54:41.192280+0000","last_became_peered":"2024-04-18T04:54:41.192280+0000","last_unstale":"2024-04-18T04:54:42.169844+0000","last_undegraded":"2024-04-18T04:54:42.169844+0000","last_fullsized":"2024-04-18T04:54:42.169844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454615+0000","last_change":"2024-04-18T04:54:41.193920+0000","last_active":"2024-04-18T04:54:42.454615+0000","last_peered":"2024-04-18T04:54:42.454615+0000","last_clean":"2024-04-18T04:54:42.454615+0000","last_became_active":"2024-04-18T04:54:41.193660+0000","last_became_peered":"2024-04-18T04:54:41.193660+0000","last_unstale":"2024-04-18T04:54:42.454615+0000","last_undegraded":"2024-04-18T04:54:42.454615+0000","last_fullsized":"2024-04-18T04:54:42.454615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:22.072498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.456447+0000","last_change":"2024-04-18T04:54:41.190298+0000","last_active":"2024-04-18T04:54:42.456447+0000","last_peered":"2024-04-18T04:54:42.456447+0000","last_clean":"2024-04-18T04:54:42.456447+0000","last_became_active":"2024-04-18T04:54:41.189374+0000","last_became_peered":"2024-04-18T04:54:41.189374+0000","last_unstale":"2024-04-18T04:54:42.456447+0000","last_undegraded":"2024-04-18T04:54:42.456447+0000","last_fullsized":"2024-04-18T04:54:42.456447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455999+0000","last_change":"2024-04-18T04:54:41.190403+0000","last_active":"2024-04-18T04:54:42.455999+0000","last_peered":"2024-04-18T04:54:42.455999+0000","last_clean":"2024-04-18T04:54:42.455999+0000","last_became_active":"2024-04-18T04:54:41.189660+0000","last_became_peered":"2024-04-18T04:54:41.189660+0000","last_unstale":"2024-04-18T04:54:42.455999+0000","last_undegraded":"2024-04-18T04:54:42.455999+0000","last_fullsized":"2024-04-18T04:54:42.455999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:34.259279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169947+0000","last_change":"2024-04-18T04:54:41.187370+0000","last_active":"2024-04-18T04:54:42.169947+0000","last_peered":"2024-04-18T04:54:42.169947+0000","last_clean":"2024-04-18T04:54:42.169947+0000","last_became_active":"2024-04-18T04:54:41.186901+0000","last_became_peered":"2024-04-18T04:54:41.186901+0000","last_unstale":"2024-04-18T04:54:42.169947+0000","last_undegraded":"2024-04-18T04:54:42.169947+0000","last_fullsized":"2024-04-18T04:54:42.169947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454539+0000","last_change":"2024-04-18T04:54:41.192719+0000","last_active":"2024-04-18T04:54:42.454539+0000","last_peered":"2024-04-18T04:54:42.454539+0000","last_clean":"2024-04-18T04:54:42.454539+0000","last_became_active":"2024-04-18T04:54:41.192114+0000","last_became_peered":"2024-04-18T04:54:41.192114+0000","last_unstale":"2024-04-18T04:54:42.454539+0000","last_undegraded":"2024-04-18T04:54:42.454539+0000","last_fullsized":"2024-04-18T04:54:42.454539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:33:21.965783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454128+0000","last_change":"2024-04-18T04:54:41.186276+0000","last_active":"2024-04-18T04:54:42.454128+0000","last_peered":"2024-04-18T04:54:42.454128+0000","last_clean":"2024-04-18T04:54:42.454128+0000","last_became_active":"2024-04-18T04:54:41.185915+0000","last_became_peered":"2024-04-18T04:54:41.185915+0000","last_unstale":"2024-04-18T04:54:42.454128+0000","last_undegraded":"2024-04-18T04:54:42.454128+0000","last_fullsized":"2024-04-18T04:54:42.454128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453190+0000","last_change":"2024-04-18T04:54:41.190283+0000","last_active":"2024-04-18T04:54:42.453190+0000","last_peered":"2024-04-18T04:54:42.453190+0000","last_clean":"2024-04-18T04:54:42.453190+0000","last_became_active":"2024-04-18T04:54:41.189892+0000","last_became_peered":"2024-04-18T04:54:41.189892+0000","last_unstale":"2024-04-18T04:54:42.453190+0000","last_undegraded":"2024-04-18T04:54:42.453190+0000","last_fullsized":"2024-04-18T04:54:42.453190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:53.175178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167307+0000","last_change":"2024-04-18T04:54:41.187326+0000","last_active":"2024-04-18T04:54:42.167307+0000","last_peered":"2024-04-18T04:54:42.167307+0000","last_clean":"2024-04-18T04:54:42.167307+0000","last_became_active":"2024-04-18T04:54:41.187001+0000","last_became_peered":"2024-04-18T04:54:41.187001+0000","last_unstale":"2024-04-18T04:54:42.167307+0000","last_undegraded":"2024-04-18T04:54:42.167307+0000","last_fullsized":"2024-04-18T04:54:42.167307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170150+0000","last_change":"2024-04-18T04:54:40.824658+0000","last_active":"2024-04-18T04:54:42.170150+0000","last_peered":"2024-04-18T04:54:42.170150+0000","last_clean":"2024-04-18T04:54:42.170150+0000","last_became_active":"2024-04-18T04:54:40.823652+0000","last_became_peered":"2024-04-18T04:54:40.823652+0000","last_unstale":"2024-04-18T04:54:42.170150+0000","last_undegraded":"2024-04-18T04:54:42.170150+0000","last_fullsized":"2024-04-18T04:54:42.170150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170634+0000","last_change":"2024-04-18T04:54:41.184497+0000","last_active":"2024-04-18T04:54:42.170634+0000","last_peered":"2024-04-18T04:54:42.170634+0000","last_clean":"2024-04-18T04:54:42.170634+0000","last_became_active":"2024-04-18T04:54:41.182180+0000","last_became_peered":"2024-04-18T04:54:41.182180+0000","last_unstale":"2024-04-18T04:54:42.170634+0000","last_undegraded":"2024-04-18T04:54:42.170634+0000","last_fullsized":"2024-04-18T04:54:42.170634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:25:15.707596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454777+0000","last_change":"2024-04-18T04:54:40.803244+0000","last_active":"2024-04-18T04:54:42.454777+0000","last_peered":"2024-04-18T04:54:42.454777+0000","last_clean":"2024-04-18T04:54:42.454777+0000","last_became_active":"2024-04-18T04:54:40.802672+0000","last_became_peered":"2024-04-18T04:54:40.802672+0000","last_unstale":"2024-04-18T04:54:42.454777+0000","last_undegraded":"2024-04-18T04:54:42.454777+0000","last_fullsized":"2024-04-18T04:54:42.454777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:56.851301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.171919+0000","last_change":"2024-04-18T04:54:40.823675+0000","last_active":"2024-04-18T04:54:41.171919+0000","last_peered":"2024-04-18T04:54:41.171919+0000","last_clean":"2024-04-18T04:54:41.171919+0000","last_became_active":"2024-04-18T04:54:40.823091+0000","last_became_peered":"2024-04-18T04:54:40.823091+0000","last_unstale":"2024-04-18T04:54:41.171919+0000","last_undegraded":"2024-04-18T04:54:41.171919+0000","last_fullsized":"2024-04-18T04:54:41.171919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169532+0000","last_change":"2024-04-18T04:54:41.200326+0000","last_active":"2024-04-18T04:54:42.169532+0000","last_peered":"2024-04-18T04:54:42.169532+0000","last_clean":"2024-04-18T04:54:42.169532+0000","last_became_active":"2024-04-18T04:54:41.199690+0000","last_became_peered":"2024-04-18T04:54:41.199690+0000","last_unstale":"2024-04-18T04:54:42.169532+0000","last_undegraded":"2024-04-18T04:54:42.169532+0000","last_fullsized":"2024-04-18T04:54:42.169532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.185487+0000","last_change":"2024-04-18T04:54:40.805264+0000","last_active":"2024-04-18T04:54:41.185487+0000","last_peered":"2024-04-18T04:54:41.185487+0000","last_clean":"2024-04-18T04:54:41.185487+0000","last_became_active":"2024-04-18T04:54:40.804605+0000","last_became_peered":"2024-04-18T04:54:40.804605+0000","last_unstale":"2024-04-18T04:54:41.185487+0000","last_undegraded":"2024-04-18T04:54:41.185487+0000","last_fullsized":"2024-04-18T04:54:41.185487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:48.991270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.171188+0000","last_change":"2024-04-18T04:54:41.175359+0000","last_active":"2024-04-18T04:54:42.171188+0000","last_peered":"2024-04-18T04:54:42.171188+0000","last_clean":"2024-04-18T04:54:42.171188+0000","last_became_active":"2024-04-18T04:54:41.175137+0000","last_became_peered":"2024-04-18T04:54:41.175137+0000","last_unstale":"2024-04-18T04:54:42.171188+0000","last_undegraded":"2024-04-18T04:54:42.171188+0000","last_fullsized":"2024-04-18T04:54:42.171188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:06:24.271204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.164938+0000","last_change":"2024-04-18T04:54:40.798936+0000","last_active":"2024-04-18T04:54:41.164938+0000","last_peered":"2024-04-18T04:54:41.164938+0000","last_clean":"2024-04-18T04:54:41.164938+0000","last_became_active":"2024-04-18T04:54:40.798572+0000","last_became_peered":"2024-04-18T04:54:40.798572+0000","last_unstale":"2024-04-18T04:54:41.164938+0000","last_undegraded":"2024-04-18T04:54:41.164938+0000","last_fullsized":"2024-04-18T04:54:41.164938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454742+0000","last_change":"2024-04-18T04:54:41.188280+0000","last_active":"2024-04-18T04:54:42.454742+0000","last_peered":"2024-04-18T04:54:42.454742+0000","last_clean":"2024-04-18T04:54:42.454742+0000","last_became_active":"2024-04-18T04:54:41.188012+0000","last_became_peered":"2024-04-18T04:54:41.188012+0000","last_unstale":"2024-04-18T04:54:42.454742+0000","last_undegraded":"2024-04-18T04:54:42.454742+0000","last_fullsized":"2024-04-18T04:54:42.454742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:11.319118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.174130+0000","last_change":"2024-04-18T04:54:40.802894+0000","last_active":"2024-04-18T04:54:41.174130+0000","last_peered":"2024-04-18T04:54:41.174130+0000","last_clean":"2024-04-18T04:54:41.174130+0000","last_became_active":"2024-04-18T04:54:40.801406+0000","last_became_peered":"2024-04-18T04:54:40.801406+0000","last_unstale":"2024-04-18T04:54:41.174130+0000","last_undegraded":"2024-04-18T04:54:41.174130+0000","last_fullsized":"2024-04-18T04:54:41.174130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170319+0000","last_change":"2024-04-18T04:54:41.203407+0000","last_active":"2024-04-18T04:54:42.170319+0000","last_peered":"2024-04-18T04:54:42.170319+0000","last_clean":"2024-04-18T04:54:42.170319+0000","last_became_active":"2024-04-18T04:54:41.203186+0000","last_became_peered":"2024-04-18T04:54:41.203186+0000","last_unstale":"2024-04-18T04:54:42.170319+0000","last_undegraded":"2024-04-18T04:54:42.170319+0000","last_fullsized":"2024-04-18T04:54:42.170319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:23:50.107054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.186282+0000","last_change":"2024-04-18T04:54:40.822014+0000","last_active":"2024-04-18T04:54:46.186282+0000","last_peered":"2024-04-18T04:54:46.186282+0000","last_clean":"2024-04-18T04:54:46.186282+0000","last_became_active":"2024-04-18T04:54:40.820920+0000","last_became_peered":"2024-04-18T04:54:40.820920+0000","last_unstale":"2024-04-18T04:54:46.186282+0000","last_undegraded":"2024-04-18T04:54:46.186282+0000","last_fullsized":"2024-04-18T04:54:46.186282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455233+0000","last_change":"2024-04-18T04:54:41.197254+0000","last_active":"2024-04-18T04:54:42.455233+0000","last_peered":"2024-04-18T04:54:42.455233+0000","last_clean":"2024-04-18T04:54:42.455233+0000","last_became_active":"2024-04-18T04:54:41.196927+0000","last_became_peered":"2024-04-18T04:54:41.196927+0000","last_unstale":"2024-04-18T04:54:42.455233+0000","last_undegraded":"2024-04-18T04:54:42.455233+0000","last_fullsized":"2024-04-18T04:54:42.455233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:01:45.182766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.188149+0000","last_change":"2024-04-18T04:54:40.801789+0000","last_active":"2024-04-18T04:54:46.188149+0000","last_peered":"2024-04-18T04:54:46.188149+0000","last_clean":"2024-04-18T04:54:46.188149+0000","last_became_active":"2024-04-18T04:54:40.801403+0000","last_became_peered":"2024-04-18T04:54:40.801403+0000","last_unstale":"2024-04-18T04:54:46.188149+0000","last_undegraded":"2024-04-18T04:54:46.188149+0000","last_fullsized":"2024-04-18T04:54:46.188149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:15:11.220095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323817+0000","last_change":"2024-04-18T04:54:41.195518+0000","last_active":"2024-04-18T04:54:42.323817+0000","last_peered":"2024-04-18T04:54:42.323817+0000","last_clean":"2024-04-18T04:54:42.323817+0000","last_became_active":"2024-04-18T04:54:41.195172+0000","last_became_peered":"2024-04-18T04:54:41.195172+0000","last_unstale":"2024-04-18T04:54:42.323817+0000","last_undegraded":"2024-04-18T04:54:42.323817+0000","last_fullsized":"2024-04-18T04:54:42.323817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.182275+0000","last_change":"2024-04-18T04:54:40.818390+0000","last_active":"2024-04-18T04:54:46.182275+0000","last_peered":"2024-04-18T04:54:46.182275+0000","last_clean":"2024-04-18T04:54:46.182275+0000","last_became_active":"2024-04-18T04:54:40.817681+0000","last_became_peered":"2024-04-18T04:54:40.817681+0000","last_unstale":"2024-04-18T04:54:46.182275+0000","last_undegraded":"2024-04-18T04:54:46.182275+0000","last_fullsized":"2024-04-18T04:54:46.182275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455448+0000","last_change":"2024-04-18T04:54:41.194807+0000","last_active":"2024-04-18T04:54:42.455448+0000","last_peered":"2024-04-18T04:54:42.455448+0000","last_clean":"2024-04-18T04:54:42.455448+0000","last_became_active":"2024-04-18T04:54:41.194499+0000","last_became_peered":"2024-04-18T04:54:41.194499+0000","last_unstale":"2024-04-18T04:54:42.455448+0000","last_undegraded":"2024-04-18T04:54:42.455448+0000","last_fullsized":"2024-04-18T04:54:42.455448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.179340+0000","last_change":"2024-04-18T04:54:40.817631+0000","last_active":"2024-04-18T04:54:41.179340+0000","last_peered":"2024-04-18T04:54:41.179340+0000","last_clean":"2024-04-18T04:54:41.179340+0000","last_became_active":"2024-04-18T04:54:40.817370+0000","last_became_peered":"2024-04-18T04:54:40.817370+0000","last_unstale":"2024-04-18T04:54:41.179340+0000","last_undegraded":"2024-04-18T04:54:41.179340+0000","last_fullsized":"2024-04-18T04:54:41.179340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454210+0000","last_change":"2024-04-18T04:54:41.193363+0000","last_active":"2024-04-18T04:54:42.454210+0000","last_peered":"2024-04-18T04:54:42.454210+0000","last_clean":"2024-04-18T04:54:42.454210+0000","last_became_active":"2024-04-18T04:54:41.192889+0000","last_became_peered":"2024-04-18T04:54:41.192889+0000","last_unstale":"2024-04-18T04:54:42.454210+0000","last_undegraded":"2024-04-18T04:54:42.454210+0000","last_fullsized":"2024-04-18T04:54:42.454210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.173292+0000","last_change":"2024-04-18T04:54:40.806633+0000","last_active":"2024-04-18T04:54:41.173292+0000","last_peered":"2024-04-18T04:54:41.173292+0000","last_clean":"2024-04-18T04:54:41.173292+0000","last_became_active":"2024-04-18T04:54:40.805965+0000","last_became_peered":"2024-04-18T04:54:40.805965+0000","last_unstale":"2024-04-18T04:54:41.173292+0000","last_undegraded":"2024-04-18T04:54:41.173292+0000","last_fullsized":"2024-04-18T04:54:41.173292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167013+0000","last_change":"2024-04-18T04:54:41.184321+0000","last_active":"2024-04-18T04:54:42.167013+0000","last_peered":"2024-04-18T04:54:42.167013+0000","last_clean":"2024-04-18T04:54:42.167013+0000","last_became_active":"2024-04-18T04:54:41.183838+0000","last_became_peered":"2024-04-18T04:54:41.183838+0000","last_unstale":"2024-04-18T04:54:42.167013+0000","last_undegraded":"2024-04-18T04:54:42.167013+0000","last_fullsized":"2024-04-18T04:54:42.167013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.187534+0000","last_change":"2024-04-18T04:54:40.818954+0000","last_active":"2024-04-18T04:54:46.187534+0000","last_peered":"2024-04-18T04:54:46.187534+0000","last_clean":"2024-04-18T04:54:46.187534+0000","last_became_active":"2024-04-18T04:54:40.818227+0000","last_became_peered":"2024-04-18T04:54:40.818227+0000","last_unstale":"2024-04-18T04:54:46.187534+0000","last_undegraded":"2024-04-18T04:54:46.187534+0000","last_fullsized":"2024-04-18T04:54:46.187534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:25.263089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454553+0000","last_change":"2024-04-18T04:54:41.192227+0000","last_active":"2024-04-18T04:54:42.454553+0000","last_peered":"2024-04-18T04:54:42.454553+0000","last_clean":"2024-04-18T04:54:42.454553+0000","last_became_active":"2024-04-18T04:54:41.187002+0000","last_became_peered":"2024-04-18T04:54:41.187002+0000","last_unstale":"2024-04-18T04:54:42.454553+0000","last_undegraded":"2024-04-18T04:54:42.454553+0000","last_fullsized":"2024-04-18T04:54:42.454553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.324159+0000","last_change":"2024-04-18T04:54:40.805795+0000","last_active":"2024-04-18T04:54:42.324159+0000","last_peered":"2024-04-18T04:54:42.324159+0000","last_clean":"2024-04-18T04:54:42.324159+0000","last_became_active":"2024-04-18T04:54:40.802550+0000","last_became_peered":"2024-04-18T04:54:40.802550+0000","last_unstale":"2024-04-18T04:54:42.324159+0000","last_undegraded":"2024-04-18T04:54:42.324159+0000","last_fullsized":"2024-04-18T04:54:42.324159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454849+0000","last_change":"2024-04-18T04:54:41.180426+0000","last_active":"2024-04-18T04:54:42.454849+0000","last_peered":"2024-04-18T04:54:42.454849+0000","last_clean":"2024-04-18T04:54:42.454849+0000","last_became_active":"2024-04-18T04:54:41.179540+0000","last_became_peered":"2024-04-18T04:54:41.179540+0000","last_unstale":"2024-04-18T04:54:42.454849+0000","last_undegraded":"2024-04-18T04:54:42.454849+0000","last_fullsized":"2024-04-18T04:54:42.454849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:38:25.074053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.180573+0000","last_change":"2024-04-18T04:54:40.804284+0000","last_active":"2024-04-18T04:54:46.180573+0000","last_peered":"2024-04-18T04:54:46.180573+0000","last_clean":"2024-04-18T04:54:46.180573+0000","last_became_active":"2024-04-18T04:54:40.803464+0000","last_became_peered":"2024-04-18T04:54:40.803464+0000","last_unstale":"2024-04-18T04:54:46.180573+0000","last_undegraded":"2024-04-18T04:54:46.180573+0000","last_fullsized":"2024-04-18T04:54:46.180573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:52.171667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.324196+0000","last_change":"2024-04-18T04:54:41.188591+0000","last_active":"2024-04-18T04:54:42.324196+0000","last_peered":"2024-04-18T04:54:42.324196+0000","last_clean":"2024-04-18T04:54:42.324196+0000","last_became_active":"2024-04-18T04:54:41.188152+0000","last_became_peered":"2024-04-18T04:54:41.188152+0000","last_unstale":"2024-04-18T04:54:42.324196+0000","last_undegraded":"2024-04-18T04:54:42.324196+0000","last_fullsized":"2024-04-18T04:54:42.324196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169752+0000","last_change":"2024-04-18T04:54:40.814901+0000","last_active":"2024-04-18T04:54:42.169752+0000","last_peered":"2024-04-18T04:54:42.169752+0000","last_clean":"2024-04-18T04:54:42.169752+0000","last_became_active":"2024-04-18T04:54:40.814207+0000","last_became_peered":"2024-04-18T04:54:40.814207+0000","last_unstale":"2024-04-18T04:54:42.169752+0000","last_undegraded":"2024-04-18T04:54:42.169752+0000","last_fullsized":"2024-04-18T04:54:42.169752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323473+0000","last_change":"2024-04-18T04:54:41.188664+0000","last_active":"2024-04-18T04:54:42.323473+0000","last_peered":"2024-04-18T04:54:42.323473+0000","last_clean":"2024-04-18T04:54:42.323473+0000","last_became_active":"2024-04-18T04:54:41.188249+0000","last_became_peered":"2024-04-18T04:54:41.188249+0000","last_unstale":"2024-04-18T04:54:42.323473+0000","last_undegraded":"2024-04-18T04:54:42.323473+0000","last_fullsized":"2024-04-18T04:54:42.323473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.173221+0000","last_change":"2024-04-18T04:54:40.828447+0000","last_active":"2024-04-18T04:54:41.173221+0000","last_peered":"2024-04-18T04:54:41.173221+0000","last_clean":"2024-04-18T04:54:41.173221+0000","last_became_active":"2024-04-18T04:54:40.823755+0000","last_became_peered":"2024-04-18T04:54:40.823755+0000","last_unstale":"2024-04-18T04:54:41.173221+0000","last_undegraded":"2024-04-18T04:54:41.173221+0000","last_fullsized":"2024-04-18T04:54:41.173221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455365+0000","last_change":"2024-04-18T04:54:41.186523+0000","last_active":"2024-04-18T04:54:42.455365+0000","last_peered":"2024-04-18T04:54:42.455365+0000","last_clean":"2024-04-18T04:54:42.455365+0000","last_became_active":"2024-04-18T04:54:41.186149+0000","last_became_peered":"2024-04-18T04:54:41.186149+0000","last_unstale":"2024-04-18T04:54:42.455365+0000","last_undegraded":"2024-04-18T04:54:42.455365+0000","last_fullsized":"2024-04-18T04:54:42.455365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.164056+0000","last_change":"2024-04-18T04:54:35.674328+0000","last_active":"2024-04-18T04:54:41.164056+0000","last_peered":"2024-04-18T04:54:41.164056+0000","last_clean":"2024-04-18T04:54:41.164056+0000","last_became_active":"2024-04-18T04:54:35.672457+0000","last_became_peered":"2024-04-18T04:54:35.672457+0000","last_unstale":"2024-04-18T04:54:41.164056+0000","last_undegraded":"2024-04-18T04:54:41.164056+0000","last_fullsized":"2024-04-18T04:54:41.164056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_clean_scrub_stamp":"2024-04-18T04:54:33.597974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:02:10.966568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.178915+0000","last_change":"2024-04-18T04:54:40.802422+0000","last_active":"2024-04-18T04:54:41.178915+0000","last_peered":"2024-04-18T04:54:41.178915+0000","last_clean":"2024-04-18T04:54:41.178915+0000","last_became_active":"2024-04-18T04:54:40.801083+0000","last_became_peered":"2024-04-18T04:54:40.801083+0000","last_unstale":"2024-04-18T04:54:41.178915+0000","last_undegraded":"2024-04-18T04:54:41.178915+0000","last_fullsized":"2024-04-18T04:54:41.178915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170437+0000","last_change":"2024-04-18T04:54:41.174658+0000","last_active":"2024-04-18T04:54:42.170437+0000","last_peered":"2024-04-18T04:54:42.170437+0000","last_clean":"2024-04-18T04:54:42.170437+0000","last_became_active":"2024-04-18T04:54:41.174391+0000","last_became_peered":"2024-04-18T04:54:41.174391+0000","last_unstale":"2024-04-18T04:54:42.170437+0000","last_undegraded":"2024-04-18T04:54:42.170437+0000","last_fullsized":"2024-04-18T04:54:42.170437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:28:24.015964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.185583+0000","last_change":"2024-04-18T04:54:40.813770+0000","last_active":"2024-04-18T04:54:41.185583+0000","last_peered":"2024-04-18T04:54:41.185583+0000","last_clean":"2024-04-18T04:54:41.185583+0000","last_became_active":"2024-04-18T04:54:40.813396+0000","last_became_peered":"2024-04-18T04:54:40.813396+0000","last_unstale":"2024-04-18T04:54:41.185583+0000","last_undegraded":"2024-04-18T04:54:41.185583+0000","last_fullsized":"2024-04-18T04:54:41.185583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455360+0000","last_change":"2024-04-18T04:54:41.195440+0000","last_active":"2024-04-18T04:54:42.455360+0000","last_peered":"2024-04-18T04:54:42.455360+0000","last_clean":"2024-04-18T04:54:42.455360+0000","last_became_active":"2024-04-18T04:54:41.195152+0000","last_became_peered":"2024-04-18T04:54:41.195152+0000","last_unstale":"2024-04-18T04:54:42.455360+0000","last_undegraded":"2024-04-18T04:54:42.455360+0000","last_fullsized":"2024-04-18T04:54:42.455360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.178775+0000","last_change":"2024-04-18T04:54:40.818806+0000","last_active":"2024-04-18T04:54:41.178775+0000","last_peered":"2024-04-18T04:54:41.178775+0000","last_clean":"2024-04-18T04:54:41.178775+0000","last_became_active":"2024-04-18T04:54:40.818113+0000","last_became_peered":"2024-04-18T04:54:40.818113+0000","last_unstale":"2024-04-18T04:54:41.178775+0000","last_undegraded":"2024-04-18T04:54:41.178775+0000","last_fullsized":"2024-04-18T04:54:41.178775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169410+0000","last_change":"2024-04-18T04:54:41.192576+0000","last_active":"2024-04-18T04:54:42.169410+0000","last_peered":"2024-04-18T04:54:42.169410+0000","last_clean":"2024-04-18T04:54:42.169410+0000","last_became_active":"2024-04-18T04:54:41.192187+0000","last_became_peered":"2024-04-18T04:54:41.192187+0000","last_unstale":"2024-04-18T04:54:42.169410+0000","last_undegraded":"2024-04-18T04:54:42.169410+0000","last_fullsized":"2024-04-18T04:54:42.169410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.179509+0000","last_change":"2024-04-18T04:54:40.820531+0000","last_active":"2024-04-18T04:54:41.179509+0000","last_peered":"2024-04-18T04:54:41.179509+0000","last_clean":"2024-04-18T04:54:41.179509+0000","last_became_active":"2024-04-18T04:54:40.820025+0000","last_became_peered":"2024-04-18T04:54:40.820025+0000","last_unstale":"2024-04-18T04:54:41.179509+0000","last_undegraded":"2024-04-18T04:54:41.179509+0000","last_fullsized":"2024-04-18T04:54:41.179509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:35.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323461+0000","last_change":"2024-04-18T04:54:41.186361+0000","last_active":"2024-04-18T04:54:42.323461+0000","last_peered":"2024-04-18T04:54:42.323461+0000","last_clean":"2024-04-18T04:54:42.323461+0000","last_became_active":"2024-04-18T04:54:41.185257+0000","last_became_peered":"2024-04-18T04:54:41.185257+0000","last_unstale":"2024-04-18T04:54:42.323461+0000","last_undegraded":"2024-04-18T04:54:42.323461+0000","last_fullsized":"2024-04-18T04:54:42.323461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.179191+0000","last_change":"2024-04-18T04:54:40.824668+0000","last_active":"2024-04-18T04:54:41.179191+0000","last_peered":"2024-04-18T04:54:41.179191+0000","last_clean":"2024-04-18T04:54:41.179191+0000","last_became_active":"2024-04-18T04:54:40.824206+0000","last_became_peered":"2024-04-18T04:54:40.824206+0000","last_unstale":"2024-04-18T04:54:41.179191+0000","last_undegraded":"2024-04-18T04:54:41.179191+0000","last_fullsized":"2024-04-18T04:54:41.179191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453990+0000","last_change":"2024-04-18T04:54:41.195487+0000","last_active":"2024-04-18T04:54:42.453990+0000","last_peered":"2024-04-18T04:54:42.453990+0000","last_clean":"2024-04-18T04:54:42.453990+0000","last_became_active":"2024-04-18T04:54:41.195177+0000","last_became_peered":"2024-04-18T04:54:41.195177+0000","last_unstale":"2024-04-18T04:54:42.453990+0000","last_undegraded":"2024-04-18T04:54:42.453990+0000","last_fullsized":"2024-04-18T04:54:42.453990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:25.853413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.185102+0000","last_change":"2024-04-18T04:54:40.803387+0000","last_active":"2024-04-18T04:54:41.185102+0000","last_peered":"2024-04-18T04:54:41.185102+0000","last_clean":"2024-04-18T04:54:41.185102+0000","last_became_active":"2024-04-18T04:54:40.802902+0000","last_became_peered":"2024-04-18T04:54:40.802902+0000","last_unstale":"2024-04-18T04:54:41.185102+0000","last_undegraded":"2024-04-18T04:54:41.185102+0000","last_fullsized":"2024-04-18T04:54:41.185102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.456062+0000","last_change":"2024-04-18T04:54:41.195382+0000","last_active":"2024-04-18T04:54:42.456062+0000","last_peered":"2024-04-18T04:54:42.456062+0000","last_clean":"2024-04-18T04:54:42.456062+0000","last_became_active":"2024-04-18T04:54:41.194965+0000","last_became_peered":"2024-04-18T04:54:41.194965+0000","last_unstale":"2024-04-18T04:54:42.456062+0000","last_undegraded":"2024-04-18T04:54:42.456062+0000","last_fullsized":"2024-04-18T04:54:42.456062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:39:50.932794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.171218+0000","last_change":"2024-04-18T04:54:40.800651+0000","last_active":"2024-04-18T04:54:42.171218+0000","last_peered":"2024-04-18T04:54:42.171218+0000","last_clean":"2024-04-18T04:54:42.171218+0000","last_became_active":"2024-04-18T04:54:40.798574+0000","last_became_peered":"2024-04-18T04:54:40.798574+0000","last_unstale":"2024-04-18T04:54:42.171218+0000","last_undegraded":"2024-04-18T04:54:42.171218+0000","last_fullsized":"2024-04-18T04:54:42.171218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:55.712985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170747+0000","last_change":"2024-04-18T04:54:41.191679+0000","last_active":"2024-04-18T04:54:42.170747+0000","last_peered":"2024-04-18T04:54:42.170747+0000","last_clean":"2024-04-18T04:54:42.170747+0000","last_became_active":"2024-04-18T04:54:41.191124+0000","last_became_peered":"2024-04-18T04:54:41.191124+0000","last_unstale":"2024-04-18T04:54:42.170747+0000","last_undegraded":"2024-04-18T04:54:42.170747+0000","last_fullsized":"2024-04-18T04:54:42.170747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.296860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.181701+0000","last_change":"2024-04-18T04:54:40.804085+0000","last_active":"2024-04-18T04:54:46.181701+0000","last_peered":"2024-04-18T04:54:46.181701+0000","last_clean":"2024-04-18T04:54:46.181701+0000","last_became_active":"2024-04-18T04:54:40.803616+0000","last_became_peered":"2024-04-18T04:54:40.803616+0000","last_unstale":"2024-04-18T04:54:46.181701+0000","last_undegraded":"2024-04-18T04:54:46.181701+0000","last_fullsized":"2024-04-18T04:54:46.181701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:55.405415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170788+0000","last_change":"2024-04-18T04:54:41.185453+0000","last_active":"2024-04-18T04:54:42.170788+0000","last_peered":"2024-04-18T04:54:42.170788+0000","last_clean":"2024-04-18T04:54:42.170788+0000","last_became_active":"2024-04-18T04:54:41.185217+0000","last_became_peered":"2024-04-18T04:54:41.185217+0000","last_unstale":"2024-04-18T04:54:42.170788+0000","last_undegraded":"2024-04-18T04:54:42.170788+0000","last_fullsized":"2024-04-18T04:54:42.170788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:44:42.484978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.173081+0000","last_change":"2024-04-18T04:54:40.801317+0000","last_active":"2024-04-18T04:54:41.173081+0000","last_peered":"2024-04-18T04:54:41.173081+0000","last_clean":"2024-04-18T04:54:41.173081+0000","last_became_active":"2024-04-18T04:54:40.800598+0000","last_became_peered":"2024-04-18T04:54:40.800598+0000","last_unstale":"2024-04-18T04:54:41.173081+0000","last_undegraded":"2024-04-18T04:54:41.173081+0000","last_fullsized":"2024-04-18T04:54:41.173081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454296+0000","last_change":"2024-04-18T04:54:41.197813+0000","last_active":"2024-04-18T04:54:42.454296+0000","last_peered":"2024-04-18T04:54:42.454296+0000","last_clean":"2024-04-18T04:54:42.454296+0000","last_became_active":"2024-04-18T04:54:41.197201+0000","last_became_peered":"2024-04-18T04:54:41.197201+0000","last_unstale":"2024-04-18T04:54:42.454296+0000","last_undegraded":"2024-04-18T04:54:42.454296+0000","last_fullsized":"2024-04-18T04:54:42.454296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.171356+0000","last_change":"2024-04-18T04:54:40.800416+0000","last_active":"2024-04-18T04:54:42.171356+0000","last_peered":"2024-04-18T04:54:42.171356+0000","last_clean":"2024-04-18T04:54:42.171356+0000","last_became_active":"2024-04-18T04:54:40.797471+0000","last_became_peered":"2024-04-18T04:54:40.797471+0000","last_unstale":"2024-04-18T04:54:42.171356+0000","last_undegraded":"2024-04-18T04:54:42.171356+0000","last_fullsized":"2024-04-18T04:54:42.171356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:33.118670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170092+0000","last_change":"2024-04-18T04:54:41.192024+0000","last_active":"2024-04-18T04:54:42.170092+0000","last_peered":"2024-04-18T04:54:42.170092+0000","last_clean":"2024-04-18T04:54:42.170092+0000","last_became_active":"2024-04-18T04:54:41.191488+0000","last_became_peered":"2024-04-18T04:54:41.191488+0000","last_unstale":"2024-04-18T04:54:42.170092+0000","last_undegraded":"2024-04-18T04:54:42.170092+0000","last_fullsized":"2024-04-18T04:54:42.170092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:39:31.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.172821+0000","last_change":"2024-04-18T04:54:40.823863+0000","last_active":"2024-04-18T04:54:41.172821+0000","last_peered":"2024-04-18T04:54:41.172821+0000","last_clean":"2024-04-18T04:54:41.172821+0000","last_became_active":"2024-04-18T04:54:40.823277+0000","last_became_peered":"2024-04-18T04:54:40.823277+0000","last_unstale":"2024-04-18T04:54:41.172821+0000","last_undegraded":"2024-04-18T04:54:41.172821+0000","last_fullsized":"2024-04-18T04:54:41.172821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454635+0000","last_change":"2024-04-18T04:54:41.199981+0000","last_active":"2024-04-18T04:54:42.454635+0000","last_peered":"2024-04-18T04:54:42.454635+0000","last_clean":"2024-04-18T04:54:42.454635+0000","last_became_active":"2024-04-18T04:54:41.199700+0000","last_became_peered":"2024-04-18T04:54:41.199700+0000","last_unstale":"2024-04-18T04:54:42.454635+0000","last_undegraded":"2024-04-18T04:54:42.454635+0000","last_fullsized":"2024-04-18T04:54:42.454635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.181520+0000","last_change":"2024-04-18T04:54:40.800740+0000","last_active":"2024-04-18T04:54:46.181520+0000","last_peered":"2024-04-18T04:54:46.181520+0000","last_clean":"2024-04-18T04:54:46.181520+0000","last_became_active":"2024-04-18T04:54:40.800405+0000","last_became_peered":"2024-04-18T04:54:40.800405+0000","last_unstale":"2024-04-18T04:54:46.181520+0000","last_undegraded":"2024-04-18T04:54:46.181520+0000","last_fullsized":"2024-04-18T04:54:46.181520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454668+0000","last_change":"2024-04-18T04:54:41.192487+0000","last_active":"2024-04-18T04:54:42.454668+0000","last_peered":"2024-04-18T04:54:42.454668+0000","last_clean":"2024-04-18T04:54:42.454668+0000","last_became_active":"2024-04-18T04:54:41.186301+0000","last_became_peered":"2024-04-18T04:54:41.186301+0000","last_unstale":"2024-04-18T04:54:42.454668+0000","last_undegraded":"2024-04-18T04:54:42.454668+0000","last_fullsized":"2024-04-18T04:54:42.454668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455262+0000","last_change":"2024-04-18T04:54:41.193260+0000","last_active":"2024-04-18T04:54:42.455262+0000","last_peered":"2024-04-18T04:54:42.455262+0000","last_clean":"2024-04-18T04:54:42.455262+0000","last_became_active":"2024-04-18T04:54:41.192941+0000","last_became_peered":"2024-04-18T04:54:41.192941+0000","last_unstale":"2024-04-18T04:54:42.455262+0000","last_undegraded":"2024-04-18T04:54:42.455262+0000","last_fullsized":"2024-04-18T04:54:42.455262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.181037+0000","last_change":"2024-04-18T04:54:40.800162+0000","last_active":"2024-04-18T04:54:46.181037+0000","last_peered":"2024-04-18T04:54:46.181037+0000","last_clean":"2024-04-18T04:54:46.181037+0000","last_became_active":"2024-04-18T04:54:40.799517+0000","last_became_peered":"2024-04-18T04:54:40.799517+0000","last_unstale":"2024-04-18T04:54:46.181037+0000","last_undegraded":"2024-04-18T04:54:46.181037+0000","last_fullsized":"2024-04-18T04:54:46.181037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167393+0000","last_change":"2024-04-18T04:54:41.179695+0000","last_active":"2024-04-18T04:54:42.167393+0000","last_peered":"2024-04-18T04:54:42.167393+0000","last_clean":"2024-04-18T04:54:42.167393+0000","last_became_active":"2024-04-18T04:54:41.179359+0000","last_became_peered":"2024-04-18T04:54:41.179359+0000","last_unstale":"2024-04-18T04:54:42.167393+0000","last_undegraded":"2024-04-18T04:54:42.167393+0000","last_fullsized":"2024-04-18T04:54:42.167393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.179935+0000","last_change":"2024-04-18T04:54:40.801178+0000","last_active":"2024-04-18T04:54:46.179935+0000","last_peered":"2024-04-18T04:54:46.179935+0000","last_clean":"2024-04-18T04:54:46.179935+0000","last_became_active":"2024-04-18T04:54:40.800660+0000","last_became_peered":"2024-04-18T04:54:40.800660+0000","last_unstale":"2024-04-18T04:54:46.179935+0000","last_undegraded":"2024-04-18T04:54:46.179935+0000","last_fullsized":"2024-04-18T04:54:46.179935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170091+0000","last_change":"2024-04-18T04:54:41.190055+0000","last_active":"2024-04-18T04:54:42.170091+0000","last_peered":"2024-04-18T04:54:42.170091+0000","last_clean":"2024-04-18T04:54:42.170091+0000","last_became_active":"2024-04-18T04:54:41.189344+0000","last_became_peered":"2024-04-18T04:54:41.189344+0000","last_unstale":"2024-04-18T04:54:42.170091+0000","last_undegraded":"2024-04-18T04:54:42.170091+0000","last_fullsized":"2024-04-18T04:54:42.170091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170428+0000","last_change":"2024-04-18T04:54:40.813931+0000","last_active":"2024-04-18T04:54:42.170428+0000","last_peered":"2024-04-18T04:54:42.170428+0000","last_clean":"2024-04-18T04:54:42.170428+0000","last_became_active":"2024-04-18T04:54:40.813290+0000","last_became_peered":"2024-04-18T04:54:40.813290+0000","last_unstale":"2024-04-18T04:54:42.170428+0000","last_undegraded":"2024-04-18T04:54:42.170428+0000","last_fullsized":"2024-04-18T04:54:42.170428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170238+0000","last_change":"2024-04-18T04:54:41.192913+0000","last_active":"2024-04-18T04:54:42.170238+0000","last_peered":"2024-04-18T04:54:42.170238+0000","last_clean":"2024-04-18T04:54:42.170238+0000","last_became_active":"2024-04-18T04:54:41.192096+0000","last_became_peered":"2024-04-18T04:54:41.192096+0000","last_unstale":"2024-04-18T04:54:42.170238+0000","last_undegraded":"2024-04-18T04:54:42.170238+0000","last_fullsized":"2024-04-18T04:54:42.170238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:37:53.082409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.183325+0000","last_change":"2024-04-18T04:54:40.805596+0000","last_active":"2024-04-18T04:54:46.183325+0000","last_peered":"2024-04-18T04:54:46.183325+0000","last_clean":"2024-04-18T04:54:46.183325+0000","last_became_active":"2024-04-18T04:54:40.804913+0000","last_became_peered":"2024-04-18T04:54:40.804913+0000","last_unstale":"2024-04-18T04:54:46.183325+0000","last_undegraded":"2024-04-18T04:54:46.183325+0000","last_fullsized":"2024-04-18T04:54:46.183325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:44.772589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":73213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":663549,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":73671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":663527,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":73145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":75325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":74653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:54:53.213 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T04:54:53.213 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-18T04:54:53.213 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-18T04:54:53.213 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-18T04:54:53.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.359+0000 7f0ae2ed2640 1 Processor -- start 2024-04-18T04:54:53.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.359+0000 7f0ae2ed2640 1 -- start start 2024-04-18T04:54:53.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae2ed2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0adc06d930 0x7f0adc070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:53.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae2ed2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0adc156050 0x7f0adc06dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:53.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae2ed2640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0adc0721e0 con 0x7f0adc0c1870 2024-04-18T04:54:53.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae2ed2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc0c48a0 con 0x7f0adc156050 2024-04-18T04:54:53.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae2ed2640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc06e250 con 0x7f0adc06d930 2024-04-18T04:54:53.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae146f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0adc156050 0x7f0adc06dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:53.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae146f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0adc156050 0x7f0adc06dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38946/0 (socket says 172.21.15.96:38946) 2024-04-18T04:54:53.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae146f640 1 -- 172.21.15.96:0/2050455580 learned_addr learned my addr 172.21.15.96:0/2050455580 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:53.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae0c6e640 1 --2- 172.21.15.96:0/2050455580 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0adc06d930 0x7f0adc070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:53.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae146f640 1 -- 172.21.15.96:0/2050455580 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0adc06d930 msgr2=0x7f0adc070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:53.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae146f640 1 --2- 172.21.15.96:0/2050455580 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0adc06d930 0x7f0adc070fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae146f640 1 -- 172.21.15.96:0/2050455580 >> v1:172.21.15.139:6789/0 conn(0x7f0adc0c1870 legacy=0x7f0adc0c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:53.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae146f640 1 -- 172.21.15.96:0/2050455580 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc070730 con 0x7f0adc156050 2024-04-18T04:54:53.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae0c6e640 1 --2- 172.21.15.96:0/2050455580 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0adc06d930 0x7f0adc070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:53.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae146f640 1 --2- 172.21.15.96:0/2050455580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0adc156050 0x7f0adc06dd10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400d150 tx=0x7f0ad40213e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e21807efa9c2af server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:53.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0adb7fe640 1 -- 172.21.15.96:0/2050455580 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40aaea0 con 0x7f0adc156050 2024-04-18T04:54:53.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0adb7fe640 1 -- 172.21.15.96:0/2050455580 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad40ad050 con 0x7f0adc156050 2024-04-18T04:54:53.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0adb7fe640 1 -- 172.21.15.96:0/2050455580 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4009600 con 0x7f0adc156050 2024-04-18T04:54:53.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae2ed2640 1 -- 172.21.15.96:0/2050455580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0adc156050 msgr2=0x7f0adc06dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:53.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae2ed2640 1 --2- 172.21.15.96:0/2050455580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0adc156050 0x7f0adc06dd10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400d150 tx=0x7f0ad40213e0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae2ed2640 1 -- 172.21.15.96:0/2050455580 shutdown_connections 2024-04-18T04:54:53.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae2ed2640 1 --2- 172.21.15.96:0/2050455580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0adc156050 0x7f0adc06dd10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae2ed2640 1 --2- 172.21.15.96:0/2050455580 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0adc06d930 0x7f0adc070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.363+0000 7f0ae2ed2640 1 -- 172.21.15.96:0/2050455580 >> 172.21.15.96:0/2050455580 conn(0x7f0adc06c750 msgr2=0x7f0adc0c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:53.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae2ed2640 1 -- 172.21.15.96:0/2050455580 shutdown_connections 2024-04-18T04:54:53.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae2ed2640 1 -- 172.21.15.96:0/2050455580 wait complete. 2024-04-18T04:54:53.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae2ed2640 1 Processor -- start 2024-04-18T04:54:53.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae2ed2640 1 -- start start 2024-04-18T04:54:53.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae2ed2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0adc06d930 0x7f0adc14d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:53.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae2ed2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0adc0c1870 0x7f0adc1ee1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:53.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae2ed2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0adc156050 0x7f0adc1e0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:53.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae2ed2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0c9350 con 0x7f0adc06d930 2024-04-18T04:54:53.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae2ed2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc1edd40 con 0x7f0adc0c1870 2024-04-18T04:54:53.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae2ed2640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc1e1a00 con 0x7f0adc156050 2024-04-18T04:54:53.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae0c6e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0adc06d930 0x7f0adc14d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:53.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae0c6e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0adc06d930 0x7f0adc14d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38950/0 (socket says 172.21.15.96:38950) 2024-04-18T04:54:53.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae0c6e640 1 -- 172.21.15.96:0/2284056047 learned_addr learned my addr 172.21.15.96:0/2284056047 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae0c6e640 1 -- 172.21.15.96:0/2284056047 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0adc156050 msgr2=0x7f0adc1e0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae0c6e640 1 --2- 172.21.15.96:0/2284056047 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0adc156050 0x7f0adc1e0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae0c6e640 1 -- 172.21.15.96:0/2284056047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0adc0c1870 msgr2=0x7f0adc1ee1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae0c6e640 1 --2- 172.21.15.96:0/2284056047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0adc0c1870 0x7f0adc1ee1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae0c6e640 1 -- 172.21.15.96:0/2284056047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad400bd40 con 0x7f0adc06d930 2024-04-18T04:54:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae0c6e640 1 --2- 172.21.15.96:0/2284056047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0adc06d930 0x7f0adc14d9f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c820 tx=0x7f0ad000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ad97fa640 1 -- 172.21.15.96:0/2284056047 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0007a30 con 0x7f0adc06d930 2024-04-18T04:54:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ad97fa640 1 -- 172.21.15.96:0/2284056047 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad0007b90 con 0x7f0adc06d930 2024-04-18T04:54:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae2ed2640 1 -- 172.21.15.96:0/2284056047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc1eda10 con 0x7f0adc06d930 2024-04-18T04:54:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ad97fa640 1 -- 172.21.15.96:0/2284056047 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad000ce10 con 0x7f0adc06d930 2024-04-18T04:54:53.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae2ed2640 1 -- 172.21.15.96:0/2284056047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc0c9580 con 0x7f0adc06d930 2024-04-18T04:54:53.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ae2ed2640 1 -- 172.21.15.96:0/2284056047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0adc1e1b40 con 0x7f0adc06d930 2024-04-18T04:54:53.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.367+0000 7f0ad97fa640 1 -- 172.21.15.96:0/2284056047 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0ad00113f0 con 0x7f0adc06d930 2024-04-18T04:54:53.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.371+0000 7f0ad97fa640 1 --2- 172.21.15.96:0/2284056047 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0ac0066690 0x7f0ac0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:53.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.371+0000 7f0ad97fa640 1 -- 172.21.15.96:0/2284056047 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ad0084330 con 0x7f0adc06d930 2024-04-18T04:54:53.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.371+0000 7f0adbfff640 1 --2- 172.21.15.96:0/2284056047 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0ac0066690 0x7f0ac0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:53.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.371+0000 7f0adbfff640 1 --2- 172.21.15.96:0/2284056047 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0ac0066690 0x7f0ac0068b50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0adc14e630 tx=0x7f0ac8006bf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:53.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.375+0000 7f0ad97fa640 1 -- 172.21.15.96:0/2284056047 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0ad0051610 con 0x7f0adc06d930 2024-04-18T04:54:53.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.551+0000 7f0ae2ed2640 1 -- 172.21.15.96:0/2284056047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0adc067050 con 0x7f0adc06d930 2024-04-18T04:54:53.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.551+0000 7f0ad97fa640 1 -- 172.21.15.96:0/2284056047 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+196 (secure 0 0 0) 0x7f0ad0054c30 con 0x7f0adc06d930 2024-04-18T04:54:53.553 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:53.553 INFO:teuthology.orchestra.run.smithi096.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-18T04:54:53.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.551+0000 7f0ae2ed2640 1 -- 172.21.15.96:0/2284056047 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0ac0066690 msgr2=0x7f0ac0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:53.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.551+0000 7f0ae2ed2640 1 --2- 172.21.15.96:0/2284056047 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0ac0066690 0x7f0ac0068b50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0adc14e630 tx=0x7f0ac8006bf0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.551+0000 7f0ae2ed2640 1 -- 172.21.15.96:0/2284056047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0adc06d930 msgr2=0x7f0adc14d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:53.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.551+0000 7f0ae2ed2640 1 --2- 172.21.15.96:0/2284056047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0adc06d930 0x7f0adc14d9f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c820 tx=0x7f0ad000cce0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.555+0000 7f0ae2ed2640 1 -- 172.21.15.96:0/2284056047 shutdown_connections 2024-04-18T04:54:53.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.555+0000 7f0ae2ed2640 1 --2- 172.21.15.96:0/2284056047 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0ac0066690 0x7f0ac0068b50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.555+0000 7f0ae2ed2640 1 --2- 172.21.15.96:0/2284056047 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0adc156050 0x7f0adc1e0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.555+0000 7f0ae2ed2640 1 --2- 172.21.15.96:0/2284056047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0adc0c1870 0x7f0adc1ee1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.555+0000 7f0ae2ed2640 1 --2- 172.21.15.96:0/2284056047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0adc06d930 0x7f0adc14d9f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:53.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.555+0000 7f0ae2ed2640 1 -- 172.21.15.96:0/2284056047 >> 172.21.15.96:0/2284056047 conn(0x7f0adc06c750 msgr2=0x7f0adc0c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:53.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.555+0000 7f0ae2ed2640 1 -- 172.21.15.96:0/2284056047 shutdown_connections 2024-04-18T04:54:53.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:53.555+0000 7f0ae2ed2640 1 -- 172.21.15.96:0/2284056047 wait complete. 2024-04-18T04:54:55.754 INFO:tasks.ceph.mds.f.smithi139.stderr:2024-04-18T04:54:55.754+0000 7f98ab761640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-18T04:54:55.754 INFO:tasks.ceph.mds.f.smithi139.stderr:2024-04-18T04:54:55.754+0000 7f98ab761640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-18T04:54:56.571 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-18T04:54:56.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.699+0000 7f0224af1640 1 Processor -- start 2024-04-18T04:54:56.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.699+0000 7f0224af1640 1 -- start start 2024-04-18T04:54:56.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.699+0000 7f0224af1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0220151210 0x7f02200c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:56.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.699+0000 7f0224af1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02200c1db0 0x7f02200ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:56.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.699+0000 7f0224af1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0220157150 con 0x7f02200ca840 2024-04-18T04:54:56.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.699+0000 7f0224af1640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0220157430 con 0x7f0220151210 2024-04-18T04:54:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.699+0000 7f0224af1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0220157710 con 0x7f02200c1db0 2024-04-18T04:54:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.699+0000 7f021ed9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f02200ca840 0x7f022015a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46414/0 (socket says 172.21.15.96:46414) 2024-04-18T04:54:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.699+0000 7f021ed9d640 1 -- 172.21.15.96:0/3112623029 learned_addr learned my addr 172.21.15.96:0/3112623029 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:54:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.699+0000 7f021e59c640 1 --2- 172.21.15.96:0/3112623029 >> v2:172.21.15.139:3300/0 conn(0x7f0220151210 0x7f02200c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.699+0000 7f021dd9b640 1 --2- 172.21.15.96:0/3112623029 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02200c1db0 0x7f02200ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.699+0000 7f021d59a640 1 -- 172.21.15.96:0/3112623029 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916213261 0 0) 0x7f0220157150 con 0x7f02200ca840 2024-04-18T04:54:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.699+0000 7f021d59a640 1 -- 172.21.15.96:0/3112623029 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0208003530 con 0x7f02200ca840 2024-04-18T04:54:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 -- 172.21.15.96:0/3112623029 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 928477990 0 0) 0x7f0208003530 con 0x7f02200ca840 2024-04-18T04:54:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 -- 172.21.15.96:0/3112623029 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02200c1db0 msgr2=0x7f02200ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 --2- 172.21.15.96:0/3112623029 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02200c1db0 0x7f02200ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 -- 172.21.15.96:0/3112623029 >> v2:172.21.15.139:3300/0 conn(0x7f0220151210 msgr2=0x7f02200c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 --2- 172.21.15.96:0/3112623029 >> v2:172.21.15.139:3300/0 conn(0x7f0220151210 0x7f02200c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:56.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 -- 172.21.15.96:0/3112623029 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02201579f0 con 0x7f02200ca840 2024-04-18T04:54:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 -- 172.21.15.96:0/3112623029 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f0218001a00 con 0x7f02200ca840 2024-04-18T04:54:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 -- 172.21.15.96:0/3112623029 >> v1:172.21.15.96:6789/0 conn(0x7f02200ca840 legacy=0x7f022015a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 --2- 172.21.15.96:0/3112623029 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02200c1db0 0x7f0208003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 --2- 172.21.15.96:0/3112623029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0208003f00 0x7f02080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 --2- 172.21.15.96:0/3112623029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0208004d10 0x7f0208005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 -- 172.21.15.96:0/3112623029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0220157430 con 0x7f0208003f00 2024-04-18T04:54:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 -- 172.21.15.96:0/3112623029 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0220157710 con 0x7f0208004d10 2024-04-18T04:54:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 -- 172.21.15.96:0/3112623029 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020800b9c0 con 0x7f02200c1db0 2024-04-18T04:54:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021dd9b640 1 --2- 172.21.15.96:0/3112623029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0208003f00 0x7f02080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021e59c640 1 --2- 172.21.15.96:0/3112623029 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02200c1db0 0x7f0208003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021ed9d640 1 --2- 172.21.15.96:0/3112623029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0208004d10 0x7f0208005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021dd9b640 1 -- 172.21.15.96:0/3112623029 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02200c1db0 msgr2=0x7f0208003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:56.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021dd9b640 1 --2- 172.21.15.96:0/3112623029 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02200c1db0 0x7f0208003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:56.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021dd9b640 1 -- 172.21.15.96:0/3112623029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0208004d10 msgr2=0x7f0208005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:56.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021dd9b640 1 --2- 172.21.15.96:0/3112623029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0208004d10 0x7f0208005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:56.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021dd9b640 1 -- 172.21.15.96:0/3112623029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0208003530 con 0x7f0208003f00 2024-04-18T04:54:56.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021ed9d640 1 --2- 172.21.15.96:0/3112623029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0208004d10 0x7f0208005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:56.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021dd9b640 1 --2- 172.21.15.96:0/3112623029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0208003f00 0x7f02080047d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0214009ae0 tx=0x7f021401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764400fb7c2abcc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:56.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 -- 172.21.15.96:0/3112623029 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02140a5660 con 0x7f0208003f00 2024-04-18T04:54:56.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 -- 172.21.15.96:0/3112623029 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02140a57c0 con 0x7f0208003f00 2024-04-18T04:54:56.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021d59a640 1 -- 172.21.15.96:0/3112623029 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02140a5b70 con 0x7f0208003f00 2024-04-18T04:54:56.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f0224af1640 1 -- 172.21.15.96:0/3112623029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0208003f00 msgr2=0x7f02080047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:56.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f0224af1640 1 --2- 172.21.15.96:0/3112623029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0208003f00 0x7f02080047d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0214009ae0 tx=0x7f021401ca70 comp rx=0 tx=0).stop 2024-04-18T04:54:56.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f021ed9d640 1 -- 172.21.15.96:0/3112623029 reap_dead start 2024-04-18T04:54:56.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f0224af1640 1 -- 172.21.15.96:0/3112623029 shutdown_connections 2024-04-18T04:54:56.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f0224af1640 1 -- 172.21.15.96:0/3112623029 >> 172.21.15.96:0/3112623029 conn(0x7f022006c750 msgr2=0x7f02200c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:56.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f0224af1640 1 -- 172.21.15.96:0/3112623029 shutdown_connections 2024-04-18T04:54:56.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.703+0000 7f0224af1640 1 -- 172.21.15.96:0/3112623029 wait complete. 2024-04-18T04:54:56.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f0224af1640 1 Processor -- start 2024-04-18T04:54:56.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f0224af1640 1 -- start start 2024-04-18T04:54:56.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f0224af1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0208003f00 0x7f02201f2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:56.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f0224af1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02200ca120 0x7f022014a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:56.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f0224af1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02200c83d0 0x7f0220148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:56.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f0224af1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02200c9e20 con 0x7f02200c83d0 2024-04-18T04:54:56.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f0224af1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022014af10 con 0x7f02200ca120 2024-04-18T04:54:56.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f0224af1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02200c8f50 con 0x7f0208003f00 2024-04-18T04:54:56.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f021ed9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02200c83d0 0x7f0220148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:56.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f021ed9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02200c83d0 0x7f0220148c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38962/0 (socket says 172.21.15.96:38962) 2024-04-18T04:54:56.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f021ed9d640 1 -- 172.21.15.96:0/2551241953 learned_addr learned my addr 172.21.15.96:0/2551241953 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:54:56.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f021dd9b640 1 --2- 172.21.15.96:0/2551241953 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02200ca120 0x7f022014a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:56.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f021e59c640 1 --2- 172.21.15.96:0/2551241953 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0208003f00 0x7f02201f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:56.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f021ed9d640 1 -- 172.21.15.96:0/2551241953 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0208003f00 msgr2=0x7f02201f2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f021ed9d640 1 --2- 172.21.15.96:0/2551241953 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0208003f00 0x7f02201f2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f021ed9d640 1 -- 172.21.15.96:0/2551241953 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02200ca120 msgr2=0x7f022014a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f021ed9d640 1 --2- 172.21.15.96:0/2551241953 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02200ca120 0x7f022014a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f021ed9d640 1 -- 172.21.15.96:0/2551241953 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0220156f20 con 0x7f02200c83d0 2024-04-18T04:54:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f021ed9d640 1 --2- 172.21.15.96:0/2551241953 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02200c83d0 0x7f0220148c80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0218000f90 tx=0x7f021800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f020effd640 1 -- 172.21.15.96:0/2551241953 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021800bb80 con 0x7f02200c83d0 2024-04-18T04:54:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f020effd640 1 -- 172.21.15.96:0/2551241953 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021800bce0 con 0x7f02200c83d0 2024-04-18T04:54:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f0224af1640 1 -- 172.21.15.96:0/2551241953 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02200c91a0 con 0x7f02200c83d0 2024-04-18T04:54:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f020effd640 1 -- 172.21.15.96:0/2551241953 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218007290 con 0x7f02200c83d0 2024-04-18T04:54:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f0224af1640 1 -- 172.21.15.96:0/2551241953 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02200c9760 con 0x7f02200c83d0 2024-04-18T04:54:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.707+0000 7f0224af1640 1 -- 172.21.15.96:0/2551241953 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02200c9f60 con 0x7f02200c83d0 2024-04-18T04:54:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.711+0000 7f020effd640 1 -- 172.21.15.96:0/2551241953 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f02180073f0 con 0x7f02200c83d0 2024-04-18T04:54:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.711+0000 7f020effd640 1 --2- 172.21.15.96:0/2551241953 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0200066690 0x7f0200068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.711+0000 7f020effd640 1 -- 172.21.15.96:0/2551241953 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02180845c0 con 0x7f02200c83d0 2024-04-18T04:54:56.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.711+0000 7f021e59c640 1 --2- 172.21.15.96:0/2551241953 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0200066690 0x7f0200068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:56.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.711+0000 7f021e59c640 1 --2- 172.21.15.96:0/2551241953 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0200066690 0x7f0200068b50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0210009ab0 tx=0x7f0210008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:56.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.715+0000 7f020effd640 1 -- 172.21.15.96:0/2551241953 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0218051930 con 0x7f02200c83d0 2024-04-18T04:54:56.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.907+0000 7f0224af1640 1 -- 172.21.15.96:0/2551241953 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0220067050 con 0x7f02200c83d0 2024-04-18T04:54:56.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.907+0000 7f020effd640 1 -- 172.21.15.96:0/2551241953 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+196 (secure 0 0 0) 0x7f0218054f50 con 0x7f02200c83d0 2024-04-18T04:54:56.910 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:54:56.910 INFO:teuthology.orchestra.run.smithi096.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-18T04:54:56.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.911+0000 7f0224af1640 1 -- 172.21.15.96:0/2551241953 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0200066690 msgr2=0x7f0200068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:56.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.911+0000 7f0224af1640 1 --2- 172.21.15.96:0/2551241953 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0200066690 0x7f0200068b50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0210009ab0 tx=0x7f0210008040 comp rx=0 tx=0).stop 2024-04-18T04:54:56.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.911+0000 7f0224af1640 1 -- 172.21.15.96:0/2551241953 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02200c83d0 msgr2=0x7f0220148c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:56.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.911+0000 7f0224af1640 1 --2- 172.21.15.96:0/2551241953 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02200c83d0 0x7f0220148c80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0218000f90 tx=0x7f021800b4a0 comp rx=0 tx=0).stop 2024-04-18T04:54:56.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.911+0000 7f0224af1640 1 -- 172.21.15.96:0/2551241953 shutdown_connections 2024-04-18T04:54:56.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.911+0000 7f0224af1640 1 --2- 172.21.15.96:0/2551241953 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0200066690 0x7f0200068b50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:56.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.911+0000 7f0224af1640 1 --2- 172.21.15.96:0/2551241953 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02200c83d0 0x7f0220148c80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:56.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.911+0000 7f0224af1640 1 --2- 172.21.15.96:0/2551241953 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02200ca120 0x7f022014a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:56.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.911+0000 7f0224af1640 1 --2- 172.21.15.96:0/2551241953 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0208003f00 0x7f02201f2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:56.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.911+0000 7f0224af1640 1 -- 172.21.15.96:0/2551241953 >> 172.21.15.96:0/2551241953 conn(0x7f022006c750 msgr2=0x7f02200c2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:56.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.911+0000 7f0224af1640 1 -- 172.21.15.96:0/2551241953 shutdown_connections 2024-04-18T04:54:56.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:54:56.911+0000 7f0224af1640 1 -- 172.21.15.96:0/2551241953 wait complete. 2024-04-18T04:54:59.930 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-18T04:55:00.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.054+0000 7fc63fe84640 1 Processor -- start 2024-04-18T04:55:00.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.054+0000 7fc63fe84640 1 -- start start 2024-04-18T04:55:00.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.054+0000 7fc63fe84640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc63806a0c0 0x7fc63806efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:00.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.054+0000 7fc63fe84640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc63806a4a0 0x7fc63806f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:00.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.054+0000 7fc63fe84640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6380cb150 con 0x7fc6380cb610 2024-04-18T04:55:00.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.054+0000 7fc63fe84640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63815c690 con 0x7fc63806a0c0 2024-04-18T04:55:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.054+0000 7fc63fe84640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63815c970 con 0x7fc63806a4a0 2024-04-18T04:55:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.054+0000 7fc63dc20640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc63806a0c0 0x7fc63806efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.054+0000 7fc63e421640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc6380cb610 0x7fc6380cba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48306/0 (socket says 172.21.15.96:48306) 2024-04-18T04:55:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.054+0000 7fc63e421640 1 -- 172.21.15.96:0/920406480 learned_addr learned my addr 172.21.15.96:0/920406480 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63d41f640 1 --2- 172.21.15.96:0/920406480 >> v2:172.21.15.139:3300/0 conn(0x7fc63806a4a0 0x7fc63806f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63dc20640 1 -- 172.21.15.96:0/920406480 >> v2:172.21.15.139:3300/0 conn(0x7fc63806a4a0 msgr2=0x7fc63806f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63dc20640 1 --2- 172.21.15.96:0/920406480 >> v2:172.21.15.139:3300/0 conn(0x7fc63806a4a0 0x7fc63806f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63dc20640 1 -- 172.21.15.96:0/920406480 >> v1:172.21.15.96:6789/0 conn(0x7fc6380cb610 legacy=0x7fc6380cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63dc20640 1 -- 172.21.15.96:0/920406480 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63815cc50 con 0x7fc63806a0c0 2024-04-18T04:55:00.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63cc1e640 1 -- 172.21.15.96:0/920406480 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328737829 0 0) 0x7fc6380cb150 con 0x7fc6380cb610 2024-04-18T04:55:00.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63dc20640 1 --2- 172.21.15.96:0/920406480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc63806a0c0 0x7fc63806efd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc6380c59b0 tx=0x7fc62401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21729e5b522afce9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:00.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63cc1e640 1 -- 172.21.15.96:0/920406480 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6240a8970 con 0x7fc63806a0c0 2024-04-18T04:55:00.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63cc1e640 1 -- 172.21.15.96:0/920406480 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6240a8ad0 con 0x7fc63806a0c0 2024-04-18T04:55:00.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63cc1e640 1 -- 172.21.15.96:0/920406480 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6240a8e60 con 0x7fc63806a0c0 2024-04-18T04:55:00.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63fe84640 1 -- 172.21.15.96:0/920406480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc63806a0c0 msgr2=0x7fc63806efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:00.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63fe84640 1 --2- 172.21.15.96:0/920406480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc63806a0c0 0x7fc63806efd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc6380c59b0 tx=0x7fc62401ec70 comp rx=0 tx=0).stop 2024-04-18T04:55:00.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63fe84640 1 -- 172.21.15.96:0/920406480 shutdown_connections 2024-04-18T04:55:00.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63fe84640 1 --2- 172.21.15.96:0/920406480 >> v2:172.21.15.139:3300/0 conn(0x7fc63806a4a0 0x7fc63806f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:00.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63fe84640 1 --2- 172.21.15.96:0/920406480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc63806a0c0 0x7fc63806efd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:00.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63fe84640 1 -- 172.21.15.96:0/920406480 >> 172.21.15.96:0/920406480 conn(0x7fc63806af70 msgr2=0x7fc63806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:00.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63fe84640 1 -- 172.21.15.96:0/920406480 shutdown_connections 2024-04-18T04:55:00.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.058+0000 7fc63fe84640 1 -- 172.21.15.96:0/920406480 wait complete. 2024-04-18T04:55:00.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63fe84640 1 Processor -- start 2024-04-18T04:55:00.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63fe84640 1 -- start start 2024-04-18T04:55:00.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63fe84640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc63806a0c0 0x7fc63814e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:00.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63fe84640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc63806a4a0 0x7fc6380c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63fe84640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6380cb610 0x7fc6380c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63fe84640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc638072010 con 0x7fc63806a0c0 2024-04-18T04:55:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63fe84640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380c6690 con 0x7fc6380cb610 2024-04-18T04:55:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63fe84640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380c6970 con 0x7fc63806a4a0 2024-04-18T04:55:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63dc20640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc63806a0c0 0x7fc63814e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63dc20640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc63806a0c0 0x7fc63814e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56224/0 (socket says 172.21.15.96:56224) 2024-04-18T04:55:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63dc20640 1 -- 172.21.15.96:0/772204545 learned_addr learned my addr 172.21.15.96:0/772204545 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63e421640 1 --2- 172.21.15.96:0/772204545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6380cb610 0x7fc6380c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63d41f640 1 --2- 172.21.15.96:0/772204545 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc63806a4a0 0x7fc6380c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63dc20640 1 -- 172.21.15.96:0/772204545 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc63806a4a0 msgr2=0x7fc6380c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:00.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63dc20640 1 --2- 172.21.15.96:0/772204545 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc63806a4a0 0x7fc6380c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:00.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63dc20640 1 -- 172.21.15.96:0/772204545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6380cb610 msgr2=0x7fc6380c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:00.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63dc20640 1 --2- 172.21.15.96:0/772204545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6380cb610 0x7fc6380c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:00.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63dc20640 1 -- 172.21.15.96:0/772204545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc624009420 con 0x7fc63806a0c0 2024-04-18T04:55:00.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63dc20640 1 --2- 172.21.15.96:0/772204545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc63806a0c0 0x7fc63814e7c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc62401b880 tx=0x7fc62401d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:00.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc6367fc640 1 -- 172.21.15.96:0/772204545 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6240a8970 con 0x7fc63806a0c0 2024-04-18T04:55:00.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc6367fc640 1 -- 172.21.15.96:0/772204545 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc624006e20 con 0x7fc63806a0c0 2024-04-18T04:55:00.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63fe84640 1 -- 172.21.15.96:0/772204545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6380c6c50 con 0x7fc63806a0c0 2024-04-18T04:55:00.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc6367fc640 1 -- 172.21.15.96:0/772204545 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624004230 con 0x7fc63806a0c0 2024-04-18T04:55:00.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63fe84640 1 -- 172.21.15.96:0/772204545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6380c4bb0 con 0x7fc63806a0c0 2024-04-18T04:55:00.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc63fe84640 1 -- 172.21.15.96:0/772204545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6380c7170 con 0x7fc63806a0c0 2024-04-18T04:55:00.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.062+0000 7fc6367fc640 1 -- 172.21.15.96:0/772204545 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc624004390 con 0x7fc63806a0c0 2024-04-18T04:55:00.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.066+0000 7fc6367fc640 1 --2- 172.21.15.96:0/772204545 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc620066690 0x7fc620068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:00.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.066+0000 7fc6367fc640 1 -- 172.21.15.96:0/772204545 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc624121930 con 0x7fc63806a0c0 2024-04-18T04:55:00.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.066+0000 7fc63d41f640 1 --2- 172.21.15.96:0/772204545 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc620066690 0x7fc620068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:00.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.066+0000 7fc63d41f640 1 --2- 172.21.15.96:0/772204545 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc620066690 0x7fc620068b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc628003fd0 tx=0x7fc6280039a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:00.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.070+0000 7fc6367fc640 1 -- 172.21.15.96:0/772204545 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc6380c7170 con 0x7fc63806a0c0 2024-04-18T04:55:00.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.262+0000 7fc63fe84640 1 -- 172.21.15.96:0/772204545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc6380c7170 con 0x7fc63806a0c0 2024-04-18T04:55:00.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.262+0000 7fc6367fc640 1 -- 172.21.15.96:0/772204545 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+196 (secure 0 0 0) 0x7fc6240b50e0 con 0x7fc63806a0c0 2024-04-18T04:55:00.267 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:55:00.267 INFO:teuthology.orchestra.run.smithi096.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-18T04:55:00.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.266+0000 7fc63fe84640 1 -- 172.21.15.96:0/772204545 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc620066690 msgr2=0x7fc620068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:00.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.266+0000 7fc63fe84640 1 --2- 172.21.15.96:0/772204545 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc620066690 0x7fc620068b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc628003fd0 tx=0x7fc6280039a0 comp rx=0 tx=0).stop 2024-04-18T04:55:00.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.266+0000 7fc63fe84640 1 -- 172.21.15.96:0/772204545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc63806a0c0 msgr2=0x7fc63814e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:00.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.266+0000 7fc63fe84640 1 --2- 172.21.15.96:0/772204545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc63806a0c0 0x7fc63814e7c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc62401b880 tx=0x7fc62401d4b0 comp rx=0 tx=0).stop 2024-04-18T04:55:00.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.266+0000 7fc63fe84640 1 -- 172.21.15.96:0/772204545 shutdown_connections 2024-04-18T04:55:00.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.266+0000 7fc63fe84640 1 --2- 172.21.15.96:0/772204545 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc620066690 0x7fc620068b50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:00.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.266+0000 7fc63fe84640 1 --2- 172.21.15.96:0/772204545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6380cb610 0x7fc6380c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:00.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.266+0000 7fc63fe84640 1 --2- 172.21.15.96:0/772204545 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc63806a4a0 0x7fc6380c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:00.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.266+0000 7fc63fe84640 1 --2- 172.21.15.96:0/772204545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc63806a0c0 0x7fc63814e7c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:00.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.266+0000 7fc63fe84640 1 -- 172.21.15.96:0/772204545 >> 172.21.15.96:0/772204545 conn(0x7fc63806af70 msgr2=0x7fc63815a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:00.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.266+0000 7fc63fe84640 1 -- 172.21.15.96:0/772204545 shutdown_connections 2024-04-18T04:55:00.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:00.266+0000 7fc63fe84640 1 -- 172.21.15.96:0/772204545 wait complete. 2024-04-18T04:55:00.755 INFO:tasks.ceph.mds.f.smithi139.stderr:2024-04-18T04:55:00.754+0000 7f98ab761640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-18T04:55:03.286 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-18T04:55:03.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.410+0000 7f1dc113b640 1 Processor -- start 2024-04-18T04:55:03.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.410+0000 7f1dc113b640 1 -- start start 2024-04-18T04:55:03.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1dc113b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1dbc1532d0 0x7f1dbc158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:03.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1dc113b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1dbc0cacc0 0x7f1dbc15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:03.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1dc113b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dbc15d3b0 con 0x7f1dbc0c3fd0 2024-04-18T04:55:03.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1dc113b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dbc0c5970 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1dc113b640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dbc1594a0 con 0x7f1dbc1532d0 2024-04-18T04:55:03.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1db259c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1dbc0cacc0 0x7f1dbc15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:03.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1dbb59e640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1dbc0c3fd0 0x7f1dbc0ce740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48320/0 (socket says 172.21.15.96:48320) 2024-04-18T04:55:03.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1dbb59e640 1 -- 172.21.15.96:0/1656527699 learned_addr learned my addr 172.21.15.96:0/1656527699 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:03.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1dbad9d640 1 --2- 172.21.15.96:0/1656527699 >> v2:172.21.15.139:3300/0 conn(0x7f1dbc1532d0 0x7f1dbc158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:03.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1dba59c640 1 -- 172.21.15.96:0/1656527699 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752284779 0 0) 0x7f1dbc15d3b0 con 0x7f1dbc0c3fd0 2024-04-18T04:55:03.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1dba59c640 1 -- 172.21.15.96:0/1656527699 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1da8003530 con 0x7f1dbc0c3fd0 2024-04-18T04:55:03.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1db259c640 1 -- 172.21.15.96:0/1656527699 >> v2:172.21.15.139:3300/0 conn(0x7f1dbc1532d0 msgr2=0x7f1dbc158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:03.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1db259c640 1 --2- 172.21.15.96:0/1656527699 >> v2:172.21.15.139:3300/0 conn(0x7f1dbc1532d0 0x7f1dbc158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:03.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1db259c640 1 -- 172.21.15.96:0/1656527699 >> v1:172.21.15.96:6789/0 conn(0x7f1dbc0c3fd0 legacy=0x7f1dbc0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:03.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1db259c640 1 -- 172.21.15.96:0/1656527699 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc1536b0 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1db259c640 1 --2- 172.21.15.96:0/1656527699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dbc0cacc0 0x7f1dbc15ce70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0cc2d0 tx=0x7f1da401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bbb3a2cb311cb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:03.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1dba59c640 1 -- 172.21.15.96:0/1656527699 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da40a8950 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1dba59c640 1 -- 172.21.15.96:0/1656527699 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da40a8ab0 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.414+0000 7f1dba59c640 1 -- 172.21.15.96:0/1656527699 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da40a8e20 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 -- 172.21.15.96:0/1656527699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dbc0cacc0 msgr2=0x7f1dbc15ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:03.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 --2- 172.21.15.96:0/1656527699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dbc0cacc0 0x7f1dbc15ce70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0cc2d0 tx=0x7f1da401ec50 comp rx=0 tx=0).stop 2024-04-18T04:55:03.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 -- 172.21.15.96:0/1656527699 shutdown_connections 2024-04-18T04:55:03.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 --2- 172.21.15.96:0/1656527699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dbc0cacc0 0x7f1dbc15ce70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:03.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 --2- 172.21.15.96:0/1656527699 >> v2:172.21.15.139:3300/0 conn(0x7f1dbc1532d0 0x7f1dbc158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:03.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 -- 172.21.15.96:0/1656527699 >> 172.21.15.96:0/1656527699 conn(0x7f1dbc071760 msgr2=0x7f1dbc06b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:03.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 -- 172.21.15.96:0/1656527699 shutdown_connections 2024-04-18T04:55:03.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 -- 172.21.15.96:0/1656527699 wait complete. 2024-04-18T04:55:03.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 Processor -- start 2024-04-18T04:55:03.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 -- start start 2024-04-18T04:55:03.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dbc0c3fd0 0x7f1dbc153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:03.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dbc0cacc0 0x7f1dbc151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:03.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dbc1532d0 0x7f1dbc14e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:03.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc159f20 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc14e070 con 0x7f1dbc1532d0 2024-04-18T04:55:03.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc14e270 con 0x7f1dbc0c3fd0 2024-04-18T04:55:03.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1db259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dbc0cacc0 0x7f1dbc151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:03.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1db259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dbc0cacc0 0x7f1dbc151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56242/0 (socket says 172.21.15.96:56242) 2024-04-18T04:55:03.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1db259c640 1 -- 172.21.15.96:0/845705237 learned_addr learned my addr 172.21.15.96:0/845705237 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:03.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dbad9d640 1 --2- 172.21.15.96:0/845705237 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dbc0c3fd0 0x7f1dbc153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:03.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1db259c640 1 -- 172.21.15.96:0/845705237 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dbc0c3fd0 msgr2=0x7f1dbc153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dbb59e640 1 --2- 172.21.15.96:0/845705237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dbc1532d0 0x7f1dbc14e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1db259c640 1 --2- 172.21.15.96:0/845705237 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dbc0c3fd0 0x7f1dbc153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1db259c640 1 -- 172.21.15.96:0/845705237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dbc1532d0 msgr2=0x7f1dbc14e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1db259c640 1 --2- 172.21.15.96:0/845705237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dbc1532d0 0x7f1dbc14e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1db259c640 1 -- 172.21.15.96:0/845705237 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da4009420 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1db259c640 1 --2- 172.21.15.96:0/845705237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dbc0cacc0 0x7f1dbc151850 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1da4000c10 tx=0x7f1da401b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1db3fff640 1 -- 172.21.15.96:0/845705237 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da40044d0 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1db3fff640 1 -- 172.21.15.96:0/845705237 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da4003620 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.418+0000 7f1dc113b640 1 -- 172.21.15.96:0/845705237 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dbc1ee570 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.422+0000 7f1db3fff640 1 -- 172.21.15.96:0/845705237 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da4003990 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.422+0000 7f1dc113b640 1 -- 172.21.15.96:0/845705237 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dbc1eeb30 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.422+0000 7f1dc113b640 1 -- 172.21.15.96:0/845705237 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dbc15c630 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.422+0000 7f1db3fff640 1 -- 172.21.15.96:0/845705237 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1da40b7040 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.422+0000 7f1db3fff640 1 --2- 172.21.15.96:0/845705237 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1d9c066690 0x7f1d9c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:03.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.422+0000 7f1db3fff640 1 -- 172.21.15.96:0/845705237 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1da4121950 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.422+0000 7f1dbad9d640 1 --2- 172.21.15.96:0/845705237 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1d9c066690 0x7f1d9c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:03.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.422+0000 7f1dbad9d640 1 --2- 172.21.15.96:0/845705237 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1d9c066690 0x7f1d9c068b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009790 tx=0x7f1dac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:03.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.426+0000 7f1db3fff640 1 -- 172.21.15.96:0/845705237 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1da40eecb0 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.614+0000 7f1dc113b640 1 -- 172.21.15.96:0/845705237 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1dbc067050 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.614+0000 7f1db3fff640 1 -- 172.21.15.96:0/845705237 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+196 (secure 0 0 0) 0x7f1da40f22d0 con 0x7f1dbc0cacc0 2024-04-18T04:55:03.618 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:55:03.618 INFO:teuthology.orchestra.run.smithi096.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-18T04:55:03.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.618+0000 7f1dc113b640 1 -- 172.21.15.96:0/845705237 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1d9c066690 msgr2=0x7f1d9c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.618+0000 7f1dc113b640 1 --2- 172.21.15.96:0/845705237 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1d9c066690 0x7f1d9c068b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009790 tx=0x7f1dac008040 comp rx=0 tx=0).stop 2024-04-18T04:55:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.618+0000 7f1dc113b640 1 -- 172.21.15.96:0/845705237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dbc0cacc0 msgr2=0x7f1dbc151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.618+0000 7f1dc113b640 1 --2- 172.21.15.96:0/845705237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dbc0cacc0 0x7f1dbc151850 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1da4000c10 tx=0x7f1da401b9f0 comp rx=0 tx=0).stop 2024-04-18T04:55:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.618+0000 7f1dc113b640 1 -- 172.21.15.96:0/845705237 shutdown_connections 2024-04-18T04:55:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.618+0000 7f1dc113b640 1 --2- 172.21.15.96:0/845705237 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1d9c066690 0x7f1d9c068b50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.618+0000 7f1dc113b640 1 --2- 172.21.15.96:0/845705237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dbc1532d0 0x7f1dbc14e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.618+0000 7f1dc113b640 1 --2- 172.21.15.96:0/845705237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dbc0cacc0 0x7f1dbc151850 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.618+0000 7f1dc113b640 1 --2- 172.21.15.96:0/845705237 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dbc0c3fd0 0x7f1dbc153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.618+0000 7f1dc113b640 1 -- 172.21.15.96:0/845705237 >> 172.21.15.96:0/845705237 conn(0x7f1dbc071760 msgr2=0x7f1dbc0cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.618+0000 7f1dc113b640 1 -- 172.21.15.96:0/845705237 shutdown_connections 2024-04-18T04:55:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:03.618+0000 7f1dc113b640 1 -- 172.21.15.96:0/845705237 wait complete. 2024-04-18T04:55:05.755 INFO:tasks.ceph.mds.f.smithi139.stderr:2024-04-18T04:55:05.754+0000 7f98ab761640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-04-18T04:55:06.636 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-18T04:55:06.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.762+0000 7f649a989640 1 Processor -- start 2024-04-18T04:55:06.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.762+0000 7f649a989640 1 -- start start 2024-04-18T04:55:06.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.762+0000 7f649a989640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6494151210 0x7f64940c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:06.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.762+0000 7f649a989640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f64940c1db0 0x7f64940ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:06.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.762+0000 7f649a989640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6494157150 con 0x7f64940ca840 2024-04-18T04:55:06.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.762+0000 7f649a989640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6494157430 con 0x7f64940c1db0 2024-04-18T04:55:06.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.762+0000 7f649a989640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6494157710 con 0x7f6494151210 2024-04-18T04:55:06.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.762+0000 7f6498f26640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f64940ca840 0x7f649415a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48334/0 (socket says 172.21.15.96:48334) 2024-04-18T04:55:06.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.762+0000 7f6498f26640 1 -- 172.21.15.96:0/3867441622 learned_addr learned my addr 172.21.15.96:0/3867441622 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:06.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6493fff640 1 --2- 172.21.15.96:0/3867441622 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6494151210 0x7f64940c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:06.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f64937fe640 1 --2- 172.21.15.96:0/3867441622 >> v2:172.21.15.139:3300/0 conn(0x7f64940c1db0 0x7f64940ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:06.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 -- 172.21.15.96:0/3867441622 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148900489 0 0) 0x7f6494157150 con 0x7f64940ca840 2024-04-18T04:55:06.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 -- 172.21.15.96:0/3867441622 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f647c003530 con 0x7f64940ca840 2024-04-18T04:55:06.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 -- 172.21.15.96:0/3867441622 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3595953039 0 0) 0x7f647c003530 con 0x7f64940ca840 2024-04-18T04:55:06.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 -- 172.21.15.96:0/3867441622 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6494151210 msgr2=0x7f64940c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:06.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 --2- 172.21.15.96:0/3867441622 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6494151210 0x7f64940c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:06.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 -- 172.21.15.96:0/3867441622 >> v2:172.21.15.139:3300/0 conn(0x7f64940c1db0 msgr2=0x7f64940ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:06.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 --2- 172.21.15.96:0/3867441622 >> v2:172.21.15.139:3300/0 conn(0x7f64940c1db0 0x7f64940ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:06.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 -- 172.21.15.96:0/3867441622 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64941579f0 con 0x7f64940ca840 2024-04-18T04:55:06.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 -- 172.21.15.96:0/3867441622 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f648c001a00 con 0x7f64940ca840 2024-04-18T04:55:06.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 -- 172.21.15.96:0/3867441622 >> v1:172.21.15.96:6789/0 conn(0x7f64940ca840 legacy=0x7f649415a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:06.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 --2- 172.21.15.96:0/3867441622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f647c003980 0x7f647c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:06.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 --2- 172.21.15.96:0/3867441622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f647c0047d0 0x7f647c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:06.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 --2- 172.21.15.96:0/3867441622 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6494151210 0x7f647c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:06.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 -- 172.21.15.96:0/3867441622 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6494157430 con 0x7f647c003980 2024-04-18T04:55:06.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 -- 172.21.15.96:0/3867441622 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6494157710 con 0x7f647c0047d0 2024-04-18T04:55:06.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 -- 172.21.15.96:0/3867441622 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c00b990 con 0x7f6494151210 2024-04-18T04:55:06.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6493fff640 1 --2- 172.21.15.96:0/3867441622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f647c003980 0x7f647c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:06.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6493fff640 1 -- 172.21.15.96:0/3867441622 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6494151210 msgr2=0x7f647c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:06.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6498f26640 1 --2- 172.21.15.96:0/3867441622 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6494151210 0x7f647c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:06.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6493fff640 1 --2- 172.21.15.96:0/3867441622 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6494151210 0x7f647c005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:06.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6493fff640 1 -- 172.21.15.96:0/3867441622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f647c0047d0 msgr2=0x7f647c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:06.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6493fff640 1 --2- 172.21.15.96:0/3867441622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f647c0047d0 0x7f647c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:06.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6493fff640 1 -- 172.21.15.96:0/3867441622 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c003530 con 0x7f647c003980 2024-04-18T04:55:06.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6493fff640 1 --2- 172.21.15.96:0/3867441622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f647c003980 0x7f647c003da0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6488009ae0 tx=0x7f648801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d4acadadd9bd07 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 -- 172.21.15.96:0/3867441622 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64880a5580 con 0x7f647c003980 2024-04-18T04:55:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 -- 172.21.15.96:0/3867441622 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64880a56e0 con 0x7f647c003980 2024-04-18T04:55:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6492ffd640 1 -- 172.21.15.96:0/3867441622 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64880a5890 con 0x7f647c003980 2024-04-18T04:55:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f649a989640 1 -- 172.21.15.96:0/3867441622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f647c003980 msgr2=0x7f647c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f649a989640 1 --2- 172.21.15.96:0/3867441622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f647c003980 0x7f647c003da0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6488009ae0 tx=0x7f648801ca70 comp rx=0 tx=0).stop 2024-04-18T04:55:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f6498f26640 1 -- 172.21.15.96:0/3867441622 reap_dead start 2024-04-18T04:55:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f649a989640 1 -- 172.21.15.96:0/3867441622 shutdown_connections 2024-04-18T04:55:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.766+0000 7f649a989640 1 -- 172.21.15.96:0/3867441622 >> 172.21.15.96:0/3867441622 conn(0x7f649406c750 msgr2=0x7f64940c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f649a989640 1 -- 172.21.15.96:0/3867441622 shutdown_connections 2024-04-18T04:55:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f649a989640 1 -- 172.21.15.96:0/3867441622 wait complete. 2024-04-18T04:55:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f649a989640 1 Processor -- start 2024-04-18T04:55:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f649a989640 1 -- start start 2024-04-18T04:55:06.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f649a989640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f647c003980 0x7f64941492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:06.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f649a989640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f649414d4c0 0x7f64941ef880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:06.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f649a989640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64941ed520 0x7f6494146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:06.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f649a989640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6494148ec0 con 0x7f64941ed520 2024-04-18T04:55:06.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f649a989640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64941543b0 con 0x7f649414d4c0 2024-04-18T04:55:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f649a989640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64941f0390 con 0x7f647c003980 2024-04-18T04:55:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f6498f26640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64941ed520 0x7f6494146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f6498f26640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64941ed520 0x7f6494146720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56270/0 (socket says 172.21.15.96:56270) 2024-04-18T04:55:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f6498f26640 1 -- 172.21.15.96:0/3328886057 learned_addr learned my addr 172.21.15.96:0/3328886057 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f64937fe640 1 --2- 172.21.15.96:0/3328886057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f649414d4c0 0x7f64941ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f6493fff640 1 --2- 172.21.15.96:0/3328886057 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f647c003980 0x7f64941492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f6498f26640 1 -- 172.21.15.96:0/3328886057 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f647c003980 msgr2=0x7f64941492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f6498f26640 1 --2- 172.21.15.96:0/3328886057 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f647c003980 0x7f64941492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f6498f26640 1 -- 172.21.15.96:0/3328886057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f649414d4c0 msgr2=0x7f64941ef880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f6498f26640 1 --2- 172.21.15.96:0/3328886057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f649414d4c0 0x7f64941ef880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f6498f26640 1 -- 172.21.15.96:0/3328886057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6494156f20 con 0x7f64941ed520 2024-04-18T04:55:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f6498f26640 1 --2- 172.21.15.96:0/3328886057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64941ed520 0x7f6494146720 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f648c004c00 tx=0x7f648c010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f6490ff9640 1 -- 172.21.15.96:0/3328886057 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c00eac0 con 0x7f64941ed520 2024-04-18T04:55:06.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f6490ff9640 1 -- 172.21.15.96:0/3328886057 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c00ec20 con 0x7f64941ed520 2024-04-18T04:55:06.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f649a989640 1 -- 172.21.15.96:0/3328886057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6494148800 con 0x7f64941ed520 2024-04-18T04:55:06.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f6490ff9640 1 -- 172.21.15.96:0/3328886057 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c010e60 con 0x7f64941ed520 2024-04-18T04:55:06.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f649a989640 1 -- 172.21.15.96:0/3328886057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64941546c0 con 0x7f64941ed520 2024-04-18T04:55:06.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.770+0000 7f649a989640 1 -- 172.21.15.96:0/3328886057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6494149000 con 0x7f64941ed520 2024-04-18T04:55:06.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.774+0000 7f6490ff9640 1 -- 172.21.15.96:0/3328886057 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f648c01e3b0 con 0x7f64941ed520 2024-04-18T04:55:06.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.774+0000 7f6490ff9640 1 --2- 172.21.15.96:0/3328886057 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6480066690 0x7f6480068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:06.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.774+0000 7f6490ff9640 1 -- 172.21.15.96:0/3328886057 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f648c086b80 con 0x7f64941ed520 2024-04-18T04:55:06.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.774+0000 7f6493fff640 1 --2- 172.21.15.96:0/3328886057 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6480066690 0x7f6480068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:06.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.774+0000 7f6493fff640 1 --2- 172.21.15.96:0/3328886057 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6480066690 0x7f6480068b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f64880af000 tx=0x7f64880046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:06.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.778+0000 7f6490ff9640 1 -- 172.21.15.96:0/3328886057 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6494149000 con 0x7f64941ed520 2024-04-18T04:55:06.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.970+0000 7f649a989640 1 -- 172.21.15.96:0/3328886057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6494149000 con 0x7f64941ed520 2024-04-18T04:55:06.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.970+0000 7f6490ff9640 1 -- 172.21.15.96:0/3328886057 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6494149000 con 0x7f64941ed520 2024-04-18T04:55:06.974 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:55:06.974 INFO:teuthology.orchestra.run.smithi096.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-18T04:55:06.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.974+0000 7f649a989640 1 -- 172.21.15.96:0/3328886057 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6480066690 msgr2=0x7f6480068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:06.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.974+0000 7f649a989640 1 --2- 172.21.15.96:0/3328886057 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6480066690 0x7f6480068b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f64880af000 tx=0x7f64880046d0 comp rx=0 tx=0).stop 2024-04-18T04:55:06.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.974+0000 7f649a989640 1 -- 172.21.15.96:0/3328886057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64941ed520 msgr2=0x7f6494146720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:06.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.974+0000 7f649a989640 1 --2- 172.21.15.96:0/3328886057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64941ed520 0x7f6494146720 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f648c004c00 tx=0x7f648c010c10 comp rx=0 tx=0).stop 2024-04-18T04:55:06.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.974+0000 7f649a989640 1 -- 172.21.15.96:0/3328886057 shutdown_connections 2024-04-18T04:55:06.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.974+0000 7f649a989640 1 --2- 172.21.15.96:0/3328886057 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6480066690 0x7f6480068b50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:06.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.974+0000 7f649a989640 1 --2- 172.21.15.96:0/3328886057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64941ed520 0x7f6494146720 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:06.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.974+0000 7f649a989640 1 --2- 172.21.15.96:0/3328886057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f649414d4c0 0x7f64941ef880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:06.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.974+0000 7f649a989640 1 --2- 172.21.15.96:0/3328886057 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f647c003980 0x7f64941492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:06.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.974+0000 7f649a989640 1 -- 172.21.15.96:0/3328886057 >> 172.21.15.96:0/3328886057 conn(0x7f649406c750 msgr2=0x7f64940c9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:06.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.974+0000 7f649a989640 1 -- 172.21.15.96:0/3328886057 shutdown_connections 2024-04-18T04:55:06.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:06.974+0000 7f649a989640 1 -- 172.21.15.96:0/3328886057 wait complete. 2024-04-18T04:55:06.993 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-18T04:55:06.994 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:55:07.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.106+0000 7f57c8ecc640 1 Processor -- start 2024-04-18T04:55:07.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.106+0000 7f57c8ecc640 1 -- start start 2024-04-18T04:55:07.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.106+0000 7f57c8ecc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f57c4153180 0x7f57c4159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.106+0000 7f57c8ecc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f57c40700e0 0x7f57c40707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.106+0000 7f57c8ecc640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c4159700 con 0x7f57c415c580 2024-04-18T04:55:07.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.106+0000 7f57c8ecc640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c40c6390 con 0x7f57c4153180 2024-04-18T04:55:07.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.106+0000 7f57c8ecc640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c415cf80 con 0x7f57c40700e0 2024-04-18T04:55:07.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.106+0000 7f57c259c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f57c4153180 0x7f57c4159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:07.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.106+0000 7f57c259c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f57c4153180 0x7f57c4159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56274/0 (socket says 172.21.15.96:56274) 2024-04-18T04:55:07.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.106+0000 7f57c259c640 1 -- 172.21.15.96:0/3658713529 learned_addr learned my addr 172.21.15.96:0/3658713529 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:07.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.106+0000 7f57b9d9b640 1 --2- 172.21.15.96:0/3658713529 >> v2:172.21.15.139:3300/0 conn(0x7f57c40700e0 0x7f57c40707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:07.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.106+0000 7f57c259c640 1 -- 172.21.15.96:0/3658713529 >> v2:172.21.15.139:3300/0 conn(0x7f57c40700e0 msgr2=0x7f57c40707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:07.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.106+0000 7f57c259c640 1 --2- 172.21.15.96:0/3658713529 >> v2:172.21.15.139:3300/0 conn(0x7f57c40700e0 0x7f57c40707c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.106+0000 7f57c259c640 1 -- 172.21.15.96:0/3658713529 >> v1:172.21.15.139:6789/0 conn(0x7f57c415c580 legacy=0x7f57c40ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:07.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.106+0000 7f57c259c640 1 -- 172.21.15.96:0/3658713529 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c415d220 con 0x7f57c4153180 2024-04-18T04:55:07.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c259c640 1 --2- 172.21.15.96:0/3658713529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c4153180 0x7f57c4159b90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f57c4070750 tx=0x7f57b401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf61abc6ed3e800 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:07.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c1d9b640 1 -- 172.21.15.96:0/3658713529 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b40a89d0 con 0x7f57c4153180 2024-04-18T04:55:07.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c1d9b640 1 -- 172.21.15.96:0/3658713529 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b40a8b30 con 0x7f57c4153180 2024-04-18T04:55:07.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c1d9b640 1 -- 172.21.15.96:0/3658713529 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b40b0440 con 0x7f57c4153180 2024-04-18T04:55:07.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c8ecc640 1 -- 172.21.15.96:0/3658713529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c4153180 msgr2=0x7f57c4159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c8ecc640 1 --2- 172.21.15.96:0/3658713529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c4153180 0x7f57c4159b90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f57c4070750 tx=0x7f57b401ecd0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c8ecc640 1 -- 172.21.15.96:0/3658713529 shutdown_connections 2024-04-18T04:55:07.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c8ecc640 1 --2- 172.21.15.96:0/3658713529 >> v2:172.21.15.139:3300/0 conn(0x7f57c40700e0 0x7f57c40707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c8ecc640 1 --2- 172.21.15.96:0/3658713529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c4153180 0x7f57c4159b90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c8ecc640 1 -- 172.21.15.96:0/3658713529 >> 172.21.15.96:0/3658713529 conn(0x7f57c406c750 msgr2=0x7f57c40c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:07.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c8ecc640 1 -- 172.21.15.96:0/3658713529 shutdown_connections 2024-04-18T04:55:07.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c8ecc640 1 -- 172.21.15.96:0/3658713529 wait complete. 2024-04-18T04:55:07.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c8ecc640 1 Processor -- start 2024-04-18T04:55:07.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c8ecc640 1 -- start start 2024-04-18T04:55:07.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c8ecc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c40700e0 0x7f57c41f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c8ecc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f57c4153180 0x7f57c41e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c8ecc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57c415c580 0x7f57c41e5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c8ecc640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c41f2240 con 0x7f57c40700e0 2024-04-18T04:55:07.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c8ecc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c41f1ef0 con 0x7f57c415c580 2024-04-18T04:55:07.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c8ecc640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c414f530 con 0x7f57c4153180 2024-04-18T04:55:07.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.110+0000 7f57c259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c40700e0 0x7f57c41f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:07.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57c259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c40700e0 0x7f57c41f2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56276/0 (socket says 172.21.15.96:56276) 2024-04-18T04:55:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57c259c640 1 -- 172.21.15.96:0/1262105135 learned_addr learned my addr 172.21.15.96:0/1262105135 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57c2d9d640 1 --2- 172.21.15.96:0/1262105135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57c415c580 0x7f57c41e5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57b9d9b640 1 --2- 172.21.15.96:0/1262105135 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f57c4153180 0x7f57c41e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57c259c640 1 -- 172.21.15.96:0/1262105135 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f57c4153180 msgr2=0x7f57c41e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57c259c640 1 --2- 172.21.15.96:0/1262105135 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f57c4153180 0x7f57c41e5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57c259c640 1 -- 172.21.15.96:0/1262105135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57c415c580 msgr2=0x7f57c41e5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57c259c640 1 --2- 172.21.15.96:0/1262105135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57c415c580 0x7f57c41e5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57c259c640 1 -- 172.21.15.96:0/1262105135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b40094d0 con 0x7f57c40700e0 2024-04-18T04:55:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57c2d9d640 1 --2- 172.21.15.96:0/1262105135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57c415c580 0x7f57c41e5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57c259c640 1 --2- 172.21.15.96:0/1262105135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c40700e0 0x7f57c41f2660 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f57b40b3040 tx=0x7f57b401ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57bb7fe640 1 -- 172.21.15.96:0/1262105135 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b40b0e80 con 0x7f57c40700e0 2024-04-18T04:55:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57bb7fe640 1 -- 172.21.15.96:0/1262105135 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b40bb480 con 0x7f57c40700e0 2024-04-18T04:55:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57c8ecc640 1 -- 172.21.15.96:0/1262105135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c40c2be0 con 0x7f57c40700e0 2024-04-18T04:55:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57bb7fe640 1 -- 172.21.15.96:0/1262105135 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b40bb810 con 0x7f57c40700e0 2024-04-18T04:55:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57c8ecc640 1 -- 172.21.15.96:0/1262105135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c40c31a0 con 0x7f57c40700e0 2024-04-18T04:55:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57c8ecc640 1 -- 172.21.15.96:0/1262105135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c4067050 con 0x7f57c40700e0 2024-04-18T04:55:07.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57bb7fe640 1 -- 172.21.15.96:0/1262105135 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f57b40bb970 con 0x7f57c40700e0 2024-04-18T04:55:07.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57bb7fe640 1 --2- 172.21.15.96:0/1262105135 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f57a40666c0 0x7f57a4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57bb7fe640 1 -- 172.21.15.96:0/1262105135 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57b4122830 con 0x7f57c40700e0 2024-04-18T04:55:07.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57b9d9b640 1 --2- 172.21.15.96:0/1262105135 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f57a40666c0 0x7f57a4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:07.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.114+0000 7f57b9d9b640 1 --2- 172.21.15.96:0/1262105135 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f57a40666c0 0x7f57a4068b80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f57c4152570 tx=0x7f57ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:07.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.118+0000 7f57bb7fe640 1 -- 172.21.15.96:0/1262105135 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f57b40efb10 con 0x7f57c40700e0 2024-04-18T04:55:07.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.274+0000 7f57c8ecc640 1 -- 172.21.15.96:0/1262105135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57c4067050 con 0x7f57c40700e0 2024-04-18T04:55:07.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.278+0000 7f57bb7fe640 1 -- 172.21.15.96:0/1262105135 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f57b40b5070 con 0x7f57c40700e0 2024-04-18T04:55:07.280 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:55:07.280 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":21,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:54:42.161552+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:54:39.219441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:54:40.139557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.720340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.767224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.811511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.710188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.860525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.704784+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:55:07.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.278+0000 7f57c8ecc640 1 -- 172.21.15.96:0/1262105135 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f57a40666c0 msgr2=0x7f57a4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.278+0000 7f57c8ecc640 1 --2- 172.21.15.96:0/1262105135 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f57a40666c0 0x7f57a4068b80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f57c4152570 tx=0x7f57ac008040 comp rx=0 tx=0).stop 2024-04-18T04:55:07.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.278+0000 7f57c8ecc640 1 -- 172.21.15.96:0/1262105135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c40700e0 msgr2=0x7f57c41f2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.278+0000 7f57c8ecc640 1 --2- 172.21.15.96:0/1262105135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c40700e0 0x7f57c41f2660 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f57b40b3040 tx=0x7f57b401ba70 comp rx=0 tx=0).stop 2024-04-18T04:55:07.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.278+0000 7f57c8ecc640 1 -- 172.21.15.96:0/1262105135 shutdown_connections 2024-04-18T04:55:07.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.278+0000 7f57c8ecc640 1 --2- 172.21.15.96:0/1262105135 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f57a40666c0 0x7f57a4068b80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.278+0000 7f57c8ecc640 1 --2- 172.21.15.96:0/1262105135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57c415c580 0x7f57c41e5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.278+0000 7f57c8ecc640 1 --2- 172.21.15.96:0/1262105135 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f57c4153180 0x7f57c41e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.278+0000 7f57c8ecc640 1 --2- 172.21.15.96:0/1262105135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c40700e0 0x7f57c41f2660 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.278+0000 7f57c8ecc640 1 -- 172.21.15.96:0/1262105135 >> 172.21.15.96:0/1262105135 conn(0x7f57c406c750 msgr2=0x7f57c4150b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:07.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.278+0000 7f57c8ecc640 1 -- 172.21.15.96:0/1262105135 shutdown_connections 2024-04-18T04:55:07.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.278+0000 7f57c8ecc640 1 -- 172.21.15.96:0/1262105135 wait complete. 2024-04-18T04:55:07.298 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:54:32.641813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T04:54:39.219441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T04:54:40.139557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T04:55:07.298 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T04:55:07.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.418+0000 7f5348126640 1 Processor -- start 2024-04-18T04:55:07.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.418+0000 7f5348126640 1 -- start start 2024-04-18T04:55:07.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.418+0000 7f5348126640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5340155d00 0x7f5340156170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.418+0000 7f5348126640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f53400c3650 0x7f53400c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.418+0000 7f5348126640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53400c8100 con 0x7f534014fc60 2024-04-18T04:55:07.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.418+0000 7f5348126640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53401566b0 con 0x7f5340155d00 2024-04-18T04:55:07.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.418+0000 7f5348126640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53400c5660 con 0x7f53400c3650 2024-04-18T04:55:07.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.418+0000 7f53456c1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5340155d00 0x7f5340156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:07.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.418+0000 7f53456c1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5340155d00 0x7f5340156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56292/0 (socket says 172.21.15.96:56292) 2024-04-18T04:55:07.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.418+0000 7f5345ec2640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f534014fc60 0x7f534006d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48340/0 (socket says 172.21.15.96:48340) 2024-04-18T04:55:07.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.418+0000 7f53456c1640 1 -- 172.21.15.96:0/1248502816 learned_addr learned my addr 172.21.15.96:0/1248502816 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:07.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.418+0000 7f53456c1640 1 -- 172.21.15.96:0/1248502816 >> v2:172.21.15.139:3300/0 conn(0x7f53400c3650 msgr2=0x7f53400c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:07.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.418+0000 7f53456c1640 1 --2- 172.21.15.96:0/1248502816 >> v2:172.21.15.139:3300/0 conn(0x7f53400c3650 0x7f53400c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.418+0000 7f53456c1640 1 -- 172.21.15.96:0/1248502816 >> v1:172.21.15.96:6789/0 conn(0x7f534014fc60 legacy=0x7f534006d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.418+0000 7f53456c1640 1 -- 172.21.15.96:0/1248502816 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53400c8350 con 0x7f5340155d00 2024-04-18T04:55:07.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f53456c1640 1 --2- 172.21.15.96:0/1248502816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5340155d00 0x7f5340156170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f53400c91e0 tx=0x7f533001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921fc6247f96557b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:07.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5344ec0640 1 -- 172.21.15.96:0/1248502816 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53300ab660 con 0x7f5340155d00 2024-04-18T04:55:07.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5344ec0640 1 -- 172.21.15.96:0/1248502816 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53300ab7c0 con 0x7f5340155d00 2024-04-18T04:55:07.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5344ec0640 1 -- 172.21.15.96:0/1248502816 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53300abb50 con 0x7f5340155d00 2024-04-18T04:55:07.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5348126640 1 -- 172.21.15.96:0/1248502816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5340155d00 msgr2=0x7f5340156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5348126640 1 --2- 172.21.15.96:0/1248502816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5340155d00 0x7f5340156170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f53400c91e0 tx=0x7f533001c460 comp rx=0 tx=0).stop 2024-04-18T04:55:07.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5348126640 1 -- 172.21.15.96:0/1248502816 shutdown_connections 2024-04-18T04:55:07.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5348126640 1 --2- 172.21.15.96:0/1248502816 >> v2:172.21.15.139:3300/0 conn(0x7f53400c3650 0x7f53400c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5348126640 1 --2- 172.21.15.96:0/1248502816 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5340155d00 0x7f5340156170 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5348126640 1 -- 172.21.15.96:0/1248502816 >> 172.21.15.96:0/1248502816 conn(0x7f534006c610 msgr2=0x7f53400ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:07.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5348126640 1 -- 172.21.15.96:0/1248502816 shutdown_connections 2024-04-18T04:55:07.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5348126640 1 -- 172.21.15.96:0/1248502816 wait complete. 2024-04-18T04:55:07.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5348126640 1 Processor -- start 2024-04-18T04:55:07.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5348126640 1 -- start start 2024-04-18T04:55:07.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5348126640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53400c3650 0x7f5340141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5348126640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f534014fc60 0x7f53401f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5348126640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5340155d00 0x7f5340140670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5348126640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53401428a0 con 0x7f5340155d00 2024-04-18T04:55:07.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5348126640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5340140bb0 con 0x7f53400c3650 2024-04-18T04:55:07.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f5348126640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5340140e70 con 0x7f534014fc60 2024-04-18T04:55:07.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f53466c3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5340155d00 0x7f5340140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:07.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f53466c3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5340155d00 0x7f5340140670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56306/0 (socket says 172.21.15.96:56306) 2024-04-18T04:55:07.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.422+0000 7f53466c3640 1 -- 172.21.15.96:0/2600616565 learned_addr learned my addr 172.21.15.96:0/2600616565 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:07.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f53466c3640 1 -- 172.21.15.96:0/2600616565 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f534014fc60 msgr2=0x7f53401f2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f5345ec2640 1 --2- 172.21.15.96:0/2600616565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53400c3650 0x7f5340141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:07.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f53466c3640 1 --2- 172.21.15.96:0/2600616565 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f534014fc60 0x7f53401f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f53466c3640 1 -- 172.21.15.96:0/2600616565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53400c3650 msgr2=0x7f5340141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f53466c3640 1 --2- 172.21.15.96:0/2600616565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53400c3650 0x7f5340141300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f53466c3640 1 -- 172.21.15.96:0/2600616565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53300094d0 con 0x7f5340155d00 2024-04-18T04:55:07.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f53466c3640 1 --2- 172.21.15.96:0/2600616565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5340155d00 0x7f5340140670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f533800b970 tx=0x7f533800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:07.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f53367fc640 1 -- 172.21.15.96:0/2600616565 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533800cb40 con 0x7f5340155d00 2024-04-18T04:55:07.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f53367fc640 1 -- 172.21.15.96:0/2600616565 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533800ccc0 con 0x7f5340155d00 2024-04-18T04:55:07.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f5348126640 1 -- 172.21.15.96:0/2600616565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5340141aa0 con 0x7f5340155d00 2024-04-18T04:55:07.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f53367fc640 1 -- 172.21.15.96:0/2600616565 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338014680 con 0x7f5340155d00 2024-04-18T04:55:07.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f5348126640 1 -- 172.21.15.96:0/2600616565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53400c7490 con 0x7f5340155d00 2024-04-18T04:55:07.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f5348126640 1 -- 172.21.15.96:0/2600616565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5340142420 con 0x7f5340155d00 2024-04-18T04:55:07.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f53367fc640 1 -- 172.21.15.96:0/2600616565 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f533801d3b0 con 0x7f5340155d00 2024-04-18T04:55:07.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f53367fc640 1 --2- 172.21.15.96:0/2600616565 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5324066690 0x7f5324068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f53367fc640 1 -- 172.21.15.96:0/2600616565 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5338084180 con 0x7f5340155d00 2024-04-18T04:55:07.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f5345ec2640 1 --2- 172.21.15.96:0/2600616565 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5324066690 0x7f5324068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:07.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.426+0000 7f5345ec2640 1 --2- 172.21.15.96:0/2600616565 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5324066690 0x7f5324068b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f533c000f70 tx=0x7f533c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:07.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.430+0000 7f53367fc640 1 -- 172.21.15.96:0/2600616565 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f5340142420 con 0x7f5340155d00 2024-04-18T04:55:07.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.586+0000 7f5348126640 1 -- 172.21.15.96:0/2600616565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5340142420 con 0x7f5340155d00 2024-04-18T04:55:07.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.586+0000 7f53367fc640 1 -- 172.21.15.96:0/2600616565 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5340142420 con 0x7f5340155d00 2024-04-18T04:55:07.591 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-18T04:55:07.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.590+0000 7f5348126640 1 -- 172.21.15.96:0/2600616565 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5324066690 msgr2=0x7f5324068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.590+0000 7f5348126640 1 --2- 172.21.15.96:0/2600616565 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5324066690 0x7f5324068b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f533c000f70 tx=0x7f533c009040 comp rx=0 tx=0).stop 2024-04-18T04:55:07.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.590+0000 7f5348126640 1 -- 172.21.15.96:0/2600616565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5340155d00 msgr2=0x7f5340140670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.590+0000 7f5348126640 1 --2- 172.21.15.96:0/2600616565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5340155d00 0x7f5340140670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f533800b970 tx=0x7f533800be30 comp rx=0 tx=0).stop 2024-04-18T04:55:07.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.590+0000 7f5348126640 1 -- 172.21.15.96:0/2600616565 shutdown_connections 2024-04-18T04:55:07.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.590+0000 7f5348126640 1 --2- 172.21.15.96:0/2600616565 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5324066690 0x7f5324068b50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.590+0000 7f5348126640 1 --2- 172.21.15.96:0/2600616565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5340155d00 0x7f5340140670 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.590+0000 7f5348126640 1 --2- 172.21.15.96:0/2600616565 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f534014fc60 0x7f53401f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.590+0000 7f5348126640 1 --2- 172.21.15.96:0/2600616565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53400c3650 0x7f5340141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.590+0000 7f5348126640 1 -- 172.21.15.96:0/2600616565 >> 172.21.15.96:0/2600616565 conn(0x7f534006c610 msgr2=0x7f5340146030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:07.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.590+0000 7f5348126640 1 -- 172.21.15.96:0/2600616565 shutdown_connections 2024-04-18T04:55:07.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.590+0000 7f5348126640 1 -- 172.21.15.96:0/2600616565 wait complete. 2024-04-18T04:55:07.610 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T04:55:07.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea31fab640 1 Processor -- start 2024-04-18T04:55:07.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea31fab640 1 -- start start 2024-04-18T04:55:07.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea31fab640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fea2c151100 0x7fea2c06a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea31fab640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fea2c071c00 0x7fea2c0c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea31fab640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2c0c9340 con 0x7fea2c0c50d0 2024-04-18T04:55:07.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea31fab640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea2c0c54e0 con 0x7fea2c151100 2024-04-18T04:55:07.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea31fab640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea2c1514e0 con 0x7fea2c071c00 2024-04-18T04:55:07.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea2b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fea2c151100 0x7fea2c06a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:07.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea2bfff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fea2c0c50d0 0x7fea2c157320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48348/0 (socket says 172.21.15.96:48348) 2024-04-18T04:55:07.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea2b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fea2c151100 0x7fea2c06a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56308/0 (socket says 172.21.15.96:56308) 2024-04-18T04:55:07.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea2bfff640 1 -- 172.21.15.96:0/2778688769 learned_addr learned my addr 172.21.15.96:0/2778688769 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:07.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea2affd640 1 --2- 172.21.15.96:0/2778688769 >> v2:172.21.15.139:3300/0 conn(0x7fea2c071c00 0x7fea2c0c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:07.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea2b7fe640 1 -- 172.21.15.96:0/2778688769 >> v2:172.21.15.139:3300/0 conn(0x7fea2c071c00 msgr2=0x7fea2c0c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:07.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea2b7fe640 1 --2- 172.21.15.96:0/2778688769 >> v2:172.21.15.139:3300/0 conn(0x7fea2c071c00 0x7fea2c0c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea2b7fe640 1 -- 172.21.15.96:0/2778688769 >> v1:172.21.15.96:6789/0 conn(0x7fea2c0c50d0 legacy=0x7fea2c157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea2b7fe640 1 -- 172.21.15.96:0/2778688769 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2c0c9620 con 0x7fea2c151100 2024-04-18T04:55:07.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea2a7fc640 1 -- 172.21.15.96:0/2778688769 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406919067 0 0) 0x7fea2c0c9340 con 0x7fea2c0c50d0 2024-04-18T04:55:07.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.734+0000 7fea2affd640 1 --2- 172.21.15.96:0/2778688769 >> v2:172.21.15.139:3300/0 conn(0x7fea2c071c00 0x7fea2c0c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:07.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea2b7fe640 1 --2- 172.21.15.96:0/2778688769 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea2c151100 0x7fea2c06a5f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0725d0 tx=0x7fea2401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec982f064444f9f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:07.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea2a7fc640 1 -- 172.21.15.96:0/2778688769 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea240af600 con 0x7fea2c151100 2024-04-18T04:55:07.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea2a7fc640 1 -- 172.21.15.96:0/2778688769 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea240ab050 con 0x7fea2c151100 2024-04-18T04:55:07.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea2a7fc640 1 -- 172.21.15.96:0/2778688769 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea240af980 con 0x7fea2c151100 2024-04-18T04:55:07.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea31fab640 1 -- 172.21.15.96:0/2778688769 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea2c151100 msgr2=0x7fea2c06a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea31fab640 1 --2- 172.21.15.96:0/2778688769 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea2c151100 0x7fea2c06a5f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0725d0 tx=0x7fea2401f110 comp rx=0 tx=0).stop 2024-04-18T04:55:07.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea31fab640 1 -- 172.21.15.96:0/2778688769 shutdown_connections 2024-04-18T04:55:07.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea31fab640 1 --2- 172.21.15.96:0/2778688769 >> v2:172.21.15.139:3300/0 conn(0x7fea2c071c00 0x7fea2c0c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea31fab640 1 --2- 172.21.15.96:0/2778688769 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea2c151100 0x7fea2c06a5f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea31fab640 1 -- 172.21.15.96:0/2778688769 >> 172.21.15.96:0/2778688769 conn(0x7fea2c0662d0 msgr2=0x7fea2c06ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:07.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea31fab640 1 -- 172.21.15.96:0/2778688769 shutdown_connections 2024-04-18T04:55:07.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea31fab640 1 -- 172.21.15.96:0/2778688769 wait complete. 2024-04-18T04:55:07.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea31fab640 1 Processor -- start 2024-04-18T04:55:07.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea31fab640 1 -- start start 2024-04-18T04:55:07.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea31fab640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fea2c071c00 0x7fea2c151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea31fab640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea2c0c50d0 0x7fea2c1f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea31fab640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea2c151100 0x7fea2c1effb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea31fab640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c1efb20 con 0x7fea2c0c50d0 2024-04-18T04:55:07.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea31fab640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c15ae00 con 0x7fea2c151100 2024-04-18T04:55:07.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea31fab640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c15b0a0 con 0x7fea2c071c00 2024-04-18T04:55:07.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea2affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea2c0c50d0 0x7fea2c1f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:07.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea2affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea2c0c50d0 0x7fea2c1f1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56310/0 (socket says 172.21.15.96:56310) 2024-04-18T04:55:07.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.738+0000 7fea2affd640 1 -- 172.21.15.96:0/672482980 learned_addr learned my addr 172.21.15.96:0/672482980 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:07.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea2b7fe640 1 --2- 172.21.15.96:0/672482980 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fea2c071c00 0x7fea2c151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:07.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea2bfff640 1 --2- 172.21.15.96:0/672482980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea2c151100 0x7fea2c1effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:07.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea2affd640 1 -- 172.21.15.96:0/672482980 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fea2c071c00 msgr2=0x7fea2c151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea2affd640 1 --2- 172.21.15.96:0/672482980 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fea2c071c00 0x7fea2c151640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea2affd640 1 -- 172.21.15.96:0/672482980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea2c151100 msgr2=0x7fea2c1effb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea2affd640 1 --2- 172.21.15.96:0/672482980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea2c151100 0x7fea2c1effb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea2affd640 1 -- 172.21.15.96:0/672482980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea24009a70 con 0x7fea2c0c50d0 2024-04-18T04:55:07.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea2affd640 1 --2- 172.21.15.96:0/672482980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea2c0c50d0 0x7fea2c1f1a70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fea2000c7c0 tx=0x7fea2000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:07.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea13fff640 1 -- 172.21.15.96:0/672482980 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20007a30 con 0x7fea2c0c50d0 2024-04-18T04:55:07.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea13fff640 1 -- 172.21.15.96:0/672482980 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea20007b90 con 0x7fea2c0c50d0 2024-04-18T04:55:07.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea31fab640 1 -- 172.21.15.96:0/672482980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea2c1f23b0 con 0x7fea2c0c50d0 2024-04-18T04:55:07.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea13fff640 1 -- 172.21.15.96:0/672482980 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2000ce70 con 0x7fea2c0c50d0 2024-04-18T04:55:07.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea31fab640 1 -- 172.21.15.96:0/672482980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2c1ef7b0 con 0x7fea2c0c50d0 2024-04-18T04:55:07.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea31fab640 1 -- 172.21.15.96:0/672482980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea2c067050 con 0x7fea2c0c50d0 2024-04-18T04:55:07.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea13fff640 1 -- 172.21.15.96:0/672482980 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fea200113f0 con 0x7fea2c0c50d0 2024-04-18T04:55:07.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea13fff640 1 --2- 172.21.15.96:0/672482980 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fea18066690 0x7fea18068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:07.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea13fff640 1 -- 172.21.15.96:0/672482980 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea200845a0 con 0x7fea2c0c50d0 2024-04-18T04:55:07.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea2b7fe640 1 --2- 172.21.15.96:0/672482980 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fea18066690 0x7fea18068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:07.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.742+0000 7fea2b7fe640 1 --2- 172.21.15.96:0/672482980 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fea18066690 0x7fea18068b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea240b1000 tx=0x7fea240aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:07.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.746+0000 7fea13fff640 1 -- 172.21.15.96:0/672482980 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fea200519a0 con 0x7fea2c0c50d0 2024-04-18T04:55:07.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.906+0000 7fea31fab640 1 -- 172.21.15.96:0/672482980 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fea2c0cb670 con 0x7fea2c0c50d0 2024-04-18T04:55:07.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.906+0000 7fea13fff640 1 -- 172.21.15.96:0/672482980 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fea20054fc0 con 0x7fea2c0c50d0 2024-04-18T04:55:07.908 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-18T04:55:07.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.906+0000 7fea31fab640 1 -- 172.21.15.96:0/672482980 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fea18066690 msgr2=0x7fea18068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.906+0000 7fea31fab640 1 --2- 172.21.15.96:0/672482980 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fea18066690 0x7fea18068b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea240b1000 tx=0x7fea240aa000 comp rx=0 tx=0).stop 2024-04-18T04:55:07.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.906+0000 7fea31fab640 1 -- 172.21.15.96:0/672482980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea2c0c50d0 msgr2=0x7fea2c1f1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:07.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.906+0000 7fea31fab640 1 --2- 172.21.15.96:0/672482980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea2c0c50d0 0x7fea2c1f1a70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fea2000c7c0 tx=0x7fea2000cc80 comp rx=0 tx=0).stop 2024-04-18T04:55:07.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.906+0000 7fea31fab640 1 -- 172.21.15.96:0/672482980 shutdown_connections 2024-04-18T04:55:07.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.906+0000 7fea31fab640 1 --2- 172.21.15.96:0/672482980 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fea18066690 0x7fea18068b50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.906+0000 7fea31fab640 1 --2- 172.21.15.96:0/672482980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea2c151100 0x7fea2c1effb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.906+0000 7fea31fab640 1 --2- 172.21.15.96:0/672482980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea2c0c50d0 0x7fea2c1f1a70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.906+0000 7fea31fab640 1 --2- 172.21.15.96:0/672482980 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fea2c071c00 0x7fea2c151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:07.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.906+0000 7fea31fab640 1 -- 172.21.15.96:0/672482980 >> 172.21.15.96:0/672482980 conn(0x7fea2c0662d0 msgr2=0x7fea2c157220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:07.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.906+0000 7fea31fab640 1 -- 172.21.15.96:0/672482980 shutdown_connections 2024-04-18T04:55:07.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:07.906+0000 7fea31fab640 1 -- 172.21.15.96:0/672482980 wait complete. 2024-04-18T04:55:07.927 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T04:55:08.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.046+0000 7f190e440640 1 Processor -- start 2024-04-18T04:55:08.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.046+0000 7f190e440640 1 -- start start 2024-04-18T04:55:08.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.046+0000 7f190e440640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f19080cacc0 0x7f1908158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.046+0000 7f190e440640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f19080c3fd0 0x7f19080ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.046+0000 7f190e440640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19081536b0 con 0x7f19081532d0 2024-04-18T04:55:08.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.046+0000 7f190e440640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19080c5970 con 0x7f19080cacc0 2024-04-18T04:55:08.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.046+0000 7f190e440640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19081594a0 con 0x7f19080c3fd0 2024-04-18T04:55:08.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.046+0000 7f19077fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f19080cacc0 0x7f1908158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.046+0000 7f19077fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f19080cacc0 0x7f1908158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56320/0 (socket says 172.21.15.96:56320) 2024-04-18T04:55:08.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.046+0000 7f19077fe640 1 -- 172.21.15.96:0/3421351476 learned_addr learned my addr 172.21.15.96:0/3421351476 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:08.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.046+0000 7f190c9dd640 1 --2- 172.21.15.96:0/3421351476 >> v2:172.21.15.139:3300/0 conn(0x7f19080c3fd0 0x7f19080ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.046+0000 7f19077fe640 1 -- 172.21.15.96:0/3421351476 >> v2:172.21.15.139:3300/0 conn(0x7f19080c3fd0 msgr2=0x7f19080ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:08.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.046+0000 7f19077fe640 1 --2- 172.21.15.96:0/3421351476 >> v2:172.21.15.139:3300/0 conn(0x7f19080c3fd0 0x7f19080ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.046+0000 7f19077fe640 1 -- 172.21.15.96:0/3421351476 >> v1:172.21.15.139:6789/0 conn(0x7f19081532d0 legacy=0x7f190815ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:08.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.046+0000 7f19077fe640 1 -- 172.21.15.96:0/3421351476 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1908159680 con 0x7f19080cacc0 2024-04-18T04:55:08.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.046+0000 7f190c9dd640 1 --2- 172.21.15.96:0/3421351476 >> v2:172.21.15.139:3300/0 conn(0x7f19080c3fd0 0x7f19080ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:08.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f19077fe640 1 --2- 172.21.15.96:0/3421351476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080cacc0 0x7f1908158f60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f190808c800 tx=0x7f18fc01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d81051b6d01bbe server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:08.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f1906ffd640 1 -- 172.21.15.96:0/3421351476 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0a89d0 con 0x7f19080cacc0 2024-04-18T04:55:08.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f1906ffd640 1 -- 172.21.15.96:0/3421351476 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18fc0a8b30 con 0x7f19080cacc0 2024-04-18T04:55:08.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f1906ffd640 1 -- 172.21.15.96:0/3421351476 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0b0440 con 0x7f19080cacc0 2024-04-18T04:55:08.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190e440640 1 -- 172.21.15.96:0/3421351476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080cacc0 msgr2=0x7f1908158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190e440640 1 --2- 172.21.15.96:0/3421351476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080cacc0 0x7f1908158f60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f190808c800 tx=0x7f18fc01ecd0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190e440640 1 -- 172.21.15.96:0/3421351476 shutdown_connections 2024-04-18T04:55:08.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190e440640 1 --2- 172.21.15.96:0/3421351476 >> v2:172.21.15.139:3300/0 conn(0x7f19080c3fd0 0x7f19080ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190e440640 1 --2- 172.21.15.96:0/3421351476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080cacc0 0x7f1908158f60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190e440640 1 -- 172.21.15.96:0/3421351476 >> 172.21.15.96:0/3421351476 conn(0x7f1908071760 msgr2=0x7f190806b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:08.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190e440640 1 -- 172.21.15.96:0/3421351476 shutdown_connections 2024-04-18T04:55:08.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190e440640 1 -- 172.21.15.96:0/3421351476 wait complete. 2024-04-18T04:55:08.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190e440640 1 Processor -- start 2024-04-18T04:55:08.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190e440640 1 -- start start 2024-04-18T04:55:08.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190e440640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f19080c3fd0 0x7f19080cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190e440640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080cacc0 0x7f19081ee690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190e440640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19081532d0 0x7f19081eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190e440640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1908159f20 con 0x7f19080cacc0 2024-04-18T04:55:08.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190e440640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19081f2790 con 0x7f19081532d0 2024-04-18T04:55:08.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190e440640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19081f1b80 con 0x7f19080c3fd0 2024-04-18T04:55:08.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f19077fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080cacc0 0x7f19081ee690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f19077fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080cacc0 0x7f19081ee690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56326/0 (socket says 172.21.15.96:56326) 2024-04-18T04:55:08.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f19077fe640 1 -- 172.21.15.96:0/211777384 learned_addr learned my addr 172.21.15.96:0/211777384 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:08.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190c9dd640 1 --2- 172.21.15.96:0/211777384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19081532d0 0x7f19081eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f19077fe640 1 -- 172.21.15.96:0/211777384 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f19080c3fd0 msgr2=0x7f19080cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f1907fff640 1 --2- 172.21.15.96:0/211777384 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f19080c3fd0 0x7f19080cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f19077fe640 1 --2- 172.21.15.96:0/211777384 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f19080c3fd0 0x7f19080cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f19077fe640 1 -- 172.21.15.96:0/211777384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19081532d0 msgr2=0x7f19081eebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f19077fe640 1 --2- 172.21.15.96:0/211777384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19081532d0 0x7f19081eebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f19077fe640 1 -- 172.21.15.96:0/211777384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc0094d0 con 0x7f19080cacc0 2024-04-18T04:55:08.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.050+0000 7f190c9dd640 1 --2- 172.21.15.96:0/211777384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19081532d0 0x7f19081eebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:08.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.054+0000 7f19077fe640 1 --2- 172.21.15.96:0/211777384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080cacc0 0x7f19081ee690 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0b3040 tx=0x7f18fc01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:08.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.054+0000 7f1904ff9640 1 -- 172.21.15.96:0/211777384 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0b0e80 con 0x7f19080cacc0 2024-04-18T04:55:08.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.054+0000 7f1904ff9640 1 -- 172.21.15.96:0/211777384 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18fc0bb480 con 0x7f19080cacc0 2024-04-18T04:55:08.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.054+0000 7f190e440640 1 -- 172.21.15.96:0/211777384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19081f1e60 con 0x7f19080cacc0 2024-04-18T04:55:08.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.054+0000 7f1904ff9640 1 -- 172.21.15.96:0/211777384 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0bb830 con 0x7f19080cacc0 2024-04-18T04:55:08.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.054+0000 7f190e440640 1 -- 172.21.15.96:0/211777384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19081f2420 con 0x7f19080cacc0 2024-04-18T04:55:08.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.054+0000 7f190e440640 1 -- 172.21.15.96:0/211777384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1908067050 con 0x7f19080cacc0 2024-04-18T04:55:08.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.054+0000 7f1904ff9640 1 -- 172.21.15.96:0/211777384 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f18fc0bb990 con 0x7f19080cacc0 2024-04-18T04:55:08.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.054+0000 7f1904ff9640 1 --2- 172.21.15.96:0/211777384 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f18f40666c0 0x7f18f4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.054+0000 7f1904ff9640 1 -- 172.21.15.96:0/211777384 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18fc122910 con 0x7f19080cacc0 2024-04-18T04:55:08.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.054+0000 7f1907fff640 1 --2- 172.21.15.96:0/211777384 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f18f40666c0 0x7f18f4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.054+0000 7f1907fff640 1 --2- 172.21.15.96:0/211777384 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f18f40666c0 0x7f18f4068b80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f18f800a790 tx=0x7f18f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:08.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.058+0000 7f1904ff9640 1 -- 172.21.15.96:0/211777384 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f18fc0efd10 con 0x7f19080cacc0 2024-04-18T04:55:08.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.214+0000 7f190e440640 1 -- 172.21.15.96:0/211777384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1908067050 con 0x7f19080cacc0 2024-04-18T04:55:08.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.214+0000 7f1904ff9640 1 -- 172.21.15.96:0/211777384 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f18fc0f3330 con 0x7f19080cacc0 2024-04-18T04:55:08.219 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-18T04:55:08.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.218+0000 7f190e440640 1 -- 172.21.15.96:0/211777384 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f18f40666c0 msgr2=0x7f18f4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.218+0000 7f190e440640 1 --2- 172.21.15.96:0/211777384 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f18f40666c0 0x7f18f4068b80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f18f800a790 tx=0x7f18f8008040 comp rx=0 tx=0).stop 2024-04-18T04:55:08.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.218+0000 7f190e440640 1 -- 172.21.15.96:0/211777384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080cacc0 msgr2=0x7f19081ee690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.218+0000 7f190e440640 1 --2- 172.21.15.96:0/211777384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080cacc0 0x7f19081ee690 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0b3040 tx=0x7f18fc01ba70 comp rx=0 tx=0).stop 2024-04-18T04:55:08.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.218+0000 7f190e440640 1 -- 172.21.15.96:0/211777384 shutdown_connections 2024-04-18T04:55:08.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.218+0000 7f190e440640 1 --2- 172.21.15.96:0/211777384 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f18f40666c0 0x7f18f4068b80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.218+0000 7f190e440640 1 --2- 172.21.15.96:0/211777384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19081532d0 0x7f19081eebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.218+0000 7f190e440640 1 --2- 172.21.15.96:0/211777384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19080cacc0 0x7f19081ee690 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.218+0000 7f190e440640 1 --2- 172.21.15.96:0/211777384 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f19080c3fd0 0x7f19080cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.218+0000 7f190e440640 1 -- 172.21.15.96:0/211777384 >> 172.21.15.96:0/211777384 conn(0x7f1908071760 msgr2=0x7f19080cc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:08.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.218+0000 7f190e440640 1 -- 172.21.15.96:0/211777384 shutdown_connections 2024-04-18T04:55:08.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.218+0000 7f190e440640 1 -- 172.21.15.96:0/211777384 wait complete. 2024-04-18T04:55:08.237 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:55:08.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.354+0000 7fb2f85fc640 1 Processor -- start 2024-04-18T04:55:08.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.354+0000 7fb2f85fc640 1 -- start start 2024-04-18T04:55:08.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.354+0000 7fb2f85fc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb2f00c60e0 0x7fb2f014fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f85fc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2f0070a40 0x7fb2f0150090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f85fc640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f0159380 con 0x7fb2f00701b0 2024-04-18T04:55:08.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f85fc640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f015a1a0 con 0x7fb2f00c60e0 2024-04-18T04:55:08.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f85fc640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0155ce0 con 0x7fb2f0070a40 2024-04-18T04:55:08.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f6b99640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fb2f00701b0 0x7fb2f0156130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48362/0 (socket says 172.21.15.96:48362) 2024-04-18T04:55:08.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f6b99640 1 -- 172.21.15.96:0/238756054 learned_addr learned my addr 172.21.15.96:0/238756054 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:08.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5b97640 1 --2- 172.21.15.96:0/238756054 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2f0070a40 0x7fb2f0150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f6398640 1 --2- 172.21.15.96:0/238756054 >> v2:172.21.15.139:3300/0 conn(0x7fb2f00c60e0 0x7fb2f014fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 -- 172.21.15.96:0/238756054 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58617887 0 0) 0x7fb2f0159380 con 0x7fb2f00701b0 2024-04-18T04:55:08.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 -- 172.21.15.96:0/238756054 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d8003530 con 0x7fb2f00701b0 2024-04-18T04:55:08.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 -- 172.21.15.96:0/238756054 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3070950027 0 0) 0x7fb2d8003530 con 0x7fb2f00701b0 2024-04-18T04:55:08.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 -- 172.21.15.96:0/238756054 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2f0070a40 msgr2=0x7fb2f0150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:08.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 --2- 172.21.15.96:0/238756054 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2f0070a40 0x7fb2f0150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 -- 172.21.15.96:0/238756054 >> v2:172.21.15.139:3300/0 conn(0x7fb2f00c60e0 msgr2=0x7fb2f014fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:08.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 --2- 172.21.15.96:0/238756054 >> v2:172.21.15.139:3300/0 conn(0x7fb2f00c60e0 0x7fb2f014fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 -- 172.21.15.96:0/238756054 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f0159620 con 0x7fb2f00701b0 2024-04-18T04:55:08.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 -- 172.21.15.96:0/238756054 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fb2e0001a00 con 0x7fb2f00701b0 2024-04-18T04:55:08.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 -- 172.21.15.96:0/238756054 >> v1:172.21.15.96:6789/0 conn(0x7fb2f00701b0 legacy=0x7fb2f0156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 --2- 172.21.15.96:0/238756054 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2d8003980 0x7fb2d8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 --2- 172.21.15.96:0/238756054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2d80042e0 0x7fb2d80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 --2- 172.21.15.96:0/238756054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2d8004e20 0x7fb2d80052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 -- 172.21.15.96:0/238756054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f015a1a0 con 0x7fb2d80042e0 2024-04-18T04:55:08.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 -- 172.21.15.96:0/238756054 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0155ce0 con 0x7fb2d8004e20 2024-04-18T04:55:08.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 -- 172.21.15.96:0/238756054 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d800bd10 con 0x7fb2d8003980 2024-04-18T04:55:08.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5b97640 1 --2- 172.21.15.96:0/238756054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2d80042e0 0x7fb2d80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5b97640 1 -- 172.21.15.96:0/238756054 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2d8003980 msgr2=0x7fb2d8003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:08.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f6b99640 1 --2- 172.21.15.96:0/238756054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2d8004e20 0x7fb2d80052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5b97640 1 --2- 172.21.15.96:0/238756054 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2d8003980 0x7fb2d8003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5b97640 1 -- 172.21.15.96:0/238756054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2d8004e20 msgr2=0x7fb2d80052a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:08.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5b97640 1 --2- 172.21.15.96:0/238756054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2d8004e20 0x7fb2d80052a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5b97640 1 -- 172.21.15.96:0/238756054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8003530 con 0x7fb2d80042e0 2024-04-18T04:55:08.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f6b99640 1 --2- 172.21.15.96:0/238756054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2d8004e20 0x7fb2d80052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:08.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5b97640 1 --2- 172.21.15.96:0/238756054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2d80042e0 0x7fb2d80047d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009ae0 tx=0x7fb2e401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1e80a17aa73820 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:08.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 -- 172.21.15.96:0/238756054 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40a56a0 con 0x7fb2d80042e0 2024-04-18T04:55:08.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 -- 172.21.15.96:0/238756054 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e40a5800 con 0x7fb2d80042e0 2024-04-18T04:55:08.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.358+0000 7fb2f5396640 1 -- 172.21.15.96:0/238756054 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40a5bb0 con 0x7fb2d80042e0 2024-04-18T04:55:08.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 -- 172.21.15.96:0/238756054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2d80042e0 msgr2=0x7fb2d80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 --2- 172.21.15.96:0/238756054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2d80042e0 0x7fb2d80047d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009ae0 tx=0x7fb2e401cab0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f6b99640 1 -- 172.21.15.96:0/238756054 reap_dead start 2024-04-18T04:55:08.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 -- 172.21.15.96:0/238756054 shutdown_connections 2024-04-18T04:55:08.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 -- 172.21.15.96:0/238756054 >> 172.21.15.96:0/238756054 conn(0x7fb2f006c750 msgr2=0x7fb2f00c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:08.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 -- 172.21.15.96:0/238756054 shutdown_connections 2024-04-18T04:55:08.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 -- 172.21.15.96:0/238756054 wait complete. 2024-04-18T04:55:08.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 Processor -- start 2024-04-18T04:55:08.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 -- start start 2024-04-18T04:55:08.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2d80042e0 0x7fb2f0158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2f0156250 0x7fb2f0139150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f0156690 0x7fb2f0139690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f01540d0 con 0x7fb2f0156690 2024-04-18T04:55:08.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0158b90 con 0x7fb2d80042e0 2024-04-18T04:55:08.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f01ed260 con 0x7fb2f0156250 2024-04-18T04:55:08.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f6b99640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f0156690 0x7fb2f0139690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f6b99640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f0156690 0x7fb2f0139690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56348/0 (socket says 172.21.15.96:56348) 2024-04-18T04:55:08.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f6b99640 1 -- 172.21.15.96:0/1138617832 learned_addr learned my addr 172.21.15.96:0/1138617832 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:08.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f6398640 1 --2- 172.21.15.96:0/1138617832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2d80042e0 0x7fb2f0158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f5b97640 1 --2- 172.21.15.96:0/1138617832 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2f0156250 0x7fb2f0139150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f6b99640 1 -- 172.21.15.96:0/1138617832 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2f0156250 msgr2=0x7fb2f0139150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f6b99640 1 --2- 172.21.15.96:0/1138617832 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2f0156250 0x7fb2f0139150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f6b99640 1 -- 172.21.15.96:0/1138617832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2d80042e0 msgr2=0x7fb2f0158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f6b99640 1 --2- 172.21.15.96:0/1138617832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2d80042e0 0x7fb2f0158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f6b99640 1 -- 172.21.15.96:0/1138617832 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f01ec670 con 0x7fb2f0156690 2024-04-18T04:55:08.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f6b99640 1 --2- 172.21.15.96:0/1138617832 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f0156690 0x7fb2f0139690 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb2f01505d0 tx=0x7fb2e0010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:08.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2eeffd640 1 -- 172.21.15.96:0/1138617832 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e000eac0 con 0x7fb2f0156690 2024-04-18T04:55:08.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2eeffd640 1 -- 172.21.15.96:0/1138617832 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e000ec20 con 0x7fb2f0156690 2024-04-18T04:55:08.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 -- 172.21.15.96:0/1138617832 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f0158dc0 con 0x7fb2f0156690 2024-04-18T04:55:08.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2eeffd640 1 -- 172.21.15.96:0/1138617832 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0015400 con 0x7fb2f0156690 2024-04-18T04:55:08.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 -- 172.21.15.96:0/1138617832 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f01ecc10 con 0x7fb2f0156690 2024-04-18T04:55:08.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.362+0000 7fb2f85fc640 1 -- 172.21.15.96:0/1138617832 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f01ed410 con 0x7fb2f0156690 2024-04-18T04:55:08.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.366+0000 7fb2eeffd640 1 -- 172.21.15.96:0/1138617832 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb2e0015560 con 0x7fb2f0156690 2024-04-18T04:55:08.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.366+0000 7fb2eeffd640 1 --2- 172.21.15.96:0/1138617832 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb2dc066690 0x7fb2dc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.366+0000 7fb2eeffd640 1 -- 172.21.15.96:0/1138617832 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2e0086cd0 con 0x7fb2f0156690 2024-04-18T04:55:08.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.366+0000 7fb2f6398640 1 --2- 172.21.15.96:0/1138617832 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb2dc066690 0x7fb2dc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.366+0000 7fb2f6398640 1 --2- 172.21.15.96:0/1138617832 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb2dc066690 0x7fb2dc068b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb2e80047c0 tx=0x7fb2e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:08.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.370+0000 7fb2eeffd640 1 -- 172.21.15.96:0/1138617832 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb2f01ed410 con 0x7fb2f0156690 2024-04-18T04:55:08.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.562+0000 7fb2f85fc640 1 -- 172.21.15.96:0/1138617832 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2f01ed410 con 0x7fb2f0156690 2024-04-18T04:55:08.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.562+0000 7fb2eeffd640 1 -- 172.21.15.96:0/1138617832 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+6314 (secure 0 0 0) 0x7fb2f01ed410 con 0x7fb2f0156690 2024-04-18T04:55:08.566 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:55:08.566 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/4225147900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":4225147900},{"type":"v1","addr":"172.21.15.96:6839","nonce":4225147900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:54:41.158866+0000","modified":"2024-04-18T04:55:03.675575+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4273,"mds_1":4249,"mds_2":4239,"mds_3":4232,"mds_4":4229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4229":{"gid":4229,"name":"d","rank":4,"incarnation":16,"state":"up:creating","state_seq":1,"addr":"172.21.15.139:6836/2054604275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2054604275},{"type":"v1","addr":"172.21.15.139:6836","nonce":2054604275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4232":{"gid":4232,"name":"b","rank":3,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.139:6837/2105821790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":2105821790},{"type":"v1","addr":"172.21.15.139:6837","nonce":2105821790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4239":{"gid":4239,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.96:6835/1188672263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1188672263},{"type":"v1","addr":"172.21.15.96:6835","nonce":1188672263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4249":{"gid":4249,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.96:6837/4278976485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":4278976485},{"type":"v1","addr":"172.21.15.96:6837","nonce":4278976485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4273":{"gid":4273,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6833/3935291095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":3935291095},{"type":"v1","addr":"172.21.15.139:6833","nonce":3935291095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:55:08.567 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 16 2024-04-18T04:55:08.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.566+0000 7fb2f85fc640 1 -- 172.21.15.96:0/1138617832 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb2dc066690 msgr2=0x7fb2dc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.566+0000 7fb2f85fc640 1 --2- 172.21.15.96:0/1138617832 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb2dc066690 0x7fb2dc068b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb2e80047c0 tx=0x7fb2e8008040 comp rx=0 tx=0).stop 2024-04-18T04:55:08.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.566+0000 7fb2f85fc640 1 -- 172.21.15.96:0/1138617832 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f0156690 msgr2=0x7fb2f0139690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.566+0000 7fb2f85fc640 1 --2- 172.21.15.96:0/1138617832 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f0156690 0x7fb2f0139690 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb2f01505d0 tx=0x7fb2e0010d70 comp rx=0 tx=0).stop 2024-04-18T04:55:08.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.566+0000 7fb2f85fc640 1 -- 172.21.15.96:0/1138617832 shutdown_connections 2024-04-18T04:55:08.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.566+0000 7fb2f85fc640 1 --2- 172.21.15.96:0/1138617832 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb2dc066690 0x7fb2dc068b50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.566+0000 7fb2f85fc640 1 --2- 172.21.15.96:0/1138617832 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2f0156690 0x7fb2f0139690 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.566+0000 7fb2f85fc640 1 --2- 172.21.15.96:0/1138617832 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2f0156250 0x7fb2f0139150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.566+0000 7fb2f85fc640 1 --2- 172.21.15.96:0/1138617832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2d80042e0 0x7fb2f0158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.566+0000 7fb2f85fc640 1 -- 172.21.15.96:0/1138617832 >> 172.21.15.96:0/1138617832 conn(0x7fb2f006c750 msgr2=0x7fb2f014c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:08.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.566+0000 7fb2f85fc640 1 -- 172.21.15.96:0/1138617832 shutdown_connections 2024-04-18T04:55:08.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.566+0000 7fb2f85fc640 1 -- 172.21.15.96:0/1138617832 wait complete. 2024-04-18T04:55:08.586 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:55:08.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.694+0000 7fef11bbc640 1 Processor -- start 2024-04-18T04:55:08.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.694+0000 7fef11bbc640 1 -- start start 2024-04-18T04:55:08.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef11bbc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fef0c1530f0 0x7fef0c070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef11bbc640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0c0c9e50 con 0x7fef0c1590f0 2024-04-18T04:55:08.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef11bbc640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0c0ca130 con 0x7fef0c071cd0 2024-04-18T04:55:08.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef11bbc640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef0c0ca410 con 0x7fef0c1530f0 2024-04-18T04:55:08.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef0b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fef0c1530f0 0x7fef0c070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef0bfff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fef0c1590f0 0x7fef0c1594f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48378/0 (socket says 172.21.15.96:48378) 2024-04-18T04:55:08.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef0bfff640 1 -- 172.21.15.96:0/3846543786 learned_addr learned my addr 172.21.15.96:0/3846543786 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:08.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef0b7fe640 1 -- 172.21.15.96:0/3846543786 >> v1:172.21.15.139:6789/0 conn(0x7fef0c071cd0 legacy=0x7fef0c06f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:08.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef0b7fe640 1 -- 172.21.15.96:0/3846543786 >> v1:172.21.15.96:6789/0 conn(0x7fef0c1590f0 legacy=0x7fef0c1594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef0b7fe640 1 -- 172.21.15.96:0/3846543786 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c0ca6f0 con 0x7fef0c1530f0 2024-04-18T04:55:08.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef0b7fe640 1 --2- 172.21.15.96:0/3846543786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef0c1530f0 0x7fef0c070f70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7feefc0097c0 tx=0x7feefc01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e041ce2c802601 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:08.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef0a7fc640 1 -- 172.21.15.96:0/3846543786 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc0ab600 con 0x7fef0c1530f0 2024-04-18T04:55:08.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef0a7fc640 1 -- 172.21.15.96:0/3846543786 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc0a7050 con 0x7fef0c1530f0 2024-04-18T04:55:08.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef0a7fc640 1 -- 172.21.15.96:0/3846543786 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc0ab980 con 0x7fef0c1530f0 2024-04-18T04:55:08.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef11bbc640 1 -- 172.21.15.96:0/3846543786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef0c1530f0 msgr2=0x7fef0c070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef11bbc640 1 --2- 172.21.15.96:0/3846543786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef0c1530f0 0x7fef0c070f70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7feefc0097c0 tx=0x7feefc01c310 comp rx=0 tx=0).stop 2024-04-18T04:55:08.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef11bbc640 1 -- 172.21.15.96:0/3846543786 shutdown_connections 2024-04-18T04:55:08.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef11bbc640 1 --2- 172.21.15.96:0/3846543786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef0c1530f0 0x7fef0c070f70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef11bbc640 1 -- 172.21.15.96:0/3846543786 >> 172.21.15.96:0/3846543786 conn(0x7fef0c06af70 msgr2=0x7fef0c06b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:08.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef11bbc640 1 -- 172.21.15.96:0/3846543786 shutdown_connections 2024-04-18T04:55:08.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.698+0000 7fef11bbc640 1 -- 172.21.15.96:0/3846543786 wait complete. 2024-04-18T04:55:08.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef11bbc640 1 Processor -- start 2024-04-18T04:55:08.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef11bbc640 1 -- start start 2024-04-18T04:55:08.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef11bbc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef0c071cd0 0x7fef0c146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef11bbc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef0c1590f0 0x7fef0c147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef11bbc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fef0c156300 0x7fef0c157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef11bbc640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c145dc0 con 0x7fef0c071cd0 2024-04-18T04:55:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef11bbc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c148360 con 0x7fef0c1590f0 2024-04-18T04:55:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef11bbc640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c154de0 con 0x7fef0c156300 2024-04-18T04:55:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef0b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef0c071cd0 0x7fef0c146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef0b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef0c071cd0 0x7fef0c146530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56374/0 (socket says 172.21.15.96:56374) 2024-04-18T04:55:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef0b7fe640 1 -- 172.21.15.96:0/3057486526 learned_addr learned my addr 172.21.15.96:0/3057486526 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef0affd640 1 --2- 172.21.15.96:0/3057486526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef0c1590f0 0x7fef0c147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef0bfff640 1 --2- 172.21.15.96:0/3057486526 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fef0c156300 0x7fef0c157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef0b7fe640 1 -- 172.21.15.96:0/3057486526 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fef0c156300 msgr2=0x7fef0c157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef0b7fe640 1 --2- 172.21.15.96:0/3057486526 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fef0c156300 0x7fef0c157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef0b7fe640 1 -- 172.21.15.96:0/3057486526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef0c1590f0 msgr2=0x7fef0c147e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef0b7fe640 1 --2- 172.21.15.96:0/3057486526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef0c1590f0 0x7fef0c147e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef0b7fe640 1 -- 172.21.15.96:0/3057486526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc009420 con 0x7fef0c071cd0 2024-04-18T04:55:08.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef0b7fe640 1 --2- 172.21.15.96:0/3057486526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef0c071cd0 0x7fef0c146530 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feefc0ae040 tx=0x7feefc0190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:08.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7feef3fff640 1 -- 172.21.15.96:0/3057486526 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc0b4610 con 0x7fef0c071cd0 2024-04-18T04:55:08.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7feef3fff640 1 -- 172.21.15.96:0/3057486526 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc0b4790 con 0x7fef0c071cd0 2024-04-18T04:55:08.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef11bbc640 1 -- 172.21.15.96:0/3057486526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0c1550c0 con 0x7fef0c071cd0 2024-04-18T04:55:08.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7feef3fff640 1 -- 172.21.15.96:0/3057486526 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc0b4b40 con 0x7fef0c071cd0 2024-04-18T04:55:08.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef11bbc640 1 -- 172.21.15.96:0/3057486526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0c155680 con 0x7fef0c071cd0 2024-04-18T04:55:08.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7fef11bbc640 1 -- 172.21.15.96:0/3057486526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0c072120 con 0x7fef0c071cd0 2024-04-18T04:55:08.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.702+0000 7feef3fff640 1 -- 172.21.15.96:0/3057486526 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feefc0b2040 con 0x7fef0c071cd0 2024-04-18T04:55:08.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.706+0000 7feef3fff640 1 --2- 172.21.15.96:0/3057486526 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7feef80666c0 0x7feef8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:08.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.706+0000 7feef3fff640 1 -- 172.21.15.96:0/3057486526 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feefc11e170 con 0x7fef0c071cd0 2024-04-18T04:55:08.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.706+0000 7fef0affd640 1 --2- 172.21.15.96:0/3057486526 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7feef80666c0 0x7feef8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:08.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.706+0000 7fef0affd640 1 --2- 172.21.15.96:0/3057486526 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7feef80666c0 0x7feef8068b80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0c7e90 tx=0x7fef00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:08.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.710+0000 7feef3fff640 1 -- 172.21.15.96:0/3057486526 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fef0c072120 con 0x7fef0c071cd0 2024-04-18T04:55:08.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.866+0000 7fef11bbc640 1 -- 172.21.15.96:0/3057486526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef0c072120 con 0x7fef0c071cd0 2024-04-18T04:55:08.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.870+0000 7feef3fff640 1 -- 172.21.15.96:0/3057486526 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fef0c072120 con 0x7fef0c071cd0 2024-04-18T04:55:08.872 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:55:08.872 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":21,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:54:42.161552+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:54:39.219441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:54:40.139557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.720340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.767224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.811511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.710188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.860525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.704784+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:55:08.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.870+0000 7fef11bbc640 1 -- 172.21.15.96:0/3057486526 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7feef80666c0 msgr2=0x7feef8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.870+0000 7fef11bbc640 1 --2- 172.21.15.96:0/3057486526 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7feef80666c0 0x7feef8068b80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0c7e90 tx=0x7fef00008040 comp rx=0 tx=0).stop 2024-04-18T04:55:08.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.870+0000 7fef11bbc640 1 -- 172.21.15.96:0/3057486526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef0c071cd0 msgr2=0x7fef0c146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:08.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.870+0000 7fef11bbc640 1 --2- 172.21.15.96:0/3057486526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef0c071cd0 0x7fef0c146530 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feefc0ae040 tx=0x7feefc0190b0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.870+0000 7fef11bbc640 1 -- 172.21.15.96:0/3057486526 shutdown_connections 2024-04-18T04:55:08.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.870+0000 7fef11bbc640 1 --2- 172.21.15.96:0/3057486526 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7feef80666c0 0x7feef8068b80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.870+0000 7fef11bbc640 1 --2- 172.21.15.96:0/3057486526 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fef0c156300 0x7fef0c157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.870+0000 7fef11bbc640 1 --2- 172.21.15.96:0/3057486526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef0c1590f0 0x7fef0c147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.870+0000 7fef11bbc640 1 --2- 172.21.15.96:0/3057486526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fef0c071cd0 0x7fef0c146530 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:08.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.870+0000 7fef11bbc640 1 -- 172.21.15.96:0/3057486526 >> 172.21.15.96:0/3057486526 conn(0x7fef0c06af70 msgr2=0x7fef0c06b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:08.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.870+0000 7fef11bbc640 1 -- 172.21.15.96:0/3057486526 shutdown_connections 2024-04-18T04:55:08.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:08.870+0000 7fef11bbc640 1 -- 172.21.15.96:0/3057486526 wait complete. 2024-04-18T04:55:08.890 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:54:32.641813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T04:54:39.219441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T04:54:40.139557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T04:55:08.890 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T04:55:09.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.002+0000 7fc5d22ae640 1 Processor -- start 2024-04-18T04:55:09.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.002+0000 7fc5d22ae640 1 -- start start 2024-04-18T04:55:09.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5d22ae640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc5cc0c4ed0 0x7fc5cc0c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5d22ae640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc5cc156f10 0x7fc5cc157350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5d22ae640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5cc069e60 con 0x7fc5cc0c52b0 2024-04-18T04:55:09.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5d22ae640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc0c9010 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5d22ae640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc157890 con 0x7fc5cc156f10 2024-04-18T04:55:09.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5cbfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc5cc0c4ed0 0x7fc5cc0c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5cbfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc5cc0c4ed0 0x7fc5cc0c8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37398/0 (socket says 172.21.15.96:37398) 2024-04-18T04:55:09.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5cbfff640 1 -- 172.21.15.96:0/70683881 learned_addr learned my addr 172.21.15.96:0/70683881 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:09.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5cbfff640 1 -- 172.21.15.96:0/70683881 >> v2:172.21.15.139:3300/0 conn(0x7fc5cc156f10 msgr2=0x7fc5cc157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:09.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5cbfff640 1 --2- 172.21.15.96:0/70683881 >> v2:172.21.15.139:3300/0 conn(0x7fc5cc156f10 0x7fc5cc157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5cbfff640 1 -- 172.21.15.96:0/70683881 >> v1:172.21.15.139:6789/0 conn(0x7fc5cc0c52b0 legacy=0x7fc5cc0c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:09.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5cbfff640 1 -- 172.21.15.96:0/70683881 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc06a0b0 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5cbfff640 1 --2- 172.21.15.96:0/70683881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5cc0c4ed0 0x7fc5cc0c8ad0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0cc530 tx=0x7fc5bc01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52474c05c48466bb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:09.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5caffd640 1 -- 172.21.15.96:0/70683881 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0a89d0 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5caffd640 1 -- 172.21.15.96:0/70683881 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc0a8b30 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5caffd640 1 -- 172.21.15.96:0/70683881 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0b0440 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5d22ae640 1 -- 172.21.15.96:0/70683881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5cc0c4ed0 msgr2=0x7fc5cc0c8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5d22ae640 1 --2- 172.21.15.96:0/70683881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5cc0c4ed0 0x7fc5cc0c8ad0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0cc530 tx=0x7fc5bc01ecd0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5d22ae640 1 -- 172.21.15.96:0/70683881 shutdown_connections 2024-04-18T04:55:09.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5d22ae640 1 --2- 172.21.15.96:0/70683881 >> v2:172.21.15.139:3300/0 conn(0x7fc5cc156f10 0x7fc5cc157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5d22ae640 1 --2- 172.21.15.96:0/70683881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5cc0c4ed0 0x7fc5cc0c8ad0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5d22ae640 1 -- 172.21.15.96:0/70683881 >> 172.21.15.96:0/70683881 conn(0x7fc5cc0cb560 msgr2=0x7fc5cc0cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:09.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5d22ae640 1 -- 172.21.15.96:0/70683881 shutdown_connections 2024-04-18T04:55:09.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.006+0000 7fc5d22ae640 1 -- 172.21.15.96:0/70683881 wait complete. 2024-04-18T04:55:09.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5d22ae640 1 Processor -- start 2024-04-18T04:55:09.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5d22ae640 1 -- start start 2024-04-18T04:55:09.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5d22ae640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5cc0c4ed0 0x7fc5cc148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5d22ae640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5cc0c52b0 0x7fc5cc14b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5d22ae640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc5cc156f10 0x7fc5cc1ee160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5d22ae640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc1f16d0 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5d22ae640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc149150 con 0x7fc5cc0c52b0 2024-04-18T04:55:09.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5d22ae640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc14a580 con 0x7fc5cc156f10 2024-04-18T04:55:09.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5cbfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5cc0c4ed0 0x7fc5cc148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5cbfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5cc0c4ed0 0x7fc5cc148c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37408/0 (socket says 172.21.15.96:37408) 2024-04-18T04:55:09.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5cbfff640 1 -- 172.21.15.96:0/1183691255 learned_addr learned my addr 172.21.15.96:0/1183691255 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:09.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5d084b640 1 --2- 172.21.15.96:0/1183691255 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc5cc156f10 0x7fc5cc1ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5cb7fe640 1 --2- 172.21.15.96:0/1183691255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5cc0c52b0 0x7fc5cc14b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5cbfff640 1 -- 172.21.15.96:0/1183691255 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc5cc156f10 msgr2=0x7fc5cc1ee160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5cbfff640 1 --2- 172.21.15.96:0/1183691255 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc5cc156f10 0x7fc5cc1ee160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5cbfff640 1 -- 172.21.15.96:0/1183691255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5cc0c52b0 msgr2=0x7fc5cc14b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5cbfff640 1 --2- 172.21.15.96:0/1183691255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5cc0c52b0 0x7fc5cc14b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5cbfff640 1 -- 172.21.15.96:0/1183691255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc0094d0 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5cbfff640 1 --2- 172.21.15.96:0/1183691255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5cc0c4ed0 0x7fc5cc148c10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc0b3040 tx=0x7fc5bc01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:09.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5c8ff9640 1 -- 172.21.15.96:0/1183691255 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0b0e00 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5c8ff9640 1 -- 172.21.15.96:0/1183691255 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc0bb470 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5c8ff9640 1 -- 172.21.15.96:0/1183691255 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0bb820 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5d22ae640 1 -- 172.21.15.96:0/1183691255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5cc1f18e0 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5d22ae640 1 -- 172.21.15.96:0/1183691255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc1f1ea0 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5c8ff9640 1 -- 172.21.15.96:0/1183691255 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc5bc0b7070 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.010+0000 7fc5d22ae640 1 -- 172.21.15.96:0/1183691255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5cc0c7940 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.014+0000 7fc5c8ff9640 1 --2- 172.21.15.96:0/1183691255 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5b8066690 0x7fc5b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.014+0000 7fc5cb7fe640 1 --2- 172.21.15.96:0/1183691255 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5b8066690 0x7fc5b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.014+0000 7fc5c8ff9640 1 -- 172.21.15.96:0/1183691255 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5bc1224c0 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.014+0000 7fc5cb7fe640 1 --2- 172.21.15.96:0/1183691255 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5b8066690 0x7fc5b8068b50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc147610 tx=0x7fc5c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:09.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.018+0000 7fc5c8ff9640 1 -- 172.21.15.96:0/1183691255 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc5bc0ef8c0 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.158+0000 7fc5d22ae640 1 -- 172.21.15.96:0/1183691255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5cc0c7940 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.162+0000 7fc5c8ff9640 1 -- 172.21.15.96:0/1183691255 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5bc0f2ee0 con 0x7fc5cc0c4ed0 2024-04-18T04:55:09.164 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-18T04:55:09.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.162+0000 7fc5d22ae640 1 -- 172.21.15.96:0/1183691255 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5b8066690 msgr2=0x7fc5b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.162+0000 7fc5d22ae640 1 --2- 172.21.15.96:0/1183691255 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5b8066690 0x7fc5b8068b50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc147610 tx=0x7fc5c0009040 comp rx=0 tx=0).stop 2024-04-18T04:55:09.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.162+0000 7fc5d22ae640 1 -- 172.21.15.96:0/1183691255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5cc0c4ed0 msgr2=0x7fc5cc148c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.162+0000 7fc5d22ae640 1 --2- 172.21.15.96:0/1183691255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5cc0c4ed0 0x7fc5cc148c10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc0b3040 tx=0x7fc5bc01ba70 comp rx=0 tx=0).stop 2024-04-18T04:55:09.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.162+0000 7fc5d22ae640 1 -- 172.21.15.96:0/1183691255 shutdown_connections 2024-04-18T04:55:09.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.162+0000 7fc5d22ae640 1 --2- 172.21.15.96:0/1183691255 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc5b8066690 0x7fc5b8068b50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.162+0000 7fc5d22ae640 1 --2- 172.21.15.96:0/1183691255 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc5cc156f10 0x7fc5cc1ee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.162+0000 7fc5d22ae640 1 --2- 172.21.15.96:0/1183691255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5cc0c52b0 0x7fc5cc14b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.162+0000 7fc5d22ae640 1 --2- 172.21.15.96:0/1183691255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5cc0c4ed0 0x7fc5cc148c10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.162+0000 7fc5d22ae640 1 -- 172.21.15.96:0/1183691255 >> 172.21.15.96:0/1183691255 conn(0x7fc5cc0cb560 msgr2=0x7fc5cc14f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:09.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.162+0000 7fc5d22ae640 1 -- 172.21.15.96:0/1183691255 shutdown_connections 2024-04-18T04:55:09.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.162+0000 7fc5d22ae640 1 -- 172.21.15.96:0/1183691255 wait complete. 2024-04-18T04:55:09.181 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T04:55:09.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024c862640 1 Processor -- start 2024-04-18T04:55:09.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024c862640 1 -- start start 2024-04-18T04:55:09.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024c862640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0248150ca0 0x7f02480c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024c862640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02480c67d0 con 0x7f0248157660 2024-04-18T04:55:09.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024c862640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0248070f60 con 0x7f0248065fc0 2024-04-18T04:55:09.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024c862640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0248071620 con 0x7f0248150ca0 2024-04-18T04:55:09.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f0245d9b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f0248157660 0x7f02480c4300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36062/0 (socket says 172.21.15.96:36062) 2024-04-18T04:55:09.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f0245d9b640 1 -- 172.21.15.96:0/2325386561 learned_addr learned my addr 172.21.15.96:0/2325386561 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:09.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024559a640 1 -- 172.21.15.96:0/2325386561 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059357859 0 0) 0x7f02480c67d0 con 0x7f0248157660 2024-04-18T04:55:09.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024659c640 1 --2- 172.21.15.96:0/2325386561 >> v2:172.21.15.139:3300/0 conn(0x7f0248150ca0 0x7f02480c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024559a640 1 -- 172.21.15.96:0/2325386561 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0230003530 con 0x7f0248157660 2024-04-18T04:55:09.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024559a640 1 -- 172.21.15.96:0/2325386561 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3316595592 0 0) 0x7f0230003530 con 0x7f0248157660 2024-04-18T04:55:09.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024559a640 1 -- 172.21.15.96:0/2325386561 >> v2:172.21.15.139:3300/0 conn(0x7f0248150ca0 msgr2=0x7f02480c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024559a640 1 --2- 172.21.15.96:0/2325386561 >> v2:172.21.15.139:3300/0 conn(0x7f0248150ca0 0x7f02480c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024559a640 1 -- 172.21.15.96:0/2325386561 >> v1:172.21.15.139:6789/0 conn(0x7f0248065fc0 legacy=0x7f0248161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024559a640 1 -- 172.21.15.96:0/2325386561 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0248151080 con 0x7f0248157660 2024-04-18T04:55:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024559a640 1 -- 172.21.15.96:0/2325386561 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f023c001680 con 0x7f0248157660 2024-04-18T04:55:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024559a640 1 -- 172.21.15.96:0/2325386561 >> v1:172.21.15.96:6789/0 conn(0x7f0248157660 legacy=0x7f02480c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024559a640 1 --2- 172.21.15.96:0/2325386561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0230003980 0x7f0230003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024559a640 1 --2- 172.21.15.96:0/2325386561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02300047d0 0x7f0230004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024559a640 1 --2- 172.21.15.96:0/2325386561 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0230005190 0x7f023000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024559a640 1 -- 172.21.15.96:0/2325386561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023000c070 con 0x7f0230003980 2024-04-18T04:55:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024559a640 1 -- 172.21.15.96:0/2325386561 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023000c1e0 con 0x7f02300047d0 2024-04-18T04:55:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024559a640 1 -- 172.21.15.96:0/2325386561 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023000c3a0 con 0x7f0230005190 2024-04-18T04:55:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024659c640 1 --2- 172.21.15.96:0/2325386561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0230003980 0x7f0230003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024659c640 1 -- 172.21.15.96:0/2325386561 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0230005190 msgr2=0x7f023000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024659c640 1 --2- 172.21.15.96:0/2325386561 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0230005190 0x7f023000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024659c640 1 -- 172.21.15.96:0/2325386561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02300047d0 msgr2=0x7f0230004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:09.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024659c640 1 --2- 172.21.15.96:0/2325386561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02300047d0 0x7f0230004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f024659c640 1 -- 172.21.15.96:0/2325386561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0230003530 con 0x7f0230003980 2024-04-18T04:55:09.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.290+0000 7f0246d9d640 1 -- 172.21.15.96:0/2325386561 reap_dead start 2024-04-18T04:55:09.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024659c640 1 --2- 172.21.15.96:0/2325386561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0230003980 0x7f0230003d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f023800ba30 tx=0x7f023801c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f8d85dc8a75bbb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:09.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024559a640 1 -- 172.21.15.96:0/2325386561 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02380aa630 con 0x7f0230003980 2024-04-18T04:55:09.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024559a640 1 -- 172.21.15.96:0/2325386561 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02380aa790 con 0x7f0230003980 2024-04-18T04:55:09.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024559a640 1 -- 172.21.15.96:0/2325386561 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02380aab40 con 0x7f0230003980 2024-04-18T04:55:09.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024c862640 1 -- 172.21.15.96:0/2325386561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0230003980 msgr2=0x7f0230003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024c862640 1 --2- 172.21.15.96:0/2325386561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0230003980 0x7f0230003d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f023800ba30 tx=0x7f023801c6c0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024c862640 1 -- 172.21.15.96:0/2325386561 shutdown_connections 2024-04-18T04:55:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024c862640 1 --2- 172.21.15.96:0/2325386561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0230003980 0x7f0230003d80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024c862640 1 -- 172.21.15.96:0/2325386561 >> 172.21.15.96:0/2325386561 conn(0x7f02480cabf0 msgr2=0x7f02480cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024c862640 1 -- 172.21.15.96:0/2325386561 shutdown_connections 2024-04-18T04:55:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024c862640 1 -- 172.21.15.96:0/2325386561 wait complete. 2024-04-18T04:55:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024c862640 1 Processor -- start 2024-04-18T04:55:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024c862640 1 -- start start 2024-04-18T04:55:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024c862640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0230003980 0x7f02480ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024c862640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f024814f9b0 0x7f024814fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024c862640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0248144810 0x7f0248144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024c862640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024814e090 con 0x7f024814f9b0 2024-04-18T04:55:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024c862640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0248143dc0 con 0x7f0230003980 2024-04-18T04:55:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f024c862640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0248144380 con 0x7f0248144810 2024-04-18T04:55:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f0245d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f024814f9b0 0x7f024814fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f0245d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f024814f9b0 0x7f024814fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37418/0 (socket says 172.21.15.96:37418) 2024-04-18T04:55:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.294+0000 7f0245d9b640 1 -- 172.21.15.96:0/206914491 learned_addr learned my addr 172.21.15.96:0/206914491 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:09.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f0246d9d640 1 --2- 172.21.15.96:0/206914491 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0248144810 0x7f0248144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f024659c640 1 --2- 172.21.15.96:0/206914491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0230003980 0x7f02480ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f0245d9b640 1 -- 172.21.15.96:0/206914491 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0248144810 msgr2=0x7f0248144c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f0245d9b640 1 --2- 172.21.15.96:0/206914491 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0248144810 0x7f0248144c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f0245d9b640 1 -- 172.21.15.96:0/206914491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0230003980 msgr2=0x7f02480ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f0245d9b640 1 --2- 172.21.15.96:0/206914491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0230003980 0x7f02480ca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f0245d9b640 1 -- 172.21.15.96:0/206914491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02481451d0 con 0x7f024814f9b0 2024-04-18T04:55:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f0245d9b640 1 --2- 172.21.15.96:0/206914491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f024814f9b0 0x7f024814fe10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f023c00f440 tx=0x7f023c00f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f0236ffd640 1 -- 172.21.15.96:0/206914491 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c007d00 con 0x7f024814f9b0 2024-04-18T04:55:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f0236ffd640 1 -- 172.21.15.96:0/206914491 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023c007e80 con 0x7f024814f9b0 2024-04-18T04:55:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f024c862640 1 -- 172.21.15.96:0/206914491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f024814ec60 con 0x7f024814f9b0 2024-04-18T04:55:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f0236ffd640 1 -- 172.21.15.96:0/206914491 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c00a310 con 0x7f024814f9b0 2024-04-18T04:55:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f024c862640 1 -- 172.21.15.96:0/206914491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02480c96b0 con 0x7f024814f9b0 2024-04-18T04:55:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f024c862640 1 -- 172.21.15.96:0/206914491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02480675e0 con 0x7f024814f9b0 2024-04-18T04:55:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f0236ffd640 1 -- 172.21.15.96:0/206914491 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f023c00a470 con 0x7f024814f9b0 2024-04-18T04:55:09.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f0236ffd640 1 --2- 172.21.15.96:0/206914491 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02280666c0 0x7f0228068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f024659c640 1 --2- 172.21.15.96:0/206914491 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02280666c0 0x7f0228068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f0236ffd640 1 -- 172.21.15.96:0/206914491 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f023c086d90 con 0x7f024814f9b0 2024-04-18T04:55:09.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.298+0000 7f024659c640 1 --2- 172.21.15.96:0/206914491 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02280666c0 0x7f0228068b80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f02380af000 tx=0x7f02380ac040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:09.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.302+0000 7f0236ffd640 1 -- 172.21.15.96:0/206914491 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f023c054190 con 0x7f024814f9b0 2024-04-18T04:55:09.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.446+0000 7f024c862640 1 -- 172.21.15.96:0/206914491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02481544e0 con 0x7f024814f9b0 2024-04-18T04:55:09.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.450+0000 7f0236ffd640 1 -- 172.21.15.96:0/206914491 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f023c0577b0 con 0x7f024814f9b0 2024-04-18T04:55:09.452 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-18T04:55:09.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.450+0000 7f024c862640 1 -- 172.21.15.96:0/206914491 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02280666c0 msgr2=0x7f0228068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.450+0000 7f024c862640 1 --2- 172.21.15.96:0/206914491 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02280666c0 0x7f0228068b80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f02380af000 tx=0x7f02380ac040 comp rx=0 tx=0).stop 2024-04-18T04:55:09.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.450+0000 7f024c862640 1 -- 172.21.15.96:0/206914491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f024814f9b0 msgr2=0x7f024814fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.450+0000 7f024c862640 1 --2- 172.21.15.96:0/206914491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f024814f9b0 0x7f024814fe10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f023c00f440 tx=0x7f023c00f900 comp rx=0 tx=0).stop 2024-04-18T04:55:09.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.450+0000 7f024c862640 1 -- 172.21.15.96:0/206914491 shutdown_connections 2024-04-18T04:55:09.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.450+0000 7f024c862640 1 --2- 172.21.15.96:0/206914491 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02280666c0 0x7f0228068b80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.450+0000 7f024c862640 1 --2- 172.21.15.96:0/206914491 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0248144810 0x7f0248144c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.450+0000 7f024c862640 1 --2- 172.21.15.96:0/206914491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f024814f9b0 0x7f024814fe10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.450+0000 7f024c862640 1 --2- 172.21.15.96:0/206914491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0230003980 0x7f02480ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.450+0000 7f024c862640 1 -- 172.21.15.96:0/206914491 >> 172.21.15.96:0/206914491 conn(0x7f02480cabf0 msgr2=0x7f0248156c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:09.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.450+0000 7f024c862640 1 -- 172.21.15.96:0/206914491 shutdown_connections 2024-04-18T04:55:09.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.450+0000 7f024c862640 1 -- 172.21.15.96:0/206914491 wait complete. 2024-04-18T04:55:09.469 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T04:55:09.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.574+0000 7f4ff80d1640 1 Processor -- start 2024-04-18T04:55:09.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.574+0000 7f4ff80d1640 1 -- start start 2024-04-18T04:55:09.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff80d1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4ff0151070 0x7f4ff015ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff80d1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff006f200 con 0x7f4ff006eb10 2024-04-18T04:55:09.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff80d1640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff0151450 con 0x7f4ff00c3610 2024-04-18T04:55:09.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff80d1640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff00c7680 con 0x7f4ff0151070 2024-04-18T04:55:09.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff666e640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f4ff006eb10 0x7f4ff0161530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36070/0 (socket says 172.21.15.96:36070) 2024-04-18T04:55:09.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff666e640 1 -- 172.21.15.96:0/3094628742 learned_addr learned my addr 172.21.15.96:0/3094628742 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:09.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff5e6d640 1 --2- 172.21.15.96:0/3094628742 >> v2:172.21.15.139:3300/0 conn(0x7f4ff0151070 0x7f4ff015ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff4e6b640 1 -- 172.21.15.96:0/3094628742 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190977244 0 0) 0x7f4ff006f200 con 0x7f4ff006eb10 2024-04-18T04:55:09.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff4e6b640 1 -- 172.21.15.96:0/3094628742 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fdc003530 con 0x7f4ff006eb10 2024-04-18T04:55:09.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff4e6b640 1 -- 172.21.15.96:0/3094628742 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4216857607 0 0) 0x7f4fdc003530 con 0x7f4ff006eb10 2024-04-18T04:55:09.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff4e6b640 1 -- 172.21.15.96:0/3094628742 >> v2:172.21.15.139:3300/0 conn(0x7f4ff0151070 msgr2=0x7f4ff015ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:09.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff4e6b640 1 --2- 172.21.15.96:0/3094628742 >> v2:172.21.15.139:3300/0 conn(0x7f4ff0151070 0x7f4ff015ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff4e6b640 1 -- 172.21.15.96:0/3094628742 >> v1:172.21.15.139:6789/0 conn(0x7f4ff00c3610 legacy=0x7f4ff00cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff4e6b640 1 -- 172.21.15.96:0/3094628742 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff00c70c0 con 0x7f4ff006eb10 2024-04-18T04:55:09.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff4e6b640 1 -- 172.21.15.96:0/3094628742 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f4fec001680 con 0x7f4ff006eb10 2024-04-18T04:55:09.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff4e6b640 1 -- 172.21.15.96:0/3094628742 >> v1:172.21.15.96:6789/0 conn(0x7f4ff006eb10 legacy=0x7f4ff0161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff4e6b640 1 --2- 172.21.15.96:0/3094628742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fdc003980 0x7f4fdc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff4e6b640 1 --2- 172.21.15.96:0/3094628742 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4fdc0047d0 0x7f4fdc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff4e6b640 1 --2- 172.21.15.96:0/3094628742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4fdc005190 0x7f4fdc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff4e6b640 1 -- 172.21.15.96:0/3094628742 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff00c7680 con 0x7f4fdc003980 2024-04-18T04:55:09.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff4e6b640 1 -- 172.21.15.96:0/3094628742 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc00c040 con 0x7f4fdc005190 2024-04-18T04:55:09.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff4e6b640 1 -- 172.21.15.96:0/3094628742 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc00c200 con 0x7f4fdc0047d0 2024-04-18T04:55:09.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff5e6d640 1 --2- 172.21.15.96:0/3094628742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fdc003980 0x7f4fdc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff666e640 1 --2- 172.21.15.96:0/3094628742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4fdc005190 0x7f4fdc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff5e6d640 1 -- 172.21.15.96:0/3094628742 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4fdc0047d0 msgr2=0x7f4fdc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:09.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff5e6d640 1 --2- 172.21.15.96:0/3094628742 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4fdc0047d0 0x7f4fdc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff5e6d640 1 -- 172.21.15.96:0/3094628742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4fdc005190 msgr2=0x7f4fdc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:09.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff5e6d640 1 --2- 172.21.15.96:0/3094628742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4fdc005190 0x7f4fdc00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff666e640 1 -- 172.21.15.96:0/3094628742 reap_dead start 2024-04-18T04:55:09.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.578+0000 7f4ff5e6d640 1 -- 172.21.15.96:0/3094628742 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc003530 con 0x7f4fdc003980 2024-04-18T04:55:09.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff5e6d640 1 --2- 172.21.15.96:0/3094628742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fdc003980 0x7f4fdc003da0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009fc0 tx=0x7f4fe801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688cf9625c5eefd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:09.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff4e6b640 1 -- 172.21.15.96:0/3094628742 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe80a5c90 con 0x7f4fdc003980 2024-04-18T04:55:09.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff4e6b640 1 -- 172.21.15.96:0/3094628742 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe800f040 con 0x7f4fdc003980 2024-04-18T04:55:09.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff4e6b640 1 -- 172.21.15.96:0/3094628742 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe80ad440 con 0x7f4fdc003980 2024-04-18T04:55:09.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 -- 172.21.15.96:0/3094628742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fdc003980 msgr2=0x7f4fdc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 --2- 172.21.15.96:0/3094628742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fdc003980 0x7f4fdc003da0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009fc0 tx=0x7f4fe801cc80 comp rx=0 tx=0).stop 2024-04-18T04:55:09.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 -- 172.21.15.96:0/3094628742 shutdown_connections 2024-04-18T04:55:09.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 --2- 172.21.15.96:0/3094628742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4fdc003980 0x7f4fdc003da0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 -- 172.21.15.96:0/3094628742 >> 172.21.15.96:0/3094628742 conn(0x7f4ff006a5c0 msgr2=0x7f4ff0065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:09.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 -- 172.21.15.96:0/3094628742 shutdown_connections 2024-04-18T04:55:09.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 -- 172.21.15.96:0/3094628742 wait complete. 2024-04-18T04:55:09.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 Processor -- start 2024-04-18T04:55:09.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 -- start start 2024-04-18T04:55:09.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4fdc003980 0x7f4ff006c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ff0155380 0x7f4ff00ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ff00c77c0 0x7f4ff00c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff006c3f0 con 0x7f4ff0155380 2024-04-18T04:55:09.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff00c3b70 con 0x7f4ff00c77c0 2024-04-18T04:55:09.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff006b4b0 con 0x7f4fdc003980 2024-04-18T04:55:09.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff566c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ff0155380 0x7f4ff00ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff566c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ff0155380 0x7f4ff00ca780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37440/0 (socket says 172.21.15.96:37440) 2024-04-18T04:55:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff566c640 1 -- 172.21.15.96:0/2875138140 learned_addr learned my addr 172.21.15.96:0/2875138140 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff5e6d640 1 --2- 172.21.15.96:0/2875138140 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4fdc003980 0x7f4ff006c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff566c640 1 -- 172.21.15.96:0/2875138140 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4fdc003980 msgr2=0x7f4ff006c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff566c640 1 --2- 172.21.15.96:0/2875138140 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4fdc003980 0x7f4ff006c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff566c640 1 -- 172.21.15.96:0/2875138140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ff00c77c0 msgr2=0x7f4ff00c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff566c640 1 --2- 172.21.15.96:0/2875138140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ff00c77c0 0x7f4ff00c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff566c640 1 -- 172.21.15.96:0/2875138140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff006b770 con 0x7f4ff0155380 2024-04-18T04:55:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff566c640 1 --2- 172.21.15.96:0/2875138140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ff0155380 0x7f4ff00ca780 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400c430 tx=0x7f4fe400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4fe27fc640 1 -- 172.21.15.96:0/2875138140 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe40052d0 con 0x7f4ff0155380 2024-04-18T04:55:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4fe27fc640 1 -- 172.21.15.96:0/2875138140 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe4005450 con 0x7f4ff0155380 2024-04-18T04:55:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 -- 172.21.15.96:0/2875138140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff006ba50 con 0x7f4ff0155380 2024-04-18T04:55:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4fe27fc640 1 -- 172.21.15.96:0/2875138140 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4003840 con 0x7f4ff0155380 2024-04-18T04:55:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.582+0000 7f4ff80d1640 1 -- 172.21.15.96:0/2875138140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff006c010 con 0x7f4ff0155380 2024-04-18T04:55:09.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.586+0000 7f4ff80d1640 1 -- 172.21.15.96:0/2875138140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff006c660 con 0x7f4ff0155380 2024-04-18T04:55:09.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.586+0000 7f4fe27fc640 1 -- 172.21.15.96:0/2875138140 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4fe40039a0 con 0x7f4ff0155380 2024-04-18T04:55:09.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.586+0000 7f4fe27fc640 1 --2- 172.21.15.96:0/2875138140 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4fd40666c0 0x7f4fd4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.586+0000 7f4ff5e6d640 1 --2- 172.21.15.96:0/2875138140 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4fd40666c0 0x7f4fd4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.586+0000 7f4fe27fc640 1 -- 172.21.15.96:0/2875138140 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4fe4083790 con 0x7f4ff0155380 2024-04-18T04:55:09.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.586+0000 7f4ff5e6d640 1 --2- 172.21.15.96:0/2875138140 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4fd40666c0 0x7f4fd4068b80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4fe80af000 tx=0x7f4fe8004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:09.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.590+0000 7f4fe27fc640 1 -- 172.21.15.96:0/2875138140 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f4fe4050b00 con 0x7f4ff0155380 2024-04-18T04:55:09.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.746+0000 7f4ff80d1640 1 -- 172.21.15.96:0/2875138140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ff0067050 con 0x7f4ff0155380 2024-04-18T04:55:09.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.750+0000 7f4fe27fc640 1 -- 172.21.15.96:0/2875138140 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4fe40170a0 con 0x7f4ff0155380 2024-04-18T04:55:09.751 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-18T04:55:09.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.750+0000 7f4ff80d1640 1 -- 172.21.15.96:0/2875138140 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4fd40666c0 msgr2=0x7f4fd4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.750+0000 7f4ff80d1640 1 --2- 172.21.15.96:0/2875138140 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4fd40666c0 0x7f4fd4068b80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4fe80af000 tx=0x7f4fe8004ac0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.750+0000 7f4ff80d1640 1 -- 172.21.15.96:0/2875138140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ff0155380 msgr2=0x7f4ff00ca780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.750+0000 7f4ff80d1640 1 --2- 172.21.15.96:0/2875138140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ff0155380 0x7f4ff00ca780 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400c430 tx=0x7f4fe400c8f0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.750+0000 7f4ff80d1640 1 -- 172.21.15.96:0/2875138140 shutdown_connections 2024-04-18T04:55:09.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.750+0000 7f4ff80d1640 1 --2- 172.21.15.96:0/2875138140 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4fd40666c0 0x7f4fd4068b80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.750+0000 7f4ff80d1640 1 --2- 172.21.15.96:0/2875138140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ff00c77c0 0x7f4ff00c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.750+0000 7f4ff80d1640 1 --2- 172.21.15.96:0/2875138140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ff0155380 0x7f4ff00ca780 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.750+0000 7f4ff80d1640 1 --2- 172.21.15.96:0/2875138140 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4fdc003980 0x7f4ff006c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.750+0000 7f4ff80d1640 1 -- 172.21.15.96:0/2875138140 >> 172.21.15.96:0/2875138140 conn(0x7f4ff006a5c0 msgr2=0x7f4ff01583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:09.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.750+0000 7f4ff80d1640 1 -- 172.21.15.96:0/2875138140 shutdown_connections 2024-04-18T04:55:09.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.750+0000 7f4ff80d1640 1 -- 172.21.15.96:0/2875138140 wait complete. 2024-04-18T04:55:09.770 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:55:09.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.878+0000 7f6e0ec4a640 1 Processor -- start 2024-04-18T04:55:09.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.878+0000 7f6e0ec4a640 1 -- start start 2024-04-18T04:55:09.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e0ec4a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6e080c16e0 0x7f6e08157680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e0ec4a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6e080c20a0 0x7f6e080c2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e0ec4a640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e08157bc0 con 0x7f6e08150ef0 2024-04-18T04:55:09.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e0ec4a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e080c88e0 con 0x7f6e080c16e0 2024-04-18T04:55:09.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e0ec4a640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e080c70c0 con 0x7f6e080c20a0 2024-04-18T04:55:09.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e07fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6e080c16e0 0x7f6e08157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e07fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6e080c16e0 0x7f6e08157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37446/0 (socket says 172.21.15.96:37446) 2024-04-18T04:55:09.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e07fff640 1 -- 172.21.15.96:0/3430556851 learned_addr learned my addr 172.21.15.96:0/3430556851 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:09.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e0d1e7640 1 --2- 172.21.15.96:0/3430556851 >> v2:172.21.15.139:3300/0 conn(0x7f6e080c20a0 0x7f6e080c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e07fff640 1 -- 172.21.15.96:0/3430556851 >> v2:172.21.15.139:3300/0 conn(0x7f6e080c20a0 msgr2=0x7f6e080c2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:09.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e07fff640 1 --2- 172.21.15.96:0/3430556851 >> v2:172.21.15.139:3300/0 conn(0x7f6e080c20a0 0x7f6e080c2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e07fff640 1 -- 172.21.15.96:0/3430556851 >> v1:172.21.15.139:6789/0 conn(0x7f6e08150ef0 legacy=0x7f6e080c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:09.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e07fff640 1 -- 172.21.15.96:0/3430556851 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0815ab00 con 0x7f6e080c16e0 2024-04-18T04:55:09.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e07fff640 1 --2- 172.21.15.96:0/3430556851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e080c16e0 0x7f6e08157680 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6e08071e50 tx=0x7f6dfc01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84bfff6d1f36f038 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:09.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e077fe640 1 -- 172.21.15.96:0/3430556851 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc0a89d0 con 0x7f6e080c16e0 2024-04-18T04:55:09.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e077fe640 1 -- 172.21.15.96:0/3430556851 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dfc0a8b30 con 0x7f6e080c16e0 2024-04-18T04:55:09.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.882+0000 7f6e077fe640 1 -- 172.21.15.96:0/3430556851 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc0b0440 con 0x7f6e080c16e0 2024-04-18T04:55:09.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 -- 172.21.15.96:0/3430556851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e080c16e0 msgr2=0x7f6e08157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 --2- 172.21.15.96:0/3430556851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e080c16e0 0x7f6e08157680 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6e08071e50 tx=0x7f6dfc01ecd0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 -- 172.21.15.96:0/3430556851 shutdown_connections 2024-04-18T04:55:09.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 --2- 172.21.15.96:0/3430556851 >> v2:172.21.15.139:3300/0 conn(0x7f6e080c20a0 0x7f6e080c2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 --2- 172.21.15.96:0/3430556851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e080c16e0 0x7f6e08157680 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 -- 172.21.15.96:0/3430556851 >> 172.21.15.96:0/3430556851 conn(0x7f6e0806fc20 msgr2=0x7f6e08070030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:09.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 -- 172.21.15.96:0/3430556851 shutdown_connections 2024-04-18T04:55:09.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 -- 172.21.15.96:0/3430556851 wait complete. 2024-04-18T04:55:09.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 Processor -- start 2024-04-18T04:55:09.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 -- start start 2024-04-18T04:55:09.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e080c20a0 0x7f6e0806af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e08150ef0 0x7f6e080cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e081f1bb0 0x7f6e0814c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e081f2060 con 0x7f6e08150ef0 2024-04-18T04:55:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e080b25e0 con 0x7f6e080c20a0 2024-04-18T04:55:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e08146fd0 con 0x7f6e081f1bb0 2024-04-18T04:55:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e07fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e08150ef0 0x7f6e080cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e07fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e08150ef0 0x7f6e080cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37462/0 (socket says 172.21.15.96:37462) 2024-04-18T04:55:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e07fff640 1 -- 172.21.15.96:0/2570587227 learned_addr learned my addr 172.21.15.96:0/2570587227 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0d1e7640 1 --2- 172.21.15.96:0/2570587227 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e081f1bb0 0x7f6e0814c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e07fff640 1 -- 172.21.15.96:0/2570587227 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e081f1bb0 msgr2=0x7f6e0814c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e07fff640 1 --2- 172.21.15.96:0/2570587227 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e081f1bb0 0x7f6e0814c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e07fff640 1 -- 172.21.15.96:0/2570587227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e080c20a0 msgr2=0x7f6e0806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0c9e6640 1 --2- 172.21.15.96:0/2570587227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e080c20a0 0x7f6e0806af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e07fff640 1 --2- 172.21.15.96:0/2570587227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e080c20a0 0x7f6e0806af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e07fff640 1 -- 172.21.15.96:0/2570587227 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc0094d0 con 0x7f6e08150ef0 2024-04-18T04:55:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e07fff640 1 --2- 172.21.15.96:0/2570587227 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e08150ef0 0x7f6e080cc040 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc000c10 tx=0x7f6dfc01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e057fa640 1 -- 172.21.15.96:0/2570587227 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc0b1e90 con 0x7f6e08150ef0 2024-04-18T04:55:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e057fa640 1 -- 172.21.15.96:0/2570587227 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dfc0b9410 con 0x7f6e08150ef0 2024-04-18T04:55:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 -- 172.21.15.96:0/2570587227 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e080cbbb0 con 0x7f6e08150ef0 2024-04-18T04:55:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e057fa640 1 -- 172.21.15.96:0/2570587227 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc0b97c0 con 0x7f6e08150ef0 2024-04-18T04:55:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.886+0000 7f6e0ec4a640 1 -- 172.21.15.96:0/2570587227 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e080cb560 con 0x7f6e08150ef0 2024-04-18T04:55:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.890+0000 7f6e0ec4a640 1 -- 172.21.15.96:0/2570587227 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e080cbd40 con 0x7f6e08150ef0 2024-04-18T04:55:09.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.890+0000 7f6e057fa640 1 -- 172.21.15.96:0/2570587227 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6dfc0b7040 con 0x7f6e08150ef0 2024-04-18T04:55:09.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.890+0000 7f6e057fa640 1 --2- 172.21.15.96:0/2570587227 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6df4066690 0x7f6df4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:09.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.890+0000 7f6e057fa640 1 -- 172.21.15.96:0/2570587227 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6dfc121d40 con 0x7f6e08150ef0 2024-04-18T04:55:09.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.890+0000 7f6e0c9e6640 1 --2- 172.21.15.96:0/2570587227 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6df4066690 0x7f6df4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:09.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.890+0000 7f6e0c9e6640 1 --2- 172.21.15.96:0/2570587227 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6df4066690 0x7f6df4068b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6df800a790 tx=0x7f6df8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:09.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:09.894+0000 7f6e057fa640 1 -- 172.21.15.96:0/2570587227 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6dfc0ef020 con 0x7f6e08150ef0 2024-04-18T04:55:10.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.074+0000 7f6e0ec4a640 1 -- 172.21.15.96:0/2570587227 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e080cbd40 con 0x7f6e08150ef0 2024-04-18T04:55:10.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.074+0000 7f6e057fa640 1 -- 172.21.15.96:0/2570587227 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6313 (secure 0 0 0) 0x7f6dfc0b5090 con 0x7f6e08150ef0 2024-04-18T04:55:10.079 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:55:10.080 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/4225147900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":4225147900},{"type":"v1","addr":"172.21.15.96:6839","nonce":4225147900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:54:41.158866+0000","modified":"2024-04-18T04:55:09.695142+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4273,"mds_1":4249,"mds_2":4239,"mds_3":4232,"mds_4":4229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4229":{"gid":4229,"name":"d","rank":4,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.139:6836/2054604275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2054604275},{"type":"v1","addr":"172.21.15.139:6836","nonce":2054604275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4232":{"gid":4232,"name":"b","rank":3,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.139:6837/2105821790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":2105821790},{"type":"v1","addr":"172.21.15.139:6837","nonce":2105821790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4239":{"gid":4239,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.96:6835/1188672263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1188672263},{"type":"v1","addr":"172.21.15.96:6835","nonce":1188672263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4249":{"gid":4249,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.96:6837/4278976485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":4278976485},{"type":"v1","addr":"172.21.15.96:6837","nonce":4278976485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4273":{"gid":4273,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6833/3935291095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":3935291095},{"type":"v1","addr":"172.21.15.139:6833","nonce":3935291095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:55:10.080 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2024-04-18T04:55:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.078+0000 7f6e0ec4a640 1 -- 172.21.15.96:0/2570587227 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6df4066690 msgr2=0x7f6df4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.078+0000 7f6e0ec4a640 1 --2- 172.21.15.96:0/2570587227 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6df4066690 0x7f6df4068b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6df800a790 tx=0x7f6df8008040 comp rx=0 tx=0).stop 2024-04-18T04:55:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.078+0000 7f6e0ec4a640 1 -- 172.21.15.96:0/2570587227 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e08150ef0 msgr2=0x7f6e080cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.078+0000 7f6e0ec4a640 1 --2- 172.21.15.96:0/2570587227 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e08150ef0 0x7f6e080cc040 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc000c10 tx=0x7f6dfc01ba70 comp rx=0 tx=0).stop 2024-04-18T04:55:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.078+0000 7f6e0ec4a640 1 -- 172.21.15.96:0/2570587227 shutdown_connections 2024-04-18T04:55:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.078+0000 7f6e0ec4a640 1 --2- 172.21.15.96:0/2570587227 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6df4066690 0x7f6df4068b50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.078+0000 7f6e0ec4a640 1 --2- 172.21.15.96:0/2570587227 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e081f1bb0 0x7f6e0814c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.078+0000 7f6e0ec4a640 1 --2- 172.21.15.96:0/2570587227 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e08150ef0 0x7f6e080cc040 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.078+0000 7f6e0ec4a640 1 --2- 172.21.15.96:0/2570587227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e080c20a0 0x7f6e0806af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.078+0000 7f6e0ec4a640 1 -- 172.21.15.96:0/2570587227 >> 172.21.15.96:0/2570587227 conn(0x7f6e0806fc20 msgr2=0x7f6e0814ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:10.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.078+0000 7f6e0ec4a640 1 -- 172.21.15.96:0/2570587227 shutdown_connections 2024-04-18T04:55:10.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.078+0000 7f6e0ec4a640 1 -- 172.21.15.96:0/2570587227 wait complete. 2024-04-18T04:55:10.097 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:55:10.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.198+0000 7f7e5f96f640 1 Processor -- start 2024-04-18T04:55:10.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.198+0000 7f7e5f96f640 1 -- start start 2024-04-18T04:55:10.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e5f96f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e58151210 0x7f7e580c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e5f96f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7e580c1db0 0x7f7e580ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e5f96f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e58157150 con 0x7f7e580ca840 2024-04-18T04:55:10.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e5f96f640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e58157430 con 0x7f7e580c1db0 2024-04-18T04:55:10.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e5f96f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e58157710 con 0x7f7e58151210 2024-04-18T04:55:10.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e5df0c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f7e580ca840 0x7f7e5815a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36076/0 (socket says 172.21.15.96:36076) 2024-04-18T04:55:10.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e5df0c640 1 -- 172.21.15.96:0/3297683865 learned_addr learned my addr 172.21.15.96:0/3297683865 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:10.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e5cf0a640 1 --2- 172.21.15.96:0/3297683865 >> v2:172.21.15.139:3300/0 conn(0x7f7e580c1db0 0x7f7e580ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:10.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e4ffff640 1 -- 172.21.15.96:0/3297683865 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890186654 0 0) 0x7f7e58157150 con 0x7f7e580ca840 2024-04-18T04:55:10.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e5d70b640 1 --2- 172.21.15.96:0/3297683865 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e58151210 0x7f7e580c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:10.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e4ffff640 1 -- 172.21.15.96:0/3297683865 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e44003530 con 0x7f7e580ca840 2024-04-18T04:55:10.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e4ffff640 1 -- 172.21.15.96:0/3297683865 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3412023963 0 0) 0x7f7e44003530 con 0x7f7e580ca840 2024-04-18T04:55:10.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e4ffff640 1 -- 172.21.15.96:0/3297683865 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e58151210 msgr2=0x7f7e580c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:10.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e4ffff640 1 --2- 172.21.15.96:0/3297683865 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e58151210 0x7f7e580c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e4ffff640 1 -- 172.21.15.96:0/3297683865 >> v2:172.21.15.139:3300/0 conn(0x7f7e580c1db0 msgr2=0x7f7e580ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:10.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e4ffff640 1 --2- 172.21.15.96:0/3297683865 >> v2:172.21.15.139:3300/0 conn(0x7f7e580c1db0 0x7f7e580ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e4ffff640 1 -- 172.21.15.96:0/3297683865 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e581579f0 con 0x7f7e580ca840 2024-04-18T04:55:10.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e4ffff640 1 -- 172.21.15.96:0/3297683865 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f7e50001a00 con 0x7f7e580ca840 2024-04-18T04:55:10.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e4ffff640 1 -- 172.21.15.96:0/3297683865 >> v1:172.21.15.96:6789/0 conn(0x7f7e580ca840 legacy=0x7f7e5815a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:10.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e4ffff640 1 --2- 172.21.15.96:0/3297683865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e44003980 0x7f7e44003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e4ffff640 1 --2- 172.21.15.96:0/3297683865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e440047d0 0x7f7e44004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e4ffff640 1 --2- 172.21.15.96:0/3297683865 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e58151210 0x7f7e44005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e4ffff640 1 -- 172.21.15.96:0/3297683865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e58157430 con 0x7f7e44003980 2024-04-18T04:55:10.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e4ffff640 1 -- 172.21.15.96:0/3297683865 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e58157710 con 0x7f7e440047d0 2024-04-18T04:55:10.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e4ffff640 1 -- 172.21.15.96:0/3297683865 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4400ba70 con 0x7f7e58151210 2024-04-18T04:55:10.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e5d70b640 1 --2- 172.21.15.96:0/3297683865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e44003980 0x7f7e44003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:10.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e5df0c640 1 --2- 172.21.15.96:0/3297683865 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e58151210 0x7f7e44005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:10.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e5d70b640 1 -- 172.21.15.96:0/3297683865 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e58151210 msgr2=0x7f7e44005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:10.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e5d70b640 1 --2- 172.21.15.96:0/3297683865 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e58151210 0x7f7e44005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e5d70b640 1 -- 172.21.15.96:0/3297683865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e440047d0 msgr2=0x7f7e44004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:10.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e5d70b640 1 --2- 172.21.15.96:0/3297683865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e440047d0 0x7f7e44004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.202+0000 7f7e5d70b640 1 -- 172.21.15.96:0/3297683865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e44003530 con 0x7f7e44003980 2024-04-18T04:55:10.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5d70b640 1 --2- 172.21.15.96:0/3297683865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e44003980 0x7f7e44003da0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400ba30 tx=0x7f7e5401c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da55f8851b09978a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:10.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e4ffff640 1 -- 172.21.15.96:0/3297683865 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e540ac670 con 0x7f7e44003980 2024-04-18T04:55:10.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e4ffff640 1 -- 172.21.15.96:0/3297683865 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e540ac7d0 con 0x7f7e44003980 2024-04-18T04:55:10.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e4ffff640 1 -- 172.21.15.96:0/3297683865 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e540acb80 con 0x7f7e44003980 2024-04-18T04:55:10.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5f96f640 1 -- 172.21.15.96:0/3297683865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e44003980 msgr2=0x7f7e44003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:10.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5f96f640 1 --2- 172.21.15.96:0/3297683865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e44003980 0x7f7e44003da0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400ba30 tx=0x7f7e5401c6a0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5df0c640 1 -- 172.21.15.96:0/3297683865 reap_dead start 2024-04-18T04:55:10.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5f96f640 1 -- 172.21.15.96:0/3297683865 shutdown_connections 2024-04-18T04:55:10.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5f96f640 1 -- 172.21.15.96:0/3297683865 >> 172.21.15.96:0/3297683865 conn(0x7f7e5806c750 msgr2=0x7f7e580c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:10.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5f96f640 1 -- 172.21.15.96:0/3297683865 shutdown_connections 2024-04-18T04:55:10.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5f96f640 1 -- 172.21.15.96:0/3297683865 wait complete. 2024-04-18T04:55:10.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5f96f640 1 Processor -- start 2024-04-18T04:55:10.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5f96f640 1 -- start start 2024-04-18T04:55:10.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5f96f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e44003980 0x7f7e581516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5f96f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e5814b4a0 0x7f7e5814d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5f96f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e581f0580 0x7f7e58153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5f96f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5814db50 con 0x7f7e44003980 2024-04-18T04:55:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5f96f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5814ba00 con 0x7f7e5814b4a0 2024-04-18T04:55:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5f96f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5814bce0 con 0x7f7e581f0580 2024-04-18T04:55:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5d70b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e44003980 0x7f7e581516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5d70b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e44003980 0x7f7e581516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37476/0 (socket says 172.21.15.96:37476) 2024-04-18T04:55:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5d70b640 1 -- 172.21.15.96:0/453431087 learned_addr learned my addr 172.21.15.96:0/453431087 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5cf0a640 1 --2- 172.21.15.96:0/453431087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e5814b4a0 0x7f7e5814d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5df0c640 1 --2- 172.21.15.96:0/453431087 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e581f0580 0x7f7e58153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5d70b640 1 -- 172.21.15.96:0/453431087 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e581f0580 msgr2=0x7f7e58153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5d70b640 1 --2- 172.21.15.96:0/453431087 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e581f0580 0x7f7e58153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5d70b640 1 -- 172.21.15.96:0/453431087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e5814b4a0 msgr2=0x7f7e5814d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5d70b640 1 --2- 172.21.15.96:0/453431087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e5814b4a0 0x7f7e5814d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5d70b640 1 -- 172.21.15.96:0/453431087 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e58156f20 con 0x7f7e44003980 2024-04-18T04:55:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5d70b640 1 --2- 172.21.15.96:0/453431087 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e44003980 0x7f7e581516b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7e540ae040 tx=0x7f7e44005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:10.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e4dffb640 1 -- 172.21.15.96:0/453431087 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e540acd50 con 0x7f7e44003980 2024-04-18T04:55:10.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e4dffb640 1 -- 172.21.15.96:0/453431087 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e540b9070 con 0x7f7e44003980 2024-04-18T04:55:10.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e4dffb640 1 -- 172.21.15.96:0/453431087 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e54004240 con 0x7f7e44003980 2024-04-18T04:55:10.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5f96f640 1 -- 172.21.15.96:0/453431087 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5814bfc0 con 0x7f7e44003980 2024-04-18T04:55:10.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.206+0000 7f7e5f96f640 1 -- 172.21.15.96:0/453431087 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5814cbe0 con 0x7f7e44003980 2024-04-18T04:55:10.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.210+0000 7f7e5f96f640 1 -- 172.21.15.96:0/453431087 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e58067050 con 0x7f7e44003980 2024-04-18T04:55:10.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.210+0000 7f7e4dffb640 1 -- 172.21.15.96:0/453431087 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7e540043a0 con 0x7f7e44003980 2024-04-18T04:55:10.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.210+0000 7f7e4dffb640 1 --2- 172.21.15.96:0/453431087 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7e3c0666c0 0x7f7e3c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.210+0000 7f7e4dffb640 1 -- 172.21.15.96:0/453431087 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e540a6040 con 0x7f7e44003980 2024-04-18T04:55:10.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.210+0000 7f7e5cf0a640 1 --2- 172.21.15.96:0/453431087 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7e3c0666c0 0x7f7e3c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:10.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.210+0000 7f7e5cf0a640 1 --2- 172.21.15.96:0/453431087 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7e3c0666c0 0x7f7e3c068b80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7e58156530 tx=0x7f7e48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:10.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.214+0000 7f7e4dffb640 1 -- 172.21.15.96:0/453431087 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f7e540eb700 con 0x7f7e44003980 2024-04-18T04:55:10.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.362+0000 7f7e5f96f640 1 -- 172.21.15.96:0/453431087 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e58154770 con 0x7f7e44003980 2024-04-18T04:55:10.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.362+0000 7f7e4dffb640 1 -- 172.21.15.96:0/453431087 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f7e540bb090 con 0x7f7e44003980 2024-04-18T04:55:10.366 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:55:10.366 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":21,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:54:42.161552+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:54:39.219441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:54:40.139557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.720340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.767224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.811511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.710188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.860525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.704784+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:55:10.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.366+0000 7f7e5f96f640 1 -- 172.21.15.96:0/453431087 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7e3c0666c0 msgr2=0x7f7e3c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:10.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.366+0000 7f7e5f96f640 1 --2- 172.21.15.96:0/453431087 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7e3c0666c0 0x7f7e3c068b80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7e58156530 tx=0x7f7e48008040 comp rx=0 tx=0).stop 2024-04-18T04:55:10.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.366+0000 7f7e5f96f640 1 -- 172.21.15.96:0/453431087 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e44003980 msgr2=0x7f7e581516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:10.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.366+0000 7f7e5f96f640 1 --2- 172.21.15.96:0/453431087 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e44003980 0x7f7e581516b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7e540ae040 tx=0x7f7e44005800 comp rx=0 tx=0).stop 2024-04-18T04:55:10.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.366+0000 7f7e5f96f640 1 -- 172.21.15.96:0/453431087 shutdown_connections 2024-04-18T04:55:10.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.366+0000 7f7e5f96f640 1 --2- 172.21.15.96:0/453431087 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7e3c0666c0 0x7f7e3c068b80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.366+0000 7f7e5f96f640 1 --2- 172.21.15.96:0/453431087 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e581f0580 0x7f7e58153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.366+0000 7f7e5f96f640 1 --2- 172.21.15.96:0/453431087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e5814b4a0 0x7f7e5814d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.366+0000 7f7e5f96f640 1 --2- 172.21.15.96:0/453431087 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e44003980 0x7f7e581516b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.366+0000 7f7e5f96f640 1 -- 172.21.15.96:0/453431087 >> 172.21.15.96:0/453431087 conn(0x7f7e5806c750 msgr2=0x7f7e58155b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:10.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.366+0000 7f7e5f96f640 1 -- 172.21.15.96:0/453431087 shutdown_connections 2024-04-18T04:55:10.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.366+0000 7f7e5f96f640 1 -- 172.21.15.96:0/453431087 wait complete. 2024-04-18T04:55:10.383 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:55:10.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.494+0000 7fbd0007a640 1 Processor -- start 2024-04-18T04:55:10.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.494+0000 7fbd0007a640 1 -- start start 2024-04-18T04:55:10.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbd0007a640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbcf81532d0 0x7fbcf8158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbd0007a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf81536b0 con 0x7fbcf80c3fd0 2024-04-18T04:55:10.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbd0007a640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf8159680 con 0x7fbcf80cacc0 2024-04-18T04:55:10.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbd0007a640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80c5970 con 0x7fbcf81532d0 2024-04-18T04:55:10.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfe617640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fbcf80c3fd0 0x7fbcf80ce740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36082/0 (socket says 172.21.15.96:36082) 2024-04-18T04:55:10.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfe617640 1 -- 172.21.15.96:0/530929869 learned_addr learned my addr 172.21.15.96:0/530929869 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:10.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfde16640 1 --2- 172.21.15.96:0/530929869 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbcf81532d0 0x7fbcf8158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:10.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfce14640 1 -- 172.21.15.96:0/530929869 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915351822 0 0) 0x7fbcf81536b0 con 0x7fbcf80c3fd0 2024-04-18T04:55:10.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfce14640 1 -- 172.21.15.96:0/530929869 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbce4003530 con 0x7fbcf80c3fd0 2024-04-18T04:55:10.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfce14640 1 -- 172.21.15.96:0/530929869 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 42247242 0 0) 0x7fbce4003530 con 0x7fbcf80c3fd0 2024-04-18T04:55:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfce14640 1 -- 172.21.15.96:0/530929869 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbcf81532d0 msgr2=0x7fbcf8158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfce14640 1 --2- 172.21.15.96:0/530929869 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbcf81532d0 0x7fbcf8158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfce14640 1 -- 172.21.15.96:0/530929869 >> v1:172.21.15.139:6789/0 conn(0x7fbcf80cacc0 legacy=0x7fbcf815ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfce14640 1 -- 172.21.15.96:0/530929869 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf8159960 con 0x7fbcf80c3fd0 2024-04-18T04:55:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfce14640 1 -- 172.21.15.96:0/530929869 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fbcf0001a00 con 0x7fbcf80c3fd0 2024-04-18T04:55:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfce14640 1 -- 172.21.15.96:0/530929869 >> v1:172.21.15.96:6789/0 conn(0x7fbcf80c3fd0 legacy=0x7fbcf80ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfce14640 1 --2- 172.21.15.96:0/530929869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbce40039b0 0x7fbce4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfce14640 1 --2- 172.21.15.96:0/530929869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbce40047d0 0x7fbce4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfce14640 1 --2- 172.21.15.96:0/530929869 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbcf81532d0 0x7fbce4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfce14640 1 -- 172.21.15.96:0/530929869 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80c5970 con 0x7fbce40047d0 2024-04-18T04:55:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfce14640 1 -- 172.21.15.96:0/530929869 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce400bad0 con 0x7fbce40039b0 2024-04-18T04:55:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfce14640 1 -- 172.21.15.96:0/530929869 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce400bc90 con 0x7fbcf81532d0 2024-04-18T04:55:10.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfd615640 1 --2- 172.21.15.96:0/530929869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbce40047d0 0x7fbce4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:10.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfde16640 1 --2- 172.21.15.96:0/530929869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbce40039b0 0x7fbce4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:10.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfd615640 1 -- 172.21.15.96:0/530929869 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbcf81532d0 msgr2=0x7fbce4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:10.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfd615640 1 --2- 172.21.15.96:0/530929869 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbcf81532d0 0x7fbce4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfd615640 1 -- 172.21.15.96:0/530929869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbce40039b0 msgr2=0x7fbce4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:10.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfd615640 1 --2- 172.21.15.96:0/530929869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbce40039b0 0x7fbce4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfd615640 1 -- 172.21.15.96:0/530929869 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce4003530 con 0x7fbce40047d0 2024-04-18T04:55:10.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.498+0000 7fbcfde16640 1 --2- 172.21.15.96:0/530929869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbce40039b0 0x7fbce4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:10.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcfd615640 1 --2- 172.21.15.96:0/530929869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbce40047d0 0x7fbce4004c50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80cb0c0 tx=0x7fbce801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f4b6e93c5976eb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:10.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcfce14640 1 -- 172.21.15.96:0/530929869 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce80052d0 con 0x7fbce40047d0 2024-04-18T04:55:10.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcfce14640 1 -- 172.21.15.96:0/530929869 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce80a7050 con 0x7fbce40047d0 2024-04-18T04:55:10.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcfce14640 1 -- 172.21.15.96:0/530929869 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8003600 con 0x7fbce40047d0 2024-04-18T04:55:10.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbd0007a640 1 -- 172.21.15.96:0/530929869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbce40047d0 msgr2=0x7fbce4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:10.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbd0007a640 1 --2- 172.21.15.96:0/530929869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbce40047d0 0x7fbce4004c50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80cb0c0 tx=0x7fbce801c3a0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcfe617640 1 -- 172.21.15.96:0/530929869 reap_dead start 2024-04-18T04:55:10.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbd0007a640 1 -- 172.21.15.96:0/530929869 shutdown_connections 2024-04-18T04:55:10.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbd0007a640 1 -- 172.21.15.96:0/530929869 >> 172.21.15.96:0/530929869 conn(0x7fbcf8071760 msgr2=0x7fbcf806b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:10.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbd0007a640 1 -- 172.21.15.96:0/530929869 shutdown_connections 2024-04-18T04:55:10.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbd0007a640 1 -- 172.21.15.96:0/530929869 wait complete. 2024-04-18T04:55:10.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbd0007a640 1 Processor -- start 2024-04-18T04:55:10.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbd0007a640 1 -- start start 2024-04-18T04:55:10.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbd0007a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbce40047d0 0x7fbcf80b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbd0007a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcf8154cd0 0x7fbcf81efde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbd0007a640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbcf81f0320 0x7fbcf81483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbd0007a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf81594a0 con 0x7fbcf8154cd0 2024-04-18T04:55:10.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbd0007a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf8159f20 con 0x7fbce40047d0 2024-04-18T04:55:10.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbd0007a640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf81f07a0 con 0x7fbcf81f0320 2024-04-18T04:55:10.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcfd615640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcf8154cd0 0x7fbcf81efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:10.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcfd615640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcf8154cd0 0x7fbcf81efde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37490/0 (socket says 172.21.15.96:37490) 2024-04-18T04:55:10.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcfd615640 1 -- 172.21.15.96:0/4092765810 learned_addr learned my addr 172.21.15.96:0/4092765810 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:10.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcfe617640 1 --2- 172.21.15.96:0/4092765810 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbcf81f0320 0x7fbcf81483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:10.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcfd615640 1 -- 172.21.15.96:0/4092765810 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbcf81f0320 msgr2=0x7fbcf81483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:10.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcfde16640 1 --2- 172.21.15.96:0/4092765810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbce40047d0 0x7fbcf80b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:10.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcfd615640 1 --2- 172.21.15.96:0/4092765810 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbcf81f0320 0x7fbcf81483a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcfd615640 1 -- 172.21.15.96:0/4092765810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbce40047d0 msgr2=0x7fbcf80b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:10.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcfd615640 1 --2- 172.21.15.96:0/4092765810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbce40047d0 0x7fbcf80b41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcfd615640 1 -- 172.21.15.96:0/4092765810 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf8155d20 con 0x7fbcf8154cd0 2024-04-18T04:55:10.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcfd615640 1 --2- 172.21.15.96:0/4092765810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcf8154cd0 0x7fbcf81efde0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbce8097db0 tx=0x7fbce4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:10.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.502+0000 7fbcee7fc640 1 -- 172.21.15.96:0/4092765810 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8007a40 con 0x7fbcf8154cd0 2024-04-18T04:55:10.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.506+0000 7fbcee7fc640 1 -- 172.21.15.96:0/4092765810 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce8000ee0 con 0x7fbcf8154cd0 2024-04-18T04:55:10.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.506+0000 7fbd0007a640 1 -- 172.21.15.96:0/4092765810 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf8155fc0 con 0x7fbcf8154cd0 2024-04-18T04:55:10.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.506+0000 7fbcee7fc640 1 -- 172.21.15.96:0/4092765810 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8006a20 con 0x7fbcf8154cd0 2024-04-18T04:55:10.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.506+0000 7fbd0007a640 1 -- 172.21.15.96:0/4092765810 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf8156540 con 0x7fbcf8154cd0 2024-04-18T04:55:10.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.506+0000 7fbd0007a640 1 -- 172.21.15.96:0/4092765810 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf8067050 con 0x7fbcf8154cd0 2024-04-18T04:55:10.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.506+0000 7fbcee7fc640 1 -- 172.21.15.96:0/4092765810 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbce8006b80 con 0x7fbcf8154cd0 2024-04-18T04:55:10.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.506+0000 7fbcee7fc640 1 --2- 172.21.15.96:0/4092765810 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbcdc066690 0x7fbcdc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:10.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.506+0000 7fbcee7fc640 1 -- 172.21.15.96:0/4092765810 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbce811e7c0 con 0x7fbcf8154cd0 2024-04-18T04:55:10.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.506+0000 7fbcfde16640 1 --2- 172.21.15.96:0/4092765810 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbcdc066690 0x7fbcdc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:10.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.506+0000 7fbcfde16640 1 --2- 172.21.15.96:0/4092765810 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbcdc066690 0x7fbcdc068b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40099e0 tx=0x7fbcf4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:10.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.510+0000 7fbcee7fc640 1 -- 172.21.15.96:0/4092765810 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fbce80ef710 con 0x7fbcf8154cd0 2024-04-18T04:55:10.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.698+0000 7fbd0007a640 1 -- 172.21.15.96:0/4092765810 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbcf80ca290 con 0x7fbcf8154cd0 2024-04-18T04:55:10.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.698+0000 7fbcee7fc640 1 -- 172.21.15.96:0/4092765810 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6313 (secure 0 0 0) 0x7fbce80ef2a0 con 0x7fbcf8154cd0 2024-04-18T04:55:10.703 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:55:10.704 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/4225147900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":4225147900},{"type":"v1","addr":"172.21.15.96:6839","nonce":4225147900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:54:41.158866+0000","modified":"2024-04-18T04:55:09.695142+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4273,"mds_1":4249,"mds_2":4239,"mds_3":4232,"mds_4":4229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4229":{"gid":4229,"name":"d","rank":4,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.139:6836/2054604275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2054604275},{"type":"v1","addr":"172.21.15.139:6836","nonce":2054604275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4232":{"gid":4232,"name":"b","rank":3,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.139:6837/2105821790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":2105821790},{"type":"v1","addr":"172.21.15.139:6837","nonce":2105821790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4239":{"gid":4239,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.96:6835/1188672263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1188672263},{"type":"v1","addr":"172.21.15.96:6835","nonce":1188672263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4249":{"gid":4249,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.96:6837/4278976485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":4278976485},{"type":"v1","addr":"172.21.15.96:6837","nonce":4278976485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4273":{"gid":4273,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6833/3935291095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":3935291095},{"type":"v1","addr":"172.21.15.139:6833","nonce":3935291095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:55:10.704 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2024-04-18T04:55:10.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.702+0000 7fbd0007a640 1 -- 172.21.15.96:0/4092765810 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbcdc066690 msgr2=0x7fbcdc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:10.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.702+0000 7fbd0007a640 1 --2- 172.21.15.96:0/4092765810 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbcdc066690 0x7fbcdc068b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40099e0 tx=0x7fbcf4008040 comp rx=0 tx=0).stop 2024-04-18T04:55:10.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.702+0000 7fbd0007a640 1 -- 172.21.15.96:0/4092765810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcf8154cd0 msgr2=0x7fbcf81efde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:10.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.702+0000 7fbd0007a640 1 --2- 172.21.15.96:0/4092765810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcf8154cd0 0x7fbcf81efde0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbce8097db0 tx=0x7fbce4005800 comp rx=0 tx=0).stop 2024-04-18T04:55:10.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.702+0000 7fbd0007a640 1 -- 172.21.15.96:0/4092765810 shutdown_connections 2024-04-18T04:55:10.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.702+0000 7fbd0007a640 1 --2- 172.21.15.96:0/4092765810 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbcdc066690 0x7fbcdc068b50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.702+0000 7fbd0007a640 1 --2- 172.21.15.96:0/4092765810 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbcf81f0320 0x7fbcf81483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.702+0000 7fbd0007a640 1 --2- 172.21.15.96:0/4092765810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcf8154cd0 0x7fbcf81efde0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.702+0000 7fbd0007a640 1 --2- 172.21.15.96:0/4092765810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbce40047d0 0x7fbcf80b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:10.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.702+0000 7fbd0007a640 1 -- 172.21.15.96:0/4092765810 >> 172.21.15.96:0/4092765810 conn(0x7fbcf8071760 msgr2=0x7fbcf81521d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:10.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.702+0000 7fbd0007a640 1 -- 172.21.15.96:0/4092765810 shutdown_connections 2024-04-18T04:55:10.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:10.702+0000 7fbd0007a640 1 -- 172.21.15.96:0/4092765810 wait complete. 2024-04-18T04:55:10.756 INFO:tasks.ceph.mds.f.smithi139.stderr:2024-04-18T04:55:10.753+0000 7f98ab761640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-04-18T04:55:11.328 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T04:54:41.158866+0000', 'modified': '2024-04-18T04:55:09.695142+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4273, 'mds_1': 4249, 'mds_2': 4239, 'mds_3': 4232, 'mds_4': 4229}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4229': {'gid': 4229, 'name': 'd', 'rank': 4, 'incarnation': 16, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.139:6836/2054604275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6834', 'nonce': 2054604275}, {'type': 'v1', 'addr': '172.21.15.139:6836', 'nonce': 2054604275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4232': {'gid': 4232, 'name': 'b', 'rank': 3, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.139:6837/2105821790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6835', 'nonce': 2105821790}, {'type': 'v1', 'addr': '172.21.15.139:6837', 'nonce': 2105821790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4239': {'gid': 4239, 'name': 'e', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.96:6835/1188672263', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6834', 'nonce': 1188672263}, {'type': 'v1', 'addr': '172.21.15.96:6835', 'nonce': 1188672263}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4249': {'gid': 4249, 'name': 'a', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.96:6837/4278976485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6836', 'nonce': 4278976485}, {'type': 'v1', 'addr': '172.21.15.96:6837', 'nonce': 4278976485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4273': {'gid': 4273, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.139:6833/3935291095', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6832', 'nonce': 3935291095}, {'type': 'v1', 'addr': '172.21.15.139:6833', 'nonce': 3935291095}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-18T04:55:11.328 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-18T04:55:11.328 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-18T04:55:11.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.458+0000 7fb856525640 1 Processor -- start 2024-04-18T04:55:11.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.458+0000 7fb856525640 1 -- start start 2024-04-18T04:55:11.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.458+0000 7fb856525640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb8500c6830 0x7fb8501562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:11.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.458+0000 7fb856525640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb850071160 0x7fb850156800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:11.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.458+0000 7fb856525640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85006bbd0 con 0x7fb8500c6450 2024-04-18T04:55:11.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.458+0000 7fb856525640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85006c6f0 con 0x7fb8500c6830 2024-04-18T04:55:11.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.458+0000 7fb856525640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85006b9e0 con 0x7fb850071160 2024-04-18T04:55:11.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.458+0000 7fb84f7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb8500c6830 0x7fb8501562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:11.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.458+0000 7fb84f7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb8500c6830 0x7fb8501562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37502/0 (socket says 172.21.15.96:37502) 2024-04-18T04:55:11.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.458+0000 7fb84f7fe640 1 -- 172.21.15.96:0/2388556875 learned_addr learned my addr 172.21.15.96:0/2388556875 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:11.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.458+0000 7fb854ac2640 1 --2- 172.21.15.96:0/2388556875 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb850071160 0x7fb850156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:11.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.458+0000 7fb84f7fe640 1 -- 172.21.15.96:0/2388556875 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb850071160 msgr2=0x7fb850156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:11.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.458+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/2388556875 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb850071160 0x7fb850156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:11.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.458+0000 7fb84f7fe640 1 -- 172.21.15.96:0/2388556875 >> v1:172.21.15.139:6789/0 conn(0x7fb8500c6450 legacy=0x7fb8500c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:11.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.458+0000 7fb84f7fe640 1 -- 172.21.15.96:0/2388556875 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85006be70 con 0x7fb8500c6830 2024-04-18T04:55:11.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/2388556875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8500c6830 0x7fb8501562c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb8380098a0 tx=0x7fb83801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ba7805d35332ae server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:11.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb84effd640 1 -- 172.21.15.96:0/2388556875 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380ac630 con 0x7fb8500c6830 2024-04-18T04:55:11.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb84effd640 1 -- 172.21.15.96:0/2388556875 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8380ac790 con 0x7fb8500c6830 2024-04-18T04:55:11.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb84effd640 1 -- 172.21.15.96:0/2388556875 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380acb20 con 0x7fb8500c6830 2024-04-18T04:55:11.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb856525640 1 -- 172.21.15.96:0/2388556875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8500c6830 msgr2=0x7fb8501562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:11.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb856525640 1 --2- 172.21.15.96:0/2388556875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8500c6830 0x7fb8501562c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb8380098a0 tx=0x7fb83801c500 comp rx=0 tx=0).stop 2024-04-18T04:55:11.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb856525640 1 -- 172.21.15.96:0/2388556875 shutdown_connections 2024-04-18T04:55:11.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb856525640 1 --2- 172.21.15.96:0/2388556875 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb850071160 0x7fb850156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:11.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb856525640 1 --2- 172.21.15.96:0/2388556875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8500c6830 0x7fb8501562c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:11.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb856525640 1 -- 172.21.15.96:0/2388556875 >> 172.21.15.96:0/2388556875 conn(0x7fb85006a8e0 msgr2=0x7fb8500c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:11.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb856525640 1 -- 172.21.15.96:0/2388556875 shutdown_connections 2024-04-18T04:55:11.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb856525640 1 -- 172.21.15.96:0/2388556875 wait complete. 2024-04-18T04:55:11.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb856525640 1 Processor -- start 2024-04-18T04:55:11.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb856525640 1 -- start start 2024-04-18T04:55:11.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb856525640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb850071160 0x7fb8501f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:11.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb856525640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8500c6450 0x7fb8500c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:11.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb856525640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8500c6830 0x7fb8500c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:11.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb856525640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb850151400 con 0x7fb850071160 2024-04-18T04:55:11.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb856525640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb850137d50 con 0x7fb8500c6830 2024-04-18T04:55:11.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb856525640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb850152880 con 0x7fb8500c6450 2024-04-18T04:55:11.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb84ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb850071160 0x7fb8501f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:11.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb84ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb850071160 0x7fb8501f35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37510/0 (socket says 172.21.15.96:37510) 2024-04-18T04:55:11.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.462+0000 7fb84ffff640 1 -- 172.21.15.96:0/3348965291 learned_addr learned my addr 172.21.15.96:0/3348965291 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:11.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb854ac2640 1 --2- 172.21.15.96:0/3348965291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8500c6830 0x7fb8500c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:11.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/3348965291 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8500c6450 0x7fb8500c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:11.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb84ffff640 1 -- 172.21.15.96:0/3348965291 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8500c6450 msgr2=0x7fb8500c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:11.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb84ffff640 1 --2- 172.21.15.96:0/3348965291 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8500c6450 0x7fb8500c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:11.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb84ffff640 1 -- 172.21.15.96:0/3348965291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8500c6830 msgr2=0x7fb8500c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:11.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb84ffff640 1 --2- 172.21.15.96:0/3348965291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8500c6830 0x7fb8500c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:11.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb84ffff640 1 -- 172.21.15.96:0/3348965291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8380094d0 con 0x7fb850071160 2024-04-18T04:55:11.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/3348965291 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8500c6450 0x7fb8500c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:11.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb854ac2640 1 --2- 172.21.15.96:0/3348965291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8500c6830 0x7fb8500c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:11.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb84ffff640 1 --2- 172.21.15.96:0/3348965291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb850071160 0x7fb8501f35e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb84000c450 tx=0x7fb84000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:11.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb84cff9640 1 -- 172.21.15.96:0/3348965291 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840012830 con 0x7fb850071160 2024-04-18T04:55:11.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb84cff9640 1 -- 172.21.15.96:0/3348965291 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8400129b0 con 0x7fb850071160 2024-04-18T04:55:11.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb856525640 1 -- 172.21.15.96:0/3348965291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8500c2090 con 0x7fb850071160 2024-04-18T04:55:11.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb84cff9640 1 -- 172.21.15.96:0/3348965291 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840012d60 con 0x7fb850071160 2024-04-18T04:55:11.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb856525640 1 -- 172.21.15.96:0/3348965291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb850152e20 con 0x7fb850071160 2024-04-18T04:55:11.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb84cff9640 1 -- 172.21.15.96:0/3348965291 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb84001c460 con 0x7fb850071160 2024-04-18T04:55:11.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb84cff9640 1 --2- 172.21.15.96:0/3348965291 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb830066690 0x7fb830068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:11.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb84cff9640 1 -- 172.21.15.96:0/3348965291 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb840083f40 con 0x7fb850071160 2024-04-18T04:55:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/3348965291 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb830066690 0x7fb830068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/3348965291 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb830066690 0x7fb830068b50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8380ae000 tx=0x7fb838008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb859667000 1 Processor -- start 2024-04-18T04:55:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.466+0000 7fb859667000 1 -- start start 2024-04-18T04:55:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe3f6af0 0x55b5fe3c0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6ed0 0x55b5fe3c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3fab30 0x55b5fe3faf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe282e80 con 0x55b5fe3f6ed0 2024-04-18T04:55:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe210af0 con 0x55b5fe3fab30 2024-04-18T04:55:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe20e0c0 con 0x55b5fe3f6af0 2024-04-18T04:55:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6ed0 0x55b5fe3c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6ed0 0x55b5fe3c0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37514/0 (socket says 172.21.15.96:37514) 2024-04-18T04:55:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 -- 172.21.15.96:0/2625101092 learned_addr learned my addr 172.21.15.96:0/2625101092 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84ffff640 1 --2- 172.21.15.96:0/2625101092 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe3f6af0 0x55b5fe3c0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 -- 172.21.15.96:0/2625101092 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe3f6af0 msgr2=0x55b5fe3c0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/2625101092 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe3f6af0 0x55b5fe3c0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 -- 172.21.15.96:0/2625101092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3fab30 msgr2=0x55b5fe3faf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/2625101092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3fab30 0x55b5fe3faf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 -- 172.21.15.96:0/2625101092 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5fdf05890 con 0x55b5fe3f6ed0 2024-04-18T04:55:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/2625101092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6ed0 0x55b5fe3c0c40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb83801ca70 tx=0x7fb838004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ad31f784a71e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb845ffb640 1 -- 172.21.15.96:0/2625101092 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380b5ad0 con 0x55b5fe3f6ed0 2024-04-18T04:55:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb845ffb640 1 -- 172.21.15.96:0/2625101092 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8380bc040 con 0x55b5fe3f6ed0 2024-04-18T04:55:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb845ffb640 1 -- 172.21.15.96:0/2625101092 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380b5e50 con 0x55b5fe3f6ed0 2024-04-18T04:55:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 -- 172.21.15.96:0/2625101092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6ed0 msgr2=0x55b5fe3c0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 --2- 172.21.15.96:0/2625101092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6ed0 0x55b5fe3c0c40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb83801ca70 tx=0x7fb838004740 comp rx=0 tx=0).stop 2024-04-18T04:55:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 -- 172.21.15.96:0/2625101092 shutdown_connections 2024-04-18T04:55:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 --2- 172.21.15.96:0/2625101092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3fab30 0x55b5fe3faf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 --2- 172.21.15.96:0/2625101092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6ed0 0x55b5fe3c0c40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 --2- 172.21.15.96:0/2625101092 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe3f6af0 0x55b5fe3c0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 -- 172.21.15.96:0/2625101092 >> 172.21.15.96:0/2625101092 conn(0x55b5fe3c1190 msgr2=0x55b5fe3c1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 -- 172.21.15.96:0/2625101092 shutdown_connections 2024-04-18T04:55:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 -- 172.21.15.96:0/2625101092 wait complete. 2024-04-18T04:55:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 -- start start 2024-04-18T04:55:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 Processor -- start 2024-04-18T04:55:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3f6af0 0x55b5fe3bf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3fab30 0x55b5fe3bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe401390 0x55b5fe401770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe2099b0 con 0x55b5fe3fab30 2024-04-18T04:55:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe1a8c00 con 0x55b5fe3f6af0 2024-04-18T04:55:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe1c7070 con 0x55b5fe401390 2024-04-18T04:55:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 10 client.0 _ll_register_callbacks cb 0x55b5fe3a6ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:55:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3fab30 0x55b5fe3bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3fab30 0x55b5fe3bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37526/0 (socket says 172.21.15.96:37526) 2024-04-18T04:55:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 -- 172.21.15.96:0/222339758 learned_addr learned my addr 172.21.15.96:0/222339758 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb854ac2640 1 --2- 172.21.15.96:0/222339758 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe401390 0x55b5fe401770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 -- 172.21.15.96:0/222339758 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe401390 msgr2=0x55b5fe401770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/222339758 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe401390 0x55b5fe401770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 -- 172.21.15.96:0/222339758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3f6af0 msgr2=0x55b5fe3bf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/222339758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3f6af0 0x55b5fe3bf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 -- 172.21.15.96:0/222339758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85006be70 con 0x55b5fe3fab30 2024-04-18T04:55:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/222339758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3fab30 0x55b5fe3bfc80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb83801ca70 tx=0x7fb83801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c29d1eecaabb7b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb82effd640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-04-18T04:55:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb82effd640 1 -- 172.21.15.96:0/222339758 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380b5ad0 con 0x55b5fe3fab30 2024-04-18T04:55:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb82effd640 1 -- 172.21.15.96:0/222339758 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8380b5c30 con 0x55b5fe3fab30 2024-04-18T04:55:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 -- 172.21.15.96:0/222339758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5fe1c65f0 con 0x55b5fe3fab30 2024-04-18T04:55:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb82effd640 1 -- 172.21.15.96:0/222339758 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8380b5df0 con 0x55b5fe3fab30 2024-04-18T04:55:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 10 client.4740 fetch_fsmap learned FSMap version 17 2024-04-18T04:55:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.470+0000 7fb859667000 1 -- 172.21.15.96:0/222339758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b5fe1ceab0 con 0x55b5fe3fab30 2024-04-18T04:55:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.474+0000 7fb82effd640 1 -- 172.21.15.96:0/222339758 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b5fe1c65f0 con 0x55b5fe3fab30 2024-04-18T04:55:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.474+0000 7fb82effd640 1 -- 172.21.15.96:0/222339758 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 17) v1 ==== 4252+0+0 (secure 0 0 0) 0x7fb8380bf070 con 0x55b5fe3fab30 2024-04-18T04:55:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.474+0000 7fb859667000 10 client.4740 fetch_fsmap finished waiting for FSMap version 17 2024-04-18T04:55:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.474+0000 7fb859667000 10 client.4740 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-18T04:55:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.474+0000 7fb859667000 20 client.4740 populate_metadata read hostname 'smithi096' 2024-04-18T04:55:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.474+0000 7fb859667000 1 --2- 172.21.15.96:0/222339758 >> [v2:172.21.15.139:6834/2054604275,v1:172.21.15.139:6836/2054604275] conn(0x55b5fe402510 0x55b5fe4028f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.474+0000 7fb859667000 4 client.4740 mds_command: new command op to 4229 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-18T04:55:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.474+0000 7fb859667000 1 -- 172.21.15.96:0/222339758 --> [v2:172.21.15.139:6834/2054604275,v1:172.21.15.139:6836/2054604275] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b5fe206790 con 0x55b5fe402510 2024-04-18T04:55:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.474+0000 7fb84ffff640 1 --2- 172.21.15.96:0/222339758 >> [v2:172.21.15.139:6834/2054604275,v1:172.21.15.139:6836/2054604275] conn(0x55b5fe402510 0x55b5fe4028f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.474+0000 7fb82effd640 10 client.4740 ms_handle_connect on v2:172.21.15.139:6834/2054604275 2024-04-18T04:55:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:11.474+0000 7fb84ffff640 1 --2- 172.21.15.96:0/222339758 >> [v2:172.21.15.139:6834/2054604275,v1:172.21.15.139:6836/2054604275] conn(0x55b5fe402510 0x55b5fe4028f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=126ff5819efe907f server_cookie=db6850194d27a56b in_seq=0 out_seq=0 2024-04-18T04:55:14.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.698+0000 7fb82effd640 1 -- 172.21.15.96:0/222339758 <== mds.4 v2:172.21.15.139:6834/2054604275 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b5fe206790 con 0x55b5fe402510 2024-04-18T04:55:14.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.698+0000 7fb82effd640 10 client.4740 handle_command_reply: tid=0 2024-04-18T04:55:14.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.698+0000 7fb859667000 1 client.4740 shutdown 2024-04-18T04:55:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.698+0000 7fb859667000 1 -- 172.21.15.96:0/222339758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3fab30 msgr2=0x55b5fe3bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.698+0000 7fb859667000 1 --2- 172.21.15.96:0/222339758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3fab30 0x55b5fe3bfc80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb83801ca70 tx=0x7fb83801ad40 comp rx=0 tx=0).stop 2024-04-18T04:55:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.698+0000 7fb859667000 1 -- 172.21.15.96:0/222339758 shutdown_connections 2024-04-18T04:55:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.698+0000 7fb859667000 1 --2- 172.21.15.96:0/222339758 >> [v2:172.21.15.139:6834/2054604275,v1:172.21.15.139:6836/2054604275] conn(0x55b5fe402510 0x55b5fe4028f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.698+0000 7fb859667000 1 --2- 172.21.15.96:0/222339758 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe401390 0x55b5fe401770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.698+0000 7fb859667000 1 --2- 172.21.15.96:0/222339758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3fab30 0x55b5fe3bfc80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.698+0000 7fb82effd640 0 client.4740 ms_handle_reset on v2:172.21.15.139:6834/2054604275 2024-04-18T04:55:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.698+0000 7fb859667000 1 --2- 172.21.15.96:0/222339758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3f6af0 0x55b5fe3bf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.698+0000 7fb859667000 1 -- 172.21.15.96:0/222339758 >> 172.21.15.96:0/222339758 conn(0x55b5fe3c1190 msgr2=0x55b5fe3f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.698+0000 7fb859667000 1 -- 172.21.15.96:0/222339758 shutdown_connections 2024-04-18T04:55:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.698+0000 7fb859667000 1 -- 172.21.15.96:0/222339758 wait complete. 2024-04-18T04:55:14.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.698+0000 7fb859667000 20 client.4740 trim_cache size 0 max 16384 2024-04-18T04:55:14.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.718+0000 7fb859667000 1 Processor -- start 2024-04-18T04:55:14.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.718+0000 7fb859667000 1 -- start start 2024-04-18T04:55:14.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb859667000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3c1190 0x55b5fe403900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb859667000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6af0 0x55b5fe3bbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb859667000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe3fab30 0x55b5fe3bc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb859667000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe3c0c40 con 0x55b5fe3f6af0 2024-04-18T04:55:14.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb859667000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fdec6940 con 0x55b5fe3c1190 2024-04-18T04:55:14.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb859667000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe2071c0 con 0x55b5fe3fab30 2024-04-18T04:55:14.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb84f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6af0 0x55b5fe3bbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb84f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6af0 0x55b5fe3bbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37534/0 (socket says 172.21.15.96:37534) 2024-04-18T04:55:14.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb84f7fe640 1 -- 172.21.15.96:0/3703873271 learned_addr learned my addr 172.21.15.96:0/3703873271 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:14.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb84ffff640 1 --2- 172.21.15.96:0/3703873271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3c1190 0x55b5fe403900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb854ac2640 1 --2- 172.21.15.96:0/3703873271 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe3fab30 0x55b5fe3bc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb84f7fe640 1 -- 172.21.15.96:0/3703873271 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe3fab30 msgr2=0x55b5fe3bc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:14.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/3703873271 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe3fab30 0x55b5fe3bc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb84f7fe640 1 -- 172.21.15.96:0/3703873271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3c1190 msgr2=0x55b5fe403900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:14.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/3703873271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3c1190 0x55b5fe403900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb84f7fe640 1 -- 172.21.15.96:0/3703873271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5fe1b4c00 con 0x55b5fe3f6af0 2024-04-18T04:55:14.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb84ffff640 1 --2- 172.21.15.96:0/3703873271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3c1190 0x55b5fe403900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:14.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb854ac2640 1 --2- 172.21.15.96:0/3703873271 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe3fab30 0x55b5fe3bc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:14.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/3703873271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6af0 0x55b5fe3bbee0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb8380a4ed0 tx=0x7fb8380ca000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82847b56056afa48 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:14.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb8467fc640 1 -- 172.21.15.96:0/3703873271 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380b5850 con 0x55b5fe3f6af0 2024-04-18T04:55:14.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb8467fc640 1 -- 172.21.15.96:0/3703873271 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8380b9070 con 0x55b5fe3f6af0 2024-04-18T04:55:14.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb8467fc640 1 -- 172.21.15.96:0/3703873271 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380b5bd0 con 0x55b5fe3f6af0 2024-04-18T04:55:14.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb859667000 1 -- 172.21.15.96:0/3703873271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6af0 msgr2=0x55b5fe3bbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:14.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb859667000 1 --2- 172.21.15.96:0/3703873271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6af0 0x55b5fe3bbee0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb8380a4ed0 tx=0x7fb8380ca000 comp rx=0 tx=0).stop 2024-04-18T04:55:14.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb859667000 1 -- 172.21.15.96:0/3703873271 shutdown_connections 2024-04-18T04:55:14.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb859667000 1 --2- 172.21.15.96:0/3703873271 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe3fab30 0x55b5fe3bc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb859667000 1 --2- 172.21.15.96:0/3703873271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6af0 0x55b5fe3bbee0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb859667000 1 --2- 172.21.15.96:0/3703873271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3c1190 0x55b5fe403900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb859667000 1 -- 172.21.15.96:0/3703873271 >> 172.21.15.96:0/3703873271 conn(0x55b5fe3bf8d0 msgr2=0x55b5fe40cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:14.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb859667000 1 -- 172.21.15.96:0/3703873271 shutdown_connections 2024-04-18T04:55:14.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb859667000 1 -- 172.21.15.96:0/3703873271 wait complete. 2024-04-18T04:55:14.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.722+0000 7fb859667000 1 -- start start 2024-04-18T04:55:14.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 1 Processor -- start 2024-04-18T04:55:14.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe3c1190 0x55b5fe3be540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6af0 0x55b5fe45d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3fab30 0x55b5fe45d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe20d9b0 con 0x55b5fe3f6af0 2024-04-18T04:55:14.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe1d0c60 con 0x55b5fe3fab30 2024-04-18T04:55:14.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe1c7c80 con 0x55b5fe3c1190 2024-04-18T04:55:14.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 10 client.0 _ll_register_callbacks cb 0x55b5fe1d6ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:55:14.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb84f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6af0 0x55b5fe45d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb84f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6af0 0x55b5fe45d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37536/0 (socket says 172.21.15.96:37536) 2024-04-18T04:55:14.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb84f7fe640 1 -- 172.21.15.96:0/2751152749 learned_addr learned my addr 172.21.15.96:0/2751152749 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:14.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb84ffff640 1 --2- 172.21.15.96:0/2751152749 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe3c1190 0x55b5fe3be540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb854ac2640 1 --2- 172.21.15.96:0/2751152749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3fab30 0x55b5fe45d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb84f7fe640 1 -- 172.21.15.96:0/2751152749 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe3c1190 msgr2=0x55b5fe3be540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:14.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/2751152749 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe3c1190 0x55b5fe3be540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb84f7fe640 1 -- 172.21.15.96:0/2751152749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3fab30 msgr2=0x55b5fe45d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:14.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/2751152749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3fab30 0x55b5fe45d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb84f7fe640 1 -- 172.21.15.96:0/2751152749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5fe1ceab0 con 0x55b5fe3f6af0 2024-04-18T04:55:14.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb84f7fe640 1 --2- 172.21.15.96:0/2751152749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6af0 0x55b5fe45d120 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb83801ca70 tx=0x7fb8380a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93378d2e7b4ffd7e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:14.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb82effd640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-04-18T04:55:14.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb82effd640 1 -- 172.21.15.96:0/2751152749 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380b5ea0 con 0x55b5fe3f6af0 2024-04-18T04:55:14.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb82effd640 1 -- 172.21.15.96:0/2751152749 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8380d47e0 con 0x55b5fe3f6af0 2024-04-18T04:55:14.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 1 -- 172.21.15.96:0/2751152749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5fe416110 con 0x55b5fe3f6af0 2024-04-18T04:55:14.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb82effd640 1 -- 172.21.15.96:0/2751152749 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8380d49a0 con 0x55b5fe3f6af0 2024-04-18T04:55:14.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 10 client.4746 fetch_fsmap learned FSMap version 17 2024-04-18T04:55:14.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 1 -- 172.21.15.96:0/2751152749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b5fdf05cc0 con 0x55b5fe3f6af0 2024-04-18T04:55:14.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb82effd640 1 -- 172.21.15.96:0/2751152749 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b5fe416110 con 0x55b5fe3f6af0 2024-04-18T04:55:14.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb82effd640 1 -- 172.21.15.96:0/2751152749 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 17) v1 ==== 4252+0+0 (secure 0 0 0) 0x7fb8380bf040 con 0x55b5fe3f6af0 2024-04-18T04:55:14.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 10 client.4746 fetch_fsmap finished waiting for FSMap version 17 2024-04-18T04:55:14.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 10 client.4746 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-18T04:55:14.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 20 client.4746 populate_metadata read hostname 'smithi096' 2024-04-18T04:55:14.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 1 --2- 172.21.15.96:0/2751152749 >> [v2:172.21.15.139:6834/2054604275,v1:172.21.15.139:6836/2054604275] conn(0x55b5fe401390 0x55b5fe45be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 4 client.4746 mds_command: new command op to 4229 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-18T04:55:14.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb859667000 1 -- 172.21.15.96:0/2751152749 --> [v2:172.21.15.139:6834/2054604275,v1:172.21.15.139:6836/2054604275] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b5fe1d9460 con 0x55b5fe401390 2024-04-18T04:55:14.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb84ffff640 1 --2- 172.21.15.96:0/2751152749 >> [v2:172.21.15.139:6834/2054604275,v1:172.21.15.139:6836/2054604275] conn(0x55b5fe401390 0x55b5fe45be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb82effd640 10 client.4746 ms_handle_connect on v2:172.21.15.139:6834/2054604275 2024-04-18T04:55:14.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.726+0000 7fb84ffff640 1 --2- 172.21.15.96:0/2751152749 >> [v2:172.21.15.139:6834/2054604275,v1:172.21.15.139:6836/2054604275] conn(0x55b5fe401390 0x55b5fe45be00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=67b6e0470fa2dc27 server_cookie=ecd6fb55f8c56def in_seq=0 out_seq=0 2024-04-18T04:55:14.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb82effd640 1 -- 172.21.15.96:0/2751152749 <== mds.4 v2:172.21.15.139:6834/2054604275 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55b5fe1d9460 con 0x55b5fe401390 2024-04-18T04:55:14.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb82effd640 10 client.4746 handle_command_reply: tid=0 2024-04-18T04:55:14.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb859667000 1 client.4746 shutdown 2024-04-18T04:55:14.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb859667000 1 -- 172.21.15.96:0/2751152749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6af0 msgr2=0x55b5fe45d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:14.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb859667000 1 --2- 172.21.15.96:0/2751152749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6af0 0x55b5fe45d120 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb83801ca70 tx=0x7fb8380a7000 comp rx=0 tx=0).stop 2024-04-18T04:55:14.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb859667000 1 -- 172.21.15.96:0/2751152749 shutdown_connections 2024-04-18T04:55:14.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb859667000 1 --2- 172.21.15.96:0/2751152749 >> [v2:172.21.15.139:6834/2054604275,v1:172.21.15.139:6836/2054604275] conn(0x55b5fe401390 0x55b5fe45be00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb859667000 1 --2- 172.21.15.96:0/2751152749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5fe3fab30 0x55b5fe45d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb859667000 1 --2- 172.21.15.96:0/2751152749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55b5fe3f6af0 0x55b5fe45d120 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb82effd640 0 client.4746 ms_handle_reset on v2:172.21.15.139:6834/2054604275 2024-04-18T04:55:14.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb859667000 1 --2- 172.21.15.96:0/2751152749 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55b5fe3c1190 0x55b5fe3be540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb859667000 1 -- 172.21.15.96:0/2751152749 >> 172.21.15.96:0/2751152749 conn(0x55b5fe3bf8d0 msgr2=0x55b5fe4028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:14.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb859667000 1 -- 172.21.15.96:0/2751152749 shutdown_connections 2024-04-18T04:55:14.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb859667000 1 -- 172.21.15.96:0/2751152749 wait complete. 2024-04-18T04:55:14.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb859667000 20 client.4746 trim_cache size 0 max 16384 2024-04-18T04:55:14.736 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:55:14.736 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:55:14.736 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 4, 2024-04-18T04:55:14.736 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4229, 2024-04-18T04:55:14.736 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2024-04-18T04:55:14.736 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2024-04-18T04:55:14.737 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2024-04-18T04:55:14.737 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 11.054778950999999, 2024-04-18T04:55:14.737 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 17, 2024-04-18T04:55:14.737 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 21, 2024-04-18T04:55:14.737 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 21, 2024-04-18T04:55:14.737 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 39.975640017000003 2024-04-18T04:55:14.737 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:55:14.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb856525640 1 -- 172.21.15.96:0/3348965291 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb830066690 msgr2=0x7fb830068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:14.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb856525640 1 --2- 172.21.15.96:0/3348965291 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb830066690 0x7fb830068b50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8380ae000 tx=0x7fb838008040 comp rx=0 tx=0).stop 2024-04-18T04:55:14.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb856525640 1 -- 172.21.15.96:0/3348965291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb850071160 msgr2=0x7fb8501f35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:14.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb856525640 1 --2- 172.21.15.96:0/3348965291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb850071160 0x7fb8501f35e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb84000c450 tx=0x7fb84000c910 comp rx=0 tx=0).stop 2024-04-18T04:55:14.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb856525640 1 -- 172.21.15.96:0/3348965291 shutdown_connections 2024-04-18T04:55:14.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb856525640 1 --2- 172.21.15.96:0/3348965291 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb830066690 0x7fb830068b50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb856525640 1 --2- 172.21.15.96:0/3348965291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8500c6830 0x7fb8500c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb856525640 1 --2- 172.21.15.96:0/3348965291 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8500c6450 0x7fb8500c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb856525640 1 --2- 172.21.15.96:0/3348965291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb850071160 0x7fb8501f35e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb856525640 1 -- 172.21.15.96:0/3348965291 >> 172.21.15.96:0/3348965291 conn(0x7fb85006a8e0 msgr2=0x7fb8501457b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:14.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb856525640 1 -- 172.21.15.96:0/3348965291 shutdown_connections 2024-04-18T04:55:14.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.730+0000 7fb856525640 1 -- 172.21.15.96:0/3348965291 wait complete. 2024-04-18T04:55:14.752 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-18T04:55:14.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.870+0000 7ff866092640 1 Processor -- start 2024-04-18T04:55:14.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.870+0000 7ff866092640 1 -- start start 2024-04-18T04:55:14.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.870+0000 7ff866092640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff860158cd0 0x7ff8600c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.870+0000 7ff866092640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff8601590f0 0x7ff8600ca270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.870+0000 7ff866092640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8601595f0 con 0x7ff860153060 2024-04-18T04:55:14.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.870+0000 7ff866092640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff860153440 con 0x7ff8601590f0 2024-04-18T04:55:14.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.870+0000 7ff866092640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8601598d0 con 0x7ff860158cd0 2024-04-18T04:55:14.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.870+0000 7ff85ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff8601590f0 0x7ff8600ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.870+0000 7ff85ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff8601590f0 0x7ff8600ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37542/0 (socket says 172.21.15.96:37542) 2024-04-18T04:55:14.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.870+0000 7ff85ffff640 1 -- 172.21.15.96:0/2145796069 learned_addr learned my addr 172.21.15.96:0/2145796069 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:14.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.870+0000 7ff85effd640 1 --2- 172.21.15.96:0/2145796069 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff860158cd0 0x7ff8600c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.870+0000 7ff85ffff640 1 -- 172.21.15.96:0/2145796069 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff860158cd0 msgr2=0x7ff8600c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:14.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.870+0000 7ff85ffff640 1 --2- 172.21.15.96:0/2145796069 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff860158cd0 0x7ff8600c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.870+0000 7ff85ffff640 1 -- 172.21.15.96:0/2145796069 >> v1:172.21.15.139:6789/0 conn(0x7ff860153060 legacy=0x7ff8600c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:14.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.870+0000 7ff85ffff640 1 -- 172.21.15.96:0/2145796069 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff860159bb0 con 0x7ff8601590f0 2024-04-18T04:55:14.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.874+0000 7ff85ffff640 1 --2- 172.21.15.96:0/2145796069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8601590f0 0x7ff8600ca270 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff858009e50 tx=0x7ff85801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c45192347d8367a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:14.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.874+0000 7ff85e7fc640 1 -- 172.21.15.96:0/2145796069 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8580af400 con 0x7ff8601590f0 2024-04-18T04:55:14.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.874+0000 7ff85e7fc640 1 -- 172.21.15.96:0/2145796069 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8580ab050 con 0x7ff8601590f0 2024-04-18T04:55:14.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.874+0000 7ff85e7fc640 1 -- 172.21.15.96:0/2145796069 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8580af780 con 0x7ff8601590f0 2024-04-18T04:55:14.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.874+0000 7ff866092640 1 -- 172.21.15.96:0/2145796069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8601590f0 msgr2=0x7ff8600ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:14.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.874+0000 7ff866092640 1 --2- 172.21.15.96:0/2145796069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8601590f0 0x7ff8600ca270 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff858009e50 tx=0x7ff85801f210 comp rx=0 tx=0).stop 2024-04-18T04:55:14.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.874+0000 7ff866092640 1 -- 172.21.15.96:0/2145796069 shutdown_connections 2024-04-18T04:55:14.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.874+0000 7ff866092640 1 --2- 172.21.15.96:0/2145796069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8601590f0 0x7ff8600ca270 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.874+0000 7ff866092640 1 --2- 172.21.15.96:0/2145796069 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff860158cd0 0x7ff8600c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.874+0000 7ff866092640 1 -- 172.21.15.96:0/2145796069 >> 172.21.15.96:0/2145796069 conn(0x7ff86006b470 msgr2=0x7ff86006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:14.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.874+0000 7ff866092640 1 -- 172.21.15.96:0/2145796069 shutdown_connections 2024-04-18T04:55:14.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.874+0000 7ff866092640 1 -- 172.21.15.96:0/2145796069 wait complete. 2024-04-18T04:55:14.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff866092640 1 Processor -- start 2024-04-18T04:55:14.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff866092640 1 -- start start 2024-04-18T04:55:14.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff866092640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff860153060 0x7ff860146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff866092640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff860158cd0 0x7ff8601e3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff866092640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8601590f0 0x7ff8601e3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff866092640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8601ef730 con 0x7ff860158cd0 2024-04-18T04:55:14.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff866092640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8601f2de0 con 0x7ff8601590f0 2024-04-18T04:55:14.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff866092640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8601eee00 con 0x7ff860153060 2024-04-18T04:55:14.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff85effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff860158cd0 0x7ff8601e3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff85effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff860158cd0 0x7ff8601e3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37552/0 (socket says 172.21.15.96:37552) 2024-04-18T04:55:14.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff85effd640 1 -- 172.21.15.96:0/3324194778 learned_addr learned my addr 172.21.15.96:0/3324194778 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:14.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff85ffff640 1 --2- 172.21.15.96:0/3324194778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8601590f0 0x7ff8601e3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff85f7fe640 1 --2- 172.21.15.96:0/3324194778 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff860153060 0x7ff860146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff85effd640 1 -- 172.21.15.96:0/3324194778 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff860153060 msgr2=0x7ff860146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:14.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff85effd640 1 --2- 172.21.15.96:0/3324194778 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff860153060 0x7ff860146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff85effd640 1 -- 172.21.15.96:0/3324194778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8601590f0 msgr2=0x7ff8601e3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:14.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff85effd640 1 --2- 172.21.15.96:0/3324194778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8601590f0 0x7ff8601e3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff85effd640 1 -- 172.21.15.96:0/3324194778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff858009b30 con 0x7ff860158cd0 2024-04-18T04:55:14.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff85f7fe640 1 --2- 172.21.15.96:0/3324194778 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff860153060 0x7ff860146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:14.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff85ffff640 1 --2- 172.21.15.96:0/3324194778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8601590f0 0x7ff8601e3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:14.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff85effd640 1 --2- 172.21.15.96:0/3324194778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff860158cd0 0x7ff8601e3a30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff85400e930 tx=0x7ff85400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:14.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff847fff640 1 -- 172.21.15.96:0/3324194778 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff854009690 con 0x7ff860158cd0 2024-04-18T04:55:14.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff847fff640 1 -- 172.21.15.96:0/3324194778 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85400ca00 con 0x7ff860158cd0 2024-04-18T04:55:14.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff847fff640 1 -- 172.21.15.96:0/3324194778 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85400cd70 con 0x7ff860158cd0 2024-04-18T04:55:14.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff866092640 1 -- 172.21.15.96:0/3324194778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8601ef0e0 con 0x7ff860158cd0 2024-04-18T04:55:14.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.878+0000 7ff866092640 1 -- 172.21.15.96:0/3324194778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8601eeab0 con 0x7ff860158cd0 2024-04-18T04:55:14.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff847fff640 1 -- 172.21.15.96:0/3324194778 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff854013470 con 0x7ff860158cd0 2024-04-18T04:55:14.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff847fff640 1 --2- 172.21.15.96:0/3324194778 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff84c066690 0x7ff84c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff847fff640 1 -- 172.21.15.96:0/3324194778 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8540847b0 con 0x7ff860158cd0 2024-04-18T04:55:14.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff85f7fe640 1 --2- 172.21.15.96:0/3324194778 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff84c066690 0x7ff84c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff85f7fe640 1 --2- 172.21.15.96:0/3324194778 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff84c066690 0x7ff84c068b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff850000f70 tx=0x7ff850009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:14.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff8691d4000 1 Processor -- start 2024-04-18T04:55:14.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff8691d4000 1 -- start start 2024-04-18T04:55:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff8691d4000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9cd3af0 0x5561c9c9d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff8691d4000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9cd3ed0 0x5561c9c9dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff8691d4000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd7b30 0x5561c9cd7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff8691d4000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c9b5fe80 con 0x5561c9cd3af0 2024-04-18T04:55:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff8691d4000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c9aedaf0 con 0x5561c9cd7b30 2024-04-18T04:55:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff8691d4000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561c9aeb0c0 con 0x5561c9cd3ed0 2024-04-18T04:55:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff85f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9cd3af0 0x5561c9c9d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff85f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9cd3af0 0x5561c9c9d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37566/0 (socket says 172.21.15.96:37566) 2024-04-18T04:55:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff85f7fe640 1 -- 172.21.15.96:0/399181435 learned_addr learned my addr 172.21.15.96:0/399181435 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff85f7fe640 1 -- 172.21.15.96:0/399181435 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9cd3ed0 msgr2=0x5561c9c9dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff85f7fe640 1 --2- 172.21.15.96:0/399181435 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9cd3ed0 0x5561c9c9dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff85f7fe640 1 -- 172.21.15.96:0/399181435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd7b30 msgr2=0x5561c9cd7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff85f7fe640 1 --2- 172.21.15.96:0/399181435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd7b30 0x5561c9cd7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff85f7fe640 1 -- 172.21.15.96:0/399181435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561c97e2890 con 0x5561c9cd3af0 2024-04-18T04:55:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff85f7fe640 1 --2- 172.21.15.96:0/399181435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9cd3af0 0x5561c9c9d700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff85000d7d0 tx=0x7ff850010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a7c2aabb1d354d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff8457fa640 1 -- 172.21.15.96:0/399181435 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff850014ba0 con 0x5561c9cd3af0 2024-04-18T04:55:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff8457fa640 1 -- 172.21.15.96:0/399181435 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff850014d00 con 0x5561c9cd3af0 2024-04-18T04:55:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.882+0000 7ff8457fa640 1 -- 172.21.15.96:0/399181435 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85001f600 con 0x5561c9cd3af0 2024-04-18T04:55:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 -- 172.21.15.96:0/399181435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9cd3af0 msgr2=0x5561c9c9d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 --2- 172.21.15.96:0/399181435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9cd3af0 0x5561c9c9d700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff85000d7d0 tx=0x7ff850010000 comp rx=0 tx=0).stop 2024-04-18T04:55:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 -- 172.21.15.96:0/399181435 shutdown_connections 2024-04-18T04:55:14.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 --2- 172.21.15.96:0/399181435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd7b30 0x5561c9cd7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 --2- 172.21.15.96:0/399181435 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9cd3ed0 0x5561c9c9dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 --2- 172.21.15.96:0/399181435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9cd3af0 0x5561c9c9d700 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 -- 172.21.15.96:0/399181435 >> 172.21.15.96:0/399181435 conn(0x5561c9c9e190 msgr2=0x5561c9c9e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:14.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 -- 172.21.15.96:0/399181435 shutdown_connections 2024-04-18T04:55:14.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 -- 172.21.15.96:0/399181435 wait complete. 2024-04-18T04:55:14.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 -- start start 2024-04-18T04:55:14.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 Processor -- start 2024-04-18T04:55:14.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9cd3af0 0x5561c9c9c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd7b30 0x5561c9cde390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9c9ce60 0x5561c9cde8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c9ae69b0 con 0x5561c9c9ce60 2024-04-18T04:55:14.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c9a85c00 con 0x5561c9cd7b30 2024-04-18T04:55:14.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561c9aa4070 con 0x5561c9cd3af0 2024-04-18T04:55:14.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 10 client.0 _ll_register_callbacks cb 0x5561c9c83ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:55:14.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff85ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9c9ce60 0x5561c9cde8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff85ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9c9ce60 0x5561c9cde8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37574/0 (socket says 172.21.15.96:37574) 2024-04-18T04:55:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff85ffff640 1 -- 172.21.15.96:0/539872003 learned_addr learned my addr 172.21.15.96:0/539872003 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff85f7fe640 1 --2- 172.21.15.96:0/539872003 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9cd3af0 0x5561c9c9c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff85effd640 1 --2- 172.21.15.96:0/539872003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd7b30 0x5561c9cde390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff85ffff640 1 -- 172.21.15.96:0/539872003 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9cd3af0 msgr2=0x5561c9c9c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff85ffff640 1 --2- 172.21.15.96:0/539872003 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9cd3af0 0x5561c9c9c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff85ffff640 1 -- 172.21.15.96:0/539872003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd7b30 msgr2=0x5561c9cde390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff85ffff640 1 --2- 172.21.15.96:0/539872003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd7b30 0x5561c9cde390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff85ffff640 1 -- 172.21.15.96:0/539872003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8601595f0 con 0x5561c9c9ce60 2024-04-18T04:55:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff85effd640 1 --2- 172.21.15.96:0/539872003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd7b30 0x5561c9cde390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff85ffff640 1 --2- 172.21.15.96:0/539872003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9c9ce60 0x5561c9cde8d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff85801ce40 tx=0x7ff85801bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77fc6cf0daec1f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff83e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-04-18T04:55:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff83e7fc640 1 -- 172.21.15.96:0/539872003 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8580af700 con 0x5561c9c9ce60 2024-04-18T04:55:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff83e7fc640 1 -- 172.21.15.96:0/539872003 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8580af860 con 0x5561c9c9ce60 2024-04-18T04:55:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 -- 172.21.15.96:0/539872003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561c9aa35f0 con 0x5561c9c9ce60 2024-04-18T04:55:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff83e7fc640 1 -- 172.21.15.96:0/539872003 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8580afa20 con 0x5561c9c9ce60 2024-04-18T04:55:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 10 client.4758 fetch_fsmap learned FSMap version 17 2024-04-18T04:55:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 -- 172.21.15.96:0/539872003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5561c9aabab0 con 0x5561c9c9ce60 2024-04-18T04:55:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff83e7fc640 1 -- 172.21.15.96:0/539872003 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561c9aa35f0 con 0x5561c9c9ce60 2024-04-18T04:55:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff83e7fc640 1 -- 172.21.15.96:0/539872003 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 17) v1 ==== 4252+0+0 (secure 0 0 0) 0x7ff8580afb80 con 0x5561c9c9ce60 2024-04-18T04:55:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 10 client.4758 fetch_fsmap finished waiting for FSMap version 17 2024-04-18T04:55:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 10 client.4758 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-18T04:55:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 20 client.4758 populate_metadata read hostname 'smithi096' 2024-04-18T04:55:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 --2- 172.21.15.96:0/539872003 >> [v2:172.21.15.139:6835/2105821790,v1:172.21.15.139:6837/2105821790] conn(0x5561c9cdf670 0x5561c9ceec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 4 client.4758 mds_command: new command op to 4232 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-18T04:55:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff8691d4000 1 -- 172.21.15.96:0/539872003 --> [v2:172.21.15.139:6835/2105821790,v1:172.21.15.139:6837/2105821790] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561c9ae3790 con 0x5561c9cdf670 2024-04-18T04:55:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.886+0000 7ff85f7fe640 1 --2- 172.21.15.96:0/539872003 >> [v2:172.21.15.139:6835/2105821790,v1:172.21.15.139:6837/2105821790] conn(0x5561c9cdf670 0x5561c9ceec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff83e7fc640 10 client.4758 ms_handle_connect on v2:172.21.15.139:6835/2105821790 2024-04-18T04:55:14.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff85f7fe640 1 --2- 172.21.15.96:0/539872003 >> [v2:172.21.15.139:6835/2105821790,v1:172.21.15.139:6837/2105821790] conn(0x5561c9cdf670 0x5561c9ceec30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=787af1c1bd41ebe8 server_cookie=557c2bdec05929bf in_seq=0 out_seq=0 2024-04-18T04:55:14.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff83e7fc640 1 -- 172.21.15.96:0/539872003 <== mds.3 v2:172.21.15.139:6835/2105821790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5561c9ae3790 con 0x5561c9cdf670 2024-04-18T04:55:14.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff83e7fc640 10 client.4758 handle_command_reply: tid=0 2024-04-18T04:55:14.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff8691d4000 1 client.4758 shutdown 2024-04-18T04:55:14.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff8691d4000 1 -- 172.21.15.96:0/539872003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9c9ce60 msgr2=0x5561c9cde8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:14.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff8691d4000 1 --2- 172.21.15.96:0/539872003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9c9ce60 0x5561c9cde8d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff85801ce40 tx=0x7ff85801bfb0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff8691d4000 1 -- 172.21.15.96:0/539872003 shutdown_connections 2024-04-18T04:55:14.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff8691d4000 1 --2- 172.21.15.96:0/539872003 >> [v2:172.21.15.139:6835/2105821790,v1:172.21.15.139:6837/2105821790] conn(0x5561c9cdf670 0x5561c9ceec30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff8691d4000 1 --2- 172.21.15.96:0/539872003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9c9ce60 0x5561c9cde8d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff8691d4000 1 --2- 172.21.15.96:0/539872003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd7b30 0x5561c9cde390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff83e7fc640 0 client.4758 ms_handle_reset on v2:172.21.15.139:6835/2105821790 2024-04-18T04:55:14.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff8691d4000 1 --2- 172.21.15.96:0/539872003 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9cd3af0 0x5561c9c9c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff8691d4000 1 -- 172.21.15.96:0/539872003 >> 172.21.15.96:0/539872003 conn(0x5561c9c9e190 msgr2=0x5561c9cd64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:14.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff8691d4000 1 -- 172.21.15.96:0/539872003 shutdown_connections 2024-04-18T04:55:14.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff8691d4000 1 -- 172.21.15.96:0/539872003 wait complete. 2024-04-18T04:55:14.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.890+0000 7ff8691d4000 20 client.4758 trim_cache size 0 max 16384 2024-04-18T04:55:14.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 Processor -- start 2024-04-18T04:55:14.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 -- start start 2024-04-18T04:55:14.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9c9ce60 0x5561c9c98eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9cd3af0 0x5561c9c993f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd7b30 0x5561c9c99930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c97a3940 con 0x5561c9c9ce60 2024-04-18T04:55:14.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c9aa84c0 con 0x5561c9cd7b30 2024-04-18T04:55:14.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561c9ae0bb0 con 0x5561c9cd3af0 2024-04-18T04:55:14.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff85f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9c9ce60 0x5561c9c98eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff85f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9c9ce60 0x5561c9c98eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37578/0 (socket says 172.21.15.96:37578) 2024-04-18T04:55:14.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff85f7fe640 1 -- 172.21.15.96:0/32829921 learned_addr learned my addr 172.21.15.96:0/32829921 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:14.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff85f7fe640 1 -- 172.21.15.96:0/32829921 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9cd3af0 msgr2=0x5561c9c993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:14.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff85f7fe640 1 --2- 172.21.15.96:0/32829921 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9cd3af0 0x5561c9c993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff85f7fe640 1 -- 172.21.15.96:0/32829921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd7b30 msgr2=0x5561c9c99930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:14.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff85f7fe640 1 --2- 172.21.15.96:0/32829921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd7b30 0x5561c9c99930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff85f7fe640 1 -- 172.21.15.96:0/32829921 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561c9a91c00 con 0x5561c9c9ce60 2024-04-18T04:55:14.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff85f7fe640 1 --2- 172.21.15.96:0/32829921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9c9ce60 0x5561c9c98eb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff85000d520 tx=0x7ff85001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c0786b69453a3e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:14.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff845ffb640 1 -- 172.21.15.96:0/32829921 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8500149a0 con 0x5561c9c9ce60 2024-04-18T04:55:14.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff845ffb640 1 -- 172.21.15.96:0/32829921 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff850018030 con 0x5561c9c9ce60 2024-04-18T04:55:14.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff845ffb640 1 -- 172.21.15.96:0/32829921 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff850007240 con 0x5561c9c9ce60 2024-04-18T04:55:14.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 -- 172.21.15.96:0/32829921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9c9ce60 msgr2=0x5561c9c98eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:14.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 --2- 172.21.15.96:0/32829921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9c9ce60 0x5561c9c98eb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff85000d520 tx=0x7ff85001c000 comp rx=0 tx=0).stop 2024-04-18T04:55:14.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 -- 172.21.15.96:0/32829921 shutdown_connections 2024-04-18T04:55:14.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 --2- 172.21.15.96:0/32829921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd7b30 0x5561c9c99930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 --2- 172.21.15.96:0/32829921 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9cd3af0 0x5561c9c993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 --2- 172.21.15.96:0/32829921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9c9ce60 0x5561c9c98eb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 -- 172.21.15.96:0/32829921 >> 172.21.15.96:0/32829921 conn(0x5561c9c9e190 msgr2=0x5561c9cddf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:14.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 -- 172.21.15.96:0/32829921 shutdown_connections 2024-04-18T04:55:14.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 -- 172.21.15.96:0/32829921 wait complete. 2024-04-18T04:55:14.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.906+0000 7ff8691d4000 1 -- start start 2024-04-18T04:55:14.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 Processor -- start 2024-04-18T04:55:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9c9ce60 0x5561c9c9b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd3af0 0x5561c9d3bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9cd7b30 0x5561c9d3bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c9ae3440 con 0x5561c9cd7b30 2024-04-18T04:55:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c9ae4980 con 0x5561c9cd3af0 2024-04-18T04:55:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561c9aa3ac0 con 0x5561c9c9ce60 2024-04-18T04:55:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 10 client.0 _ll_register_callbacks cb 0x5561c9ab3ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:55:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff85ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9cd7b30 0x5561c9d3bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff85ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9cd7b30 0x5561c9d3bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37584/0 (socket says 172.21.15.96:37584) 2024-04-18T04:55:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff85ffff640 1 -- 172.21.15.96:0/599657260 learned_addr learned my addr 172.21.15.96:0/599657260 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff85f7fe640 1 --2- 172.21.15.96:0/599657260 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9c9ce60 0x5561c9c9b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff85ffff640 1 -- 172.21.15.96:0/599657260 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9c9ce60 msgr2=0x5561c9c9b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff85ffff640 1 --2- 172.21.15.96:0/599657260 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9c9ce60 0x5561c9c9b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff85ffff640 1 -- 172.21.15.96:0/599657260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd3af0 msgr2=0x5561c9d3bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff85effd640 1 --2- 172.21.15.96:0/599657260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd3af0 0x5561c9d3bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff85ffff640 1 --2- 172.21.15.96:0/599657260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd3af0 0x5561c9d3bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff85ffff640 1 -- 172.21.15.96:0/599657260 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561c97e2890 con 0x5561c9cd7b30 2024-04-18T04:55:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff85ffff640 1 --2- 172.21.15.96:0/599657260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9cd7b30 0x5561c9d3bff0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff85801da90 tx=0x7ff858009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efca8011f016034e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff83e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-04-18T04:55:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff83e7fc640 1 -- 172.21.15.96:0/599657260 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858003ba0 con 0x5561c9cd7b30 2024-04-18T04:55:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff83e7fc640 1 -- 172.21.15.96:0/599657260 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff858003d00 con 0x5561c9cd7b30 2024-04-18T04:55:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 -- 172.21.15.96:0/599657260 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561c9ab6460 con 0x5561c9cd7b30 2024-04-18T04:55:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff83e7fc640 1 -- 172.21.15.96:0/599657260 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8580c5350 con 0x5561c9cd7b30 2024-04-18T04:55:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 10 client.4764 fetch_fsmap learned FSMap version 17 2024-04-18T04:55:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 -- 172.21.15.96:0/599657260 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5561c97e2cc0 con 0x5561c9cd7b30 2024-04-18T04:55:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff83e7fc640 1 -- 172.21.15.96:0/599657260 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561c9ab6460 con 0x5561c9cd7b30 2024-04-18T04:55:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff83e7fc640 1 -- 172.21.15.96:0/599657260 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 17) v1 ==== 4252+0+0 (secure 0 0 0) 0x7ff8580b9850 con 0x5561c9cd7b30 2024-04-18T04:55:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 10 client.4764 fetch_fsmap finished waiting for FSMap version 17 2024-04-18T04:55:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 10 client.4764 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-18T04:55:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 20 client.4764 populate_metadata read hostname 'smithi096' 2024-04-18T04:55:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 --2- 172.21.15.96:0/599657260 >> [v2:172.21.15.139:6835/2105821790,v1:172.21.15.139:6837/2105821790] conn(0x5561c9d353a0 0x5561c9d35780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 4 client.4764 mds_command: new command op to 4232 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-18T04:55:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 -- 172.21.15.96:0/599657260 --> [v2:172.21.15.139:6835/2105821790,v1:172.21.15.139:6837/2105821790] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5561c9aaf9c0 con 0x5561c9d353a0 2024-04-18T04:55:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff85f7fe640 1 --2- 172.21.15.96:0/599657260 >> [v2:172.21.15.139:6835/2105821790,v1:172.21.15.139:6837/2105821790] conn(0x5561c9d353a0 0x5561c9d35780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff83e7fc640 10 client.4764 ms_handle_connect on v2:172.21.15.139:6835/2105821790 2024-04-18T04:55:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff85f7fe640 1 --2- 172.21.15.96:0/599657260 >> [v2:172.21.15.139:6835/2105821790,v1:172.21.15.139:6837/2105821790] conn(0x5561c9d353a0 0x5561c9d35780 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5dbbf37345e9e0a2 server_cookie=a22b2993f6c332ab in_seq=0 out_seq=0 2024-04-18T04:55:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff83e7fc640 1 -- 172.21.15.96:0/599657260 <== mds.3 v2:172.21.15.139:6835/2105821790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5561c9aaf9c0 con 0x5561c9d353a0 2024-04-18T04:55:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff83e7fc640 10 client.4764 handle_command_reply: tid=0 2024-04-18T04:55:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 client.4764 shutdown 2024-04-18T04:55:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 -- 172.21.15.96:0/599657260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9cd7b30 msgr2=0x5561c9d3bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 --2- 172.21.15.96:0/599657260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9cd7b30 0x5561c9d3bff0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff85801da90 tx=0x7ff858009810 comp rx=0 tx=0).stop 2024-04-18T04:55:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 -- 172.21.15.96:0/599657260 shutdown_connections 2024-04-18T04:55:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 --2- 172.21.15.96:0/599657260 >> [v2:172.21.15.139:6835/2105821790,v1:172.21.15.139:6837/2105821790] conn(0x5561c9d353a0 0x5561c9d35780 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 --2- 172.21.15.96:0/599657260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5561c9cd7b30 0x5561c9d3bff0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff83e7fc640 0 client.4764 ms_handle_reset on v2:172.21.15.139:6835/2105821790 2024-04-18T04:55:14.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 --2- 172.21.15.96:0/599657260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561c9cd3af0 0x5561c9d3bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 --2- 172.21.15.96:0/599657260 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5561c9c9ce60 0x5561c9c9b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 -- 172.21.15.96:0/599657260 >> 172.21.15.96:0/599657260 conn(0x5561c9c9e190 msgr2=0x5561c9ce9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:14.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 -- 172.21.15.96:0/599657260 shutdown_connections 2024-04-18T04:55:14.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 1 -- 172.21.15.96:0/599657260 wait complete. 2024-04-18T04:55:14.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.910+0000 7ff8691d4000 20 client.4764 trim_cache size 0 max 16384 2024-04-18T04:55:14.920 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:55:14.920 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:55:14.920 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 3, 2024-04-18T04:55:14.920 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4232, 2024-04-18T04:55:14.920 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2024-04-18T04:55:14.920 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2024-04-18T04:55:14.921 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2024-04-18T04:55:14.921 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 17.274840637, 2024-04-18T04:55:14.921 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 17, 2024-04-18T04:55:14.921 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 21, 2024-04-18T04:55:14.921 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 21, 2024-04-18T04:55:14.921 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 40.158347034000002 2024-04-18T04:55:14.921 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:55:14.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.914+0000 7ff866092640 1 -- 172.21.15.96:0/3324194778 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff84c066690 msgr2=0x7ff84c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:14.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.914+0000 7ff866092640 1 --2- 172.21.15.96:0/3324194778 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff84c066690 0x7ff84c068b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff850000f70 tx=0x7ff850009040 comp rx=0 tx=0).stop 2024-04-18T04:55:14.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.914+0000 7ff866092640 1 -- 172.21.15.96:0/3324194778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff860158cd0 msgr2=0x7ff8601e3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:14.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.914+0000 7ff866092640 1 --2- 172.21.15.96:0/3324194778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff860158cd0 0x7ff8601e3a30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff85400e930 tx=0x7ff85400edf0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.914+0000 7ff866092640 1 -- 172.21.15.96:0/3324194778 shutdown_connections 2024-04-18T04:55:14.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.914+0000 7ff866092640 1 --2- 172.21.15.96:0/3324194778 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff84c066690 0x7ff84c068b50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.914+0000 7ff866092640 1 --2- 172.21.15.96:0/3324194778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8601590f0 0x7ff8601e3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.914+0000 7ff866092640 1 --2- 172.21.15.96:0/3324194778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff860158cd0 0x7ff8601e3a30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.914+0000 7ff866092640 1 --2- 172.21.15.96:0/3324194778 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff860153060 0x7ff860146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:14.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.914+0000 7ff866092640 1 -- 172.21.15.96:0/3324194778 >> 172.21.15.96:0/3324194778 conn(0x7ff86006b470 msgr2=0x7ff860071590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:14.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.914+0000 7ff866092640 1 -- 172.21.15.96:0/3324194778 shutdown_connections 2024-04-18T04:55:14.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:14.914+0000 7ff866092640 1 -- 172.21.15.96:0/3324194778 wait complete. 2024-04-18T04:55:14.932 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-18T04:55:15.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.038+0000 7f6bce9db640 1 Processor -- start 2024-04-18T04:55:15.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.038+0000 7f6bce9db640 1 -- start start 2024-04-18T04:55:15.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bce9db640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6bc80c6830 0x7f6bc81562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bce9db640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6bc8071160 0x7f6bc8156800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bce9db640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc806bbd0 con 0x7f6bc80c6450 2024-04-18T04:55:15.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bce9db640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc806c6f0 con 0x7f6bc8071160 2024-04-18T04:55:15.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bce9db640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc806b9e0 con 0x7f6bc80c6830 2024-04-18T04:55:15.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bccf78640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6bc8071160 0x7f6bc8156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bccf78640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6bc8071160 0x7f6bc8156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37586/0 (socket says 172.21.15.96:37586) 2024-04-18T04:55:15.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bccf78640 1 -- 172.21.15.96:0/1749090369 learned_addr learned my addr 172.21.15.96:0/1749090369 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bc77fe640 1 --2- 172.21.15.96:0/1749090369 >> v2:172.21.15.139:3300/0 conn(0x7f6bc80c6830 0x7f6bc81562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bccf78640 1 -- 172.21.15.96:0/1749090369 >> v2:172.21.15.139:3300/0 conn(0x7f6bc80c6830 msgr2=0x7f6bc81562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bccf78640 1 --2- 172.21.15.96:0/1749090369 >> v2:172.21.15.139:3300/0 conn(0x7f6bc80c6830 0x7f6bc81562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bccf78640 1 -- 172.21.15.96:0/1749090369 >> v1:172.21.15.139:6789/0 conn(0x7f6bc80c6450 legacy=0x7f6bc80c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bccf78640 1 -- 172.21.15.96:0/1749090369 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc806be70 con 0x7f6bc8071160 2024-04-18T04:55:15.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bccf78640 1 --2- 172.21.15.96:0/1749090369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc8071160 0x7f6bc8156800 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009e50 tx=0x7f6bc001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0392b1211cc071 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bc6ffd640 1 -- 172.21.15.96:0/1749090369 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00a5760 con 0x7f6bc8071160 2024-04-18T04:55:15.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bc6ffd640 1 -- 172.21.15.96:0/1749090369 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc00a58c0 con 0x7f6bc8071160 2024-04-18T04:55:15.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bc6ffd640 1 -- 172.21.15.96:0/1749090369 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00a5c50 con 0x7f6bc8071160 2024-04-18T04:55:15.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bce9db640 1 -- 172.21.15.96:0/1749090369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc8071160 msgr2=0x7f6bc8156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bce9db640 1 --2- 172.21.15.96:0/1749090369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc8071160 0x7f6bc8156800 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009e50 tx=0x7f6bc001c9b0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bce9db640 1 -- 172.21.15.96:0/1749090369 shutdown_connections 2024-04-18T04:55:15.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bce9db640 1 --2- 172.21.15.96:0/1749090369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc8071160 0x7f6bc8156800 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bce9db640 1 --2- 172.21.15.96:0/1749090369 >> v2:172.21.15.139:3300/0 conn(0x7f6bc80c6830 0x7f6bc81562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bce9db640 1 -- 172.21.15.96:0/1749090369 >> 172.21.15.96:0/1749090369 conn(0x7f6bc806a8e0 msgr2=0x7f6bc80c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bce9db640 1 -- 172.21.15.96:0/1749090369 shutdown_connections 2024-04-18T04:55:15.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.042+0000 7f6bce9db640 1 -- 172.21.15.96:0/1749090369 wait complete. 2024-04-18T04:55:15.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bce9db640 1 Processor -- start 2024-04-18T04:55:15.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bce9db640 1 -- start start 2024-04-18T04:55:15.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bce9db640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6bc8071160 0x7f6bc806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bce9db640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6bc80c6450 0x7f6bc81efb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bce9db640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc80c6830 0x7f6bc81f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bce9db640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc81574b0 con 0x7f6bc80c6830 2024-04-18T04:55:15.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bce9db640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc814c060 con 0x7f6bc8071160 2024-04-18T04:55:15.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bce9db640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc8149770 con 0x7f6bc80c6450 2024-04-18T04:55:15.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bccf78640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc80c6830 0x7f6bc81f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bccf78640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc80c6830 0x7f6bc81f00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37588/0 (socket says 172.21.15.96:37588) 2024-04-18T04:55:15.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bccf78640 1 -- 172.21.15.96:0/3327866497 learned_addr learned my addr 172.21.15.96:0/3327866497 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bc77fe640 1 --2- 172.21.15.96:0/3327866497 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6bc80c6450 0x7f6bc81efb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bc7fff640 1 --2- 172.21.15.96:0/3327866497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6bc8071160 0x7f6bc806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bccf78640 1 -- 172.21.15.96:0/3327866497 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6bc80c6450 msgr2=0x7f6bc81efb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bccf78640 1 --2- 172.21.15.96:0/3327866497 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6bc80c6450 0x7f6bc81efb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bccf78640 1 -- 172.21.15.96:0/3327866497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6bc8071160 msgr2=0x7f6bc806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bccf78640 1 --2- 172.21.15.96:0/3327866497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6bc8071160 0x7f6bc806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bccf78640 1 -- 172.21.15.96:0/3327866497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc0009b30 con 0x7f6bc80c6830 2024-04-18T04:55:15.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bccf78640 1 --2- 172.21.15.96:0/3327866497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc80c6830 0x7f6bc81f00d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009e50 tx=0x7f6bc0019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bc4ff9640 1 -- 172.21.15.96:0/3327866497 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00b8670 con 0x7f6bc80c6830 2024-04-18T04:55:15.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bc4ff9640 1 -- 172.21.15.96:0/3327866497 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc00b87d0 con 0x7f6bc80c6830 2024-04-18T04:55:15.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bce9db640 1 -- 172.21.15.96:0/3327866497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc80c2090 con 0x7f6bc80c6830 2024-04-18T04:55:15.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bc4ff9640 1 -- 172.21.15.96:0/3327866497 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00b8b60 con 0x7f6bc80c6830 2024-04-18T04:55:15.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.046+0000 7f6bce9db640 1 -- 172.21.15.96:0/3327866497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc814ba10 con 0x7f6bc80c6830 2024-04-18T04:55:15.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bc4ff9640 1 -- 172.21.15.96:0/3327866497 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6bc00b8cc0 con 0x7f6bc80c6830 2024-04-18T04:55:15.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bc4ff9640 1 --2- 172.21.15.96:0/3327866497 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6bb4066690 0x7f6bb4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bc4ff9640 1 -- 172.21.15.96:0/3327866497 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bc011f630 con 0x7f6bc80c6830 2024-04-18T04:55:15.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bc7fff640 1 --2- 172.21.15.96:0/3327866497 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6bb4066690 0x7f6bb4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bc7fff640 1 --2- 172.21.15.96:0/3327866497 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6bb4066690 0x7f6bb4068b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800b810 tx=0x7f6bb8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 Processor -- start 2024-04-18T04:55:15.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 -- start start 2024-04-18T04:55:15.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cf0af0 0x5651f3cba700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5651f3cf0ed0 0x5651f3cbac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cf4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f3b7ce80 con 0x5651f3cf4b30 2024-04-18T04:55:15.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f3b0aaf0 con 0x5651f3cf0af0 2024-04-18T04:55:15.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651f3b080c0 con 0x5651f3cf0ed0 2024-04-18T04:55:15.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bccf78640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cf4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bccf78640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cf4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37594/0 (socket says 172.21.15.96:37594) 2024-04-18T04:55:15.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bccf78640 1 -- 172.21.15.96:0/2095181050 learned_addr learned my addr 172.21.15.96:0/2095181050 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bccf78640 1 -- 172.21.15.96:0/2095181050 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5651f3cf0ed0 msgr2=0x5651f3cbac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bc7fff640 1 --2- 172.21.15.96:0/2095181050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cf0af0 0x5651f3cba700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bccf78640 1 --2- 172.21.15.96:0/2095181050 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5651f3cf0ed0 0x5651f3cbac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bccf78640 1 -- 172.21.15.96:0/2095181050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cf0af0 msgr2=0x5651f3cba700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bccf78640 1 --2- 172.21.15.96:0/2095181050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cf0af0 0x5651f3cba700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bccf78640 1 -- 172.21.15.96:0/2095181050 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651f37ff890 con 0x5651f3cf4b30 2024-04-18T04:55:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bccf78640 1 --2- 172.21.15.96:0/2095181050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cf4f10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6bc011dc10 tx=0x7f6bc00f0220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9f00f559744573 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6badffb640 1 -- 172.21.15.96:0/2095181050 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00f8c00 con 0x5651f3cf4b30 2024-04-18T04:55:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6badffb640 1 -- 172.21.15.96:0/2095181050 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc00eea00 con 0x5651f3cf4b30 2024-04-18T04:55:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6badffb640 1 -- 172.21.15.96:0/2095181050 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00ecfd0 con 0x5651f3cf4b30 2024-04-18T04:55:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/2095181050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 msgr2=0x5651f3cf4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/2095181050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cf4f10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6bc011dc10 tx=0x7f6bc00f0220 comp rx=0 tx=0).stop 2024-04-18T04:55:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/2095181050 shutdown_connections 2024-04-18T04:55:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/2095181050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cf4f10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/2095181050 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5651f3cf0ed0 0x5651f3cbac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/2095181050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cf0af0 0x5651f3cba700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/2095181050 >> 172.21.15.96:0/2095181050 conn(0x5651f3cbb190 msgr2=0x5651f3cbb570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/2095181050 shutdown_connections 2024-04-18T04:55:15.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.050+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/2095181050 wait complete. 2024-04-18T04:55:15.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 -- start start 2024-04-18T04:55:15.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 Processor -- start 2024-04-18T04:55:15.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5651f3cf0af0 0x5651f3cb9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cfb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cb9e90 0x5651f3cfb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f3b039b0 con 0x5651f3cf4b30 2024-04-18T04:55:15.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f3aa2c00 con 0x5651f3cb9e90 2024-04-18T04:55:15.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651f3ac1070 con 0x5651f3cf0af0 2024-04-18T04:55:15.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 10 client.0 _ll_register_callbacks cb 0x5651f3ca0ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:55:15.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bc77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cfb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bc77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cfb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37598/0 (socket says 172.21.15.96:37598) 2024-04-18T04:55:15.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bc77fe640 1 -- 172.21.15.96:0/1688190158 learned_addr learned my addr 172.21.15.96:0/1688190158 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bc77fe640 1 -- 172.21.15.96:0/1688190158 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5651f3cf0af0 msgr2=0x5651f3cb9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bc77fe640 1 --2- 172.21.15.96:0/1688190158 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5651f3cf0af0 0x5651f3cb9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bc77fe640 1 -- 172.21.15.96:0/1688190158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cb9e90 msgr2=0x5651f3cfb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bc77fe640 1 --2- 172.21.15.96:0/1688190158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cb9e90 0x5651f3cfb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bc77fe640 1 -- 172.21.15.96:0/1688190158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc814ba10 con 0x5651f3cf4b30 2024-04-18T04:55:15.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bc77fe640 1 --2- 172.21.15.96:0/1688190158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cfb390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00be60 tx=0x7f6bbc00f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9b0edad36fce0e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6ba6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-04-18T04:55:15.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6ba6ffd640 1 -- 172.21.15.96:0/1688190158 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc004230 con 0x5651f3cf4b30 2024-04-18T04:55:15.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6ba6ffd640 1 -- 172.21.15.96:0/1688190158 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bbc004390 con 0x5651f3cf4b30 2024-04-18T04:55:15.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/1688190158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651f3ac05f0 con 0x5651f3cf4b30 2024-04-18T04:55:15.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6ba6ffd640 1 -- 172.21.15.96:0/1688190158 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bbc003620 con 0x5651f3cf4b30 2024-04-18T04:55:15.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 10 client.4776 fetch_fsmap learned FSMap version 17 2024-04-18T04:55:15.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/1688190158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5651f3ac8ab0 con 0x5651f3cf4b30 2024-04-18T04:55:15.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6ba6ffd640 1 -- 172.21.15.96:0/1688190158 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5651f3ac05f0 con 0x5651f3cf4b30 2024-04-18T04:55:15.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6ba6ffd640 1 -- 172.21.15.96:0/1688190158 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 17) v1 ==== 4252+0+0 (secure 0 0 0) 0x7f6bbc003780 con 0x5651f3cf4b30 2024-04-18T04:55:15.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 10 client.4776 fetch_fsmap finished waiting for FSMap version 17 2024-04-18T04:55:15.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 10 client.4776 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-18T04:55:15.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 20 client.4776 populate_metadata read hostname 'smithi096' 2024-04-18T04:55:15.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/1688190158 >> [v2:172.21.15.96:6834/1188672263,v1:172.21.15.96:6835/1188672263] conn(0x5651f3cfc670 0x5651f3d0bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 4 client.4776 mds_command: new command op to 4239 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-18T04:55:15.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/1688190158 --> [v2:172.21.15.96:6834/1188672263,v1:172.21.15.96:6835/1188672263] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651f3b00790 con 0x5651f3cfc670 2024-04-18T04:55:15.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bc7fff640 1 --2- 172.21.15.96:0/1688190158 >> [v2:172.21.15.96:6834/1188672263,v1:172.21.15.96:6835/1188672263] conn(0x5651f3cfc670 0x5651f3d0bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6ba6ffd640 10 client.4776 ms_handle_connect on v2:172.21.15.96:6834/1188672263 2024-04-18T04:55:15.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bc7fff640 1 --2- 172.21.15.96:0/1688190158 >> [v2:172.21.15.96:6834/1188672263,v1:172.21.15.96:6835/1188672263] conn(0x5651f3cfc670 0x5651f3d0bb50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b6567053f07a3c81 server_cookie=7dca3a10582d038b in_seq=0 out_seq=0 2024-04-18T04:55:15.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6ba6ffd640 1 -- 172.21.15.96:0/1688190158 <== mds.2 v2:172.21.15.96:6834/1188672263 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5651f3b00790 con 0x5651f3cfc670 2024-04-18T04:55:15.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6ba6ffd640 10 client.4776 handle_command_reply: tid=0 2024-04-18T04:55:15.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 client.4776 shutdown 2024-04-18T04:55:15.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/1688190158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 msgr2=0x5651f3cfb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/1688190158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cfb390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00be60 tx=0x7f6bbc00f5b0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/1688190158 shutdown_connections 2024-04-18T04:55:15.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/1688190158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cb9e90 0x5651f3cfb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/1688190158 >> [v2:172.21.15.96:6834/1188672263,v1:172.21.15.96:6835/1188672263] conn(0x5651f3cfc670 0x5651f3d0bb50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/1688190158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cfb390 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/1688190158 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5651f3cf0af0 0x5651f3cb9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6ba6ffd640 0 client.4776 ms_handle_reset on v2:172.21.15.96:6834/1188672263 2024-04-18T04:55:15.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/1688190158 >> 172.21.15.96:0/1688190158 conn(0x5651f3cbb190 msgr2=0x5651f3cf34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/1688190158 shutdown_connections 2024-04-18T04:55:15.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.054+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/1688190158 wait complete. 2024-04-18T04:55:15.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.058+0000 7f6bd1b1d000 20 client.4776 trim_cache size 0 max 16384 2024-04-18T04:55:15.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.070+0000 7f6bd1b1d000 1 Processor -- start 2024-04-18T04:55:15.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.070+0000 7f6bd1b1d000 1 -- start start 2024-04-18T04:55:15.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.070+0000 7f6bd1b1d000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5651f3cb9e90 0x5651f3cb5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.070+0000 7f6bd1b1d000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cf0af0 0x5651f3cb6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.070+0000 7f6bd1b1d000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cb6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.070+0000 7f6bd1b1d000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f37c0940 con 0x5651f3cf4b30 2024-04-18T04:55:15.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.070+0000 7f6bd1b1d000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f3aa0c10 con 0x5651f3cf0af0 2024-04-18T04:55:15.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.070+0000 7f6bd1b1d000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651f3b011c0 con 0x5651f3cb9e90 2024-04-18T04:55:15.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.070+0000 7f6bccf78640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cb6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.070+0000 7f6bccf78640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cb6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37600/0 (socket says 172.21.15.96:37600) 2024-04-18T04:55:15.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.070+0000 7f6bccf78640 1 -- 172.21.15.96:0/1564317550 learned_addr learned my addr 172.21.15.96:0/1564317550 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bccf78640 1 -- 172.21.15.96:0/1564317550 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5651f3cb9e90 msgr2=0x5651f3cb5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bccf78640 1 --2- 172.21.15.96:0/1564317550 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5651f3cb9e90 0x5651f3cb5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bccf78640 1 -- 172.21.15.96:0/1564317550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cf0af0 msgr2=0x5651f3cb6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bccf78640 1 --2- 172.21.15.96:0/1564317550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cf0af0 0x5651f3cb6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bccf78640 1 -- 172.21.15.96:0/1564317550 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651f3aaec00 con 0x5651f3cf4b30 2024-04-18T04:55:15.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bccf78640 1 --2- 172.21.15.96:0/1564317550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cb6960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00ecdc0 tx=0x7f6bc011f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1199db5851b804ca server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bae7fc640 1 -- 172.21.15.96:0/1564317550 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00ecc00 con 0x5651f3cf4b30 2024-04-18T04:55:15.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bae7fc640 1 -- 172.21.15.96:0/1564317550 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc00f0690 con 0x5651f3cf4b30 2024-04-18T04:55:15.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bae7fc640 1 -- 172.21.15.96:0/1564317550 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00f8c00 con 0x5651f3cf4b30 2024-04-18T04:55:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/1564317550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 msgr2=0x5651f3cb6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/1564317550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cb6960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00ecdc0 tx=0x7f6bc011f040 comp rx=0 tx=0).stop 2024-04-18T04:55:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/1564317550 shutdown_connections 2024-04-18T04:55:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/1564317550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3cb6960 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/1564317550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cf0af0 0x5651f3cb6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/1564317550 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5651f3cb9e90 0x5651f3cb5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/1564317550 >> 172.21.15.96:0/1564317550 conn(0x5651f3cbb190 msgr2=0x5651f3cfaf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/1564317550 shutdown_connections 2024-04-18T04:55:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/1564317550 wait complete. 2024-04-18T04:55:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 -- start start 2024-04-18T04:55:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 Processor -- start 2024-04-18T04:55:15.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cb9e90 0x5651f3cb87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5651f3cf0af0 0x5651f3d58ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3d59410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f3b079b0 con 0x5651f3cf4b30 2024-04-18T04:55:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f3b02840 con 0x5651f3cb9e90 2024-04-18T04:55:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651f3acac60 con 0x5651f3cf0af0 2024-04-18T04:55:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 10 client.0 _ll_register_callbacks cb 0x5651f3ad0ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:55:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bccf78640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3d59410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bccf78640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3d59410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37610/0 (socket says 172.21.15.96:37610) 2024-04-18T04:55:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bccf78640 1 -- 172.21.15.96:0/105259283 learned_addr learned my addr 172.21.15.96:0/105259283 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bccf78640 1 -- 172.21.15.96:0/105259283 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5651f3cf0af0 msgr2=0x5651f3d58ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bccf78640 1 --2- 172.21.15.96:0/105259283 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5651f3cf0af0 0x5651f3d58ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bccf78640 1 -- 172.21.15.96:0/105259283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cb9e90 msgr2=0x5651f3cb87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bccf78640 1 --2- 172.21.15.96:0/105259283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cb9e90 0x5651f3cb87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bccf78640 1 -- 172.21.15.96:0/105259283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651f37ff890 con 0x5651f3cf4b30 2024-04-18T04:55:15.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bccf78640 1 --2- 172.21.15.96:0/105259283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3d59410 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00072a0 tx=0x7f6bc0009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68edc0cbfe63d2d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6ba6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-04-18T04:55:15.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6ba6ffd640 1 -- 172.21.15.96:0/105259283 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00f0b20 con 0x5651f3cf4b30 2024-04-18T04:55:15.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6ba6ffd640 1 -- 172.21.15.96:0/105259283 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bc00f0c80 con 0x5651f3cf4b30 2024-04-18T04:55:15.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/105259283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651f3ad3460 con 0x5651f3cf4b30 2024-04-18T04:55:15.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6ba6ffd640 1 -- 172.21.15.96:0/105259283 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bc00efdb0 con 0x5651f3cf4b30 2024-04-18T04:55:15.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 10 client.4782 fetch_fsmap learned FSMap version 17 2024-04-18T04:55:15.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/105259283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5651f37ffcc0 con 0x5651f3cf4b30 2024-04-18T04:55:15.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6ba6ffd640 1 -- 172.21.15.96:0/105259283 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5651f3ad3460 con 0x5651f3cf4b30 2024-04-18T04:55:15.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6ba6ffd640 1 -- 172.21.15.96:0/105259283 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 17) v1 ==== 4252+0+0 (secure 0 0 0) 0x7f6bc00c8020 con 0x5651f3cf4b30 2024-04-18T04:55:15.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 10 client.4782 fetch_fsmap finished waiting for FSMap version 17 2024-04-18T04:55:15.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 10 client.4782 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-18T04:55:15.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 20 client.4782 populate_metadata read hostname 'smithi096' 2024-04-18T04:55:15.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/105259283 >> [v2:172.21.15.96:6834/1188672263,v1:172.21.15.96:6835/1188672263] conn(0x5651f3d524a0 0x5651f3d52880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 4 client.4782 mds_command: new command op to 4239 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-18T04:55:15.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/105259283 --> [v2:172.21.15.96:6834/1188672263,v1:172.21.15.96:6835/1188672263] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5651f3acc9c0 con 0x5651f3d524a0 2024-04-18T04:55:15.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.074+0000 7f6bc7fff640 1 --2- 172.21.15.96:0/105259283 >> [v2:172.21.15.96:6834/1188672263,v1:172.21.15.96:6835/1188672263] conn(0x5651f3d524a0 0x5651f3d52880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6ba6ffd640 10 client.4782 ms_handle_connect on v2:172.21.15.96:6834/1188672263 2024-04-18T04:55:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bc7fff640 1 --2- 172.21.15.96:0/105259283 >> [v2:172.21.15.96:6834/1188672263,v1:172.21.15.96:6835/1188672263] conn(0x5651f3d524a0 0x5651f3d52880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e430b2d8619bf6a3 server_cookie=2112aa5e1c9481c in_seq=0 out_seq=0 2024-04-18T04:55:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6ba6ffd640 1 -- 172.21.15.96:0/105259283 <== mds.2 v2:172.21.15.96:6834/1188672263 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5651f3acc9c0 con 0x5651f3d524a0 2024-04-18T04:55:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6ba6ffd640 10 client.4782 handle_command_reply: tid=0 2024-04-18T04:55:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bd1b1d000 1 client.4782 shutdown 2024-04-18T04:55:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/105259283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 msgr2=0x5651f3d59410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/105259283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3d59410 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00072a0 tx=0x7f6bc0009810 comp rx=0 tx=0).stop 2024-04-18T04:55:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/105259283 shutdown_connections 2024-04-18T04:55:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/105259283 >> [v2:172.21.15.96:6834/1188672263,v1:172.21.15.96:6835/1188672263] conn(0x5651f3d524a0 0x5651f3d52880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/105259283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5651f3cf4b30 0x5651f3d59410 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/105259283 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5651f3cf0af0 0x5651f3d58ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bd1b1d000 1 --2- 172.21.15.96:0/105259283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651f3cb9e90 0x5651f3cb87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/105259283 >> 172.21.15.96:0/105259283 conn(0x5651f3cbb190 msgr2=0x5651f3cfb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6ba6ffd640 0 client.4782 ms_handle_reset on v2:172.21.15.96:6834/1188672263 2024-04-18T04:55:15.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/105259283 shutdown_connections 2024-04-18T04:55:15.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bd1b1d000 1 -- 172.21.15.96:0/105259283 wait complete. 2024-04-18T04:55:15.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bd1b1d000 20 client.4782 trim_cache size 0 max 16384 2024-04-18T04:55:15.087 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:55:15.087 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:55:15.087 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 2, 2024-04-18T04:55:15.087 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4239, 2024-04-18T04:55:15.087 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2024-04-18T04:55:15.087 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2024-04-18T04:55:15.087 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2024-04-18T04:55:15.087 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 22.792057989, 2024-04-18T04:55:15.088 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 17, 2024-04-18T04:55:15.088 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 21, 2024-04-18T04:55:15.088 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 21, 2024-04-18T04:55:15.088 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 40.345600251999997 2024-04-18T04:55:15.088 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:55:15.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bce9db640 1 -- 172.21.15.96:0/3327866497 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6bb4066690 msgr2=0x7f6bb4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bce9db640 1 --2- 172.21.15.96:0/3327866497 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6bb4066690 0x7f6bb4068b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800b810 tx=0x7f6bb8008040 comp rx=0 tx=0).stop 2024-04-18T04:55:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bce9db640 1 -- 172.21.15.96:0/3327866497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc80c6830 msgr2=0x7f6bc81f00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bce9db640 1 --2- 172.21.15.96:0/3327866497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc80c6830 0x7f6bc81f00d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009e50 tx=0x7f6bc0019750 comp rx=0 tx=0).stop 2024-04-18T04:55:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bce9db640 1 -- 172.21.15.96:0/3327866497 shutdown_connections 2024-04-18T04:55:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bce9db640 1 --2- 172.21.15.96:0/3327866497 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6bb4066690 0x7f6bb4068b50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bce9db640 1 --2- 172.21.15.96:0/3327866497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc80c6830 0x7f6bc81f00d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bce9db640 1 --2- 172.21.15.96:0/3327866497 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6bc80c6450 0x7f6bc81efb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bce9db640 1 --2- 172.21.15.96:0/3327866497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6bc8071160 0x7f6bc806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bce9db640 1 -- 172.21.15.96:0/3327866497 >> 172.21.15.96:0/3327866497 conn(0x7f6bc806a8e0 msgr2=0x7f6bc8070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bce9db640 1 -- 172.21.15.96:0/3327866497 shutdown_connections 2024-04-18T04:55:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.078+0000 7f6bce9db640 1 -- 172.21.15.96:0/3327866497 wait complete. 2024-04-18T04:55:15.097 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-18T04:55:15.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.206+0000 7f8a31e60640 1 Processor -- start 2024-04-18T04:55:15.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.206+0000 7f8a31e60640 1 -- start start 2024-04-18T04:55:15.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.206+0000 7f8a31e60640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8a2c070180 0x7f8a2c15db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.206+0000 7f8a31e60640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8a2c1578f0 0x7f8a2c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.206+0000 7f8a31e60640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2c15d6f0 con 0x7f8a2c157510 2024-04-18T04:55:15.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.206+0000 7f8a31e60640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c0705f0 con 0x7f8a2c1578f0 2024-04-18T04:55:15.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.206+0000 7f8a31e60640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c15d3a0 con 0x7f8a2c070180 2024-04-18T04:55:15.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.206+0000 7f8a2bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8a2c1578f0 0x7f8a2c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.206+0000 7f8a2bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8a2c1578f0 0x7f8a2c06b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37612/0 (socket says 172.21.15.96:37612) 2024-04-18T04:55:15.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.206+0000 7f8a2bfff640 1 -- 172.21.15.96:0/1695201659 learned_addr learned my addr 172.21.15.96:0/1695201659 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.206+0000 7f8a2affd640 1 --2- 172.21.15.96:0/1695201659 >> v2:172.21.15.139:3300/0 conn(0x7f8a2c070180 0x7f8a2c15db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.206+0000 7f8a2bfff640 1 -- 172.21.15.96:0/1695201659 >> v2:172.21.15.139:3300/0 conn(0x7f8a2c070180 msgr2=0x7f8a2c15db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.206+0000 7f8a2bfff640 1 --2- 172.21.15.96:0/1695201659 >> v2:172.21.15.139:3300/0 conn(0x7f8a2c070180 0x7f8a2c15db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.206+0000 7f8a2bfff640 1 -- 172.21.15.96:0/1695201659 >> v1:172.21.15.139:6789/0 conn(0x7f8a2c157510 legacy=0x7f8a2c0c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.206+0000 7f8a2bfff640 1 -- 172.21.15.96:0/1695201659 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c160ef0 con 0x7f8a2c1578f0 2024-04-18T04:55:15.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a2bfff640 1 --2- 172.21.15.96:0/1695201659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a2c1578f0 0x7f8a2c06b9e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c06fda0 tx=0x7f8a2401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e859987082eb627d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a2a7fc640 1 -- 172.21.15.96:0/1695201659 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a240a5640 con 0x7f8a2c1578f0 2024-04-18T04:55:15.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a2a7fc640 1 -- 172.21.15.96:0/1695201659 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a240a57a0 con 0x7f8a2c1578f0 2024-04-18T04:55:15.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a2a7fc640 1 -- 172.21.15.96:0/1695201659 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a240a5b30 con 0x7f8a2c1578f0 2024-04-18T04:55:15.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a31e60640 1 -- 172.21.15.96:0/1695201659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a2c1578f0 msgr2=0x7f8a2c06b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a31e60640 1 --2- 172.21.15.96:0/1695201659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a2c1578f0 0x7f8a2c06b9e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c06fda0 tx=0x7f8a2401c890 comp rx=0 tx=0).stop 2024-04-18T04:55:15.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a31e60640 1 -- 172.21.15.96:0/1695201659 shutdown_connections 2024-04-18T04:55:15.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a31e60640 1 --2- 172.21.15.96:0/1695201659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a2c1578f0 0x7f8a2c06b9e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a31e60640 1 --2- 172.21.15.96:0/1695201659 >> v2:172.21.15.139:3300/0 conn(0x7f8a2c070180 0x7f8a2c15db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a31e60640 1 -- 172.21.15.96:0/1695201659 >> 172.21.15.96:0/1695201659 conn(0x7f8a2c06a8e0 msgr2=0x7f8a2c0c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a31e60640 1 -- 172.21.15.96:0/1695201659 shutdown_connections 2024-04-18T04:55:15.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a31e60640 1 -- 172.21.15.96:0/1695201659 wait complete. 2024-04-18T04:55:15.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a31e60640 1 Processor -- start 2024-04-18T04:55:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a31e60640 1 -- start start 2024-04-18T04:55:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a31e60640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a2c070180 0x7f8a2c156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a31e60640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a2c157510 0x7f8a2c0c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a31e60640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8a2c1578f0 0x7f8a2c0c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a31e60640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c14cbd0 con 0x7f8a2c157510 2024-04-18T04:55:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a31e60640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0c3390 con 0x7f8a2c070180 2024-04-18T04:55:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a31e60640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c1f6ee0 con 0x7f8a2c1578f0 2024-04-18T04:55:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a2affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a2c157510 0x7f8a2c0c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a2affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a2c157510 0x7f8a2c0c3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37614/0 (socket says 172.21.15.96:37614) 2024-04-18T04:55:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.210+0000 7f8a2affd640 1 -- 172.21.15.96:0/2413029493 learned_addr learned my addr 172.21.15.96:0/2413029493 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a2b7fe640 1 --2- 172.21.15.96:0/2413029493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a2c070180 0x7f8a2c156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a2bfff640 1 --2- 172.21.15.96:0/2413029493 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8a2c1578f0 0x7f8a2c0c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a2affd640 1 -- 172.21.15.96:0/2413029493 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8a2c1578f0 msgr2=0x7f8a2c0c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a2affd640 1 --2- 172.21.15.96:0/2413029493 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8a2c1578f0 0x7f8a2c0c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a2affd640 1 -- 172.21.15.96:0/2413029493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a2c070180 msgr2=0x7f8a2c156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a2affd640 1 --2- 172.21.15.96:0/2413029493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a2c070180 0x7f8a2c156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a2affd640 1 -- 172.21.15.96:0/2413029493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a24009b30 con 0x7f8a2c157510 2024-04-18T04:55:15.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a2bfff640 1 --2- 172.21.15.96:0/2413029493 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8a2c1578f0 0x7f8a2c0c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:15.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a2affd640 1 --2- 172.21.15.96:0/2413029493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a2c157510 0x7f8a2c0c3e30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400d5f0 tx=0x7f8a1400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a23fff640 1 -- 172.21.15.96:0/2413029493 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a140125f0 con 0x7f8a2c157510 2024-04-18T04:55:15.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a23fff640 1 -- 172.21.15.96:0/2413029493 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a14012750 con 0x7f8a2c157510 2024-04-18T04:55:15.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a31e60640 1 -- 172.21.15.96:0/2413029493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2c0c3630 con 0x7f8a2c157510 2024-04-18T04:55:15.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a23fff640 1 -- 172.21.15.96:0/2413029493 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a14012ae0 con 0x7f8a2c157510 2024-04-18T04:55:15.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a31e60640 1 -- 172.21.15.96:0/2413029493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c14d5b0 con 0x7f8a2c157510 2024-04-18T04:55:15.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a23fff640 1 -- 172.21.15.96:0/2413029493 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8a14012c40 con 0x7f8a2c157510 2024-04-18T04:55:15.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a23fff640 1 --2- 172.21.15.96:0/2413029493 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8a0c066690 0x7f8a0c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a2b7fe640 1 --2- 172.21.15.96:0/2413029493 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8a0c066690 0x7f8a0c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a23fff640 1 -- 172.21.15.96:0/2413029493 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a140846c0 con 0x7f8a2c157510 2024-04-18T04:55:15.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a2b7fe640 1 --2- 172.21.15.96:0/2413029493 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8a0c066690 0x7f8a0c068b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c004e30 tx=0x7f8a1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a34fa2000 1 Processor -- start 2024-04-18T04:55:15.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.214+0000 7f8a34fa2000 1 -- start start 2024-04-18T04:55:15.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b21731af0 0x557b216fb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b21731ed0 0x557b216fbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21735f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b215bde80 con 0x557b21735b30 2024-04-18T04:55:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b2154baf0 con 0x557b21731ed0 2024-04-18T04:55:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b215490c0 con 0x557b21731af0 2024-04-18T04:55:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21735f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21735f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37618/0 (socket says 172.21.15.96:37618) 2024-04-18T04:55:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2bfff640 1 -- 172.21.15.96:0/3279841729 learned_addr learned my addr 172.21.15.96:0/3279841729 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2b7fe640 1 --2- 172.21.15.96:0/3279841729 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b21731af0 0x557b216fb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2affd640 1 --2- 172.21.15.96:0/3279841729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b21731ed0 0x557b216fbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2bfff640 1 -- 172.21.15.96:0/3279841729 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b21731af0 msgr2=0x557b216fb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2bfff640 1 --2- 172.21.15.96:0/3279841729 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b21731af0 0x557b216fb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2bfff640 1 -- 172.21.15.96:0/3279841729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b21731ed0 msgr2=0x557b216fbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2bfff640 1 --2- 172.21.15.96:0/3279841729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b21731ed0 0x557b216fbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2bfff640 1 -- 172.21.15.96:0/3279841729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b21240890 con 0x557b21735b30 2024-04-18T04:55:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2bfff640 1 --2- 172.21.15.96:0/3279841729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21735f10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8a2401c8d0 tx=0x7f8a24004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128b5ff22e62e6a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a217fa640 1 -- 172.21.15.96:0/3279841729 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a240a5910 con 0x557b21735b30 2024-04-18T04:55:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a217fa640 1 -- 172.21.15.96:0/3279841729 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a240a5a70 con 0x557b21735b30 2024-04-18T04:55:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a217fa640 1 -- 172.21.15.96:0/3279841729 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a240a5e20 con 0x557b21735b30 2024-04-18T04:55:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 -- 172.21.15.96:0/3279841729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 msgr2=0x557b21735f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/3279841729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21735f10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8a2401c8d0 tx=0x7f8a24004ac0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 -- 172.21.15.96:0/3279841729 shutdown_connections 2024-04-18T04:55:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/3279841729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21735f10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/3279841729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b21731ed0 0x557b216fbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/3279841729 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b21731af0 0x557b216fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 -- 172.21.15.96:0/3279841729 >> 172.21.15.96:0/3279841729 conn(0x557b216fc190 msgr2=0x557b216fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 -- 172.21.15.96:0/3279841729 shutdown_connections 2024-04-18T04:55:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 -- 172.21.15.96:0/3279841729 wait complete. 2024-04-18T04:55:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 -- start start 2024-04-18T04:55:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 Processor -- start 2024-04-18T04:55:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b21731af0 0x557b216fa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b216fac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b2173c390 0x557b2173c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b215449b0 con 0x557b21735b30 2024-04-18T04:55:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b214e3c00 con 0x557b2173c390 2024-04-18T04:55:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b21502070 con 0x557b21731af0 2024-04-18T04:55:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a34fa2000 10 client.0 _ll_register_callbacks cb 0x557b216e1ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:55:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b216fac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b216fac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37628/0 (socket says 172.21.15.96:37628) 2024-04-18T04:55:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2affd640 1 -- 172.21.15.96:0/4111605376 learned_addr learned my addr 172.21.15.96:0/4111605376 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2b7fe640 1 --2- 172.21.15.96:0/4111605376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b21731af0 0x557b216fa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2affd640 1 -- 172.21.15.96:0/4111605376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b21731af0 msgr2=0x557b216fa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2bfff640 1 --2- 172.21.15.96:0/4111605376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b2173c390 0x557b2173c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2affd640 1 --2- 172.21.15.96:0/4111605376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b21731af0 0x557b216fa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2affd640 1 -- 172.21.15.96:0/4111605376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b2173c390 msgr2=0x557b2173c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2affd640 1 --2- 172.21.15.96:0/4111605376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b2173c390 0x557b2173c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.218+0000 7f8a2affd640 1 -- 172.21.15.96:0/4111605376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c160ef0 con 0x557b21735b30 2024-04-18T04:55:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a2affd640 1 --2- 172.21.15.96:0/4111605376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b216fac20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400d5c0 tx=0x7f8a14055f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62f214727aab1c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a0a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-04-18T04:55:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a0a7fc640 1 -- 172.21.15.96:0/4111605376 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a14059170 con 0x557b21735b30 2024-04-18T04:55:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a0a7fc640 1 -- 172.21.15.96:0/4111605376 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a140592d0 con 0x557b21735b30 2024-04-18T04:55:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 1 -- 172.21.15.96:0/4111605376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b215015f0 con 0x557b21735b30 2024-04-18T04:55:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a0a7fc640 1 -- 172.21.15.96:0/4111605376 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a14054be0 con 0x557b21735b30 2024-04-18T04:55:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 10 client.4794 fetch_fsmap learned FSMap version 17 2024-04-18T04:55:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 1 -- 172.21.15.96:0/4111605376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x557b21509ab0 con 0x557b21735b30 2024-04-18T04:55:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a0a7fc640 1 -- 172.21.15.96:0/4111605376 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b215015f0 con 0x557b21735b30 2024-04-18T04:55:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a0a7fc640 1 -- 172.21.15.96:0/4111605376 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 17) v1 ==== 4252+0+0 (secure 0 0 0) 0x7f8a1405d650 con 0x557b21735b30 2024-04-18T04:55:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 10 client.4794 fetch_fsmap finished waiting for FSMap version 17 2024-04-18T04:55:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 10 client.4794 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-18T04:55:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 20 client.4794 populate_metadata read hostname 'smithi096' 2024-04-18T04:55:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/4111605376 >> [v2:172.21.15.96:6836/4278976485,v1:172.21.15.96:6837/4278976485] conn(0x557b2173d510 0x557b2173d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 4 client.4794 mds_command: new command op to 4249 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-18T04:55:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 1 -- 172.21.15.96:0/4111605376 --> [v2:172.21.15.96:6836/4278976485,v1:172.21.15.96:6837/4278976485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b21541790 con 0x557b2173d510 2024-04-18T04:55:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a2b7fe640 1 --2- 172.21.15.96:0/4111605376 >> [v2:172.21.15.96:6836/4278976485,v1:172.21.15.96:6837/4278976485] conn(0x557b2173d510 0x557b2173d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a2b7fe640 1 --2- 172.21.15.96:0/4111605376 >> [v2:172.21.15.96:6836/4278976485,v1:172.21.15.96:6837/4278976485] conn(0x557b2173d510 0x557b2173d8f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7235bbb302969823 server_cookie=dae14ce88f7fee0 in_seq=0 out_seq=0 2024-04-18T04:55:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a0a7fc640 10 client.4794 ms_handle_connect on v2:172.21.15.96:6836/4278976485 2024-04-18T04:55:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a0a7fc640 1 -- 172.21.15.96:0/4111605376 <== mds.1 v2:172.21.15.96:6836/4278976485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557b21541790 con 0x557b2173d510 2024-04-18T04:55:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a0a7fc640 10 client.4794 handle_command_reply: tid=0 2024-04-18T04:55:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 1 client.4794 shutdown 2024-04-18T04:55:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 1 -- 172.21.15.96:0/4111605376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 msgr2=0x557b216fac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/4111605376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b216fac20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400d5c0 tx=0x7f8a14055f30 comp rx=0 tx=0).stop 2024-04-18T04:55:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 1 -- 172.21.15.96:0/4111605376 shutdown_connections 2024-04-18T04:55:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/4111605376 >> [v2:172.21.15.96:6836/4278976485,v1:172.21.15.96:6837/4278976485] conn(0x557b2173d510 0x557b2173d8f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/4111605376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b2173c390 0x557b2173c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/4111605376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b216fac20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a0a7fc640 0 client.4794 ms_handle_reset on v2:172.21.15.96:6836/4278976485 2024-04-18T04:55:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/4111605376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b21731af0 0x557b216fa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 1 -- 172.21.15.96:0/4111605376 >> 172.21.15.96:0/4111605376 conn(0x557b216fc190 msgr2=0x557b217344e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 1 -- 172.21.15.96:0/4111605376 shutdown_connections 2024-04-18T04:55:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 1 -- 172.21.15.96:0/4111605376 wait complete. 2024-04-18T04:55:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.222+0000 7f8a34fa2000 20 client.4794 trim_cache size 0 max 16384 2024-04-18T04:55:15.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 Processor -- start 2024-04-18T04:55:15.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 -- start start 2024-04-18T04:55:15.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b216fc190 0x557b21795dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b21731af0 0x557b21796300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21796840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b21201940 con 0x557b21735b30 2024-04-18T04:55:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b214fdf80 con 0x557b21731af0 2024-04-18T04:55:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b21546fa0 con 0x557b216fc190 2024-04-18T04:55:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a2bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21796840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a2bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21796840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37630/0 (socket says 172.21.15.96:37630) 2024-04-18T04:55:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a2bfff640 1 -- 172.21.15.96:0/1201843935 learned_addr learned my addr 172.21.15.96:0/1201843935 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a2bfff640 1 -- 172.21.15.96:0/1201843935 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b216fc190 msgr2=0x557b21795dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a2b7fe640 1 --2- 172.21.15.96:0/1201843935 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b216fc190 0x557b21795dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a2bfff640 1 --2- 172.21.15.96:0/1201843935 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b216fc190 0x557b21795dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a2bfff640 1 -- 172.21.15.96:0/1201843935 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b21731af0 msgr2=0x557b21796300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a2bfff640 1 --2- 172.21.15.96:0/1201843935 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b21731af0 0x557b21796300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a2bfff640 1 -- 172.21.15.96:0/1201843935 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b214efc00 con 0x557b21735b30 2024-04-18T04:55:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a2bfff640 1 --2- 172.21.15.96:0/1201843935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21796840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009680 tx=0x7f8a240a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b655f1a62f82d5da server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a21ffb640 1 -- 172.21.15.96:0/1201843935 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a24009150 con 0x557b21735b30 2024-04-18T04:55:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a21ffb640 1 -- 172.21.15.96:0/1201843935 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a240039a0 con 0x557b21735b30 2024-04-18T04:55:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a21ffb640 1 -- 172.21.15.96:0/1201843935 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a240092b0 con 0x557b21735b30 2024-04-18T04:55:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 -- 172.21.15.96:0/1201843935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 msgr2=0x557b21796840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/1201843935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21796840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009680 tx=0x7f8a240a7000 comp rx=0 tx=0).stop 2024-04-18T04:55:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 -- 172.21.15.96:0/1201843935 shutdown_connections 2024-04-18T04:55:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/1201843935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21796840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/1201843935 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b21731af0 0x557b21796300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/1201843935 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b216fc190 0x557b21795dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 -- 172.21.15.96:0/1201843935 >> 172.21.15.96:0/1201843935 conn(0x557b217314a0 msgr2=0x557b216f6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 -- 172.21.15.96:0/1201843935 shutdown_connections 2024-04-18T04:55:15.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 -- 172.21.15.96:0/1201843935 wait complete. 2024-04-18T04:55:15.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.238+0000 7f8a34fa2000 1 -- start start 2024-04-18T04:55:15.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 Processor -- start 2024-04-18T04:55:15.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b216fc190 0x557b2179a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b21731af0 0x557b21793ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21794430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b214e1c10 con 0x557b21735b30 2024-04-18T04:55:15.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b214e8860 con 0x557b216fc190 2024-04-18T04:55:15.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b215401a0 con 0x557b21731af0 2024-04-18T04:55:15.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 10 client.0 _ll_register_callbacks cb 0x557b21511ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:55:15.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a2bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21794430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a2bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21794430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37634/0 (socket says 172.21.15.96:37634) 2024-04-18T04:55:15.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a2bfff640 1 -- 172.21.15.96:0/478053335 learned_addr learned my addr 172.21.15.96:0/478053335 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a2b7fe640 1 --2- 172.21.15.96:0/478053335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b216fc190 0x557b2179a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a2affd640 1 --2- 172.21.15.96:0/478053335 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b21731af0 0x557b21793ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a2bfff640 1 -- 172.21.15.96:0/478053335 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b21731af0 msgr2=0x557b21793ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a2bfff640 1 --2- 172.21.15.96:0/478053335 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b21731af0 0x557b21793ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a2bfff640 1 -- 172.21.15.96:0/478053335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b216fc190 msgr2=0x557b2179a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a2bfff640 1 --2- 172.21.15.96:0/478053335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b216fc190 0x557b2179a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a2bfff640 1 -- 172.21.15.96:0/478053335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b21240890 con 0x557b21735b30 2024-04-18T04:55:15.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a2b7fe640 1 --2- 172.21.15.96:0/478053335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b216fc190 0x557b2179a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:15.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a2bfff640 1 --2- 172.21.15.96:0/478053335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21794430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8a2401af40 tx=0x7f8a2401b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f114807d2db4bd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a0a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-04-18T04:55:15.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a0a7fc640 1 -- 172.21.15.96:0/478053335 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a240b9470 con 0x557b21735b30 2024-04-18T04:55:15.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a0a7fc640 1 -- 172.21.15.96:0/478053335 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a240ceb10 con 0x557b21735b30 2024-04-18T04:55:15.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 -- 172.21.15.96:0/478053335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b21514460 con 0x557b21735b30 2024-04-18T04:55:15.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a0a7fc640 1 -- 172.21.15.96:0/478053335 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a240cecd0 con 0x557b21735b30 2024-04-18T04:55:15.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 10 client.4800 fetch_fsmap learned FSMap version 17 2024-04-18T04:55:15.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 -- 172.21.15.96:0/478053335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x557b21240cc0 con 0x557b21735b30 2024-04-18T04:55:15.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a0a7fc640 1 -- 172.21.15.96:0/478053335 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b21514460 con 0x557b21735b30 2024-04-18T04:55:15.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a0a7fc640 1 -- 172.21.15.96:0/478053335 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 17) v1 ==== 4252+0+0 (secure 0 0 0) 0x7f8a240d4020 con 0x557b21735b30 2024-04-18T04:55:15.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 10 client.4800 fetch_fsmap finished waiting for FSMap version 17 2024-04-18T04:55:15.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 10 client.4800 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-18T04:55:15.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 20 client.4800 populate_metadata read hostname 'smithi096' 2024-04-18T04:55:15.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/478053335 >> [v2:172.21.15.96:6836/4278976485,v1:172.21.15.96:6837/4278976485] conn(0x557b2173c390 0x557b217970d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 4 client.4800 mds_command: new command op to 4249 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-18T04:55:15.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 -- 172.21.15.96:0/478053335 --> [v2:172.21.15.96:6836/4278976485,v1:172.21.15.96:6837/4278976485] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557b2150d9c0 con 0x557b2173c390 2024-04-18T04:55:15.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a2b7fe640 1 --2- 172.21.15.96:0/478053335 >> [v2:172.21.15.96:6836/4278976485,v1:172.21.15.96:6837/4278976485] conn(0x557b2173c390 0x557b217970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a2b7fe640 1 --2- 172.21.15.96:0/478053335 >> [v2:172.21.15.96:6836/4278976485,v1:172.21.15.96:6837/4278976485] conn(0x557b2173c390 0x557b217970d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3eb4beac9dd268a1 server_cookie=d8d9e86630ed100e in_seq=0 out_seq=0 2024-04-18T04:55:15.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a0a7fc640 10 client.4800 ms_handle_connect on v2:172.21.15.96:6836/4278976485 2024-04-18T04:55:15.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a0a7fc640 1 -- 172.21.15.96:0/478053335 <== mds.1 v2:172.21.15.96:6836/4278976485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x557b2150d9c0 con 0x557b2173c390 2024-04-18T04:55:15.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a0a7fc640 10 client.4800 handle_command_reply: tid=0 2024-04-18T04:55:15.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 client.4800 shutdown 2024-04-18T04:55:15.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 -- 172.21.15.96:0/478053335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 msgr2=0x557b21794430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/478053335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21794430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8a2401af40 tx=0x7f8a2401b0d0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 -- 172.21.15.96:0/478053335 shutdown_connections 2024-04-18T04:55:15.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/478053335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x557b21735b30 0x557b21794430 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/478053335 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x557b21731af0 0x557b21793ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/478053335 >> [v2:172.21.15.96:6836/4278976485,v1:172.21.15.96:6837/4278976485] conn(0x557b2173c390 0x557b217970d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 --2- 172.21.15.96:0/478053335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b216fc190 0x557b2179a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a0a7fc640 0 client.4800 ms_handle_reset on v2:172.21.15.96:6836/4278976485 2024-04-18T04:55:15.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 -- 172.21.15.96:0/478053335 >> 172.21.15.96:0/478053335 conn(0x557b217314a0 msgr2=0x557b216f6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 -- 172.21.15.96:0/478053335 shutdown_connections 2024-04-18T04:55:15.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 1 -- 172.21.15.96:0/478053335 wait complete. 2024-04-18T04:55:15.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a34fa2000 20 client.4800 trim_cache size 0 max 16384 2024-04-18T04:55:15.254 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:55:15.254 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:55:15.254 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 1, 2024-04-18T04:55:15.254 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4249, 2024-04-18T04:55:15.254 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2024-04-18T04:55:15.254 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2024-04-18T04:55:15.254 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2024-04-18T04:55:15.254 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 28.047677518, 2024-04-18T04:55:15.254 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 17, 2024-04-18T04:55:15.254 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 21, 2024-04-18T04:55:15.254 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 21, 2024-04-18T04:55:15.254 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 40.510980752999998 2024-04-18T04:55:15.255 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:55:15.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a31e60640 1 -- 172.21.15.96:0/2413029493 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8a0c066690 msgr2=0x7f8a0c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a31e60640 1 --2- 172.21.15.96:0/2413029493 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8a0c066690 0x7f8a0c068b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c004e30 tx=0x7f8a1c009040 comp rx=0 tx=0).stop 2024-04-18T04:55:15.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a31e60640 1 -- 172.21.15.96:0/2413029493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a2c157510 msgr2=0x7f8a2c0c3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a31e60640 1 --2- 172.21.15.96:0/2413029493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a2c157510 0x7f8a2c0c3e30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400d5f0 tx=0x7f8a1400dab0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a31e60640 1 -- 172.21.15.96:0/2413029493 shutdown_connections 2024-04-18T04:55:15.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a31e60640 1 --2- 172.21.15.96:0/2413029493 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8a0c066690 0x7f8a0c068b50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a31e60640 1 --2- 172.21.15.96:0/2413029493 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8a2c1578f0 0x7f8a2c0c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a31e60640 1 --2- 172.21.15.96:0/2413029493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a2c157510 0x7f8a2c0c3e30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a31e60640 1 --2- 172.21.15.96:0/2413029493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a2c070180 0x7f8a2c156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a31e60640 1 -- 172.21.15.96:0/2413029493 >> 172.21.15.96:0/2413029493 conn(0x7f8a2c06a8e0 msgr2=0x7f8a2c15c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a31e60640 1 -- 172.21.15.96:0/2413029493 shutdown_connections 2024-04-18T04:55:15.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.242+0000 7f8a31e60640 1 -- 172.21.15.96:0/2413029493 wait complete. 2024-04-18T04:55:15.263 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-18T04:55:15.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.374+0000 7fe3fdf3f640 1 Processor -- start 2024-04-18T04:55:15.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.374+0000 7fe3fdf3f640 1 -- start start 2024-04-18T04:55:15.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.374+0000 7fe3fdf3f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe3f80c7e90 0x7fe3f80c8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.374+0000 7fe3fdf3f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3f8153290 0x7fe3f80713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.374+0000 7fe3fdf3f640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f8071900 con 0x7fe3f8071cc0 2024-04-18T04:55:15.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.374+0000 7fe3fdf3f640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f80cad40 con 0x7fe3f80c7e90 2024-04-18T04:55:15.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.374+0000 7fe3fdf3f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f8158fc0 con 0x7fe3f8153290 2024-04-18T04:55:15.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.374+0000 7fe3f6ffd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3f8153290 0x7fe3f80713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.374+0000 7fe3f77fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe3f80c7e90 0x7fe3f80c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.374+0000 7fe3f6ffd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3f8153290 0x7fe3f80713c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:50344/0 (socket says 172.21.15.96:50344) 2024-04-18T04:55:15.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.374+0000 7fe3f77fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe3f80c7e90 0x7fe3f80c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:43460/0 (socket says 172.21.15.96:43460) 2024-04-18T04:55:15.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.374+0000 7fe3f6ffd640 1 -- 172.21.15.96:0/2204457870 learned_addr learned my addr 172.21.15.96:0/2204457870 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.374+0000 7fe3f6ffd640 1 -- 172.21.15.96:0/2204457870 >> v2:172.21.15.139:3300/0 conn(0x7fe3f80c7e90 msgr2=0x7fe3f80c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.374+0000 7fe3f6ffd640 1 --2- 172.21.15.96:0/2204457870 >> v2:172.21.15.139:3300/0 conn(0x7fe3f80c7e90 0x7fe3f80c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.374+0000 7fe3f6ffd640 1 -- 172.21.15.96:0/2204457870 >> v1:172.21.15.139:6789/0 conn(0x7fe3f8071cc0 legacy=0x7fe3f8159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.374+0000 7fe3f6ffd640 1 -- 172.21.15.96:0/2204457870 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f80c9ee0 con 0x7fe3f8153290 2024-04-18T04:55:15.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3f6ffd640 1 --2- 172.21.15.96:0/2204457870 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3f8153290 0x7fe3f80713c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009870 tx=0x7fe3ec01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=297f738636f5a499 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3f67fc640 1 -- 172.21.15.96:0/2204457870 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec0ab650 con 0x7fe3f8153290 2024-04-18T04:55:15.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3f67fc640 1 -- 172.21.15.96:0/2204457870 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec0ab7b0 con 0x7fe3f8153290 2024-04-18T04:55:15.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3f67fc640 1 -- 172.21.15.96:0/2204457870 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec0abb40 con 0x7fe3f8153290 2024-04-18T04:55:15.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3fdf3f640 1 -- 172.21.15.96:0/2204457870 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3f8153290 msgr2=0x7fe3f80713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3fdf3f640 1 --2- 172.21.15.96:0/2204457870 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3f8153290 0x7fe3f80713c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009870 tx=0x7fe3ec01c560 comp rx=0 tx=0).stop 2024-04-18T04:55:15.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3fdf3f640 1 -- 172.21.15.96:0/2204457870 shutdown_connections 2024-04-18T04:55:15.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3fdf3f640 1 --2- 172.21.15.96:0/2204457870 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3f8153290 0x7fe3f80713c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3fdf3f640 1 --2- 172.21.15.96:0/2204457870 >> v2:172.21.15.139:3300/0 conn(0x7fe3f80c7e90 0x7fe3f80c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3fdf3f640 1 -- 172.21.15.96:0/2204457870 >> 172.21.15.96:0/2204457870 conn(0x7fe3f80661c0 msgr2=0x7fe3f806eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3fdf3f640 1 -- 172.21.15.96:0/2204457870 shutdown_connections 2024-04-18T04:55:15.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3fdf3f640 1 -- 172.21.15.96:0/2204457870 wait complete. 2024-04-18T04:55:15.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3fdf3f640 1 Processor -- start 2024-04-18T04:55:15.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3fdf3f640 1 -- start start 2024-04-18T04:55:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3fdf3f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3f8071cc0 0x7fe3f81f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3fdf3f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3f80c7e90 0x7fe3f8154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3fdf3f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3f814e7f0 0x7fe3f814bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3fdf3f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80bceb0 con 0x7fe3f814e7f0 2024-04-18T04:55:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3fdf3f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f81f66a0 con 0x7fe3f80c7e90 2024-04-18T04:55:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.378+0000 7fe3fdf3f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f81f21e0 con 0x7fe3f8071cc0 2024-04-18T04:55:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3f814e7f0 0x7fe3f814bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3f814e7f0 0x7fe3f814bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37650/0 (socket says 172.21.15.96:37650) 2024-04-18T04:55:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3f7fff640 1 -- 172.21.15.96:0/3849679776 learned_addr learned my addr 172.21.15.96:0/3849679776 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3f77fe640 1 --2- 172.21.15.96:0/3849679776 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3f8071cc0 0x7fe3f81f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3f6ffd640 1 --2- 172.21.15.96:0/3849679776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3f80c7e90 0x7fe3f8154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3f7fff640 1 -- 172.21.15.96:0/3849679776 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3f8071cc0 msgr2=0x7fe3f81f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3f7fff640 1 --2- 172.21.15.96:0/3849679776 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3f8071cc0 0x7fe3f81f6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3f7fff640 1 -- 172.21.15.96:0/3849679776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3f80c7e90 msgr2=0x7fe3f8154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3f7fff640 1 --2- 172.21.15.96:0/3849679776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3f80c7e90 0x7fe3f8154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3f7fff640 1 -- 172.21.15.96:0/3849679776 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec0094d0 con 0x7fe3f814e7f0 2024-04-18T04:55:15.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3f6ffd640 1 --2- 172.21.15.96:0/3849679776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3f80c7e90 0x7fe3f8154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:15.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3f7fff640 1 --2- 172.21.15.96:0/3849679776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3f814e7f0 0x7fe3f814bd40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000c730 tx=0x7fe3f000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3dffff640 1 -- 172.21.15.96:0/3849679776 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0006d60 con 0x7fe3f814e7f0 2024-04-18T04:55:15.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3dffff640 1 -- 172.21.15.96:0/3849679776 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f0003980 con 0x7fe3f814e7f0 2024-04-18T04:55:15.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3fdf3f640 1 -- 172.21.15.96:0/3849679776 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f8156bb0 con 0x7fe3f814e7f0 2024-04-18T04:55:15.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3dffff640 1 -- 172.21.15.96:0/3849679776 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0003d30 con 0x7fe3f814e7f0 2024-04-18T04:55:15.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3fdf3f640 1 -- 172.21.15.96:0/3849679776 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f81f24a0 con 0x7fe3f814e7f0 2024-04-18T04:55:15.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3dffff640 1 -- 172.21.15.96:0/3849679776 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe3f00050d0 con 0x7fe3f814e7f0 2024-04-18T04:55:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3dffff640 1 --2- 172.21.15.96:0/3849679776 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe3e4066690 0x7fe3e4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3dffff640 1 -- 172.21.15.96:0/3849679776 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3f0083b00 con 0x7fe3f814e7f0 2024-04-18T04:55:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3f77fe640 1 --2- 172.21.15.96:0/3849679776 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe3e4066690 0x7fe3e4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe3f77fe640 1 --2- 172.21.15.96:0/3849679776 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe3e4066690 0x7fe3e4068b50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009a50 tx=0x7fe3e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe401081000 1 Processor -- start 2024-04-18T04:55:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.382+0000 7fe401081000 1 -- start start 2024-04-18T04:55:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a756db00 0x55a9a7537710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a756dee0 0x55a9a7537c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a7571b40 0x55a9a7571f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a73f9e90 con 0x55a9a756dee0 2024-04-18T04:55:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a7367af0 con 0x55a9a7571b40 2024-04-18T04:55:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9a73650c0 con 0x55a9a756db00 2024-04-18T04:55:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f6ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a756dee0 0x55a9a7537c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f6ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a756dee0 0x55a9a7537c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37652/0 (socket says 172.21.15.96:37652) 2024-04-18T04:55:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f6ffd640 1 -- 172.21.15.96:0/667978952 learned_addr learned my addr 172.21.15.96:0/667978952 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f6ffd640 1 -- 172.21.15.96:0/667978952 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a756db00 msgr2=0x55a9a7537710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f6ffd640 1 --2- 172.21.15.96:0/667978952 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a756db00 0x55a9a7537710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f6ffd640 1 -- 172.21.15.96:0/667978952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a7571b40 msgr2=0x55a9a7571f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f6ffd640 1 --2- 172.21.15.96:0/667978952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a7571b40 0x55a9a7571f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f6ffd640 1 -- 172.21.15.96:0/667978952 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9a705c890 con 0x55a9a756dee0 2024-04-18T04:55:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f6ffd640 1 --2- 172.21.15.96:0/667978952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a756dee0 0x55a9a7537c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec000c10 tx=0x7fe3ec0a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57341cd6dfff537 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3dd7fa640 1 -- 172.21.15.96:0/667978952 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec0abb20 con 0x55a9a756dee0 2024-04-18T04:55:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3dd7fa640 1 -- 172.21.15.96:0/667978952 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec0b8070 con 0x55a9a756dee0 2024-04-18T04:55:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3dd7fa640 1 -- 172.21.15.96:0/667978952 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec0abe80 con 0x55a9a756dee0 2024-04-18T04:55:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 -- 172.21.15.96:0/667978952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a756dee0 msgr2=0x55a9a7537c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 --2- 172.21.15.96:0/667978952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a756dee0 0x55a9a7537c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec000c10 tx=0x7fe3ec0a7000 comp rx=0 tx=0).stop 2024-04-18T04:55:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 -- 172.21.15.96:0/667978952 shutdown_connections 2024-04-18T04:55:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 --2- 172.21.15.96:0/667978952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a7571b40 0x55a9a7571f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 --2- 172.21.15.96:0/667978952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a756dee0 0x55a9a7537c50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 --2- 172.21.15.96:0/667978952 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a756db00 0x55a9a7537710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 -- 172.21.15.96:0/667978952 >> 172.21.15.96:0/667978952 conn(0x55a9a75381a0 msgr2=0x55a9a7538580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 -- 172.21.15.96:0/667978952 shutdown_connections 2024-04-18T04:55:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 -- 172.21.15.96:0/667978952 wait complete. 2024-04-18T04:55:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 -- start start 2024-04-18T04:55:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 Processor -- start 2024-04-18T04:55:15.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a756db00 0x55a9a756c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a7571b40 0x55a9a756cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7578780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a73609b0 con 0x55a9a75783a0 2024-04-18T04:55:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a72ffc00 con 0x55a9a756db00 2024-04-18T04:55:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9a731e070 con 0x55a9a7571b40 2024-04-18T04:55:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe401081000 10 client.0 _ll_register_callbacks cb 0x55a9a751daf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:55:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7578780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7578780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37666/0 (socket says 172.21.15.96:37666) 2024-04-18T04:55:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f7fff640 1 -- 172.21.15.96:0/3676124146 learned_addr learned my addr 172.21.15.96:0/3676124146 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f6ffd640 1 --2- 172.21.15.96:0/3676124146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a7571b40 0x55a9a756cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f77fe640 1 --2- 172.21.15.96:0/3676124146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a756db00 0x55a9a756c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f7fff640 1 -- 172.21.15.96:0/3676124146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a7571b40 msgr2=0x55a9a756cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f7fff640 1 --2- 172.21.15.96:0/3676124146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a7571b40 0x55a9a756cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f7fff640 1 -- 172.21.15.96:0/3676124146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a756db00 msgr2=0x55a9a756c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f7fff640 1 --2- 172.21.15.96:0/3676124146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a756db00 0x55a9a756c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f7fff640 1 -- 172.21.15.96:0/3676124146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f80c9ee0 con 0x55a9a75783a0 2024-04-18T04:55:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f77fe640 1 --2- 172.21.15.96:0/3676124146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a756db00 0x55a9a756c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3f7fff640 1 --2- 172.21.15.96:0/3676124146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7578780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe3f005c9f0 tx=0x7fe3f0054bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9abbfa29eb5c3867 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.386+0000 7fe3d67fc640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-04-18T04:55:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe3d67fc640 1 -- 172.21.15.96:0/3676124146 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f007f070 con 0x55a9a75783a0 2024-04-18T04:55:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe3d67fc640 1 -- 172.21.15.96:0/3676124146 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3f0051240 con 0x55a9a75783a0 2024-04-18T04:55:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 1 -- 172.21.15.96:0/3676124146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9a731d5f0 con 0x55a9a75783a0 2024-04-18T04:55:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe3d67fc640 1 -- 172.21.15.96:0/3676124146 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3f005ca90 con 0x55a9a75783a0 2024-04-18T04:55:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 10 client.4809 fetch_fsmap learned FSMap version 17 2024-04-18T04:55:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 1 -- 172.21.15.96:0/3676124146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a9a7325ab0 con 0x55a9a75783a0 2024-04-18T04:55:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe3d67fc640 1 -- 172.21.15.96:0/3676124146 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9a731d5f0 con 0x55a9a75783a0 2024-04-18T04:55:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe3d67fc640 1 -- 172.21.15.96:0/3676124146 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 17) v1 ==== 4252+0+0 (secure 0 0 0) 0x7fe3f0019030 con 0x55a9a75783a0 2024-04-18T04:55:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 10 client.4809 fetch_fsmap finished waiting for FSMap version 17 2024-04-18T04:55:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 10 client.4809 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-18T04:55:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 20 client.4809 populate_metadata read hostname 'smithi096' 2024-04-18T04:55:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 1 --2- 172.21.15.96:0/3676124146 >> [v2:172.21.15.139:6832/3935291095,v1:172.21.15.139:6833/3935291095] conn(0x55a9a75794f0 0x55a9a75798d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 4 client.4809 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-18T04:55:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 1 -- 172.21.15.96:0/3676124146 --> [v2:172.21.15.139:6832/3935291095,v1:172.21.15.139:6833/3935291095] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a9a735d790 con 0x55a9a75794f0 2024-04-18T04:55:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe3f77fe640 1 --2- 172.21.15.96:0/3676124146 >> [v2:172.21.15.139:6832/3935291095,v1:172.21.15.139:6833/3935291095] conn(0x55a9a75794f0 0x55a9a75798d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe3f77fe640 1 --2- 172.21.15.96:0/3676124146 >> [v2:172.21.15.139:6832/3935291095,v1:172.21.15.139:6833/3935291095] conn(0x55a9a75794f0 0x55a9a75798d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=252ef6004775c570 server_cookie=7212bd7890612b96 in_seq=0 out_seq=0 2024-04-18T04:55:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe3d67fc640 10 client.4809 ms_handle_connect on v2:172.21.15.139:6832/3935291095 2024-04-18T04:55:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe3d67fc640 1 -- 172.21.15.96:0/3676124146 <== mds.0 v2:172.21.15.139:6832/3935291095 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a9a735d790 con 0x55a9a75794f0 2024-04-18T04:55:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe3d67fc640 10 client.4809 handle_command_reply: tid=0 2024-04-18T04:55:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 1 client.4809 shutdown 2024-04-18T04:55:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 1 -- 172.21.15.96:0/3676124146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 msgr2=0x55a9a7578780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 1 --2- 172.21.15.96:0/3676124146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7578780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe3f005c9f0 tx=0x7fe3f0054bf0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 1 -- 172.21.15.96:0/3676124146 shutdown_connections 2024-04-18T04:55:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 1 --2- 172.21.15.96:0/3676124146 >> [v2:172.21.15.139:6832/3935291095,v1:172.21.15.139:6833/3935291095] conn(0x55a9a75794f0 0x55a9a75798d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 1 --2- 172.21.15.96:0/3676124146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7578780 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 1 --2- 172.21.15.96:0/3676124146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a7571b40 0x55a9a756cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe3d67fc640 0 client.4809 ms_handle_reset on v2:172.21.15.139:6832/3935291095 2024-04-18T04:55:15.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 1 --2- 172.21.15.96:0/3676124146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a756db00 0x55a9a756c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 1 -- 172.21.15.96:0/3676124146 >> 172.21.15.96:0/3676124146 conn(0x55a9a75381a0 msgr2=0x55a9a75704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 1 -- 172.21.15.96:0/3676124146 shutdown_connections 2024-04-18T04:55:15.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 1 -- 172.21.15.96:0/3676124146 wait complete. 2024-04-18T04:55:15.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.390+0000 7fe401081000 20 client.4809 trim_cache size 0 max 16384 2024-04-18T04:55:15.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe401081000 1 Processor -- start 2024-04-18T04:55:15.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe401081000 1 -- start start 2024-04-18T04:55:15.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe401081000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a756db00 0x55a9a756b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe401081000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a7571b40 0x55a9a75798d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe401081000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7579e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe401081000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a701d940 con 0x55a9a75783a0 2024-04-18T04:55:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe401081000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a7327c60 con 0x55a9a7571b40 2024-04-18T04:55:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe401081000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9a7368d80 con 0x55a9a756db00 2024-04-18T04:55:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7579e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7579e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37670/0 (socket says 172.21.15.96:37670) 2024-04-18T04:55:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe3f7fff640 1 -- 172.21.15.96:0/3222203453 learned_addr learned my addr 172.21.15.96:0/3222203453 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe3f6ffd640 1 --2- 172.21.15.96:0/3222203453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a7571b40 0x55a9a75798d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe3f77fe640 1 --2- 172.21.15.96:0/3222203453 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a756db00 0x55a9a756b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe3f7fff640 1 -- 172.21.15.96:0/3222203453 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a756db00 msgr2=0x55a9a756b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe3f7fff640 1 --2- 172.21.15.96:0/3222203453 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a756db00 0x55a9a756b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe3f7fff640 1 -- 172.21.15.96:0/3222203453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a7571b40 msgr2=0x55a9a75798d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe3f7fff640 1 --2- 172.21.15.96:0/3222203453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a7571b40 0x55a9a75798d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.406+0000 7fe3f7fff640 1 -- 172.21.15.96:0/3222203453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9a730bc00 con 0x55a9a75783a0 2024-04-18T04:55:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3f7fff640 1 --2- 172.21.15.96:0/3222203453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7579e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0083de0 tx=0x7fe3f0058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0c7f1b5ea9388b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3ddffb640 1 -- 172.21.15.96:0/3222203453 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f007f030 con 0x55a9a75783a0 2024-04-18T04:55:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3ddffb640 1 -- 172.21.15.96:0/3222203453 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f0058960 con 0x55a9a75783a0 2024-04-18T04:55:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3ddffb640 1 -- 172.21.15.96:0/3222203453 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f005ca90 con 0x55a9a75783a0 2024-04-18T04:55:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 -- 172.21.15.96:0/3222203453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 msgr2=0x55a9a7579e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 --2- 172.21.15.96:0/3222203453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7579e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0083de0 tx=0x7fe3f0058000 comp rx=0 tx=0).stop 2024-04-18T04:55:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 -- 172.21.15.96:0/3222203453 shutdown_connections 2024-04-18T04:55:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 --2- 172.21.15.96:0/3222203453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7579e10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 --2- 172.21.15.96:0/3222203453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a7571b40 0x55a9a75798d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 --2- 172.21.15.96:0/3222203453 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a756db00 0x55a9a756b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 -- 172.21.15.96:0/3222203453 >> 172.21.15.96:0/3222203453 conn(0x55a9a75381a0 msgr2=0x55a9a756b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 -- 172.21.15.96:0/3222203453 shutdown_connections 2024-04-18T04:55:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 -- 172.21.15.96:0/3222203453 wait complete. 2024-04-18T04:55:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 -- start start 2024-04-18T04:55:15.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 Processor -- start 2024-04-18T04:55:15.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a756db00 0x55a9a7575ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a7571b40 0x55a9a7576010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7576550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a735f840 con 0x55a9a75783a0 2024-04-18T04:55:15.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a7327c60 con 0x55a9a7571b40 2024-04-18T04:55:15.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9a758d260 con 0x55a9a756db00 2024-04-18T04:55:15.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 10 client.0 _ll_register_callbacks cb 0x55a9a732dff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:55:15.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7576550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7576550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37672/0 (socket says 172.21.15.96:37672) 2024-04-18T04:55:15.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3f7fff640 1 -- 172.21.15.96:0/2560505848 learned_addr learned my addr 172.21.15.96:0/2560505848 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3f77fe640 1 --2- 172.21.15.96:0/2560505848 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a756db00 0x55a9a7575ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3f6ffd640 1 --2- 172.21.15.96:0/2560505848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a7571b40 0x55a9a7576010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3f7fff640 1 -- 172.21.15.96:0/2560505848 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a756db00 msgr2=0x55a9a7575ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3f7fff640 1 --2- 172.21.15.96:0/2560505848 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a756db00 0x55a9a7575ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3f7fff640 1 -- 172.21.15.96:0/2560505848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a7571b40 msgr2=0x55a9a7576010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3f7fff640 1 --2- 172.21.15.96:0/2560505848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a7571b40 0x55a9a7576010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3f7fff640 1 -- 172.21.15.96:0/2560505848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9a7325ab0 con 0x55a9a75783a0 2024-04-18T04:55:15.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3f7fff640 1 --2- 172.21.15.96:0/2560505848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7576550 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0007fd0 tx=0x7fe3f0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc821f18539cb1a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3d67fc640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-04-18T04:55:15.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3d67fc640 1 -- 172.21.15.96:0/2560505848 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0053a90 con 0x55a9a75783a0 2024-04-18T04:55:15.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3d67fc640 1 -- 172.21.15.96:0/2560505848 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3f0053bf0 con 0x55a9a75783a0 2024-04-18T04:55:15.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 -- 172.21.15.96:0/2560505848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9a756d990 con 0x55a9a75783a0 2024-04-18T04:55:15.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3d67fc640 1 -- 172.21.15.96:0/2560505848 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3f0053db0 con 0x55a9a75783a0 2024-04-18T04:55:15.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 10 client.4815 fetch_fsmap learned FSMap version 17 2024-04-18T04:55:15.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 -- 172.21.15.96:0/2560505848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a9a705ccc0 con 0x55a9a75783a0 2024-04-18T04:55:15.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3d67fc640 1 -- 172.21.15.96:0/2560505848 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9a756d990 con 0x55a9a75783a0 2024-04-18T04:55:15.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3d67fc640 1 -- 172.21.15.96:0/2560505848 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 17) v1 ==== 4252+0+0 (secure 0 0 0) 0x7fe3f0019050 con 0x55a9a75783a0 2024-04-18T04:55:15.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 10 client.4815 fetch_fsmap finished waiting for FSMap version 17 2024-04-18T04:55:15.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 10 client.4815 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-18T04:55:15.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 20 client.4815 populate_metadata read hostname 'smithi096' 2024-04-18T04:55:15.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 --2- 172.21.15.96:0/2560505848 >> [v2:172.21.15.139:6832/3935291095,v1:172.21.15.139:6833/3935291095] conn(0x55a9a7576f10 0x55a9a75de0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 4 client.4815 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-18T04:55:15.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe401081000 1 -- 172.21.15.96:0/2560505848 --> [v2:172.21.15.139:6832/3935291095,v1:172.21.15.139:6833/3935291095] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a9a7330460 con 0x55a9a7576f10 2024-04-18T04:55:15.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.410+0000 7fe3f77fe640 1 --2- 172.21.15.96:0/2560505848 >> [v2:172.21.15.139:6832/3935291095,v1:172.21.15.139:6833/3935291095] conn(0x55a9a7576f10 0x55a9a75de0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3d67fc640 10 client.4815 ms_handle_connect on v2:172.21.15.139:6832/3935291095 2024-04-18T04:55:15.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3f77fe640 1 --2- 172.21.15.96:0/2560505848 >> [v2:172.21.15.139:6832/3935291095,v1:172.21.15.139:6833/3935291095] conn(0x55a9a7576f10 0x55a9a75de0b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8e6c6ae6a637462 server_cookie=32500033fb3b61f0 in_seq=0 out_seq=0 2024-04-18T04:55:15.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3d67fc640 1 -- 172.21.15.96:0/2560505848 <== mds.0 v2:172.21.15.139:6832/3935291095 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a9a7330460 con 0x55a9a7576f10 2024-04-18T04:55:15.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3d67fc640 10 client.4815 handle_command_reply: tid=0 2024-04-18T04:55:15.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe401081000 1 client.4815 shutdown 2024-04-18T04:55:15.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe401081000 1 -- 172.21.15.96:0/2560505848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 msgr2=0x55a9a7576550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe401081000 1 --2- 172.21.15.96:0/2560505848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7576550 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0007fd0 tx=0x7fe3f0001260 comp rx=0 tx=0).stop 2024-04-18T04:55:15.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe401081000 1 -- 172.21.15.96:0/2560505848 shutdown_connections 2024-04-18T04:55:15.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe401081000 1 --2- 172.21.15.96:0/2560505848 >> [v2:172.21.15.139:6832/3935291095,v1:172.21.15.139:6833/3935291095] conn(0x55a9a7576f10 0x55a9a75de0b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe401081000 1 --2- 172.21.15.96:0/2560505848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a9a75783a0 0x55a9a7576550 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe401081000 1 --2- 172.21.15.96:0/2560505848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9a7571b40 0x55a9a7576010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe401081000 1 --2- 172.21.15.96:0/2560505848 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55a9a756db00 0x55a9a7575ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3d67fc640 0 client.4815 ms_handle_reset on v2:172.21.15.139:6832/3935291095 2024-04-18T04:55:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe401081000 1 -- 172.21.15.96:0/2560505848 >> 172.21.15.96:0/2560505848 conn(0x55a9a75381a0 msgr2=0x55a9a756b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe401081000 1 -- 172.21.15.96:0/2560505848 shutdown_connections 2024-04-18T04:55:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe401081000 1 -- 172.21.15.96:0/2560505848 wait complete. 2024-04-18T04:55:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe401081000 20 client.4815 trim_cache size 0 max 16384 2024-04-18T04:55:15.423 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:55:15.423 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:55:15.423 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2024-04-18T04:55:15.423 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4273, 2024-04-18T04:55:15.424 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2024-04-18T04:55:15.424 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2024-04-18T04:55:15.424 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2024-04-18T04:55:15.424 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 34.255112455000003, 2024-04-18T04:55:15.424 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 17, 2024-04-18T04:55:15.424 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 21, 2024-04-18T04:55:15.424 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 21, 2024-04-18T04:55:15.424 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 40.664582909000003 2024-04-18T04:55:15.424 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:55:15.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3fdf3f640 1 -- 172.21.15.96:0/3849679776 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe3e4066690 msgr2=0x7fe3e4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3fdf3f640 1 --2- 172.21.15.96:0/3849679776 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe3e4066690 0x7fe3e4068b50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009a50 tx=0x7fe3e8008040 comp rx=0 tx=0).stop 2024-04-18T04:55:15.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3fdf3f640 1 -- 172.21.15.96:0/3849679776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3f814e7f0 msgr2=0x7fe3f814bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3fdf3f640 1 --2- 172.21.15.96:0/3849679776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3f814e7f0 0x7fe3f814bd40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000c730 tx=0x7fe3f000cb30 comp rx=0 tx=0).stop 2024-04-18T04:55:15.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3fdf3f640 1 -- 172.21.15.96:0/3849679776 shutdown_connections 2024-04-18T04:55:15.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3fdf3f640 1 --2- 172.21.15.96:0/3849679776 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe3e4066690 0x7fe3e4068b50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3fdf3f640 1 --2- 172.21.15.96:0/3849679776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3f814e7f0 0x7fe3f814bd40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3fdf3f640 1 --2- 172.21.15.96:0/3849679776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3f80c7e90 0x7fe3f8154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3fdf3f640 1 --2- 172.21.15.96:0/3849679776 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3f8071cc0 0x7fe3f81f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3fdf3f640 1 -- 172.21.15.96:0/3849679776 >> 172.21.15.96:0/3849679776 conn(0x7fe3f80661c0 msgr2=0x7fe3f8159410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3fdf3f640 1 -- 172.21.15.96:0/3849679776 shutdown_connections 2024-04-18T04:55:15.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.414+0000 7fe3fdf3f640 1 -- 172.21.15.96:0/3849679776 wait complete. 2024-04-18T04:55:15.433 INFO:teuthology.run_tasks:Running task sequential... 2024-04-18T04:55:15.444 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-18T04:55:15.444 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-18T04:55:15.444 INFO:teuthology.task.print:Enabling mgr modules 2024-04-18T04:55:15.444 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-18T04:55:15.478 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-18T04:55:15.478 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-18T04:55:15.478 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-18T04:55:15.478 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-18T04:55:15.478 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-18T04:55:15.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:15.478 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-04-18T04:55:15.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:15.485 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2024-04-18T04:55:15.542 INFO:teuthology.orchestra.run.smithi096.stderr:Cannot find device "ceph-brx" 2024-04-18T04:55:15.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:55:15.543 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-18T04:55:15.543 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-18T04:55:15.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.706+0000 7f8243bcd640 1 Processor -- start 2024-04-18T04:55:15.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.706+0000 7f8243bcd640 1 -- start start 2024-04-18T04:55:15.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.710+0000 7f8243bcd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f823c151210 0x7f823c0c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.710+0000 7f8243bcd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f823c15a950 0x7f823c15adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.710+0000 7f8243bcd640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823c15b300 con 0x7f823c0c1db0 2024-04-18T04:55:15.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.710+0000 7f8243bcd640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823c157150 con 0x7f823c151210 2024-04-18T04:55:15.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.710+0000 7f8243bcd640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823c157430 con 0x7f823c15a950 2024-04-18T04:55:15.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.710+0000 7f8241168640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f823c0c1db0 0x7f823c0ca300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36098/0 (socket says 172.21.15.96:36098) 2024-04-18T04:55:15.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.710+0000 7f8241168640 1 -- 172.21.15.96:0/435487661 learned_addr learned my addr 172.21.15.96:0/435487661 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:15.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.710+0000 7f824216a640 1 --2- 172.21.15.96:0/435487661 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f823c15a950 0x7f823c15adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.710+0000 7f8241969640 1 --2- 172.21.15.96:0/435487661 >> v2:172.21.15.139:3300/0 conn(0x7f823c151210 0x7f823c0c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.710+0000 7f8240967640 1 -- 172.21.15.96:0/435487661 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292334729 0 0) 0x7f823c15b300 con 0x7f823c0c1db0 2024-04-18T04:55:15.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.710+0000 7f8240967640 1 -- 172.21.15.96:0/435487661 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8228003530 con 0x7f823c0c1db0 2024-04-18T04:55:15.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.710+0000 7f824216a640 1 -- 172.21.15.96:0/435487661 >> v2:172.21.15.139:3300/0 conn(0x7f823c151210 msgr2=0x7f823c0c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:15.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.710+0000 7f824216a640 1 --2- 172.21.15.96:0/435487661 >> v2:172.21.15.139:3300/0 conn(0x7f823c151210 0x7f823c0c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.710+0000 7f824216a640 1 -- 172.21.15.96:0/435487661 >> v1:172.21.15.96:6789/0 conn(0x7f823c0c1db0 legacy=0x7f823c0ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.710+0000 7f824216a640 1 -- 172.21.15.96:0/435487661 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c157710 con 0x7f823c15a950 2024-04-18T04:55:15.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.714+0000 7f824216a640 1 --2- 172.21.15.96:0/435487661 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f823c15a950 0x7f823c15adc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8234009d90 tx=0x7f823401f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=828cd0eb4b9ef662 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8240967640 1 -- 172.21.15.96:0/435487661 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82340af600 con 0x7f823c15a950 2024-04-18T04:55:15.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8240967640 1 -- 172.21.15.96:0/435487661 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82340ab050 con 0x7f823c15a950 2024-04-18T04:55:15.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8240967640 1 -- 172.21.15.96:0/435487661 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82340af960 con 0x7f823c15a950 2024-04-18T04:55:15.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 -- 172.21.15.96:0/435487661 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f823c15a950 msgr2=0x7f823c15adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 --2- 172.21.15.96:0/435487661 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f823c15a950 0x7f823c15adc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8234009d90 tx=0x7f823401f150 comp rx=0 tx=0).stop 2024-04-18T04:55:15.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 -- 172.21.15.96:0/435487661 shutdown_connections 2024-04-18T04:55:15.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 --2- 172.21.15.96:0/435487661 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f823c15a950 0x7f823c15adc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 --2- 172.21.15.96:0/435487661 >> v2:172.21.15.139:3300/0 conn(0x7f823c151210 0x7f823c0c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 -- 172.21.15.96:0/435487661 >> 172.21.15.96:0/435487661 conn(0x7f823c06c750 msgr2=0x7f823c0c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 -- 172.21.15.96:0/435487661 shutdown_connections 2024-04-18T04:55:15.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 -- 172.21.15.96:0/435487661 wait complete. 2024-04-18T04:55:15.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 Processor -- start 2024-04-18T04:55:15.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 -- start start 2024-04-18T04:55:15.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f823c0c1db0 0x7f823c1ed640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f823c151210 0x7f823c14bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f823c15a950 0x7f823c14f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c14b4c0 con 0x7f823c151210 2024-04-18T04:55:15.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c14d450 con 0x7f823c0c1db0 2024-04-18T04:55:15.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823c14d730 con 0x7f823c15a950 2024-04-18T04:55:15.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8241168640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f823c151210 0x7f823c14bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8241168640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f823c151210 0x7f823c14bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37686/0 (socket says 172.21.15.96:37686) 2024-04-18T04:55:15.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8241168640 1 -- 172.21.15.96:0/1387835119 learned_addr learned my addr 172.21.15.96:0/1387835119 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:15.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8241969640 1 --2- 172.21.15.96:0/1387835119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f823c0c1db0 0x7f823c1ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f824216a640 1 --2- 172.21.15.96:0/1387835119 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f823c15a950 0x7f823c14f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8241168640 1 -- 172.21.15.96:0/1387835119 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f823c15a950 msgr2=0x7f823c14f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8241168640 1 --2- 172.21.15.96:0/1387835119 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f823c15a950 0x7f823c14f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8241168640 1 -- 172.21.15.96:0/1387835119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f823c0c1db0 msgr2=0x7f823c1ed640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8241168640 1 --2- 172.21.15.96:0/1387835119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f823c0c1db0 0x7f823c1ed640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8241168640 1 -- 172.21.15.96:0/1387835119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8234009a70 con 0x7f823c151210 2024-04-18T04:55:15.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f824216a640 1 --2- 172.21.15.96:0/1387835119 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f823c15a950 0x7f823c14f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:15.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8241168640 1 --2- 172.21.15.96:0/1387835119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f823c151210 0x7f823c14bf60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f822c00c420 tx=0x7f822c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f82327fc640 1 -- 172.21.15.96:0/1387835119 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c005cf0 con 0x7f823c151210 2024-04-18T04:55:15.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f82327fc640 1 -- 172.21.15.96:0/1387835119 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c005e50 con 0x7f823c151210 2024-04-18T04:55:15.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 -- 172.21.15.96:0/1387835119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823c14da10 con 0x7f823c151210 2024-04-18T04:55:15.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f82327fc640 1 -- 172.21.15.96:0/1387835119 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c0072d0 con 0x7f823c151210 2024-04-18T04:55:15.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.718+0000 7f8243bcd640 1 -- 172.21.15.96:0/1387835119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823c14ba40 con 0x7f823c151210 2024-04-18T04:55:15.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.722+0000 7f8243bcd640 1 -- 172.21.15.96:0/1387835119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823c14bc30 con 0x7f823c151210 2024-04-18T04:55:15.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.722+0000 7f82327fc640 1 -- 172.21.15.96:0/1387835119 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f822c007430 con 0x7f823c151210 2024-04-18T04:55:15.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.722+0000 7f82327fc640 1 --2- 172.21.15.96:0/1387835119 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f82200666c0 0x7f8220068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:15.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.722+0000 7f82327fc640 1 -- 172.21.15.96:0/1387835119 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f822c0836a0 con 0x7f823c151210 2024-04-18T04:55:15.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.722+0000 7f8241969640 1 --2- 172.21.15.96:0/1387835119 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f82200666c0 0x7f8220068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:15.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.722+0000 7f8241969640 1 --2- 172.21.15.96:0/1387835119 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f82200666c0 0x7f8220068b80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8238009a50 tx=0x7f8238008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:15.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.726+0000 7f82327fc640 1 -- 172.21.15.96:0/1387835119 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f822c050ac0 con 0x7f823c151210 2024-04-18T04:55:15.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.918+0000 7f8243bcd640 1 -- 172.21.15.96:0/1387835119 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f823c067050 con 0x7f823c151210 2024-04-18T04:55:15.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.918+0000 7f82327fc640 1 -- 172.21.15.96:0/1387835119 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f822c017070 con 0x7f823c151210 2024-04-18T04:55:15.923 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-18T04:55:15.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.922+0000 7f8243bcd640 1 -- 172.21.15.96:0/1387835119 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f82200666c0 msgr2=0x7f8220068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.922+0000 7f8243bcd640 1 --2- 172.21.15.96:0/1387835119 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f82200666c0 0x7f8220068b80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8238009a50 tx=0x7f8238008040 comp rx=0 tx=0).stop 2024-04-18T04:55:15.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.922+0000 7f8243bcd640 1 -- 172.21.15.96:0/1387835119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f823c151210 msgr2=0x7f823c14bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:15.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.922+0000 7f8243bcd640 1 --2- 172.21.15.96:0/1387835119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f823c151210 0x7f823c14bf60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f822c00c420 tx=0x7f822c00c8e0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.922+0000 7f8243bcd640 1 -- 172.21.15.96:0/1387835119 shutdown_connections 2024-04-18T04:55:15.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.922+0000 7f8243bcd640 1 --2- 172.21.15.96:0/1387835119 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f82200666c0 0x7f8220068b80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.922+0000 7f8243bcd640 1 --2- 172.21.15.96:0/1387835119 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f823c15a950 0x7f823c14f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.922+0000 7f8243bcd640 1 --2- 172.21.15.96:0/1387835119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f823c151210 0x7f823c14bf60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.922+0000 7f8243bcd640 1 --2- 172.21.15.96:0/1387835119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f823c0c1db0 0x7f823c1ed640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:15.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.922+0000 7f8243bcd640 1 -- 172.21.15.96:0/1387835119 >> 172.21.15.96:0/1387835119 conn(0x7f823c06c750 msgr2=0x7f823c0c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:15.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.922+0000 7f8243bcd640 1 -- 172.21.15.96:0/1387835119 shutdown_connections 2024-04-18T04:55:15.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:15.922+0000 7f8243bcd640 1 -- 172.21.15.96:0/1387835119 wait complete. 2024-04-18T04:55:15.942 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-18T04:55:15.942 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-18T04:55:15.942 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2024-04-18T04:55:15.942 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-18T04:55:15.942 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-18T04:55:15.942 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-18T04:55:15.943 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-18T04:55:15.943 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-18T04:55:15.943 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-18T04:55:15.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:15.943 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2024-04-18T04:55:15.950 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T04:55:15.950 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T04:55:15.950 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T04:55:15.950 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-18T04:55:15.950 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2024-04-18T04:55:15.950 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-18T04:55:15.950 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T04:55:15.951 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2024-04-18T04:55:15.951 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f0 2024-04-18T04:55:15.951 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T04:55:15.951 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2024-04-18T04:55:15.951 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f1 2024-04-18T04:55:15.951 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T04:55:15.951 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2024-04-18T04:55:15.951 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-18T04:55:15.951 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2024-04-18T04:55:15.951 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-18T04:55:15.952 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42514sec preferred_lft 42514sec 2024-04-18T04:55:15.952 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::ec4:7aff:fe8f:cc0d/64 scope link 2024-04-18T04:55:15.952 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-18T04:55:15.952 INFO:teuthology.orchestra.run.smithi096.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-18T04:55:15.952 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 02:42:65:5c:1d:c9 brd ff:ff:ff:ff:ff:ff 2024-04-18T04:55:15.952 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-18T04:55:15.952 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-04-18T04:55:15.953 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-18T04:55:15.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:15.953 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2024-04-18T04:55:15.953 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-18T04:55:15.953 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add name ceph-brx type bridge 2024-04-18T04:55:15.953 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr flush dev ceph-brx 2024-04-18T04:55:15.953 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set ceph-brx up 2024-04-18T04:55:15.953 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-18T04:55:15.953 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-18T04:55:16.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:16.025 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-18T04:55:16.076 INFO:teuthology.orchestra.run.smithi096.stdout:1 2024-04-18T04:55:16.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:16.077 DEBUG:teuthology.orchestra.run.smithi096:> route 2024-04-18T04:55:16.157 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2024-04-18T04:55:16.157 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-18T04:55:16.157 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-18T04:55:16.157 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-18T04:55:16.157 INFO:teuthology.orchestra.run.smithi096.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-18T04:55:16.157 INFO:teuthology.orchestra.run.smithi096.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-18T04:55:16.157 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-18T04:55:16.157 INFO:teuthology.orchestra.run.smithi096.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T04:55:16.157 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T04:55:16.158 INFO:teuthology.orchestra.run.smithi096.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T04:55:16.158 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-18T04:55:16.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:16.158 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2024-04-18T04:55:16.158 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-18T04:55:16.158 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-18T04:55:16.158 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-18T04:55:16.158 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-18T04:55:16.159 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-18T04:55:16.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:16.233 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-04-18T04:55:16.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:16.281 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list-id 2024-04-18T04:55:16.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:16.328 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2024-04-18T04:55:16.328 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-18T04:55:16.328 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T04:55:16.328 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-18T04:55:16.328 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-18T04:55:16.398 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-18T04:55:16.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:16.399 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2024-04-18T04:55:16.399 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-18T04:55:16.399 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-18T04:55:16.399 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-18T04:55:16.399 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-18T04:55:16.399 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-18T04:55:16.399 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-18T04:55:16.399 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-18T04:55:16.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:16.511 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2024-04-18T04:55:16.512 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-04-18T04:55:16.512 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.0 up 2024-04-18T04:55:16.512 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set dev brx.0 master ceph-brx 2024-04-18T04:55:16.512 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-04-18T04:55:16.531 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-18T04:55:16.531 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T04:55:16.531 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-18T04:55:16.579 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-18T04:55:16.580 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T04:55:16.580 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-18T04:55:16.632 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2024-04-18T04:55:16.687 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T04:55:16.687 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T04:55:16.747 INFO:teuthology.orchestra.run.smithi096.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T04:55:16.748 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T04:55:16.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:16.749 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2024-04-18T04:55:16.796 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-18T04:55:16.796 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-18T04:55:16.841 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2024-04-18T04:55:16.855 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T04:55:16.855 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T04:55:16.910 INFO:teuthology.orchestra.run.smithi096.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T04:55:16.911 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T04:55:16.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:16.912 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2024-04-18T04:55:16.918 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:2024-04-18T04:55:16.914+0000 7f37e52fd580 -1 init, newargv = 0x55a7011da240 newargc=15 2024-04-18T04:55:16.919 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[33640]: starting ceph client 2024-04-18T04:55:16.936 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[33640]: starting fuse 2024-04-18T04:55:17.374 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:55:17.377 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:55:18.023 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2024-04-18T04:55:18.040 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T04:55:18.040 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T04:55:18.095 INFO:teuthology.orchestra.run.smithi096.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T04:55:18.096 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T04:55:18.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:18.097 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2024-04-18T04:55:18.144 INFO:teuthology.orchestra.run.smithi096.stdout:45 2024-04-18T04:55:18.145 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-18T04:55:18.145 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-18T04:55:18.145 DEBUG:teuthology.orchestra.run.smithi096:> import glob 2024-04-18T04:55:18.145 DEBUG:teuthology.orchestra.run.smithi096:> import re 2024-04-18T04:55:18.145 DEBUG:teuthology.orchestra.run.smithi096:> import os 2024-04-18T04:55:18.145 DEBUG:teuthology.orchestra.run.smithi096:> import subprocess 2024-04-18T04:55:18.145 DEBUG:teuthology.orchestra.run.smithi096:> 2024-04-18T04:55:18.145 DEBUG:teuthology.orchestra.run.smithi096:> def _find_admin_socket(client_name): 2024-04-18T04:55:18.145 DEBUG:teuthology.orchestra.run.smithi096:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-18T04:55:18.145 DEBUG:teuthology.orchestra.run.smithi096:> files = glob.glob(asok_path) 2024-04-18T04:55:18.145 DEBUG:teuthology.orchestra.run.smithi096:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-18T04:55:18.145 DEBUG:teuthology.orchestra.run.smithi096:> 2024-04-18T04:55:18.145 DEBUG:teuthology.orchestra.run.smithi096:> # Given a non-glob path, it better be there 2024-04-18T04:55:18.145 DEBUG:teuthology.orchestra.run.smithi096:> if "*" not in asok_path: 2024-04-18T04:55:18.146 DEBUG:teuthology.orchestra.run.smithi096:> assert(len(files) == 1) 2024-04-18T04:55:18.146 DEBUG:teuthology.orchestra.run.smithi096:> return files[0] 2024-04-18T04:55:18.146 DEBUG:teuthology.orchestra.run.smithi096:> 2024-04-18T04:55:18.146 DEBUG:teuthology.orchestra.run.smithi096:> for f in files: 2024-04-18T04:55:18.146 DEBUG:teuthology.orchestra.run.smithi096:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-18T04:55:18.146 DEBUG:teuthology.orchestra.run.smithi096:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-18T04:55:18.146 DEBUG:teuthology.orchestra.run.smithi096:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-18T04:55:18.146 DEBUG:teuthology.orchestra.run.smithi096:> contents = proc_f.read() 2024-04-18T04:55:18.146 DEBUG:teuthology.orchestra.run.smithi096:> if mountpoint in contents: 2024-04-18T04:55:18.146 DEBUG:teuthology.orchestra.run.smithi096:> return f 2024-04-18T04:55:18.146 DEBUG:teuthology.orchestra.run.smithi096:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-18T04:55:18.146 DEBUG:teuthology.orchestra.run.smithi096:> 2024-04-18T04:55:18.146 DEBUG:teuthology.orchestra.run.smithi096:> print(_find_admin_socket("client.0")) 2024-04-18T04:55:18.146 DEBUG:teuthology.orchestra.run.smithi096:> ' 2024-04-18T04:55:18.264 INFO:teuthology.orchestra.run.smithi096.stdout:/var/run/ceph/ceph-client.0.33640.asok 2024-04-18T04:55:18.447 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33640.asok 2024-04-18T04:55:18.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:18.447 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33640.asok status 2024-04-18T04:55:18.606 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:55:18.606 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": { 2024-04-18T04:55:18.606 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_sha1": "56a91dd158be807f143cc918a11685fc9ee164ae", 2024-04-18T04:55:18.606 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 18.2.2-1229-g56a91dd1 (56a91dd158be807f143cc918a11685fc9ee164ae) reef (stable)", 2024-04-18T04:55:18.607 INFO:teuthology.orchestra.run.smithi096.stdout: "entity_id": "0", 2024-04-18T04:55:18.607 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": "smithi096", 2024-04-18T04:55:18.607 INFO:teuthology.orchestra.run.smithi096.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-18T04:55:18.607 INFO:teuthology.orchestra.run.smithi096.stdout: "pid": "33640", 2024-04-18T04:55:18.607 INFO:teuthology.orchestra.run.smithi096.stdout: "root": "/" 2024-04-18T04:55:18.607 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:18.607 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_count": 0, 2024-04-18T04:55:18.607 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_pinned_count": 0, 2024-04-18T04:55:18.607 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4830, 2024-04-18T04:55:18.607 INFO:teuthology.orchestra.run.smithi096.stdout: "inst": { 2024-04-18T04:55:18.607 INFO:teuthology.orchestra.run.smithi096.stdout: "name": { 2024-04-18T04:55:18.607 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "client", 2024-04-18T04:55:18.607 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4830 2024-04-18T04:55:18.607 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:18.607 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2024-04-18T04:55:18.608 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:18.608 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2024-04-18T04:55:18.608 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1877361357 2024-04-18T04:55:18.608 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:18.608 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:18.608 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2024-04-18T04:55:18.608 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:18.608 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2024-04-18T04:55:18.608 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1877361357 2024-04-18T04:55:18.608 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:18.608 INFO:teuthology.orchestra.run.smithi096.stdout: "inst_str": "client.4830 192.168.0.1:0/1877361357", 2024-04-18T04:55:18.608 INFO:teuthology.orchestra.run.smithi096.stdout: "addr_str": "192.168.0.1:0/1877361357", 2024-04-18T04:55:18.608 INFO:teuthology.orchestra.run.smithi096.stdout: "inode_count": 1, 2024-04-18T04:55:18.608 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_epoch": 17, 2024-04-18T04:55:18.609 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch": 21, 2024-04-18T04:55:18.609 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch_barrier": 0, 2024-04-18T04:55:18.609 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklisted": false, 2024-04-18T04:55:18.609 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs" 2024-04-18T04:55:18.609 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:55:18.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:18.620 DEBUG:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2024-04-18T04:55:18.620 DEBUG:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-18T04:55:18.626 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2024-04-18T04:55:18.626 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-18T04:55:18.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:18.627 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-18T04:55:18.686 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-04-18T04:55:18.698 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-04-18T04:55:18.698 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:55:18.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f3069230640 1 Processor -- start 2024-04-18T04:55:18.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f3069230640 1 -- start start 2024-04-18T04:55:18.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f3069230640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3064070a40 0x7f3064156130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f3069230640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3064159380 con 0x7f30640c60e0 2024-04-18T04:55:18.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f3069230640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3064159620 con 0x7f3064150260 2024-04-18T04:55:18.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f3069230640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306415a1a0 con 0x7f3064070a40 2024-04-18T04:55:18.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f3062d9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f30640c60e0 0x7f306414fb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36100/0 (socket says 172.21.15.96:36100) 2024-04-18T04:55:18.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f3062d9d640 1 -- 172.21.15.96:0/3420555782 learned_addr learned my addr 172.21.15.96:0/3420555782 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:18.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f305bfff640 1 --2- 172.21.15.96:0/3420555782 >> v2:172.21.15.139:3300/0 conn(0x7f3064070a40 0x7f3064156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306259c640 1 -- 172.21.15.96:0/3420555782 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320722379 0 0) 0x7f3064159380 con 0x7f30640c60e0 2024-04-18T04:55:18.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306259c640 1 -- 172.21.15.96:0/3420555782 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3050003530 con 0x7f30640c60e0 2024-04-18T04:55:18.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306259c640 1 -- 172.21.15.96:0/3420555782 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3592234068 0 0) 0x7f3050003530 con 0x7f30640c60e0 2024-04-18T04:55:18.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306259c640 1 -- 172.21.15.96:0/3420555782 >> v2:172.21.15.139:3300/0 conn(0x7f3064070a40 msgr2=0x7f3064156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:18.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306259c640 1 --2- 172.21.15.96:0/3420555782 >> v2:172.21.15.139:3300/0 conn(0x7f3064070a40 0x7f3064156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306259c640 1 -- 172.21.15.96:0/3420555782 >> v1:172.21.15.139:6789/0 conn(0x7f3064150260 legacy=0x7f3064160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306259c640 1 -- 172.21.15.96:0/3420555782 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3064159900 con 0x7f30640c60e0 2024-04-18T04:55:18.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306259c640 1 -- 172.21.15.96:0/3420555782 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f3054001680 con 0x7f30640c60e0 2024-04-18T04:55:18.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306259c640 1 -- 172.21.15.96:0/3420555782 >> v1:172.21.15.96:6789/0 conn(0x7f30640c60e0 legacy=0x7f306414fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306259c640 1 --2- 172.21.15.96:0/3420555782 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3050003980 0x7f3050003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306259c640 1 --2- 172.21.15.96:0/3420555782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30500047d0 0x7f3050004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306259c640 1 --2- 172.21.15.96:0/3420555782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3050005190 0x7f305000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306259c640 1 -- 172.21.15.96:0/3420555782 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306415a1a0 con 0x7f30500047d0 2024-04-18T04:55:18.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306259c640 1 -- 172.21.15.96:0/3420555782 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305000e240 con 0x7f3050005190 2024-04-18T04:55:18.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306259c640 1 -- 172.21.15.96:0/3420555782 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305000e400 con 0x7f3050003980 2024-04-18T04:55:18.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f305bfff640 1 --2- 172.21.15.96:0/3420555782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30500047d0 0x7f3050004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f305bfff640 1 -- 172.21.15.96:0/3420555782 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3050003980 msgr2=0x7f3050003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:18.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f3062d9d640 1 --2- 172.21.15.96:0/3420555782 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3050003980 0x7f3050003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306359e640 1 --2- 172.21.15.96:0/3420555782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3050005190 0x7f305000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f305bfff640 1 --2- 172.21.15.96:0/3420555782 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3050003980 0x7f3050003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f305bfff640 1 -- 172.21.15.96:0/3420555782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3050005190 msgr2=0x7f305000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:18.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f305bfff640 1 --2- 172.21.15.96:0/3420555782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3050005190 0x7f305000dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f305bfff640 1 -- 172.21.15.96:0/3420555782 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050003530 con 0x7f30500047d0 2024-04-18T04:55:18.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.858+0000 7f306359e640 1 -- 172.21.15.96:0/3420555782 reap_dead start 2024-04-18T04:55:18.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f305bfff640 1 --2- 172.21.15.96:0/3420555782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30500047d0 0x7f3050004c50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f304c009ae0 tx=0x7f304c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1673133b62ba33 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:18.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f306259c640 1 -- 172.21.15.96:0/3420555782 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0a5660 con 0x7f30500047d0 2024-04-18T04:55:18.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f306259c640 1 -- 172.21.15.96:0/3420555782 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c0a57c0 con 0x7f30500047d0 2024-04-18T04:55:18.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f306259c640 1 -- 172.21.15.96:0/3420555782 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0a5b70 con 0x7f30500047d0 2024-04-18T04:55:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f3069230640 1 -- 172.21.15.96:0/3420555782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30500047d0 msgr2=0x7f3050004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f3069230640 1 --2- 172.21.15.96:0/3420555782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30500047d0 0x7f3050004c50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f304c009ae0 tx=0x7f304c01ca70 comp rx=0 tx=0).stop 2024-04-18T04:55:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f3069230640 1 -- 172.21.15.96:0/3420555782 shutdown_connections 2024-04-18T04:55:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f3069230640 1 --2- 172.21.15.96:0/3420555782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30500047d0 0x7f3050004c50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f3069230640 1 -- 172.21.15.96:0/3420555782 >> 172.21.15.96:0/3420555782 conn(0x7f306406c750 msgr2=0x7f30640c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f3069230640 1 -- 172.21.15.96:0/3420555782 shutdown_connections 2024-04-18T04:55:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f3069230640 1 -- 172.21.15.96:0/3420555782 wait complete. 2024-04-18T04:55:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f3069230640 1 Processor -- start 2024-04-18T04:55:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f3069230640 1 -- start start 2024-04-18T04:55:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f3069230640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30500047d0 0x7f30641edd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f3069230640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3064139ff0 0x7f3064139650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f3069230640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3064139b90 0x7f3064144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f3069230640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306413e900 con 0x7f3064139b90 2024-04-18T04:55:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f3069230640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306413e2d0 con 0x7f30500047d0 2024-04-18T04:55:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f3069230640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3064140bd0 con 0x7f3064139ff0 2024-04-18T04:55:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f306359e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3064139b90 0x7f3064144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f306359e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3064139b90 0x7f3064144f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37710/0 (socket says 172.21.15.96:37710) 2024-04-18T04:55:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f306359e640 1 -- 172.21.15.96:0/880713128 learned_addr learned my addr 172.21.15.96:0/880713128 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f3062d9d640 1 --2- 172.21.15.96:0/880713128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30500047d0 0x7f30641edd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.862+0000 7f305bfff640 1 --2- 172.21.15.96:0/880713128 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3064139ff0 0x7f3064139650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f306359e640 1 -- 172.21.15.96:0/880713128 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3064139ff0 msgr2=0x7f3064139650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f306359e640 1 --2- 172.21.15.96:0/880713128 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3064139ff0 0x7f3064139650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f306359e640 1 -- 172.21.15.96:0/880713128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30500047d0 msgr2=0x7f30641edd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f306359e640 1 --2- 172.21.15.96:0/880713128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30500047d0 0x7f30641edd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f306359e640 1 -- 172.21.15.96:0/880713128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3064140e90 con 0x7f3064139b90 2024-04-18T04:55:18.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f305bfff640 1 --2- 172.21.15.96:0/880713128 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3064139ff0 0x7f3064139650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:18.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f306359e640 1 --2- 172.21.15.96:0/880713128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3064139b90 0x7f3064144f10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f30640c30a0 tx=0x7f305c00d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:18.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f305b7fe640 1 -- 172.21.15.96:0/880713128 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c003d90 con 0x7f3064139b90 2024-04-18T04:55:18.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f305b7fe640 1 -- 172.21.15.96:0/880713128 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c005070 con 0x7f3064139b90 2024-04-18T04:55:18.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f3069230640 1 -- 172.21.15.96:0/880713128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3064141170 con 0x7f3064139b90 2024-04-18T04:55:18.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f305b7fe640 1 -- 172.21.15.96:0/880713128 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c005420 con 0x7f3064139b90 2024-04-18T04:55:18.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f3069230640 1 -- 172.21.15.96:0/880713128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306413ed20 con 0x7f3064139b90 2024-04-18T04:55:18.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f3069230640 1 -- 172.21.15.96:0/880713128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3064141300 con 0x7f3064139b90 2024-04-18T04:55:18.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f305b7fe640 1 -- 172.21.15.96:0/880713128 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f305c005580 con 0x7f3064139b90 2024-04-18T04:55:18.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f305b7fe640 1 --2- 172.21.15.96:0/880713128 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3044066690 0x7f3044068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f305b7fe640 1 -- 172.21.15.96:0/880713128 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f305c083a80 con 0x7f3064139b90 2024-04-18T04:55:18.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f3062d9d640 1 --2- 172.21.15.96:0/880713128 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3044066690 0x7f3044068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.866+0000 7f3062d9d640 1 --2- 172.21.15.96:0/880713128 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3044066690 0x7f3044068b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3054004880 tx=0x7f3054001580 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:18.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:18.870+0000 7f305b7fe640 1 -- 172.21.15.96:0/880713128 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f305c050df0 con 0x7f3064139b90 2024-04-18T04:55:19.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.026+0000 7f3069230640 1 -- 172.21.15.96:0/880713128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3064067050 con 0x7f3064139b90 2024-04-18T04:55:19.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.030+0000 7f305b7fe640 1 -- 172.21.15.96:0/880713128 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f305c018070 con 0x7f3064139b90 2024-04-18T04:55:19.028 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:55:19.028 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":21,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:54:42.161552+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:54:39.219441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:54:40.139557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.720340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.767224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.811511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.710188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.860525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.704784+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:55:19.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.030+0000 7f3069230640 1 -- 172.21.15.96:0/880713128 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3044066690 msgr2=0x7f3044068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.030+0000 7f3069230640 1 --2- 172.21.15.96:0/880713128 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3044066690 0x7f3044068b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3054004880 tx=0x7f3054001580 comp rx=0 tx=0).stop 2024-04-18T04:55:19.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.030+0000 7f3069230640 1 -- 172.21.15.96:0/880713128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3064139b90 msgr2=0x7f3064144f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.030+0000 7f3069230640 1 --2- 172.21.15.96:0/880713128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3064139b90 0x7f3064144f10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f30640c30a0 tx=0x7f305c00d9d0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.030+0000 7f3069230640 1 -- 172.21.15.96:0/880713128 shutdown_connections 2024-04-18T04:55:19.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.030+0000 7f3069230640 1 --2- 172.21.15.96:0/880713128 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3044066690 0x7f3044068b50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.030+0000 7f3069230640 1 --2- 172.21.15.96:0/880713128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3064139b90 0x7f3064144f10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.030+0000 7f3069230640 1 --2- 172.21.15.96:0/880713128 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3064139ff0 0x7f3064139650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.030+0000 7f3069230640 1 --2- 172.21.15.96:0/880713128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30500047d0 0x7f30641edd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.030+0000 7f3069230640 1 -- 172.21.15.96:0/880713128 >> 172.21.15.96:0/880713128 conn(0x7f306406c750 msgr2=0x7f30640c5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:19.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.030+0000 7f3069230640 1 -- 172.21.15.96:0/880713128 shutdown_connections 2024-04-18T04:55:19.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.030+0000 7f3069230640 1 -- 172.21.15.96:0/880713128 wait complete. 2024-04-18T04:55:19.045 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:54:32.641813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T04:54:39.219441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T04:54:40.139557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T04:55:19.045 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T04:55:19.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.166+0000 7fb06fab2640 1 Processor -- start 2024-04-18T04:55:19.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.166+0000 7fb06fab2640 1 -- start start 2024-04-18T04:55:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06fab2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb068157590 0x7fb0680c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06fab2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb068156d30 0x7fb0680c9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06fab2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb068157970 0x7fb0680c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06fab2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0680c89c0 con 0x7fb068157970 2024-04-18T04:55:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06fab2640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0680b0960 con 0x7fb068157590 2024-04-18T04:55:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06fab2640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680b0c00 con 0x7fb068156d30 2024-04-18T04:55:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06e04f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb068157970 0x7fb0680c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06e04f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb068157970 0x7fb0680c42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56652/0 (socket says 172.21.15.96:56652) 2024-04-18T04:55:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06e04f640 1 -- 172.21.15.96:0/488270746 learned_addr learned my addr 172.21.15.96:0/488270746 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06d84e640 1 --2- 172.21.15.96:0/488270746 >> v2:172.21.15.139:3300/0 conn(0x7fb068157590 0x7fb0680c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06d04d640 1 --2- 172.21.15.96:0/488270746 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb068156d30 0x7fb0680c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06e04f640 1 -- 172.21.15.96:0/488270746 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb068156d30 msgr2=0x7fb0680c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06e04f640 1 --2- 172.21.15.96:0/488270746 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb068156d30 0x7fb0680c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06e04f640 1 -- 172.21.15.96:0/488270746 >> v2:172.21.15.139:3300/0 conn(0x7fb068157590 msgr2=0x7fb0680c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:19.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06e04f640 1 --2- 172.21.15.96:0/488270746 >> v2:172.21.15.139:3300/0 conn(0x7fb068157590 0x7fb0680c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06e04f640 1 -- 172.21.15.96:0/488270746 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0680b0ee0 con 0x7fb068157970 2024-04-18T04:55:19.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06d84e640 1 --2- 172.21.15.96:0/488270746 >> v2:172.21.15.139:3300/0 conn(0x7fb068157590 0x7fb0680c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:19.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06e04f640 1 --2- 172.21.15.96:0/488270746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb068157970 0x7fb0680c42d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb068070040 tx=0x7fb06001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3300bccc1f5a92 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:19.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06c84c640 1 -- 172.21.15.96:0/488270746 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0600a5860 con 0x7fb068157970 2024-04-18T04:55:19.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06c84c640 1 -- 172.21.15.96:0/488270746 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0600a59c0 con 0x7fb068157970 2024-04-18T04:55:19.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.170+0000 7fb06c84c640 1 -- 172.21.15.96:0/488270746 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0600a5d50 con 0x7fb068157970 2024-04-18T04:55:19.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 -- 172.21.15.96:0/488270746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb068157970 msgr2=0x7fb0680c42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 --2- 172.21.15.96:0/488270746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb068157970 0x7fb0680c42d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb068070040 tx=0x7fb06001c9c0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 -- 172.21.15.96:0/488270746 shutdown_connections 2024-04-18T04:55:19.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 --2- 172.21.15.96:0/488270746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb068157970 0x7fb0680c42d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 --2- 172.21.15.96:0/488270746 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb068156d30 0x7fb0680c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 --2- 172.21.15.96:0/488270746 >> v2:172.21.15.139:3300/0 conn(0x7fb068157590 0x7fb0680c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 -- 172.21.15.96:0/488270746 >> 172.21.15.96:0/488270746 conn(0x7fb0680c76c0 msgr2=0x7fb0680c7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:19.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 -- 172.21.15.96:0/488270746 shutdown_connections 2024-04-18T04:55:19.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 -- 172.21.15.96:0/488270746 wait complete. 2024-04-18T04:55:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 Processor -- start 2024-04-18T04:55:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 -- start start 2024-04-18T04:55:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb068156d30 0x7fb068144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb068157590 0x7fb068156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb068157970 0x7fb068157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680bfeb0 con 0x7fb068156d30 2024-04-18T04:55:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06815fe60 con 0x7fb068157970 2024-04-18T04:55:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0681607a0 con 0x7fb068157590 2024-04-18T04:55:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06d84e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb068156d30 0x7fb068144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06d84e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb068156d30 0x7fb068144100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56668/0 (socket says 172.21.15.96:56668) 2024-04-18T04:55:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06d84e640 1 -- 172.21.15.96:0/3900060727 learned_addr learned my addr 172.21.15.96:0/3900060727 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06d04d640 1 --2- 172.21.15.96:0/3900060727 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb068157590 0x7fb068156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06e04f640 1 --2- 172.21.15.96:0/3900060727 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb068157970 0x7fb068157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06d84e640 1 -- 172.21.15.96:0/3900060727 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb068157590 msgr2=0x7fb068156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06d84e640 1 --2- 172.21.15.96:0/3900060727 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb068157590 0x7fb068156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06d84e640 1 -- 172.21.15.96:0/3900060727 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb068157970 msgr2=0x7fb068157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06d84e640 1 --2- 172.21.15.96:0/3900060727 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb068157970 0x7fb068157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06d84e640 1 -- 172.21.15.96:0/3900060727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb060009b30 con 0x7fb068156d30 2024-04-18T04:55:19.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06d84e640 1 --2- 172.21.15.96:0/3900060727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb068156d30 0x7fb068144100 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb05800c7f0 tx=0x7fb05800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:19.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb0667fc640 1 -- 172.21.15.96:0/3900060727 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058007820 con 0x7fb068156d30 2024-04-18T04:55:19.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb0667fc640 1 -- 172.21.15.96:0/3900060727 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb058007980 con 0x7fb068156d30 2024-04-18T04:55:19.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb0667fc640 1 -- 172.21.15.96:0/3900060727 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058007d30 con 0x7fb068156d30 2024-04-18T04:55:19.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 -- 172.21.15.96:0/3900060727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06815f6f0 con 0x7fb068156d30 2024-04-18T04:55:19.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.174+0000 7fb06fab2640 1 -- 172.21.15.96:0/3900060727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0680c5260 con 0x7fb068156d30 2024-04-18T04:55:19.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.178+0000 7fb06fab2640 1 -- 172.21.15.96:0/3900060727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb068067050 con 0x7fb068156d30 2024-04-18T04:55:19.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.178+0000 7fb0667fc640 1 -- 172.21.15.96:0/3900060727 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb0580113f0 con 0x7fb068156d30 2024-04-18T04:55:19.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.178+0000 7fb0667fc640 1 --2- 172.21.15.96:0/3900060727 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb054066690 0x7fb054068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.178+0000 7fb0667fc640 1 -- 172.21.15.96:0/3900060727 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb058084590 con 0x7fb068156d30 2024-04-18T04:55:19.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.178+0000 7fb06d04d640 1 --2- 172.21.15.96:0/3900060727 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb054066690 0x7fb054068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.178+0000 7fb06d04d640 1 --2- 172.21.15.96:0/3900060727 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb054066690 0x7fb054068b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb0680c1c70 tx=0x7fb05c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:19.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.182+0000 7fb0667fc640 1 -- 172.21.15.96:0/3900060727 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb0580517d0 con 0x7fb068156d30 2024-04-18T04:55:19.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.342+0000 7fb06fab2640 1 -- 172.21.15.96:0/3900060727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0680c8f80 con 0x7fb068156d30 2024-04-18T04:55:19.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.342+0000 7fb0667fc640 1 -- 172.21.15.96:0/3900060727 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb058054df0 con 0x7fb068156d30 2024-04-18T04:55:19.340 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-18T04:55:19.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.342+0000 7fb06fab2640 1 -- 172.21.15.96:0/3900060727 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb054066690 msgr2=0x7fb054068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.342+0000 7fb06fab2640 1 --2- 172.21.15.96:0/3900060727 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb054066690 0x7fb054068b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb0680c1c70 tx=0x7fb05c008040 comp rx=0 tx=0).stop 2024-04-18T04:55:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.342+0000 7fb06fab2640 1 -- 172.21.15.96:0/3900060727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb068156d30 msgr2=0x7fb068144100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.342+0000 7fb06fab2640 1 --2- 172.21.15.96:0/3900060727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb068156d30 0x7fb068144100 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb05800c7f0 tx=0x7fb05800ccb0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.342+0000 7fb06fab2640 1 -- 172.21.15.96:0/3900060727 shutdown_connections 2024-04-18T04:55:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.342+0000 7fb06fab2640 1 --2- 172.21.15.96:0/3900060727 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb054066690 0x7fb054068b50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.342+0000 7fb06fab2640 1 --2- 172.21.15.96:0/3900060727 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb068157970 0x7fb068157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.342+0000 7fb06fab2640 1 --2- 172.21.15.96:0/3900060727 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb068157590 0x7fb068156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.342+0000 7fb06fab2640 1 --2- 172.21.15.96:0/3900060727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb068156d30 0x7fb068144100 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.342+0000 7fb06fab2640 1 -- 172.21.15.96:0/3900060727 >> 172.21.15.96:0/3900060727 conn(0x7fb0680c76c0 msgr2=0x7fb0680c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.342+0000 7fb06fab2640 1 -- 172.21.15.96:0/3900060727 shutdown_connections 2024-04-18T04:55:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.342+0000 7fb06fab2640 1 -- 172.21.15.96:0/3900060727 wait complete. 2024-04-18T04:55:19.359 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T04:55:19.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.486+0000 7f5da46d1640 1 Processor -- start 2024-04-18T04:55:19.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.486+0000 7f5da46d1640 1 -- start start 2024-04-18T04:55:19.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.486+0000 7f5da46d1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5d9c150e20 0x7f5d9c0c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.486+0000 7f5da46d1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9c0c6c50 con 0x7f5d9c0c8100 2024-04-18T04:55:19.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.486+0000 7f5da46d1640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9c0c9610 con 0x7f5d9c0c9020 2024-04-18T04:55:19.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.486+0000 7f5da46d1640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9c151200 con 0x7f5d9c150e20 2024-04-18T04:55:19.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.486+0000 7f5da246d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5d9c150e20 0x7f5d9c0c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.486+0000 7f5da1c6c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5d9c0c8100 0x7f5d9c0c9af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40626/0 (socket says 172.21.15.96:40626) 2024-04-18T04:55:19.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.486+0000 7f5da1c6c640 1 -- 172.21.15.96:0/3338850952 learned_addr learned my addr 172.21.15.96:0/3338850952 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:19.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.486+0000 7f5da246d640 1 -- 172.21.15.96:0/3338850952 >> v1:172.21.15.139:6789/0 conn(0x7f5d9c0c9020 legacy=0x7f5d9c0c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:19.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.486+0000 7f5da246d640 1 -- 172.21.15.96:0/3338850952 >> v1:172.21.15.96:6789/0 conn(0x7f5d9c0c8100 legacy=0x7f5d9c0c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.486+0000 7f5da146b640 1 -- 172.21.15.96:0/3338850952 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187431940 0 0) 0x7f5d9c0c6c50 con 0x7f5d9c0c8100 2024-04-18T04:55:19.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.486+0000 7f5da246d640 1 -- 172.21.15.96:0/3338850952 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c0c85d0 con 0x7f5d9c150e20 2024-04-18T04:55:19.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da246d640 1 --2- 172.21.15.96:0/3338850952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d9c150e20 0x7f5d9c0c8a80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5d980097c0 tx=0x7f5d9801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e8fbaea223a7c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:19.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da146b640 1 -- 172.21.15.96:0/3338850952 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d980a7070 con 0x7f5d9c150e20 2024-04-18T04:55:19.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da146b640 1 -- 172.21.15.96:0/3338850952 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d980ab430 con 0x7f5d9c150e20 2024-04-18T04:55:19.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da146b640 1 -- 172.21.15.96:0/3338850952 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d980ab7c0 con 0x7f5d9c150e20 2024-04-18T04:55:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da46d1640 1 -- 172.21.15.96:0/3338850952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d9c150e20 msgr2=0x7f5d9c0c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da46d1640 1 --2- 172.21.15.96:0/3338850952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d9c150e20 0x7f5d9c0c8a80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5d980097c0 tx=0x7f5d9801c430 comp rx=0 tx=0).stop 2024-04-18T04:55:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da46d1640 1 -- 172.21.15.96:0/3338850952 shutdown_connections 2024-04-18T04:55:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da46d1640 1 --2- 172.21.15.96:0/3338850952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d9c150e20 0x7f5d9c0c8a80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da46d1640 1 -- 172.21.15.96:0/3338850952 >> 172.21.15.96:0/3338850952 conn(0x7f5d9c06c610 msgr2=0x7f5d9c0ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da46d1640 1 -- 172.21.15.96:0/3338850952 shutdown_connections 2024-04-18T04:55:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da46d1640 1 -- 172.21.15.96:0/3338850952 wait complete. 2024-04-18T04:55:19.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da46d1640 1 Processor -- start 2024-04-18T04:55:19.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da46d1640 1 -- start start 2024-04-18T04:55:19.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da46d1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5d9c0c8100 0x7f5d9c15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da46d1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d9c0c9020 0x7f5d9c140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da46d1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d9c150e20 0x7f5d9c137c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da46d1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c1f3430 con 0x7f5d9c150e20 2024-04-18T04:55:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da46d1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c144470 con 0x7f5d9c0c9020 2024-04-18T04:55:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da46d1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c1eef10 con 0x7f5d9c0c8100 2024-04-18T04:55:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da2c6e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d9c150e20 0x7f5d9c137c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da2c6e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d9c150e20 0x7f5d9c137c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56686/0 (socket says 172.21.15.96:56686) 2024-04-18T04:55:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.490+0000 7f5da2c6e640 1 -- 172.21.15.96:0/2271857671 learned_addr learned my addr 172.21.15.96:0/2271857671 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5da1c6c640 1 --2- 172.21.15.96:0/2271857671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d9c0c9020 0x7f5d9c140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5da246d640 1 --2- 172.21.15.96:0/2271857671 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5d9c0c8100 0x7f5d9c15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5da2c6e640 1 -- 172.21.15.96:0/2271857671 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5d9c0c8100 msgr2=0x7f5d9c15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5da2c6e640 1 --2- 172.21.15.96:0/2271857671 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5d9c0c8100 0x7f5d9c15a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5da2c6e640 1 -- 172.21.15.96:0/2271857671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d9c0c9020 msgr2=0x7f5d9c140cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5da2c6e640 1 --2- 172.21.15.96:0/2271857671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d9c0c9020 0x7f5d9c140cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5da2c6e640 1 -- 172.21.15.96:0/2271857671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d98009420 con 0x7f5d9c150e20 2024-04-18T04:55:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5da2c6e640 1 --2- 172.21.15.96:0/2271857671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d9c150e20 0x7f5d9c137c60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400c780 tx=0x7f5d9400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5d92ffd640 1 -- 172.21.15.96:0/2271857671 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94004b70 con 0x7f5d9c150e20 2024-04-18T04:55:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5d92ffd640 1 -- 172.21.15.96:0/2271857671 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9400ce90 con 0x7f5d9c150e20 2024-04-18T04:55:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5da46d1640 1 -- 172.21.15.96:0/2271857671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9c1f2e90 con 0x7f5d9c150e20 2024-04-18T04:55:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5d92ffd640 1 -- 172.21.15.96:0/2271857671 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9400a850 con 0x7f5d9c150e20 2024-04-18T04:55:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5da46d1640 1 -- 172.21.15.96:0/2271857671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9c1454b0 con 0x7f5d9c150e20 2024-04-18T04:55:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5da46d1640 1 -- 172.21.15.96:0/2271857671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9c1ef130 con 0x7f5d9c150e20 2024-04-18T04:55:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5d92ffd640 1 -- 172.21.15.96:0/2271857671 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5d94006b60 con 0x7f5d9c150e20 2024-04-18T04:55:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5d92ffd640 1 --2- 172.21.15.96:0/2271857671 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5d80066690 0x7f5d80068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5d92ffd640 1 -- 172.21.15.96:0/2271857671 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d94084890 con 0x7f5d9c150e20 2024-04-18T04:55:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5da246d640 1 --2- 172.21.15.96:0/2271857671 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5d80066690 0x7f5d80068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.494+0000 7f5da246d640 1 --2- 172.21.15.96:0/2271857671 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5d80066690 0x7f5d80068b50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d980af000 tx=0x7f5d980a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.498+0000 7f5d92ffd640 1 -- 172.21.15.96:0/2271857671 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f5d94051c50 con 0x7f5d9c150e20 2024-04-18T04:55:19.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.642+0000 7f5da46d1640 1 -- 172.21.15.96:0/2271857671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5d9c1ef130 con 0x7f5d9c150e20 2024-04-18T04:55:19.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.646+0000 7f5d92ffd640 1 -- 172.21.15.96:0/2271857671 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5d9c1ef130 con 0x7f5d9c150e20 2024-04-18T04:55:19.644 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-18T04:55:19.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.646+0000 7f5da46d1640 1 -- 172.21.15.96:0/2271857671 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5d80066690 msgr2=0x7f5d80068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.646+0000 7f5da46d1640 1 --2- 172.21.15.96:0/2271857671 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5d80066690 0x7f5d80068b50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d980af000 tx=0x7f5d980a7000 comp rx=0 tx=0).stop 2024-04-18T04:55:19.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.646+0000 7f5da46d1640 1 -- 172.21.15.96:0/2271857671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d9c150e20 msgr2=0x7f5d9c137c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.646+0000 7f5da46d1640 1 --2- 172.21.15.96:0/2271857671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d9c150e20 0x7f5d9c137c60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400c780 tx=0x7f5d9400cc40 comp rx=0 tx=0).stop 2024-04-18T04:55:19.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.646+0000 7f5da46d1640 1 -- 172.21.15.96:0/2271857671 shutdown_connections 2024-04-18T04:55:19.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.646+0000 7f5da46d1640 1 --2- 172.21.15.96:0/2271857671 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5d80066690 0x7f5d80068b50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.646+0000 7f5da46d1640 1 --2- 172.21.15.96:0/2271857671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d9c150e20 0x7f5d9c137c60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.646+0000 7f5da46d1640 1 --2- 172.21.15.96:0/2271857671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d9c0c9020 0x7f5d9c140cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.646+0000 7f5da46d1640 1 --2- 172.21.15.96:0/2271857671 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5d9c0c8100 0x7f5d9c15a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.646+0000 7f5da46d1640 1 -- 172.21.15.96:0/2271857671 >> 172.21.15.96:0/2271857671 conn(0x7f5d9c06c610 msgr2=0x7f5d9c069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:19.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.646+0000 7f5da46d1640 1 -- 172.21.15.96:0/2271857671 shutdown_connections 2024-04-18T04:55:19.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.646+0000 7f5da46d1640 1 -- 172.21.15.96:0/2271857671 wait complete. 2024-04-18T04:55:19.661 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T04:55:19.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.786+0000 7fa65fafb640 1 Processor -- start 2024-04-18T04:55:19.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.786+0000 7fa65fafb640 1 -- start start 2024-04-18T04:55:19.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.786+0000 7fa65fafb640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa6580af0b0 0x7fa6580c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.786+0000 7fa65fafb640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa6580c7020 0x7fa658159380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.786+0000 7fa65fafb640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65806f050 con 0x7fa65806eb10 2024-04-18T04:55:19.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.786+0000 7fa65fafb640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65806b9b0 con 0x7fa6580af0b0 2024-04-18T04:55:19.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.786+0000 7fa65fafb640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65806f7e0 con 0x7fa6580c7020 2024-04-18T04:55:19.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.786+0000 7fa65d897640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa6580af0b0 0x7fa6580c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.786+0000 7fa65d897640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa6580af0b0 0x7fa6580c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56694/0 (socket says 172.21.15.96:56694) 2024-04-18T04:55:19.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.786+0000 7fa65d897640 1 -- 172.21.15.96:0/4266018027 learned_addr learned my addr 172.21.15.96:0/4266018027 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:19.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.786+0000 7fa65e098640 1 --2- 172.21.15.96:0/4266018027 >> v2:172.21.15.139:3300/0 conn(0x7fa6580c7020 0x7fa658159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.786+0000 7fa65d897640 1 -- 172.21.15.96:0/4266018027 >> v2:172.21.15.139:3300/0 conn(0x7fa6580c7020 msgr2=0x7fa658159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:19.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.786+0000 7fa65d897640 1 --2- 172.21.15.96:0/4266018027 >> v2:172.21.15.139:3300/0 conn(0x7fa6580c7020 0x7fa658159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.786+0000 7fa65d897640 1 -- 172.21.15.96:0/4266018027 >> v1:172.21.15.139:6789/0 conn(0x7fa65806eb10 legacy=0x7fa6580cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:19.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.786+0000 7fa65d897640 1 -- 172.21.15.96:0/4266018027 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65806b110 con 0x7fa6580af0b0 2024-04-18T04:55:19.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65d897640 1 --2- 172.21.15.96:0/4266018027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6580af0b0 0x7fa6580c34b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa65806ef50 tx=0x7fa65401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf515243ea9d6517 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:19.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65c895640 1 -- 172.21.15.96:0/4266018027 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6540ad660 con 0x7fa6580af0b0 2024-04-18T04:55:19.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65c895640 1 -- 172.21.15.96:0/4266018027 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6540ad7c0 con 0x7fa6580af0b0 2024-04-18T04:55:19.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65c895640 1 -- 172.21.15.96:0/4266018027 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6540adb50 con 0x7fa6580af0b0 2024-04-18T04:55:19.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 -- 172.21.15.96:0/4266018027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6580af0b0 msgr2=0x7fa6580c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 --2- 172.21.15.96:0/4266018027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6580af0b0 0x7fa6580c34b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa65806ef50 tx=0x7fa65401c450 comp rx=0 tx=0).stop 2024-04-18T04:55:19.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 -- 172.21.15.96:0/4266018027 shutdown_connections 2024-04-18T04:55:19.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 --2- 172.21.15.96:0/4266018027 >> v2:172.21.15.139:3300/0 conn(0x7fa6580c7020 0x7fa658159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 --2- 172.21.15.96:0/4266018027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6580af0b0 0x7fa6580c34b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 -- 172.21.15.96:0/4266018027 >> 172.21.15.96:0/4266018027 conn(0x7fa65806a5c0 msgr2=0x7fa658065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:19.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 -- 172.21.15.96:0/4266018027 shutdown_connections 2024-04-18T04:55:19.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 -- 172.21.15.96:0/4266018027 wait complete. 2024-04-18T04:55:19.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 Processor -- start 2024-04-18T04:55:19.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 -- start start 2024-04-18T04:55:19.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa65806eb10 0x7fa65814e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6580af0b0 0x7fa6580c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa6580c7020 0x7fa6580c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa658150140 con 0x7fa65806eb10 2024-04-18T04:55:19.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6580c6360 con 0x7fa6580af0b0 2024-04-18T04:55:19.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6580c6600 con 0x7fa6580c7020 2024-04-18T04:55:19.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65d897640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa65806eb10 0x7fa65814e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65d897640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa65806eb10 0x7fa65814e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56710/0 (socket says 172.21.15.96:56710) 2024-04-18T04:55:19.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65d897640 1 -- 172.21.15.96:0/3680553093 learned_addr learned my addr 172.21.15.96:0/3680553093 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:19.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65d096640 1 --2- 172.21.15.96:0/3680553093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6580af0b0 0x7fa6580c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65e098640 1 --2- 172.21.15.96:0/3680553093 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa6580c7020 0x7fa6580c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65d897640 1 -- 172.21.15.96:0/3680553093 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa6580c7020 msgr2=0x7fa6580c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65d897640 1 --2- 172.21.15.96:0/3680553093 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa6580c7020 0x7fa6580c4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65d897640 1 -- 172.21.15.96:0/3680553093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6580af0b0 msgr2=0x7fa6580c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65d897640 1 --2- 172.21.15.96:0/3680553093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6580af0b0 0x7fa6580c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65d897640 1 -- 172.21.15.96:0/3680553093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6540094d0 con 0x7fa65806eb10 2024-04-18T04:55:19.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65d897640 1 --2- 172.21.15.96:0/3680553093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa65806eb10 0x7fa65814e140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa65401a080 tx=0x7fa65401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:19.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa64e7fc640 1 -- 172.21.15.96:0/3680553093 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6540b8620 con 0x7fa65806eb10 2024-04-18T04:55:19.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa64e7fc640 1 -- 172.21.15.96:0/3680553093 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6540b8780 con 0x7fa65806eb10 2024-04-18T04:55:19.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 -- 172.21.15.96:0/3680553093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6580c68e0 con 0x7fa65806eb10 2024-04-18T04:55:19.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa64e7fc640 1 -- 172.21.15.96:0/3680553093 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6540b8b30 con 0x7fa65806eb10 2024-04-18T04:55:19.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.790+0000 7fa65fafb640 1 -- 172.21.15.96:0/3680553093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65814f660 con 0x7fa65806eb10 2024-04-18T04:55:19.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.794+0000 7fa65fafb640 1 -- 172.21.15.96:0/3680553093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa658067050 con 0x7fa65806eb10 2024-04-18T04:55:19.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.794+0000 7fa64e7fc640 1 -- 172.21.15.96:0/3680553093 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa6540b4040 con 0x7fa65806eb10 2024-04-18T04:55:19.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.794+0000 7fa64e7fc640 1 --2- 172.21.15.96:0/3680553093 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa63c066690 0x7fa63c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:19.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.794+0000 7fa64e7fc640 1 -- 172.21.15.96:0/3680553093 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa65411e8e0 con 0x7fa65806eb10 2024-04-18T04:55:19.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.794+0000 7fa65d096640 1 --2- 172.21.15.96:0/3680553093 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa63c066690 0x7fa63c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:19.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.794+0000 7fa65d096640 1 --2- 172.21.15.96:0/3680553093 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa63c066690 0x7fa63c068b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa6581f6260 tx=0x7fa648008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:19.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.798+0000 7fa64e7fc640 1 -- 172.21.15.96:0/3680553093 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa6540ebce0 con 0x7fa65806eb10 2024-04-18T04:55:19.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.942+0000 7fa65fafb640 1 -- 172.21.15.96:0/3680553093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6580c3080 con 0x7fa65806eb10 2024-04-18T04:55:19.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.946+0000 7fa64e7fc640 1 -- 172.21.15.96:0/3680553093 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6540ef300 con 0x7fa65806eb10 2024-04-18T04:55:19.944 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-18T04:55:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.946+0000 7fa65fafb640 1 -- 172.21.15.96:0/3680553093 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa63c066690 msgr2=0x7fa63c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.946+0000 7fa65fafb640 1 --2- 172.21.15.96:0/3680553093 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa63c066690 0x7fa63c068b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa6581f6260 tx=0x7fa648008040 comp rx=0 tx=0).stop 2024-04-18T04:55:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.946+0000 7fa65fafb640 1 -- 172.21.15.96:0/3680553093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa65806eb10 msgr2=0x7fa65814e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.946+0000 7fa65fafb640 1 --2- 172.21.15.96:0/3680553093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa65806eb10 0x7fa65814e140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa65401a080 tx=0x7fa65401ac90 comp rx=0 tx=0).stop 2024-04-18T04:55:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.946+0000 7fa65fafb640 1 -- 172.21.15.96:0/3680553093 shutdown_connections 2024-04-18T04:55:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.946+0000 7fa65fafb640 1 --2- 172.21.15.96:0/3680553093 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa63c066690 0x7fa63c068b50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.946+0000 7fa65fafb640 1 --2- 172.21.15.96:0/3680553093 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa6580c7020 0x7fa6580c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.946+0000 7fa65fafb640 1 --2- 172.21.15.96:0/3680553093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6580af0b0 0x7fa6580c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.946+0000 7fa65fafb640 1 --2- 172.21.15.96:0/3680553093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa65806eb10 0x7fa65814e140 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:19.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.946+0000 7fa65fafb640 1 -- 172.21.15.96:0/3680553093 >> 172.21.15.96:0/3680553093 conn(0x7fa65806a5c0 msgr2=0x7fa6580702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:19.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.946+0000 7fa65fafb640 1 -- 172.21.15.96:0/3680553093 shutdown_connections 2024-04-18T04:55:19.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:19.946+0000 7fa65fafb640 1 -- 172.21.15.96:0/3680553093 wait complete. 2024-04-18T04:55:19.961 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-04-18T04:55:19.961 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:55:20.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa82fc640 1 Processor -- start 2024-04-18T04:55:20.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa82fc640 1 -- start start 2024-04-18T04:55:20.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa82fc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ffaa0151210 0x7ffaa00c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa82fc640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa0157150 con 0x7ffaa015a950 2024-04-18T04:55:20.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa82fc640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa0157430 con 0x7ffaa00c1db0 2024-04-18T04:55:20.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa82fc640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa0157710 con 0x7ffaa0151210 2024-04-18T04:55:20.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa6899640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ffaa015a950 0x7ffaa015ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40634/0 (socket says 172.21.15.96:40634) 2024-04-18T04:55:20.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa6899640 1 -- 172.21.15.96:0/477184850 learned_addr learned my addr 172.21.15.96:0/477184850 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa6098640 1 --2- 172.21.15.96:0/477184850 >> v2:172.21.15.139:3300/0 conn(0x7ffaa0151210 0x7ffaa00c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa5096640 1 -- 172.21.15.96:0/477184850 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904048988 0 0) 0x7ffaa0157150 con 0x7ffaa015a950 2024-04-18T04:55:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa5096640 1 -- 172.21.15.96:0/477184850 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa88003530 con 0x7ffaa015a950 2024-04-18T04:55:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa5096640 1 -- 172.21.15.96:0/477184850 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1878376405 0 0) 0x7ffa88003530 con 0x7ffaa015a950 2024-04-18T04:55:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa5096640 1 -- 172.21.15.96:0/477184850 >> v2:172.21.15.139:3300/0 conn(0x7ffaa0151210 msgr2=0x7ffaa00c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa5096640 1 --2- 172.21.15.96:0/477184850 >> v2:172.21.15.139:3300/0 conn(0x7ffaa0151210 0x7ffaa00c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa5096640 1 -- 172.21.15.96:0/477184850 >> v1:172.21.15.139:6789/0 conn(0x7ffaa00c1db0 legacy=0x7ffaa00ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa5096640 1 -- 172.21.15.96:0/477184850 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa01579f0 con 0x7ffaa015a950 2024-04-18T04:55:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa5096640 1 -- 172.21.15.96:0/477184850 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7ffa98001680 con 0x7ffaa015a950 2024-04-18T04:55:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa5096640 1 -- 172.21.15.96:0/477184850 >> v1:172.21.15.96:6789/0 conn(0x7ffaa015a950 legacy=0x7ffaa015ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa5096640 1 --2- 172.21.15.96:0/477184850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa88003980 0x7ffa88003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa5096640 1 --2- 172.21.15.96:0/477184850 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ffa880047d0 0x7ffa88004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa5096640 1 --2- 172.21.15.96:0/477184850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa88005190 0x7ffa8800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa5096640 1 -- 172.21.15.96:0/477184850 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0157710 con 0x7ffa88005190 2024-04-18T04:55:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa5096640 1 -- 172.21.15.96:0/477184850 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8800c040 con 0x7ffa88003980 2024-04-18T04:55:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa5096640 1 -- 172.21.15.96:0/477184850 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8800c200 con 0x7ffa880047d0 2024-04-18T04:55:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa6899640 1 --2- 172.21.15.96:0/477184850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa88005190 0x7ffa8800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa6098640 1 --2- 172.21.15.96:0/477184850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa88003980 0x7ffa88003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa5897640 1 --2- 172.21.15.96:0/477184850 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ffa880047d0 0x7ffa88004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa6899640 1 -- 172.21.15.96:0/477184850 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ffa880047d0 msgr2=0x7ffa88004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa6899640 1 --2- 172.21.15.96:0/477184850 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ffa880047d0 0x7ffa88004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa6899640 1 -- 172.21.15.96:0/477184850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa88003980 msgr2=0x7ffa88003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa6899640 1 --2- 172.21.15.96:0/477184850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa88003980 0x7ffa88003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa6899640 1 -- 172.21.15.96:0/477184850 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa88003530 con 0x7ffa88005190 2024-04-18T04:55:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.082+0000 7ffaa6098640 1 --2- 172.21.15.96:0/477184850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa88003980 0x7ffa88003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa6899640 1 -- 172.21.15.96:0/477184850 reap_dead start 2024-04-18T04:55:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa6899640 1 --2- 172.21.15.96:0/477184850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa88005190 0x7ffa8800b990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800c240 tx=0x7ffa9801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb19c25c43eb57f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa5096640 1 -- 172.21.15.96:0/477184850 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980a5b60 con 0x7ffa88005190 2024-04-18T04:55:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa5096640 1 -- 172.21.15.96:0/477184850 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa980a5ce0 con 0x7ffa88005190 2024-04-18T04:55:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa5096640 1 -- 172.21.15.96:0/477184850 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98005b20 con 0x7ffa88005190 2024-04-18T04:55:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa82fc640 1 -- 172.21.15.96:0/477184850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa88005190 msgr2=0x7ffa8800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa82fc640 1 --2- 172.21.15.96:0/477184850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa88005190 0x7ffa8800b990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800c240 tx=0x7ffa9801cc60 comp rx=0 tx=0).stop 2024-04-18T04:55:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa82fc640 1 -- 172.21.15.96:0/477184850 shutdown_connections 2024-04-18T04:55:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa82fc640 1 --2- 172.21.15.96:0/477184850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa88005190 0x7ffa8800b990 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa82fc640 1 -- 172.21.15.96:0/477184850 >> 172.21.15.96:0/477184850 conn(0x7ffaa006c750 msgr2=0x7ffaa00c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa82fc640 1 -- 172.21.15.96:0/477184850 shutdown_connections 2024-04-18T04:55:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa82fc640 1 -- 172.21.15.96:0/477184850 wait complete. 2024-04-18T04:55:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa82fc640 1 Processor -- start 2024-04-18T04:55:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa82fc640 1 -- start start 2024-04-18T04:55:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa82fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa88005190 0x7ffaa0155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa82fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffaa00c9c40 0x7ffaa01ec910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa82fc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ffaa014afa0 0x7ffaa0146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa82fc640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa01ec4f0 con 0x7ffa88005190 2024-04-18T04:55:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa82fc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0151760 con 0x7ffaa00c9c40 2024-04-18T04:55:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa82fc640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa00ca380 con 0x7ffaa014afa0 2024-04-18T04:55:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa6098640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa88005190 0x7ffaa0155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa6098640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa88005190 0x7ffaa0155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56720/0 (socket says 172.21.15.96:56720) 2024-04-18T04:55:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa6098640 1 -- 172.21.15.96:0/3382787714 learned_addr learned my addr 172.21.15.96:0/3382787714 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa5897640 1 --2- 172.21.15.96:0/3382787714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffaa00c9c40 0x7ffaa01ec910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa6098640 1 -- 172.21.15.96:0/3382787714 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ffaa014afa0 msgr2=0x7ffaa0146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa6098640 1 --2- 172.21.15.96:0/3382787714 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ffaa014afa0 0x7ffaa0146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa6098640 1 -- 172.21.15.96:0/3382787714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffaa00c9c40 msgr2=0x7ffaa01ec910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa6098640 1 --2- 172.21.15.96:0/3382787714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffaa00c9c40 0x7ffaa01ec910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa6098640 1 -- 172.21.15.96:0/3382787714 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa00caad0 con 0x7ffa88005190 2024-04-18T04:55:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa5897640 1 --2- 172.21.15.96:0/3382787714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffaa00c9c40 0x7ffaa01ec910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffaa6098640 1 --2- 172.21.15.96:0/3382787714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa88005190 0x7ffaa0155d10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffa900108d0 tx=0x7ffa90010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffa9effd640 1 -- 172.21.15.96:0/3382787714 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90004220 con 0x7ffa88005190 2024-04-18T04:55:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffa9effd640 1 -- 172.21.15.96:0/3382787714 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa90004380 con 0x7ffa88005190 2024-04-18T04:55:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.086+0000 7ffa9effd640 1 -- 172.21.15.96:0/3382787714 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9000eba0 con 0x7ffa88005190 2024-04-18T04:55:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.090+0000 7ffaa82fc640 1 -- 172.21.15.96:0/3382787714 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa00cadb0 con 0x7ffa88005190 2024-04-18T04:55:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.090+0000 7ffaa82fc640 1 -- 172.21.15.96:0/3382787714 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa01ef610 con 0x7ffa88005190 2024-04-18T04:55:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.090+0000 7ffaa82fc640 1 -- 172.21.15.96:0/3382787714 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa01ec760 con 0x7ffa88005190 2024-04-18T04:55:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.090+0000 7ffa9effd640 1 -- 172.21.15.96:0/3382787714 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffa9000ed00 con 0x7ffa88005190 2024-04-18T04:55:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.090+0000 7ffa9effd640 1 --2- 172.21.15.96:0/3382787714 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ffa8c066690 0x7ffa8c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.090+0000 7ffa9effd640 1 -- 172.21.15.96:0/3382787714 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa90084290 con 0x7ffa88005190 2024-04-18T04:55:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.090+0000 7ffaa5897640 1 --2- 172.21.15.96:0/3382787714 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ffa8c066690 0x7ffa8c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.090+0000 7ffaa5897640 1 --2- 172.21.15.96:0/3382787714 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ffa8c066690 0x7ffa8c068b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffa94007fd0 tx=0x7ffa94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:20.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.094+0000 7ffa9effd640 1 -- 172.21.15.96:0/3382787714 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ffa90051570 con 0x7ffa88005190 2024-04-18T04:55:20.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.254+0000 7ffaa82fc640 1 -- 172.21.15.96:0/3382787714 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffaa015a430 con 0x7ffa8c066690 2024-04-18T04:55:20.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.262+0000 7ffa9effd640 1 -- 172.21.15.96:0/3382787714 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264686 (secure 0 0 0) 0x7ffa9400d040 con 0x7ffa8c066690 2024-04-18T04:55:20.265 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:55:20.267 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T04:55:20.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.266+0000 7ffaa82fc640 1 -- 172.21.15.96:0/3382787714 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ffa8c066690 msgr2=0x7ffa8c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.266+0000 7ffaa82fc640 1 --2- 172.21.15.96:0/3382787714 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ffa8c066690 0x7ffa8c068b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffa94007fd0 tx=0x7ffa94009040 comp rx=0 tx=0).stop 2024-04-18T04:55:20.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.266+0000 7ffaa82fc640 1 -- 172.21.15.96:0/3382787714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa88005190 msgr2=0x7ffaa0155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.266+0000 7ffaa82fc640 1 --2- 172.21.15.96:0/3382787714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa88005190 0x7ffaa0155d10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffa900108d0 tx=0x7ffa90010d90 comp rx=0 tx=0).stop 2024-04-18T04:55:20.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.266+0000 7ffaa82fc640 1 -- 172.21.15.96:0/3382787714 shutdown_connections 2024-04-18T04:55:20.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.266+0000 7ffaa82fc640 1 --2- 172.21.15.96:0/3382787714 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ffa8c066690 0x7ffa8c068b50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.266+0000 7ffaa82fc640 1 --2- 172.21.15.96:0/3382787714 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ffaa014afa0 0x7ffaa0146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.266+0000 7ffaa82fc640 1 --2- 172.21.15.96:0/3382787714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffaa00c9c40 0x7ffaa01ec910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.266+0000 7ffaa82fc640 1 --2- 172.21.15.96:0/3382787714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffa88005190 0x7ffaa0155d10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.266+0000 7ffaa82fc640 1 -- 172.21.15.96:0/3382787714 >> 172.21.15.96:0/3382787714 conn(0x7ffaa006c750 msgr2=0x7ffaa014d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:20.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.266+0000 7ffaa82fc640 1 -- 172.21.15.96:0/3382787714 shutdown_connections 2024-04-18T04:55:20.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.266+0000 7ffaa82fc640 1 -- 172.21.15.96:0/3382787714 wait complete. 2024-04-18T04:55:20.284 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-18T04:55:18.580149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598162,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":364,"num_write_kb":2478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218144,"kb_used_data":2016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756576,"statfs":{"total":773094113280,"available":772870733824,"internally_reserved":0,"allocated":2064384,"data_stored":1781036,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1358,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004054"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323999+0000","last_change":"2024-04-18T04:54:41.199306+0000","last_active":"2024-04-18T04:54:42.323999+0000","last_peered":"2024-04-18T04:54:42.323999+0000","last_clean":"2024-04-18T04:54:42.323999+0000","last_became_active":"2024-04-18T04:54:41.199046+0000","last_became_peered":"2024-04-18T04:54:41.199046+0000","last_unstale":"2024-04-18T04:54:42.323999+0000","last_undegraded":"2024-04-18T04:54:42.323999+0000","last_fullsized":"2024-04-18T04:54:42.323999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169848+0000","last_change":"2024-04-18T04:54:41.200447+0000","last_active":"2024-04-18T04:54:42.169848+0000","last_peered":"2024-04-18T04:54:42.169848+0000","last_clean":"2024-04-18T04:54:42.169848+0000","last_became_active":"2024-04-18T04:54:41.200136+0000","last_became_peered":"2024-04-18T04:54:41.200136+0000","last_unstale":"2024-04-18T04:54:42.169848+0000","last_undegraded":"2024-04-18T04:54:42.169848+0000","last_fullsized":"2024-04-18T04:54:42.169848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169517+0000","last_change":"2024-04-18T04:54:41.185987+0000","last_active":"2024-04-18T04:54:42.169517+0000","last_peered":"2024-04-18T04:54:42.169517+0000","last_clean":"2024-04-18T04:54:42.169517+0000","last_became_active":"2024-04-18T04:54:41.185206+0000","last_became_peered":"2024-04-18T04:54:41.185206+0000","last_unstale":"2024-04-18T04:54:42.169517+0000","last_undegraded":"2024-04-18T04:54:42.169517+0000","last_fullsized":"2024-04-18T04:54:42.169517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453954+0000","last_change":"2024-04-18T04:54:41.177487+0000","last_active":"2024-04-18T04:54:42.453954+0000","last_peered":"2024-04-18T04:54:42.453954+0000","last_clean":"2024-04-18T04:54:42.453954+0000","last_became_active":"2024-04-18T04:54:41.177217+0000","last_became_peered":"2024-04-18T04:54:41.177217+0000","last_unstale":"2024-04-18T04:54:42.453954+0000","last_undegraded":"2024-04-18T04:54:42.453954+0000","last_fullsized":"2024-04-18T04:54:42.453954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:08.067252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323329+0000","last_change":"2024-04-18T04:54:41.186573+0000","last_active":"2024-04-18T04:54:42.323329+0000","last_peered":"2024-04-18T04:54:42.323329+0000","last_clean":"2024-04-18T04:54:42.323329+0000","last_became_active":"2024-04-18T04:54:41.186027+0000","last_became_peered":"2024-04-18T04:54:41.186027+0000","last_unstale":"2024-04-18T04:54:42.323329+0000","last_undegraded":"2024-04-18T04:54:42.323329+0000","last_fullsized":"2024-04-18T04:54:42.323329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453454+0000","last_change":"2024-04-18T04:54:41.177550+0000","last_active":"2024-04-18T04:54:42.453454+0000","last_peered":"2024-04-18T04:54:42.453454+0000","last_clean":"2024-04-18T04:54:42.453454+0000","last_became_active":"2024-04-18T04:54:41.177215+0000","last_became_peered":"2024-04-18T04:54:41.177215+0000","last_unstale":"2024-04-18T04:54:42.453454+0000","last_undegraded":"2024-04-18T04:54:42.453454+0000","last_fullsized":"2024-04-18T04:54:42.453454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:26.266600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323158+0000","last_change":"2024-04-18T04:54:41.178605+0000","last_active":"2024-04-18T04:54:42.323158+0000","last_peered":"2024-04-18T04:54:42.323158+0000","last_clean":"2024-04-18T04:54:42.323158+0000","last_became_active":"2024-04-18T04:54:41.178094+0000","last_became_peered":"2024-04-18T04:54:41.178094+0000","last_unstale":"2024-04-18T04:54:42.323158+0000","last_undegraded":"2024-04-18T04:54:42.323158+0000","last_fullsized":"2024-04-18T04:54:42.323158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169250+0000","last_change":"2024-04-18T04:54:41.193174+0000","last_active":"2024-04-18T04:54:42.169250+0000","last_peered":"2024-04-18T04:54:42.169250+0000","last_clean":"2024-04-18T04:54:42.169250+0000","last_became_active":"2024-04-18T04:54:41.192678+0000","last_became_peered":"2024-04-18T04:54:41.192678+0000","last_unstale":"2024-04-18T04:54:42.169250+0000","last_undegraded":"2024-04-18T04:54:42.169250+0000","last_fullsized":"2024-04-18T04:54:42.169250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167601+0000","last_change":"2024-04-18T04:54:41.198121+0000","last_active":"2024-04-18T04:54:42.167601+0000","last_peered":"2024-04-18T04:54:42.167601+0000","last_clean":"2024-04-18T04:54:42.167601+0000","last_became_active":"2024-04-18T04:54:41.197832+0000","last_became_peered":"2024-04-18T04:54:41.197832+0000","last_unstale":"2024-04-18T04:54:42.167601+0000","last_undegraded":"2024-04-18T04:54:42.167601+0000","last_fullsized":"2024-04-18T04:54:42.167601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.835581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323925+0000","last_change":"2024-04-18T04:54:41.183032+0000","last_active":"2024-04-18T04:54:42.323925+0000","last_peered":"2024-04-18T04:54:42.323925+0000","last_clean":"2024-04-18T04:54:42.323925+0000","last_became_active":"2024-04-18T04:54:41.182698+0000","last_became_peered":"2024-04-18T04:54:41.182698+0000","last_unstale":"2024-04-18T04:54:42.323925+0000","last_undegraded":"2024-04-18T04:54:42.323925+0000","last_fullsized":"2024-04-18T04:54:42.323925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323788+0000","last_change":"2024-04-18T04:54:41.187831+0000","last_active":"2024-04-18T04:54:42.323788+0000","last_peered":"2024-04-18T04:54:42.323788+0000","last_clean":"2024-04-18T04:54:42.323788+0000","last_became_active":"2024-04-18T04:54:41.187360+0000","last_became_peered":"2024-04-18T04:54:41.187360+0000","last_unstale":"2024-04-18T04:54:42.323788+0000","last_undegraded":"2024-04-18T04:54:42.323788+0000","last_fullsized":"2024-04-18T04:54:42.323788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323367+0000","last_change":"2024-04-18T04:54:41.188641+0000","last_active":"2024-04-18T04:54:42.323367+0000","last_peered":"2024-04-18T04:54:42.323367+0000","last_clean":"2024-04-18T04:54:42.323367+0000","last_became_active":"2024-04-18T04:54:41.188281+0000","last_became_peered":"2024-04-18T04:54:41.188281+0000","last_unstale":"2024-04-18T04:54:42.323367+0000","last_undegraded":"2024-04-18T04:54:42.323367+0000","last_fullsized":"2024-04-18T04:54:42.323367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455946+0000","last_change":"2024-04-18T04:54:41.194578+0000","last_active":"2024-04-18T04:54:42.455946+0000","last_peered":"2024-04-18T04:54:42.455946+0000","last_clean":"2024-04-18T04:54:42.455946+0000","last_became_active":"2024-04-18T04:54:41.190882+0000","last_became_peered":"2024-04-18T04:54:41.190882+0000","last_unstale":"2024-04-18T04:54:42.455946+0000","last_undegraded":"2024-04-18T04:54:42.455946+0000","last_fullsized":"2024-04-18T04:54:42.455946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:45:52.041196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455376+0000","last_change":"2024-04-18T04:54:41.190210+0000","last_active":"2024-04-18T04:54:42.455376+0000","last_peered":"2024-04-18T04:54:42.455376+0000","last_clean":"2024-04-18T04:54:42.455376+0000","last_became_active":"2024-04-18T04:54:41.189813+0000","last_became_peered":"2024-04-18T04:54:41.189813+0000","last_unstale":"2024-04-18T04:54:42.455376+0000","last_undegraded":"2024-04-18T04:54:42.455376+0000","last_fullsized":"2024-04-18T04:54:42.455376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:38:02.632458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169188+0000","last_change":"2024-04-18T04:54:41.183027+0000","last_active":"2024-04-18T04:54:42.169188+0000","last_peered":"2024-04-18T04:54:42.169188+0000","last_clean":"2024-04-18T04:54:42.169188+0000","last_became_active":"2024-04-18T04:54:41.182713+0000","last_became_peered":"2024-04-18T04:54:41.182713+0000","last_unstale":"2024-04-18T04:54:42.169188+0000","last_undegraded":"2024-04-18T04:54:42.169188+0000","last_fullsized":"2024-04-18T04:54:42.169188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453959+0000","last_change":"2024-04-18T04:54:41.186060+0000","last_active":"2024-04-18T04:54:42.453959+0000","last_peered":"2024-04-18T04:54:42.453959+0000","last_clean":"2024-04-18T04:54:42.453959+0000","last_became_active":"2024-04-18T04:54:41.185803+0000","last_became_peered":"2024-04-18T04:54:41.185803+0000","last_unstale":"2024-04-18T04:54:42.453959+0000","last_undegraded":"2024-04-18T04:54:42.453959+0000","last_fullsized":"2024-04-18T04:54:42.453959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:48:04.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455728+0000","last_change":"2024-04-18T04:54:41.200802+0000","last_active":"2024-04-18T04:54:42.455728+0000","last_peered":"2024-04-18T04:54:42.455728+0000","last_clean":"2024-04-18T04:54:42.455728+0000","last_became_active":"2024-04-18T04:54:41.198404+0000","last_became_peered":"2024-04-18T04:54:41.198404+0000","last_unstale":"2024-04-18T04:54:42.455728+0000","last_undegraded":"2024-04-18T04:54:42.455728+0000","last_fullsized":"2024-04-18T04:54:42.455728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:56.686481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454830+0000","last_change":"2024-04-18T04:54:41.189568+0000","last_active":"2024-04-18T04:54:42.454830+0000","last_peered":"2024-04-18T04:54:42.454830+0000","last_clean":"2024-04-18T04:54:42.454830+0000","last_became_active":"2024-04-18T04:54:41.188139+0000","last_became_peered":"2024-04-18T04:54:41.188139+0000","last_unstale":"2024-04-18T04:54:42.454830+0000","last_undegraded":"2024-04-18T04:54:42.454830+0000","last_fullsized":"2024-04-18T04:54:42.454830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455410+0000","last_change":"2024-04-18T04:54:41.197901+0000","last_active":"2024-04-18T04:54:42.455410+0000","last_peered":"2024-04-18T04:54:42.455410+0000","last_clean":"2024-04-18T04:54:42.455410+0000","last_became_active":"2024-04-18T04:54:41.197235+0000","last_became_peered":"2024-04-18T04:54:41.197235+0000","last_unstale":"2024-04-18T04:54:42.455410+0000","last_undegraded":"2024-04-18T04:54:42.455410+0000","last_fullsized":"2024-04-18T04:54:42.455410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:41:20.213202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323339+0000","last_change":"2024-04-18T04:54:41.188440+0000","last_active":"2024-04-18T04:54:42.323339+0000","last_peered":"2024-04-18T04:54:42.323339+0000","last_clean":"2024-04-18T04:54:42.323339+0000","last_became_active":"2024-04-18T04:54:41.187925+0000","last_became_peered":"2024-04-18T04:54:41.187925+0000","last_unstale":"2024-04-18T04:54:42.323339+0000","last_undegraded":"2024-04-18T04:54:42.323339+0000","last_fullsized":"2024-04-18T04:54:42.323339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170212+0000","last_change":"2024-04-18T04:54:41.179672+0000","last_active":"2024-04-18T04:54:42.170212+0000","last_peered":"2024-04-18T04:54:42.170212+0000","last_clean":"2024-04-18T04:54:42.170212+0000","last_became_active":"2024-04-18T04:54:41.178963+0000","last_became_peered":"2024-04-18T04:54:41.178963+0000","last_unstale":"2024-04-18T04:54:42.170212+0000","last_undegraded":"2024-04-18T04:54:42.170212+0000","last_fullsized":"2024-04-18T04:54:42.170212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:56:31.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167152+0000","last_change":"2024-04-18T04:54:41.182902+0000","last_active":"2024-04-18T04:54:42.167152+0000","last_peered":"2024-04-18T04:54:42.167152+0000","last_clean":"2024-04-18T04:54:42.167152+0000","last_became_active":"2024-04-18T04:54:41.182664+0000","last_became_peered":"2024-04-18T04:54:41.182664+0000","last_unstale":"2024-04-18T04:54:42.167152+0000","last_undegraded":"2024-04-18T04:54:42.167152+0000","last_fullsized":"2024-04-18T04:54:42.167152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:56.408926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169624+0000","last_change":"2024-04-18T04:54:41.187578+0000","last_active":"2024-04-18T04:54:42.169624+0000","last_peered":"2024-04-18T04:54:42.169624+0000","last_clean":"2024-04-18T04:54:42.169624+0000","last_became_active":"2024-04-18T04:54:41.186881+0000","last_became_peered":"2024-04-18T04:54:41.186881+0000","last_unstale":"2024-04-18T04:54:42.169624+0000","last_undegraded":"2024-04-18T04:54:42.169624+0000","last_fullsized":"2024-04-18T04:54:42.169624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:27.817916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454216+0000","last_change":"2024-04-18T04:54:41.193206+0000","last_active":"2024-04-18T04:54:42.454216+0000","last_peered":"2024-04-18T04:54:42.454216+0000","last_clean":"2024-04-18T04:54:42.454216+0000","last_became_active":"2024-04-18T04:54:41.192740+0000","last_became_peered":"2024-04-18T04:54:41.192740+0000","last_unstale":"2024-04-18T04:54:42.454216+0000","last_undegraded":"2024-04-18T04:54:42.454216+0000","last_fullsized":"2024-04-18T04:54:42.454216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:51:34.311826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169844+0000","last_change":"2024-04-18T04:54:41.192785+0000","last_active":"2024-04-18T04:54:42.169844+0000","last_peered":"2024-04-18T04:54:42.169844+0000","last_clean":"2024-04-18T04:54:42.169844+0000","last_became_active":"2024-04-18T04:54:41.192280+0000","last_became_peered":"2024-04-18T04:54:41.192280+0000","last_unstale":"2024-04-18T04:54:42.169844+0000","last_undegraded":"2024-04-18T04:54:42.169844+0000","last_fullsized":"2024-04-18T04:54:42.169844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454615+0000","last_change":"2024-04-18T04:54:41.193920+0000","last_active":"2024-04-18T04:54:42.454615+0000","last_peered":"2024-04-18T04:54:42.454615+0000","last_clean":"2024-04-18T04:54:42.454615+0000","last_became_active":"2024-04-18T04:54:41.193660+0000","last_became_peered":"2024-04-18T04:54:41.193660+0000","last_unstale":"2024-04-18T04:54:42.454615+0000","last_undegraded":"2024-04-18T04:54:42.454615+0000","last_fullsized":"2024-04-18T04:54:42.454615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:22.072498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.456447+0000","last_change":"2024-04-18T04:54:41.190298+0000","last_active":"2024-04-18T04:54:42.456447+0000","last_peered":"2024-04-18T04:54:42.456447+0000","last_clean":"2024-04-18T04:54:42.456447+0000","last_became_active":"2024-04-18T04:54:41.189374+0000","last_became_peered":"2024-04-18T04:54:41.189374+0000","last_unstale":"2024-04-18T04:54:42.456447+0000","last_undegraded":"2024-04-18T04:54:42.456447+0000","last_fullsized":"2024-04-18T04:54:42.456447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455999+0000","last_change":"2024-04-18T04:54:41.190403+0000","last_active":"2024-04-18T04:54:42.455999+0000","last_peered":"2024-04-18T04:54:42.455999+0000","last_clean":"2024-04-18T04:54:42.455999+0000","last_became_active":"2024-04-18T04:54:41.189660+0000","last_became_peered":"2024-04-18T04:54:41.189660+0000","last_unstale":"2024-04-18T04:54:42.455999+0000","last_undegraded":"2024-04-18T04:54:42.455999+0000","last_fullsized":"2024-04-18T04:54:42.455999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:34.259279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169947+0000","last_change":"2024-04-18T04:54:41.187370+0000","last_active":"2024-04-18T04:54:42.169947+0000","last_peered":"2024-04-18T04:54:42.169947+0000","last_clean":"2024-04-18T04:54:42.169947+0000","last_became_active":"2024-04-18T04:54:41.186901+0000","last_became_peered":"2024-04-18T04:54:41.186901+0000","last_unstale":"2024-04-18T04:54:42.169947+0000","last_undegraded":"2024-04-18T04:54:42.169947+0000","last_fullsized":"2024-04-18T04:54:42.169947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454539+0000","last_change":"2024-04-18T04:54:41.192719+0000","last_active":"2024-04-18T04:54:42.454539+0000","last_peered":"2024-04-18T04:54:42.454539+0000","last_clean":"2024-04-18T04:54:42.454539+0000","last_became_active":"2024-04-18T04:54:41.192114+0000","last_became_peered":"2024-04-18T04:54:41.192114+0000","last_unstale":"2024-04-18T04:54:42.454539+0000","last_undegraded":"2024-04-18T04:54:42.454539+0000","last_fullsized":"2024-04-18T04:54:42.454539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:33:21.965783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454128+0000","last_change":"2024-04-18T04:54:41.186276+0000","last_active":"2024-04-18T04:54:42.454128+0000","last_peered":"2024-04-18T04:54:42.454128+0000","last_clean":"2024-04-18T04:54:42.454128+0000","last_became_active":"2024-04-18T04:54:41.185915+0000","last_became_peered":"2024-04-18T04:54:41.185915+0000","last_unstale":"2024-04-18T04:54:42.454128+0000","last_undegraded":"2024-04-18T04:54:42.454128+0000","last_fullsized":"2024-04-18T04:54:42.454128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453190+0000","last_change":"2024-04-18T04:54:41.190283+0000","last_active":"2024-04-18T04:54:42.453190+0000","last_peered":"2024-04-18T04:54:42.453190+0000","last_clean":"2024-04-18T04:54:42.453190+0000","last_became_active":"2024-04-18T04:54:41.189892+0000","last_became_peered":"2024-04-18T04:54:41.189892+0000","last_unstale":"2024-04-18T04:54:42.453190+0000","last_undegraded":"2024-04-18T04:54:42.453190+0000","last_fullsized":"2024-04-18T04:54:42.453190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:53.175178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167307+0000","last_change":"2024-04-18T04:54:41.187326+0000","last_active":"2024-04-18T04:54:42.167307+0000","last_peered":"2024-04-18T04:54:42.167307+0000","last_clean":"2024-04-18T04:54:42.167307+0000","last_became_active":"2024-04-18T04:54:41.187001+0000","last_became_peered":"2024-04-18T04:54:41.187001+0000","last_unstale":"2024-04-18T04:54:42.167307+0000","last_undegraded":"2024-04-18T04:54:42.167307+0000","last_fullsized":"2024-04-18T04:54:42.167307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:52.220269+0000","last_change":"2024-04-18T04:54:40.824658+0000","last_active":"2024-04-18T04:54:52.220269+0000","last_peered":"2024-04-18T04:54:52.220269+0000","last_clean":"2024-04-18T04:54:52.220269+0000","last_became_active":"2024-04-18T04:54:40.823652+0000","last_became_peered":"2024-04-18T04:54:40.823652+0000","last_unstale":"2024-04-18T04:54:52.220269+0000","last_undegraded":"2024-04-18T04:54:52.220269+0000","last_fullsized":"2024-04-18T04:54:52.220269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170634+0000","last_change":"2024-04-18T04:54:41.184497+0000","last_active":"2024-04-18T04:54:42.170634+0000","last_peered":"2024-04-18T04:54:42.170634+0000","last_clean":"2024-04-18T04:54:42.170634+0000","last_became_active":"2024-04-18T04:54:41.182180+0000","last_became_peered":"2024-04-18T04:54:41.182180+0000","last_unstale":"2024-04-18T04:54:42.170634+0000","last_undegraded":"2024-04-18T04:54:42.170634+0000","last_fullsized":"2024-04-18T04:54:42.170634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:25:15.707596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'7","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.661765+0000","last_change":"2024-04-18T04:54:40.803244+0000","last_active":"2024-04-18T04:55:02.661765+0000","last_peered":"2024-04-18T04:55:02.661765+0000","last_clean":"2024-04-18T04:55:02.661765+0000","last_became_active":"2024-04-18T04:54:40.802672+0000","last_became_peered":"2024-04-18T04:54:40.802672+0000","last_unstale":"2024-04-18T04:55:02.661765+0000","last_undegraded":"2024-04-18T04:55:02.661765+0000","last_fullsized":"2024-04-18T04:55:02.661765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:56.851301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:57.304619+0000","last_change":"2024-04-18T04:54:40.823675+0000","last_active":"2024-04-18T04:54:57.304619+0000","last_peered":"2024-04-18T04:54:57.304619+0000","last_clean":"2024-04-18T04:54:57.304619+0000","last_became_active":"2024-04-18T04:54:40.823091+0000","last_became_peered":"2024-04-18T04:54:40.823091+0000","last_unstale":"2024-04-18T04:54:57.304619+0000","last_undegraded":"2024-04-18T04:54:57.304619+0000","last_fullsized":"2024-04-18T04:54:57.304619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169532+0000","last_change":"2024-04-18T04:54:41.200326+0000","last_active":"2024-04-18T04:54:42.169532+0000","last_peered":"2024-04-18T04:54:42.169532+0000","last_clean":"2024-04-18T04:54:42.169532+0000","last_became_active":"2024-04-18T04:54:41.199690+0000","last_became_peered":"2024-04-18T04:54:41.199690+0000","last_unstale":"2024-04-18T04:54:42.169532+0000","last_undegraded":"2024-04-18T04:54:42.169532+0000","last_fullsized":"2024-04-18T04:54:42.169532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.659131+0000","last_change":"2024-04-18T04:54:40.805264+0000","last_active":"2024-04-18T04:55:02.659131+0000","last_peered":"2024-04-18T04:55:02.659131+0000","last_clean":"2024-04-18T04:55:02.659131+0000","last_became_active":"2024-04-18T04:54:40.804605+0000","last_became_peered":"2024-04-18T04:54:40.804605+0000","last_unstale":"2024-04-18T04:55:02.659131+0000","last_undegraded":"2024-04-18T04:55:02.659131+0000","last_fullsized":"2024-04-18T04:55:02.659131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:48.991270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.171188+0000","last_change":"2024-04-18T04:54:41.175359+0000","last_active":"2024-04-18T04:54:42.171188+0000","last_peered":"2024-04-18T04:54:42.171188+0000","last_clean":"2024-04-18T04:54:42.171188+0000","last_became_active":"2024-04-18T04:54:41.175137+0000","last_became_peered":"2024-04-18T04:54:41.175137+0000","last_unstale":"2024-04-18T04:54:42.171188+0000","last_undegraded":"2024-04-18T04:54:42.171188+0000","last_fullsized":"2024-04-18T04:54:42.171188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:06:24.271204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:52.216917+0000","last_change":"2024-04-18T04:54:40.798936+0000","last_active":"2024-04-18T04:54:52.216917+0000","last_peered":"2024-04-18T04:54:52.216917+0000","last_clean":"2024-04-18T04:54:52.216917+0000","last_became_active":"2024-04-18T04:54:40.798572+0000","last_became_peered":"2024-04-18T04:54:40.798572+0000","last_unstale":"2024-04-18T04:54:52.216917+0000","last_undegraded":"2024-04-18T04:54:52.216917+0000","last_fullsized":"2024-04-18T04:54:52.216917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454742+0000","last_change":"2024-04-18T04:54:41.188280+0000","last_active":"2024-04-18T04:54:42.454742+0000","last_peered":"2024-04-18T04:54:42.454742+0000","last_clean":"2024-04-18T04:54:42.454742+0000","last_became_active":"2024-04-18T04:54:41.188012+0000","last_became_peered":"2024-04-18T04:54:41.188012+0000","last_unstale":"2024-04-18T04:54:42.454742+0000","last_undegraded":"2024-04-18T04:54:42.454742+0000","last_fullsized":"2024-04-18T04:54:42.454742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:11.319118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.689262+0000","last_change":"2024-04-18T04:54:40.802894+0000","last_active":"2024-04-18T04:55:08.689262+0000","last_peered":"2024-04-18T04:55:08.689262+0000","last_clean":"2024-04-18T04:55:08.689262+0000","last_became_active":"2024-04-18T04:54:40.801406+0000","last_became_peered":"2024-04-18T04:54:40.801406+0000","last_unstale":"2024-04-18T04:55:08.689262+0000","last_undegraded":"2024-04-18T04:55:08.689262+0000","last_fullsized":"2024-04-18T04:55:08.689262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170319+0000","last_change":"2024-04-18T04:54:41.203407+0000","last_active":"2024-04-18T04:54:42.170319+0000","last_peered":"2024-04-18T04:54:42.170319+0000","last_clean":"2024-04-18T04:54:42.170319+0000","last_became_active":"2024-04-18T04:54:41.203186+0000","last_became_peered":"2024-04-18T04:54:41.203186+0000","last_unstale":"2024-04-18T04:54:42.170319+0000","last_undegraded":"2024-04-18T04:54:42.170319+0000","last_fullsized":"2024-04-18T04:54:42.170319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:23:50.107054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:52.216865+0000","last_change":"2024-04-18T04:54:40.822014+0000","last_active":"2024-04-18T04:54:52.216865+0000","last_peered":"2024-04-18T04:54:52.216865+0000","last_clean":"2024-04-18T04:54:52.216865+0000","last_became_active":"2024-04-18T04:54:40.820920+0000","last_became_peered":"2024-04-18T04:54:40.820920+0000","last_unstale":"2024-04-18T04:54:52.216865+0000","last_undegraded":"2024-04-18T04:54:52.216865+0000","last_fullsized":"2024-04-18T04:54:52.216865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455233+0000","last_change":"2024-04-18T04:54:41.197254+0000","last_active":"2024-04-18T04:54:42.455233+0000","last_peered":"2024-04-18T04:54:42.455233+0000","last_clean":"2024-04-18T04:54:42.455233+0000","last_became_active":"2024-04-18T04:54:41.196927+0000","last_became_peered":"2024-04-18T04:54:41.196927+0000","last_unstale":"2024-04-18T04:54:42.455233+0000","last_undegraded":"2024-04-18T04:54:42.455233+0000","last_fullsized":"2024-04-18T04:54:42.455233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:01:45.182766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'10","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.691412+0000","last_change":"2024-04-18T04:54:40.801789+0000","last_active":"2024-04-18T04:55:08.691412+0000","last_peered":"2024-04-18T04:55:08.691412+0000","last_clean":"2024-04-18T04:55:08.691412+0000","last_became_active":"2024-04-18T04:54:40.801403+0000","last_became_peered":"2024-04-18T04:54:40.801403+0000","last_unstale":"2024-04-18T04:55:08.691412+0000","last_undegraded":"2024-04-18T04:55:08.691412+0000","last_fullsized":"2024-04-18T04:55:08.691412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:15:11.220095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323817+0000","last_change":"2024-04-18T04:54:41.195518+0000","last_active":"2024-04-18T04:54:42.323817+0000","last_peered":"2024-04-18T04:54:42.323817+0000","last_clean":"2024-04-18T04:54:42.323817+0000","last_became_active":"2024-04-18T04:54:41.195172+0000","last_became_peered":"2024-04-18T04:54:41.195172+0000","last_unstale":"2024-04-18T04:54:42.323817+0000","last_undegraded":"2024-04-18T04:54:42.323817+0000","last_fullsized":"2024-04-18T04:54:42.323817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'9","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.693381+0000","last_change":"2024-04-18T04:54:40.818390+0000","last_active":"2024-04-18T04:55:08.693381+0000","last_peered":"2024-04-18T04:55:08.693381+0000","last_clean":"2024-04-18T04:55:08.693381+0000","last_became_active":"2024-04-18T04:54:40.817681+0000","last_became_peered":"2024-04-18T04:54:40.817681+0000","last_unstale":"2024-04-18T04:55:08.693381+0000","last_undegraded":"2024-04-18T04:55:08.693381+0000","last_fullsized":"2024-04-18T04:55:08.693381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455448+0000","last_change":"2024-04-18T04:54:41.194807+0000","last_active":"2024-04-18T04:54:42.455448+0000","last_peered":"2024-04-18T04:54:42.455448+0000","last_clean":"2024-04-18T04:54:42.455448+0000","last_became_active":"2024-04-18T04:54:41.194499+0000","last_became_peered":"2024-04-18T04:54:41.194499+0000","last_unstale":"2024-04-18T04:54:42.455448+0000","last_undegraded":"2024-04-18T04:54:42.455448+0000","last_fullsized":"2024-04-18T04:54:42.455448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.662518+0000","last_change":"2024-04-18T04:54:40.817631+0000","last_active":"2024-04-18T04:55:02.662518+0000","last_peered":"2024-04-18T04:55:02.662518+0000","last_clean":"2024-04-18T04:55:02.662518+0000","last_became_active":"2024-04-18T04:54:40.817370+0000","last_became_peered":"2024-04-18T04:54:40.817370+0000","last_unstale":"2024-04-18T04:55:02.662518+0000","last_undegraded":"2024-04-18T04:55:02.662518+0000","last_fullsized":"2024-04-18T04:55:02.662518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454210+0000","last_change":"2024-04-18T04:54:41.193363+0000","last_active":"2024-04-18T04:54:42.454210+0000","last_peered":"2024-04-18T04:54:42.454210+0000","last_clean":"2024-04-18T04:54:42.454210+0000","last_became_active":"2024-04-18T04:54:41.192889+0000","last_became_peered":"2024-04-18T04:54:41.192889+0000","last_unstale":"2024-04-18T04:54:42.454210+0000","last_undegraded":"2024-04-18T04:54:42.454210+0000","last_fullsized":"2024-04-18T04:54:42.454210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.661210+0000","last_change":"2024-04-18T04:54:40.806633+0000","last_active":"2024-04-18T04:55:02.661210+0000","last_peered":"2024-04-18T04:55:02.661210+0000","last_clean":"2024-04-18T04:55:02.661210+0000","last_became_active":"2024-04-18T04:54:40.805965+0000","last_became_peered":"2024-04-18T04:54:40.805965+0000","last_unstale":"2024-04-18T04:55:02.661210+0000","last_undegraded":"2024-04-18T04:55:02.661210+0000","last_fullsized":"2024-04-18T04:55:02.661210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167013+0000","last_change":"2024-04-18T04:54:41.184321+0000","last_active":"2024-04-18T04:54:42.167013+0000","last_peered":"2024-04-18T04:54:42.167013+0000","last_clean":"2024-04-18T04:54:42.167013+0000","last_became_active":"2024-04-18T04:54:41.183838+0000","last_became_peered":"2024-04-18T04:54:41.183838+0000","last_unstale":"2024-04-18T04:54:42.167013+0000","last_undegraded":"2024-04-18T04:54:42.167013+0000","last_fullsized":"2024-04-18T04:54:42.167013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'17","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.656803+0000","last_change":"2024-04-18T04:54:40.818954+0000","last_active":"2024-04-18T04:55:02.656803+0000","last_peered":"2024-04-18T04:55:02.656803+0000","last_clean":"2024-04-18T04:55:02.656803+0000","last_became_active":"2024-04-18T04:54:40.818227+0000","last_became_peered":"2024-04-18T04:54:40.818227+0000","last_unstale":"2024-04-18T04:55:02.656803+0000","last_undegraded":"2024-04-18T04:55:02.656803+0000","last_fullsized":"2024-04-18T04:55:02.656803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:25.263089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454553+0000","last_change":"2024-04-18T04:54:41.192227+0000","last_active":"2024-04-18T04:54:42.454553+0000","last_peered":"2024-04-18T04:54:42.454553+0000","last_clean":"2024-04-18T04:54:42.454553+0000","last_became_active":"2024-04-18T04:54:41.187002+0000","last_became_peered":"2024-04-18T04:54:41.187002+0000","last_unstale":"2024-04-18T04:54:42.454553+0000","last_undegraded":"2024-04-18T04:54:42.454553+0000","last_fullsized":"2024-04-18T04:54:42.454553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.180662+0000","last_change":"2024-04-18T04:54:40.805795+0000","last_active":"2024-04-18T04:54:46.180662+0000","last_peered":"2024-04-18T04:54:46.180662+0000","last_clean":"2024-04-18T04:54:46.180662+0000","last_became_active":"2024-04-18T04:54:40.802550+0000","last_became_peered":"2024-04-18T04:54:40.802550+0000","last_unstale":"2024-04-18T04:54:46.180662+0000","last_undegraded":"2024-04-18T04:54:46.180662+0000","last_fullsized":"2024-04-18T04:54:46.180662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454849+0000","last_change":"2024-04-18T04:54:41.180426+0000","last_active":"2024-04-18T04:54:42.454849+0000","last_peered":"2024-04-18T04:54:42.454849+0000","last_clean":"2024-04-18T04:54:42.454849+0000","last_became_active":"2024-04-18T04:54:41.179540+0000","last_became_peered":"2024-04-18T04:54:41.179540+0000","last_unstale":"2024-04-18T04:54:42.454849+0000","last_undegraded":"2024-04-18T04:54:42.454849+0000","last_fullsized":"2024-04-18T04:54:42.454849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:38:25.074053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.691060+0000","last_change":"2024-04-18T04:54:40.804284+0000","last_active":"2024-04-18T04:55:08.691060+0000","last_peered":"2024-04-18T04:55:08.691060+0000","last_clean":"2024-04-18T04:55:08.691060+0000","last_became_active":"2024-04-18T04:54:40.803464+0000","last_became_peered":"2024-04-18T04:54:40.803464+0000","last_unstale":"2024-04-18T04:55:08.691060+0000","last_undegraded":"2024-04-18T04:55:08.691060+0000","last_fullsized":"2024-04-18T04:55:08.691060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:52.171667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.324196+0000","last_change":"2024-04-18T04:54:41.188591+0000","last_active":"2024-04-18T04:54:42.324196+0000","last_peered":"2024-04-18T04:54:42.324196+0000","last_clean":"2024-04-18T04:54:42.324196+0000","last_became_active":"2024-04-18T04:54:41.188152+0000","last_became_peered":"2024-04-18T04:54:41.188152+0000","last_unstale":"2024-04-18T04:54:42.324196+0000","last_undegraded":"2024-04-18T04:54:42.324196+0000","last_fullsized":"2024-04-18T04:54:42.324196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.659248+0000","last_change":"2024-04-18T04:54:40.814901+0000","last_active":"2024-04-18T04:55:02.659248+0000","last_peered":"2024-04-18T04:55:02.659248+0000","last_clean":"2024-04-18T04:55:02.659248+0000","last_became_active":"2024-04-18T04:54:40.814207+0000","last_became_peered":"2024-04-18T04:54:40.814207+0000","last_unstale":"2024-04-18T04:55:02.659248+0000","last_undegraded":"2024-04-18T04:55:02.659248+0000","last_fullsized":"2024-04-18T04:55:02.659248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323473+0000","last_change":"2024-04-18T04:54:41.188664+0000","last_active":"2024-04-18T04:54:42.323473+0000","last_peered":"2024-04-18T04:54:42.323473+0000","last_clean":"2024-04-18T04:54:42.323473+0000","last_became_active":"2024-04-18T04:54:41.188249+0000","last_became_peered":"2024-04-18T04:54:41.188249+0000","last_unstale":"2024-04-18T04:54:42.323473+0000","last_undegraded":"2024-04-18T04:54:42.323473+0000","last_fullsized":"2024-04-18T04:54:42.323473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.656250+0000","last_change":"2024-04-18T04:54:40.828447+0000","last_active":"2024-04-18T04:55:02.656250+0000","last_peered":"2024-04-18T04:55:02.656250+0000","last_clean":"2024-04-18T04:55:02.656250+0000","last_became_active":"2024-04-18T04:54:40.823755+0000","last_became_peered":"2024-04-18T04:54:40.823755+0000","last_unstale":"2024-04-18T04:55:02.656250+0000","last_undegraded":"2024-04-18T04:55:02.656250+0000","last_fullsized":"2024-04-18T04:55:02.656250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455365+0000","last_change":"2024-04-18T04:54:41.186523+0000","last_active":"2024-04-18T04:54:42.455365+0000","last_peered":"2024-04-18T04:54:42.455365+0000","last_clean":"2024-04-18T04:54:42.455365+0000","last_became_active":"2024-04-18T04:54:41.186149+0000","last_became_peered":"2024-04-18T04:54:41.186149+0000","last_unstale":"2024-04-18T04:54:42.455365+0000","last_undegraded":"2024-04-18T04:54:42.455365+0000","last_fullsized":"2024-04-18T04:54:42.455365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.164056+0000","last_change":"2024-04-18T04:54:35.674328+0000","last_active":"2024-04-18T04:54:41.164056+0000","last_peered":"2024-04-18T04:54:41.164056+0000","last_clean":"2024-04-18T04:54:41.164056+0000","last_became_active":"2024-04-18T04:54:35.672457+0000","last_became_peered":"2024-04-18T04:54:35.672457+0000","last_unstale":"2024-04-18T04:54:41.164056+0000","last_undegraded":"2024-04-18T04:54:41.164056+0000","last_fullsized":"2024-04-18T04:54:41.164056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_clean_scrub_stamp":"2024-04-18T04:54:33.597974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:02:10.966568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.662735+0000","last_change":"2024-04-18T04:54:40.802422+0000","last_active":"2024-04-18T04:55:02.662735+0000","last_peered":"2024-04-18T04:55:02.662735+0000","last_clean":"2024-04-18T04:55:02.662735+0000","last_became_active":"2024-04-18T04:54:40.801083+0000","last_became_peered":"2024-04-18T04:54:40.801083+0000","last_unstale":"2024-04-18T04:55:02.662735+0000","last_undegraded":"2024-04-18T04:55:02.662735+0000","last_fullsized":"2024-04-18T04:55:02.662735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170437+0000","last_change":"2024-04-18T04:54:41.174658+0000","last_active":"2024-04-18T04:54:42.170437+0000","last_peered":"2024-04-18T04:54:42.170437+0000","last_clean":"2024-04-18T04:54:42.170437+0000","last_became_active":"2024-04-18T04:54:41.174391+0000","last_became_peered":"2024-04-18T04:54:41.174391+0000","last_unstale":"2024-04-18T04:54:42.170437+0000","last_undegraded":"2024-04-18T04:54:42.170437+0000","last_fullsized":"2024-04-18T04:54:42.170437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:28:24.015964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:57.311612+0000","last_change":"2024-04-18T04:54:40.813770+0000","last_active":"2024-04-18T04:54:57.311612+0000","last_peered":"2024-04-18T04:54:57.311612+0000","last_clean":"2024-04-18T04:54:57.311612+0000","last_became_active":"2024-04-18T04:54:40.813396+0000","last_became_peered":"2024-04-18T04:54:40.813396+0000","last_unstale":"2024-04-18T04:54:57.311612+0000","last_undegraded":"2024-04-18T04:54:57.311612+0000","last_fullsized":"2024-04-18T04:54:57.311612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455360+0000","last_change":"2024-04-18T04:54:41.195440+0000","last_active":"2024-04-18T04:54:42.455360+0000","last_peered":"2024-04-18T04:54:42.455360+0000","last_clean":"2024-04-18T04:54:42.455360+0000","last_became_active":"2024-04-18T04:54:41.195152+0000","last_became_peered":"2024-04-18T04:54:41.195152+0000","last_unstale":"2024-04-18T04:54:42.455360+0000","last_undegraded":"2024-04-18T04:54:42.455360+0000","last_fullsized":"2024-04-18T04:54:42.455360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:57.312350+0000","last_change":"2024-04-18T04:54:40.818806+0000","last_active":"2024-04-18T04:54:57.312350+0000","last_peered":"2024-04-18T04:54:57.312350+0000","last_clean":"2024-04-18T04:54:57.312350+0000","last_became_active":"2024-04-18T04:54:40.818113+0000","last_became_peered":"2024-04-18T04:54:40.818113+0000","last_unstale":"2024-04-18T04:54:57.312350+0000","last_undegraded":"2024-04-18T04:54:57.312350+0000","last_fullsized":"2024-04-18T04:54:57.312350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169410+0000","last_change":"2024-04-18T04:54:41.192576+0000","last_active":"2024-04-18T04:54:42.169410+0000","last_peered":"2024-04-18T04:54:42.169410+0000","last_clean":"2024-04-18T04:54:42.169410+0000","last_became_active":"2024-04-18T04:54:41.192187+0000","last_became_peered":"2024-04-18T04:54:41.192187+0000","last_unstale":"2024-04-18T04:54:42.169410+0000","last_undegraded":"2024-04-18T04:54:42.169410+0000","last_fullsized":"2024-04-18T04:54:42.169410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.695117+0000","last_change":"2024-04-18T04:54:40.820531+0000","last_active":"2024-04-18T04:55:08.695117+0000","last_peered":"2024-04-18T04:55:08.695117+0000","last_clean":"2024-04-18T04:55:08.695117+0000","last_became_active":"2024-04-18T04:54:40.820025+0000","last_became_peered":"2024-04-18T04:54:40.820025+0000","last_unstale":"2024-04-18T04:55:08.695117+0000","last_undegraded":"2024-04-18T04:55:08.695117+0000","last_fullsized":"2024-04-18T04:55:08.695117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:35.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323461+0000","last_change":"2024-04-18T04:54:41.186361+0000","last_active":"2024-04-18T04:54:42.323461+0000","last_peered":"2024-04-18T04:54:42.323461+0000","last_clean":"2024-04-18T04:54:42.323461+0000","last_became_active":"2024-04-18T04:54:41.185257+0000","last_became_peered":"2024-04-18T04:54:41.185257+0000","last_unstale":"2024-04-18T04:54:42.323461+0000","last_undegraded":"2024-04-18T04:54:42.323461+0000","last_fullsized":"2024-04-18T04:54:42.323461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170201+0000","last_change":"2024-04-18T04:54:40.824668+0000","last_active":"2024-04-18T04:54:42.170201+0000","last_peered":"2024-04-18T04:54:42.170201+0000","last_clean":"2024-04-18T04:54:42.170201+0000","last_became_active":"2024-04-18T04:54:40.824206+0000","last_became_peered":"2024-04-18T04:54:40.824206+0000","last_unstale":"2024-04-18T04:54:42.170201+0000","last_undegraded":"2024-04-18T04:54:42.170201+0000","last_fullsized":"2024-04-18T04:54:42.170201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453990+0000","last_change":"2024-04-18T04:54:41.195487+0000","last_active":"2024-04-18T04:54:42.453990+0000","last_peered":"2024-04-18T04:54:42.453990+0000","last_clean":"2024-04-18T04:54:42.453990+0000","last_became_active":"2024-04-18T04:54:41.195177+0000","last_became_peered":"2024-04-18T04:54:41.195177+0000","last_unstale":"2024-04-18T04:54:42.453990+0000","last_undegraded":"2024-04-18T04:54:42.453990+0000","last_fullsized":"2024-04-18T04:54:42.453990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:25.853413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.660760+0000","last_change":"2024-04-18T04:54:40.803387+0000","last_active":"2024-04-18T04:55:02.660760+0000","last_peered":"2024-04-18T04:55:02.660760+0000","last_clean":"2024-04-18T04:55:02.660760+0000","last_became_active":"2024-04-18T04:54:40.802902+0000","last_became_peered":"2024-04-18T04:54:40.802902+0000","last_unstale":"2024-04-18T04:55:02.660760+0000","last_undegraded":"2024-04-18T04:55:02.660760+0000","last_fullsized":"2024-04-18T04:55:02.660760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.456062+0000","last_change":"2024-04-18T04:54:41.195382+0000","last_active":"2024-04-18T04:54:42.456062+0000","last_peered":"2024-04-18T04:54:42.456062+0000","last_clean":"2024-04-18T04:54:42.456062+0000","last_became_active":"2024-04-18T04:54:41.194965+0000","last_became_peered":"2024-04-18T04:54:41.194965+0000","last_unstale":"2024-04-18T04:54:42.456062+0000","last_undegraded":"2024-04-18T04:54:42.456062+0000","last_fullsized":"2024-04-18T04:54:42.456062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:39:50.932794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'7","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.662991+0000","last_change":"2024-04-18T04:54:40.800651+0000","last_active":"2024-04-18T04:55:02.662991+0000","last_peered":"2024-04-18T04:55:02.662991+0000","last_clean":"2024-04-18T04:55:02.662991+0000","last_became_active":"2024-04-18T04:54:40.798574+0000","last_became_peered":"2024-04-18T04:54:40.798574+0000","last_unstale":"2024-04-18T04:55:02.662991+0000","last_undegraded":"2024-04-18T04:55:02.662991+0000","last_fullsized":"2024-04-18T04:55:02.662991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:55.712985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170747+0000","last_change":"2024-04-18T04:54:41.191679+0000","last_active":"2024-04-18T04:54:42.170747+0000","last_peered":"2024-04-18T04:54:42.170747+0000","last_clean":"2024-04-18T04:54:42.170747+0000","last_became_active":"2024-04-18T04:54:41.191124+0000","last_became_peered":"2024-04-18T04:54:41.191124+0000","last_unstale":"2024-04-18T04:54:42.170747+0000","last_undegraded":"2024-04-18T04:54:42.170747+0000","last_fullsized":"2024-04-18T04:54:42.170747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.296860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'7","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.690206+0000","last_change":"2024-04-18T04:54:40.804085+0000","last_active":"2024-04-18T04:55:08.690206+0000","last_peered":"2024-04-18T04:55:08.690206+0000","last_clean":"2024-04-18T04:55:08.690206+0000","last_became_active":"2024-04-18T04:54:40.803616+0000","last_became_peered":"2024-04-18T04:54:40.803616+0000","last_unstale":"2024-04-18T04:55:08.690206+0000","last_undegraded":"2024-04-18T04:55:08.690206+0000","last_fullsized":"2024-04-18T04:55:08.690206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:55.405415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170788+0000","last_change":"2024-04-18T04:54:41.185453+0000","last_active":"2024-04-18T04:54:42.170788+0000","last_peered":"2024-04-18T04:54:42.170788+0000","last_clean":"2024-04-18T04:54:42.170788+0000","last_became_active":"2024-04-18T04:54:41.185217+0000","last_became_peered":"2024-04-18T04:54:41.185217+0000","last_unstale":"2024-04-18T04:54:42.170788+0000","last_undegraded":"2024-04-18T04:54:42.170788+0000","last_fullsized":"2024-04-18T04:54:42.170788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:44:42.484978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:52.218027+0000","last_change":"2024-04-18T04:54:40.801317+0000","last_active":"2024-04-18T04:54:52.218027+0000","last_peered":"2024-04-18T04:54:52.218027+0000","last_clean":"2024-04-18T04:54:52.218027+0000","last_became_active":"2024-04-18T04:54:40.800598+0000","last_became_peered":"2024-04-18T04:54:40.800598+0000","last_unstale":"2024-04-18T04:54:52.218027+0000","last_undegraded":"2024-04-18T04:54:52.218027+0000","last_fullsized":"2024-04-18T04:54:52.218027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454296+0000","last_change":"2024-04-18T04:54:41.197813+0000","last_active":"2024-04-18T04:54:42.454296+0000","last_peered":"2024-04-18T04:54:42.454296+0000","last_clean":"2024-04-18T04:54:42.454296+0000","last_became_active":"2024-04-18T04:54:41.197201+0000","last_became_peered":"2024-04-18T04:54:41.197201+0000","last_unstale":"2024-04-18T04:54:42.454296+0000","last_undegraded":"2024-04-18T04:54:42.454296+0000","last_fullsized":"2024-04-18T04:54:42.454296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"21'7","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.690093+0000","last_change":"2024-04-18T04:54:40.800416+0000","last_active":"2024-04-18T04:55:08.690093+0000","last_peered":"2024-04-18T04:55:08.690093+0000","last_clean":"2024-04-18T04:55:08.690093+0000","last_became_active":"2024-04-18T04:54:40.797471+0000","last_became_peered":"2024-04-18T04:54:40.797471+0000","last_unstale":"2024-04-18T04:55:08.690093+0000","last_undegraded":"2024-04-18T04:55:08.690093+0000","last_fullsized":"2024-04-18T04:55:08.690093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:33.118670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170092+0000","last_change":"2024-04-18T04:54:41.192024+0000","last_active":"2024-04-18T04:54:42.170092+0000","last_peered":"2024-04-18T04:54:42.170092+0000","last_clean":"2024-04-18T04:54:42.170092+0000","last_became_active":"2024-04-18T04:54:41.191488+0000","last_became_peered":"2024-04-18T04:54:41.191488+0000","last_unstale":"2024-04-18T04:54:42.170092+0000","last_undegraded":"2024-04-18T04:54:42.170092+0000","last_fullsized":"2024-04-18T04:54:42.170092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:39:31.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.659470+0000","last_change":"2024-04-18T04:54:40.823863+0000","last_active":"2024-04-18T04:55:02.659470+0000","last_peered":"2024-04-18T04:55:02.659470+0000","last_clean":"2024-04-18T04:55:02.659470+0000","last_became_active":"2024-04-18T04:54:40.823277+0000","last_became_peered":"2024-04-18T04:54:40.823277+0000","last_unstale":"2024-04-18T04:55:02.659470+0000","last_undegraded":"2024-04-18T04:55:02.659470+0000","last_fullsized":"2024-04-18T04:55:02.659470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454635+0000","last_change":"2024-04-18T04:54:41.199981+0000","last_active":"2024-04-18T04:54:42.454635+0000","last_peered":"2024-04-18T04:54:42.454635+0000","last_clean":"2024-04-18T04:54:42.454635+0000","last_became_active":"2024-04-18T04:54:41.199700+0000","last_became_peered":"2024-04-18T04:54:41.199700+0000","last_unstale":"2024-04-18T04:54:42.454635+0000","last_undegraded":"2024-04-18T04:54:42.454635+0000","last_fullsized":"2024-04-18T04:54:42.454635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:52.229222+0000","last_change":"2024-04-18T04:54:40.800740+0000","last_active":"2024-04-18T04:54:52.229222+0000","last_peered":"2024-04-18T04:54:52.229222+0000","last_clean":"2024-04-18T04:54:52.229222+0000","last_became_active":"2024-04-18T04:54:40.800405+0000","last_became_peered":"2024-04-18T04:54:40.800405+0000","last_unstale":"2024-04-18T04:54:52.229222+0000","last_undegraded":"2024-04-18T04:54:52.229222+0000","last_fullsized":"2024-04-18T04:54:52.229222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454668+0000","last_change":"2024-04-18T04:54:41.192487+0000","last_active":"2024-04-18T04:54:42.454668+0000","last_peered":"2024-04-18T04:54:42.454668+0000","last_clean":"2024-04-18T04:54:42.454668+0000","last_became_active":"2024-04-18T04:54:41.186301+0000","last_became_peered":"2024-04-18T04:54:41.186301+0000","last_unstale":"2024-04-18T04:54:42.454668+0000","last_undegraded":"2024-04-18T04:54:42.454668+0000","last_fullsized":"2024-04-18T04:54:42.454668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455262+0000","last_change":"2024-04-18T04:54:41.193260+0000","last_active":"2024-04-18T04:54:42.455262+0000","last_peered":"2024-04-18T04:54:42.455262+0000","last_clean":"2024-04-18T04:54:42.455262+0000","last_became_active":"2024-04-18T04:54:41.192941+0000","last_became_peered":"2024-04-18T04:54:41.192941+0000","last_unstale":"2024-04-18T04:54:42.455262+0000","last_undegraded":"2024-04-18T04:54:42.455262+0000","last_fullsized":"2024-04-18T04:54:42.455262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.697336+0000","last_change":"2024-04-18T04:54:40.800162+0000","last_active":"2024-04-18T04:55:08.697336+0000","last_peered":"2024-04-18T04:55:08.697336+0000","last_clean":"2024-04-18T04:55:08.697336+0000","last_became_active":"2024-04-18T04:54:40.799517+0000","last_became_peered":"2024-04-18T04:54:40.799517+0000","last_unstale":"2024-04-18T04:55:08.697336+0000","last_undegraded":"2024-04-18T04:55:08.697336+0000","last_fullsized":"2024-04-18T04:55:08.697336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167393+0000","last_change":"2024-04-18T04:54:41.179695+0000","last_active":"2024-04-18T04:54:42.167393+0000","last_peered":"2024-04-18T04:54:42.167393+0000","last_clean":"2024-04-18T04:54:42.167393+0000","last_became_active":"2024-04-18T04:54:41.179359+0000","last_became_peered":"2024-04-18T04:54:41.179359+0000","last_unstale":"2024-04-18T04:54:42.167393+0000","last_undegraded":"2024-04-18T04:54:42.167393+0000","last_fullsized":"2024-04-18T04:54:42.167393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'12","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.697456+0000","last_change":"2024-04-18T04:54:40.801178+0000","last_active":"2024-04-18T04:55:08.697456+0000","last_peered":"2024-04-18T04:55:08.697456+0000","last_clean":"2024-04-18T04:55:08.697456+0000","last_became_active":"2024-04-18T04:54:40.800660+0000","last_became_peered":"2024-04-18T04:54:40.800660+0000","last_unstale":"2024-04-18T04:55:08.697456+0000","last_undegraded":"2024-04-18T04:55:08.697456+0000","last_fullsized":"2024-04-18T04:55:08.697456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170091+0000","last_change":"2024-04-18T04:54:41.190055+0000","last_active":"2024-04-18T04:54:42.170091+0000","last_peered":"2024-04-18T04:54:42.170091+0000","last_clean":"2024-04-18T04:54:42.170091+0000","last_became_active":"2024-04-18T04:54:41.189344+0000","last_became_peered":"2024-04-18T04:54:41.189344+0000","last_unstale":"2024-04-18T04:54:42.170091+0000","last_undegraded":"2024-04-18T04:54:42.170091+0000","last_fullsized":"2024-04-18T04:54:42.170091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.185261+0000","last_change":"2024-04-18T04:54:40.813931+0000","last_active":"2024-04-18T04:54:46.185261+0000","last_peered":"2024-04-18T04:54:46.185261+0000","last_clean":"2024-04-18T04:54:46.185261+0000","last_became_active":"2024-04-18T04:54:40.813290+0000","last_became_peered":"2024-04-18T04:54:40.813290+0000","last_unstale":"2024-04-18T04:54:46.185261+0000","last_undegraded":"2024-04-18T04:54:46.185261+0000","last_fullsized":"2024-04-18T04:54:46.185261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170238+0000","last_change":"2024-04-18T04:54:41.192913+0000","last_active":"2024-04-18T04:54:42.170238+0000","last_peered":"2024-04-18T04:54:42.170238+0000","last_clean":"2024-04-18T04:54:42.170238+0000","last_became_active":"2024-04-18T04:54:41.192096+0000","last_became_peered":"2024-04-18T04:54:41.192096+0000","last_unstale":"2024-04-18T04:54:42.170238+0000","last_undegraded":"2024-04-18T04:54:42.170238+0000","last_fullsized":"2024-04-18T04:54:42.170238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:37:53.082409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'13","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.690753+0000","last_change":"2024-04-18T04:54:40.805596+0000","last_active":"2024-04-18T04:55:08.690753+0000","last_peered":"2024-04-18T04:55:08.690753+0000","last_clean":"2024-04-18T04:55:08.690753+0000","last_became_active":"2024-04-18T04:54:40.804913+0000","last_became_peered":"2024-04-18T04:54:40.804913+0000","last_unstale":"2024-04-18T04:55:08.690753+0000","last_undegraded":"2024-04-18T04:55:08.690753+0000","last_fullsized":"2024-04-18T04:55:08.690753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:44.772589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7794,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":15588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":74143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":75325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":664235,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]}]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":75715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":664871,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":75535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":76491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":74721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:55:20.289 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:55:20.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.442+0000 7f2daee95640 1 Processor -- start 2024-04-18T04:55:20.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.442+0000 7f2daee95640 1 -- start start 2024-04-18T04:55:20.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2daee95640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2da8151210 0x7f2da80c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2daee95640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2da80c1db0 0x7f2da80ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2daee95640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2da80ca840 0x7f2da815a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2daee95640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da8157150 con 0x7f2da80ca840 2024-04-18T04:55:20.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2daee95640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da8157430 con 0x7f2da8151210 2024-04-18T04:55:20.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2daee95640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da8157710 con 0x7f2da80c1db0 2024-04-18T04:55:20.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2dad432640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2da80ca840 0x7f2da815a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2dad432640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2da80ca840 0x7f2da815a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56728/0 (socket says 172.21.15.96:56728) 2024-04-18T04:55:20.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2dad432640 1 -- 172.21.15.96:0/4253499709 learned_addr learned my addr 172.21.15.96:0/4253499709 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:20.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2da7fff640 1 --2- 172.21.15.96:0/4253499709 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2da80c1db0 0x7f2da80ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2dacc31640 1 --2- 172.21.15.96:0/4253499709 >> v2:172.21.15.139:3300/0 conn(0x7f2da8151210 0x7f2da80c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2dad432640 1 -- 172.21.15.96:0/4253499709 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2da80c1db0 msgr2=0x7f2da80ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:20.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2dad432640 1 --2- 172.21.15.96:0/4253499709 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2da80c1db0 0x7f2da80ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2dad432640 1 -- 172.21.15.96:0/4253499709 >> v2:172.21.15.139:3300/0 conn(0x7f2da8151210 msgr2=0x7f2da80c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:20.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2dad432640 1 --2- 172.21.15.96:0/4253499709 >> v2:172.21.15.139:3300/0 conn(0x7f2da8151210 0x7f2da80c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2dad432640 1 -- 172.21.15.96:0/4253499709 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da81579f0 con 0x7f2da80ca840 2024-04-18T04:55:20.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2dad432640 1 --2- 172.21.15.96:0/4253499709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da80ca840 0x7f2da815a950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2da80c7b80 tx=0x7f2da001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0652a3ba1de6002 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:20.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2da77fe640 1 -- 172.21.15.96:0/4253499709 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da00af400 con 0x7f2da80ca840 2024-04-18T04:55:20.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2da77fe640 1 -- 172.21.15.96:0/4253499709 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da00ab050 con 0x7f2da80ca840 2024-04-18T04:55:20.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.446+0000 7f2da77fe640 1 -- 172.21.15.96:0/4253499709 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da00af780 con 0x7f2da80ca840 2024-04-18T04:55:20.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 -- 172.21.15.96:0/4253499709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da80ca840 msgr2=0x7f2da815a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 --2- 172.21.15.96:0/4253499709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da80ca840 0x7f2da815a950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2da80c7b80 tx=0x7f2da001f1e0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 -- 172.21.15.96:0/4253499709 shutdown_connections 2024-04-18T04:55:20.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 --2- 172.21.15.96:0/4253499709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da80ca840 0x7f2da815a950 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 --2- 172.21.15.96:0/4253499709 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2da80c1db0 0x7f2da80ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 --2- 172.21.15.96:0/4253499709 >> v2:172.21.15.139:3300/0 conn(0x7f2da8151210 0x7f2da80c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 -- 172.21.15.96:0/4253499709 >> 172.21.15.96:0/4253499709 conn(0x7f2da806c750 msgr2=0x7f2da80c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:20.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 -- 172.21.15.96:0/4253499709 shutdown_connections 2024-04-18T04:55:20.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 -- 172.21.15.96:0/4253499709 wait complete. 2024-04-18T04:55:20.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 Processor -- start 2024-04-18T04:55:20.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 -- start start 2024-04-18T04:55:20.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da80c1db0 0x7f2da8143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2da80ca840 0x7f2da8144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da8151210 0x7f2da81452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da8143960 con 0x7f2da8151210 2024-04-18T04:55:20.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80c8170 con 0x7f2da80c1db0 2024-04-18T04:55:20.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80c8980 con 0x7f2da80ca840 2024-04-18T04:55:20.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2dad432640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da8151210 0x7f2da81452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2dad432640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da8151210 0x7f2da81452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56732/0 (socket says 172.21.15.96:56732) 2024-04-18T04:55:20.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2dad432640 1 -- 172.21.15.96:0/2165009712 learned_addr learned my addr 172.21.15.96:0/2165009712 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:20.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2da7fff640 1 --2- 172.21.15.96:0/2165009712 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2da80ca840 0x7f2da8144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2dacc31640 1 --2- 172.21.15.96:0/2165009712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da80c1db0 0x7f2da8143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2dad432640 1 -- 172.21.15.96:0/2165009712 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2da80ca840 msgr2=0x7f2da8144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2dad432640 1 --2- 172.21.15.96:0/2165009712 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2da80ca840 0x7f2da8144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2dad432640 1 -- 172.21.15.96:0/2165009712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da80c1db0 msgr2=0x7f2da8143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2dad432640 1 --2- 172.21.15.96:0/2165009712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da80c1db0 0x7f2da8143420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2dad432640 1 -- 172.21.15.96:0/2165009712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da0009b30 con 0x7f2da8151210 2024-04-18T04:55:20.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2dad432640 1 --2- 172.21.15.96:0/2165009712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da8151210 0x7f2da81452a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2da00b2040 tx=0x7f2da001bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:20.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2da57fa640 1 -- 172.21.15.96:0/2165009712 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da00afde0 con 0x7f2da8151210 2024-04-18T04:55:20.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2da57fa640 1 -- 172.21.15.96:0/2165009712 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da0009510 con 0x7f2da8151210 2024-04-18T04:55:20.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 -- 172.21.15.96:0/2165009712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da8156f20 con 0x7f2da8151210 2024-04-18T04:55:20.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2da57fa640 1 -- 172.21.15.96:0/2165009712 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da00ba660 con 0x7f2da8151210 2024-04-18T04:55:20.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.450+0000 7f2daee95640 1 -- 172.21.15.96:0/2165009712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da80c86a0 con 0x7f2da8151210 2024-04-18T04:55:20.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.454+0000 7f2daee95640 1 -- 172.21.15.96:0/2165009712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da8067050 con 0x7f2da8151210 2024-04-18T04:55:20.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.454+0000 7f2da57fa640 1 -- 172.21.15.96:0/2165009712 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2da00b6040 con 0x7f2da8151210 2024-04-18T04:55:20.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.454+0000 7f2da57fa640 1 --2- 172.21.15.96:0/2165009712 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2d94066690 0x7f2d94068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.454+0000 7f2da57fa640 1 -- 172.21.15.96:0/2165009712 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2da0122380 con 0x7f2da8151210 2024-04-18T04:55:20.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.454+0000 7f2dacc31640 1 --2- 172.21.15.96:0/2165009712 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2d94066690 0x7f2d94068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.454+0000 7f2dacc31640 1 --2- 172.21.15.96:0/2165009712 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2d94066690 0x7f2d94068b50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2d98007a60 tx=0x7f2d98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:20.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.458+0000 7f2da57fa640 1 -- 172.21.15.96:0/2165009712 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2da00ef7d0 con 0x7f2da8151210 2024-04-18T04:55:20.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.602+0000 7f2daee95640 1 -- 172.21.15.96:0/2165009712 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2da8156da0 con 0x7f2d94066690 2024-04-18T04:55:20.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.610+0000 7f2da57fa640 1 -- 172.21.15.96:0/2165009712 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264674 (secure 0 0 0) 0x7f2d98010990 con 0x7f2d94066690 2024-04-18T04:55:20.614 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:55:20.616 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T04:55:20.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.614+0000 7f2daee95640 1 -- 172.21.15.96:0/2165009712 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2d94066690 msgr2=0x7f2d94068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.614+0000 7f2daee95640 1 --2- 172.21.15.96:0/2165009712 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2d94066690 0x7f2d94068b50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2d98007a60 tx=0x7f2d98008040 comp rx=0 tx=0).stop 2024-04-18T04:55:20.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.614+0000 7f2daee95640 1 -- 172.21.15.96:0/2165009712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da8151210 msgr2=0x7f2da81452a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.614+0000 7f2daee95640 1 --2- 172.21.15.96:0/2165009712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da8151210 0x7f2da81452a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2da00b2040 tx=0x7f2da001bf80 comp rx=0 tx=0).stop 2024-04-18T04:55:20.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.614+0000 7f2daee95640 1 -- 172.21.15.96:0/2165009712 shutdown_connections 2024-04-18T04:55:20.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.614+0000 7f2daee95640 1 --2- 172.21.15.96:0/2165009712 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2d94066690 0x7f2d94068b50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.614+0000 7f2daee95640 1 --2- 172.21.15.96:0/2165009712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2da8151210 0x7f2da81452a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.614+0000 7f2daee95640 1 --2- 172.21.15.96:0/2165009712 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2da80ca840 0x7f2da8144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.614+0000 7f2daee95640 1 --2- 172.21.15.96:0/2165009712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da80c1db0 0x7f2da8143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.614+0000 7f2daee95640 1 -- 172.21.15.96:0/2165009712 >> 172.21.15.96:0/2165009712 conn(0x7f2da806c750 msgr2=0x7f2da806d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:20.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.618+0000 7f2daee95640 1 -- 172.21.15.96:0/2165009712 shutdown_connections 2024-04-18T04:55:20.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.618+0000 7f2daee95640 1 -- 172.21.15.96:0/2165009712 wait complete. 2024-04-18T04:55:20.631 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-18T04:55:20.580697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598605,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":366,"num_write_kb":2480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218144,"kb_used_data":2016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756576,"statfs":{"total":773094113280,"available":772870733824,"internally_reserved":0,"allocated":2064384,"data_stored":1781922,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1801,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003780"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323999+0000","last_change":"2024-04-18T04:54:41.199306+0000","last_active":"2024-04-18T04:54:42.323999+0000","last_peered":"2024-04-18T04:54:42.323999+0000","last_clean":"2024-04-18T04:54:42.323999+0000","last_became_active":"2024-04-18T04:54:41.199046+0000","last_became_peered":"2024-04-18T04:54:41.199046+0000","last_unstale":"2024-04-18T04:54:42.323999+0000","last_undegraded":"2024-04-18T04:54:42.323999+0000","last_fullsized":"2024-04-18T04:54:42.323999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169848+0000","last_change":"2024-04-18T04:54:41.200447+0000","last_active":"2024-04-18T04:54:42.169848+0000","last_peered":"2024-04-18T04:54:42.169848+0000","last_clean":"2024-04-18T04:54:42.169848+0000","last_became_active":"2024-04-18T04:54:41.200136+0000","last_became_peered":"2024-04-18T04:54:41.200136+0000","last_unstale":"2024-04-18T04:54:42.169848+0000","last_undegraded":"2024-04-18T04:54:42.169848+0000","last_fullsized":"2024-04-18T04:54:42.169848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169517+0000","last_change":"2024-04-18T04:54:41.185987+0000","last_active":"2024-04-18T04:54:42.169517+0000","last_peered":"2024-04-18T04:54:42.169517+0000","last_clean":"2024-04-18T04:54:42.169517+0000","last_became_active":"2024-04-18T04:54:41.185206+0000","last_became_peered":"2024-04-18T04:54:41.185206+0000","last_unstale":"2024-04-18T04:54:42.169517+0000","last_undegraded":"2024-04-18T04:54:42.169517+0000","last_fullsized":"2024-04-18T04:54:42.169517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453954+0000","last_change":"2024-04-18T04:54:41.177487+0000","last_active":"2024-04-18T04:54:42.453954+0000","last_peered":"2024-04-18T04:54:42.453954+0000","last_clean":"2024-04-18T04:54:42.453954+0000","last_became_active":"2024-04-18T04:54:41.177217+0000","last_became_peered":"2024-04-18T04:54:41.177217+0000","last_unstale":"2024-04-18T04:54:42.453954+0000","last_undegraded":"2024-04-18T04:54:42.453954+0000","last_fullsized":"2024-04-18T04:54:42.453954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:08.067252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323329+0000","last_change":"2024-04-18T04:54:41.186573+0000","last_active":"2024-04-18T04:54:42.323329+0000","last_peered":"2024-04-18T04:54:42.323329+0000","last_clean":"2024-04-18T04:54:42.323329+0000","last_became_active":"2024-04-18T04:54:41.186027+0000","last_became_peered":"2024-04-18T04:54:41.186027+0000","last_unstale":"2024-04-18T04:54:42.323329+0000","last_undegraded":"2024-04-18T04:54:42.323329+0000","last_fullsized":"2024-04-18T04:54:42.323329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453454+0000","last_change":"2024-04-18T04:54:41.177550+0000","last_active":"2024-04-18T04:54:42.453454+0000","last_peered":"2024-04-18T04:54:42.453454+0000","last_clean":"2024-04-18T04:54:42.453454+0000","last_became_active":"2024-04-18T04:54:41.177215+0000","last_became_peered":"2024-04-18T04:54:41.177215+0000","last_unstale":"2024-04-18T04:54:42.453454+0000","last_undegraded":"2024-04-18T04:54:42.453454+0000","last_fullsized":"2024-04-18T04:54:42.453454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:26.266600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323158+0000","last_change":"2024-04-18T04:54:41.178605+0000","last_active":"2024-04-18T04:54:42.323158+0000","last_peered":"2024-04-18T04:54:42.323158+0000","last_clean":"2024-04-18T04:54:42.323158+0000","last_became_active":"2024-04-18T04:54:41.178094+0000","last_became_peered":"2024-04-18T04:54:41.178094+0000","last_unstale":"2024-04-18T04:54:42.323158+0000","last_undegraded":"2024-04-18T04:54:42.323158+0000","last_fullsized":"2024-04-18T04:54:42.323158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169250+0000","last_change":"2024-04-18T04:54:41.193174+0000","last_active":"2024-04-18T04:54:42.169250+0000","last_peered":"2024-04-18T04:54:42.169250+0000","last_clean":"2024-04-18T04:54:42.169250+0000","last_became_active":"2024-04-18T04:54:41.192678+0000","last_became_peered":"2024-04-18T04:54:41.192678+0000","last_unstale":"2024-04-18T04:54:42.169250+0000","last_undegraded":"2024-04-18T04:54:42.169250+0000","last_fullsized":"2024-04-18T04:54:42.169250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167601+0000","last_change":"2024-04-18T04:54:41.198121+0000","last_active":"2024-04-18T04:54:42.167601+0000","last_peered":"2024-04-18T04:54:42.167601+0000","last_clean":"2024-04-18T04:54:42.167601+0000","last_became_active":"2024-04-18T04:54:41.197832+0000","last_became_peered":"2024-04-18T04:54:41.197832+0000","last_unstale":"2024-04-18T04:54:42.167601+0000","last_undegraded":"2024-04-18T04:54:42.167601+0000","last_fullsized":"2024-04-18T04:54:42.167601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.835581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323925+0000","last_change":"2024-04-18T04:54:41.183032+0000","last_active":"2024-04-18T04:54:42.323925+0000","last_peered":"2024-04-18T04:54:42.323925+0000","last_clean":"2024-04-18T04:54:42.323925+0000","last_became_active":"2024-04-18T04:54:41.182698+0000","last_became_peered":"2024-04-18T04:54:41.182698+0000","last_unstale":"2024-04-18T04:54:42.323925+0000","last_undegraded":"2024-04-18T04:54:42.323925+0000","last_fullsized":"2024-04-18T04:54:42.323925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323788+0000","last_change":"2024-04-18T04:54:41.187831+0000","last_active":"2024-04-18T04:54:42.323788+0000","last_peered":"2024-04-18T04:54:42.323788+0000","last_clean":"2024-04-18T04:54:42.323788+0000","last_became_active":"2024-04-18T04:54:41.187360+0000","last_became_peered":"2024-04-18T04:54:41.187360+0000","last_unstale":"2024-04-18T04:54:42.323788+0000","last_undegraded":"2024-04-18T04:54:42.323788+0000","last_fullsized":"2024-04-18T04:54:42.323788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323367+0000","last_change":"2024-04-18T04:54:41.188641+0000","last_active":"2024-04-18T04:54:42.323367+0000","last_peered":"2024-04-18T04:54:42.323367+0000","last_clean":"2024-04-18T04:54:42.323367+0000","last_became_active":"2024-04-18T04:54:41.188281+0000","last_became_peered":"2024-04-18T04:54:41.188281+0000","last_unstale":"2024-04-18T04:54:42.323367+0000","last_undegraded":"2024-04-18T04:54:42.323367+0000","last_fullsized":"2024-04-18T04:54:42.323367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455946+0000","last_change":"2024-04-18T04:54:41.194578+0000","last_active":"2024-04-18T04:54:42.455946+0000","last_peered":"2024-04-18T04:54:42.455946+0000","last_clean":"2024-04-18T04:54:42.455946+0000","last_became_active":"2024-04-18T04:54:41.190882+0000","last_became_peered":"2024-04-18T04:54:41.190882+0000","last_unstale":"2024-04-18T04:54:42.455946+0000","last_undegraded":"2024-04-18T04:54:42.455946+0000","last_fullsized":"2024-04-18T04:54:42.455946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:45:52.041196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455376+0000","last_change":"2024-04-18T04:54:41.190210+0000","last_active":"2024-04-18T04:54:42.455376+0000","last_peered":"2024-04-18T04:54:42.455376+0000","last_clean":"2024-04-18T04:54:42.455376+0000","last_became_active":"2024-04-18T04:54:41.189813+0000","last_became_peered":"2024-04-18T04:54:41.189813+0000","last_unstale":"2024-04-18T04:54:42.455376+0000","last_undegraded":"2024-04-18T04:54:42.455376+0000","last_fullsized":"2024-04-18T04:54:42.455376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:38:02.632458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169188+0000","last_change":"2024-04-18T04:54:41.183027+0000","last_active":"2024-04-18T04:54:42.169188+0000","last_peered":"2024-04-18T04:54:42.169188+0000","last_clean":"2024-04-18T04:54:42.169188+0000","last_became_active":"2024-04-18T04:54:41.182713+0000","last_became_peered":"2024-04-18T04:54:41.182713+0000","last_unstale":"2024-04-18T04:54:42.169188+0000","last_undegraded":"2024-04-18T04:54:42.169188+0000","last_fullsized":"2024-04-18T04:54:42.169188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453959+0000","last_change":"2024-04-18T04:54:41.186060+0000","last_active":"2024-04-18T04:54:42.453959+0000","last_peered":"2024-04-18T04:54:42.453959+0000","last_clean":"2024-04-18T04:54:42.453959+0000","last_became_active":"2024-04-18T04:54:41.185803+0000","last_became_peered":"2024-04-18T04:54:41.185803+0000","last_unstale":"2024-04-18T04:54:42.453959+0000","last_undegraded":"2024-04-18T04:54:42.453959+0000","last_fullsized":"2024-04-18T04:54:42.453959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:48:04.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455728+0000","last_change":"2024-04-18T04:54:41.200802+0000","last_active":"2024-04-18T04:54:42.455728+0000","last_peered":"2024-04-18T04:54:42.455728+0000","last_clean":"2024-04-18T04:54:42.455728+0000","last_became_active":"2024-04-18T04:54:41.198404+0000","last_became_peered":"2024-04-18T04:54:41.198404+0000","last_unstale":"2024-04-18T04:54:42.455728+0000","last_undegraded":"2024-04-18T04:54:42.455728+0000","last_fullsized":"2024-04-18T04:54:42.455728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:56.686481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454830+0000","last_change":"2024-04-18T04:54:41.189568+0000","last_active":"2024-04-18T04:54:42.454830+0000","last_peered":"2024-04-18T04:54:42.454830+0000","last_clean":"2024-04-18T04:54:42.454830+0000","last_became_active":"2024-04-18T04:54:41.188139+0000","last_became_peered":"2024-04-18T04:54:41.188139+0000","last_unstale":"2024-04-18T04:54:42.454830+0000","last_undegraded":"2024-04-18T04:54:42.454830+0000","last_fullsized":"2024-04-18T04:54:42.454830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455410+0000","last_change":"2024-04-18T04:54:41.197901+0000","last_active":"2024-04-18T04:54:42.455410+0000","last_peered":"2024-04-18T04:54:42.455410+0000","last_clean":"2024-04-18T04:54:42.455410+0000","last_became_active":"2024-04-18T04:54:41.197235+0000","last_became_peered":"2024-04-18T04:54:41.197235+0000","last_unstale":"2024-04-18T04:54:42.455410+0000","last_undegraded":"2024-04-18T04:54:42.455410+0000","last_fullsized":"2024-04-18T04:54:42.455410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:41:20.213202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323339+0000","last_change":"2024-04-18T04:54:41.188440+0000","last_active":"2024-04-18T04:54:42.323339+0000","last_peered":"2024-04-18T04:54:42.323339+0000","last_clean":"2024-04-18T04:54:42.323339+0000","last_became_active":"2024-04-18T04:54:41.187925+0000","last_became_peered":"2024-04-18T04:54:41.187925+0000","last_unstale":"2024-04-18T04:54:42.323339+0000","last_undegraded":"2024-04-18T04:54:42.323339+0000","last_fullsized":"2024-04-18T04:54:42.323339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170212+0000","last_change":"2024-04-18T04:54:41.179672+0000","last_active":"2024-04-18T04:54:42.170212+0000","last_peered":"2024-04-18T04:54:42.170212+0000","last_clean":"2024-04-18T04:54:42.170212+0000","last_became_active":"2024-04-18T04:54:41.178963+0000","last_became_peered":"2024-04-18T04:54:41.178963+0000","last_unstale":"2024-04-18T04:54:42.170212+0000","last_undegraded":"2024-04-18T04:54:42.170212+0000","last_fullsized":"2024-04-18T04:54:42.170212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:56:31.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167152+0000","last_change":"2024-04-18T04:54:41.182902+0000","last_active":"2024-04-18T04:54:42.167152+0000","last_peered":"2024-04-18T04:54:42.167152+0000","last_clean":"2024-04-18T04:54:42.167152+0000","last_became_active":"2024-04-18T04:54:41.182664+0000","last_became_peered":"2024-04-18T04:54:41.182664+0000","last_unstale":"2024-04-18T04:54:42.167152+0000","last_undegraded":"2024-04-18T04:54:42.167152+0000","last_fullsized":"2024-04-18T04:54:42.167152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:56.408926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169624+0000","last_change":"2024-04-18T04:54:41.187578+0000","last_active":"2024-04-18T04:54:42.169624+0000","last_peered":"2024-04-18T04:54:42.169624+0000","last_clean":"2024-04-18T04:54:42.169624+0000","last_became_active":"2024-04-18T04:54:41.186881+0000","last_became_peered":"2024-04-18T04:54:41.186881+0000","last_unstale":"2024-04-18T04:54:42.169624+0000","last_undegraded":"2024-04-18T04:54:42.169624+0000","last_fullsized":"2024-04-18T04:54:42.169624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:27.817916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454216+0000","last_change":"2024-04-18T04:54:41.193206+0000","last_active":"2024-04-18T04:54:42.454216+0000","last_peered":"2024-04-18T04:54:42.454216+0000","last_clean":"2024-04-18T04:54:42.454216+0000","last_became_active":"2024-04-18T04:54:41.192740+0000","last_became_peered":"2024-04-18T04:54:41.192740+0000","last_unstale":"2024-04-18T04:54:42.454216+0000","last_undegraded":"2024-04-18T04:54:42.454216+0000","last_fullsized":"2024-04-18T04:54:42.454216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:51:34.311826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169844+0000","last_change":"2024-04-18T04:54:41.192785+0000","last_active":"2024-04-18T04:54:42.169844+0000","last_peered":"2024-04-18T04:54:42.169844+0000","last_clean":"2024-04-18T04:54:42.169844+0000","last_became_active":"2024-04-18T04:54:41.192280+0000","last_became_peered":"2024-04-18T04:54:41.192280+0000","last_unstale":"2024-04-18T04:54:42.169844+0000","last_undegraded":"2024-04-18T04:54:42.169844+0000","last_fullsized":"2024-04-18T04:54:42.169844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454615+0000","last_change":"2024-04-18T04:54:41.193920+0000","last_active":"2024-04-18T04:54:42.454615+0000","last_peered":"2024-04-18T04:54:42.454615+0000","last_clean":"2024-04-18T04:54:42.454615+0000","last_became_active":"2024-04-18T04:54:41.193660+0000","last_became_peered":"2024-04-18T04:54:41.193660+0000","last_unstale":"2024-04-18T04:54:42.454615+0000","last_undegraded":"2024-04-18T04:54:42.454615+0000","last_fullsized":"2024-04-18T04:54:42.454615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:22.072498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.456447+0000","last_change":"2024-04-18T04:54:41.190298+0000","last_active":"2024-04-18T04:54:42.456447+0000","last_peered":"2024-04-18T04:54:42.456447+0000","last_clean":"2024-04-18T04:54:42.456447+0000","last_became_active":"2024-04-18T04:54:41.189374+0000","last_became_peered":"2024-04-18T04:54:41.189374+0000","last_unstale":"2024-04-18T04:54:42.456447+0000","last_undegraded":"2024-04-18T04:54:42.456447+0000","last_fullsized":"2024-04-18T04:54:42.456447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455999+0000","last_change":"2024-04-18T04:54:41.190403+0000","last_active":"2024-04-18T04:54:42.455999+0000","last_peered":"2024-04-18T04:54:42.455999+0000","last_clean":"2024-04-18T04:54:42.455999+0000","last_became_active":"2024-04-18T04:54:41.189660+0000","last_became_peered":"2024-04-18T04:54:41.189660+0000","last_unstale":"2024-04-18T04:54:42.455999+0000","last_undegraded":"2024-04-18T04:54:42.455999+0000","last_fullsized":"2024-04-18T04:54:42.455999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:34.259279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169947+0000","last_change":"2024-04-18T04:54:41.187370+0000","last_active":"2024-04-18T04:54:42.169947+0000","last_peered":"2024-04-18T04:54:42.169947+0000","last_clean":"2024-04-18T04:54:42.169947+0000","last_became_active":"2024-04-18T04:54:41.186901+0000","last_became_peered":"2024-04-18T04:54:41.186901+0000","last_unstale":"2024-04-18T04:54:42.169947+0000","last_undegraded":"2024-04-18T04:54:42.169947+0000","last_fullsized":"2024-04-18T04:54:42.169947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454539+0000","last_change":"2024-04-18T04:54:41.192719+0000","last_active":"2024-04-18T04:54:42.454539+0000","last_peered":"2024-04-18T04:54:42.454539+0000","last_clean":"2024-04-18T04:54:42.454539+0000","last_became_active":"2024-04-18T04:54:41.192114+0000","last_became_peered":"2024-04-18T04:54:41.192114+0000","last_unstale":"2024-04-18T04:54:42.454539+0000","last_undegraded":"2024-04-18T04:54:42.454539+0000","last_fullsized":"2024-04-18T04:54:42.454539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:33:21.965783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454128+0000","last_change":"2024-04-18T04:54:41.186276+0000","last_active":"2024-04-18T04:54:42.454128+0000","last_peered":"2024-04-18T04:54:42.454128+0000","last_clean":"2024-04-18T04:54:42.454128+0000","last_became_active":"2024-04-18T04:54:41.185915+0000","last_became_peered":"2024-04-18T04:54:41.185915+0000","last_unstale":"2024-04-18T04:54:42.454128+0000","last_undegraded":"2024-04-18T04:54:42.454128+0000","last_fullsized":"2024-04-18T04:54:42.454128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453190+0000","last_change":"2024-04-18T04:54:41.190283+0000","last_active":"2024-04-18T04:54:42.453190+0000","last_peered":"2024-04-18T04:54:42.453190+0000","last_clean":"2024-04-18T04:54:42.453190+0000","last_became_active":"2024-04-18T04:54:41.189892+0000","last_became_peered":"2024-04-18T04:54:41.189892+0000","last_unstale":"2024-04-18T04:54:42.453190+0000","last_undegraded":"2024-04-18T04:54:42.453190+0000","last_fullsized":"2024-04-18T04:54:42.453190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:53.175178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167307+0000","last_change":"2024-04-18T04:54:41.187326+0000","last_active":"2024-04-18T04:54:42.167307+0000","last_peered":"2024-04-18T04:54:42.167307+0000","last_clean":"2024-04-18T04:54:42.167307+0000","last_became_active":"2024-04-18T04:54:41.187001+0000","last_became_peered":"2024-04-18T04:54:41.187001+0000","last_unstale":"2024-04-18T04:54:42.167307+0000","last_undegraded":"2024-04-18T04:54:42.167307+0000","last_fullsized":"2024-04-18T04:54:42.167307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:52.220269+0000","last_change":"2024-04-18T04:54:40.824658+0000","last_active":"2024-04-18T04:54:52.220269+0000","last_peered":"2024-04-18T04:54:52.220269+0000","last_clean":"2024-04-18T04:54:52.220269+0000","last_became_active":"2024-04-18T04:54:40.823652+0000","last_became_peered":"2024-04-18T04:54:40.823652+0000","last_unstale":"2024-04-18T04:54:52.220269+0000","last_undegraded":"2024-04-18T04:54:52.220269+0000","last_fullsized":"2024-04-18T04:54:52.220269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170634+0000","last_change":"2024-04-18T04:54:41.184497+0000","last_active":"2024-04-18T04:54:42.170634+0000","last_peered":"2024-04-18T04:54:42.170634+0000","last_clean":"2024-04-18T04:54:42.170634+0000","last_became_active":"2024-04-18T04:54:41.182180+0000","last_became_peered":"2024-04-18T04:54:41.182180+0000","last_unstale":"2024-04-18T04:54:42.170634+0000","last_undegraded":"2024-04-18T04:54:42.170634+0000","last_fullsized":"2024-04-18T04:54:42.170634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:25:15.707596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'7","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.661765+0000","last_change":"2024-04-18T04:54:40.803244+0000","last_active":"2024-04-18T04:55:02.661765+0000","last_peered":"2024-04-18T04:55:02.661765+0000","last_clean":"2024-04-18T04:55:02.661765+0000","last_became_active":"2024-04-18T04:54:40.802672+0000","last_became_peered":"2024-04-18T04:54:40.802672+0000","last_unstale":"2024-04-18T04:55:02.661765+0000","last_undegraded":"2024-04-18T04:55:02.661765+0000","last_fullsized":"2024-04-18T04:55:02.661765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:56.851301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:57.304619+0000","last_change":"2024-04-18T04:54:40.823675+0000","last_active":"2024-04-18T04:54:57.304619+0000","last_peered":"2024-04-18T04:54:57.304619+0000","last_clean":"2024-04-18T04:54:57.304619+0000","last_became_active":"2024-04-18T04:54:40.823091+0000","last_became_peered":"2024-04-18T04:54:40.823091+0000","last_unstale":"2024-04-18T04:54:57.304619+0000","last_undegraded":"2024-04-18T04:54:57.304619+0000","last_fullsized":"2024-04-18T04:54:57.304619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169532+0000","last_change":"2024-04-18T04:54:41.200326+0000","last_active":"2024-04-18T04:54:42.169532+0000","last_peered":"2024-04-18T04:54:42.169532+0000","last_clean":"2024-04-18T04:54:42.169532+0000","last_became_active":"2024-04-18T04:54:41.199690+0000","last_became_peered":"2024-04-18T04:54:41.199690+0000","last_unstale":"2024-04-18T04:54:42.169532+0000","last_undegraded":"2024-04-18T04:54:42.169532+0000","last_fullsized":"2024-04-18T04:54:42.169532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.659131+0000","last_change":"2024-04-18T04:54:40.805264+0000","last_active":"2024-04-18T04:55:02.659131+0000","last_peered":"2024-04-18T04:55:02.659131+0000","last_clean":"2024-04-18T04:55:02.659131+0000","last_became_active":"2024-04-18T04:54:40.804605+0000","last_became_peered":"2024-04-18T04:54:40.804605+0000","last_unstale":"2024-04-18T04:55:02.659131+0000","last_undegraded":"2024-04-18T04:55:02.659131+0000","last_fullsized":"2024-04-18T04:55:02.659131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:48.991270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.171188+0000","last_change":"2024-04-18T04:54:41.175359+0000","last_active":"2024-04-18T04:54:42.171188+0000","last_peered":"2024-04-18T04:54:42.171188+0000","last_clean":"2024-04-18T04:54:42.171188+0000","last_became_active":"2024-04-18T04:54:41.175137+0000","last_became_peered":"2024-04-18T04:54:41.175137+0000","last_unstale":"2024-04-18T04:54:42.171188+0000","last_undegraded":"2024-04-18T04:54:42.171188+0000","last_fullsized":"2024-04-18T04:54:42.171188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:06:24.271204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:52.216917+0000","last_change":"2024-04-18T04:54:40.798936+0000","last_active":"2024-04-18T04:54:52.216917+0000","last_peered":"2024-04-18T04:54:52.216917+0000","last_clean":"2024-04-18T04:54:52.216917+0000","last_became_active":"2024-04-18T04:54:40.798572+0000","last_became_peered":"2024-04-18T04:54:40.798572+0000","last_unstale":"2024-04-18T04:54:52.216917+0000","last_undegraded":"2024-04-18T04:54:52.216917+0000","last_fullsized":"2024-04-18T04:54:52.216917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454742+0000","last_change":"2024-04-18T04:54:41.188280+0000","last_active":"2024-04-18T04:54:42.454742+0000","last_peered":"2024-04-18T04:54:42.454742+0000","last_clean":"2024-04-18T04:54:42.454742+0000","last_became_active":"2024-04-18T04:54:41.188012+0000","last_became_peered":"2024-04-18T04:54:41.188012+0000","last_unstale":"2024-04-18T04:54:42.454742+0000","last_undegraded":"2024-04-18T04:54:42.454742+0000","last_fullsized":"2024-04-18T04:54:42.454742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:11.319118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.689262+0000","last_change":"2024-04-18T04:54:40.802894+0000","last_active":"2024-04-18T04:55:08.689262+0000","last_peered":"2024-04-18T04:55:08.689262+0000","last_clean":"2024-04-18T04:55:08.689262+0000","last_became_active":"2024-04-18T04:54:40.801406+0000","last_became_peered":"2024-04-18T04:54:40.801406+0000","last_unstale":"2024-04-18T04:55:08.689262+0000","last_undegraded":"2024-04-18T04:55:08.689262+0000","last_fullsized":"2024-04-18T04:55:08.689262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170319+0000","last_change":"2024-04-18T04:54:41.203407+0000","last_active":"2024-04-18T04:54:42.170319+0000","last_peered":"2024-04-18T04:54:42.170319+0000","last_clean":"2024-04-18T04:54:42.170319+0000","last_became_active":"2024-04-18T04:54:41.203186+0000","last_became_peered":"2024-04-18T04:54:41.203186+0000","last_unstale":"2024-04-18T04:54:42.170319+0000","last_undegraded":"2024-04-18T04:54:42.170319+0000","last_fullsized":"2024-04-18T04:54:42.170319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:23:50.107054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:52.216865+0000","last_change":"2024-04-18T04:54:40.822014+0000","last_active":"2024-04-18T04:54:52.216865+0000","last_peered":"2024-04-18T04:54:52.216865+0000","last_clean":"2024-04-18T04:54:52.216865+0000","last_became_active":"2024-04-18T04:54:40.820920+0000","last_became_peered":"2024-04-18T04:54:40.820920+0000","last_unstale":"2024-04-18T04:54:52.216865+0000","last_undegraded":"2024-04-18T04:54:52.216865+0000","last_fullsized":"2024-04-18T04:54:52.216865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455233+0000","last_change":"2024-04-18T04:54:41.197254+0000","last_active":"2024-04-18T04:54:42.455233+0000","last_peered":"2024-04-18T04:54:42.455233+0000","last_clean":"2024-04-18T04:54:42.455233+0000","last_became_active":"2024-04-18T04:54:41.196927+0000","last_became_peered":"2024-04-18T04:54:41.196927+0000","last_unstale":"2024-04-18T04:54:42.455233+0000","last_undegraded":"2024-04-18T04:54:42.455233+0000","last_fullsized":"2024-04-18T04:54:42.455233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:01:45.182766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'12","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:16.937931+0000","last_change":"2024-04-18T04:54:40.801789+0000","last_active":"2024-04-18T04:55:16.937931+0000","last_peered":"2024-04-18T04:55:16.937931+0000","last_clean":"2024-04-18T04:55:16.937931+0000","last_became_active":"2024-04-18T04:54:40.801403+0000","last_became_peered":"2024-04-18T04:54:40.801403+0000","last_unstale":"2024-04-18T04:55:16.937931+0000","last_undegraded":"2024-04-18T04:55:16.937931+0000","last_fullsized":"2024-04-18T04:55:16.937931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:15:11.220095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2007,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323817+0000","last_change":"2024-04-18T04:54:41.195518+0000","last_active":"2024-04-18T04:54:42.323817+0000","last_peered":"2024-04-18T04:54:42.323817+0000","last_clean":"2024-04-18T04:54:42.323817+0000","last_became_active":"2024-04-18T04:54:41.195172+0000","last_became_peered":"2024-04-18T04:54:41.195172+0000","last_unstale":"2024-04-18T04:54:42.323817+0000","last_undegraded":"2024-04-18T04:54:42.323817+0000","last_fullsized":"2024-04-18T04:54:42.323817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'9","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.693381+0000","last_change":"2024-04-18T04:54:40.818390+0000","last_active":"2024-04-18T04:55:08.693381+0000","last_peered":"2024-04-18T04:55:08.693381+0000","last_clean":"2024-04-18T04:55:08.693381+0000","last_became_active":"2024-04-18T04:54:40.817681+0000","last_became_peered":"2024-04-18T04:54:40.817681+0000","last_unstale":"2024-04-18T04:55:08.693381+0000","last_undegraded":"2024-04-18T04:55:08.693381+0000","last_fullsized":"2024-04-18T04:55:08.693381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455448+0000","last_change":"2024-04-18T04:54:41.194807+0000","last_active":"2024-04-18T04:54:42.455448+0000","last_peered":"2024-04-18T04:54:42.455448+0000","last_clean":"2024-04-18T04:54:42.455448+0000","last_became_active":"2024-04-18T04:54:41.194499+0000","last_became_peered":"2024-04-18T04:54:41.194499+0000","last_unstale":"2024-04-18T04:54:42.455448+0000","last_undegraded":"2024-04-18T04:54:42.455448+0000","last_fullsized":"2024-04-18T04:54:42.455448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.662518+0000","last_change":"2024-04-18T04:54:40.817631+0000","last_active":"2024-04-18T04:55:02.662518+0000","last_peered":"2024-04-18T04:55:02.662518+0000","last_clean":"2024-04-18T04:55:02.662518+0000","last_became_active":"2024-04-18T04:54:40.817370+0000","last_became_peered":"2024-04-18T04:54:40.817370+0000","last_unstale":"2024-04-18T04:55:02.662518+0000","last_undegraded":"2024-04-18T04:55:02.662518+0000","last_fullsized":"2024-04-18T04:55:02.662518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454210+0000","last_change":"2024-04-18T04:54:41.193363+0000","last_active":"2024-04-18T04:54:42.454210+0000","last_peered":"2024-04-18T04:54:42.454210+0000","last_clean":"2024-04-18T04:54:42.454210+0000","last_became_active":"2024-04-18T04:54:41.192889+0000","last_became_peered":"2024-04-18T04:54:41.192889+0000","last_unstale":"2024-04-18T04:54:42.454210+0000","last_undegraded":"2024-04-18T04:54:42.454210+0000","last_fullsized":"2024-04-18T04:54:42.454210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.661210+0000","last_change":"2024-04-18T04:54:40.806633+0000","last_active":"2024-04-18T04:55:02.661210+0000","last_peered":"2024-04-18T04:55:02.661210+0000","last_clean":"2024-04-18T04:55:02.661210+0000","last_became_active":"2024-04-18T04:54:40.805965+0000","last_became_peered":"2024-04-18T04:54:40.805965+0000","last_unstale":"2024-04-18T04:55:02.661210+0000","last_undegraded":"2024-04-18T04:55:02.661210+0000","last_fullsized":"2024-04-18T04:55:02.661210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167013+0000","last_change":"2024-04-18T04:54:41.184321+0000","last_active":"2024-04-18T04:54:42.167013+0000","last_peered":"2024-04-18T04:54:42.167013+0000","last_clean":"2024-04-18T04:54:42.167013+0000","last_became_active":"2024-04-18T04:54:41.183838+0000","last_became_peered":"2024-04-18T04:54:41.183838+0000","last_unstale":"2024-04-18T04:54:42.167013+0000","last_undegraded":"2024-04-18T04:54:42.167013+0000","last_fullsized":"2024-04-18T04:54:42.167013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'17","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.656803+0000","last_change":"2024-04-18T04:54:40.818954+0000","last_active":"2024-04-18T04:55:02.656803+0000","last_peered":"2024-04-18T04:55:02.656803+0000","last_clean":"2024-04-18T04:55:02.656803+0000","last_became_active":"2024-04-18T04:54:40.818227+0000","last_became_peered":"2024-04-18T04:54:40.818227+0000","last_unstale":"2024-04-18T04:55:02.656803+0000","last_undegraded":"2024-04-18T04:55:02.656803+0000","last_fullsized":"2024-04-18T04:55:02.656803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:25.263089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454553+0000","last_change":"2024-04-18T04:54:41.192227+0000","last_active":"2024-04-18T04:54:42.454553+0000","last_peered":"2024-04-18T04:54:42.454553+0000","last_clean":"2024-04-18T04:54:42.454553+0000","last_became_active":"2024-04-18T04:54:41.187002+0000","last_became_peered":"2024-04-18T04:54:41.187002+0000","last_unstale":"2024-04-18T04:54:42.454553+0000","last_undegraded":"2024-04-18T04:54:42.454553+0000","last_fullsized":"2024-04-18T04:54:42.454553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.180662+0000","last_change":"2024-04-18T04:54:40.805795+0000","last_active":"2024-04-18T04:54:46.180662+0000","last_peered":"2024-04-18T04:54:46.180662+0000","last_clean":"2024-04-18T04:54:46.180662+0000","last_became_active":"2024-04-18T04:54:40.802550+0000","last_became_peered":"2024-04-18T04:54:40.802550+0000","last_unstale":"2024-04-18T04:54:46.180662+0000","last_undegraded":"2024-04-18T04:54:46.180662+0000","last_fullsized":"2024-04-18T04:54:46.180662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454849+0000","last_change":"2024-04-18T04:54:41.180426+0000","last_active":"2024-04-18T04:54:42.454849+0000","last_peered":"2024-04-18T04:54:42.454849+0000","last_clean":"2024-04-18T04:54:42.454849+0000","last_became_active":"2024-04-18T04:54:41.179540+0000","last_became_peered":"2024-04-18T04:54:41.179540+0000","last_unstale":"2024-04-18T04:54:42.454849+0000","last_undegraded":"2024-04-18T04:54:42.454849+0000","last_fullsized":"2024-04-18T04:54:42.454849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:38:25.074053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.691060+0000","last_change":"2024-04-18T04:54:40.804284+0000","last_active":"2024-04-18T04:55:08.691060+0000","last_peered":"2024-04-18T04:55:08.691060+0000","last_clean":"2024-04-18T04:55:08.691060+0000","last_became_active":"2024-04-18T04:54:40.803464+0000","last_became_peered":"2024-04-18T04:54:40.803464+0000","last_unstale":"2024-04-18T04:55:08.691060+0000","last_undegraded":"2024-04-18T04:55:08.691060+0000","last_fullsized":"2024-04-18T04:55:08.691060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:52.171667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.324196+0000","last_change":"2024-04-18T04:54:41.188591+0000","last_active":"2024-04-18T04:54:42.324196+0000","last_peered":"2024-04-18T04:54:42.324196+0000","last_clean":"2024-04-18T04:54:42.324196+0000","last_became_active":"2024-04-18T04:54:41.188152+0000","last_became_peered":"2024-04-18T04:54:41.188152+0000","last_unstale":"2024-04-18T04:54:42.324196+0000","last_undegraded":"2024-04-18T04:54:42.324196+0000","last_fullsized":"2024-04-18T04:54:42.324196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.659248+0000","last_change":"2024-04-18T04:54:40.814901+0000","last_active":"2024-04-18T04:55:02.659248+0000","last_peered":"2024-04-18T04:55:02.659248+0000","last_clean":"2024-04-18T04:55:02.659248+0000","last_became_active":"2024-04-18T04:54:40.814207+0000","last_became_peered":"2024-04-18T04:54:40.814207+0000","last_unstale":"2024-04-18T04:55:02.659248+0000","last_undegraded":"2024-04-18T04:55:02.659248+0000","last_fullsized":"2024-04-18T04:55:02.659248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323473+0000","last_change":"2024-04-18T04:54:41.188664+0000","last_active":"2024-04-18T04:54:42.323473+0000","last_peered":"2024-04-18T04:54:42.323473+0000","last_clean":"2024-04-18T04:54:42.323473+0000","last_became_active":"2024-04-18T04:54:41.188249+0000","last_became_peered":"2024-04-18T04:54:41.188249+0000","last_unstale":"2024-04-18T04:54:42.323473+0000","last_undegraded":"2024-04-18T04:54:42.323473+0000","last_fullsized":"2024-04-18T04:54:42.323473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.656250+0000","last_change":"2024-04-18T04:54:40.828447+0000","last_active":"2024-04-18T04:55:02.656250+0000","last_peered":"2024-04-18T04:55:02.656250+0000","last_clean":"2024-04-18T04:55:02.656250+0000","last_became_active":"2024-04-18T04:54:40.823755+0000","last_became_peered":"2024-04-18T04:54:40.823755+0000","last_unstale":"2024-04-18T04:55:02.656250+0000","last_undegraded":"2024-04-18T04:55:02.656250+0000","last_fullsized":"2024-04-18T04:55:02.656250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455365+0000","last_change":"2024-04-18T04:54:41.186523+0000","last_active":"2024-04-18T04:54:42.455365+0000","last_peered":"2024-04-18T04:54:42.455365+0000","last_clean":"2024-04-18T04:54:42.455365+0000","last_became_active":"2024-04-18T04:54:41.186149+0000","last_became_peered":"2024-04-18T04:54:41.186149+0000","last_unstale":"2024-04-18T04:54:42.455365+0000","last_undegraded":"2024-04-18T04:54:42.455365+0000","last_fullsized":"2024-04-18T04:54:42.455365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T04:54:41.164056+0000","last_change":"2024-04-18T04:54:35.674328+0000","last_active":"2024-04-18T04:54:41.164056+0000","last_peered":"2024-04-18T04:54:41.164056+0000","last_clean":"2024-04-18T04:54:41.164056+0000","last_became_active":"2024-04-18T04:54:35.672457+0000","last_became_peered":"2024-04-18T04:54:35.672457+0000","last_unstale":"2024-04-18T04:54:41.164056+0000","last_undegraded":"2024-04-18T04:54:41.164056+0000","last_fullsized":"2024-04-18T04:54:41.164056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_clean_scrub_stamp":"2024-04-18T04:54:33.597974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:02:10.966568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.662735+0000","last_change":"2024-04-18T04:54:40.802422+0000","last_active":"2024-04-18T04:55:02.662735+0000","last_peered":"2024-04-18T04:55:02.662735+0000","last_clean":"2024-04-18T04:55:02.662735+0000","last_became_active":"2024-04-18T04:54:40.801083+0000","last_became_peered":"2024-04-18T04:54:40.801083+0000","last_unstale":"2024-04-18T04:55:02.662735+0000","last_undegraded":"2024-04-18T04:55:02.662735+0000","last_fullsized":"2024-04-18T04:55:02.662735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170437+0000","last_change":"2024-04-18T04:54:41.174658+0000","last_active":"2024-04-18T04:54:42.170437+0000","last_peered":"2024-04-18T04:54:42.170437+0000","last_clean":"2024-04-18T04:54:42.170437+0000","last_became_active":"2024-04-18T04:54:41.174391+0000","last_became_peered":"2024-04-18T04:54:41.174391+0000","last_unstale":"2024-04-18T04:54:42.170437+0000","last_undegraded":"2024-04-18T04:54:42.170437+0000","last_fullsized":"2024-04-18T04:54:42.170437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:28:24.015964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:57.311612+0000","last_change":"2024-04-18T04:54:40.813770+0000","last_active":"2024-04-18T04:54:57.311612+0000","last_peered":"2024-04-18T04:54:57.311612+0000","last_clean":"2024-04-18T04:54:57.311612+0000","last_became_active":"2024-04-18T04:54:40.813396+0000","last_became_peered":"2024-04-18T04:54:40.813396+0000","last_unstale":"2024-04-18T04:54:57.311612+0000","last_undegraded":"2024-04-18T04:54:57.311612+0000","last_fullsized":"2024-04-18T04:54:57.311612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455360+0000","last_change":"2024-04-18T04:54:41.195440+0000","last_active":"2024-04-18T04:54:42.455360+0000","last_peered":"2024-04-18T04:54:42.455360+0000","last_clean":"2024-04-18T04:54:42.455360+0000","last_became_active":"2024-04-18T04:54:41.195152+0000","last_became_peered":"2024-04-18T04:54:41.195152+0000","last_unstale":"2024-04-18T04:54:42.455360+0000","last_undegraded":"2024-04-18T04:54:42.455360+0000","last_fullsized":"2024-04-18T04:54:42.455360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:57.312350+0000","last_change":"2024-04-18T04:54:40.818806+0000","last_active":"2024-04-18T04:54:57.312350+0000","last_peered":"2024-04-18T04:54:57.312350+0000","last_clean":"2024-04-18T04:54:57.312350+0000","last_became_active":"2024-04-18T04:54:40.818113+0000","last_became_peered":"2024-04-18T04:54:40.818113+0000","last_unstale":"2024-04-18T04:54:57.312350+0000","last_undegraded":"2024-04-18T04:54:57.312350+0000","last_fullsized":"2024-04-18T04:54:57.312350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.169410+0000","last_change":"2024-04-18T04:54:41.192576+0000","last_active":"2024-04-18T04:54:42.169410+0000","last_peered":"2024-04-18T04:54:42.169410+0000","last_clean":"2024-04-18T04:54:42.169410+0000","last_became_active":"2024-04-18T04:54:41.192187+0000","last_became_peered":"2024-04-18T04:54:41.192187+0000","last_unstale":"2024-04-18T04:54:42.169410+0000","last_undegraded":"2024-04-18T04:54:42.169410+0000","last_fullsized":"2024-04-18T04:54:42.169410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.695117+0000","last_change":"2024-04-18T04:54:40.820531+0000","last_active":"2024-04-18T04:55:08.695117+0000","last_peered":"2024-04-18T04:55:08.695117+0000","last_clean":"2024-04-18T04:55:08.695117+0000","last_became_active":"2024-04-18T04:54:40.820025+0000","last_became_peered":"2024-04-18T04:54:40.820025+0000","last_unstale":"2024-04-18T04:55:08.695117+0000","last_undegraded":"2024-04-18T04:55:08.695117+0000","last_fullsized":"2024-04-18T04:55:08.695117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:35.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.323461+0000","last_change":"2024-04-18T04:54:41.186361+0000","last_active":"2024-04-18T04:54:42.323461+0000","last_peered":"2024-04-18T04:54:42.323461+0000","last_clean":"2024-04-18T04:54:42.323461+0000","last_became_active":"2024-04-18T04:54:41.185257+0000","last_became_peered":"2024-04-18T04:54:41.185257+0000","last_unstale":"2024-04-18T04:54:42.323461+0000","last_undegraded":"2024-04-18T04:54:42.323461+0000","last_fullsized":"2024-04-18T04:54:42.323461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170201+0000","last_change":"2024-04-18T04:54:40.824668+0000","last_active":"2024-04-18T04:54:42.170201+0000","last_peered":"2024-04-18T04:54:42.170201+0000","last_clean":"2024-04-18T04:54:42.170201+0000","last_became_active":"2024-04-18T04:54:40.824206+0000","last_became_peered":"2024-04-18T04:54:40.824206+0000","last_unstale":"2024-04-18T04:54:42.170201+0000","last_undegraded":"2024-04-18T04:54:42.170201+0000","last_fullsized":"2024-04-18T04:54:42.170201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.453990+0000","last_change":"2024-04-18T04:54:41.195487+0000","last_active":"2024-04-18T04:54:42.453990+0000","last_peered":"2024-04-18T04:54:42.453990+0000","last_clean":"2024-04-18T04:54:42.453990+0000","last_became_active":"2024-04-18T04:54:41.195177+0000","last_became_peered":"2024-04-18T04:54:41.195177+0000","last_unstale":"2024-04-18T04:54:42.453990+0000","last_undegraded":"2024-04-18T04:54:42.453990+0000","last_fullsized":"2024-04-18T04:54:42.453990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:25.853413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.660760+0000","last_change":"2024-04-18T04:54:40.803387+0000","last_active":"2024-04-18T04:55:02.660760+0000","last_peered":"2024-04-18T04:55:02.660760+0000","last_clean":"2024-04-18T04:55:02.660760+0000","last_became_active":"2024-04-18T04:54:40.802902+0000","last_became_peered":"2024-04-18T04:54:40.802902+0000","last_unstale":"2024-04-18T04:55:02.660760+0000","last_undegraded":"2024-04-18T04:55:02.660760+0000","last_fullsized":"2024-04-18T04:55:02.660760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.456062+0000","last_change":"2024-04-18T04:54:41.195382+0000","last_active":"2024-04-18T04:54:42.456062+0000","last_peered":"2024-04-18T04:54:42.456062+0000","last_clean":"2024-04-18T04:54:42.456062+0000","last_became_active":"2024-04-18T04:54:41.194965+0000","last_became_peered":"2024-04-18T04:54:41.194965+0000","last_unstale":"2024-04-18T04:54:42.456062+0000","last_undegraded":"2024-04-18T04:54:42.456062+0000","last_fullsized":"2024-04-18T04:54:42.456062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:39:50.932794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'7","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.662991+0000","last_change":"2024-04-18T04:54:40.800651+0000","last_active":"2024-04-18T04:55:02.662991+0000","last_peered":"2024-04-18T04:55:02.662991+0000","last_clean":"2024-04-18T04:55:02.662991+0000","last_became_active":"2024-04-18T04:54:40.798574+0000","last_became_peered":"2024-04-18T04:54:40.798574+0000","last_unstale":"2024-04-18T04:55:02.662991+0000","last_undegraded":"2024-04-18T04:55:02.662991+0000","last_fullsized":"2024-04-18T04:55:02.662991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:55.712985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170747+0000","last_change":"2024-04-18T04:54:41.191679+0000","last_active":"2024-04-18T04:54:42.170747+0000","last_peered":"2024-04-18T04:54:42.170747+0000","last_clean":"2024-04-18T04:54:42.170747+0000","last_became_active":"2024-04-18T04:54:41.191124+0000","last_became_peered":"2024-04-18T04:54:41.191124+0000","last_unstale":"2024-04-18T04:54:42.170747+0000","last_undegraded":"2024-04-18T04:54:42.170747+0000","last_fullsized":"2024-04-18T04:54:42.170747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.296860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'7","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.690206+0000","last_change":"2024-04-18T04:54:40.804085+0000","last_active":"2024-04-18T04:55:08.690206+0000","last_peered":"2024-04-18T04:55:08.690206+0000","last_clean":"2024-04-18T04:55:08.690206+0000","last_became_active":"2024-04-18T04:54:40.803616+0000","last_became_peered":"2024-04-18T04:54:40.803616+0000","last_unstale":"2024-04-18T04:55:08.690206+0000","last_undegraded":"2024-04-18T04:55:08.690206+0000","last_fullsized":"2024-04-18T04:55:08.690206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:55.405415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170788+0000","last_change":"2024-04-18T04:54:41.185453+0000","last_active":"2024-04-18T04:54:42.170788+0000","last_peered":"2024-04-18T04:54:42.170788+0000","last_clean":"2024-04-18T04:54:42.170788+0000","last_became_active":"2024-04-18T04:54:41.185217+0000","last_became_peered":"2024-04-18T04:54:41.185217+0000","last_unstale":"2024-04-18T04:54:42.170788+0000","last_undegraded":"2024-04-18T04:54:42.170788+0000","last_fullsized":"2024-04-18T04:54:42.170788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:44:42.484978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:52.218027+0000","last_change":"2024-04-18T04:54:40.801317+0000","last_active":"2024-04-18T04:54:52.218027+0000","last_peered":"2024-04-18T04:54:52.218027+0000","last_clean":"2024-04-18T04:54:52.218027+0000","last_became_active":"2024-04-18T04:54:40.800598+0000","last_became_peered":"2024-04-18T04:54:40.800598+0000","last_unstale":"2024-04-18T04:54:52.218027+0000","last_undegraded":"2024-04-18T04:54:52.218027+0000","last_fullsized":"2024-04-18T04:54:52.218027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454296+0000","last_change":"2024-04-18T04:54:41.197813+0000","last_active":"2024-04-18T04:54:42.454296+0000","last_peered":"2024-04-18T04:54:42.454296+0000","last_clean":"2024-04-18T04:54:42.454296+0000","last_became_active":"2024-04-18T04:54:41.197201+0000","last_became_peered":"2024-04-18T04:54:41.197201+0000","last_unstale":"2024-04-18T04:54:42.454296+0000","last_undegraded":"2024-04-18T04:54:42.454296+0000","last_fullsized":"2024-04-18T04:54:42.454296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"21'7","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.690093+0000","last_change":"2024-04-18T04:54:40.800416+0000","last_active":"2024-04-18T04:55:08.690093+0000","last_peered":"2024-04-18T04:55:08.690093+0000","last_clean":"2024-04-18T04:55:08.690093+0000","last_became_active":"2024-04-18T04:54:40.797471+0000","last_became_peered":"2024-04-18T04:54:40.797471+0000","last_unstale":"2024-04-18T04:55:08.690093+0000","last_undegraded":"2024-04-18T04:55:08.690093+0000","last_fullsized":"2024-04-18T04:55:08.690093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:33.118670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170092+0000","last_change":"2024-04-18T04:54:41.192024+0000","last_active":"2024-04-18T04:54:42.170092+0000","last_peered":"2024-04-18T04:54:42.170092+0000","last_clean":"2024-04-18T04:54:42.170092+0000","last_became_active":"2024-04-18T04:54:41.191488+0000","last_became_peered":"2024-04-18T04:54:41.191488+0000","last_unstale":"2024-04-18T04:54:42.170092+0000","last_undegraded":"2024-04-18T04:54:42.170092+0000","last_fullsized":"2024-04-18T04:54:42.170092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:39:31.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:02.659470+0000","last_change":"2024-04-18T04:54:40.823863+0000","last_active":"2024-04-18T04:55:02.659470+0000","last_peered":"2024-04-18T04:55:02.659470+0000","last_clean":"2024-04-18T04:55:02.659470+0000","last_became_active":"2024-04-18T04:54:40.823277+0000","last_became_peered":"2024-04-18T04:54:40.823277+0000","last_unstale":"2024-04-18T04:55:02.659470+0000","last_undegraded":"2024-04-18T04:55:02.659470+0000","last_fullsized":"2024-04-18T04:55:02.659470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454635+0000","last_change":"2024-04-18T04:54:41.199981+0000","last_active":"2024-04-18T04:54:42.454635+0000","last_peered":"2024-04-18T04:54:42.454635+0000","last_clean":"2024-04-18T04:54:42.454635+0000","last_became_active":"2024-04-18T04:54:41.199700+0000","last_became_peered":"2024-04-18T04:54:41.199700+0000","last_unstale":"2024-04-18T04:54:42.454635+0000","last_undegraded":"2024-04-18T04:54:42.454635+0000","last_fullsized":"2024-04-18T04:54:42.454635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:52.229222+0000","last_change":"2024-04-18T04:54:40.800740+0000","last_active":"2024-04-18T04:54:52.229222+0000","last_peered":"2024-04-18T04:54:52.229222+0000","last_clean":"2024-04-18T04:54:52.229222+0000","last_became_active":"2024-04-18T04:54:40.800405+0000","last_became_peered":"2024-04-18T04:54:40.800405+0000","last_unstale":"2024-04-18T04:54:52.229222+0000","last_undegraded":"2024-04-18T04:54:52.229222+0000","last_fullsized":"2024-04-18T04:54:52.229222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.454668+0000","last_change":"2024-04-18T04:54:41.192487+0000","last_active":"2024-04-18T04:54:42.454668+0000","last_peered":"2024-04-18T04:54:42.454668+0000","last_clean":"2024-04-18T04:54:42.454668+0000","last_became_active":"2024-04-18T04:54:41.186301+0000","last_became_peered":"2024-04-18T04:54:41.186301+0000","last_unstale":"2024-04-18T04:54:42.454668+0000","last_undegraded":"2024-04-18T04:54:42.454668+0000","last_fullsized":"2024-04-18T04:54:42.454668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.455262+0000","last_change":"2024-04-18T04:54:41.193260+0000","last_active":"2024-04-18T04:54:42.455262+0000","last_peered":"2024-04-18T04:54:42.455262+0000","last_clean":"2024-04-18T04:54:42.455262+0000","last_became_active":"2024-04-18T04:54:41.192941+0000","last_became_peered":"2024-04-18T04:54:41.192941+0000","last_unstale":"2024-04-18T04:54:42.455262+0000","last_undegraded":"2024-04-18T04:54:42.455262+0000","last_fullsized":"2024-04-18T04:54:42.455262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'5","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.697336+0000","last_change":"2024-04-18T04:54:40.800162+0000","last_active":"2024-04-18T04:55:08.697336+0000","last_peered":"2024-04-18T04:55:08.697336+0000","last_clean":"2024-04-18T04:55:08.697336+0000","last_became_active":"2024-04-18T04:54:40.799517+0000","last_became_peered":"2024-04-18T04:54:40.799517+0000","last_unstale":"2024-04-18T04:55:08.697336+0000","last_undegraded":"2024-04-18T04:55:08.697336+0000","last_fullsized":"2024-04-18T04:55:08.697336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.167393+0000","last_change":"2024-04-18T04:54:41.179695+0000","last_active":"2024-04-18T04:54:42.167393+0000","last_peered":"2024-04-18T04:54:42.167393+0000","last_clean":"2024-04-18T04:54:42.167393+0000","last_became_active":"2024-04-18T04:54:41.179359+0000","last_became_peered":"2024-04-18T04:54:41.179359+0000","last_unstale":"2024-04-18T04:54:42.167393+0000","last_undegraded":"2024-04-18T04:54:42.167393+0000","last_fullsized":"2024-04-18T04:54:42.167393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'12","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.697456+0000","last_change":"2024-04-18T04:54:40.801178+0000","last_active":"2024-04-18T04:55:08.697456+0000","last_peered":"2024-04-18T04:55:08.697456+0000","last_clean":"2024-04-18T04:55:08.697456+0000","last_became_active":"2024-04-18T04:54:40.800660+0000","last_became_peered":"2024-04-18T04:54:40.800660+0000","last_unstale":"2024-04-18T04:55:08.697456+0000","last_undegraded":"2024-04-18T04:55:08.697456+0000","last_fullsized":"2024-04-18T04:55:08.697456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170091+0000","last_change":"2024-04-18T04:54:41.190055+0000","last_active":"2024-04-18T04:54:42.170091+0000","last_peered":"2024-04-18T04:54:42.170091+0000","last_clean":"2024-04-18T04:54:42.170091+0000","last_became_active":"2024-04-18T04:54:41.189344+0000","last_became_peered":"2024-04-18T04:54:41.189344+0000","last_unstale":"2024-04-18T04:54:42.170091+0000","last_undegraded":"2024-04-18T04:54:42.170091+0000","last_fullsized":"2024-04-18T04:54:42.170091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.185261+0000","last_change":"2024-04-18T04:54:40.813931+0000","last_active":"2024-04-18T04:54:46.185261+0000","last_peered":"2024-04-18T04:54:46.185261+0000","last_clean":"2024-04-18T04:54:46.185261+0000","last_became_active":"2024-04-18T04:54:40.813290+0000","last_became_peered":"2024-04-18T04:54:40.813290+0000","last_unstale":"2024-04-18T04:54:46.185261+0000","last_undegraded":"2024-04-18T04:54:46.185261+0000","last_fullsized":"2024-04-18T04:54:46.185261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:54:42.170238+0000","last_change":"2024-04-18T04:54:41.192913+0000","last_active":"2024-04-18T04:54:42.170238+0000","last_peered":"2024-04-18T04:54:42.170238+0000","last_clean":"2024-04-18T04:54:42.170238+0000","last_became_active":"2024-04-18T04:54:41.192096+0000","last_became_peered":"2024-04-18T04:54:41.192096+0000","last_unstale":"2024-04-18T04:54:42.170238+0000","last_undegraded":"2024-04-18T04:54:42.170238+0000","last_fullsized":"2024-04-18T04:54:42.170238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:37:53.082409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'13","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T04:55:08.690753+0000","last_change":"2024-04-18T04:54:40.805596+0000","last_active":"2024-04-18T04:55:08.690753+0000","last_peered":"2024-04-18T04:55:08.690753+0000","last_clean":"2024-04-18T04:55:08.690753+0000","last_became_active":"2024-04-18T04:54:40.804913+0000","last_became_peered":"2024-04-18T04:54:40.804913+0000","last_unstale":"2024-04-18T04:55:08.690753+0000","last_undegraded":"2024-04-18T04:55:08.690753+0000","last_fullsized":"2024-04-18T04:55:08.690753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:44.772589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8237,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":16474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":74143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":75325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":664235,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]}]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":75715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":664871,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":75535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":76934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":75164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:55:20.635 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-04-18T04:55:20.636 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:55:20.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.790+0000 7f37eff8b640 1 Processor -- start 2024-04-18T04:55:20.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.790+0000 7f37eff8b640 1 -- start start 2024-04-18T04:55:20.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.790+0000 7f37eff8b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f37e8151080 0x7f37e815ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.790+0000 7f37eff8b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f37e815b070 0x7f37e80c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.790+0000 7f37eff8b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e80c6c20 con 0x7f37e8156ea0 2024-04-18T04:55:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.790+0000 7f37eff8b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e80c41b0 con 0x7f37e815b070 2024-04-18T04:55:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.790+0000 7f37eff8b640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e815a6a0 con 0x7f37e8151080 2024-04-18T04:55:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.790+0000 7f37ee528640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f37e815b070 0x7f37e80c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.790+0000 7f37ee528640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f37e815b070 0x7f37e80c1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56738/0 (socket says 172.21.15.96:56738) 2024-04-18T04:55:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.790+0000 7f37ee528640 1 -- 172.21.15.96:0/4011478957 learned_addr learned my addr 172.21.15.96:0/4011478957 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.790+0000 7f37ed526640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f37e8156ea0 0x7f37e80c5100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40640/0 (socket says 172.21.15.96:40640) 2024-04-18T04:55:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.790+0000 7f37ee528640 1 -- 172.21.15.96:0/4011478957 >> v2:172.21.15.139:3300/0 conn(0x7f37e8151080 msgr2=0x7f37e815ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.790+0000 7f37ee528640 1 --2- 172.21.15.96:0/4011478957 >> v2:172.21.15.139:3300/0 conn(0x7f37e8151080 0x7f37e815ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.790+0000 7f37ee528640 1 -- 172.21.15.96:0/4011478957 >> v1:172.21.15.96:6789/0 conn(0x7f37e8156ea0 legacy=0x7f37e80c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.790+0000 7f37ee528640 1 -- 172.21.15.96:0/4011478957 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e81573e0 con 0x7f37e815b070 2024-04-18T04:55:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.790+0000 7f37ecd25640 1 -- 172.21.15.96:0/4011478957 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284746128 0 0) 0x7f37e80c6c20 con 0x7f37e8156ea0 2024-04-18T04:55:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.794+0000 7f37ee528640 1 --2- 172.21.15.96:0/4011478957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37e815b070 0x7f37e80c1870 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f37e80caeb0 tx=0x7f37e001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bc49ef2c45b65d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.794+0000 7f37ecd25640 1 -- 172.21.15.96:0/4011478957 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e00a57d0 con 0x7f37e815b070 2024-04-18T04:55:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.794+0000 7f37ecd25640 1 -- 172.21.15.96:0/4011478957 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e00a5930 con 0x7f37e815b070 2024-04-18T04:55:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.794+0000 7f37ecd25640 1 -- 172.21.15.96:0/4011478957 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e00a5cc0 con 0x7f37e815b070 2024-04-18T04:55:20.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.794+0000 7f37eff8b640 1 -- 172.21.15.96:0/4011478957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37e815b070 msgr2=0x7f37e80c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.794+0000 7f37eff8b640 1 --2- 172.21.15.96:0/4011478957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37e815b070 0x7f37e80c1870 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f37e80caeb0 tx=0x7f37e001c9f0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.794+0000 7f37eff8b640 1 -- 172.21.15.96:0/4011478957 shutdown_connections 2024-04-18T04:55:20.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.794+0000 7f37eff8b640 1 --2- 172.21.15.96:0/4011478957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37e815b070 0x7f37e80c1870 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.794+0000 7f37eff8b640 1 --2- 172.21.15.96:0/4011478957 >> v2:172.21.15.139:3300/0 conn(0x7f37e8151080 0x7f37e815ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.794+0000 7f37eff8b640 1 -- 172.21.15.96:0/4011478957 >> 172.21.15.96:0/4011478957 conn(0x7f37e806c750 msgr2=0x7f37e80c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:20.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.794+0000 7f37eff8b640 1 -- 172.21.15.96:0/4011478957 shutdown_connections 2024-04-18T04:55:20.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.794+0000 7f37eff8b640 1 -- 172.21.15.96:0/4011478957 wait complete. 2024-04-18T04:55:20.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.794+0000 7f37eff8b640 1 Processor -- start 2024-04-18T04:55:20.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.794+0000 7f37eff8b640 1 -- start start 2024-04-18T04:55:20.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37eff8b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37e8151080 0x7f37e8161260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37eff8b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f37e8156ea0 0x7f37e8154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37eff8b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37e815b070 0x7f37e8151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37eff8b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e8154eb0 con 0x7f37e8151080 2024-04-18T04:55:20.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37eff8b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e8154350 con 0x7f37e815b070 2024-04-18T04:55:20.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37eff8b640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e81ef500 con 0x7f37e8156ea0 2024-04-18T04:55:20.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37edd27640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37e8151080 0x7f37e8161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37edd27640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37e8151080 0x7f37e8161260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56750/0 (socket says 172.21.15.96:56750) 2024-04-18T04:55:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37edd27640 1 -- 172.21.15.96:0/1107596647 learned_addr learned my addr 172.21.15.96:0/1107596647 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37ed526640 1 --2- 172.21.15.96:0/1107596647 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f37e8156ea0 0x7f37e8154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37edd27640 1 -- 172.21.15.96:0/1107596647 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f37e8156ea0 msgr2=0x7f37e8154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37edd27640 1 --2- 172.21.15.96:0/1107596647 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f37e8156ea0 0x7f37e8154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37edd27640 1 -- 172.21.15.96:0/1107596647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37e815b070 msgr2=0x7f37e8151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37ee528640 1 --2- 172.21.15.96:0/1107596647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37e815b070 0x7f37e8151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37edd27640 1 --2- 172.21.15.96:0/1107596647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37e815b070 0x7f37e8151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37edd27640 1 -- 172.21.15.96:0/1107596647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e0009b30 con 0x7f37e8151080 2024-04-18T04:55:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37edd27640 1 --2- 172.21.15.96:0/1107596647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37e8151080 0x7f37e8161260 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f37e400b550 tx=0x7f37e400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37de7fc640 1 -- 172.21.15.96:0/1107596647 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4010870 con 0x7f37e8151080 2024-04-18T04:55:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37de7fc640 1 -- 172.21.15.96:0/1107596647 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e40109f0 con 0x7f37e8151080 2024-04-18T04:55:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37eff8b640 1 -- 172.21.15.96:0/1107596647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e8143450 con 0x7f37e8151080 2024-04-18T04:55:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37de7fc640 1 -- 172.21.15.96:0/1107596647 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4010da0 con 0x7f37e8151080 2024-04-18T04:55:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37eff8b640 1 -- 172.21.15.96:0/1107596647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e80c6660 con 0x7f37e8151080 2024-04-18T04:55:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37eff8b640 1 -- 172.21.15.96:0/1107596647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e8067050 con 0x7f37e8151080 2024-04-18T04:55:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37de7fc640 1 -- 172.21.15.96:0/1107596647 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f37e400f3c0 con 0x7f37e8151080 2024-04-18T04:55:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37de7fc640 1 --2- 172.21.15.96:0/1107596647 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f37cc066690 0x7f37cc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37de7fc640 1 -- 172.21.15.96:0/1107596647 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37e40842c0 con 0x7f37e8151080 2024-04-18T04:55:20.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.798+0000 7f37ed526640 1 --2- 172.21.15.96:0/1107596647 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f37cc066690 0x7f37cc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:20.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.802+0000 7f37ed526640 1 --2- 172.21.15.96:0/1107596647 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f37cc066690 0x7f37cc068b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f37e8150aa0 tx=0x7f37d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:20.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.802+0000 7f37de7fc640 1 -- 172.21.15.96:0/1107596647 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f37e40515a0 con 0x7f37e8151080 2024-04-18T04:55:20.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.958+0000 7f37eff8b640 1 -- 172.21.15.96:0/1107596647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37e81ef670 con 0x7f37e8151080 2024-04-18T04:55:20.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.962+0000 7f37de7fc640 1 -- 172.21.15.96:0/1107596647 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f37e4054bc0 con 0x7f37e8151080 2024-04-18T04:55:20.961 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:55:20.961 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":21,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:54:42.161552+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:54:39.219441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:54:40.139557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.720340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.767224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.811511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.710188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.860525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.704784+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:55:20.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.966+0000 7f37eff8b640 1 -- 172.21.15.96:0/1107596647 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f37cc066690 msgr2=0x7f37cc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.966+0000 7f37eff8b640 1 --2- 172.21.15.96:0/1107596647 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f37cc066690 0x7f37cc068b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f37e8150aa0 tx=0x7f37d8009040 comp rx=0 tx=0).stop 2024-04-18T04:55:20.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.966+0000 7f37eff8b640 1 -- 172.21.15.96:0/1107596647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37e8151080 msgr2=0x7f37e8161260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:20.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.966+0000 7f37eff8b640 1 --2- 172.21.15.96:0/1107596647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37e8151080 0x7f37e8161260 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f37e400b550 tx=0x7f37e400ba10 comp rx=0 tx=0).stop 2024-04-18T04:55:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.966+0000 7f37eff8b640 1 -- 172.21.15.96:0/1107596647 shutdown_connections 2024-04-18T04:55:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.966+0000 7f37eff8b640 1 --2- 172.21.15.96:0/1107596647 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f37cc066690 0x7f37cc068b50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.966+0000 7f37eff8b640 1 --2- 172.21.15.96:0/1107596647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37e815b070 0x7f37e8151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.966+0000 7f37eff8b640 1 --2- 172.21.15.96:0/1107596647 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f37e8156ea0 0x7f37e8154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.966+0000 7f37eff8b640 1 --2- 172.21.15.96:0/1107596647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37e8151080 0x7f37e8161260 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.966+0000 7f37eff8b640 1 -- 172.21.15.96:0/1107596647 >> 172.21.15.96:0/1107596647 conn(0x7f37e806c750 msgr2=0x7f37e8140730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.966+0000 7f37eff8b640 1 -- 172.21.15.96:0/1107596647 shutdown_connections 2024-04-18T04:55:20.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:20.966+0000 7f37eff8b640 1 -- 172.21.15.96:0/1107596647 wait complete. 2024-04-18T04:55:20.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:54:32.641813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T04:54:39.219441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T04:54:40.139557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T04:55:20.981 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T04:55:21.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.102+0000 7fecaefdb640 1 Processor -- start 2024-04-18T04:55:21.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.102+0000 7fecaefdb640 1 -- start start 2024-04-18T04:55:21.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecaefdb640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7feca80c4ca0 0x7feca80caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecaefdb640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7feca80c98f0 0x7feca80cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecaefdb640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca80b0850 con 0x7feca8151180 2024-04-18T04:55:21.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecaefdb640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca80c5bc0 con 0x7feca80c98f0 2024-04-18T04:55:21.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecaefdb640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca80c41f0 con 0x7feca80c4ca0 2024-04-18T04:55:21.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecad578640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7feca80c98f0 0x7feca80cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecad578640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7feca80c98f0 0x7feca80cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56754/0 (socket says 172.21.15.96:56754) 2024-04-18T04:55:21.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecad578640 1 -- 172.21.15.96:0/135178441 learned_addr learned my addr 172.21.15.96:0/135178441 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:21.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7feca7fff640 1 --2- 172.21.15.96:0/135178441 >> v2:172.21.15.139:3300/0 conn(0x7feca80c4ca0 0x7feca80caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecad578640 1 -- 172.21.15.96:0/135178441 >> v2:172.21.15.139:3300/0 conn(0x7feca80c4ca0 msgr2=0x7feca80caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:21.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecad578640 1 --2- 172.21.15.96:0/135178441 >> v2:172.21.15.139:3300/0 conn(0x7feca80c4ca0 0x7feca80caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecad578640 1 -- 172.21.15.96:0/135178441 >> v1:172.21.15.139:6789/0 conn(0x7feca8151180 legacy=0x7feca80c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:21.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecad578640 1 -- 172.21.15.96:0/135178441 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca80c5900 con 0x7feca80c98f0 2024-04-18T04:55:21.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecad578640 1 --2- 172.21.15.96:0/135178441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feca80c98f0 0x7feca80cb440 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7feca815b2c0 tx=0x7feca001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e744bc5d065a0b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:21.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7feca77fe640 1 -- 172.21.15.96:0/135178441 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00a56d0 con 0x7feca80c98f0 2024-04-18T04:55:21.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7feca77fe640 1 -- 172.21.15.96:0/135178441 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca00a5830 con 0x7feca80c98f0 2024-04-18T04:55:21.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7feca77fe640 1 -- 172.21.15.96:0/135178441 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00a5bc0 con 0x7feca80c98f0 2024-04-18T04:55:21.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecaefdb640 1 -- 172.21.15.96:0/135178441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feca80c98f0 msgr2=0x7feca80cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecaefdb640 1 --2- 172.21.15.96:0/135178441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feca80c98f0 0x7feca80cb440 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7feca815b2c0 tx=0x7feca001c920 comp rx=0 tx=0).stop 2024-04-18T04:55:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecaefdb640 1 -- 172.21.15.96:0/135178441 shutdown_connections 2024-04-18T04:55:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecaefdb640 1 --2- 172.21.15.96:0/135178441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feca80c98f0 0x7feca80cb440 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecaefdb640 1 --2- 172.21.15.96:0/135178441 >> v2:172.21.15.139:3300/0 conn(0x7feca80c4ca0 0x7feca80caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecaefdb640 1 -- 172.21.15.96:0/135178441 >> 172.21.15.96:0/135178441 conn(0x7feca806e660 msgr2=0x7feca806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecaefdb640 1 -- 172.21.15.96:0/135178441 shutdown_connections 2024-04-18T04:55:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.106+0000 7fecaefdb640 1 -- 172.21.15.96:0/135178441 wait complete. 2024-04-18T04:55:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecaefdb640 1 Processor -- start 2024-04-18T04:55:21.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecaefdb640 1 -- start start 2024-04-18T04:55:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecaefdb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feca80c4ca0 0x7feca80c1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecaefdb640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feca80c98f0 0x7feca813bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecaefdb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feca8151180 0x7feca813f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecaefdb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca80c1420 con 0x7feca80c4ca0 2024-04-18T04:55:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecaefdb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca81421e0 con 0x7feca8151180 2024-04-18T04:55:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecaefdb640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca814abd0 con 0x7feca80c98f0 2024-04-18T04:55:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecacd77640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feca80c4ca0 0x7feca80c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecacd77640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feca80c4ca0 0x7feca80c1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56766/0 (socket says 172.21.15.96:56766) 2024-04-18T04:55:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecacd77640 1 -- 172.21.15.96:0/2384807625 learned_addr learned my addr 172.21.15.96:0/2384807625 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecad578640 1 --2- 172.21.15.96:0/2384807625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feca8151180 0x7feca813f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7feca7fff640 1 --2- 172.21.15.96:0/2384807625 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feca80c98f0 0x7feca813bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecacd77640 1 -- 172.21.15.96:0/2384807625 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feca80c98f0 msgr2=0x7feca813bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecacd77640 1 --2- 172.21.15.96:0/2384807625 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feca80c98f0 0x7feca813bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecacd77640 1 -- 172.21.15.96:0/2384807625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feca8151180 msgr2=0x7feca813f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecacd77640 1 --2- 172.21.15.96:0/2384807625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feca8151180 0x7feca813f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecacd77640 1 -- 172.21.15.96:0/2384807625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca0009b30 con 0x7feca80c4ca0 2024-04-18T04:55:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7feca7fff640 1 --2- 172.21.15.96:0/2384807625 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feca80c98f0 0x7feca813bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:55:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecacd77640 1 --2- 172.21.15.96:0/2384807625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feca80c4ca0 0x7feca80c1840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00c4c0 tx=0x7fec9c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7feca57fa640 1 -- 172.21.15.96:0/2384807625 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c005480 con 0x7feca80c4ca0 2024-04-18T04:55:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7feca57fa640 1 -- 172.21.15.96:0/2384807625 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c003600 con 0x7feca80c4ca0 2024-04-18T04:55:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecaefdb640 1 -- 172.21.15.96:0/2384807625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca814a930 con 0x7feca80c4ca0 2024-04-18T04:55:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7feca57fa640 1 -- 172.21.15.96:0/2384807625 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c003990 con 0x7feca80c4ca0 2024-04-18T04:55:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecaefdb640 1 -- 172.21.15.96:0/2384807625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca8141c20 con 0x7feca80c4ca0 2024-04-18T04:55:21.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.110+0000 7fecaefdb640 1 -- 172.21.15.96:0/2384807625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca80c1690 con 0x7feca80c4ca0 2024-04-18T04:55:21.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.114+0000 7feca57fa640 1 -- 172.21.15.96:0/2384807625 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fec9c003af0 con 0x7feca80c4ca0 2024-04-18T04:55:21.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.114+0000 7feca57fa640 1 --2- 172.21.15.96:0/2384807625 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fec8c0666c0 0x7fec8c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.114+0000 7feca57fa640 1 -- 172.21.15.96:0/2384807625 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec9c0836b0 con 0x7feca80c4ca0 2024-04-18T04:55:21.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.114+0000 7feca7fff640 1 --2- 172.21.15.96:0/2384807625 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fec8c0666c0 0x7fec8c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.114+0000 7feca7fff640 1 --2- 172.21.15.96:0/2384807625 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fec8c0666c0 0x7fec8c068b80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feca8142720 tx=0x7fec94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:21.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.118+0000 7feca57fa640 1 -- 172.21.15.96:0/2384807625 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fec9c050ad0 con 0x7feca80c4ca0 2024-04-18T04:55:21.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.270+0000 7fecaefdb640 1 -- 172.21.15.96:0/2384807625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feca8067050 con 0x7feca80c4ca0 2024-04-18T04:55:21.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.270+0000 7feca57fa640 1 -- 172.21.15.96:0/2384807625 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec9c0540f0 con 0x7feca80c4ca0 2024-04-18T04:55:21.271 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-18T04:55:21.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.274+0000 7fecaefdb640 1 -- 172.21.15.96:0/2384807625 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fec8c0666c0 msgr2=0x7fec8c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.274+0000 7fecaefdb640 1 --2- 172.21.15.96:0/2384807625 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fec8c0666c0 0x7fec8c068b80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feca8142720 tx=0x7fec94008040 comp rx=0 tx=0).stop 2024-04-18T04:55:21.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.274+0000 7fecaefdb640 1 -- 172.21.15.96:0/2384807625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feca80c4ca0 msgr2=0x7feca80c1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.274+0000 7fecaefdb640 1 --2- 172.21.15.96:0/2384807625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feca80c4ca0 0x7feca80c1840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00c4c0 tx=0x7fec9c001e80 comp rx=0 tx=0).stop 2024-04-18T04:55:21.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.274+0000 7fecaefdb640 1 -- 172.21.15.96:0/2384807625 shutdown_connections 2024-04-18T04:55:21.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.274+0000 7fecaefdb640 1 --2- 172.21.15.96:0/2384807625 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fec8c0666c0 0x7fec8c068b80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.274+0000 7fecaefdb640 1 --2- 172.21.15.96:0/2384807625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feca8151180 0x7feca813f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.274+0000 7fecaefdb640 1 --2- 172.21.15.96:0/2384807625 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feca80c98f0 0x7feca813bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.274+0000 7fecaefdb640 1 --2- 172.21.15.96:0/2384807625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feca80c4ca0 0x7feca80c1840 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.274+0000 7fecaefdb640 1 -- 172.21.15.96:0/2384807625 >> 172.21.15.96:0/2384807625 conn(0x7feca806e660 msgr2=0x7feca80c8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.274+0000 7fecaefdb640 1 -- 172.21.15.96:0/2384807625 shutdown_connections 2024-04-18T04:55:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.274+0000 7fecaefdb640 1 -- 172.21.15.96:0/2384807625 wait complete. 2024-04-18T04:55:21.288 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T04:55:21.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.398+0000 7faa3cc9f640 1 Processor -- start 2024-04-18T04:55:21.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.398+0000 7faa3cc9f640 1 -- start start 2024-04-18T04:55:21.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3cc9f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7faa3814fc60 0x7faa3806d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3cc9f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380c8100 con 0x7faa3806dd50 2024-04-18T04:55:21.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3cc9f640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380c5660 con 0x7faa38156410 2024-04-18T04:55:21.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3cc9f640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380c8350 con 0x7faa3814fc60 2024-04-18T04:55:21.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa35d9b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7faa3806dd50 0x7faa38155d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40648/0 (socket says 172.21.15.96:40648) 2024-04-18T04:55:21.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa35d9b640 1 -- 172.21.15.96:0/3495584985 learned_addr learned my addr 172.21.15.96:0/3495584985 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:21.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3659c640 1 --2- 172.21.15.96:0/3495584985 >> v2:172.21.15.139:3300/0 conn(0x7faa3814fc60 0x7faa3806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3559a640 1 -- 172.21.15.96:0/3495584985 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434401604 0 0) 0x7faa380c8100 con 0x7faa3806dd50 2024-04-18T04:55:21.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3559a640 1 -- 172.21.15.96:0/3495584985 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa20005740 con 0x7faa3806dd50 2024-04-18T04:55:21.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3559a640 1 -- 172.21.15.96:0/3495584985 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1690404407 0 0) 0x7faa20005740 con 0x7faa3806dd50 2024-04-18T04:55:21.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3559a640 1 -- 172.21.15.96:0/3495584985 >> v2:172.21.15.139:3300/0 conn(0x7faa3814fc60 msgr2=0x7faa3806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:21.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3559a640 1 --2- 172.21.15.96:0/3495584985 >> v2:172.21.15.139:3300/0 conn(0x7faa3814fc60 0x7faa3806d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3559a640 1 -- 172.21.15.96:0/3495584985 >> v1:172.21.15.139:6789/0 conn(0x7faa38156410 legacy=0x7faa380c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3559a640 1 -- 172.21.15.96:0/3495584985 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa380c8630 con 0x7faa3806dd50 2024-04-18T04:55:21.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3559a640 1 -- 172.21.15.96:0/3495584985 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7faa2c001680 con 0x7faa3806dd50 2024-04-18T04:55:21.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3559a640 1 -- 172.21.15.96:0/3495584985 >> v1:172.21.15.96:6789/0 conn(0x7faa3806dd50 legacy=0x7faa38155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3559a640 1 --2- 172.21.15.96:0/3495584985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa20005b90 0x7faa20005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3559a640 1 --2- 172.21.15.96:0/3495584985 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa200069e0 0x7faa20006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3559a640 1 --2- 172.21.15.96:0/3495584985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa200073a0 0x7faa2000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3559a640 1 -- 172.21.15.96:0/3495584985 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa380c8350 con 0x7faa20005b90 2024-04-18T04:55:21.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3559a640 1 -- 172.21.15.96:0/3495584985 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2000e340 con 0x7faa200073a0 2024-04-18T04:55:21.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3559a640 1 -- 172.21.15.96:0/3495584985 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2000e500 con 0x7faa200069e0 2024-04-18T04:55:21.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3659c640 1 --2- 172.21.15.96:0/3495584985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa20005b90 0x7faa20005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3659c640 1 -- 172.21.15.96:0/3495584985 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa200069e0 msgr2=0x7faa20006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:21.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3659c640 1 --2- 172.21.15.96:0/3495584985 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa200069e0 0x7faa20006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3659c640 1 -- 172.21.15.96:0/3495584985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa200073a0 msgr2=0x7faa2000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:21.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3659c640 1 --2- 172.21.15.96:0/3495584985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa200073a0 0x7faa2000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3659c640 1 -- 172.21.15.96:0/3495584985 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa20005740 con 0x7faa20005b90 2024-04-18T04:55:21.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa36d9d640 1 -- 172.21.15.96:0/3495584985 reap_dead start 2024-04-18T04:55:21.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.402+0000 7faa3659c640 1 --2- 172.21.15.96:0/3495584985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa20005b90 0x7faa20005fb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faa28009ae0 tx=0x7faa2801ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb091914187a3f01 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:21.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3559a640 1 -- 172.21.15.96:0/3495584985 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa280a5560 con 0x7faa20005b90 2024-04-18T04:55:21.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3559a640 1 -- 172.21.15.96:0/3495584985 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa280a56c0 con 0x7faa20005b90 2024-04-18T04:55:21.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3559a640 1 -- 172.21.15.96:0/3495584985 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa280a5a70 con 0x7faa20005b90 2024-04-18T04:55:21.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 -- 172.21.15.96:0/3495584985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa20005b90 msgr2=0x7faa20005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 --2- 172.21.15.96:0/3495584985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa20005b90 0x7faa20005fb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faa28009ae0 tx=0x7faa2801ca80 comp rx=0 tx=0).stop 2024-04-18T04:55:21.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 -- 172.21.15.96:0/3495584985 shutdown_connections 2024-04-18T04:55:21.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 --2- 172.21.15.96:0/3495584985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa20005b90 0x7faa20005fb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 -- 172.21.15.96:0/3495584985 >> 172.21.15.96:0/3495584985 conn(0x7faa3806c610 msgr2=0x7faa380ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:21.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 -- 172.21.15.96:0/3495584985 shutdown_connections 2024-04-18T04:55:21.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 -- 172.21.15.96:0/3495584985 wait complete. 2024-04-18T04:55:21.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 Processor -- start 2024-04-18T04:55:21.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 -- start start 2024-04-18T04:55:21.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa20005b90 0x7faa3814cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa38157140 0x7faa38157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa38141a40 0x7faa38141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3814a2b0 con 0x7faa38157140 2024-04-18T04:55:21.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa38156c90 con 0x7faa20005b90 2024-04-18T04:55:21.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa38144970 con 0x7faa38141a40 2024-04-18T04:55:21.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa35d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa38157140 0x7faa38157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa35d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa38157140 0x7faa38157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56774/0 (socket says 172.21.15.96:56774) 2024-04-18T04:55:21.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa35d9b640 1 -- 172.21.15.96:0/1206473798 learned_addr learned my addr 172.21.15.96:0/1206473798 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:21.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3659c640 1 --2- 172.21.15.96:0/1206473798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa20005b90 0x7faa3814cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa36d9d640 1 --2- 172.21.15.96:0/1206473798 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa38141a40 0x7faa38141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa35d9b640 1 -- 172.21.15.96:0/1206473798 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa38141a40 msgr2=0x7faa38141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa35d9b640 1 --2- 172.21.15.96:0/1206473798 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa38141a40 0x7faa38141ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa35d9b640 1 -- 172.21.15.96:0/1206473798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa20005b90 msgr2=0x7faa3814cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa35d9b640 1 --2- 172.21.15.96:0/1206473798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa20005b90 0x7faa3814cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa35d9b640 1 -- 172.21.15.96:0/1206473798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38144c10 con 0x7faa38157140 2024-04-18T04:55:21.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa35d9b640 1 --2- 172.21.15.96:0/1206473798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa38157140 0x7faa38157540 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faa2c00c820 tx=0x7faa2c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:21.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa26ffd640 1 -- 172.21.15.96:0/1206473798 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c0074e0 con 0x7faa38157140 2024-04-18T04:55:21.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa26ffd640 1 -- 172.21.15.96:0/1206473798 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c007660 con 0x7faa38157140 2024-04-18T04:55:21.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 -- 172.21.15.96:0/1206473798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa38159690 con 0x7faa38157140 2024-04-18T04:55:21.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa26ffd640 1 -- 172.21.15.96:0/1206473798 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c004a30 con 0x7faa38157140 2024-04-18T04:55:21.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.406+0000 7faa3cc9f640 1 -- 172.21.15.96:0/1206473798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa38157a80 con 0x7faa38157140 2024-04-18T04:55:21.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.410+0000 7faa3cc9f640 1 -- 172.21.15.96:0/1206473798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa38067050 con 0x7faa38157140 2024-04-18T04:55:21.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.410+0000 7faa26ffd640 1 -- 172.21.15.96:0/1206473798 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faa2c004b90 con 0x7faa38157140 2024-04-18T04:55:21.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.410+0000 7faa26ffd640 1 --2- 172.21.15.96:0/1206473798 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa180666c0 0x7faa18068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.410+0000 7faa3659c640 1 --2- 172.21.15.96:0/1206473798 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa180666c0 0x7faa18068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.410+0000 7faa26ffd640 1 -- 172.21.15.96:0/1206473798 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa2c083700 con 0x7faa38157140 2024-04-18T04:55:21.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.410+0000 7faa3659c640 1 --2- 172.21.15.96:0/1206473798 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa180666c0 0x7faa18068b80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faa280af000 tx=0x7faa28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:21.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.414+0000 7faa26ffd640 1 -- 172.21.15.96:0/1206473798 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7faa2c050a70 con 0x7faa38157140 2024-04-18T04:55:21.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.558+0000 7faa3cc9f640 1 -- 172.21.15.96:0/1206473798 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa38072230 con 0x7faa38157140 2024-04-18T04:55:21.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.558+0000 7faa26ffd640 1 -- 172.21.15.96:0/1206473798 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa2c0180a0 con 0x7faa38157140 2024-04-18T04:55:21.559 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-18T04:55:21.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.562+0000 7faa3cc9f640 1 -- 172.21.15.96:0/1206473798 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa180666c0 msgr2=0x7faa18068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.562+0000 7faa3cc9f640 1 --2- 172.21.15.96:0/1206473798 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa180666c0 0x7faa18068b80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faa280af000 tx=0x7faa28008040 comp rx=0 tx=0).stop 2024-04-18T04:55:21.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.562+0000 7faa3cc9f640 1 -- 172.21.15.96:0/1206473798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa38157140 msgr2=0x7faa38157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.562+0000 7faa3cc9f640 1 --2- 172.21.15.96:0/1206473798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa38157140 0x7faa38157540 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faa2c00c820 tx=0x7faa2c00cce0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.562+0000 7faa3cc9f640 1 -- 172.21.15.96:0/1206473798 shutdown_connections 2024-04-18T04:55:21.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.562+0000 7faa3cc9f640 1 --2- 172.21.15.96:0/1206473798 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa180666c0 0x7faa18068b80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.562+0000 7faa3cc9f640 1 --2- 172.21.15.96:0/1206473798 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa38141a40 0x7faa38141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.562+0000 7faa3cc9f640 1 --2- 172.21.15.96:0/1206473798 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa38157140 0x7faa38157540 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.562+0000 7faa3cc9f640 1 --2- 172.21.15.96:0/1206473798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa20005b90 0x7faa3814cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.562+0000 7faa3cc9f640 1 -- 172.21.15.96:0/1206473798 >> 172.21.15.96:0/1206473798 conn(0x7faa3806c610 msgr2=0x7faa380c91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:21.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.562+0000 7faa3cc9f640 1 -- 172.21.15.96:0/1206473798 shutdown_connections 2024-04-18T04:55:21.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.562+0000 7faa3cc9f640 1 -- 172.21.15.96:0/1206473798 wait complete. 2024-04-18T04:55:21.575 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T04:55:21.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.694+0000 7f11d54e9640 1 Processor -- start 2024-04-18T04:55:21.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.694+0000 7f11d54e9640 1 -- start start 2024-04-18T04:55:21.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11d54e9640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f11d01532d0 0x7f11d0158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11d54e9640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f11d00cacc0 0x7f11d015ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11d54e9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d015d3b0 con 0x7f11d00c3fd0 2024-04-18T04:55:21.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11d54e9640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d00c5970 con 0x7f11d01532d0 2024-04-18T04:55:21.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11d54e9640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d01594a0 con 0x7f11d00cacc0 2024-04-18T04:55:21.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11cf7fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f11d00c3fd0 0x7f11d00ce740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40658/0 (socket says 172.21.15.96:40658) 2024-04-18T04:55:21.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11cf7fe640 1 -- 172.21.15.96:0/2237515682 learned_addr learned my addr 172.21.15.96:0/2237515682 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:21.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11ceffd640 1 --2- 172.21.15.96:0/2237515682 >> v2:172.21.15.96:3300/0 conn(0x7f11d01532d0 0x7f11d0158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11ce7fc640 1 -- 172.21.15.96:0/2237515682 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519518465 0 0) 0x7f11d015d3b0 con 0x7f11d00c3fd0 2024-04-18T04:55:21.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11c67fc640 1 --2- 172.21.15.96:0/2237515682 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f11d00cacc0 0x7f11d015ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11ce7fc640 1 -- 172.21.15.96:0/2237515682 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11bc003530 con 0x7f11d00c3fd0 2024-04-18T04:55:21.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11ceffd640 1 -- 172.21.15.96:0/2237515682 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f11d00cacc0 msgr2=0x7f11d015ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:21.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11ceffd640 1 --2- 172.21.15.96:0/2237515682 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f11d00cacc0 0x7f11d015ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11ceffd640 1 -- 172.21.15.96:0/2237515682 >> v1:172.21.15.96:6789/0 conn(0x7f11d00c3fd0 legacy=0x7f11d00ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11ceffd640 1 -- 172.21.15.96:0/2237515682 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d01536b0 con 0x7f11d01532d0 2024-04-18T04:55:21.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11ceffd640 1 --2- 172.21.15.96:0/2237515682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11d01532d0 0x7f11d0158f60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f11c00097f0 tx=0x7f11c001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfa9b0f1dcb26f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:21.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11ce7fc640 1 -- 172.21.15.96:0/2237515682 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c00a8990 con 0x7f11d01532d0 2024-04-18T04:55:21.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11ce7fc640 1 -- 172.21.15.96:0/2237515682 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c00a8af0 con 0x7f11d01532d0 2024-04-18T04:55:21.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11ce7fc640 1 -- 172.21.15.96:0/2237515682 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c00a8e80 con 0x7f11d01532d0 2024-04-18T04:55:21.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11d54e9640 1 -- 172.21.15.96:0/2237515682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11d01532d0 msgr2=0x7f11d0158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11d54e9640 1 --2- 172.21.15.96:0/2237515682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11d01532d0 0x7f11d0158f60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f11c00097f0 tx=0x7f11c001ec90 comp rx=0 tx=0).stop 2024-04-18T04:55:21.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11d54e9640 1 -- 172.21.15.96:0/2237515682 shutdown_connections 2024-04-18T04:55:21.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11d54e9640 1 --2- 172.21.15.96:0/2237515682 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f11d00cacc0 0x7f11d015ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11d54e9640 1 --2- 172.21.15.96:0/2237515682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11d01532d0 0x7f11d0158f60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11d54e9640 1 -- 172.21.15.96:0/2237515682 >> 172.21.15.96:0/2237515682 conn(0x7f11d0071760 msgr2=0x7f11d006b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:21.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11d54e9640 1 -- 172.21.15.96:0/2237515682 shutdown_connections 2024-04-18T04:55:21.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.698+0000 7f11d54e9640 1 -- 172.21.15.96:0/2237515682 wait complete. 2024-04-18T04:55:21.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11d54e9640 1 Processor -- start 2024-04-18T04:55:21.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11d54e9640 1 -- start start 2024-04-18T04:55:21.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11d54e9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11d00c3fd0 0x7f11d0151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11d54e9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11d00cacc0 0x7f11d0153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11d54e9640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f11d01532d0 0x7f11d0154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11d54e9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d0159f20 con 0x7f11d00cacc0 2024-04-18T04:55:21.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11d54e9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d0158c00 con 0x7f11d00c3fd0 2024-04-18T04:55:21.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11d54e9640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d0158080 con 0x7f11d01532d0 2024-04-18T04:55:21.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11c67fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11d00cacc0 0x7f11d0153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11c67fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11d00cacc0 0x7f11d0153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56806/0 (socket says 172.21.15.96:56806) 2024-04-18T04:55:21.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11c67fc640 1 -- 172.21.15.96:0/1030727040 learned_addr learned my addr 172.21.15.96:0/1030727040 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:21.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11cf7fe640 1 --2- 172.21.15.96:0/1030727040 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f11d01532d0 0x7f11d0154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11c67fc640 1 -- 172.21.15.96:0/1030727040 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f11d01532d0 msgr2=0x7f11d0154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11c67fc640 1 --2- 172.21.15.96:0/1030727040 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f11d01532d0 0x7f11d0154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11c67fc640 1 -- 172.21.15.96:0/1030727040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11d00c3fd0 msgr2=0x7f11d0151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11c67fc640 1 --2- 172.21.15.96:0/1030727040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11d00c3fd0 0x7f11d0151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11c67fc640 1 -- 172.21.15.96:0/1030727040 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c0009420 con 0x7f11d00cacc0 2024-04-18T04:55:21.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11c67fc640 1 --2- 172.21.15.96:0/1030727040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11d00cacc0 0x7f11d0153de0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f11b800d7d0 tx=0x7f11b800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:21.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11c7fff640 1 -- 172.21.15.96:0/1030727040 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b800b6c0 con 0x7f11d00cacc0 2024-04-18T04:55:21.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11c7fff640 1 -- 172.21.15.96:0/1030727040 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b800b820 con 0x7f11d00cacc0 2024-04-18T04:55:21.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11d54e9640 1 -- 172.21.15.96:0/1030727040 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d0158360 con 0x7f11d00cacc0 2024-04-18T04:55:21.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11c7fff640 1 -- 172.21.15.96:0/1030727040 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b800bbd0 con 0x7f11d00cacc0 2024-04-18T04:55:21.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11d54e9640 1 -- 172.21.15.96:0/1030727040 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d0158920 con 0x7f11d00cacc0 2024-04-18T04:55:21.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11d54e9640 1 -- 172.21.15.96:0/1030727040 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d0067050 con 0x7f11d00cacc0 2024-04-18T04:55:21.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.702+0000 7f11c7fff640 1 -- 172.21.15.96:0/1030727040 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f11b800bd30 con 0x7f11d00cacc0 2024-04-18T04:55:21.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.706+0000 7f11c7fff640 1 --2- 172.21.15.96:0/1030727040 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f11b0066690 0x7f11b0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:21.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.706+0000 7f11c7fff640 1 -- 172.21.15.96:0/1030727040 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11b8084730 con 0x7f11d00cacc0 2024-04-18T04:55:21.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.706+0000 7f11ceffd640 1 --2- 172.21.15.96:0/1030727040 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f11b0066690 0x7f11b0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:21.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.706+0000 7f11ceffd640 1 --2- 172.21.15.96:0/1030727040 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f11b0066690 0x7f11b0068b50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f11c00b2000 tx=0x7f11c0004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:21.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.710+0000 7f11c7fff640 1 -- 172.21.15.96:0/1030727040 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f11b8051aa0 con 0x7f11d00cacc0 2024-04-18T04:55:21.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.854+0000 7f11d54e9640 1 -- 172.21.15.96:0/1030727040 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11d014d360 con 0x7f11d00cacc0 2024-04-18T04:55:21.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.854+0000 7f11c7fff640 1 -- 172.21.15.96:0/1030727040 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f11b80550c0 con 0x7f11d00cacc0 2024-04-18T04:55:21.854 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-18T04:55:21.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.858+0000 7f11d54e9640 1 -- 172.21.15.96:0/1030727040 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f11b0066690 msgr2=0x7f11b0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.858+0000 7f11d54e9640 1 --2- 172.21.15.96:0/1030727040 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f11b0066690 0x7f11b0068b50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f11c00b2000 tx=0x7f11c0004740 comp rx=0 tx=0).stop 2024-04-18T04:55:21.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.858+0000 7f11d54e9640 1 -- 172.21.15.96:0/1030727040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11d00cacc0 msgr2=0x7f11d0153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:21.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.858+0000 7f11d54e9640 1 --2- 172.21.15.96:0/1030727040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11d00cacc0 0x7f11d0153de0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f11b800d7d0 tx=0x7f11b800dc90 comp rx=0 tx=0).stop 2024-04-18T04:55:21.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.858+0000 7f11d54e9640 1 -- 172.21.15.96:0/1030727040 shutdown_connections 2024-04-18T04:55:21.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.858+0000 7f11d54e9640 1 --2- 172.21.15.96:0/1030727040 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f11b0066690 0x7f11b0068b50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.858+0000 7f11d54e9640 1 --2- 172.21.15.96:0/1030727040 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f11d01532d0 0x7f11d0154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.858+0000 7f11d54e9640 1 --2- 172.21.15.96:0/1030727040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11d00cacc0 0x7f11d0153de0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.858+0000 7f11d54e9640 1 --2- 172.21.15.96:0/1030727040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11d00c3fd0 0x7f11d0151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:21.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.858+0000 7f11d54e9640 1 -- 172.21.15.96:0/1030727040 >> 172.21.15.96:0/1030727040 conn(0x7f11d0071760 msgr2=0x7f11d0065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:21.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.858+0000 7f11d54e9640 1 -- 172.21.15.96:0/1030727040 shutdown_connections 2024-04-18T04:55:21.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:21.858+0000 7f11d54e9640 1 -- 172.21.15.96:0/1030727040 wait complete. 2024-04-18T04:55:21.871 DEBUG:tasks.mon_thrash:Yielding 2024-04-18T04:55:21.871 INFO:teuthology.run_tasks:Running task workunit... 2024-04-18T04:55:21.885 INFO:tasks.workunit:Pulling workunits from ref 646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-18T04:55:21.885 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-18T04:55:21.885 INFO:tasks.workunit:timeout=6h 2024-04-18T04:55:21.886 INFO:tasks.workunit:cleanup=True 2024-04-18T04:55:21.886 DEBUG:teuthology.orchestra.run.smithi096:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-18T04:55:21.886 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:55:21.892 INFO:teuthology.orchestra.run.smithi096.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-18T04:55:21.893 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-18T04:55:21.893 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-04-18T04:55:21.893 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:55:21.893 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-18T04:55:21.893 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-18 04:54:46.165333971 +0000 2024-04-18T04:55:21.893 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-18 04:55:18.684312259 +0000 2024-04-18T04:55:21.893 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-04-18T04:55:21.893 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-18T04:55:21.893 DEBUG:teuthology.orchestra.run.smithi096:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-18T04:55:21.961 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-18T04:55:22.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.002+0000 7fc97f9e3640 1 Processor -- start 2024-04-18T04:55:22.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.002+0000 7fc97f9e3640 1 -- start start 2024-04-18T04:55:22.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.002+0000 7fc97f9e3640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc978151210 0x7fc9780c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.002+0000 7fc97f9e3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc97815a950 0x7fc97815ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.002+0000 7fc97f9e3640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97815b320 con 0x7fc9780c1db0 2024-04-18T04:55:22.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.002+0000 7fc97f9e3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc978157150 con 0x7fc97815a950 2024-04-18T04:55:22.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.002+0000 7fc97f9e3640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc978157430 con 0x7fc978151210 2024-04-18T04:55:22.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.002+0000 7fc97df80640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc97815a950 0x7fc97815ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.002+0000 7fc97df80640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc97815a950 0x7fc97815ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56816/0 (socket says 172.21.15.96:56816) 2024-04-18T04:55:22.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.002+0000 7fc97df80640 1 -- 172.21.15.96:0/764482568 learned_addr learned my addr 172.21.15.96:0/764482568 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:22.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.002+0000 7fc97df80640 1 -- 172.21.15.96:0/764482568 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc978151210 msgr2=0x7fc9780c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:22.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.002+0000 7fc97df80640 1 --2- 172.21.15.96:0/764482568 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc978151210 0x7fc9780c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.002+0000 7fc97df80640 1 -- 172.21.15.96:0/764482568 >> v1:172.21.15.139:6789/0 conn(0x7fc9780c1db0 legacy=0x7fc9780ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:22.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.002+0000 7fc97df80640 1 -- 172.21.15.96:0/764482568 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc978157710 con 0x7fc97815a950 2024-04-18T04:55:22.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97df80640 1 --2- 172.21.15.96:0/764482568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc97815a950 0x7fc97815ade0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc970009e50 tx=0x7fc97001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943d1f2ea0a2328a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:22.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc96ffff640 1 -- 172.21.15.96:0/764482568 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700af400 con 0x7fc97815a950 2024-04-18T04:55:22.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc96ffff640 1 -- 172.21.15.96:0/764482568 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9700ab050 con 0x7fc97815a950 2024-04-18T04:55:22.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc96ffff640 1 -- 172.21.15.96:0/764482568 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700af780 con 0x7fc97815a950 2024-04-18T04:55:22.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97f9e3640 1 -- 172.21.15.96:0/764482568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc97815a950 msgr2=0x7fc97815ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97f9e3640 1 --2- 172.21.15.96:0/764482568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc97815a950 0x7fc97815ade0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc970009e50 tx=0x7fc97001f1e0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97f9e3640 1 -- 172.21.15.96:0/764482568 shutdown_connections 2024-04-18T04:55:22.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97f9e3640 1 --2- 172.21.15.96:0/764482568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc97815a950 0x7fc97815ade0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97f9e3640 1 --2- 172.21.15.96:0/764482568 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc978151210 0x7fc9780c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97f9e3640 1 -- 172.21.15.96:0/764482568 >> 172.21.15.96:0/764482568 conn(0x7fc97806c750 msgr2=0x7fc9780c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:22.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97f9e3640 1 -- 172.21.15.96:0/764482568 shutdown_connections 2024-04-18T04:55:22.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97f9e3640 1 -- 172.21.15.96:0/764482568 wait complete. 2024-04-18T04:55:22.006 INFO:tasks.workunit.client.0.smithi096.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-18T04:55:22.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97f9e3640 1 Processor -- start 2024-04-18T04:55:22.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97f9e3640 1 -- start start 2024-04-18T04:55:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97f9e3640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9780c1db0 0x7fc978070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97f9e3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc978151210 0x7fc97813ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97f9e3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc97815a950 0x7fc9781e3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97f9e3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc978070d50 con 0x7fc97815a950 2024-04-18T04:55:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97f9e3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9781eec00 con 0x7fc978151210 2024-04-18T04:55:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97f9e3640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97813e310 con 0x7fc9780c1db0 2024-04-18T04:55:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97df80640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc97815a950 0x7fc9781e3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97df80640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc97815a950 0x7fc9781e3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56820/0 (socket says 172.21.15.96:56820) 2024-04-18T04:55:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97df80640 1 -- 172.21.15.96:0/2803923226 learned_addr learned my addr 172.21.15.96:0/2803923226 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97d77f640 1 --2- 172.21.15.96:0/2803923226 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9780c1db0 0x7fc978070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97cf7e640 1 --2- 172.21.15.96:0/2803923226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc978151210 0x7fc97813ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97df80640 1 -- 172.21.15.96:0/2803923226 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9780c1db0 msgr2=0x7fc978070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97df80640 1 --2- 172.21.15.96:0/2803923226 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9780c1db0 0x7fc978070810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.006+0000 7fc97df80640 1 -- 172.21.15.96:0/2803923226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc978151210 msgr2=0x7fc97813ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.010+0000 7fc97df80640 1 --2- 172.21.15.96:0/2803923226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc978151210 0x7fc97813ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.010+0000 7fc97df80640 1 -- 172.21.15.96:0/2803923226 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc970009b30 con 0x7fc97815a950 2024-04-18T04:55:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.010+0000 7fc97d77f640 1 --2- 172.21.15.96:0/2803923226 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9780c1db0 0x7fc978070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.010+0000 7fc97df80640 1 --2- 172.21.15.96:0/2803923226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc97815a950 0x7fc9781e3400 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc97001d890 tx=0x7fc97001bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.010+0000 7fc96dffb640 1 -- 172.21.15.96:0/2803923226 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700afdc0 con 0x7fc97815a950 2024-04-18T04:55:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.010+0000 7fc96dffb640 1 -- 172.21.15.96:0/2803923226 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9700b8400 con 0x7fc97815a950 2024-04-18T04:55:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.010+0000 7fc97f9e3640 1 -- 172.21.15.96:0/2803923226 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc978143ff0 con 0x7fc97815a950 2024-04-18T04:55:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.010+0000 7fc96dffb640 1 -- 172.21.15.96:0/2803923226 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700b87b0 con 0x7fc97815a950 2024-04-18T04:55:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.010+0000 7fc97f9e3640 1 -- 172.21.15.96:0/2803923226 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9781ef1a0 con 0x7fc97815a950 2024-04-18T04:55:22.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.010+0000 7fc97f9e3640 1 -- 172.21.15.96:0/2803923226 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9781546e0 con 0x7fc97815a950 2024-04-18T04:55:22.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.010+0000 7fc96dffb640 1 -- 172.21.15.96:0/2803923226 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc9700b6040 con 0x7fc97815a950 2024-04-18T04:55:22.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.010+0000 7fc96dffb640 1 --2- 172.21.15.96:0/2803923226 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc95c0666e0 0x7fc95c068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.010+0000 7fc96dffb640 1 -- 172.21.15.96:0/2803923226 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc970122270 con 0x7fc97815a950 2024-04-18T04:55:22.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.010+0000 7fc97d77f640 1 --2- 172.21.15.96:0/2803923226 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc95c0666e0 0x7fc95c068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.010+0000 7fc97d77f640 1 --2- 172.21.15.96:0/2803923226 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc95c0666e0 0x7fc95c068ba0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc97400a870 tx=0x7fc974008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.014+0000 7fc96dffb640 1 -- 172.21.15.96:0/2803923226 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc9700ef6f0 con 0x7fc97815a950 2024-04-18T04:55:22.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.214+0000 7fc97f9e3640 1 -- 172.21.15.96:0/2803923226 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc978155ed0 con 0x7fc97815a950 2024-04-18T04:55:22.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.214+0000 7fc96dffb640 1 -- 172.21.15.96:0/2803923226 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6313 (secure 0 0 0) 0x7fc9700f2d10 con 0x7fc97815a950 2024-04-18T04:55:22.215 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T04:55:22.215 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/4225147900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":4225147900},{"type":"v1","addr":"172.21.15.96:6839","nonce":4225147900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:54:41.158866+0000","modified":"2024-04-18T04:55:09.695142+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4273,"mds_1":4249,"mds_2":4239,"mds_3":4232,"mds_4":4229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4229":{"gid":4229,"name":"d","rank":4,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.139:6836/2054604275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2054604275},{"type":"v1","addr":"172.21.15.139:6836","nonce":2054604275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4232":{"gid":4232,"name":"b","rank":3,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.139:6837/2105821790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":2105821790},{"type":"v1","addr":"172.21.15.139:6837","nonce":2105821790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4239":{"gid":4239,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.96:6835/1188672263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1188672263},{"type":"v1","addr":"172.21.15.96:6835","nonce":1188672263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4249":{"gid":4249,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.96:6837/4278976485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":4278976485},{"type":"v1","addr":"172.21.15.96:6837","nonce":4278976485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4273":{"gid":4273,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6833/3935291095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":3935291095},{"type":"v1","addr":"172.21.15.139:6833","nonce":3935291095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:55:22.215 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2024-04-18T04:55:22.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.218+0000 7fc97f9e3640 1 -- 172.21.15.96:0/2803923226 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc95c0666e0 msgr2=0x7fc95c068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.218+0000 7fc97f9e3640 1 --2- 172.21.15.96:0/2803923226 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc95c0666e0 0x7fc95c068ba0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc97400a870 tx=0x7fc974008040 comp rx=0 tx=0).stop 2024-04-18T04:55:22.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.218+0000 7fc97f9e3640 1 -- 172.21.15.96:0/2803923226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc97815a950 msgr2=0x7fc9781e3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.218+0000 7fc97f9e3640 1 --2- 172.21.15.96:0/2803923226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc97815a950 0x7fc9781e3400 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc97001d890 tx=0x7fc97001bf80 comp rx=0 tx=0).stop 2024-04-18T04:55:22.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.218+0000 7fc97f9e3640 1 -- 172.21.15.96:0/2803923226 shutdown_connections 2024-04-18T04:55:22.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.218+0000 7fc97f9e3640 1 --2- 172.21.15.96:0/2803923226 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc95c0666e0 0x7fc95c068ba0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.218+0000 7fc97f9e3640 1 --2- 172.21.15.96:0/2803923226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc97815a950 0x7fc9781e3400 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.218+0000 7fc97f9e3640 1 --2- 172.21.15.96:0/2803923226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc978151210 0x7fc97813ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.218+0000 7fc97f9e3640 1 --2- 172.21.15.96:0/2803923226 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9780c1db0 0x7fc978070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.218+0000 7fc97f9e3640 1 -- 172.21.15.96:0/2803923226 >> 172.21.15.96:0/2803923226 conn(0x7fc97806c750 msgr2=0x7fc9780c4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:22.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.218+0000 7fc97f9e3640 1 -- 172.21.15.96:0/2803923226 shutdown_connections 2024-04-18T04:55:22.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.218+0000 7fc97f9e3640 1 -- 172.21.15.96:0/2803923226 wait complete. 2024-04-18T04:55:22.233 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-04-18T04:55:22.233 INFO:tasks.mon_thrash.mon_thrasher:seed: 1713416120, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-04-18T04:55:22.233 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-18T04:55:22.233 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:55:22.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.386+0000 7f487d0a7640 1 Processor -- start 2024-04-18T04:55:22.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.386+0000 7f487d0a7640 1 -- start start 2024-04-18T04:55:22.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.386+0000 7f487d0a7640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f487806d930 0x7f4878070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.386+0000 7f487d0a7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f48780c1870 0x7f4878156050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.386+0000 7f487d0a7640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48780721e0 con 0x7f487806dd10 2024-04-18T04:55:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.386+0000 7f487d0a7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48780c48a0 con 0x7f48780c1870 2024-04-18T04:55:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.386+0000 7f487d0a7640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4878070730 con 0x7f487806d930 2024-04-18T04:55:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.386+0000 7f487659c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f48780c1870 0x7f4878156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.386+0000 7f487659c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f48780c1870 0x7f4878156050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56832/0 (socket says 172.21.15.96:56832) 2024-04-18T04:55:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.386+0000 7f487659c640 1 -- 172.21.15.96:0/3859451053 learned_addr learned my addr 172.21.15.96:0/3859451053 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.386+0000 7f4876d9d640 1 --2- 172.21.15.96:0/3859451053 >> v2:172.21.15.139:3300/0 conn(0x7f487806d930 0x7f4878070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.386+0000 7f487659c640 1 -- 172.21.15.96:0/3859451053 >> v2:172.21.15.139:3300/0 conn(0x7f487806d930 msgr2=0x7f4878070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.386+0000 7f487659c640 1 --2- 172.21.15.96:0/3859451053 >> v2:172.21.15.139:3300/0 conn(0x7f487806d930 0x7f4878070fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.386+0000 7f487659c640 1 -- 172.21.15.96:0/3859451053 >> v1:172.21.15.139:6789/0 conn(0x7f487806dd10 legacy=0x7f48780c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.386+0000 7f487659c640 1 -- 172.21.15.96:0/3859451053 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4878070a10 con 0x7f48780c1870 2024-04-18T04:55:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.386+0000 7f4876d9d640 1 --2- 172.21.15.96:0/3859451053 >> v2:172.21.15.139:3300/0 conn(0x7f487806d930 0x7f4878070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:22.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.390+0000 7f487659c640 1 --2- 172.21.15.96:0/3859451053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48780c1870 0x7f4878156050 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f48780c7c10 tx=0x7f486001f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b30da667c03597 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:22.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.390+0000 7f4875d9b640 1 -- 172.21.15.96:0/3859451053 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48600af400 con 0x7f48780c1870 2024-04-18T04:55:22.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.390+0000 7f4875d9b640 1 -- 172.21.15.96:0/3859451053 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48600ab050 con 0x7f48780c1870 2024-04-18T04:55:22.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.390+0000 7f4875d9b640 1 -- 172.21.15.96:0/3859451053 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48600af780 con 0x7f48780c1870 2024-04-18T04:55:22.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.390+0000 7f487d0a7640 1 -- 172.21.15.96:0/3859451053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48780c1870 msgr2=0x7f4878156050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.390+0000 7f487d0a7640 1 --2- 172.21.15.96:0/3859451053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48780c1870 0x7f4878156050 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f48780c7c10 tx=0x7f486001f1a0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.390+0000 7f487d0a7640 1 -- 172.21.15.96:0/3859451053 shutdown_connections 2024-04-18T04:55:22.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.390+0000 7f487d0a7640 1 --2- 172.21.15.96:0/3859451053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48780c1870 0x7f4878156050 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.390+0000 7f487d0a7640 1 --2- 172.21.15.96:0/3859451053 >> v2:172.21.15.139:3300/0 conn(0x7f487806d930 0x7f4878070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.390+0000 7f487d0a7640 1 -- 172.21.15.96:0/3859451053 >> 172.21.15.96:0/3859451053 conn(0x7f487806c750 msgr2=0x7f48780c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:22.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.390+0000 7f487d0a7640 1 -- 172.21.15.96:0/3859451053 shutdown_connections 2024-04-18T04:55:22.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.390+0000 7f487d0a7640 1 -- 172.21.15.96:0/3859451053 wait complete. 2024-04-18T04:55:22.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f487d0a7640 1 Processor -- start 2024-04-18T04:55:22.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f487d0a7640 1 -- start start 2024-04-18T04:55:22.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f487d0a7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f487806d930 0x7f48780c06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f487d0a7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f487806dd10 0x7f48780c0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f487d0a7640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f48780c1870 0x7f48781f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f487d0a7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48780c7340 con 0x7f487806d930 2024-04-18T04:55:22.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f487d0a7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48780b8b20 con 0x7f487806dd10 2024-04-18T04:55:22.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f487d0a7640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48780b7c30 con 0x7f48780c1870 2024-04-18T04:55:22.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f4876d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f487806d930 0x7f48780c06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f4876d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f487806d930 0x7f48780c06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56838/0 (socket says 172.21.15.96:56838) 2024-04-18T04:55:22.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f4876d9d640 1 -- 172.21.15.96:0/2809638995 learned_addr learned my addr 172.21.15.96:0/2809638995 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:22.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f487759e640 1 --2- 172.21.15.96:0/2809638995 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f48780c1870 0x7f48781f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f487659c640 1 --2- 172.21.15.96:0/2809638995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f487806dd10 0x7f48780c0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f4876d9d640 1 -- 172.21.15.96:0/2809638995 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f48780c1870 msgr2=0x7f48781f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f4876d9d640 1 --2- 172.21.15.96:0/2809638995 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f48780c1870 0x7f48781f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f4876d9d640 1 -- 172.21.15.96:0/2809638995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f487806dd10 msgr2=0x7f48780c0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f4876d9d640 1 --2- 172.21.15.96:0/2809638995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f487806dd10 0x7f48780c0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f4876d9d640 1 -- 172.21.15.96:0/2809638995 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4860009b30 con 0x7f487806d930 2024-04-18T04:55:22.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f487659c640 1 --2- 172.21.15.96:0/2809638995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f487806dd10 0x7f48780c0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:22.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f4876d9d640 1 --2- 172.21.15.96:0/2809638995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f487806d930 0x7f48780c06f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f486800c7f0 tx=0x7f486800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:22.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f486f7fe640 1 -- 172.21.15.96:0/2809638995 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4868007820 con 0x7f487806d930 2024-04-18T04:55:22.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f486f7fe640 1 -- 172.21.15.96:0/2809638995 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4868007980 con 0x7f487806d930 2024-04-18T04:55:22.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f487d0a7640 1 -- 172.21.15.96:0/2809638995 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48780b7f10 con 0x7f487806d930 2024-04-18T04:55:22.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f486f7fe640 1 -- 172.21.15.96:0/2809638995 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4868007d30 con 0x7f487806d930 2024-04-18T04:55:22.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f487d0a7640 1 -- 172.21.15.96:0/2809638995 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48780b84d0 con 0x7f487806d930 2024-04-18T04:55:22.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.394+0000 7f487d0a7640 1 -- 172.21.15.96:0/2809638995 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4878067050 con 0x7f487806d930 2024-04-18T04:55:22.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.398+0000 7f486f7fe640 1 -- 172.21.15.96:0/2809638995 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f48680113f0 con 0x7f487806d930 2024-04-18T04:55:22.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.398+0000 7f486f7fe640 1 --2- 172.21.15.96:0/2809638995 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4858066690 0x7f4858068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.398+0000 7f486f7fe640 1 -- 172.21.15.96:0/2809638995 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4868084570 con 0x7f487806d930 2024-04-18T04:55:22.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.398+0000 7f487659c640 1 --2- 172.21.15.96:0/2809638995 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4858066690 0x7f4858068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.398+0000 7f487659c640 1 --2- 172.21.15.96:0/2809638995 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4858066690 0x7f4858068b50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f48600b1000 tx=0x7f48600aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:22.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.402+0000 7f486f7fe640 1 -- 172.21.15.96:0/2809638995 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f4868051850 con 0x7f487806d930 2024-04-18T04:55:22.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.606+0000 7f487d0a7640 1 -- 172.21.15.96:0/2809638995 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f48780c68c0 con 0x7f487806d930 2024-04-18T04:55:22.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.606+0000 7f486f7fe640 1 -- 172.21.15.96:0/2809638995 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f486801f080 con 0x7f487806d930 2024-04-18T04:55:22.606 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":58,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:55:22.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.610+0000 7f487d0a7640 1 -- 172.21.15.96:0/2809638995 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4858066690 msgr2=0x7f4858068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.610+0000 7f487d0a7640 1 --2- 172.21.15.96:0/2809638995 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4858066690 0x7f4858068b50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f48600b1000 tx=0x7f48600aa000 comp rx=0 tx=0).stop 2024-04-18T04:55:22.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.610+0000 7f487d0a7640 1 -- 172.21.15.96:0/2809638995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f487806d930 msgr2=0x7f48780c06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.610+0000 7f487d0a7640 1 --2- 172.21.15.96:0/2809638995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f487806d930 0x7f48780c06f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f486800c7f0 tx=0x7f486800ccb0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.610+0000 7f487d0a7640 1 -- 172.21.15.96:0/2809638995 shutdown_connections 2024-04-18T04:55:22.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.610+0000 7f487d0a7640 1 --2- 172.21.15.96:0/2809638995 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4858066690 0x7f4858068b50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.610+0000 7f487d0a7640 1 --2- 172.21.15.96:0/2809638995 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f48780c1870 0x7f48781f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.610+0000 7f487d0a7640 1 --2- 172.21.15.96:0/2809638995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f487806dd10 0x7f48780c0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.610+0000 7f487d0a7640 1 --2- 172.21.15.96:0/2809638995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f487806d930 0x7f48780c06f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.610+0000 7f487d0a7640 1 -- 172.21.15.96:0/2809638995 >> 172.21.15.96:0/2809638995 conn(0x7f487806c750 msgr2=0x7f48780c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:22.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.610+0000 7f487d0a7640 1 -- 172.21.15.96:0/2809638995 shutdown_connections 2024-04-18T04:55:22.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.610+0000 7f487d0a7640 1 -- 172.21.15.96:0/2809638995 wait complete. 2024-04-18T04:55:22.623 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-18T04:55:22.623 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-18T04:55:22.623 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-18T04:55:22.623 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T04:55:22.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f8364640 1 Processor -- start 2024-04-18T04:55:22.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f8364640 1 -- start start 2024-04-18T04:55:22.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f8364640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa5f01533d0 0x7fa5f01590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f8364640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5f015c610 0x7fa5f00ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f8364640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f00c9990 con 0x7fa5f00ca920 2024-04-18T04:55:22.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f8364640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f00c9f50 con 0x7fa5f01533d0 2024-04-18T04:55:22.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f8364640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f01595e0 con 0x7fa5f015c610 2024-04-18T04:55:22.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f6901640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa5f00ca920 0x7fa5f0069e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40660/0 (socket says 172.21.15.96:40660) 2024-04-18T04:55:22.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f6901640 1 -- 172.21.15.96:0/2147303147 learned_addr learned my addr 172.21.15.96:0/2147303147 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:22.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f58ff640 1 --2- 172.21.15.96:0/2147303147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5f015c610 0x7fa5f00ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f50fe640 1 -- 172.21.15.96:0/2147303147 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475180401 0 0) 0x7fa5f00c9990 con 0x7fa5f00ca920 2024-04-18T04:55:22.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f50fe640 1 -- 172.21.15.96:0/2147303147 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5dc003530 con 0x7fa5f00ca920 2024-04-18T04:55:22.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f6100640 1 --2- 172.21.15.96:0/2147303147 >> v2:172.21.15.139:3300/0 conn(0x7fa5f01533d0 0x7fa5f01590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f50fe640 1 -- 172.21.15.96:0/2147303147 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3743044056 0 0) 0x7fa5dc003530 con 0x7fa5f00ca920 2024-04-18T04:55:22.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f50fe640 1 -- 172.21.15.96:0/2147303147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5f015c610 msgr2=0x7fa5f00ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:22.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f50fe640 1 --2- 172.21.15.96:0/2147303147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5f015c610 0x7fa5f00ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f50fe640 1 -- 172.21.15.96:0/2147303147 >> v2:172.21.15.139:3300/0 conn(0x7fa5f01533d0 msgr2=0x7fa5f01590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:22.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f50fe640 1 --2- 172.21.15.96:0/2147303147 >> v2:172.21.15.139:3300/0 conn(0x7fa5f01533d0 0x7fa5f01590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f50fe640 1 -- 172.21.15.96:0/2147303147 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0159870 con 0x7fa5f00ca920 2024-04-18T04:55:22.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f50fe640 1 -- 172.21.15.96:0/2147303147 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fa5e8001a00 con 0x7fa5f00ca920 2024-04-18T04:55:22.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f50fe640 1 -- 172.21.15.96:0/2147303147 >> v1:172.21.15.96:6789/0 conn(0x7fa5f00ca920 legacy=0x7fa5f0069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f50fe640 1 --2- 172.21.15.96:0/2147303147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5f015c610 0x7fa5dc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f50fe640 1 --2- 172.21.15.96:0/2147303147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5dc003fb0 0x7fa5dc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f50fe640 1 --2- 172.21.15.96:0/2147303147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5dc004d10 0x7fa5dc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f50fe640 1 -- 172.21.15.96:0/2147303147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00c9f50 con 0x7fa5dc003fb0 2024-04-18T04:55:22.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f50fe640 1 -- 172.21.15.96:0/2147303147 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f01595e0 con 0x7fa5dc004d10 2024-04-18T04:55:22.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f50fe640 1 -- 172.21.15.96:0/2147303147 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc00ba90 con 0x7fa5f015c610 2024-04-18T04:55:22.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f58ff640 1 --2- 172.21.15.96:0/2147303147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5dc003fb0 0x7fa5dc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f6100640 1 --2- 172.21.15.96:0/2147303147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5f015c610 0x7fa5dc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f58ff640 1 -- 172.21.15.96:0/2147303147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5f015c610 msgr2=0x7fa5dc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:22.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f6901640 1 --2- 172.21.15.96:0/2147303147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5dc004d10 0x7fa5dc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f58ff640 1 --2- 172.21.15.96:0/2147303147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5f015c610 0x7fa5dc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f58ff640 1 -- 172.21.15.96:0/2147303147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5dc004d10 msgr2=0x7fa5dc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:22.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f58ff640 1 --2- 172.21.15.96:0/2147303147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5dc004d10 0x7fa5dc005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f58ff640 1 -- 172.21.15.96:0/2147303147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc003530 con 0x7fa5dc003fb0 2024-04-18T04:55:22.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.742+0000 7fa5f6100640 1 --2- 172.21.15.96:0/2147303147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5f015c610 0x7fa5dc003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:22.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.746+0000 7fa5f58ff640 1 --2- 172.21.15.96:0/2147303147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5dc003fb0 0x7fa5dc0047d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000ba30 tx=0x7fa5e001c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5b8cb17776e317 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:22.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.746+0000 7fa5f50fe640 1 -- 172.21.15.96:0/2147303147 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00a9680 con 0x7fa5dc003fb0 2024-04-18T04:55:22.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.746+0000 7fa5f50fe640 1 -- 172.21.15.96:0/2147303147 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e00a97e0 con 0x7fa5dc003fb0 2024-04-18T04:55:22.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.746+0000 7fa5f50fe640 1 -- 172.21.15.96:0/2147303147 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00a9b90 con 0x7fa5dc003fb0 2024-04-18T04:55:22.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.746+0000 7fa5f8364640 1 -- 172.21.15.96:0/2147303147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5dc003fb0 msgr2=0x7fa5dc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.746+0000 7fa5f8364640 1 --2- 172.21.15.96:0/2147303147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5dc003fb0 0x7fa5dc0047d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000ba30 tx=0x7fa5e001c6a0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.746+0000 7fa5f6901640 1 -- 172.21.15.96:0/2147303147 reap_dead start 2024-04-18T04:55:22.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.746+0000 7fa5f8364640 1 -- 172.21.15.96:0/2147303147 shutdown_connections 2024-04-18T04:55:22.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.746+0000 7fa5f8364640 1 -- 172.21.15.96:0/2147303147 >> 172.21.15.96:0/2147303147 conn(0x7fa5f00c7e80 msgr2=0x7fa5f00c8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:22.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.746+0000 7fa5f8364640 1 -- 172.21.15.96:0/2147303147 shutdown_connections 2024-04-18T04:55:22.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.746+0000 7fa5f8364640 1 -- 172.21.15.96:0/2147303147 wait complete. 2024-04-18T04:55:22.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.746+0000 7fa5f8364640 1 Processor -- start 2024-04-18T04:55:22.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.746+0000 7fa5f8364640 1 -- start start 2024-04-18T04:55:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f8364640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5dc003fb0 0x7fa5f01ef440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f8364640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f00bc810 0x7fa5f0151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f8364640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5f00bd030 0x7fa5f00bd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f8364640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f01ef980 con 0x7fa5f00bc810 2024-04-18T04:55:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f8364640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00bcde0 con 0x7fa5f00bd030 2024-04-18T04:55:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f8364640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00bb3c0 con 0x7fa5dc003fb0 2024-04-18T04:55:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f58ff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f00bc810 0x7fa5f0151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f58ff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f00bc810 0x7fa5f0151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56866/0 (socket says 172.21.15.96:56866) 2024-04-18T04:55:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f58ff640 1 -- 172.21.15.96:0/1467355337 learned_addr learned my addr 172.21.15.96:0/1467355337 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f6100640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5dc003fb0 0x7fa5f01ef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f6901640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5f00bd030 0x7fa5f00bd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f58ff640 1 -- 172.21.15.96:0/1467355337 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5dc003fb0 msgr2=0x7fa5f01ef440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f58ff640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5dc003fb0 0x7fa5f01ef440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f58ff640 1 -- 172.21.15.96:0/1467355337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5f00bd030 msgr2=0x7fa5f00bd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f58ff640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5f00bd030 0x7fa5f00bd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f58ff640 1 -- 172.21.15.96:0/1467355337 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f00bb6a0 con 0x7fa5f00bc810 2024-04-18T04:55:22.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f6100640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5dc003fb0 0x7fa5f01ef440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:22.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f58ff640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f00bc810 0x7fa5f0151510 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00980b0 tx=0x7fa5dc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:22.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5e6ffd640 1 -- 172.21.15.96:0/1467355337 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00a9d60 con 0x7fa5f00bc810 2024-04-18T04:55:22.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5e6ffd640 1 -- 172.21.15.96:0/1467355337 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e00a9ec0 con 0x7fa5f00bc810 2024-04-18T04:55:22.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f8364640 1 -- 172.21.15.96:0/1467355337 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f01ef980 con 0x7fa5f00bc810 2024-04-18T04:55:22.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5e6ffd640 1 -- 172.21.15.96:0/1467355337 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0004220 con 0x7fa5f00bc810 2024-04-18T04:55:22.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f8364640 1 -- 172.21.15.96:0/1467355337 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f00bbc60 con 0x7fa5f00bc810 2024-04-18T04:55:22.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f8364640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f00bbe20 0x7fa5f014bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f8364640 1 -- 172.21.15.96:0/1467355337 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00bb830 con 0x7fa5f00bbe20 2024-04-18T04:55:22.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f6100640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f00bbe20 0x7fa5f014bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.750+0000 7fa5f6100640 1 -- 172.21.15.96:0/1467355337 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5f00c9be0 con 0x7fa5f00bbe20 2024-04-18T04:55:22.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.754+0000 7fa5f6100640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f00bbe20 0x7fa5f014bd40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00f580 tx=0x7fa5ec00fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:22.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.754+0000 7fa5e6ffd640 1 -- 172.21.15.96:0/1467355337 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa5e0004380 con 0x7fa5f00bc810 2024-04-18T04:55:22.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.754+0000 7fa5e6ffd640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa5d4066690 0x7fa5d4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.754+0000 7fa5f6901640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa5d4066690 0x7fa5d4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.754+0000 7fa5e6ffd640 1 -- 172.21.15.96:0/1467355337 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec004220 con 0x7fa5f00bbe20 2024-04-18T04:55:22.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.754+0000 7fa5e6ffd640 1 -- 172.21.15.96:0/1467355337 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5e011eea0 con 0x7fa5f00bc810 2024-04-18T04:55:22.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.754+0000 7fa5e6ffd640 1 -- 172.21.15.96:0/1467355337 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fa5ec00c030 con 0x7fa5f00bbe20 2024-04-18T04:55:22.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.754+0000 7fa5e6ffd640 1 -- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f00bbe20 msgr2=0x7fa5f014bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.754+0000 7fa5e6ffd640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f00bbe20 0x7fa5f014bd40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00f580 tx=0x7fa5ec00fa40 comp rx=0 tx=0).stop 2024-04-18T04:55:22.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.754+0000 7fa5e6ffd640 1 -- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f00bbe20 msgr2=0x7fa5f014bd40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:55:22.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.754+0000 7fa5e6ffd640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f00bbe20 0x7fa5f014bd40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.754+0000 7fa5f6901640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa5d4066690 0x7fa5d4068b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00bc20 tx=0x7fa5e8001260 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:22.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.758+0000 7fa5f8364640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f014c280 0x7fa5f01f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.758+0000 7fa5f8364640 1 -- 172.21.15.96:0/1467355337 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0066b90 con 0x7fa5f014c280 2024-04-18T04:55:22.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.758+0000 7fa5f6100640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f014c280 0x7fa5f01f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.758+0000 7fa5f6100640 1 -- 172.21.15.96:0/1467355337 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa5f0159e30 con 0x7fa5f014c280 2024-04-18T04:55:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.758+0000 7fa5f6100640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f014c280 0x7fa5f01f1f80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec018000 tx=0x7fa5ec004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.758+0000 7fa5e6ffd640 1 -- 172.21.15.96:0/1467355337 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec023070 con 0x7fa5f014c280 2024-04-18T04:55:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.758+0000 7fa5e6ffd640 1 -- 172.21.15.96:0/1467355337 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7fa5ec014e80 con 0x7fa5f014c280 2024-04-18T04:55:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.758+0000 7fa5e6ffd640 1 -- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f014c280 msgr2=0x7fa5f01f1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.758+0000 7fa5e6ffd640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f014c280 0x7fa5f01f1f80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec018000 tx=0x7fa5ec004740 comp rx=0 tx=0).stop 2024-04-18T04:55:22.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.758+0000 7fa5e6ffd640 1 -- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f014c280 msgr2=0x7fa5f01f1f80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:55:22.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.758+0000 7fa5e6ffd640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f014c280 0x7fa5f01f1f80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.760 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:55:22.760 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:55:22.760 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:55:22.760 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T04:55:22.760 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 4, 2024-04-18T04:55:22.760 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:55:22.760 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:55:22.760 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:55:22.760 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:55:22.760 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 58, 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:55:22.761 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:55:22.762 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:55:22.762 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:55:22.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:55:22.762 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:55:22.762 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:55:22.762 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:55:22.762 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:55:22.762 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:55:22.762 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:55:22.762 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:55:22.762 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:22.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.762 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:55:22.762 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:55:22.762 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:55:22.762 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:55:22.763 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:55:22.763 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:55:22.763 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:55:22.763 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:55:22.763 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:55:22.763 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:55:22.763 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:55:22.763 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:55:22.763 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:55:22.763 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:55:22.763 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:55:22.763 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:55:22.763 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:55:22.763 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:55:22.763 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:55:22.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:55:22.764 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:55:22.764 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:55:22.764 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:55:22.764 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:55:22.764 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:55:22.764 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:55:22.764 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:55:22.764 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:22.764 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:55:22.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:55:22.764 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.764 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:55:22.764 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:55:22.764 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:55:22.764 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:55:22.765 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.765 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:55:22.765 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:55:22.765 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:22.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.765 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.765 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:22.765 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:55:22.765 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:22.765 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.765 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:22.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.765 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:55:22.765 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:55:22.765 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:55:22.765 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:55:22.766 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:55:22.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.766 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.766 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:55:22.766 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:55:22.766 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:55:22.766 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:55:22.766 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.766 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:55:22.766 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:55:22.766 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:22.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.766 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.766 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:22.766 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:55:22.767 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:22.767 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.767 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:22.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.767 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:55:22.767 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:55:22.767 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:55:22.767 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:55:22.767 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:55:22.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.767 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.767 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:55:22.767 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:55:22.767 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:55:22.767 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:55:22.767 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.768 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:55:22.768 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:55:22.768 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:22.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.768 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.768 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:22.768 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:55:22.768 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:22.768 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.768 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:22.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.768 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:55:22.768 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:55:22.768 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:55:22.768 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:55:22.768 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:55:22.769 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.770 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:22.770 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:55:22.770 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.770 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:22.770 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:22.770 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:55:22.770 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.770 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:22.770 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:55:22.770 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.770 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:22.770 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:22.770 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 7 2024-04-18T04:55:22.770 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.770 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:22.771 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:55:22.771 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.771 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:22.771 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:22.771 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:55:22.771 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.771 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:22.771 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.771 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:55:22.771 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:55:22.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.758+0000 7fa5f8364640 1 -- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa5d4066690 msgr2=0x7fa5d4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.758+0000 7fa5f8364640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa5d4066690 0x7fa5d4068b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00bc20 tx=0x7fa5e8001260 comp rx=0 tx=0).stop 2024-04-18T04:55:22.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.758+0000 7fa5f8364640 1 -- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f00bc810 msgr2=0x7fa5f0151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.758+0000 7fa5f8364640 1 --2- 172.21.15.96:0/1467355337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5f00bc810 0x7fa5f0151510 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00980b0 tx=0x7fa5dc005800 comp rx=0 tx=0).stop 2024-04-18T04:55:22.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.758+0000 7fa5f6901640 1 -- 172.21.15.96:0/1467355337 reap_dead start 2024-04-18T04:55:22.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.762+0000 7fa5f6901640 1 -- 172.21.15.96:0/1467355337 reap_dead start 2024-04-18T04:55:22.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.762+0000 7fa5f8364640 1 -- 172.21.15.96:0/1467355337 shutdown_connections 2024-04-18T04:55:22.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.762+0000 7fa5f8364640 1 -- 172.21.15.96:0/1467355337 >> 172.21.15.96:0/1467355337 conn(0x7fa5f00c7e80 msgr2=0x7fa5f00c6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:22.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.762+0000 7fa5f8364640 1 -- 172.21.15.96:0/1467355337 shutdown_connections 2024-04-18T04:55:22.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.762+0000 7fa5f8364640 1 -- 172.21.15.96:0/1467355337 wait complete. 2024-04-18T04:55:22.774 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:55:22.774 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-18T04:55:22.775 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-18T04:55:22.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.878+0000 7f275b9ae640 1 Processor -- start 2024-04-18T04:55:22.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.878+0000 7f275b9ae640 1 -- start start 2024-04-18T04:55:22.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.878+0000 7f275b9ae640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f27540c5b30 0x7f27540c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.878+0000 7f275b9ae640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f27540c6670 0x7f2754157620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.878+0000 7f275b9ae640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275406c650 con 0x7f275415a270 2024-04-18T04:55:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.878+0000 7f275b9ae640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2754157200 con 0x7f27540c6670 2024-04-18T04:55:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.878+0000 7f275b9ae640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27540c6450 con 0x7f27540c5b30 2024-04-18T04:55:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.878+0000 7f2759f4b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f27540c6670 0x7f2754157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.878+0000 7f2759f4b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f27540c6670 0x7f2754157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56884/0 (socket says 172.21.15.96:56884) 2024-04-18T04:55:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.878+0000 7f2759f4b640 1 -- 172.21.15.96:0/1216146889 learned_addr learned my addr 172.21.15.96:0/1216146889 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f275974a640 1 --2- 172.21.15.96:0/1216146889 >> v2:172.21.15.139:3300/0 conn(0x7f27540c5b30 0x7f27540c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f2759f4b640 1 -- 172.21.15.96:0/1216146889 >> v2:172.21.15.139:3300/0 conn(0x7f27540c5b30 msgr2=0x7f27540c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f2759f4b640 1 --2- 172.21.15.96:0/1216146889 >> v2:172.21.15.139:3300/0 conn(0x7f27540c5b30 0x7f27540c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f2759f4b640 1 -- 172.21.15.96:0/1216146889 >> v1:172.21.15.139:6789/0 conn(0x7f275415a270 legacy=0x7f27540c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:22.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f2759f4b640 1 -- 172.21.15.96:0/1216146889 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27540c1500 con 0x7f27540c6670 2024-04-18T04:55:22.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f2759f4b640 1 --2- 172.21.15.96:0/1216146889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27540c6670 0x7f2754157620 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f27540721b0 tx=0x7f274c01f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ef7a7278e45080 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:22.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f274bfff640 1 -- 172.21.15.96:0/1216146889 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c0af400 con 0x7f27540c6670 2024-04-18T04:55:22.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f274bfff640 1 -- 172.21.15.96:0/1216146889 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c0ab050 con 0x7f27540c6670 2024-04-18T04:55:22.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f274bfff640 1 -- 172.21.15.96:0/1216146889 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c0af780 con 0x7f27540c6670 2024-04-18T04:55:22.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f275b9ae640 1 -- 172.21.15.96:0/1216146889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27540c6670 msgr2=0x7f2754157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f275b9ae640 1 --2- 172.21.15.96:0/1216146889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27540c6670 0x7f2754157620 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f27540721b0 tx=0x7f274c01f1a0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f275b9ae640 1 -- 172.21.15.96:0/1216146889 shutdown_connections 2024-04-18T04:55:22.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f275b9ae640 1 --2- 172.21.15.96:0/1216146889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27540c6670 0x7f2754157620 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f275b9ae640 1 --2- 172.21.15.96:0/1216146889 >> v2:172.21.15.139:3300/0 conn(0x7f27540c5b30 0x7f27540c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f275b9ae640 1 -- 172.21.15.96:0/1216146889 >> 172.21.15.96:0/1216146889 conn(0x7f275406a8e0 msgr2=0x7f27540c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:22.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f275b9ae640 1 -- 172.21.15.96:0/1216146889 shutdown_connections 2024-04-18T04:55:22.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.882+0000 7f275b9ae640 1 -- 172.21.15.96:0/1216146889 wait complete. 2024-04-18T04:55:22.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275b9ae640 1 Processor -- start 2024-04-18T04:55:22.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275b9ae640 1 -- start start 2024-04-18T04:55:22.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275b9ae640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27540c5b30 0x7f27540bf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275b9ae640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f27540c6670 0x7f27540bf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275b9ae640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f275415a270 0x7f27541ef830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275b9ae640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27540c02c0 con 0x7f27540c5b30 2024-04-18T04:55:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275b9ae640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27540be9a0 con 0x7f275415a270 2024-04-18T04:55:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275b9ae640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27541ece70 con 0x7f27540c6670 2024-04-18T04:55:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275974a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27540c5b30 0x7f27540bf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275974a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27540c5b30 0x7f27540bf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56900/0 (socket says 172.21.15.96:56900) 2024-04-18T04:55:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275974a640 1 -- 172.21.15.96:0/2932819242 learned_addr learned my addr 172.21.15.96:0/2932819242 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275974a640 1 -- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f27540c6670 msgr2=0x7f27540bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275974a640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f27540c6670 0x7f27540bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275974a640 1 -- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f275415a270 msgr2=0x7f27541ef830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275974a640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f275415a270 0x7f27541ef830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275974a640 1 -- 172.21.15.96:0/2932819242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c009b30 con 0x7f27540c5b30 2024-04-18T04:55:22.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275974a640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27540c5b30 0x7f27540bf2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f275000c7f0 tx=0x7f275000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:22.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f2749ffb640 1 -- 172.21.15.96:0/2932819242 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750004220 con 0x7f27540c5b30 2024-04-18T04:55:22.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f2749ffb640 1 -- 172.21.15.96:0/2932819242 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27500043a0 con 0x7f27540c5b30 2024-04-18T04:55:22.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275b9ae640 1 -- 172.21.15.96:0/2932819242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27540be6c0 con 0x7f27540c5b30 2024-04-18T04:55:22.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f2749ffb640 1 -- 172.21.15.96:0/2932819242 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750004510 con 0x7f27540c5b30 2024-04-18T04:55:22.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275b9ae640 1 -- 172.21.15.96:0/2932819242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27540c04e0 con 0x7f27540c5b30 2024-04-18T04:55:22.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275b9ae640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27540c9e10 0x7f27541efd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f275b9ae640 1 -- 172.21.15.96:0/2932819242 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2754066b90 con 0x7f27540c9e10 2024-04-18T04:55:22.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f2758f49640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27540c9e10 0x7f27541efd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f2749ffb640 1 -- 172.21.15.96:0/2932819242 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2750003860 con 0x7f27540c5b30 2024-04-18T04:55:22.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f2749ffb640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2738066690 0x7f2738068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f2758f49640 1 -- 172.21.15.96:0/2932819242 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f275406c370 con 0x7f27540c9e10 2024-04-18T04:55:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f2749ffb640 1 -- 172.21.15.96:0/2932819242 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2750083f70 con 0x7f27540c5b30 2024-04-18T04:55:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f2759f4b640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2738066690 0x7f2738068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f2758f49640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27540c9e10 0x7f27541efd70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f27540c0de0 tx=0x7f274400b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.886+0000 7f2759f4b640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2738066690 0x7f2738068b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f274c0b1000 tx=0x7f274c004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.890+0000 7f2749ffb640 1 -- 172.21.15.96:0/2932819242 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744011830 con 0x7f27540c9e10 2024-04-18T04:55:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.890+0000 7f2749ffb640 1 -- 172.21.15.96:0/2932819242 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f2744011990 con 0x7f27540c9e10 2024-04-18T04:55:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.890+0000 7f2749ffb640 1 -- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27540c9e10 msgr2=0x7f27541efd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.890+0000 7f2749ffb640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27540c9e10 0x7f27541efd70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f27540c0de0 tx=0x7f274400b7a0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.890+0000 7f2749ffb640 1 -- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27540c9e10 msgr2=0x7f27541efd70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:55:22.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.890+0000 7f2749ffb640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27540c9e10 0x7f27541efd70 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f27540c0de0 tx=0x7f274400b7a0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.894+0000 7f275b9ae640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27540c0700 0x7f2754147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:22.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.894+0000 7f275b9ae640 1 -- 172.21.15.96:0/2932819242 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275406c090 con 0x7f27540c0700 2024-04-18T04:55:22.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.894+0000 7f2758f49640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27540c0700 0x7f2754147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:22.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.898+0000 7f2758f49640 1 -- 172.21.15.96:0/2932819242 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2754156e20 con 0x7f27540c0700 2024-04-18T04:55:22.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.898+0000 7f2758f49640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27540c0700 0x7f2754147700 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f27540ca210 tx=0x7f27440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:22.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.898+0000 7f2749ffb640 1 -- 172.21.15.96:0/2932819242 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744021070 con 0x7f27540c0700 2024-04-18T04:55:22.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.898+0000 7f2749ffb640 1 -- 172.21.15.96:0/2932819242 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4975 (secure 0 0 0) 0x7f274401a420 con 0x7f27540c0700 2024-04-18T04:55:22.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.898+0000 7f2749ffb640 1 -- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27540c0700 msgr2=0x7f2754147700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.898+0000 7f2749ffb640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27540c0700 0x7f2754147700 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f27540ca210 tx=0x7f27440046c0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.898+0000 7f2749ffb640 1 -- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27540c0700 msgr2=0x7f2754147700 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:55:22.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.898+0000 7f2749ffb640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27540c0700 0x7f2754147700 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.899 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:55:22.900 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:55:22.900 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:55:22.900 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:55:22.900 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 4, 2024-04-18T04:55:22.900 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:55:22.900 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:55:22.900 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:55:22.900 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:55:22.900 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:22.900 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 58, 2024-04-18T04:55:22.900 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:55:22.900 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:55:22.900 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:55:22.900 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:55:22.901 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:55:22.901 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:55:22.901 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:55:22.901 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:55:22.901 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:55:22.901 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:55:22.901 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:55:22.901 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:55:22.901 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:55:22.901 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:22.901 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:55:22.901 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:55:22.901 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:55:22.901 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:55:22.901 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:55:22.901 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:55:22.902 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:55:22.902 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:55:22.902 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:55:22.902 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:55:22.902 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:55:22.902 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:55:22.902 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:22.902 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.902 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:55:22.902 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:55:22.902 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:55:22.902 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:55:22.902 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:55:22.902 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:55:22.902 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:55:22.902 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:55:22.903 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:55:22.903 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:55:22.903 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:55:22.903 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:55:22.903 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:55:22.903 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:55:22.903 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:55:22.903 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:55:22.903 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:55:22.903 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:55:22.903 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:55:22.903 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:55:22.903 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:55:22.903 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:55:22.903 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:55:22.904 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:55:22.904 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:55:22.904 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:55:22.904 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:55:22.904 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:22.904 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:55:22.904 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.904 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:55:22.904 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.904 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:55:22.904 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:55:22.904 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:55:22.904 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:55:22.904 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.904 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:55:22.905 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:55:22.905 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:22.905 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.905 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.905 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:22.905 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:55:22.905 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:22.905 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.905 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:22.905 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.905 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:55:22.905 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:55:22.905 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:55:22.905 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:55:22.905 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:55:22.906 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.906 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.906 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:55:22.906 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:55:22.906 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:55:22.906 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:55:22.906 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.906 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:55:22.906 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:55:22.906 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:22.906 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.906 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.906 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:22.906 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:55:22.907 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:22.907 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.907 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:22.907 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.907 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:55:22.907 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:55:22.907 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:55:22.907 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:55:22.907 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:55:22.907 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.907 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.907 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:55:22.907 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:55:22.907 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:55:22.907 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:55:22.907 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.908 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:55:22.908 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:55:22.908 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:22.908 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.908 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.908 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:22.908 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:55:22.908 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:22.908 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.908 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:22.908 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.908 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:55:22.908 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:55:22.908 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:55:22.908 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:55:22.909 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:55:22.909 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.909 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:22.909 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.909 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:55:22.909 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:55:22.909 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.909 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:22.909 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:22.909 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:55:22.909 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.909 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:22.909 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:55:22.909 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.909 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:22.910 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:22.910 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:55:22.910 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.910 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:22.910 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:55:22.910 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.910 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:22.910 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:22.910 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:55:22.910 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.910 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:22.910 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:55:22.910 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.910 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:22.911 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:22.911 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:55:22.911 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.911 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:22.911 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:55:22.911 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:22.911 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:22.911 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:22.911 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:55:22.911 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:22.911 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:22.911 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:22.911 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:55:22.911 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:55:22.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.902+0000 7f275b9ae640 1 -- 172.21.15.96:0/2932819242 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2738066690 msgr2=0x7f2738068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.902+0000 7f275b9ae640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2738066690 0x7f2738068b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f274c0b1000 tx=0x7f274c004ac0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.902+0000 7f275b9ae640 1 -- 172.21.15.96:0/2932819242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27540c5b30 msgr2=0x7f27540bf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:22.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.902+0000 7f275b9ae640 1 --2- 172.21.15.96:0/2932819242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27540c5b30 0x7f27540bf2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f275000c7f0 tx=0x7f275000ccb0 comp rx=0 tx=0).stop 2024-04-18T04:55:22.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.902+0000 7f2759f4b640 1 -- 172.21.15.96:0/2932819242 reap_dead start 2024-04-18T04:55:22.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.902+0000 7f2759f4b640 1 -- 172.21.15.96:0/2932819242 reap_dead start 2024-04-18T04:55:22.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.902+0000 7f275b9ae640 1 -- 172.21.15.96:0/2932819242 shutdown_connections 2024-04-18T04:55:22.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.902+0000 7f275b9ae640 1 -- 172.21.15.96:0/2932819242 >> 172.21.15.96:0/2932819242 conn(0x7f275406a8e0 msgr2=0x7f275414e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:22.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.902+0000 7f275b9ae640 1 -- 172.21.15.96:0/2932819242 shutdown_connections 2024-04-18T04:55:22.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:22.902+0000 7f275b9ae640 1 -- 172.21.15.96:0/2932819242 wait complete. 2024-04-18T04:55:22.914 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:55:22.914 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-18T04:55:22.914 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-18T04:55:23.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.026+0000 7f7de9a69640 1 Processor -- start 2024-04-18T04:55:23.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.026+0000 7f7de9a69640 1 -- start start 2024-04-18T04:55:23.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.026+0000 7f7de9a69640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7de40c4e50 0x7f7de40cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:23.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.026+0000 7f7de9a69640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7de40c5230 0x7f7de40cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:23.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.026+0000 7f7de9a69640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de406f970 con 0x7f7de4150b30 2024-04-18T04:55:23.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.026+0000 7f7de9a69640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de406edb0 con 0x7f7de40c5230 2024-04-18T04:55:23.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.026+0000 7f7de9a69640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de406f070 con 0x7f7de40c4e50 2024-04-18T04:55:23.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.026+0000 7f7de2ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7de40c5230 0x7f7de40cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:23.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.026+0000 7f7de3fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f7de4150b30 0x7f7de415a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40670/0 (socket says 172.21.15.96:40670) 2024-04-18T04:55:23.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.026+0000 7f7de3fff640 1 -- 172.21.15.96:0/1802988259 learned_addr learned my addr 172.21.15.96:0/1802988259 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:23.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.026+0000 7f7de37fe640 1 --2- 172.21.15.96:0/1802988259 >> v2:172.21.15.139:3300/0 conn(0x7f7de40c4e50 0x7f7de40cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:23.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.026+0000 7f7de2ffd640 1 -- 172.21.15.96:0/1802988259 >> v2:172.21.15.139:3300/0 conn(0x7f7de40c4e50 msgr2=0x7f7de40cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:23.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.026+0000 7f7de2ffd640 1 --2- 172.21.15.96:0/1802988259 >> v2:172.21.15.139:3300/0 conn(0x7f7de40c4e50 0x7f7de40cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.026+0000 7f7de2ffd640 1 -- 172.21.15.96:0/1802988259 >> v1:172.21.15.96:6789/0 conn(0x7f7de4150b30 legacy=0x7f7de415a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:23.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.026+0000 7f7de27fc640 1 -- 172.21.15.96:0/1802988259 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011831682 0 0) 0x7f7de406f970 con 0x7f7de4150b30 2024-04-18T04:55:23.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.026+0000 7f7de2ffd640 1 -- 172.21.15.96:0/1802988259 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de406f350 con 0x7f7de40c5230 2024-04-18T04:55:23.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de2ffd640 1 --2- 172.21.15.96:0/1802988259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de40c5230 0x7f7de40cbba0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7de40cb8c0 tx=0x7f7dcc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fbd1a30f1120df7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:23.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de27fc640 1 -- 172.21.15.96:0/1802988259 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0a8970 con 0x7f7de40c5230 2024-04-18T04:55:23.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de27fc640 1 -- 172.21.15.96:0/1802988259 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc0a8ad0 con 0x7f7de40c5230 2024-04-18T04:55:23.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de27fc640 1 -- 172.21.15.96:0/1802988259 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0a8e60 con 0x7f7de40c5230 2024-04-18T04:55:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de9a69640 1 -- 172.21.15.96:0/1802988259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de40c5230 msgr2=0x7f7de40cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de9a69640 1 --2- 172.21.15.96:0/1802988259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de40c5230 0x7f7de40cbba0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7de40cb8c0 tx=0x7f7dcc01ec70 comp rx=0 tx=0).stop 2024-04-18T04:55:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de9a69640 1 -- 172.21.15.96:0/1802988259 shutdown_connections 2024-04-18T04:55:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de9a69640 1 --2- 172.21.15.96:0/1802988259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de40c5230 0x7f7de40cbba0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de9a69640 1 --2- 172.21.15.96:0/1802988259 >> v2:172.21.15.139:3300/0 conn(0x7f7de40c4e50 0x7f7de40cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de9a69640 1 -- 172.21.15.96:0/1802988259 >> 172.21.15.96:0/1802988259 conn(0x7f7de406d2a0 msgr2=0x7f7de406afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de9a69640 1 -- 172.21.15.96:0/1802988259 shutdown_connections 2024-04-18T04:55:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de9a69640 1 -- 172.21.15.96:0/1802988259 wait complete. 2024-04-18T04:55:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de9a69640 1 Processor -- start 2024-04-18T04:55:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de9a69640 1 -- start start 2024-04-18T04:55:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de9a69640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7de40c4e50 0x7f7de4155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de9a69640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de4150b30 0x7f7de41ecb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de9a69640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de40c78d0 0x7f7de41ed090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de9a69640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de41ec670 con 0x7f7de40c78d0 2024-04-18T04:55:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de9a69640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de414b0e0 con 0x7f7de40c4e50 2024-04-18T04:55:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de9a69640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de414b3c0 con 0x7f7de4150b30 2024-04-18T04:55:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de40c78d0 0x7f7de41ed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de40c78d0 0x7f7de41ed090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56926/0 (socket says 172.21.15.96:56926) 2024-04-18T04:55:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de3fff640 1 -- 172.21.15.96:0/2289904254 learned_addr learned my addr 172.21.15.96:0/2289904254 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de2ffd640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de4150b30 0x7f7de41ecb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.030+0000 7f7de37fe640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7de40c4e50 0x7f7de4155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7de3fff640 1 -- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de4150b30 msgr2=0x7f7de41ecb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:23.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7de3fff640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de4150b30 0x7f7de41ecb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7de3fff640 1 -- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7de40c4e50 msgr2=0x7f7de4155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:23.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7de3fff640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7de40c4e50 0x7f7de4155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7de3fff640 1 -- 172.21.15.96:0/2289904254 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc009420 con 0x7f7de40c78d0 2024-04-18T04:55:23.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7de37fe640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7de40c4e50 0x7f7de4155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:23.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7de3fff640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de40c78d0 0x7f7de41ed090 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400c470 tx=0x7f7dd400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:23.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7ddbfff640 1 -- 172.21.15.96:0/2289904254 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40074e0 con 0x7f7de40c78d0 2024-04-18T04:55:23.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7ddbfff640 1 -- 172.21.15.96:0/2289904254 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd4007640 con 0x7f7de40c78d0 2024-04-18T04:55:23.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7de9a69640 1 -- 172.21.15.96:0/2289904254 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de414b6a0 con 0x7f7de40c78d0 2024-04-18T04:55:23.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7ddbfff640 1 -- 172.21.15.96:0/2289904254 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4004a30 con 0x7f7de40c78d0 2024-04-18T04:55:23.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7de9a69640 1 -- 172.21.15.96:0/2289904254 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de4154650 con 0x7f7de40c78d0 2024-04-18T04:55:23.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7de9a69640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de40c5230 0x7f7de4142bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:23.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7de9a69640 1 -- 172.21.15.96:0/2289904254 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de4066b20 con 0x7f7de40c5230 2024-04-18T04:55:23.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7de37fe640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de40c5230 0x7f7de4142bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:23.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7ddbfff640 1 -- 172.21.15.96:0/2289904254 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7dd4004b90 con 0x7f7de40c78d0 2024-04-18T04:55:23.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7de37fe640 1 -- 172.21.15.96:0/2289904254 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7de40720e0 con 0x7f7de40c5230 2024-04-18T04:55:23.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7ddbfff640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7dc4066690 0x7f7dc4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:23.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7ddbfff640 1 -- 172.21.15.96:0/2289904254 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dd4083770 con 0x7f7de40c78d0 2024-04-18T04:55:23.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7de2ffd640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7dc4066690 0x7f7dc4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:23.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7de37fe640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de40c5230 0x7f7de4142bb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00dd40 tx=0x7f7ddc00b630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:23.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7ddbfff640 1 -- 172.21.15.96:0/2289904254 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc010460 con 0x7f7de40c5230 2024-04-18T04:55:23.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7de2ffd640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7dc4066690 0x7f7dc4068b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0b2000 tx=0x7f7dcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:23.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7ddbfff640 1 -- 172.21.15.96:0/2289904254 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f7ddc0105c0 con 0x7f7de40c5230 2024-04-18T04:55:23.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7ddbfff640 1 -- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de40c5230 msgr2=0x7f7de4142bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:23.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7ddbfff640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de40c5230 0x7f7de4142bb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00dd40 tx=0x7f7ddc00b630 comp rx=0 tx=0).stop 2024-04-18T04:55:23.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7ddbfff640 1 -- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de40c5230 msgr2=0x7f7de4142bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:55:23.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.034+0000 7f7ddbfff640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de40c5230 0x7f7de4142bb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.042+0000 7f7de9a69640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de4154080 0x7f7de41430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:23.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.042+0000 7f7de9a69640 1 -- 172.21.15.96:0/2289904254 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de414bbc0 con 0x7f7de4154080 2024-04-18T04:55:23.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.042+0000 7f7de37fe640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de4154080 0x7f7de41430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:23.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.042+0000 7f7de37fe640 1 -- 172.21.15.96:0/2289904254 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7de4071e00 con 0x7f7de4154080 2024-04-18T04:55:23.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.042+0000 7f7de37fe640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de4154080 0x7f7de41430f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00dd40 tx=0x7f7ddc004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:23.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.042+0000 7f7ddbfff640 1 -- 172.21.15.96:0/2289904254 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc024650 con 0x7f7de4154080 2024-04-18T04:55:23.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.042+0000 7f7ddbfff640 1 -- 172.21.15.96:0/2289904254 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4805 (secure 0 0 0) 0x7f7ddc0247b0 con 0x7f7de4154080 2024-04-18T04:55:23.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.042+0000 7f7ddbfff640 1 -- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de4154080 msgr2=0x7f7de41430f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:23.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.042+0000 7f7ddbfff640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de4154080 0x7f7de41430f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00dd40 tx=0x7f7ddc004a50 comp rx=0 tx=0).stop 2024-04-18T04:55:23.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.042+0000 7f7ddbfff640 1 -- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de4154080 msgr2=0x7f7de41430f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:55:23.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.042+0000 7f7ddbfff640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7de4154080 0x7f7de41430f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.044 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:55:23.044 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:55:23.044 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:55:23.044 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:55:23.044 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 4, 2024-04-18T04:55:23.044 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:55:23.044 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:55:23.044 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:55:23.044 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:55:23.044 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:23.044 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 59, 2024-04-18T04:55:23.044 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:55:23.045 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:55:23.045 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:55:23.045 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:55:23.045 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:55:23.045 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:55:23.045 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:55:23.045 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:55:23.045 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:55:23.045 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:55:23.045 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:55:23.045 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:55:23.045 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:55:23.045 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:23.045 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:55:23.045 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:55:23.046 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:55:23.046 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:55:23.046 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:55:23.046 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:55:23.046 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:55:23.046 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:55:23.046 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:55:23.046 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:55:23.046 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:55:23.046 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:55:23.046 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:23.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:23.046 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:55:23.047 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:55:23.047 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:55:23.047 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:55:23.047 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:55:23.047 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:55:23.047 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:55:23.047 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:55:23.047 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:55:23.047 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:55:23.047 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:55:23.047 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:55:23.047 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:55:23.047 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:55:23.047 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:55:23.047 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:55:23.048 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:55:23.048 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:55:23.048 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:55:23.048 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:55:23.048 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:55:23.048 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:55:23.048 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:55:23.048 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:55:23.048 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:55:23.048 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:55:23.048 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:55:23.048 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:23.048 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:55:23.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:23.048 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:55:23.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:23.049 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:55:23.049 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:55:23.049 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:55:23.049 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:55:23.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:23.049 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:55:23.049 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:55:23.049 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:23.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:23.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:23.049 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:23.049 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:55:23.049 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:23.050 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:23.050 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:23.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:23.050 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:55:23.050 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:55:23.050 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:55:23.050 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:55:23.050 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:55:23.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:23.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:23.050 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:55:23.050 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:55:23.050 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:55:23.050 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:55:23.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:23.051 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:55:23.051 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:55:23.051 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:23.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:23.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:23.051 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:23.051 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:55:23.051 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:23.051 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:23.051 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:23.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:23.051 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:55:23.051 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:55:23.052 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:55:23.052 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:55:23.052 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:55:23.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:23.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:23.052 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:55:23.052 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:55:23.052 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:55:23.052 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:55:23.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:23.052 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:55:23.052 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:55:23.052 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:23.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:23.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:55:23.054 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:55:23.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:23.054 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:23.054 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:23.054 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:55:23.054 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:23.054 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:23.054 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:55:23.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:23.054 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:23.054 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:23.054 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:55:23.054 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:23.055 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:23.055 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:55:23.055 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:23.055 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:23.055 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:23.055 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:55:23.055 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:23.055 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:23.055 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:55:23.055 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:23.055 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:23.055 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:23.055 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:55:23.055 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:23.055 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:23.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:23.056 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:55:23.056 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:55:23.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.046+0000 7f7de9a69640 1 -- 172.21.15.96:0/2289904254 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7dc4066690 msgr2=0x7f7dc4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:23.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.046+0000 7f7de9a69640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7dc4066690 0x7f7dc4068b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0b2000 tx=0x7f7dcc008040 comp rx=0 tx=0).stop 2024-04-18T04:55:23.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.046+0000 7f7de9a69640 1 -- 172.21.15.96:0/2289904254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de40c78d0 msgr2=0x7f7de41ed090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:23.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.046+0000 7f7de9a69640 1 --2- 172.21.15.96:0/2289904254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7de40c78d0 0x7f7de41ed090 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400c470 tx=0x7f7dd400c930 comp rx=0 tx=0).stop 2024-04-18T04:55:23.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.046+0000 7f7de3fff640 1 -- 172.21.15.96:0/2289904254 reap_dead start 2024-04-18T04:55:23.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.046+0000 7f7de3fff640 1 -- 172.21.15.96:0/2289904254 reap_dead start 2024-04-18T04:55:23.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.046+0000 7f7de9a69640 1 -- 172.21.15.96:0/2289904254 shutdown_connections 2024-04-18T04:55:23.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.046+0000 7f7de9a69640 1 -- 172.21.15.96:0/2289904254 >> 172.21.15.96:0/2289904254 conn(0x7f7de406d2a0 msgr2=0x7f7de414d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:23.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.046+0000 7f7de9a69640 1 -- 172.21.15.96:0/2289904254 shutdown_connections 2024-04-18T04:55:23.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.046+0000 7f7de9a69640 1 -- 172.21.15.96:0/2289904254 wait complete. 2024-04-18T04:55:23.058 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:55:23.059 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-04-18T04:55:23.059 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-18T04:55:23.059 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-04-18T04:55:23.059 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-18T04:55:23.059 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-18T04:55:23.059 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:55:23.079 INFO:tasks.ceph.mon.b:Stopped 2024-04-18T04:55:23.079 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-18T04:55:23.080 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:55:23.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f977ed7c640 1 Processor -- start 2024-04-18T04:55:23.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f977ed7c640 1 -- start start 2024-04-18T04:55:23.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f977ed7c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9778152fe0 0x7f97780c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:23.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f977ed7c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f97780c4510 0x7f97780c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:23.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f977ed7c640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97781533c0 con 0x7f977815c480 2024-04-18T04:55:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f977ed7c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97780c4950 con 0x7f9778152fe0 2024-04-18T04:55:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f977ed7c640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9778066940 con 0x7f97780c4510 2024-04-18T04:55:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f977cb18640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9778152fe0 0x7f97780c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f977cb18640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9778152fe0 0x7f97780c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56950/0 (socket says 172.21.15.96:56950) 2024-04-18T04:55:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f977cb18640 1 -- 172.21.15.96:0/2075673873 learned_addr learned my addr 172.21.15.96:0/2075673873 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f977d319640 1 -- 172.21.15.96:0/2075673873 >> v1:172.21.15.139:6789/0 conn(0x7f977815c480 legacy=0x7f977815c8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:55:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f9777fff640 1 -- 172.21.15.96:0/2075673873 >> v2:172.21.15.139:3300/0 conn(0x7f97780c4510 msgr2=0x7f97780c9f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:55:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f9777fff640 1 --2- 172.21.15.96:0/2075673873 >> v2:172.21.15.139:3300/0 conn(0x7f97780c4510 0x7f97780c9f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:55:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f977cb18640 1 -- 172.21.15.96:0/2075673873 >> v2:172.21.15.139:3300/0 conn(0x7f97780c4510 msgr2=0x7f97780c9f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:55:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f977cb18640 1 --2- 172.21.15.96:0/2075673873 >> v2:172.21.15.139:3300/0 conn(0x7f97780c4510 0x7f97780c9f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f977cb18640 1 -- 172.21.15.96:0/2075673873 >> v1:172.21.15.139:6789/0 conn(0x7f977815c480 legacy=0x7f977815c8b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:55:23.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.182+0000 7f977cb18640 1 -- 172.21.15.96:0/2075673873 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9778159c50 con 0x7f9778152fe0 2024-04-18T04:55:23.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977cb18640 1 --2- 172.21.15.96:0/2075673873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9778152fe0 0x7f97780c9160 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f97780cc2c0 tx=0x7f976c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b943cf9f40db6dd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:23.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f97777fe640 1 -- 172.21.15.96:0/2075673873 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0a89f0 con 0x7f9778152fe0 2024-04-18T04:55:23.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f97777fe640 1 -- 172.21.15.96:0/2075673873 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c0a8b50 con 0x7f9778152fe0 2024-04-18T04:55:23.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f97777fe640 1 -- 172.21.15.96:0/2075673873 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0b0440 con 0x7f9778152fe0 2024-04-18T04:55:23.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 -- 172.21.15.96:0/2075673873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9778152fe0 msgr2=0x7f97780c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:23.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 --2- 172.21.15.96:0/2075673873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9778152fe0 0x7f97780c9160 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f97780cc2c0 tx=0x7f976c01ecf0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 -- 172.21.15.96:0/2075673873 shutdown_connections 2024-04-18T04:55:23.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 --2- 172.21.15.96:0/2075673873 >> v2:172.21.15.139:3300/0 conn(0x7f97780c4510 0x7f97780c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 --2- 172.21.15.96:0/2075673873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9778152fe0 0x7f97780c9160 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 -- 172.21.15.96:0/2075673873 >> 172.21.15.96:0/2075673873 conn(0x7f9778071760 msgr2=0x7f9778065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:23.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 -- 172.21.15.96:0/2075673873 shutdown_connections 2024-04-18T04:55:23.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 -- 172.21.15.96:0/2075673873 wait complete. 2024-04-18T04:55:23.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 Processor -- start 2024-04-18T04:55:23.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 -- start start 2024-04-18T04:55:23.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97780c4510 0x7f97781eefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:23.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9778152fe0 0x7f97780cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:23.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f977815c480 0x7f97781578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:23.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9778157440 con 0x7f97780c4510 2024-04-18T04:55:23.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9778158bc0 con 0x7f977815c480 2024-04-18T04:55:23.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97781590f0 con 0x7f9778152fe0 2024-04-18T04:55:23.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977cb18640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97780c4510 0x7f97781eefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:23.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977cb18640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97780c4510 0x7f97781eefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56964/0 (socket says 172.21.15.96:56964) 2024-04-18T04:55:23.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977cb18640 1 -- 172.21.15.96:0/2723694181 learned_addr learned my addr 172.21.15.96:0/2723694181 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:23.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977d319640 1 -- 172.21.15.96:0/2723694181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f977815c480 msgr2=0x7f97781578d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:55:23.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977d319640 1 --2- 172.21.15.96:0/2723694181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f977815c480 0x7f97781578d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:55:23.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977cb18640 1 -- 172.21.15.96:0/2723694181 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9778152fe0 msgr2=0x7f97780cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:23.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977cb18640 1 --2- 172.21.15.96:0/2723694181 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9778152fe0 0x7f97780cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977cb18640 1 -- 172.21.15.96:0/2723694181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f977815c480 msgr2=0x7f97781578d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:55:23.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977cb18640 1 --2- 172.21.15.96:0/2723694181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f977815c480 0x7f97781578d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977cb18640 1 -- 172.21.15.96:0/2723694181 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c0094d0 con 0x7f97780c4510 2024-04-18T04:55:23.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977cb18640 1 --2- 172.21.15.96:0/2723694181 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97780c4510 0x7f97781eefe0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f976c0b3040 tx=0x7f976c01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:23.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f97757fa640 1 -- 172.21.15.96:0/2723694181 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0b0e00 con 0x7f97780c4510 2024-04-18T04:55:23.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f97757fa640 1 -- 172.21.15.96:0/2723694181 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c0bb470 con 0x7f97780c4510 2024-04-18T04:55:23.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f977ed7c640 1 -- 172.21.15.96:0/2723694181 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9778156e30 con 0x7f97780c4510 2024-04-18T04:55:23.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.186+0000 7f97757fa640 1 -- 172.21.15.96:0/2723694181 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0bb820 con 0x7f97780c4510 2024-04-18T04:55:23.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.190+0000 7f977ed7c640 1 -- 172.21.15.96:0/2723694181 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9778158e10 con 0x7f97780c4510 2024-04-18T04:55:23.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.190+0000 7f977ed7c640 1 -- 172.21.15.96:0/2723694181 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97780721f0 con 0x7f97780c4510 2024-04-18T04:55:23.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.190+0000 7f97757fa640 1 -- 172.21.15.96:0/2723694181 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f976c0b7070 con 0x7f97780c4510 2024-04-18T04:55:23.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.190+0000 7f97757fa640 1 --2- 172.21.15.96:0/2723694181 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9764066670 0x7f9764068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:23.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.190+0000 7f97757fa640 1 -- 172.21.15.96:0/2723694181 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f976c122540 con 0x7f97780c4510 2024-04-18T04:55:23.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.190+0000 7f9777fff640 1 --2- 172.21.15.96:0/2723694181 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9764066670 0x7f9764068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:23.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.190+0000 7f9777fff640 1 --2- 172.21.15.96:0/2723694181 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9764066670 0x7f9764068b30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f97781f2bc0 tx=0x7f9768006ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:23.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.194+0000 7f97757fa640 1 -- 172.21.15.96:0/2723694181 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f976c0ef8a0 con 0x7f97780c4510 2024-04-18T04:55:23.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.398+0000 7f977ed7c640 1 -- 172.21.15.96:0/2723694181 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f97780721f0 con 0x7f97780c4510 2024-04-18T04:55:23.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.398+0000 7f97757fa640 1 -- 172.21.15.96:0/2723694181 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f976c0b5620 con 0x7f97780c4510 2024-04-18T04:55:23.399 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":59,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:55:23.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.402+0000 7f977ed7c640 1 -- 172.21.15.96:0/2723694181 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9764066670 msgr2=0x7f9764068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:23.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.402+0000 7f977ed7c640 1 --2- 172.21.15.96:0/2723694181 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9764066670 0x7f9764068b30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f97781f2bc0 tx=0x7f9768006ca0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.402+0000 7f977ed7c640 1 -- 172.21.15.96:0/2723694181 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97780c4510 msgr2=0x7f97781eefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:23.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.402+0000 7f977ed7c640 1 --2- 172.21.15.96:0/2723694181 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97780c4510 0x7f97781eefe0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f976c0b3040 tx=0x7f976c01ba90 comp rx=0 tx=0).stop 2024-04-18T04:55:23.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.402+0000 7f977ed7c640 1 -- 172.21.15.96:0/2723694181 shutdown_connections 2024-04-18T04:55:23.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.402+0000 7f977ed7c640 1 --2- 172.21.15.96:0/2723694181 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9764066670 0x7f9764068b30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.402+0000 7f977ed7c640 1 --2- 172.21.15.96:0/2723694181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f977815c480 0x7f97781578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.402+0000 7f977ed7c640 1 --2- 172.21.15.96:0/2723694181 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9778152fe0 0x7f97780cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.402+0000 7f977ed7c640 1 --2- 172.21.15.96:0/2723694181 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97780c4510 0x7f97781eefe0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:23.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.402+0000 7f977ed7c640 1 -- 172.21.15.96:0/2723694181 >> 172.21.15.96:0/2723694181 conn(0x7f9778071760 msgr2=0x7f9778150cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:23.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.402+0000 7f977ed7c640 1 -- 172.21.15.96:0/2723694181 shutdown_connections 2024-04-18T04:55:23.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:23.402+0000 7f977ed7c640 1 -- 172.21.15.96:0/2723694181 wait complete. 2024-04-18T04:55:23.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-18T04:55:26.418 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:55:26.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.538+0000 7f817eb9a640 1 Processor -- start 2024-04-18T04:55:26.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.538+0000 7f817eb9a640 1 -- start start 2024-04-18T04:55:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.538+0000 7f817eb9a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f81780700e0 0x7f8178159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.538+0000 7f817eb9a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f81780707c0 0x7f81780ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.538+0000 7f817eb9a640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8178159700 con 0x7f8178153180 2024-04-18T04:55:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.538+0000 7f817eb9a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8178070be0 con 0x7f81780700e0 2024-04-18T04:55:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.538+0000 7f817eb9a640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81780c6390 con 0x7f81780707c0 2024-04-18T04:55:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.538+0000 7f817c936640 1 -- >> v1:172.21.15.139:6789/0 conn(0x7f8178153180 legacy=0x7f817815c580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:55:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.538+0000 7f817d137640 1 -- >> v2:172.21.15.139:3300/0 conn(0x7f81780707c0 msgr2=0x7f81780ca300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:55:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f817d137640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f81780707c0 0x7f81780ca300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:55:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f8177fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f81780700e0 0x7f8178159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:26.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f8177fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f81780700e0 0x7f8178159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56974/0 (socket says 172.21.15.96:56974) 2024-04-18T04:55:26.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f8177fff640 1 -- 172.21.15.96:0/3233756365 learned_addr learned my addr 172.21.15.96:0/3233756365 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:26.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f8177fff640 1 -- 172.21.15.96:0/3233756365 >> v2:172.21.15.139:3300/0 conn(0x7f81780707c0 msgr2=0x7f81780ca300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:55:26.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f8177fff640 1 --2- 172.21.15.96:0/3233756365 >> v2:172.21.15.139:3300/0 conn(0x7f81780707c0 0x7f81780ca300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:26.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f8177fff640 1 -- 172.21.15.96:0/3233756365 >> v1:172.21.15.139:6789/0 conn(0x7f8178153180 legacy=0x7f817815c580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:55:26.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f8177fff640 1 -- 172.21.15.96:0/3233756365 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817815cf80 con 0x7f81780700e0 2024-04-18T04:55:26.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f8177fff640 1 --2- 172.21.15.96:0/3233756365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81780700e0 0x7f8178159b90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f81780c7d80 tx=0x7f816401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5ab83e7e839914 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:26.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f81777fe640 1 -- 172.21.15.96:0/3233756365 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81640a89f0 con 0x7f81780700e0 2024-04-18T04:55:26.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f81777fe640 1 -- 172.21.15.96:0/3233756365 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81640a8b50 con 0x7f81780700e0 2024-04-18T04:55:26.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f81777fe640 1 -- 172.21.15.96:0/3233756365 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81640b0440 con 0x7f81780700e0 2024-04-18T04:55:26.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f817eb9a640 1 -- 172.21.15.96:0/3233756365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81780700e0 msgr2=0x7f8178159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:26.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f817eb9a640 1 --2- 172.21.15.96:0/3233756365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81780700e0 0x7f8178159b90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f81780c7d80 tx=0x7f816401ecf0 comp rx=0 tx=0).stop 2024-04-18T04:55:26.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f817eb9a640 1 -- 172.21.15.96:0/3233756365 shutdown_connections 2024-04-18T04:55:26.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f817eb9a640 1 --2- 172.21.15.96:0/3233756365 >> v2:172.21.15.139:3300/0 conn(0x7f81780707c0 0x7f81780ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:26.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f817eb9a640 1 --2- 172.21.15.96:0/3233756365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81780700e0 0x7f8178159b90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:26.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f817eb9a640 1 -- 172.21.15.96:0/3233756365 >> 172.21.15.96:0/3233756365 conn(0x7f817806c750 msgr2=0x7f81780c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:26.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f817eb9a640 1 -- 172.21.15.96:0/3233756365 shutdown_connections 2024-04-18T04:55:26.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.542+0000 7f817eb9a640 1 -- 172.21.15.96:0/3233756365 wait complete. 2024-04-18T04:55:26.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817eb9a640 1 Processor -- start 2024-04-18T04:55:26.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817eb9a640 1 -- start start 2024-04-18T04:55:26.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817eb9a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81780700e0 0x7f817814d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:26.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817eb9a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81780707c0 0x7f81781524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:26.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817eb9a640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8178153180 0x7f817815b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:26.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817eb9a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8178153e40 con 0x7f81780700e0 2024-04-18T04:55:26.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817eb9a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817815b530 con 0x7f81780707c0 2024-04-18T04:55:26.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817eb9a640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817814d9e0 con 0x7f8178153180 2024-04-18T04:55:26.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817c936640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81780700e0 0x7f817814d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817c936640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81780700e0 0x7f817814d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56990/0 (socket says 172.21.15.96:56990) 2024-04-18T04:55:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817c936640 1 -- 172.21.15.96:0/3789032887 learned_addr learned my addr 172.21.15.96:0/3789032887 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f8177fff640 1 -- 172.21.15.96:0/3789032887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81780707c0 msgr2=0x7f81781524c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:55:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f8177fff640 1 --2- 172.21.15.96:0/3789032887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81780707c0 0x7f81781524c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:55:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817d137640 1 --2- 172.21.15.96:0/3789032887 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8178153180 0x7f817815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817c936640 1 -- 172.21.15.96:0/3789032887 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8178153180 msgr2=0x7f817815b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817c936640 1 --2- 172.21.15.96:0/3789032887 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8178153180 0x7f817815b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817c936640 1 -- 172.21.15.96:0/3789032887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81780707c0 msgr2=0x7f81781524c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:55:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817c936640 1 --2- 172.21.15.96:0/3789032887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81780707c0 0x7f81781524c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817c936640 1 -- 172.21.15.96:0/3789032887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81640094d0 con 0x7f81780700e0 2024-04-18T04:55:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817c936640 1 --2- 172.21.15.96:0/3789032887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81780700e0 0x7f817814d4a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f816c00b530 tx=0x7f816c00b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f81757fa640 1 -- 172.21.15.96:0/3789032887 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c003dd0 con 0x7f81780700e0 2024-04-18T04:55:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f81757fa640 1 -- 172.21.15.96:0/3789032887 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c005070 con 0x7f81780700e0 2024-04-18T04:55:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817eb9a640 1 -- 172.21.15.96:0/3789032887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817815c8b0 con 0x7f81780700e0 2024-04-18T04:55:26.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f81757fa640 1 -- 172.21.15.96:0/3789032887 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c005420 con 0x7f81780700e0 2024-04-18T04:55:26.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817eb9a640 1 -- 172.21.15.96:0/3789032887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81781ef970 con 0x7f81780700e0 2024-04-18T04:55:26.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f817eb9a640 1 -- 172.21.15.96:0/3789032887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81781ef4f0 con 0x7f81780700e0 2024-04-18T04:55:26.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f81757fa640 1 -- 172.21.15.96:0/3789032887 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f816c005580 con 0x7f81780700e0 2024-04-18T04:55:26.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.546+0000 7f81757fa640 1 --2- 172.21.15.96:0/3789032887 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f815c066640 0x7f815c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:26.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.550+0000 7f81757fa640 1 -- 172.21.15.96:0/3789032887 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f816c084020 con 0x7f81780700e0 2024-04-18T04:55:26.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.550+0000 7f8177fff640 1 --2- 172.21.15.96:0/3789032887 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f815c066640 0x7f815c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:26.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.550+0000 7f8177fff640 1 --2- 172.21.15.96:0/3789032887 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f815c066640 0x7f815c068b00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f81640b2000 tx=0x7f8164008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:26.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.554+0000 7f81757fa640 1 -- 172.21.15.96:0/3789032887 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f81781ef4f0 con 0x7f81780700e0 2024-04-18T04:55:26.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.766+0000 7f817eb9a640 1 -- 172.21.15.96:0/3789032887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f81781ef4f0 con 0x7f81780700e0 2024-04-18T04:55:26.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.766+0000 7f81757fa640 1 -- 172.21.15.96:0/3789032887 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f81781ef4f0 con 0x7f81780700e0 2024-04-18T04:55:26.766 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":62,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:55:26.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.770+0000 7f817eb9a640 1 -- 172.21.15.96:0/3789032887 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f815c066640 msgr2=0x7f815c068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:26.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.770+0000 7f817eb9a640 1 --2- 172.21.15.96:0/3789032887 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f815c066640 0x7f815c068b00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f81640b2000 tx=0x7f8164008040 comp rx=0 tx=0).stop 2024-04-18T04:55:26.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.770+0000 7f817eb9a640 1 -- 172.21.15.96:0/3789032887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81780700e0 msgr2=0x7f817814d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:26.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.770+0000 7f817eb9a640 1 --2- 172.21.15.96:0/3789032887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81780700e0 0x7f817814d4a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f816c00b530 tx=0x7f816c00b9f0 comp rx=0 tx=0).stop 2024-04-18T04:55:26.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.770+0000 7f817eb9a640 1 -- 172.21.15.96:0/3789032887 shutdown_connections 2024-04-18T04:55:26.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.770+0000 7f817eb9a640 1 --2- 172.21.15.96:0/3789032887 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f815c066640 0x7f815c068b00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:26.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.770+0000 7f817eb9a640 1 --2- 172.21.15.96:0/3789032887 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8178153180 0x7f817815b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:26.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.770+0000 7f817eb9a640 1 --2- 172.21.15.96:0/3789032887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81780707c0 0x7f81781524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:26.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.770+0000 7f817eb9a640 1 --2- 172.21.15.96:0/3789032887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81780700e0 0x7f817814d4a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:26.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.770+0000 7f817eb9a640 1 -- 172.21.15.96:0/3789032887 >> 172.21.15.96:0/3789032887 conn(0x7f817806c750 msgr2=0x7f817806d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:26.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.770+0000 7f817eb9a640 1 -- 172.21.15.96:0/3789032887 shutdown_connections 2024-04-18T04:55:26.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:26.770+0000 7f817eb9a640 1 -- 172.21.15.96:0/3789032887 wait complete. 2024-04-18T04:55:29.784 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:55:29.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.909+0000 7f507a488640 1 Processor -- start 2024-04-18T04:55:29.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.909+0000 7f507a488640 1 -- start start 2024-04-18T04:55:29.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f507a488640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5074152dd0 0x7f5074069e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f507a488640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f507406a3a0 0x7f50740c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f507a488640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f50740c6ad0 0x7f507406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f507a488640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50740c53d0 con 0x7f507406a3a0 2024-04-18T04:55:29.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f507a488640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50740c3040 con 0x7f50740c6ad0 2024-04-18T04:55:29.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f507a488640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50740c6f60 con 0x7f5074152dd0 2024-04-18T04:55:29.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f506b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f507406a3a0 0x7f50740c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f5078a25640 1 -- >> v2:172.21.15.139:3300/0 conn(0x7f50740c6ad0 msgr2=0x7f507406eef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:55:29.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f506b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f507406a3a0 0x7f50740c6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37218/0 (socket says 172.21.15.96:37218) 2024-04-18T04:55:29.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f506b7fe640 1 -- 172.21.15.96:0/705233104 learned_addr learned my addr 172.21.15.96:0/705233104 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:29.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f5078a25640 1 --2- 172.21.15.96:0/705233104 >> v2:172.21.15.139:3300/0 conn(0x7f50740c6ad0 0x7f507406eef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:55:29.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f5073fff640 1 --2- 172.21.15.96:0/705233104 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5074152dd0 0x7f5074069e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f506b7fe640 1 -- 172.21.15.96:0/705233104 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5074152dd0 msgr2=0x7f5074069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:29.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f506b7fe640 1 --2- 172.21.15.96:0/705233104 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5074152dd0 0x7f5074069e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f506b7fe640 1 -- 172.21.15.96:0/705233104 >> v2:172.21.15.139:3300/0 conn(0x7f50740c6ad0 msgr2=0x7f507406eef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:55:29.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f506b7fe640 1 --2- 172.21.15.96:0/705233104 >> v2:172.21.15.139:3300/0 conn(0x7f50740c6ad0 0x7f507406eef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f506b7fe640 1 -- 172.21.15.96:0/705233104 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50741531b0 con 0x7f507406a3a0 2024-04-18T04:55:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f506b7fe640 1 --2- 172.21.15.96:0/705233104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f507406a3a0 0x7f50740c6590 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f50741568c0 tx=0x7f505c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0425c6568842d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f50737fe640 1 -- 172.21.15.96:0/705233104 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c0ab5f0 con 0x7f507406a3a0 2024-04-18T04:55:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f50737fe640 1 -- 172.21.15.96:0/705233104 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c0ab750 con 0x7f507406a3a0 2024-04-18T04:55:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.913+0000 7f50737fe640 1 -- 172.21.15.96:0/705233104 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c0abae0 con 0x7f507406a3a0 2024-04-18T04:55:29.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 -- 172.21.15.96:0/705233104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f507406a3a0 msgr2=0x7f50740c6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:29.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 --2- 172.21.15.96:0/705233104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f507406a3a0 0x7f50740c6590 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f50741568c0 tx=0x7f505c01c540 comp rx=0 tx=0).stop 2024-04-18T04:55:29.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 -- 172.21.15.96:0/705233104 shutdown_connections 2024-04-18T04:55:29.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 --2- 172.21.15.96:0/705233104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f507406a3a0 0x7f50740c6590 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 --2- 172.21.15.96:0/705233104 >> v2:172.21.15.139:3300/0 conn(0x7f50740c6ad0 0x7f507406eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 --2- 172.21.15.96:0/705233104 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5074152dd0 0x7f5074069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 -- 172.21.15.96:0/705233104 >> 172.21.15.96:0/705233104 conn(0x7f50740663b0 msgr2=0x7f507406af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:29.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 -- 172.21.15.96:0/705233104 shutdown_connections 2024-04-18T04:55:29.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 -- 172.21.15.96:0/705233104 wait complete. 2024-04-18T04:55:29.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 Processor -- start 2024-04-18T04:55:29.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 -- start start 2024-04-18T04:55:29.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f507406a3a0 0x7f5074147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50740c6ad0 0x7f507415b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5074152dd0 0x7f507415b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5074158e90 con 0x7f50740c6ad0 2024-04-18T04:55:29.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50741f2580 con 0x7f5074152dd0 2024-04-18T04:55:29.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50741524f0 con 0x7f507406a3a0 2024-04-18T04:55:29.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f506b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50740c6ad0 0x7f507415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f506b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50740c6ad0 0x7f507415b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37222/0 (socket says 172.21.15.96:37222) 2024-04-18T04:55:29.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f506b7fe640 1 -- 172.21.15.96:0/3627635498 learned_addr learned my addr 172.21.15.96:0/3627635498 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:29.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f5078a25640 1 -- 172.21.15.96:0/3627635498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5074152dd0 msgr2=0x7f507415b650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:55:29.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f5078a25640 1 --2- 172.21.15.96:0/3627635498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5074152dd0 0x7f507415b650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:55:29.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f5073fff640 1 --2- 172.21.15.96:0/3627635498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f507406a3a0 0x7f5074147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f506b7fe640 1 -- 172.21.15.96:0/3627635498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f507406a3a0 msgr2=0x7f5074147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:29.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f506b7fe640 1 --2- 172.21.15.96:0/3627635498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f507406a3a0 0x7f5074147890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f506b7fe640 1 -- 172.21.15.96:0/3627635498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5074152dd0 msgr2=0x7f507415b650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:55:29.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f506b7fe640 1 --2- 172.21.15.96:0/3627635498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5074152dd0 0x7f507415b650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f506b7fe640 1 -- 172.21.15.96:0/3627635498 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c0094d0 con 0x7f50740c6ad0 2024-04-18T04:55:29.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f506b7fe640 1 --2- 172.21.15.96:0/3627635498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50740c6ad0 0x7f507415b110 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f505c01abf0 tx=0x7f505c01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:29.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f50717fa640 1 -- 172.21.15.96:0/3627635498 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c0b4800 con 0x7f50740c6ad0 2024-04-18T04:55:29.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f50717fa640 1 -- 172.21.15.96:0/3627635498 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c0b4960 con 0x7f50740c6ad0 2024-04-18T04:55:29.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f50717fa640 1 -- 172.21.15.96:0/3627635498 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c0b4d10 con 0x7f50740c6ad0 2024-04-18T04:55:29.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 -- 172.21.15.96:0/3627635498 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5074152790 con 0x7f50740c6ad0 2024-04-18T04:55:29.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.917+0000 7f507a488640 1 -- 172.21.15.96:0/3627635498 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5074150bd0 con 0x7f50740c6ad0 2024-04-18T04:55:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.921+0000 7f507a488640 1 -- 172.21.15.96:0/3627635498 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50741529d0 con 0x7f50740c6ad0 2024-04-18T04:55:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.921+0000 7f50717fa640 1 -- 172.21.15.96:0/3627635498 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f505c0b3380 con 0x7f50740c6ad0 2024-04-18T04:55:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.921+0000 7f50717fa640 1 --2- 172.21.15.96:0/3627635498 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5054066640 0x7f5054068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.921+0000 7f5073fff640 1 --2- 172.21.15.96:0/3627635498 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5054066640 0x7f5054068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.921+0000 7f50717fa640 1 -- 172.21.15.96:0/3627635498 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f505c0a8050 con 0x7f50740c6ad0 2024-04-18T04:55:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.921+0000 7f5073fff640 1 --2- 172.21.15.96:0/3627635498 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5054066640 0x7f5054068b00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f50640096f0 tx=0x7f5064008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:29.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:29.925+0000 7f50717fa640 1 -- 172.21.15.96:0/3627635498 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f50741529d0 con 0x7f50740c6ad0 2024-04-18T04:55:30.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:30.141+0000 7f507a488640 1 -- 172.21.15.96:0/3627635498 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5074150750 con 0x7f50740c6ad0 2024-04-18T04:55:30.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:30.141+0000 7f50717fa640 1 -- 172.21.15.96:0/3627635498 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f5074150750 con 0x7f50740c6ad0 2024-04-18T04:55:30.143 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":66,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:55:30.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:30.145+0000 7f507a488640 1 -- 172.21.15.96:0/3627635498 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5054066640 msgr2=0x7f5054068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:30.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:30.145+0000 7f507a488640 1 --2- 172.21.15.96:0/3627635498 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5054066640 0x7f5054068b00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f50640096f0 tx=0x7f5064008040 comp rx=0 tx=0).stop 2024-04-18T04:55:30.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:30.145+0000 7f507a488640 1 -- 172.21.15.96:0/3627635498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50740c6ad0 msgr2=0x7f507415b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:30.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:30.145+0000 7f507a488640 1 --2- 172.21.15.96:0/3627635498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50740c6ad0 0x7f507415b110 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f505c01abf0 tx=0x7f505c01ad80 comp rx=0 tx=0).stop 2024-04-18T04:55:30.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:30.145+0000 7f507a488640 1 -- 172.21.15.96:0/3627635498 shutdown_connections 2024-04-18T04:55:30.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:30.145+0000 7f507a488640 1 --2- 172.21.15.96:0/3627635498 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5054066640 0x7f5054068b00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:30.145+0000 7f507a488640 1 --2- 172.21.15.96:0/3627635498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5074152dd0 0x7f507415b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:30.145+0000 7f507a488640 1 --2- 172.21.15.96:0/3627635498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50740c6ad0 0x7f507415b110 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:30.145+0000 7f507a488640 1 --2- 172.21.15.96:0/3627635498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f507406a3a0 0x7f5074147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:30.145+0000 7f507a488640 1 -- 172.21.15.96:0/3627635498 >> 172.21.15.96:0/3627635498 conn(0x7f50740663b0 msgr2=0x7f5074070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:30.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:30.145+0000 7f507a488640 1 -- 172.21.15.96:0/3627635498 shutdown_connections 2024-04-18T04:55:30.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:30.145+0000 7f507a488640 1 -- 172.21.15.96:0/3627635498 wait complete. 2024-04-18T04:55:30.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-18T04:55:33.161 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:55:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.289+0000 7fbca8284640 1 Processor -- start 2024-04-18T04:55:33.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.289+0000 7fbca8284640 1 -- start start 2024-04-18T04:55:33.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.289+0000 7fbca8284640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 0x7fbca014fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:33.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.289+0000 7fbca8284640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 0x7fbca0150090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:33.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.289+0000 7fbca8284640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca0159380 con 0x7fbca00701b0 2024-04-18T04:55:33.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.289+0000 7fbca8284640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca015a1a0 con 0x7fbca0070a40 2024-04-18T04:55:33.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.289+0000 7fbca8284640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca0155ce0 con 0x7fbca00c60e0 2024-04-18T04:55:33.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.289+0000 7fbca581f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 0x7fbca0150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.289+0000 7fbca581f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 0x7fbca0150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37230/0 (socket says 172.21.15.96:37230) 2024-04-18T04:55:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.289+0000 7fbca581f640 1 -- 172.21.15.96:0/3560316301 learned_addr learned my addr 172.21.15.96:0/3560316301 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.293+0000 7fbca581f640 1 -- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 msgr2=0x7fbca0150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:55:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.293+0000 7fbca581f640 1 -- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 msgr2=0x7fbca0150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:55:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.293+0000 7fbca581f640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 0x7fbca0150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:55:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.293+0000 7fbca581f640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 0x7fbca0150090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:55:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.293+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 0x7fbca014fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.293+0000 7fbca6020640 1 -- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 msgr2=0x7fbca014fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:55:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.293+0000 7fbca6020640 1 -- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 msgr2=0x7fbca014fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:55:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.293+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 0x7fbca014fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:55:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.293+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 0x7fbca014fb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:55:33.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.497+0000 7fbca581f640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 0x7fbca0150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.497+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 0x7fbca014fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.497+0000 7fbca581f640 1 -- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 msgr2=0x7fbca0150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:55:33.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.497+0000 7fbca581f640 1 -- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 msgr2=0x7fbca0150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:55:33.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.497+0000 7fbca581f640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 0x7fbca0150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:55:33.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.497+0000 7fbca581f640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 0x7fbca0150090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:55:33.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.497+0000 7fbca6020640 1 -- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 msgr2=0x7fbca014fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:55:33.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.497+0000 7fbca6020640 1 -- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 msgr2=0x7fbca014fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:55:33.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.497+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 0x7fbca014fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:55:33.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.497+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 0x7fbca014fb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:55:33.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.901+0000 7fbca581f640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 0x7fbca0150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.901+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 0x7fbca014fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.901+0000 7fbca581f640 1 -- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 msgr2=0x7fbca0150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:55:33.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.901+0000 7fbca581f640 1 -- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 msgr2=0x7fbca0150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:55:33.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.901+0000 7fbca581f640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 0x7fbca0150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:55:33.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.901+0000 7fbca581f640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 0x7fbca0150090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:55:33.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.901+0000 7fbca6020640 1 -- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 msgr2=0x7fbca014fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:55:33.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.901+0000 7fbca6020640 1 -- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 msgr2=0x7fbca014fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:55:33.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.901+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 0x7fbca014fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:55:33.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:33.901+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 0x7fbca014fb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:55:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:34.705+0000 7fbca581f640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 0x7fbca0150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:34.705+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 0x7fbca014fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:34.705+0000 7fbca581f640 1 -- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 msgr2=0x7fbca0150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:55:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:34.705+0000 7fbca581f640 1 -- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 msgr2=0x7fbca0150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:55:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:34.705+0000 7fbca581f640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 0x7fbca0150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:55:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:34.705+0000 7fbca581f640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 0x7fbca0150090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:55:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:34.705+0000 7fbca6020640 1 -- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 msgr2=0x7fbca014fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:55:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:34.705+0000 7fbca6020640 1 -- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 msgr2=0x7fbca014fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:55:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:34.705+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 0x7fbca014fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:55:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:34.705+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 0x7fbca014fb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:55:36.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.289+0000 7fbc97fff640 1 -- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 msgr2=0x7fbca014fb50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:55:36.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.289+0000 7fbc97fff640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbca00c60e0 0x7fbca014fb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.289+0000 7fbc97fff640 1 -- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 msgr2=0x7fbca0150090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:55:36.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.289+0000 7fbc97fff640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbca0070a40 0x7fbca0150090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.289+0000 7fbc97fff640 1 -- 172.21.15.96:0/3560316301 >> v1:172.21.15.96:6789/0 conn(0x7fbca00701b0 legacy=0x7fbca0156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.293+0000 7fbc97fff640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc840036f0 0x7fbc84005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.293+0000 7fbc97fff640 1 -- 172.21.15.96:0/3560316301 --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca0159620 con 0x7fbc84006180 2024-04-18T04:55:36.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.293+0000 7fbc97fff640 1 -- 172.21.15.96:0/3560316301 --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca015a1a0 con 0x7fbc840036f0 2024-04-18T04:55:36.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.293+0000 7fbca581f640 1 -- 172.21.15.96:0/3560316301 >> v1:172.21.15.139:6789/0 conn(0x7fbc84006180 legacy=0x7fbc84008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:55:36.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.293+0000 7fbca6020640 1 -- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc840036f0 msgr2=0x7fbc84005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:55:36.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.293+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc840036f0 0x7fbc84005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:55:36.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.497+0000 7fbca6020640 1 -- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc840036f0 msgr2=0x7fbc84005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:55:36.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.497+0000 7fbca581f640 1 -- 172.21.15.96:0/3560316301 >> v1:172.21.15.139:6789/0 conn(0x7fbc84006180 legacy=0x7fbc84008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:55:36.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.497+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc840036f0 0x7fbc84005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:55:36.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.901+0000 7fbca6020640 1 -- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc840036f0 msgr2=0x7fbc84005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:55:36.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.901+0000 7fbca581f640 1 -- 172.21.15.96:0/3560316301 >> v1:172.21.15.139:6789/0 conn(0x7fbc84006180 legacy=0x7fbc84008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:55:36.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:36.901+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc840036f0 0x7fbc84005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:55:37.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:37.705+0000 7fbca581f640 1 -- 172.21.15.96:0/3560316301 >> v1:172.21.15.139:6789/0 conn(0x7fbc84006180 legacy=0x7fbc84008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:55:37.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:37.705+0000 7fbca6020640 1 -- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc840036f0 msgr2=0x7fbc84005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:55:37.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:37.705+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc840036f0 0x7fbc84005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:55:39.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbc97fff640 1 -- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc840036f0 msgr2=0x7fbc84005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:55:39.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbc97fff640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc840036f0 0x7fbc84005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbc97fff640 1 -- 172.21.15.96:0/3560316301 >> v1:172.21.15.139:6789/0 conn(0x7fbc84006180 legacy=0x7fbc84008640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:55:39.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbca6821640 1 -- 172.21.15.96:0/3560316301 reap_dead start 2024-04-18T04:55:39.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbc97fff640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbc84009ee0 0x7fbc8400a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbc97fff640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbc8400a800 0x7fbc84005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbc97fff640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc84008d70 0x7fbc840085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbc97fff640 1 -- 172.21.15.96:0/3560316301 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca015a1a0 con 0x7fbc84009ee0 2024-04-18T04:55:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbc97fff640 1 -- 172.21.15.96:0/3560316301 --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca0155ce0 con 0x7fbc84008d70 2024-04-18T04:55:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbc97fff640 1 -- 172.21.15.96:0/3560316301 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84008c10 con 0x7fbc8400a800 2024-04-18T04:55:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbca6821640 1 -- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc84008d70 msgr2=0x7fbc840085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:55:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbca6821640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc84008d70 0x7fbc840085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:55:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.96:3300/0 conn(0x7fbc84009ee0 0x7fbc8400a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbca581f640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbc8400a800 0x7fbc84005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbca6020640 1 -- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbc8400a800 msgr2=0x7fbc84005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbc8400a800 0x7fbc84005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbca6020640 1 -- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc84008d70 msgr2=0x7fbc840085c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:55:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc84008d70 0x7fbc840085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.293+0000 7fbca6020640 1 -- 172.21.15.96:0/3560316301 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8400af20 con 0x7fbc84009ee0 2024-04-18T04:55:39.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.297+0000 7fbca6020640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc84009ee0 0x7fbc8400a2c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbc84006560 tx=0x7fbc9c01d290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b71cd93ab3645d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:39.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.297+0000 7fbca501e640 1 -- 172.21.15.96:0/3560316301 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0af640 con 0x7fbc84009ee0 2024-04-18T04:55:39.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.301+0000 7fbca501e640 1 -- 172.21.15.96:0/3560316301 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c0a8030 con 0x7fbc84009ee0 2024-04-18T04:55:39.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.301+0000 7fbca501e640 1 -- 172.21.15.96:0/3560316301 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0afa00 con 0x7fbc84009ee0 2024-04-18T04:55:39.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.301+0000 7fbca8284640 1 -- 172.21.15.96:0/3560316301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc84009ee0 msgr2=0x7fbc8400a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:39.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.301+0000 7fbca8284640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc84009ee0 0x7fbc8400a2c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbc84006560 tx=0x7fbc9c01d290 comp rx=0 tx=0).stop 2024-04-18T04:55:39.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.301+0000 7fbca8284640 1 -- 172.21.15.96:0/3560316301 shutdown_connections 2024-04-18T04:55:39.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.301+0000 7fbca8284640 1 --2- 172.21.15.96:0/3560316301 >> v2:172.21.15.139:3300/0 conn(0x7fbc84008d70 0x7fbc840085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.301+0000 7fbca8284640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbc8400a800 0x7fbc84005b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.301+0000 7fbca8284640 1 --2- 172.21.15.96:0/3560316301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc84009ee0 0x7fbc8400a2c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.301+0000 7fbca8284640 1 -- 172.21.15.96:0/3560316301 >> 172.21.15.96:0/3560316301 conn(0x7fbca006c750 msgr2=0x7fbca00c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:39.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.301+0000 7fbca8284640 1 -- 172.21.15.96:0/3560316301 shutdown_connections 2024-04-18T04:55:39.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.301+0000 7fbca8284640 1 -- 172.21.15.96:0/3560316301 wait complete. 2024-04-18T04:55:39.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.305+0000 7fbca8284640 1 Processor -- start 2024-04-18T04:55:39.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.305+0000 7fbca8284640 1 -- start start 2024-04-18T04:55:39.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.305+0000 7fbca8284640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc84008d70 0x7fbca013ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.305+0000 7fbca8284640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc84009ee0 0x7fbca013f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.305+0000 7fbca8284640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbc8400a800 0x7fbca01410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.305+0000 7fbca8284640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca0142710 con 0x7fbc84008d70 2024-04-18T04:55:39.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.305+0000 7fbca8284640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca014caf0 con 0x7fbc84009ee0 2024-04-18T04:55:39.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.305+0000 7fbca8284640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca01ef010 con 0x7fbc8400a800 2024-04-18T04:55:39.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.305+0000 7fbca6020640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc84008d70 0x7fbca013ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.305+0000 7fbca6020640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc84008d70 0x7fbca013ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53992/0 (socket says 172.21.15.96:53992) 2024-04-18T04:55:39.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.305+0000 7fbca6020640 1 -- 172.21.15.96:0/3550674286 learned_addr learned my addr 172.21.15.96:0/3550674286 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:39.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.305+0000 7fbca581f640 1 -- 172.21.15.96:0/3550674286 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc84009ee0 msgr2=0x7fbca013f1d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:55:39.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.305+0000 7fbca581f640 1 --2- 172.21.15.96:0/3550674286 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc84009ee0 0x7fbca013f1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:55:39.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbca6821640 1 --2- 172.21.15.96:0/3550674286 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbc8400a800 0x7fbca01410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbca6020640 1 -- 172.21.15.96:0/3550674286 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbc8400a800 msgr2=0x7fbca01410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:39.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbca6020640 1 --2- 172.21.15.96:0/3550674286 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbc8400a800 0x7fbca01410c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbca6020640 1 -- 172.21.15.96:0/3550674286 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc84009ee0 msgr2=0x7fbca013f1d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:55:39.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbca6020640 1 --2- 172.21.15.96:0/3550674286 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc84009ee0 0x7fbca013f1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbca6020640 1 -- 172.21.15.96:0/3550674286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c00e040 con 0x7fbc84008d70 2024-04-18T04:55:39.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbca6020640 1 --2- 172.21.15.96:0/3550674286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc84008d70 0x7fbca013ec90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c01af20 tx=0x7fbc9c01a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:39.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbc96ffd640 1 -- 172.21.15.96:0/3550674286 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0ba640 con 0x7fbc84008d70 2024-04-18T04:55:39.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbc96ffd640 1 -- 172.21.15.96:0/3550674286 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c00c040 con 0x7fbc84008d70 2024-04-18T04:55:39.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbca8284640 1 -- 172.21.15.96:0/3550674286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca01ef550 con 0x7fbc84008d70 2024-04-18T04:55:39.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbc96ffd640 1 -- 172.21.15.96:0/3550674286 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0ba9a0 con 0x7fbc84008d70 2024-04-18T04:55:39.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbca8284640 1 -- 172.21.15.96:0/3550674286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca01ef270 con 0x7fbc84008d70 2024-04-18T04:55:39.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbca8284640 1 -- 172.21.15.96:0/3550674286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca0067050 con 0x7fbc84008d70 2024-04-18T04:55:39.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbc96ffd640 1 -- 172.21.15.96:0/3550674286 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbc9c0b8430 con 0x7fbc84008d70 2024-04-18T04:55:39.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbc96ffd640 1 --2- 172.21.15.96:0/3550674286 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbc8406b730 0x7fbc8406dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbc96ffd640 1 -- 172.21.15.96:0/3550674286 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fbc9c11f7a0 con 0x7fbc84008d70 2024-04-18T04:55:39.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.309+0000 7fbca581f640 1 --2- 172.21.15.96:0/3550674286 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbc8406b730 0x7fbc8406dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.313+0000 7fbca581f640 1 --2- 172.21.15.96:0/3550674286 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbc8406b730 0x7fbc8406dbf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbca0143250 tx=0x7fbc90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:39.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.317+0000 7fbc96ffd640 1 -- 172.21.15.96:0/3550674286 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fbc9c0ecaf0 con 0x7fbc84008d70 2024-04-18T04:55:39.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.533+0000 7fbca8284640 1 -- 172.21.15.96:0/3550674286 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbca0143280 con 0x7fbc84008d70 2024-04-18T04:55:39.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.533+0000 7fbc96ffd640 1 -- 172.21.15.96:0/3550674286 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7fbc9c0f0110 con 0x7fbc84008d70 2024-04-18T04:55:39.534 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":8,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:55:39.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.537+0000 7fbca8284640 1 -- 172.21.15.96:0/3550674286 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbc8406b730 msgr2=0x7fbc8406dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:39.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.537+0000 7fbca8284640 1 --2- 172.21.15.96:0/3550674286 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbc8406b730 0x7fbc8406dbf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbca0143250 tx=0x7fbc90008040 comp rx=0 tx=0).stop 2024-04-18T04:55:39.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.537+0000 7fbca8284640 1 -- 172.21.15.96:0/3550674286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc84008d70 msgr2=0x7fbca013ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:39.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.537+0000 7fbca8284640 1 --2- 172.21.15.96:0/3550674286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc84008d70 0x7fbca013ec90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c01af20 tx=0x7fbc9c01a090 comp rx=0 tx=0).stop 2024-04-18T04:55:39.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.537+0000 7fbca8284640 1 -- 172.21.15.96:0/3550674286 shutdown_connections 2024-04-18T04:55:39.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.537+0000 7fbca8284640 1 --2- 172.21.15.96:0/3550674286 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbc8406b730 0x7fbc8406dbf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.537+0000 7fbca8284640 1 --2- 172.21.15.96:0/3550674286 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbc8400a800 0x7fbca01410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.537+0000 7fbca8284640 1 --2- 172.21.15.96:0/3550674286 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc84009ee0 0x7fbca013f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.537+0000 7fbca8284640 1 --2- 172.21.15.96:0/3550674286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc84008d70 0x7fbca013ec90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.537+0000 7fbca8284640 1 -- 172.21.15.96:0/3550674286 >> 172.21.15.96:0/3550674286 conn(0x7fbca006c750 msgr2=0x7fbca0071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:39.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.537+0000 7fbca8284640 1 -- 172.21.15.96:0/3550674286 shutdown_connections 2024-04-18T04:55:39.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.537+0000 7fbca8284640 1 -- 172.21.15.96:0/3550674286 wait complete. 2024-04-18T04:55:39.552 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-18T04:55:39.553 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-04-18T04:55:39.553 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T04:55:39.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f21489df640 1 Processor -- start 2024-04-18T04:55:39.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f21489df640 1 -- start start 2024-04-18T04:55:39.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f21489df640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2144156590 0x7f21440cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f21489df640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2144159aa0 0x7f21440c9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f21489df640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214406f2f0 con 0x7f21440cbea0 2024-04-18T04:55:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f21489df640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2144159680 con 0x7f2144156590 2024-04-18T04:55:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f21489df640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2144159020 con 0x7f2144159aa0 2024-04-18T04:55:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f214259c640 1 -- >> v2:172.21.15.139:3300/0 conn(0x7f2144156590 msgr2=0x7f21440cabc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:55:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f2141d9b640 1 -- >> v1:172.21.15.139:6789/0 conn(0x7f21440cbea0 legacy=0x7f214406ebe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:55:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f214259c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2144156590 0x7f21440cabc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:55:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f2142d9d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2144159aa0 0x7f21440c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f2142d9d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2144159aa0 0x7f21440c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:51286/0 (socket says 172.21.15.96:51286) 2024-04-18T04:55:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f2142d9d640 1 -- 172.21.15.96:0/4024284821 learned_addr learned my addr 172.21.15.96:0/4024284821 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:39.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f2142d9d640 1 -- 172.21.15.96:0/4024284821 >> v2:172.21.15.139:3300/0 conn(0x7f2144156590 msgr2=0x7f21440cabc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:55:39.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f2142d9d640 1 --2- 172.21.15.96:0/4024284821 >> v2:172.21.15.139:3300/0 conn(0x7f2144156590 0x7f21440cabc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f2142d9d640 1 -- 172.21.15.96:0/4024284821 >> v1:172.21.15.139:6789/0 conn(0x7f21440cbea0 legacy=0x7f214406ebe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:55:39.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.673+0000 7f2142d9d640 1 -- 172.21.15.96:0/4024284821 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21440cb1e0 con 0x7f2144159aa0 2024-04-18T04:55:39.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.677+0000 7f2142d9d640 1 --2- 172.21.15.96:0/4024284821 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2144159aa0 0x7f21440c9000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2134009870 tx=0x7f213401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99ff323a1a7be49 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:39.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.677+0000 7f214159a640 1 -- 172.21.15.96:0/4024284821 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21340ab610 con 0x7f2144159aa0 2024-04-18T04:55:39.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.677+0000 7f214159a640 1 -- 172.21.15.96:0/4024284821 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21340ab770 con 0x7f2144159aa0 2024-04-18T04:55:39.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.677+0000 7f214159a640 1 -- 172.21.15.96:0/4024284821 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21340abb00 con 0x7f2144159aa0 2024-04-18T04:55:39.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.677+0000 7f21489df640 1 -- 172.21.15.96:0/4024284821 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2144159aa0 msgr2=0x7f21440c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:39.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.677+0000 7f21489df640 1 --2- 172.21.15.96:0/4024284821 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2144159aa0 0x7f21440c9000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2134009870 tx=0x7f213401c540 comp rx=0 tx=0).stop 2024-04-18T04:55:39.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.677+0000 7f21489df640 1 -- 172.21.15.96:0/4024284821 shutdown_connections 2024-04-18T04:55:39.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.677+0000 7f21489df640 1 --2- 172.21.15.96:0/4024284821 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2144159aa0 0x7f21440c9000 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.677+0000 7f21489df640 1 --2- 172.21.15.96:0/4024284821 >> v2:172.21.15.139:3300/0 conn(0x7f2144156590 0x7f21440cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.677+0000 7f21489df640 1 -- 172.21.15.96:0/4024284821 >> 172.21.15.96:0/4024284821 conn(0x7f214406a6b0 msgr2=0x7f2144065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:39.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.677+0000 7f21489df640 1 -- 172.21.15.96:0/4024284821 shutdown_connections 2024-04-18T04:55:39.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.677+0000 7f21489df640 1 -- 172.21.15.96:0/4024284821 wait complete. 2024-04-18T04:55:39.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.677+0000 7f21489df640 1 Processor -- start 2024-04-18T04:55:39.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.677+0000 7f21489df640 1 -- start start 2024-04-18T04:55:39.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f21489df640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21440cbea0 0x7f21440c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f21489df640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2144156590 0x7f21441eb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f21489df640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2144159aa0 0x7f21441eb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f21489df640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21440c57c0 con 0x7f2144156590 2024-04-18T04:55:39.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f21489df640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21440c6620 con 0x7f21440cbea0 2024-04-18T04:55:39.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f21489df640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21440c5a80 con 0x7f2144159aa0 2024-04-18T04:55:39.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f2141d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2144156590 0x7f21441eb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f214259c640 1 -- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21440cbea0 msgr2=0x7f21440c7f50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:55:39.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f214259c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21440cbea0 0x7f21440c7f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:55:39.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f2141d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2144156590 0x7f21441eb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53994/0 (socket says 172.21.15.96:53994) 2024-04-18T04:55:39.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f2141d9b640 1 -- 172.21.15.96:0/3670098423 learned_addr learned my addr 172.21.15.96:0/3670098423 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:39.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f2142d9d640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2144159aa0 0x7f21441eb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f2141d9b640 1 -- 172.21.15.96:0/3670098423 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2144159aa0 msgr2=0x7f21441eb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:39.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f2141d9b640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2144159aa0 0x7f21441eb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f2141d9b640 1 -- 172.21.15.96:0/3670098423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21440cbea0 msgr2=0x7f21440c7f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:55:39.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f2141d9b640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21440cbea0 0x7f21440c7f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f2141d9b640 1 -- 172.21.15.96:0/3670098423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21340094d0 con 0x7f2144156590 2024-04-18T04:55:39.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f2141d9b640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2144156590 0x7f21441eb030 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f212c00b550 tx=0x7f212c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:39.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f213affd640 1 -- 172.21.15.96:0/3670098423 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c003d00 con 0x7f2144156590 2024-04-18T04:55:39.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f213affd640 1 -- 172.21.15.96:0/3670098423 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c003e80 con 0x7f2144156590 2024-04-18T04:55:39.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f213affd640 1 -- 172.21.15.96:0/3670098423 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c005330 con 0x7f2144156590 2024-04-18T04:55:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f21489df640 1 -- 172.21.15.96:0/3670098423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21440c5380 con 0x7f2144156590 2024-04-18T04:55:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f21489df640 1 -- 172.21.15.96:0/3670098423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21440c5cf0 con 0x7f2144156590 2024-04-18T04:55:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f21489df640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21440c8c80 0x7f21440c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f21489df640 1 -- 172.21.15.96:0/3670098423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214406abd0 con 0x7f21440c8c80 2024-04-18T04:55:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f214259c640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21440c8c80 0x7f21440c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f214259c640 1 -- 172.21.15.96:0/3670098423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f214406cb00 con 0x7f21440c8c80 2024-04-18T04:55:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f214259c640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21440c8c80 0x7f21440c5f10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f213c00bcc0 tx=0x7f213c009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f213affd640 1 -- 172.21.15.96:0/3670098423 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f212c005490 con 0x7f2144156590 2024-04-18T04:55:39.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f213affd640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2124066640 0x7f2124068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f2142d9d640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2124066640 0x7f2124068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f213affd640 1 -- 172.21.15.96:0/3670098423 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c014630 con 0x7f21440c8c80 2024-04-18T04:55:39.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f213affd640 1 -- 172.21.15.96:0/3670098423 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f212c084060 con 0x7f2144156590 2024-04-18T04:55:39.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f213affd640 1 -- 172.21.15.96:0/3670098423 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f213c00f070 con 0x7f21440c8c80 2024-04-18T04:55:39.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f213affd640 1 -- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21440c8c80 msgr2=0x7f21440c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:39.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f213affd640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21440c8c80 0x7f21440c5f10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f213c00bcc0 tx=0x7f213c009f30 comp rx=0 tx=0).stop 2024-04-18T04:55:39.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f213affd640 1 -- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21440c8c80 msgr2=0x7f21440c5f10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:55:39.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.681+0000 7f213affd640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21440c8c80 0x7f21440c5f10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.685+0000 7f2142d9d640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2124066640 0x7f2124068b00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f21340af000 tx=0x7f21340a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:39.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f21489df640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21441462a0 0x7f21441f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f21489df640 1 -- 172.21.15.96:0/3670098423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2144159f30 con 0x7f21441462a0 2024-04-18T04:55:39.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f214259c640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21441462a0 0x7f21441f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f214259c640 1 -- 172.21.15.96:0/3670098423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2144156970 con 0x7f21441462a0 2024-04-18T04:55:39.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f214259c640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21441462a0 0x7f21441f4ba0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f213c014000 tx=0x7f213c005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:39.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f213affd640 1 -- 172.21.15.96:0/3670098423 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c013bd0 con 0x7f21441462a0 2024-04-18T04:55:39.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f213affd640 1 -- 172.21.15.96:0/3670098423 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4965 (secure 0 0 0) 0x7f213c013d30 con 0x7f21441462a0 2024-04-18T04:55:39.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f213affd640 1 -- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21441462a0 msgr2=0x7f21441f4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:39.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f213affd640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21441462a0 0x7f21441f4ba0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f213c014000 tx=0x7f213c005db0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f213affd640 1 -- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21441462a0 msgr2=0x7f21441f4ba0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:55:39.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f213affd640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21441462a0 0x7f21441f4ba0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T04:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 8, 2024-04-18T04:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 1, 2024-04-18T04:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 7 2024-04-18T04:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 7 2024-04-18T04:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:55:39.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f21489df640 1 -- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2124066640 msgr2=0x7f2124068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:39.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f21489df640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2124066640 0x7f2124068b00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f21340af000 tx=0x7f21340a7000 comp rx=0 tx=0).stop 2024-04-18T04:55:39.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f21489df640 1 -- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2144156590 msgr2=0x7f21441eb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:39.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f21489df640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2144156590 0x7f21441eb030 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f212c00b550 tx=0x7f212c00ba10 comp rx=0 tx=0).stop 2024-04-18T04:55:39.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f2142d9d640 1 -- 172.21.15.96:0/3670098423 reap_dead start 2024-04-18T04:55:39.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f21489df640 1 -- 172.21.15.96:0/3670098423 shutdown_connections 2024-04-18T04:55:39.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f21489df640 1 --2- 172.21.15.96:0/3670098423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2144156590 0x7f21441eb030 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f21489df640 1 -- 172.21.15.96:0/3670098423 >> 172.21.15.96:0/3670098423 conn(0x7f214406a6b0 msgr2=0x7f214406ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:39.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f21489df640 1 -- 172.21.15.96:0/3670098423 shutdown_connections 2024-04-18T04:55:39.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.689+0000 7f21489df640 1 -- 172.21.15.96:0/3670098423 wait complete. 2024-04-18T04:55:39.706 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-18T04:55:39.707 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-18T04:55:39.707 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-18T04:55:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff09b6a0640 1 Processor -- start 2024-04-18T04:55:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff09b6a0640 1 -- start start 2024-04-18T04:55:39.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff09b6a0640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff0940c6830 0x7ff094156220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff09b6a0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff094071160 0x7ff094156760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff09b6a0640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff094070d60 con 0x7ff0940c6450 2024-04-18T04:55:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff09b6a0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0940c2cc0 con 0x7ff094071160 2024-04-18T04:55:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff09b6a0640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff094155d90 con 0x7ff0940c6830 2024-04-18T04:55:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff09943c640 1 -- >> v1:172.21.15.139:6789/0 conn(0x7ff0940c6450 legacy=0x7ff0940c1800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:55:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff099c3d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff094071160 0x7ff094156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff099c3d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff094071160 0x7ff094156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54026/0 (socket says 172.21.15.96:54026) 2024-04-18T04:55:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff099c3d640 1 -- 172.21.15.96:0/4071178318 learned_addr learned my addr 172.21.15.96:0/4071178318 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff098c3b640 1 --2- 172.21.15.96:0/4071178318 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff0940c6830 0x7ff094156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff099c3d640 1 -- 172.21.15.96:0/4071178318 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff0940c6830 msgr2=0x7ff094156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff099c3d640 1 --2- 172.21.15.96:0/4071178318 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff0940c6830 0x7ff094156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff099c3d640 1 -- 172.21.15.96:0/4071178318 >> v1:172.21.15.139:6789/0 conn(0x7ff0940c6450 legacy=0x7ff0940c1800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:55:39.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff099c3d640 1 -- 172.21.15.96:0/4071178318 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff094071750 con 0x7ff094071160 2024-04-18T04:55:39.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.813+0000 7ff099c3d640 1 --2- 172.21.15.96:0/4071178318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff094071160 0x7ff094156760 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009e50 tx=0x7ff08c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92bec20f8874690c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:39.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.817+0000 7ff08bfff640 1 -- 172.21.15.96:0/4071178318 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c0af400 con 0x7ff094071160 2024-04-18T04:55:39.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.817+0000 7ff08bfff640 1 -- 172.21.15.96:0/4071178318 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c0ab050 con 0x7ff094071160 2024-04-18T04:55:39.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.817+0000 7ff08bfff640 1 -- 172.21.15.96:0/4071178318 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c0af780 con 0x7ff094071160 2024-04-18T04:55:39.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.817+0000 7ff09b6a0640 1 -- 172.21.15.96:0/4071178318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff094071160 msgr2=0x7ff094156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:39.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.817+0000 7ff09b6a0640 1 --2- 172.21.15.96:0/4071178318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff094071160 0x7ff094156760 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009e50 tx=0x7ff08c01f1e0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.817+0000 7ff09b6a0640 1 -- 172.21.15.96:0/4071178318 shutdown_connections 2024-04-18T04:55:39.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.817+0000 7ff09b6a0640 1 --2- 172.21.15.96:0/4071178318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff094071160 0x7ff094156760 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.817+0000 7ff09b6a0640 1 --2- 172.21.15.96:0/4071178318 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff0940c6830 0x7ff094156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.817+0000 7ff09b6a0640 1 -- 172.21.15.96:0/4071178318 >> 172.21.15.96:0/4071178318 conn(0x7ff09406a8e0 msgr2=0x7ff0940c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:39.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.817+0000 7ff09b6a0640 1 -- 172.21.15.96:0/4071178318 shutdown_connections 2024-04-18T04:55:39.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.817+0000 7ff09b6a0640 1 -- 172.21.15.96:0/4071178318 wait complete. 2024-04-18T04:55:39.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.817+0000 7ff09b6a0640 1 Processor -- start 2024-04-18T04:55:39.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.817+0000 7ff09b6a0640 1 -- start start 2024-04-18T04:55:39.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.817+0000 7ff09b6a0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff094071160 0x7ff094143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.817+0000 7ff09b6a0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0940c6450 0x7ff0940c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff09b6a0640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff0940c6830 0x7ff0941f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff09b6a0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09414a850 con 0x7ff0940c6450 2024-04-18T04:55:39.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff09b6a0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09414d900 con 0x7ff094071160 2024-04-18T04:55:39.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff09b6a0640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09414bb00 con 0x7ff0940c6830 2024-04-18T04:55:39.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff098c3b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0940c6450 0x7ff0940c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff09943c640 1 -- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff094071160 msgr2=0x7ff094143230 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:55:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff098c3b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0940c6450 0x7ff0940c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54034/0 (socket says 172.21.15.96:54034) 2024-04-18T04:55:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff098c3b640 1 -- 172.21.15.96:0/2522461781 learned_addr learned my addr 172.21.15.96:0/2522461781 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:55:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff09943c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff094071160 0x7ff094143230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:55:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff098c3b640 1 -- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff0940c6830 msgr2=0x7ff0941f6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff098c3b640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff0940c6830 0x7ff0941f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff098c3b640 1 -- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff094071160 msgr2=0x7ff094143230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:55:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff098c3b640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff094071160 0x7ff094143230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff098c3b640 1 -- 172.21.15.96:0/2522461781 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c009b30 con 0x7ff0940c6450 2024-04-18T04:55:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff098c3b640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0940c6450 0x7ff0940c5410 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff08400d620 tx=0x7ff08400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff089ffb640 1 -- 172.21.15.96:0/2522461781 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08400b620 con 0x7ff0940c6450 2024-04-18T04:55:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff089ffb640 1 -- 172.21.15.96:0/2522461781 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08400b780 con 0x7ff0940c6450 2024-04-18T04:55:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff09b6a0640 1 -- 172.21.15.96:0/2522461781 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09414d540 con 0x7ff0940c6450 2024-04-18T04:55:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff089ffb640 1 -- 172.21.15.96:0/2522461781 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08400bb10 con 0x7ff0940c6450 2024-04-18T04:55:39.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff09b6a0640 1 -- 172.21.15.96:0/2522461781 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0941f5e00 con 0x7ff0940c6450 2024-04-18T04:55:39.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff09b6a0640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff09414f070 0x7ff09414a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff09b6a0640 1 -- 172.21.15.96:0/2522461781 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff094066b90 con 0x7ff09414f070 2024-04-18T04:55:39.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff09943c640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff09414f070 0x7ff09414a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff089ffb640 1 -- 172.21.15.96:0/2522461781 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff08400bc70 con 0x7ff0940c6450 2024-04-18T04:55:39.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff089ffb640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff078066670 0x7ff078068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff089ffb640 1 -- 172.21.15.96:0/2522461781 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff084084710 con 0x7ff0940c6450 2024-04-18T04:55:39.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff099c3d640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff078066670 0x7ff078068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff09943c640 1 -- 172.21.15.96:0/2522461781 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff094071fd0 con 0x7ff09414f070 2024-04-18T04:55:39.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff099c3d640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff078066670 0x7ff078068b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0b1000 tx=0x7ff08c004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:39.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff09943c640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff09414f070 0x7ff09414a290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff09000b450 tx=0x7ff09000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:39.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.821+0000 7ff089ffb640 1 -- 172.21.15.96:0/2522461781 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090003e20 con 0x7ff09414f070 2024-04-18T04:55:39.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.825+0000 7ff089ffb640 1 -- 172.21.15.96:0/2522461781 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7ff090005070 con 0x7ff09414f070 2024-04-18T04:55:39.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.825+0000 7ff089ffb640 1 -- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff09414f070 msgr2=0x7ff09414a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:39.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.825+0000 7ff089ffb640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff09414f070 0x7ff09414a290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff09000b450 tx=0x7ff09000b910 comp rx=0 tx=0).stop 2024-04-18T04:55:39.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.825+0000 7ff089ffb640 1 -- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff09414f070 msgr2=0x7ff09414a290 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:55:39.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.825+0000 7ff089ffb640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff09414f070 0x7ff09414a290 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff09000b450 tx=0x7ff09000b910 comp rx=0 tx=0).stop 2024-04-18T04:55:39.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.829+0000 7ff09b6a0640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff0941f67d0 0x7ff094140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:39.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.829+0000 7ff09b6a0640 1 -- 172.21.15.96:0/2522461781 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0941f5c90 con 0x7ff0941f67d0 2024-04-18T04:55:39.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.829+0000 7ff09943c640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff0941f67d0 0x7ff094140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:39.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.829+0000 7ff09943c640 1 -- 172.21.15.96:0/2522461781 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff094071cf0 con 0x7ff0941f67d0 2024-04-18T04:55:39.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.829+0000 7ff09943c640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff0941f67d0 0x7ff094140ae0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff09000b450 tx=0x7ff090005a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:39.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.833+0000 7ff089ffb640 1 -- 172.21.15.96:0/2522461781 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090020070 con 0x7ff0941f67d0 2024-04-18T04:55:39.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.833+0000 7ff089ffb640 1 -- 172.21.15.96:0/2522461781 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4793 (secure 0 0 0) 0x7ff09001bce0 con 0x7ff0941f67d0 2024-04-18T04:55:39.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.833+0000 7ff089ffb640 1 -- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff0941f67d0 msgr2=0x7ff094140ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:39.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.833+0000 7ff089ffb640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff0941f67d0 0x7ff094140ae0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff09000b450 tx=0x7ff090005a30 comp rx=0 tx=0).stop 2024-04-18T04:55:39.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.833+0000 7ff089ffb640 1 -- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff0941f67d0 msgr2=0x7ff094140ae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:55:39.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.833+0000 7ff089ffb640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff0941f67d0 0x7ff094140ae0 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff09000b450 tx=0x7ff090005a30 comp rx=0 tx=0).stop 2024-04-18T04:55:39.833 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:55:39.833 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:55:39.833 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:55:39.833 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:55:39.833 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 8, 2024-04-18T04:55:39.833 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:55:39.833 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:55:39.833 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:55:39.833 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:39.833 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 2, 2024-04-18T04:55:39.833 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:55:39.833 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:55:39.833 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:55:39.833 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:55:39.834 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:55:39.834 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:55:39.834 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:55:39.834 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:55:39.834 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:55:39.834 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:55:39.834 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:55:39.834 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:55:39.834 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:55:39.834 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:39.834 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:55:39.834 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:55:39.834 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:55:39.834 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:55:39.834 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:55:39.835 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:55:39.835 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:55:39.835 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:55:39.835 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:55:39.835 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:55:39.835 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:55:39.835 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:55:39.835 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:39.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.835 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:55:39.835 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:55:39.835 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:55:39.835 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:55:39.835 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:55:39.835 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:55:39.836 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:55:39.836 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:55:39.836 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:55:39.836 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:55:39.836 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:55:39.836 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:55:39.836 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:55:39.836 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:55:39.836 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:55:39.836 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:55:39.836 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:55:39.836 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:55:39.836 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:55:39.836 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:55:39.836 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:55:39.837 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:55:39.837 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:55:39.837 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:55:39.837 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:55:39.837 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:55:39.837 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:55:39.837 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:39.837 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:55:39.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.837 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:55:39.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.837 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:55:39.837 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:55:39.837 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:55:39.837 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:55:39.838 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.838 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:55:39.838 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:55:39.838 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:39.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.838 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.838 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:39.838 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:55:39.838 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:39.838 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.838 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:39.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.838 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:55:39.838 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:55:39.838 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:55:39.839 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:39.840 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.840 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:39.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.840 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:55:39.840 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:55:39.840 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:55:39.840 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:55:39.840 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:55:39.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.840 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:55:39.840 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:55:39.840 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:55:39.840 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:55:39.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.840 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:55:39.841 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:55:39.841 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:39.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.841 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:55:39.841 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:55:39.841 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:55:39.841 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.841 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:39.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.841 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:55:39.841 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:55:39.841 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:55:39.841 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:55:39.841 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:55:39.842 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.842 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:39.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.842 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:55:39.842 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:55:39.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.842 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:39.842 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:39.842 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:55:39.842 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.842 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:39.842 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:55:39.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.842 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:39.842 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:39.843 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:55:39.843 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.843 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:39.843 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:55:39.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.843 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:39.843 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:39.843 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:55:39.843 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.843 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:55:39.843 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:55:39.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:55:39.843 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:55:39.843 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:55:39.843 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:55:39.844 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:55:39.844 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:55:39.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:55:39.844 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:55:39.844 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:55:39.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.833+0000 7ff09b6a0640 1 -- 172.21.15.96:0/2522461781 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff078066670 msgr2=0x7ff078068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:39.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.833+0000 7ff09b6a0640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff078066670 0x7ff078068b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0b1000 tx=0x7ff08c004ac0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.833+0000 7ff09b6a0640 1 -- 172.21.15.96:0/2522461781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0940c6450 msgr2=0x7ff0940c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:39.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.833+0000 7ff09b6a0640 1 --2- 172.21.15.96:0/2522461781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0940c6450 0x7ff0940c5410 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff08400d620 tx=0x7ff08400dae0 comp rx=0 tx=0).stop 2024-04-18T04:55:39.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.833+0000 7ff099c3d640 1 -- 172.21.15.96:0/2522461781 reap_dead start 2024-04-18T04:55:39.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.833+0000 7ff099c3d640 1 -- 172.21.15.96:0/2522461781 reap_dead start 2024-04-18T04:55:39.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.833+0000 7ff09b6a0640 1 -- 172.21.15.96:0/2522461781 shutdown_connections 2024-04-18T04:55:39.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.833+0000 7ff09b6a0640 1 -- 172.21.15.96:0/2522461781 >> 172.21.15.96:0/2522461781 conn(0x7ff09406a8e0 msgr2=0x7ff0940c3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:39.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.833+0000 7ff09b6a0640 1 -- 172.21.15.96:0/2522461781 shutdown_connections 2024-04-18T04:55:39.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:39.833+0000 7ff09b6a0640 1 -- 172.21.15.96:0/2522461781 wait complete. 2024-04-18T04:55:39.847 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-18T04:55:39.847 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-18T04:55:47.496 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:55:47.499 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:55:59.847 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-18T04:55:59.848 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-04-18T04:55:59.848 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-18T04:55:59.848 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-18T04:55:59.851 INFO:tasks.ceph.mon.b:Started 2024-04-18T04:55:59.851 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-18T04:55:59.851 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:55:59.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:59.985+0000 7f55da48f640 1 Processor -- start 2024-04-18T04:55:59.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:59.985+0000 7f55da48f640 1 -- start start 2024-04-18T04:55:59.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:59.985+0000 7f55da48f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 0x7f55d40c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:59.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:59.985+0000 7f55da48f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d4159af0 con 0x7f55d40c7f10 2024-04-18T04:55:59.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:59.985+0000 7f55da48f640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d4158f40 con 0x7f55d415c530 2024-04-18T04:55:59.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:59.985+0000 7f55da48f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d4072460 con 0x7f55d4071210 2024-04-18T04:55:59.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:59.985+0000 7f55cb7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 0x7f55d40c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:59.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:59.985+0000 7f55d3fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f55d40c7f10 0x7f55d4071d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:56860/0 (socket says 172.21.15.96:56860) 2024-04-18T04:55:59.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:59.985+0000 7f55d3fff640 1 -- 172.21.15.96:0/2282749147 learned_addr learned my addr 172.21.15.96:0/2282749147 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:55:59.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:59.985+0000 7f55cb7fe640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 msgr2=0x7f55d40c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:55:59.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:59.985+0000 7f55cb7fe640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 msgr2=0x7f55d40c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:55:59.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:59.985+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 0x7f55d40c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:55:59.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:55:59.985+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 0x7f55d40c82f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:00.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:00.189+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 0x7f55d40c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:00.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:00.189+0000 7f55cb7fe640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 msgr2=0x7f55d40c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:56:00.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:00.189+0000 7f55cb7fe640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 msgr2=0x7f55d40c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:00.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:00.189+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 0x7f55d40c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:00.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:00.189+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 0x7f55d40c82f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:56:00.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:00.593+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 0x7f55d40c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:00.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:00.593+0000 7f55cb7fe640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 msgr2=0x7f55d40c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:56:00.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:00.593+0000 7f55cb7fe640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 msgr2=0x7f55d40c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:00.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:00.593+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 0x7f55d40c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:00.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:00.593+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 0x7f55d40c82f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:56:01.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:01.397+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 0x7f55d40c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:01.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:01.397+0000 7f55cb7fe640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 msgr2=0x7f55d40c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:56:01.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:01.397+0000 7f55cb7fe640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 msgr2=0x7f55d40c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:01.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:01.397+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 0x7f55d40c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:01.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:01.397+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 0x7f55d40c82f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:56:02.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55d27fc640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 msgr2=0x7f55d40c82f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:56:02.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55d27fc640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55d4071210 0x7f55d40c82f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:02.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55d27fc640 1 -- 172.21.15.96:0/2282749147 >> v1:172.21.15.139:6789/0 conn(0x7f55d415c530 legacy=0x7f55d41638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:02.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55d27fc640 1 -- 172.21.15.96:0/2282749147 >> v1:172.21.15.96:6789/0 conn(0x7f55d40c7f10 legacy=0x7f55d4071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:02.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55d27fc640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 0x7f55b4005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:02.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55d27fc640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 0x7f55b40086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:02.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55d27fc640 1 -- 172.21.15.96:0/2282749147 --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d4072460 con 0x7f55b40036d0 2024-04-18T04:56:02.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55d27fc640 1 -- 172.21.15.96:0/2282749147 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b4008dc0 con 0x7f55b4006200 2024-04-18T04:56:02.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55d3fff640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 0x7f55b4005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:02.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 0x7f55b40086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:02.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55cb7fe640 1 -- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 msgr2=0x7f55b40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:56:02.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55cb7fe640 1 -- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 msgr2=0x7f55b40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:02.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 0x7f55b40086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:02.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55d3fff640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 msgr2=0x7f55b4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:56:02.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55d3fff640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 msgr2=0x7f55b4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:02.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 0x7f55b40086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:02.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55d3fff640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 0x7f55b4005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:02.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:02.985+0000 7f55d3fff640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 0x7f55b4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:03.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.189+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 0x7f55b40086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:03.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.189+0000 7f55d3fff640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 0x7f55b4005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:03.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.189+0000 7f55cb7fe640 1 -- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 msgr2=0x7f55b40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:56:03.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.189+0000 7f55cb7fe640 1 -- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 msgr2=0x7f55b40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:03.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.189+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 0x7f55b40086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:03.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.189+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 0x7f55b40086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:56:03.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.189+0000 7f55d3fff640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 msgr2=0x7f55b4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:56:03.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.189+0000 7f55d3fff640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 msgr2=0x7f55b4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:03.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.189+0000 7f55d3fff640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 0x7f55b4005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:03.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.189+0000 7f55d3fff640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 0x7f55b4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:56:03.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.592+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 0x7f55b40086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:03.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.592+0000 7f55d3fff640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 0x7f55b4005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:03.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.592+0000 7f55cb7fe640 1 -- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 msgr2=0x7f55b40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:56:03.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.592+0000 7f55cb7fe640 1 -- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 msgr2=0x7f55b40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:03.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.592+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 0x7f55b40086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:03.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.592+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 0x7f55b40086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:56:03.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.592+0000 7f55d3fff640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 msgr2=0x7f55b4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:56:03.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.592+0000 7f55d3fff640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 msgr2=0x7f55b4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:03.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.592+0000 7f55d3fff640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 0x7f55b4005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:03.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:03.592+0000 7f55d3fff640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 0x7f55b4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:56:04.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:04.396+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 0x7f55b40086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:04.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:04.396+0000 7f55d3fff640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 0x7f55b4005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:04.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:04.396+0000 7f55cb7fe640 1 -- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 msgr2=0x7f55b40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:56:04.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:04.396+0000 7f55cb7fe640 1 -- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 msgr2=0x7f55b40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:04.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:04.396+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 0x7f55b40086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:04.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:04.396+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 0x7f55b40086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:56:04.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:04.396+0000 7f55d3fff640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 msgr2=0x7f55b4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:56:04.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:04.396+0000 7f55d3fff640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 msgr2=0x7f55b4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:04.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:04.396+0000 7f55d3fff640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 0x7f55b4005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:04.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:04.396+0000 7f55d3fff640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 0x7f55b4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:56:05.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.984+0000 7f55d27fc640 1 -- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 msgr2=0x7f55b40086a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:56:05.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.984+0000 7f55d27fc640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4006200 0x7f55b40086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:05.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.984+0000 7f55d27fc640 1 -- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 msgr2=0x7f55b4005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:56:05.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.984+0000 7f55d27fc640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.139:3300/0 conn(0x7f55b40036d0 0x7f55b4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:05.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.984+0000 7f55d8a2c640 1 -- 172.21.15.96:0/2282749147 reap_dead start 2024-04-18T04:56:05.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.984+0000 7f55d27fc640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55b4006690 0x7f55b4006a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:05.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.984+0000 7f55d27fc640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4005af0 0x7f55b4006fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:05.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.984+0000 7f55d27fc640 1 -- 172.21.15.96:0/2282749147 --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d40717c0 con 0x7f55b4007520 2024-04-18T04:56:05.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.984+0000 7f55d27fc640 1 -- 172.21.15.96:0/2282749147 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d4072460 con 0x7f55b4006690 2024-04-18T04:56:05.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.984+0000 7f55d27fc640 1 -- 172.21.15.96:0/2282749147 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b4008dc0 con 0x7f55b4005af0 2024-04-18T04:56:05.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.984+0000 7f55d3fff640 1 --2- 172.21.15.96:0/2282749147 >> v2:172.21.15.96:3300/0 conn(0x7f55b4006690 0x7f55b4006a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:05.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.984+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4005af0 0x7f55b4006fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:05.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.984+0000 7f55d3fff640 1 -- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4005af0 msgr2=0x7f55b4006fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:05.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.984+0000 7f55d3fff640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4005af0 0x7f55b4006fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:05.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.984+0000 7f55d3fff640 1 -- 172.21.15.96:0/2282749147 >> v1:172.21.15.139:6789/0 conn(0x7f55b4007520 legacy=0x7f55b40079d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:05.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.984+0000 7f55d3fff640 1 -- 172.21.15.96:0/2282749147 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b4008430 con 0x7f55b4006690 2024-04-18T04:56:05.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.988+0000 7f55d3fff640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b4006690 0x7f55b4006a70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f55b4006090 tx=0x7f55c401cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a31a11ef7fd4ab server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:05.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.988+0000 7f55d37fe640 1 -- 172.21.15.96:0/2282749147 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c40a5d60 con 0x7f55b4006690 2024-04-18T04:56:05.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.988+0000 7f55d37fe640 1 -- 172.21.15.96:0/2282749147 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c40a9070 con 0x7f55b4006690 2024-04-18T04:56:05.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.988+0000 7f55d37fe640 1 -- 172.21.15.96:0/2282749147 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c40af640 con 0x7f55b4006690 2024-04-18T04:56:05.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.988+0000 7f55da48f640 1 -- 172.21.15.96:0/2282749147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b4006690 msgr2=0x7f55b4006a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:05.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.988+0000 7f55da48f640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b4006690 0x7f55b4006a70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f55b4006090 tx=0x7f55c401cec0 comp rx=0 tx=0).stop 2024-04-18T04:56:05.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.988+0000 7f55da48f640 1 -- 172.21.15.96:0/2282749147 shutdown_connections 2024-04-18T04:56:05.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.988+0000 7f55da48f640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4005af0 0x7f55b4006fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:05.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.988+0000 7f55da48f640 1 --2- 172.21.15.96:0/2282749147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b4006690 0x7f55b4006a70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:05.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.988+0000 7f55da48f640 1 -- 172.21.15.96:0/2282749147 >> 172.21.15.96:0/2282749147 conn(0x7f55d4066250 msgr2=0x7f55d406eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:05.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.988+0000 7f55da48f640 1 -- 172.21.15.96:0/2282749147 shutdown_connections 2024-04-18T04:56:05.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.988+0000 7f55da48f640 1 -- 172.21.15.96:0/2282749147 wait complete. 2024-04-18T04:56:05.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55da48f640 1 Processor -- start 2024-04-18T04:56:05.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55da48f640 1 -- start start 2024-04-18T04:56:05.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55da48f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55b4005af0 0x7f55d4148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:05.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55da48f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b4006690 0x7f55d414f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:05.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55da48f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4007520 0x7f55d414dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:05.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55da48f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d40c7900 con 0x7f55b4006690 2024-04-18T04:56:05.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55da48f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d414f9e0 con 0x7f55b4005af0 2024-04-18T04:56:05.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55da48f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d4152640 con 0x7f55b4007520 2024-04-18T04:56:05.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55cb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b4006690 0x7f55d414f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:05.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55cb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b4006690 0x7f55d414f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53310/0 (socket says 172.21.15.96:53310) 2024-04-18T04:56:05.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55cb7fe640 1 -- 172.21.15.96:0/854083722 learned_addr learned my addr 172.21.15.96:0/854083722 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:05.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55d3fff640 1 --2- 172.21.15.96:0/854083722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55b4005af0 0x7f55d4148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:05.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55d8a2c640 1 --2- 172.21.15.96:0/854083722 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4007520 0x7f55d414dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:05.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55cb7fe640 1 -- 172.21.15.96:0/854083722 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4007520 msgr2=0x7f55d414dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:05.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/854083722 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4007520 0x7f55d414dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:05.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55cb7fe640 1 -- 172.21.15.96:0/854083722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55b4005af0 msgr2=0x7f55d4148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:05.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/854083722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55b4005af0 0x7f55d4148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:05.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55cb7fe640 1 -- 172.21.15.96:0/854083722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c400f040 con 0x7f55b4006690 2024-04-18T04:56:05.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55d8a2c640 1 --2- 172.21.15.96:0/854083722 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4007520 0x7f55d414dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:56:05.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55cb7fe640 1 --2- 172.21.15.96:0/854083722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b4006690 0x7f55d414f4a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0189e0 tx=0x7f55bc018ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:05.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55d17fa640 1 -- 172.21.15.96:0/854083722 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc014d10 con 0x7f55b4006690 2024-04-18T04:56:05.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55d17fa640 1 -- 172.21.15.96:0/854083722 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc01f040 con 0x7f55b4006690 2024-04-18T04:56:05.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55da48f640 1 -- 172.21.15.96:0/854083722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d414d800 con 0x7f55b4006690 2024-04-18T04:56:05.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55d17fa640 1 -- 172.21.15.96:0/854083722 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0235f0 con 0x7f55b4006690 2024-04-18T04:56:05.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55da48f640 1 -- 172.21.15.96:0/854083722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d40c7af0 con 0x7f55b4006690 2024-04-18T04:56:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55da48f640 1 -- 172.21.15.96:0/854083722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d414d990 con 0x7f55b4006690 2024-04-18T04:56:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.992+0000 7f55d17fa640 1 -- 172.21.15.96:0/854083722 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f55bc023750 con 0x7f55b4006690 2024-04-18T04:56:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.996+0000 7f55d17fa640 1 --2- 172.21.15.96:0/854083722 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f55b406b370 0x7f55b406d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.996+0000 7f55d3fff640 1 --2- 172.21.15.96:0/854083722 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f55b406b370 0x7f55b406d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.996+0000 7f55d17fa640 1 -- 172.21.15.96:0/854083722 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f55bc085740 con 0x7f55b4006690 2024-04-18T04:56:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:05.996+0000 7f55d3fff640 1 --2- 172.21.15.96:0/854083722 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f55b406b370 0x7f55b406d830 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f55c40b0000 tx=0x7f55c40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.000+0000 7f55d17fa640 1 -- 172.21.15.96:0/854083722 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f55bc052a90 con 0x7f55b4006690 2024-04-18T04:56:06.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.296+0000 7f55da48f640 1 -- 172.21.15.96:0/854083722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f55d4067050 con 0x7f55b4006690 2024-04-18T04:56:06.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.300+0000 7f55d17fa640 1 -- 172.21.15.96:0/854083722 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f55bc0560b0 con 0x7f55b4006690 2024-04-18T04:56:06.300 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:56:06.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.300+0000 7f55da48f640 1 -- 172.21.15.96:0/854083722 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f55b406b370 msgr2=0x7f55b406d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.300+0000 7f55da48f640 1 --2- 172.21.15.96:0/854083722 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f55b406b370 0x7f55b406d830 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f55c40b0000 tx=0x7f55c40a7070 comp rx=0 tx=0).stop 2024-04-18T04:56:06.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.300+0000 7f55da48f640 1 -- 172.21.15.96:0/854083722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b4006690 msgr2=0x7f55d414f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.300+0000 7f55da48f640 1 --2- 172.21.15.96:0/854083722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b4006690 0x7f55d414f4a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0189e0 tx=0x7f55bc018ea0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.300+0000 7f55da48f640 1 -- 172.21.15.96:0/854083722 shutdown_connections 2024-04-18T04:56:06.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.300+0000 7f55da48f640 1 --2- 172.21.15.96:0/854083722 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f55b406b370 0x7f55b406d830 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.300+0000 7f55da48f640 1 --2- 172.21.15.96:0/854083722 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55b4007520 0x7f55d414dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.300+0000 7f55da48f640 1 --2- 172.21.15.96:0/854083722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55b4006690 0x7f55d414f4a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.300+0000 7f55da48f640 1 --2- 172.21.15.96:0/854083722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55b4005af0 0x7f55d4148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.300+0000 7f55da48f640 1 -- 172.21.15.96:0/854083722 >> 172.21.15.96:0/854083722 conn(0x7f55d4066250 msgr2=0x7f55d40cb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:06.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.300+0000 7f55da48f640 1 -- 172.21.15.96:0/854083722 shutdown_connections 2024-04-18T04:56:06.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.300+0000 7f55da48f640 1 -- 172.21.15.96:0/854083722 wait complete. 2024-04-18T04:56:06.318 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-18T04:56:06.318 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-18T04:56:06.318 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T04:56:06.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.448+0000 7f8086dd6640 1 Processor -- start 2024-04-18T04:56:06.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.448+0000 7f8086dd6640 1 -- start start 2024-04-18T04:56:06.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.448+0000 7f8086dd6640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f80800c89a0 0x7f8080070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f8086dd6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f808015a860 0x7f808015aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f8086dd6640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8080157be0 con 0x7f8080150cb0 2024-04-18T04:56:06.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f8086dd6640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808015b1e0 con 0x7f808015a860 2024-04-18T04:56:06.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f8086dd6640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808015a3d0 con 0x7f80800c89a0 2024-04-18T04:56:06.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f8085373640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f808015a860 0x7f808015aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f8085373640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f808015a860 0x7f808015aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53314/0 (socket says 172.21.15.96:53314) 2024-04-18T04:56:06.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f8085373640 1 -- 172.21.15.96:0/2736662989 learned_addr learned my addr 172.21.15.96:0/2736662989 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:06.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f807ffff640 1 --2- 172.21.15.96:0/2736662989 >> v2:172.21.15.139:3300/0 conn(0x7f80800c89a0 0x7f8080070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f8085373640 1 -- 172.21.15.96:0/2736662989 >> v2:172.21.15.139:3300/0 conn(0x7f80800c89a0 msgr2=0x7f8080070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:06.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f8085373640 1 --2- 172.21.15.96:0/2736662989 >> v2:172.21.15.139:3300/0 conn(0x7f80800c89a0 0x7f8080070fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f8085373640 1 -- 172.21.15.96:0/2736662989 >> v1:172.21.15.139:6789/0 conn(0x7f8080150cb0 legacy=0x7f80800c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:06.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f8085373640 1 -- 172.21.15.96:0/2736662989 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80800c5740 con 0x7f808015a860 2024-04-18T04:56:06.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f807ffff640 1 --2- 172.21.15.96:0/2736662989 >> v2:172.21.15.139:3300/0 conn(0x7f80800c89a0 0x7f8080070fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:56:06.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f8085373640 1 --2- 172.21.15.96:0/2736662989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f808015a860 0x7f808015aca0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f80800cb320 tx=0x7f807801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42048b7ee8b35861 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f807f7fe640 1 -- 172.21.15.96:0/2736662989 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80780a5880 con 0x7f808015a860 2024-04-18T04:56:06.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f807f7fe640 1 -- 172.21.15.96:0/2736662989 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80780a59e0 con 0x7f808015a860 2024-04-18T04:56:06.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.452+0000 7f807f7fe640 1 -- 172.21.15.96:0/2736662989 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80780a5d70 con 0x7f808015a860 2024-04-18T04:56:06.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8086dd6640 1 -- 172.21.15.96:0/2736662989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f808015a860 msgr2=0x7f808015aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8086dd6640 1 --2- 172.21.15.96:0/2736662989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f808015a860 0x7f808015aca0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f80800cb320 tx=0x7f807801c9c0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8086dd6640 1 -- 172.21.15.96:0/2736662989 shutdown_connections 2024-04-18T04:56:06.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8086dd6640 1 --2- 172.21.15.96:0/2736662989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f808015a860 0x7f808015aca0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8086dd6640 1 --2- 172.21.15.96:0/2736662989 >> v2:172.21.15.139:3300/0 conn(0x7f80800c89a0 0x7f8080070fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8086dd6640 1 -- 172.21.15.96:0/2736662989 >> 172.21.15.96:0/2736662989 conn(0x7f80800c7e80 msgr2=0x7f80800c8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:06.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8086dd6640 1 -- 172.21.15.96:0/2736662989 shutdown_connections 2024-04-18T04:56:06.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8086dd6640 1 -- 172.21.15.96:0/2736662989 wait complete. 2024-04-18T04:56:06.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8086dd6640 1 Processor -- start 2024-04-18T04:56:06.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8086dd6640 1 -- start start 2024-04-18T04:56:06.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8086dd6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80800c89a0 0x7f80801f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8086dd6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8080150cb0 0x7f8080158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8086dd6640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f808015a860 0x7f808013f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8086dd6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8080140930 con 0x7f8080150cb0 2024-04-18T04:56:06.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8086dd6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8080156080 con 0x7f80800c89a0 2024-04-18T04:56:06.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8086dd6640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8080156360 con 0x7f808015a860 2024-04-18T04:56:06.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f807ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8080150cb0 0x7f8080158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f807ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8080150cb0 0x7f8080158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53326/0 (socket says 172.21.15.96:53326) 2024-04-18T04:56:06.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f807ffff640 1 -- 172.21.15.96:0/1020707160 learned_addr learned my addr 172.21.15.96:0/1020707160 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:06.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8084b72640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80800c89a0 0x7f80801f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f8085373640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f808015a860 0x7f808013f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f807ffff640 1 -- 172.21.15.96:0/1020707160 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f808015a860 msgr2=0x7f808013f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f807ffff640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f808015a860 0x7f808013f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f807ffff640 1 -- 172.21.15.96:0/1020707160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80800c89a0 msgr2=0x7f80801f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f807ffff640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80800c89a0 0x7f80801f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f807ffff640 1 -- 172.21.15.96:0/1020707160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8078009b30 con 0x7f8080150cb0 2024-04-18T04:56:06.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f807ffff640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8080150cb0 0x7f8080158040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f806c00c7c0 tx=0x7f806c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f807d7fa640 1 -- 172.21.15.96:0/1020707160 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c007a30 con 0x7f8080150cb0 2024-04-18T04:56:06.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.456+0000 7f807d7fa640 1 -- 172.21.15.96:0/1020707160 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c007b90 con 0x7f8080150cb0 2024-04-18T04:56:06.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f807d7fa640 1 -- 172.21.15.96:0/1020707160 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c00ce70 con 0x7f8080150cb0 2024-04-18T04:56:06.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f8086dd6640 1 -- 172.21.15.96:0/1020707160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80801402e0 con 0x7f8080150cb0 2024-04-18T04:56:06.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f8086dd6640 1 -- 172.21.15.96:0/1020707160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8080156b10 con 0x7f8080150cb0 2024-04-18T04:56:06.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f8086dd6640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8080140da0 0x7f808013aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f8086dd6640 1 -- 172.21.15.96:0/1020707160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8080141180 con 0x7f8080140da0 2024-04-18T04:56:06.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f8084b72640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8080140da0 0x7f808013aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f8084b72640 1 -- 172.21.15.96:0/1020707160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8080151090 con 0x7f8080140da0 2024-04-18T04:56:06.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f807d7fa640 1 -- 172.21.15.96:0/1020707160 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f806c0113f0 con 0x7f8080150cb0 2024-04-18T04:56:06.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f8084b72640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8080140da0 0x7f808013aac0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f807400e4d0 tx=0x7f807400e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f807d7fa640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8064066690 0x7f8064068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f807d7fa640 1 -- 172.21.15.96:0/1020707160 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f806c084790 con 0x7f8080150cb0 2024-04-18T04:56:06.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f8085373640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8064066690 0x7f8064068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f807d7fa640 1 -- 172.21.15.96:0/1020707160 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80740052e0 con 0x7f8080140da0 2024-04-18T04:56:06.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f807d7fa640 1 -- 172.21.15.96:0/1020707160 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f8074005440 con 0x7f8080140da0 2024-04-18T04:56:06.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f807d7fa640 1 -- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8080140da0 msgr2=0x7f808013aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f807d7fa640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8080140da0 0x7f808013aac0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f807400e4d0 tx=0x7f807400e990 comp rx=0 tx=0).stop 2024-04-18T04:56:06.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f807d7fa640 1 -- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8080140da0 msgr2=0x7f808013aac0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:56:06.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f807d7fa640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8080140da0 0x7f808013aac0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.460+0000 7f8085373640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8064066690 0x7f8064068b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f80780ae000 tx=0x7f80780a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f8086dd6640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f808013b000 0x7f8080141430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f8086dd6640 1 -- 172.21.15.96:0/1020707160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8080066b90 con 0x7f808013b000 2024-04-18T04:56:06.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f8084b72640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f808013b000 0x7f8080141430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f8084b72640 1 -- 172.21.15.96:0/1020707160 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8080157900 con 0x7f808013b000 2024-04-18T04:56:06.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f8084b72640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f808013b000 0x7f8080141430 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f807400e4d0 tx=0x7f8074001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f807d7fa640 1 -- 172.21.15.96:0/1020707160 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074022070 con 0x7f808013b000 2024-04-18T04:56:06.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f807d7fa640 1 -- 172.21.15.96:0/1020707160 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7f8074006c70 con 0x7f808013b000 2024-04-18T04:56:06.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f807d7fa640 1 -- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f808013b000 msgr2=0x7f8080141430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f807d7fa640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f808013b000 0x7f8080141430 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f807400e4d0 tx=0x7f8074001130 comp rx=0 tx=0).stop 2024-04-18T04:56:06.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f807d7fa640 1 -- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f808013b000 msgr2=0x7f8080141430 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:56:06.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f807d7fa640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f808013b000 0x7f8080141430 secure :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f807400e4d0 tx=0x7f8074001130 comp rx=0 tx=0).stop 2024-04-18T04:56:06.470 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:56:06.470 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:56:06.470 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:56:06.470 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T04:56:06.471 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 16, 2024-04-18T04:56:06.471 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:56:06.471 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:56:06.471 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:56:06.471 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:56:06.471 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.471 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 1, 2024-04-18T04:56:06.471 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:56:06.471 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:56:06.471 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:56:06.471 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:06.471 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:06.471 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:06.471 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:06.472 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:06.472 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:06.472 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:06.472 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:06.472 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:06.472 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:06.472 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.472 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:56:06.472 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:56:06.472 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:06.472 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:06.472 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:06.472 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:06.472 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:06.472 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:06.473 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:06.473 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:06.473 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:06.473 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:06.473 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.473 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:56:06.473 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:56:06.473 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:56:06.473 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:56:06.473 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:56:06.473 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:56:06.473 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:56:06.473 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:56:06.473 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:56:06.474 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:56:06.474 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:56:06.474 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:56:06.474 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:56:06.474 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:56:06.474 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:56:06.474 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:56:06.474 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:56:06.474 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:06.474 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:06.474 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:06.474 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:06.474 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:06.474 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:06.475 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:06.475 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:06.475 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:06.475 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:06.475 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.475 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:56:06.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.475 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:56:06.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.475 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:56:06.475 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:56:06.475 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:06.475 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:06.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.475 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:06.476 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:56:06.476 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.476 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.476 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:06.476 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:56:06.476 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.476 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.476 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.476 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:56:06.476 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:56:06.476 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:06.476 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:06.477 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:06.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.477 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.477 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:56:06.477 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:56:06.477 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:06.477 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:06.477 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.477 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:06.477 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:56:06.477 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.477 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.477 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:06.478 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:56:06.478 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.478 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.478 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.478 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:56:06.478 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:56:06.478 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:06.478 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:06.478 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:06.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.478 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.478 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:56:06.478 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:56:06.479 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:06.479 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:06.479 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.479 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:06.479 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:56:06.479 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.479 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.479 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.479 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:06.479 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:56:06.479 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.479 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.479 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.479 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.479 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:56:06.480 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:56:06.480 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:06.480 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:06.480 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:06.480 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.480 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.480 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:56:06.480 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:56:06.480 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.480 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:06.480 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:06.480 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:56:06.480 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.480 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.481 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:56:06.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.481 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:06.481 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:06.481 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:56:06.481 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.481 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.481 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:56:06.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.481 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:06.481 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:06.481 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 7 2024-04-18T04:56:06.481 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.481 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.481 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:56:06.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.482 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:06.482 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:06.482 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 7 2024-04-18T04:56:06.482 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.482 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.482 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:56:06.482 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.482 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:06.482 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:06.482 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:56:06.482 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.482 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.482 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:56:06.482 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:56:06.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f8086dd6640 1 -- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8064066690 msgr2=0x7f8064068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f8086dd6640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8064066690 0x7f8064068b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f80780ae000 tx=0x7f80780a7070 comp rx=0 tx=0).stop 2024-04-18T04:56:06.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f8085373640 1 -- 172.21.15.96:0/1020707160 reap_dead start 2024-04-18T04:56:06.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f8086dd6640 1 -- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8080150cb0 msgr2=0x7f8080158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f8086dd6640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8080150cb0 0x7f8080158040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f806c00c7c0 tx=0x7f806c00cc80 comp rx=0 tx=0).stop 2024-04-18T04:56:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f8086dd6640 1 -- 172.21.15.96:0/1020707160 shutdown_connections 2024-04-18T04:56:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f8086dd6640 1 --2- 172.21.15.96:0/1020707160 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8080150cb0 0x7f8080158040 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f8086dd6640 1 -- 172.21.15.96:0/1020707160 >> 172.21.15.96:0/1020707160 conn(0x7f80800c7e80 msgr2=0x7f80800c8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f8086dd6640 1 -- 172.21.15.96:0/1020707160 shutdown_connections 2024-04-18T04:56:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.468+0000 7f8086dd6640 1 -- 172.21.15.96:0/1020707160 wait complete. 2024-04-18T04:56:06.485 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:56:06.485 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-18T04:56:06.485 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-18T04:56:06.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.588+0000 7fae84991640 1 Processor -- start 2024-04-18T04:56:06.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.588+0000 7fae84991640 1 -- start start 2024-04-18T04:56:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae84991640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fae8014fea0 0x7fae800cb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae84991640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fae8006e300 0x7fae800cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae84991640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae800c7c80 con 0x7fae8006ea10 2024-04-18T04:56:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae84991640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae80150280 con 0x7fae8006e300 2024-04-18T04:56:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae84991640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae800c76c0 con 0x7fae8014fea0 2024-04-18T04:56:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae7dd9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fae8006e300 0x7fae800cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae7dd9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fae8006e300 0x7fae800cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53344/0 (socket says 172.21.15.96:53344) 2024-04-18T04:56:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae7dd9b640 1 -- 172.21.15.96:0/245175762 learned_addr learned my addr 172.21.15.96:0/245175762 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae7e59c640 1 --2- 172.21.15.96:0/245175762 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fae8014fea0 0x7fae800cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae7dd9b640 1 -- 172.21.15.96:0/245175762 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fae8014fea0 msgr2=0x7fae800cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae7dd9b640 1 --2- 172.21.15.96:0/245175762 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fae8014fea0 0x7fae800cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae7dd9b640 1 -- 172.21.15.96:0/245175762 >> v1:172.21.15.139:6789/0 conn(0x7fae8006ea10 legacy=0x7fae80155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae7dd9b640 1 -- 172.21.15.96:0/245175762 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae800c79a0 con 0x7fae8006e300 2024-04-18T04:56:06.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae7dd9b640 1 --2- 172.21.15.96:0/245175762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae8006e300 0x7fae800cbc70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fae74009870 tx=0x7fae7401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3ee184d796ab42 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae7d59a640 1 -- 172.21.15.96:0/245175762 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae740a8a50 con 0x7fae8006e300 2024-04-18T04:56:06.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae7d59a640 1 -- 172.21.15.96:0/245175762 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae740a8bb0 con 0x7fae8006e300 2024-04-18T04:56:06.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae7d59a640 1 -- 172.21.15.96:0/245175762 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae740b0440 con 0x7fae8006e300 2024-04-18T04:56:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae84991640 1 -- 172.21.15.96:0/245175762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae8006e300 msgr2=0x7fae800cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae84991640 1 --2- 172.21.15.96:0/245175762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae8006e300 0x7fae800cbc70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fae74009870 tx=0x7fae7401ed50 comp rx=0 tx=0).stop 2024-04-18T04:56:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.592+0000 7fae84991640 1 -- 172.21.15.96:0/245175762 shutdown_connections 2024-04-18T04:56:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae84991640 1 --2- 172.21.15.96:0/245175762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae8006e300 0x7fae800cbc70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae84991640 1 --2- 172.21.15.96:0/245175762 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fae8014fea0 0x7fae800cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae84991640 1 -- 172.21.15.96:0/245175762 >> 172.21.15.96:0/245175762 conn(0x7fae8006b140 msgr2=0x7fae8006b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae84991640 1 -- 172.21.15.96:0/245175762 shutdown_connections 2024-04-18T04:56:06.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae84991640 1 -- 172.21.15.96:0/245175762 wait complete. 2024-04-18T04:56:06.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae84991640 1 Processor -- start 2024-04-18T04:56:06.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae84991640 1 -- start start 2024-04-18T04:56:06.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae84991640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8006e300 0x7fae800c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae84991640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fae8006ea10 0x7fae8013dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae84991640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae8014fea0 0x7fae8013e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae84991640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae801ec7a0 con 0x7fae8014fea0 2024-04-18T04:56:06.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae84991640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8013e970 con 0x7fae8006e300 2024-04-18T04:56:06.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae84991640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8014af00 con 0x7fae8006ea10 2024-04-18T04:56:06.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae7ed9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae8014fea0 0x7fae8013e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae7ed9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae8014fea0 0x7fae8013e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53356/0 (socket says 172.21.15.96:53356) 2024-04-18T04:56:06.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae7ed9d640 1 -- 172.21.15.96:0/277480958 learned_addr learned my addr 172.21.15.96:0/277480958 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:06.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae7e59c640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8006e300 0x7fae800c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae7dd9b640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fae8006ea10 0x7fae8013dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae7ed9d640 1 -- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fae8006ea10 msgr2=0x7fae8013dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae7ed9d640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fae8006ea10 0x7fae8013dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae7ed9d640 1 -- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8006e300 msgr2=0x7fae800c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae7ed9d640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8006e300 0x7fae800c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae7ed9d640 1 -- 172.21.15.96:0/277480958 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae740094d0 con 0x7fae8014fea0 2024-04-18T04:56:06.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae7ed9d640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae8014fea0 0x7fae8013e2b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fae7800c710 tx=0x7fae7800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae6effd640 1 -- 172.21.15.96:0/277480958 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae78006d60 con 0x7fae8014fea0 2024-04-18T04:56:06.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae84991640 1 -- 172.21.15.96:0/277480958 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8014b1e0 con 0x7fae8014fea0 2024-04-18T04:56:06.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.596+0000 7fae6effd640 1 -- 172.21.15.96:0/277480958 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7800ce20 con 0x7fae8014fea0 2024-04-18T04:56:06.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae6effd640 1 -- 172.21.15.96:0/277480958 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae78003bc0 con 0x7fae8014fea0 2024-04-18T04:56:06.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae84991640 1 -- 172.21.15.96:0/277480958 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8014b7a0 con 0x7fae8014fea0 2024-04-18T04:56:06.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae84991640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8014bdc0 0x7fae800caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae84991640 1 -- 172.21.15.96:0/277480958 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae80066b90 con 0x7fae8014bdc0 2024-04-18T04:56:06.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae7e59c640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8014bdc0 0x7fae800caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae6effd640 1 -- 172.21.15.96:0/277480958 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fae78003d20 con 0x7fae8014fea0 2024-04-18T04:56:06.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae7e59c640 1 -- 172.21.15.96:0/277480958 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae800c2d90 con 0x7fae8014bdc0 2024-04-18T04:56:06.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae6effd640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fae60066690 0x7fae60068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae7dd9b640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fae60066690 0x7fae60068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae6effd640 1 -- 172.21.15.96:0/277480958 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fae78083ca0 con 0x7fae8014fea0 2024-04-18T04:56:06.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae7e59c640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8014bdc0 0x7fae800caac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fae7000f410 tx=0x7fae7000f8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae6effd640 1 -- 172.21.15.96:0/277480958 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70014870 con 0x7fae8014bdc0 2024-04-18T04:56:06.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae7dd9b640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fae60066690 0x7fae60068b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae740b2000 tx=0x7fae740aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae6effd640 1 -- 172.21.15.96:0/277480958 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fae700149d0 con 0x7fae8014bdc0 2024-04-18T04:56:06.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae6effd640 1 -- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8014bdc0 msgr2=0x7fae800caac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae6effd640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8014bdc0 0x7fae800caac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fae7000f410 tx=0x7fae7000f8d0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae6effd640 1 -- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8014bdc0 msgr2=0x7fae800caac0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:56:06.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.600+0000 7fae6effd640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8014bdc0 0x7fae800caac0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.612+0000 7fae84991640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae801ecbd0 0x7fae801ecfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.612+0000 7fae84991640 1 -- 172.21.15.96:0/277480958 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae800c3070 con 0x7fae801ecbd0 2024-04-18T04:56:06.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.612+0000 7fae7e59c640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae801ecbd0 0x7fae801ecfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.612+0000 7fae7e59c640 1 -- 172.21.15.96:0/277480958 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fae801ec8e0 con 0x7fae801ecbd0 2024-04-18T04:56:06.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.612+0000 7fae7e59c640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae801ecbd0 0x7fae801ecfe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fae7001a000 tx=0x7fae700046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.612+0000 7fae6effd640 1 -- 172.21.15.96:0/277480958 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70020510 con 0x7fae801ecbd0 2024-04-18T04:56:06.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.612+0000 7fae6effd640 1 -- 172.21.15.96:0/277480958 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7fae70003ec0 con 0x7fae801ecbd0 2024-04-18T04:56:06.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.612+0000 7fae6effd640 1 -- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae801ecbd0 msgr2=0x7fae801ecfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.612+0000 7fae6effd640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae801ecbd0 0x7fae801ecfe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fae7001a000 tx=0x7fae700046d0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.612+0000 7fae6effd640 1 -- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae801ecbd0 msgr2=0x7fae801ecfe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:56:06.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.612+0000 7fae6effd640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae801ecbd0 0x7fae801ecfe0 secure :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fae7001a000 tx=0x7fae700046d0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 16, 2024-04-18T04:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 1, 2024-04-18T04:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:56:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.616+0000 7fae84991640 1 -- 172.21.15.96:0/277480958 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fae60066690 msgr2=0x7fae60068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.616+0000 7fae84991640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fae60066690 0x7fae60068b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae740b2000 tx=0x7fae740aa070 comp rx=0 tx=0).stop 2024-04-18T04:56:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.616+0000 7fae84991640 1 -- 172.21.15.96:0/277480958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae8014fea0 msgr2=0x7fae8013e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.616+0000 7fae84991640 1 --2- 172.21.15.96:0/277480958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae8014fea0 0x7fae8013e2b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fae7800c710 tx=0x7fae7800cbd0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.616+0000 7fae7ed9d640 1 -- 172.21.15.96:0/277480958 reap_dead start 2024-04-18T04:56:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.616+0000 7fae7ed9d640 1 -- 172.21.15.96:0/277480958 reap_dead start 2024-04-18T04:56:06.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.616+0000 7fae84991640 1 -- 172.21.15.96:0/277480958 shutdown_connections 2024-04-18T04:56:06.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.616+0000 7fae84991640 1 -- 172.21.15.96:0/277480958 >> 172.21.15.96:0/277480958 conn(0x7fae8006b140 msgr2=0x7fae80071060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:06.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.616+0000 7fae84991640 1 -- 172.21.15.96:0/277480958 shutdown_connections 2024-04-18T04:56:06.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.616+0000 7fae84991640 1 -- 172.21.15.96:0/277480958 wait complete. 2024-04-18T04:56:06.632 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:56:06.632 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-18T04:56:06.632 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-18T04:56:06.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.768+0000 7f1e013a7640 1 Processor -- start 2024-04-18T04:56:06.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.768+0000 7f1e013a7640 1 -- start start 2024-04-18T04:56:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.772+0000 7f1e013a7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1dfc15c610 0x7f1dfc0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.772+0000 7f1e013a7640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dfc0ca920 0x7f1dfc069e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.772+0000 7f1e013a7640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dfc0c9990 con 0x7f1dfc1533d0 2024-04-18T04:56:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.772+0000 7f1e013a7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dfc0c9f50 con 0x7f1dfc15c610 2024-04-18T04:56:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.772+0000 7f1e013a7640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc159870 con 0x7f1dfc0ca920 2024-04-18T04:56:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.772+0000 7f1df3fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1dfc15c610 0x7f1dfc0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.772+0000 7f1df3fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1dfc15c610 0x7f1dfc0ca3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53362/0 (socket says 172.21.15.96:53362) 2024-04-18T04:56:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.772+0000 7f1df3fff640 1 -- 172.21.15.96:0/48140338 learned_addr learned my addr 172.21.15.96:0/48140338 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.772+0000 7f1dfb7fe640 1 --2- 172.21.15.96:0/48140338 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dfc0ca920 0x7f1dfc069e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.772+0000 7f1df3fff640 1 -- 172.21.15.96:0/48140338 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dfc0ca920 msgr2=0x7f1dfc069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.772+0000 7f1df3fff640 1 --2- 172.21.15.96:0/48140338 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dfc0ca920 0x7f1dfc069e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.772+0000 7f1df3fff640 1 -- 172.21.15.96:0/48140338 >> v1:172.21.15.139:6789/0 conn(0x7f1dfc1533d0 legacy=0x7f1dfc1590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:06.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.772+0000 7f1df3fff640 1 -- 172.21.15.96:0/48140338 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc159b50 con 0x7f1dfc15c610 2024-04-18T04:56:06.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.776+0000 7f1df3fff640 1 --2- 172.21.15.96:0/48140338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dfc15c610 0x7f1dfc0ca3e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009870 tx=0x7f1de401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94a3860ca515e6a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.776+0000 7f1dfa7fc640 1 -- 172.21.15.96:0/48140338 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de40ac630 con 0x7f1dfc15c610 2024-04-18T04:56:06.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.776+0000 7f1dfa7fc640 1 -- 172.21.15.96:0/48140338 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de40ac790 con 0x7f1dfc15c610 2024-04-18T04:56:06.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.776+0000 7f1dfa7fc640 1 -- 172.21.15.96:0/48140338 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de40acb20 con 0x7f1dfc15c610 2024-04-18T04:56:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.776+0000 7f1e013a7640 1 -- 172.21.15.96:0/48140338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dfc15c610 msgr2=0x7f1dfc0ca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.776+0000 7f1e013a7640 1 --2- 172.21.15.96:0/48140338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dfc15c610 0x7f1dfc0ca3e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009870 tx=0x7f1de401c520 comp rx=0 tx=0).stop 2024-04-18T04:56:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.776+0000 7f1e013a7640 1 -- 172.21.15.96:0/48140338 shutdown_connections 2024-04-18T04:56:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.776+0000 7f1e013a7640 1 --2- 172.21.15.96:0/48140338 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dfc0ca920 0x7f1dfc069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.776+0000 7f1e013a7640 1 --2- 172.21.15.96:0/48140338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dfc15c610 0x7f1dfc0ca3e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.776+0000 7f1e013a7640 1 -- 172.21.15.96:0/48140338 >> 172.21.15.96:0/48140338 conn(0x7f1dfc0c7e80 msgr2=0x7f1dfc0c8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:06.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.776+0000 7f1e013a7640 1 -- 172.21.15.96:0/48140338 shutdown_connections 2024-04-18T04:56:06.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.776+0000 7f1e013a7640 1 -- 172.21.15.96:0/48140338 wait complete. 2024-04-18T04:56:06.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.776+0000 7f1e013a7640 1 Processor -- start 2024-04-18T04:56:06.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.776+0000 7f1e013a7640 1 -- start start 2024-04-18T04:56:06.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1e013a7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dfc0ca920 0x7f1dfc155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1e013a7640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dfc1533d0 0x7f1dfc1553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1e013a7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dfc15c610 0x7f1dfc157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1e013a7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc0bb320 con 0x7f1dfc15c610 2024-04-18T04:56:06.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1e013a7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc0bbe80 con 0x7f1dfc0ca920 2024-04-18T04:56:06.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1e013a7640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc159270 con 0x7f1dfc1533d0 2024-04-18T04:56:06.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1dfb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dfc15c610 0x7f1dfc157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1dfb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dfc15c610 0x7f1dfc157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53378/0 (socket says 172.21.15.96:53378) 2024-04-18T04:56:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1dfb7fe640 1 -- 172.21.15.96:0/57108667 learned_addr learned my addr 172.21.15.96:0/57108667 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1dfaffd640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dfc0ca920 0x7f1dfc155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1df3fff640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dfc1533d0 0x7f1dfc1553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1dfb7fe640 1 -- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dfc1533d0 msgr2=0x7f1dfc1553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1dfb7fe640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1dfc1533d0 0x7f1dfc1553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1dfb7fe640 1 -- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dfc0ca920 msgr2=0x7f1dfc155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1dfb7fe640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dfc0ca920 0x7f1dfc155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1dfb7fe640 1 -- 172.21.15.96:0/57108667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de40094d0 con 0x7f1dfc15c610 2024-04-18T04:56:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1dfb7fe640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dfc15c610 0x7f1dfc157920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1df4007e30 tx=0x7f1df400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1df37fe640 1 -- 172.21.15.96:0/57108667 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4014620 con 0x7f1dfc15c610 2024-04-18T04:56:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1df37fe640 1 -- 172.21.15.96:0/57108667 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df400ee90 con 0x7f1dfc15c610 2024-04-18T04:56:06.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1e013a7640 1 -- 172.21.15.96:0/57108667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dfc0bc120 con 0x7f1dfc15c610 2024-04-18T04:56:06.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1df37fe640 1 -- 172.21.15.96:0/57108667 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4014980 con 0x7f1dfc15c610 2024-04-18T04:56:06.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1e013a7640 1 -- 172.21.15.96:0/57108667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dfc06d8c0 con 0x7f1dfc15c610 2024-04-18T04:56:06.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1e013a7640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1de0002a40 0x7f1de0004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1e013a7640 1 -- 172.21.15.96:0/57108667 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de0007e90 con 0x7f1de0002a40 2024-04-18T04:56:06.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1dfaffd640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1de0002a40 0x7f1de0004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1df37fe640 1 -- 172.21.15.96:0/57108667 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1df4014ae0 con 0x7f1dfc15c610 2024-04-18T04:56:06.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1dfaffd640 1 -- 172.21.15.96:0/57108667 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1de0008050 con 0x7f1de0002a40 2024-04-18T04:56:06.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1df37fe640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1ddc066690 0x7f1ddc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1df3fff640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1ddc066690 0x7f1ddc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1df37fe640 1 -- 172.21.15.96:0/57108667 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1df4084b30 con 0x7f1dfc15c610 2024-04-18T04:56:06.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.780+0000 7f1dfaffd640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1de0002a40 0x7f1de0004f00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00e450 tx=0x7f1dec00e910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.784+0000 7f1df37fe640 1 -- 172.21.15.96:0/57108667 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec007240 con 0x7f1de0002a40 2024-04-18T04:56:06.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.784+0000 7f1df3fff640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1ddc066690 0x7f1ddc068b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1de40ae000 tx=0x7f1de40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.784+0000 7f1df37fe640 1 -- 172.21.15.96:0/57108667 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f1dec0073a0 con 0x7f1de0002a40 2024-04-18T04:56:06.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.784+0000 7f1df37fe640 1 -- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1de0002a40 msgr2=0x7f1de0004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.784+0000 7f1df37fe640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1de0002a40 0x7f1de0004f00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00e450 tx=0x7f1dec00e910 comp rx=0 tx=0).stop 2024-04-18T04:56:06.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.784+0000 7f1df37fe640 1 -- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1de0002a40 msgr2=0x7f1de0004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:56:06.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.784+0000 7f1df37fe640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1de0002a40 0x7f1de0004f00 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00e450 tx=0x7f1dec00e910 comp rx=0 tx=0).stop 2024-04-18T04:56:06.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1e013a7640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1de0006df0 0x7f1de0007260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1e013a7640 1 -- 172.21.15.96:0/57108667 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de0007850 con 0x7f1de0006df0 2024-04-18T04:56:06.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1dfaffd640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1de0006df0 0x7f1de0007260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1dfaffd640 1 -- 172.21.15.96:0/57108667 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1de0007a10 con 0x7f1de0006df0 2024-04-18T04:56:06.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1dfaffd640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1de0006df0 0x7f1de0007260 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00e450 tx=0x7f1dec003770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1df37fe640 1 -- 172.21.15.96:0/57108667 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec013830 con 0x7f1de0006df0 2024-04-18T04:56:06.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1df37fe640 1 -- 172.21.15.96:0/57108667 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4805 (secure 0 0 0) 0x7f1dec013990 con 0x7f1de0006df0 2024-04-18T04:56:06.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1df37fe640 1 -- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1de0006df0 msgr2=0x7f1de0007260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1df37fe640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1de0006df0 0x7f1de0007260 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00e450 tx=0x7f1dec003770 comp rx=0 tx=0).stop 2024-04-18T04:56:06.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1df37fe640 1 -- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1de0006df0 msgr2=0x7f1de0007260 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:56:06.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1df37fe640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1de0006df0 0x7f1de0007260 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.795 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:56:06.795 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:56:06.795 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:56:06.795 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:56:06.795 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 16, 2024-04-18T04:56:06.795 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:56:06.795 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:56:06.795 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:56:06.795 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:56:06.795 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.795 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 1, 2024-04-18T04:56:06.795 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:56:06.796 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:56:06.796 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:56:06.796 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:06.796 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:06.796 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:06.796 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:06.796 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:06.796 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:06.796 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:06.796 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:06.796 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:06.796 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:06.796 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.796 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:56:06.796 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:56:06.797 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:06.797 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:06.797 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:06.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:06.797 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:06.797 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:06.797 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:06.797 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:06.797 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:06.797 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:06.797 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.797 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:56:06.797 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:56:06.797 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:56:06.797 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:56:06.798 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:56:06.798 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:56:06.798 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:56:06.798 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:56:06.798 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:56:06.798 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:56:06.798 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:56:06.798 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:56:06.798 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:56:06.798 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:56:06.798 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:56:06.798 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:56:06.798 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:56:06.798 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:56:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:56:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:56:06.799 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:56:06.800 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:06.800 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:06.800 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.800 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:06.800 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:56:06.800 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.800 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.800 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.800 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:06.800 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:56:06.800 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.800 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.800 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.800 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.801 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:56:06.801 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:56:06.801 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:06.801 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:06.801 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:06.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.801 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.801 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:56:06.801 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:56:06.801 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:06.801 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:06.801 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.801 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:06.801 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:56:06.801 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.802 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.802 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.802 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:06.802 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:56:06.802 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.802 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.802 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.802 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.802 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:56:06.802 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:56:06.802 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:06.802 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:06.802 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:06.802 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.803 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:56:06.803 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:56:06.803 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:06.803 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:06.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.803 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:06.803 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:56:06.803 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.803 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:06.803 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:56:06.803 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:06.803 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.804 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.804 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:56:06.804 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:56:06.804 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:06.804 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:06.804 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:06.804 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.804 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.804 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:56:06.804 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:56:06.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.804 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:06.804 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:06.804 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:56:06.805 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.805 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.805 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:56:06.805 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.805 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:06.805 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:06.805 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:56:06.805 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.805 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.805 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:56:06.805 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.805 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:06.805 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:06.805 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:56:06.805 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.806 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:06.806 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:56:06.806 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:06.806 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:06.806 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:06.806 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:56:06.806 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:06.806 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:06.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:06.806 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:56:06.806 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:56:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1e013a7640 1 -- 172.21.15.96:0/57108667 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1ddc066690 msgr2=0x7f1ddc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1e013a7640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1ddc066690 0x7f1ddc068b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1de40ae000 tx=0x7f1de40a7000 comp rx=0 tx=0).stop 2024-04-18T04:56:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1e013a7640 1 -- 172.21.15.96:0/57108667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dfc15c610 msgr2=0x7f1dfc157920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1e013a7640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dfc15c610 0x7f1dfc157920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1df4007e30 tx=0x7f1df400e4b0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1dfb7fe640 1 -- 172.21.15.96:0/57108667 reap_dead start 2024-04-18T04:56:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1e013a7640 1 -- 172.21.15.96:0/57108667 shutdown_connections 2024-04-18T04:56:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1e013a7640 1 --2- 172.21.15.96:0/57108667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1dfc15c610 0x7f1dfc157920 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1e013a7640 1 -- 172.21.15.96:0/57108667 >> 172.21.15.96:0/57108667 conn(0x7f1dfc0c7e80 msgr2=0x7f1dfc0c4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:06.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1e013a7640 1 -- 172.21.15.96:0/57108667 shutdown_connections 2024-04-18T04:56:06.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.792+0000 7f1e013a7640 1 -- 172.21.15.96:0/57108667 wait complete. 2024-04-18T04:56:06.813 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:56:06.813 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-18T04:56:06.813 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-18T04:56:06.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.944+0000 7f6421838640 1 Processor -- start 2024-04-18T04:56:06.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.944+0000 7f6421838640 1 -- start start 2024-04-18T04:56:06.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.944+0000 7f6421838640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f641c150030 0x7f641c0c2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.944+0000 7f6421838640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f641c156810 0x7f641c0c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.944+0000 7f6421838640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f641c1591c0 con 0x7f641c071500 2024-04-18T04:56:06.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.944+0000 7f6421838640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f641c159480 con 0x7f641c156810 2024-04-18T04:56:06.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.944+0000 7f6421838640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f641c159760 con 0x7f641c150030 2024-04-18T04:56:06.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.944+0000 7f641a7fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f641c156810 0x7f641c0c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.944+0000 7f641b7fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f641c071500 0x7f641c0c9ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:56862/0 (socket says 172.21.15.96:56862) 2024-04-18T04:56:06.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.944+0000 7f641b7fe640 1 -- 172.21.15.96:0/557989584 learned_addr learned my addr 172.21.15.96:0/557989584 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:56:06.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.944+0000 7f641a7fc640 1 -- 172.21.15.96:0/557989584 >> v2:172.21.15.139:3300/0 conn(0x7f641c150030 msgr2=0x7f641c0c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:06.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.944+0000 7f641affd640 1 --2- 172.21.15.96:0/557989584 >> v2:172.21.15.139:3300/0 conn(0x7f641c150030 0x7f641c0c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.944+0000 7f641a7fc640 1 --2- 172.21.15.96:0/557989584 >> v2:172.21.15.139:3300/0 conn(0x7f641c150030 0x7f641c0c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.944+0000 7f641a7fc640 1 -- 172.21.15.96:0/557989584 >> v1:172.21.15.96:6789/0 conn(0x7f641c071500 legacy=0x7f641c0c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.944+0000 7f641a7fc640 1 -- 172.21.15.96:0/557989584 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c159a40 con 0x7f641c156810 2024-04-18T04:56:06.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.944+0000 7f641affd640 1 --2- 172.21.15.96:0/557989584 >> v2:172.21.15.139:3300/0 conn(0x7f641c150030 0x7f641c0c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:56:06.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f641a7fc640 1 --2- 172.21.15.96:0/557989584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f641c156810 0x7f641c0c2ec0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f641c066700 tx=0x7f641001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7937f1f52afe560d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f6419ffb640 1 -- 172.21.15.96:0/557989584 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64100a8970 con 0x7f641c156810 2024-04-18T04:56:06.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f6419ffb640 1 -- 172.21.15.96:0/557989584 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64100a8ad0 con 0x7f641c156810 2024-04-18T04:56:06.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f6419ffb640 1 -- 172.21.15.96:0/557989584 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64100a8e60 con 0x7f641c156810 2024-04-18T04:56:06.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f6421838640 1 -- 172.21.15.96:0/557989584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f641c156810 msgr2=0x7f641c0c2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f6421838640 1 --2- 172.21.15.96:0/557989584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f641c156810 0x7f641c0c2ec0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f641c066700 tx=0x7f641001ec70 comp rx=0 tx=0).stop 2024-04-18T04:56:06.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f6421838640 1 -- 172.21.15.96:0/557989584 shutdown_connections 2024-04-18T04:56:06.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f6421838640 1 --2- 172.21.15.96:0/557989584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f641c156810 0x7f641c0c2ec0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f6421838640 1 --2- 172.21.15.96:0/557989584 >> v2:172.21.15.139:3300/0 conn(0x7f641c150030 0x7f641c0c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f6421838640 1 -- 172.21.15.96:0/557989584 >> 172.21.15.96:0/557989584 conn(0x7f641c06af70 msgr2=0x7f641c06b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:06.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f6421838640 1 -- 172.21.15.96:0/557989584 shutdown_connections 2024-04-18T04:56:06.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f6421838640 1 -- 172.21.15.96:0/557989584 wait complete. 2024-04-18T04:56:06.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f6421838640 1 Processor -- start 2024-04-18T04:56:06.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f6421838640 1 -- start start 2024-04-18T04:56:06.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f6421838640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f641c071500 0x7f641c148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f6421838640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f641c150030 0x7f641c14bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.948+0000 7f6421838640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f641c156810 0x7f641c1497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f641affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f641c071500 0x7f641c148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f6421838640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641c14d1f0 con 0x7f641c071500 2024-04-18T04:56:06.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f6421838640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641c14c9e0 con 0x7f641c150030 2024-04-18T04:56:06.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f6421838640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641c149360 con 0x7f641c156810 2024-04-18T04:56:06.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f641affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f641c071500 0x7f641c148670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53410/0 (socket says 172.21.15.96:53410) 2024-04-18T04:56:06.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f641affd640 1 -- 172.21.15.96:0/3911250733 learned_addr learned my addr 172.21.15.96:0/3911250733 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:06.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f641a7fc640 1 --2- 172.21.15.96:0/3911250733 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f641c150030 0x7f641c14bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f641b7fe640 1 --2- 172.21.15.96:0/3911250733 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f641c156810 0x7f641c1497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f641affd640 1 -- 172.21.15.96:0/3911250733 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f641c156810 msgr2=0x7f641c1497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f641affd640 1 --2- 172.21.15.96:0/3911250733 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f641c156810 0x7f641c1497f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f641affd640 1 -- 172.21.15.96:0/3911250733 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f641c150030 msgr2=0x7f641c14bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:06.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f641affd640 1 --2- 172.21.15.96:0/3911250733 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f641c150030 0x7f641c14bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:06.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f641affd640 1 -- 172.21.15.96:0/3911250733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6410009420 con 0x7f641c071500 2024-04-18T04:56:06.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f641b7fe640 1 --2- 172.21.15.96:0/3911250733 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f641c156810 0x7f641c1497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:56:06.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f641a7fc640 1 --2- 172.21.15.96:0/3911250733 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f641c150030 0x7f641c14bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:56:06.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f641affd640 1 --2- 172.21.15.96:0/3911250733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f641c071500 0x7f641c148670 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f640c00c7c0 tx=0x7f640c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f6403fff640 1 -- 172.21.15.96:0/3911250733 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c007a30 con 0x7f641c071500 2024-04-18T04:56:06.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f6403fff640 1 -- 172.21.15.96:0/3911250733 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640c007b90 con 0x7f641c071500 2024-04-18T04:56:06.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f6421838640 1 -- 172.21.15.96:0/3911250733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641c14cc30 con 0x7f641c071500 2024-04-18T04:56:06.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f6421838640 1 -- 172.21.15.96:0/3911250733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641c148ff0 con 0x7f641c071500 2024-04-18T04:56:06.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f6403fff640 1 -- 172.21.15.96:0/3911250733 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c00ce70 con 0x7f641c071500 2024-04-18T04:56:06.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f6421838640 1 -- 172.21.15.96:0/3911250733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63fc005260 con 0x7f641c071500 2024-04-18T04:56:06.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f6403fff640 1 -- 172.21.15.96:0/3911250733 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f640c0193f0 con 0x7f641c071500 2024-04-18T04:56:06.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f6403fff640 1 --2- 172.21.15.96:0/3911250733 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6408066690 0x7f6408068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:06.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f6403fff640 1 -- 172.21.15.96:0/3911250733 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f640c0845d0 con 0x7f641c071500 2024-04-18T04:56:06.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f641a7fc640 1 --2- 172.21.15.96:0/3911250733 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6408066690 0x7f6408068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:06.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.952+0000 7f641a7fc640 1 --2- 172.21.15.96:0/3911250733 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6408066690 0x7f6408068b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f64100b2000 tx=0x7f64100aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:06.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:06.960+0000 7f6403fff640 1 -- 172.21.15.96:0/3911250733 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f640c0519b0 con 0x7f641c071500 2024-04-18T04:56:07.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:07.208+0000 7f6421838640 1 -- 172.21.15.96:0/3911250733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f63fc0057e0 con 0x7f641c071500 2024-04-18T04:56:07.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:07.208+0000 7f6403fff640 1 -- 172.21.15.96:0/3911250733 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f640c054fd0 con 0x7f641c071500 2024-04-18T04:56:07.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:07.208+0000 7f6421838640 1 -- 172.21.15.96:0/3911250733 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6408066690 msgr2=0x7f6408068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:07.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:07.208+0000 7f6421838640 1 --2- 172.21.15.96:0/3911250733 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6408066690 0x7f6408068b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f64100b2000 tx=0x7f64100aa070 comp rx=0 tx=0).stop 2024-04-18T04:56:07.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:07.208+0000 7f6421838640 1 -- 172.21.15.96:0/3911250733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f641c071500 msgr2=0x7f641c148670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:07.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:07.208+0000 7f6421838640 1 --2- 172.21.15.96:0/3911250733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f641c071500 0x7f641c148670 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f640c00c7c0 tx=0x7f640c00cc80 comp rx=0 tx=0).stop 2024-04-18T04:56:07.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:07.208+0000 7f6421838640 1 -- 172.21.15.96:0/3911250733 shutdown_connections 2024-04-18T04:56:07.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:07.208+0000 7f6421838640 1 --2- 172.21.15.96:0/3911250733 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6408066690 0x7f6408068b50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:07.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:07.208+0000 7f6421838640 1 --2- 172.21.15.96:0/3911250733 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f641c156810 0x7f641c1497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:07.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:07.208+0000 7f6421838640 1 --2- 172.21.15.96:0/3911250733 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f641c150030 0x7f641c14bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:07.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:07.208+0000 7f6421838640 1 --2- 172.21.15.96:0/3911250733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f641c071500 0x7f641c148670 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:07.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:07.208+0000 7f6421838640 1 -- 172.21.15.96:0/3911250733 >> 172.21.15.96:0/3911250733 conn(0x7f641c06af70 msgr2=0x7f641c0cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:07.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:07.208+0000 7f6421838640 1 -- 172.21.15.96:0/3911250733 shutdown_connections 2024-04-18T04:56:07.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:07.208+0000 7f6421838640 1 -- 172.21.15.96:0/3911250733 wait complete. 2024-04-18T04:56:07.231 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-18T04:56:17.232 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-18T04:56:17.233 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:56:17.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.384+0000 7fbdd4570640 1 Processor -- start 2024-04-18T04:56:17.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.384+0000 7fbdd4570640 1 -- start start 2024-04-18T04:56:17.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.388+0000 7fbdd4570640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbdcc0cacc0 0x7fbdcc158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:17.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.388+0000 7fbdd4570640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbdcc0c3fd0 0x7fbdcc0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:17.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.388+0000 7fbdd4570640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdcc1536b0 con 0x7fbdcc1532d0 2024-04-18T04:56:17.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.388+0000 7fbdd4570640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdcc0c5970 con 0x7fbdcc0c3fd0 2024-04-18T04:56:17.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.388+0000 7fbdd4570640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc1594a0 con 0x7fbdcc0cacc0 2024-04-18T04:56:17.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.388+0000 7fbdd2b0d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbdcc0c3fd0 0x7fbdcc0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:17.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.388+0000 7fbdd2b0d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbdcc0c3fd0 0x7fbdcc0ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51918/0 (socket says 172.21.15.96:51918) 2024-04-18T04:56:17.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.388+0000 7fbdd2b0d640 1 -- 172.21.15.96:0/2540818443 learned_addr learned my addr 172.21.15.96:0/2540818443 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:17.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.388+0000 7fbdd1b0b640 1 --2- 172.21.15.96:0/2540818443 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbdcc0cacc0 0x7fbdcc158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:17.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.388+0000 7fbdd2b0d640 1 -- 172.21.15.96:0/2540818443 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbdcc0cacc0 msgr2=0x7fbdcc158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:17.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.388+0000 7fbdd2b0d640 1 --2- 172.21.15.96:0/2540818443 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbdcc0cacc0 0x7fbdcc158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:17.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.388+0000 7fbdd2b0d640 1 -- 172.21.15.96:0/2540818443 >> v1:172.21.15.96:6789/0 conn(0x7fbdcc1532d0 legacy=0x7fbdcc15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:17.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.388+0000 7fbdd130a640 1 -- 172.21.15.96:0/2540818443 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467543266 0 0) 0x7fbdcc1536b0 con 0x7fbdcc1532d0 2024-04-18T04:56:17.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.388+0000 7fbdd2b0d640 1 -- 172.21.15.96:0/2540818443 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc159680 con 0x7fbdcc0c3fd0 2024-04-18T04:56:17.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.392+0000 7fbdd2b0d640 1 --2- 172.21.15.96:0/2540818443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdcc0c3fd0 0x7fbdcc0ce740 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009e50 tx=0x7fbdc401f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef6dd210684d412 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:17.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.392+0000 7fbdd130a640 1 -- 172.21.15.96:0/2540818443 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40af400 con 0x7fbdcc0c3fd0 2024-04-18T04:56:17.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.392+0000 7fbdd130a640 1 -- 172.21.15.96:0/2540818443 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc40ab050 con 0x7fbdcc0c3fd0 2024-04-18T04:56:17.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.392+0000 7fbdd130a640 1 -- 172.21.15.96:0/2540818443 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40af780 con 0x7fbdcc0c3fd0 2024-04-18T04:56:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.392+0000 7fbdd4570640 1 -- 172.21.15.96:0/2540818443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdcc0c3fd0 msgr2=0x7fbdcc0ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.392+0000 7fbdd4570640 1 --2- 172.21.15.96:0/2540818443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdcc0c3fd0 0x7fbdcc0ce740 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009e50 tx=0x7fbdc401f210 comp rx=0 tx=0).stop 2024-04-18T04:56:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.392+0000 7fbdd4570640 1 -- 172.21.15.96:0/2540818443 shutdown_connections 2024-04-18T04:56:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.392+0000 7fbdd4570640 1 --2- 172.21.15.96:0/2540818443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdcc0c3fd0 0x7fbdcc0ce740 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.392+0000 7fbdd4570640 1 --2- 172.21.15.96:0/2540818443 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbdcc0cacc0 0x7fbdcc158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.392+0000 7fbdd4570640 1 -- 172.21.15.96:0/2540818443 >> 172.21.15.96:0/2540818443 conn(0x7fbdcc071760 msgr2=0x7fbdcc06b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.392+0000 7fbdd4570640 1 -- 172.21.15.96:0/2540818443 shutdown_connections 2024-04-18T04:56:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.392+0000 7fbdd4570640 1 -- 172.21.15.96:0/2540818443 wait complete. 2024-04-18T04:56:17.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.392+0000 7fbdd4570640 1 Processor -- start 2024-04-18T04:56:17.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.392+0000 7fbdd4570640 1 -- start start 2024-04-18T04:56:17.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd4570640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbdcc0c3fd0 0x7fbdcc158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:17.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd4570640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdcc0cacc0 0x7fbdcc0cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:17.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd4570640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdcc1532d0 0x7fbdcc0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:17.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd1b0b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdcc0cacc0 0x7fbdcc0cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:17.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd1b0b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdcc0cacc0 0x7fbdcc0cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51922/0 (socket says 172.21.15.96:51922) 2024-04-18T04:56:17.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd1b0b640 1 -- 172.21.15.96:0/4140386777 learned_addr learned my addr 172.21.15.96:0/4140386777 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:17.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd230c640 1 --2- 172.21.15.96:0/4140386777 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbdcc0c3fd0 0x7fbdcc158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:17.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd4570640 1 -- 172.21.15.96:0/4140386777 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc159f20 con 0x7fbdcc0cacc0 2024-04-18T04:56:17.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd4570640 1 -- 172.21.15.96:0/4140386777 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc158e70 con 0x7fbdcc1532d0 2024-04-18T04:56:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd4570640 1 -- 172.21.15.96:0/4140386777 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc1ef240 con 0x7fbdcc0c3fd0 2024-04-18T04:56:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd2b0d640 1 --2- 172.21.15.96:0/4140386777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdcc1532d0 0x7fbdcc0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd1b0b640 1 -- 172.21.15.96:0/4140386777 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbdcc0c3fd0 msgr2=0x7fbdcc158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd1b0b640 1 --2- 172.21.15.96:0/4140386777 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbdcc0c3fd0 0x7fbdcc158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd1b0b640 1 -- 172.21.15.96:0/4140386777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdcc1532d0 msgr2=0x7fbdcc0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd1b0b640 1 --2- 172.21.15.96:0/4140386777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdcc1532d0 0x7fbdcc0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd1b0b640 1 -- 172.21.15.96:0/4140386777 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc4009b30 con 0x7fbdcc0cacc0 2024-04-18T04:56:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd1b0b640 1 --2- 172.21.15.96:0/4140386777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdcc0cacc0 0x7fbdcc0cd700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00d7d0 tx=0x7fbdbc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdc2ffd640 1 -- 172.21.15.96:0/4140386777 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc00b6c0 con 0x7fbdcc0cacc0 2024-04-18T04:56:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdc2ffd640 1 -- 172.21.15.96:0/4140386777 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc00b820 con 0x7fbdcc0cacc0 2024-04-18T04:56:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdc2ffd640 1 -- 172.21.15.96:0/4140386777 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc00bbd0 con 0x7fbdcc0cacc0 2024-04-18T04:56:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.396+0000 7fbdd4570640 1 -- 172.21.15.96:0/4140386777 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdcc0b41d0 con 0x7fbdcc0cacc0 2024-04-18T04:56:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.400+0000 7fbdd4570640 1 -- 172.21.15.96:0/4140386777 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdcc15a160 con 0x7fbdcc0cacc0 2024-04-18T04:56:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.400+0000 7fbdd4570640 1 -- 172.21.15.96:0/4140386777 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdcc067050 con 0x7fbdcc0cacc0 2024-04-18T04:56:17.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.400+0000 7fbdc2ffd640 1 -- 172.21.15.96:0/4140386777 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbdbc00bd30 con 0x7fbdcc0cacc0 2024-04-18T04:56:17.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.400+0000 7fbdc2ffd640 1 --2- 172.21.15.96:0/4140386777 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbdb0066710 0x7fbdb0068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:17.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.400+0000 7fbdc2ffd640 1 -- 172.21.15.96:0/4140386777 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fbdbc084410 con 0x7fbdcc0cacc0 2024-04-18T04:56:17.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.400+0000 7fbdd230c640 1 --2- 172.21.15.96:0/4140386777 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbdb0066710 0x7fbdb0068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:17.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.400+0000 7fbdd230c640 1 --2- 172.21.15.96:0/4140386777 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbdb0066710 0x7fbdb0068bd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8007fd0 tx=0x7fbdc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:17.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.408+0000 7fbdc2ffd640 1 -- 172.21.15.96:0/4140386777 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fbdbc051980 con 0x7fbdcc0cacc0 2024-04-18T04:56:17.635 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:56:17.637 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:56:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.828+0000 7fbdd4570640 1 -- 172.21.15.96:0/4140386777 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbdcc0ca290 con 0x7fbdcc0cacc0 2024-04-18T04:56:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.828+0000 7fbdc2ffd640 1 -- 172.21.15.96:0/4140386777 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fbdbc054fa0 con 0x7fbdcc0cacc0 2024-04-18T04:56:17.831 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:56:17.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.832+0000 7fbdd4570640 1 -- 172.21.15.96:0/4140386777 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbdb0066710 msgr2=0x7fbdb0068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:17.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.832+0000 7fbdd4570640 1 --2- 172.21.15.96:0/4140386777 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbdb0066710 0x7fbdb0068bd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8007fd0 tx=0x7fbdc8009040 comp rx=0 tx=0).stop 2024-04-18T04:56:17.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.832+0000 7fbdd4570640 1 -- 172.21.15.96:0/4140386777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdcc0cacc0 msgr2=0x7fbdcc0cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:17.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.832+0000 7fbdd4570640 1 --2- 172.21.15.96:0/4140386777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdcc0cacc0 0x7fbdcc0cd700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00d7d0 tx=0x7fbdbc00dc90 comp rx=0 tx=0).stop 2024-04-18T04:56:17.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.832+0000 7fbdd4570640 1 -- 172.21.15.96:0/4140386777 shutdown_connections 2024-04-18T04:56:17.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.832+0000 7fbdd4570640 1 --2- 172.21.15.96:0/4140386777 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbdb0066710 0x7fbdb0068bd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:17.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.832+0000 7fbdd4570640 1 --2- 172.21.15.96:0/4140386777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdcc1532d0 0x7fbdcc0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:17.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.832+0000 7fbdd4570640 1 --2- 172.21.15.96:0/4140386777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbdcc0cacc0 0x7fbdcc0cd700 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:17.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.832+0000 7fbdd4570640 1 --2- 172.21.15.96:0/4140386777 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbdcc0c3fd0 0x7fbdcc158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:17.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.832+0000 7fbdd4570640 1 -- 172.21.15.96:0/4140386777 >> 172.21.15.96:0/4140386777 conn(0x7fbdcc071760 msgr2=0x7fbdcc065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:17.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.832+0000 7fbdd4570640 1 -- 172.21.15.96:0/4140386777 shutdown_connections 2024-04-18T04:56:17.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:17.832+0000 7fbdd4570640 1 -- 172.21.15.96:0/4140386777 wait complete. 2024-04-18T04:56:17.853 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-18T04:56:17.853 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-18T04:56:17.853 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-18T04:56:17.853 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T04:56:18.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c2c338640 1 Processor -- start 2024-04-18T04:56:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c2c338640 1 -- start start 2024-04-18T04:56:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c2c338640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1c24071500 0x7f1c24155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c2c338640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c241503b0 con 0x7f1c240c2980 2024-04-18T04:56:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c2c338640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c241564f0 con 0x7f1c2414ffd0 2024-04-18T04:56:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c2c338640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c241567d0 con 0x7f1c24071500 2024-04-18T04:56:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c2a8d5640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1c240c2980 0x7f1c24160550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37548/0 (socket says 172.21.15.96:37548) 2024-04-18T04:56:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c2a8d5640 1 -- 172.21.15.96:0/752488917 learned_addr learned my addr 172.21.15.96:0/752488917 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:56:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c298d3640 1 --2- 172.21.15.96:0/752488917 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1c24071500 0x7f1c24155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c290d2640 1 -- 172.21.15.96:0/752488917 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323455922 0 0) 0x7f1c241503b0 con 0x7f1c240c2980 2024-04-18T04:56:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c290d2640 1 -- 172.21.15.96:0/752488917 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c10003530 con 0x7f1c240c2980 2024-04-18T04:56:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c290d2640 1 -- 172.21.15.96:0/752488917 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3680257160 0 0) 0x7f1c10003530 con 0x7f1c240c2980 2024-04-18T04:56:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c290d2640 1 -- 172.21.15.96:0/752488917 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1c24071500 msgr2=0x7f1c24155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c290d2640 1 --2- 172.21.15.96:0/752488917 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1c24071500 0x7f1c24155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c290d2640 1 -- 172.21.15.96:0/752488917 >> v1:172.21.15.139:6789/0 conn(0x7f1c2414ffd0 legacy=0x7f1c240c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c290d2640 1 -- 172.21.15.96:0/752488917 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c24156ab0 con 0x7f1c240c2980 2024-04-18T04:56:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.008+0000 7f1c290d2640 1 -- 172.21.15.96:0/752488917 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f1c1c001a00 con 0x7f1c240c2980 2024-04-18T04:56:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.012+0000 7f1c290d2640 1 -- 172.21.15.96:0/752488917 >> v1:172.21.15.96:6789/0 conn(0x7f1c240c2980 legacy=0x7f1c24160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.012+0000 7f1c290d2640 1 --2- 172.21.15.96:0/752488917 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1c100039b0 0x7f1c10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.012+0000 7f1c290d2640 1 --2- 172.21.15.96:0/752488917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c100043a0 0x7f1c10004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.012+0000 7f1c290d2640 1 --2- 172.21.15.96:0/752488917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c10004ed0 0x7f1c1000ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.012+0000 7f1c290d2640 1 -- 172.21.15.96:0/752488917 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c241567d0 con 0x7f1c10004ed0 2024-04-18T04:56:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.012+0000 7f1c290d2640 1 -- 172.21.15.96:0/752488917 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10005690 con 0x7f1c100043a0 2024-04-18T04:56:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.012+0000 7f1c290d2640 1 -- 172.21.15.96:0/752488917 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10009c00 con 0x7f1c100039b0 2024-04-18T04:56:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.012+0000 7f1c2a8d5640 1 --2- 172.21.15.96:0/752488917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c10004ed0 0x7f1c1000ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.012+0000 7f1c2a0d4640 1 --2- 172.21.15.96:0/752488917 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1c100039b0 0x7f1c10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.012+0000 7f1c298d3640 1 --2- 172.21.15.96:0/752488917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c100043a0 0x7f1c10004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.012+0000 7f1c2a8d5640 1 -- 172.21.15.96:0/752488917 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1c100039b0 msgr2=0x7f1c10003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:18.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.012+0000 7f1c2a8d5640 1 --2- 172.21.15.96:0/752488917 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1c100039b0 0x7f1c10003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.012+0000 7f1c2a8d5640 1 -- 172.21.15.96:0/752488917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c100043a0 msgr2=0x7f1c10004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:18.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.012+0000 7f1c2a8d5640 1 --2- 172.21.15.96:0/752488917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c100043a0 0x7f1c10004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.012+0000 7f1c2a8d5640 1 -- 172.21.15.96:0/752488917 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c10003530 con 0x7f1c10004ed0 2024-04-18T04:56:18.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.012+0000 7f1c2a8d5640 1 --2- 172.21.15.96:0/752488917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c10004ed0 0x7f1c1000ffa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00a830 tx=0x7f1c1c01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83fc8cdc634f444 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.016+0000 7f1c290d2640 1 -- 172.21.15.96:0/752488917 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0072d0 con 0x7f1c10004ed0 2024-04-18T04:56:18.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.016+0000 7f1c290d2640 1 -- 172.21.15.96:0/752488917 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c0a8070 con 0x7f1c10004ed0 2024-04-18T04:56:18.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.016+0000 7f1c290d2640 1 -- 172.21.15.96:0/752488917 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c007690 con 0x7f1c10004ed0 2024-04-18T04:56:18.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.016+0000 7f1c2c338640 1 -- 172.21.15.96:0/752488917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c10004ed0 msgr2=0x7f1c1000ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.016+0000 7f1c2c338640 1 --2- 172.21.15.96:0/752488917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c10004ed0 0x7f1c1000ffa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00a830 tx=0x7f1c1c01d360 comp rx=0 tx=0).stop 2024-04-18T04:56:18.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.016+0000 7f1c2a8d5640 1 -- 172.21.15.96:0/752488917 reap_dead start 2024-04-18T04:56:18.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.016+0000 7f1c2c338640 1 -- 172.21.15.96:0/752488917 shutdown_connections 2024-04-18T04:56:18.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.016+0000 7f1c2c338640 1 -- 172.21.15.96:0/752488917 >> 172.21.15.96:0/752488917 conn(0x7f1c2406d600 msgr2=0x7f1c2406eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:18.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.016+0000 7f1c2c338640 1 -- 172.21.15.96:0/752488917 shutdown_connections 2024-04-18T04:56:18.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.016+0000 7f1c2c338640 1 -- 172.21.15.96:0/752488917 wait complete. 2024-04-18T04:56:18.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.016+0000 7f1c2c338640 1 Processor -- start 2024-04-18T04:56:18.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.016+0000 7f1c2c338640 1 -- start start 2024-04-18T04:56:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c2c338640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1c10004ed0 0x7f1c241540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c2c338640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c241507a0 0x7f1c240c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c2c338640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c24150be0 0x7f1c240c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c2c338640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c241536c0 con 0x7f1c241507a0 2024-04-18T04:56:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c298d3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c241507a0 0x7f1c240c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c298d3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c241507a0 0x7f1c240c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51952/0 (socket says 172.21.15.96:51952) 2024-04-18T04:56:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c298d3640 1 -- 172.21.15.96:0/2242713134 learned_addr learned my addr 172.21.15.96:0/2242713134 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c2c338640 1 -- 172.21.15.96:0/2242713134 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24155b70 con 0x7f1c24150be0 2024-04-18T04:56:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c2c338640 1 -- 172.21.15.96:0/2242713134 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2406ad40 con 0x7f1c10004ed0 2024-04-18T04:56:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c2a0d4640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1c10004ed0 0x7f1c241540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c2a8d5640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c24150be0 0x7f1c240c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c298d3640 1 -- 172.21.15.96:0/2242713134 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1c10004ed0 msgr2=0x7f1c241540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c298d3640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1c10004ed0 0x7f1c241540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c298d3640 1 -- 172.21.15.96:0/2242713134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c24150be0 msgr2=0x7f1c240c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c298d3640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c24150be0 0x7f1c240c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c298d3640 1 -- 172.21.15.96:0/2242713134 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c24155da0 con 0x7f1c241507a0 2024-04-18T04:56:18.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c2a8d5640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c24150be0 0x7f1c240c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:56:18.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c298d3640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c241507a0 0x7f1c240c9280 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1c140114c0 tx=0x7f1c14011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c1affd640 1 -- 172.21.15.96:0/2242713134 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14015870 con 0x7f1c241507a0 2024-04-18T04:56:18.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c1affd640 1 -- 172.21.15.96:0/2242713134 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c140159d0 con 0x7f1c241507a0 2024-04-18T04:56:18.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c2c338640 1 -- 172.21.15.96:0/2242713134 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c241e9f30 con 0x7f1c241507a0 2024-04-18T04:56:18.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c1affd640 1 -- 172.21.15.96:0/2242713134 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14015d80 con 0x7f1c241507a0 2024-04-18T04:56:18.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c2c338640 1 -- 172.21.15.96:0/2242713134 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c241ea4f0 con 0x7f1c241507a0 2024-04-18T04:56:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c2c338640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c241ea710 0x7f1c2414a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.020+0000 7f1c2c338640 1 -- 172.21.15.96:0/2242713134 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24066ac0 con 0x7f1c241ea710 2024-04-18T04:56:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.024+0000 7f1c1affd640 1 -- 172.21.15.96:0/2242713134 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c1401d400 con 0x7f1c241507a0 2024-04-18T04:56:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.024+0000 7f1c2a0d4640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c241ea710 0x7f1c2414a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.024+0000 7f1c2a0d4640 1 -- 172.21.15.96:0/2242713134 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c240c4840 con 0x7f1c241ea710 2024-04-18T04:56:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.024+0000 7f1c1affd640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1c08066690 0x7f1c08068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.024+0000 7f1c1affd640 1 -- 172.21.15.96:0/2242713134 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1c140848f0 con 0x7f1c241507a0 2024-04-18T04:56:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.024+0000 7f1c2a8d5640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1c08066690 0x7f1c08068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.024+0000 7f1c2a8d5640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1c08066690 0x7f1c08068b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0ad000 tx=0x7f1c1c009050 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.024+0000 7f1c2a0d4640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c241ea710 0x7f1c2414a040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1c20012860 tx=0x7f1c20012d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.024+0000 7f1c1affd640 1 -- 172.21.15.96:0/2242713134 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20012e50 con 0x7f1c241ea710 2024-04-18T04:56:18.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.024+0000 7f1c1affd640 1 -- 172.21.15.96:0/2242713134 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f1c20005320 con 0x7f1c241ea710 2024-04-18T04:56:18.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.024+0000 7f1c1affd640 1 -- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c241ea710 msgr2=0x7f1c2414a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.024+0000 7f1c1affd640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c241ea710 0x7f1c2414a040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1c20012860 tx=0x7f1c20012d20 comp rx=0 tx=0).stop 2024-04-18T04:56:18.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.024+0000 7f1c1affd640 1 -- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c241ea710 msgr2=0x7f1c2414a040 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:56:18.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.024+0000 7f1c1affd640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c241ea710 0x7f1c2414a040 secure :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1c20012860 tx=0x7f1c20012d20 comp rx=0 tx=0).stop 2024-04-18T04:56:18.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c2c338640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c2414a580 0x7f1c241ed150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c2c338640 1 -- 172.21.15.96:0/2242713134 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c241ea0c0 con 0x7f1c2414a580 2024-04-18T04:56:18.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c2a0d4640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c2414a580 0x7f1c241ed150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c2a0d4640 1 -- 172.21.15.96:0/2242713134 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1c240c4e20 con 0x7f1c2414a580 2024-04-18T04:56:18.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c2a0d4640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c2414a580 0x7f1c241ed150 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1c20012860 tx=0x7f1c20001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c1affd640 1 -- 172.21.15.96:0/2242713134 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20026070 con 0x7f1c2414a580 2024-04-18T04:56:18.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c1affd640 1 -- 172.21.15.96:0/2242713134 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7f1c20007680 con 0x7f1c2414a580 2024-04-18T04:56:18.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c1affd640 1 -- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c2414a580 msgr2=0x7f1c241ed150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c1affd640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c2414a580 0x7f1c241ed150 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1c20012860 tx=0x7f1c20001130 comp rx=0 tx=0).stop 2024-04-18T04:56:18.039 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:56:18.040 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:56:18.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:56:18.040 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T04:56:18.040 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 16, 2024-04-18T04:56:18.040 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:56:18.040 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:56:18.040 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:56:18.040 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:56:18.040 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.040 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 13, 2024-04-18T04:56:18.040 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:56:18.040 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:56:18.040 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:56:18.040 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:18.040 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:18.040 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:18.041 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:18.042 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:18.042 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:18.042 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:18.042 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.042 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:56:18.042 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:56:18.042 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:56:18.042 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:56:18.042 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:56:18.042 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:56:18.042 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:56:18.042 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:56:18.042 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:56:18.043 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:56:18.043 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:56:18.043 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:56:18.043 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:56:18.043 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:56:18.043 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:56:18.043 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:56:18.043 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:56:18.043 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:18.043 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:18.043 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:18.043 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:18.043 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:18.043 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:18.043 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:18.044 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:18.044 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:18.044 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:18.044 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.044 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:56:18.044 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.044 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:56:18.044 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.044 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:56:18.044 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:56:18.044 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:18.044 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:18.044 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.044 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:18.044 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:56:18.044 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.045 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:18.045 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:56:18.045 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.045 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.045 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.045 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:56:18.045 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:56:18.045 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:18.045 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:18.045 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:18.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:56:18.046 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:56:18.046 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:18.046 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:18.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.046 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:18.046 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:56:18.046 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.046 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:18.046 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:56:18.046 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.046 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.046 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.047 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:56:18.047 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:56:18.047 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:18.047 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:18.047 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:18.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.047 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:56:18.047 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:56:18.047 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:18.047 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:18.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.047 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:18.048 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:56:18.048 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.048 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:18.048 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:56:18.048 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.048 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.048 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.048 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:56:18.048 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:56:18.048 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:18.048 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:18.048 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:18.048 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.049 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.049 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:56:18.049 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:56:18.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.049 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:18.049 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:18.049 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:56:18.049 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.049 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.049 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:56:18.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.049 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:18.049 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:18.049 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:56:18.049 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.050 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.050 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:56:18.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.050 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:18.050 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:18.050 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 7 2024-04-18T04:56:18.050 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.050 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.050 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:56:18.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.050 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:18.050 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:18.050 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 7 2024-04-18T04:56:18.050 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.050 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.050 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:56:18.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.051 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:18.051 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:18.051 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:56:18.051 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.051 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.051 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:56:18.051 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:56:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c1affd640 1 -- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c2414a580 msgr2=0x7f1c241ed150 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:56:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c1affd640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c2414a580 0x7f1c241ed150 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c2c338640 1 -- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1c08066690 msgr2=0x7f1c08068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c2c338640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1c08066690 0x7f1c08068b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0ad000 tx=0x7f1c1c009050 comp rx=0 tx=0).stop 2024-04-18T04:56:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c2c338640 1 -- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c241507a0 msgr2=0x7f1c240c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c2c338640 1 --2- 172.21.15.96:0/2242713134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c241507a0 0x7f1c240c9280 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1c140114c0 tx=0x7f1c14011980 comp rx=0 tx=0).stop 2024-04-18T04:56:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c2a8d5640 1 -- 172.21.15.96:0/2242713134 reap_dead start 2024-04-18T04:56:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c2a8d5640 1 -- 172.21.15.96:0/2242713134 reap_dead start 2024-04-18T04:56:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c2c338640 1 -- 172.21.15.96:0/2242713134 shutdown_connections 2024-04-18T04:56:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c2c338640 1 -- 172.21.15.96:0/2242713134 >> 172.21.15.96:0/2242713134 conn(0x7f1c2406d600 msgr2=0x7f1c24158d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c2c338640 1 -- 172.21.15.96:0/2242713134 shutdown_connections 2024-04-18T04:56:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.036+0000 7f1c2c338640 1 -- 172.21.15.96:0/2242713134 wait complete. 2024-04-18T04:56:18.058 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:56:18.058 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-18T04:56:18.058 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-18T04:56:18.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.212+0000 7f3b8c16b640 1 Processor -- start 2024-04-18T04:56:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.212+0000 7f3b8c16b640 1 -- start start 2024-04-18T04:56:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.212+0000 7f3b8c16b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3b8406f210 0x7f3b84071a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.212+0000 7f3b8c16b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b84152c90 0x7f3b841530e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.212+0000 7f3b89f07640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3b8406f210 0x7f3b84071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.212+0000 7f3b89f07640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3b8406f210 0x7f3b84071a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51968/0 (socket says 172.21.15.96:51968) 2024-04-18T04:56:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.216+0000 7f3b89f07640 1 -- 172.21.15.96:0/2191248519 learned_addr learned my addr 172.21.15.96:0/2191248519 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.216+0000 7f3b8c16b640 1 -- 172.21.15.96:0/2191248519 --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b840c6820 con 0x7f3b8406f5f0 2024-04-18T04:56:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.216+0000 7f3b8c16b640 1 -- 172.21.15.96:0/2191248519 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b84153620 con 0x7f3b8406f210 2024-04-18T04:56:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.216+0000 7f3b8c16b640 1 -- 172.21.15.96:0/2191248519 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8406ede0 con 0x7f3b84152c90 2024-04-18T04:56:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.216+0000 7f3b8a708640 1 --2- 172.21.15.96:0/2191248519 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b84152c90 0x7f3b841530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.216+0000 7f3b89f07640 1 -- 172.21.15.96:0/2191248519 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b84152c90 msgr2=0x7f3b841530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.216+0000 7f3b89f07640 1 --2- 172.21.15.96:0/2191248519 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b84152c90 0x7f3b841530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.216+0000 7f3b89f07640 1 -- 172.21.15.96:0/2191248519 >> v1:172.21.15.139:6789/0 conn(0x7f3b8406f5f0 legacy=0x7f3b8406e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.216+0000 7f3b89f07640 1 -- 172.21.15.96:0/2191248519 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b840720f0 con 0x7f3b8406f210 2024-04-18T04:56:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.216+0000 7f3b89f07640 1 --2- 172.21.15.96:0/2191248519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b8406f210 0x7f3b84071a40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009870 tx=0x7f3b8001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d42dcb56c4675c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.216+0000 7f3b88f05640 1 -- 172.21.15.96:0/2191248519 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b800a8a50 con 0x7f3b8406f210 2024-04-18T04:56:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.220+0000 7f3b88f05640 1 -- 172.21.15.96:0/2191248519 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b800a8bb0 con 0x7f3b8406f210 2024-04-18T04:56:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.220+0000 7f3b88f05640 1 -- 172.21.15.96:0/2191248519 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b800b0440 con 0x7f3b8406f210 2024-04-18T04:56:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.220+0000 7f3b8c16b640 1 -- 172.21.15.96:0/2191248519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b8406f210 msgr2=0x7f3b84071a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.220+0000 7f3b8c16b640 1 --2- 172.21.15.96:0/2191248519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b8406f210 0x7f3b84071a40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009870 tx=0x7f3b8001ed50 comp rx=0 tx=0).stop 2024-04-18T04:56:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.220+0000 7f3b8c16b640 1 -- 172.21.15.96:0/2191248519 shutdown_connections 2024-04-18T04:56:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.220+0000 7f3b8c16b640 1 --2- 172.21.15.96:0/2191248519 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b84152c90 0x7f3b841530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.220+0000 7f3b8c16b640 1 --2- 172.21.15.96:0/2191248519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b8406f210 0x7f3b84071a40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.220+0000 7f3b8c16b640 1 -- 172.21.15.96:0/2191248519 >> 172.21.15.96:0/2191248519 conn(0x7f3b8406b140 msgr2=0x7f3b8406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.220+0000 7f3b8c16b640 1 -- 172.21.15.96:0/2191248519 shutdown_connections 2024-04-18T04:56:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.220+0000 7f3b8c16b640 1 -- 172.21.15.96:0/2191248519 wait complete. 2024-04-18T04:56:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.220+0000 7f3b8c16b640 1 Processor -- start 2024-04-18T04:56:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.220+0000 7f3b8c16b640 1 -- start start 2024-04-18T04:56:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.220+0000 7f3b8c16b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b8406f210 0x7f3b840c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.220+0000 7f3b8c16b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b8406f5f0 0x7f3b840caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.220+0000 7f3b8c16b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b84152c90 0x7f3b841ef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.220+0000 7f3b8c16b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b84155950 con 0x7f3b84152c90 2024-04-18T04:56:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b8a708640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b84152c90 0x7f3b841ef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b8c16b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b841566b0 con 0x7f3b8406f210 2024-04-18T04:56:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b8a708640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b84152c90 0x7f3b841ef3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51980/0 (socket says 172.21.15.96:51980) 2024-04-18T04:56:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b8a708640 1 -- 172.21.15.96:0/4121337091 learned_addr learned my addr 172.21.15.96:0/4121337091 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b8c16b640 1 -- 172.21.15.96:0/4121337091 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b841eef40 con 0x7f3b8406f5f0 2024-04-18T04:56:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b89f07640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b8406f210 0x7f3b840c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b89706640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b8406f5f0 0x7f3b840caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b8a708640 1 -- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b8406f5f0 msgr2=0x7f3b840caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b8a708640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b8406f5f0 0x7f3b840caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b8a708640 1 -- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b8406f210 msgr2=0x7f3b840c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b8a708640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b8406f210 0x7f3b840c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b8a708640 1 -- 172.21.15.96:0/4121337091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b800094d0 con 0x7f3b84152c90 2024-04-18T04:56:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b89f07640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b8406f210 0x7f3b840c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:56:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b8a708640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b84152c90 0x7f3b841ef3d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009d30 tx=0x7f3b7c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b7a7fc640 1 -- 172.21.15.96:0/4121337091 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c009ba0 con 0x7f3b84152c90 2024-04-18T04:56:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b7a7fc640 1 -- 172.21.15.96:0/4121337091 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7c00f040 con 0x7f3b84152c90 2024-04-18T04:56:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b7a7fc640 1 -- 172.21.15.96:0/4121337091 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0146c0 con 0x7f3b84152c90 2024-04-18T04:56:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b8c16b640 1 -- 172.21.15.96:0/4121337091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b84155b30 con 0x7f3b84152c90 2024-04-18T04:56:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b8c16b640 1 -- 172.21.15.96:0/4121337091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b841560f0 con 0x7f3b84152c90 2024-04-18T04:56:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b8c16b640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b84154170 0x7f3b841ef910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b8c16b640 1 -- 172.21.15.96:0/4121337091 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b84066b90 con 0x7f3b84154170 2024-04-18T04:56:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b89f07640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b84154170 0x7f3b841ef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b89f07640 1 -- 172.21.15.96:0/4121337091 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b840c6dc0 con 0x7f3b84154170 2024-04-18T04:56:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b89f07640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b84154170 0x7f3b841ef910 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3b840c3590 tx=0x7f3b8001d590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b7a7fc640 1 -- 172.21.15.96:0/4121337091 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3b7c014820 con 0x7f3b84152c90 2024-04-18T04:56:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.224+0000 7f3b7a7fc640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3b680666e0 0x7f3b68068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.228+0000 7f3b7a7fc640 1 -- 172.21.15.96:0/4121337091 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f3b7c084ed0 con 0x7f3b84152c90 2024-04-18T04:56:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.228+0000 7f3b89706640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3b680666e0 0x7f3b68068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.228+0000 7f3b7a7fc640 1 -- 172.21.15.96:0/4121337091 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b800b0d30 con 0x7f3b84154170 2024-04-18T04:56:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.228+0000 7f3b7a7fc640 1 -- 172.21.15.96:0/4121337091 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f3b800b0e90 con 0x7f3b84154170 2024-04-18T04:56:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.228+0000 7f3b7a7fc640 1 -- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b84154170 msgr2=0x7f3b841ef910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.228+0000 7f3b7a7fc640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b84154170 0x7f3b841ef910 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3b840c3590 tx=0x7f3b8001d590 comp rx=0 tx=0).stop 2024-04-18T04:56:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.228+0000 7f3b7a7fc640 1 -- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b84154170 msgr2=0x7f3b841ef910 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:56:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.228+0000 7f3b7a7fc640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b84154170 0x7f3b841ef910 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.228+0000 7f3b89706640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3b680666e0 0x7f3b68068ba0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3b84071a20 tx=0x7f3b74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.236+0000 7f3b8c16b640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b840caf60 0x7f3b8413f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.236+0000 7f3b8c16b640 1 -- 172.21.15.96:0/4121337091 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b840c70a0 con 0x7f3b840caf60 2024-04-18T04:56:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.236+0000 7f3b89f07640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b840caf60 0x7f3b8413f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b89f07640 1 -- 172.21.15.96:0/4121337091 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3b840c6620 con 0x7f3b840caf60 2024-04-18T04:56:18.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b89f07640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b840caf60 0x7f3b8413f130 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009870 tx=0x7f3b800aa000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b7a7fc640 1 -- 172.21.15.96:0/4121337091 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b800d1070 con 0x7f3b840caf60 2024-04-18T04:56:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b7a7fc640 1 -- 172.21.15.96:0/4121337091 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f3b800cd400 con 0x7f3b840caf60 2024-04-18T04:56:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b7a7fc640 1 -- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b840caf60 msgr2=0x7f3b8413f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b7a7fc640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b840caf60 0x7f3b8413f130 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009870 tx=0x7f3b800aa000 comp rx=0 tx=0).stop 2024-04-18T04:56:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b7a7fc640 1 -- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b840caf60 msgr2=0x7f3b8413f130 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:56:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b7a7fc640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b840caf60 0x7f3b8413f130 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.242 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:56:18.242 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:56:18.242 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:56:18.242 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:56:18.242 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 16, 2024-04-18T04:56:18.242 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:56:18.242 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:56:18.242 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:56:18.242 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:56:18.243 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.243 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 13, 2024-04-18T04:56:18.243 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:56:18.243 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:56:18.243 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:56:18.243 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:18.243 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:18.243 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:18.243 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:18.243 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:18.243 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:18.243 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:18.243 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:56:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:56:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:18.244 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:18.245 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:18.245 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.245 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:56:18.245 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:56:18.245 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:56:18.245 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:56:18.245 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:56:18.245 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:56:18.245 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:56:18.245 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:56:18.245 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:56:18.246 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:56:18.246 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:56:18.246 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:56:18.246 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:56:18.246 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:56:18.246 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:56:18.246 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:56:18.246 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:56:18.246 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:18.246 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:18.246 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:18.246 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:18.247 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:18.247 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:18.247 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:18.247 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:18.247 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:18.247 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:18.247 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.247 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:56:18.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.247 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:56:18.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.247 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:56:18.248 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:56:18.248 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:18.248 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:18.248 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.248 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:18.248 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:56:18.248 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.248 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.248 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:18.248 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:56:18.248 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.248 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.248 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.249 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.249 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:56:18.249 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:56:18.249 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:18.249 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:18.249 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:18.249 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.249 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.249 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:56:18.249 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:56:18.249 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:18.249 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:18.249 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.249 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:18.250 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:56:18.250 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.250 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:18.250 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:56:18.250 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.250 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.250 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.250 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:56:18.250 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:56:18.251 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:18.251 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:18.251 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:18.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.251 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:56:18.251 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:56:18.251 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:18.251 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:18.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.251 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:18.251 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:56:18.251 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.252 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.252 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:18.252 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:56:18.252 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.252 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.252 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.252 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:56:18.252 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:56:18.252 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:18.252 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:18.252 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:18.252 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.252 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.253 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:56:18.253 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:56:18.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.253 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:18.253 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:18.253 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:56:18.253 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.253 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.253 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:56:18.254 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.254 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:18.254 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:18.254 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:56:18.254 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.254 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.254 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:56:18.254 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:56:18.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b8c16b640 1 -- 172.21.15.96:0/4121337091 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3b680666e0 msgr2=0x7f3b68068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b8c16b640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3b680666e0 0x7f3b68068ba0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3b84071a20 tx=0x7f3b74009040 comp rx=0 tx=0).stop 2024-04-18T04:56:18.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b8c16b640 1 -- 172.21.15.96:0/4121337091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b84152c90 msgr2=0x7f3b841ef3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b8c16b640 1 --2- 172.21.15.96:0/4121337091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b84152c90 0x7f3b841ef3d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009d30 tx=0x7f3b7c00c490 comp rx=0 tx=0).stop 2024-04-18T04:56:18.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b8a708640 1 -- 172.21.15.96:0/4121337091 reap_dead start 2024-04-18T04:56:18.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b8a708640 1 -- 172.21.15.96:0/4121337091 reap_dead start 2024-04-18T04:56:18.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b8c16b640 1 -- 172.21.15.96:0/4121337091 shutdown_connections 2024-04-18T04:56:18.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b8c16b640 1 -- 172.21.15.96:0/4121337091 >> 172.21.15.96:0/4121337091 conn(0x7f3b8406b140 msgr2=0x7f3b840cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:18.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b8c16b640 1 -- 172.21.15.96:0/4121337091 shutdown_connections 2024-04-18T04:56:18.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.240+0000 7f3b8c16b640 1 -- 172.21.15.96:0/4121337091 wait complete. 2024-04-18T04:56:18.261 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:56:18.261 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-18T04:56:18.261 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-18T04:56:18.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.416+0000 7f8ee0408640 1 Processor -- start 2024-04-18T04:56:18.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.416+0000 7f8ee0408640 1 -- start start 2024-04-18T04:56:18.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.420+0000 7f8ee0408640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ed80c89a0 0x7f8ed8070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.420+0000 7f8ee0408640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8ed815a860 0x7f8ed815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.420+0000 7f8ee0408640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed8157be0 con 0x7f8ed8150cb0 2024-04-18T04:56:18.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.420+0000 7f8ee0408640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed815a3d0 con 0x7f8ed815a860 2024-04-18T04:56:18.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.420+0000 7f8ee0408640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80c5740 con 0x7f8ed80c89a0 2024-04-18T04:56:18.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.420+0000 7f8ede9a5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8ed815a860 0x7f8ed815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.420+0000 7f8ede1a4640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f8ed8150cb0 0x7f8ed80c4a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37556/0 (socket says 172.21.15.96:37556) 2024-04-18T04:56:18.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.420+0000 7f8ede1a4640 1 -- 172.21.15.96:0/4117328511 learned_addr learned my addr 172.21.15.96:0/4117328511 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:56:18.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.420+0000 7f8edd9a3640 1 --2- 172.21.15.96:0/4117328511 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ed80c89a0 0x7f8ed8070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.420+0000 7f8ede9a5640 1 -- 172.21.15.96:0/4117328511 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ed80c89a0 msgr2=0x7f8ed8070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:18.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.420+0000 7f8edd1a2640 1 -- 172.21.15.96:0/4117328511 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398530215 0 0) 0x7f8ed8157be0 con 0x7f8ed8150cb0 2024-04-18T04:56:18.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.420+0000 7f8ede9a5640 1 --2- 172.21.15.96:0/4117328511 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ed80c89a0 0x7f8ed8070fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.420+0000 7f8ede9a5640 1 -- 172.21.15.96:0/4117328511 >> v1:172.21.15.96:6789/0 conn(0x7f8ed8150cb0 legacy=0x7f8ed80c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.420+0000 7f8ede9a5640 1 -- 172.21.15.96:0/4117328511 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8157060 con 0x7f8ed815a860 2024-04-18T04:56:18.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.424+0000 7f8ede9a5640 1 --2- 172.21.15.96:0/4117328511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed815a860 0x7f8ed815acf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009d90 tx=0x7f8ed001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53706d7b2686f2bd server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.424+0000 7f8edd1a2640 1 -- 172.21.15.96:0/4117328511 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed00a5a00 con 0x7f8ed815a860 2024-04-18T04:56:18.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.424+0000 7f8edd1a2640 1 -- 172.21.15.96:0/4117328511 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed00a5b60 con 0x7f8ed815a860 2024-04-18T04:56:18.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.424+0000 7f8edd1a2640 1 -- 172.21.15.96:0/4117328511 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed00ad440 con 0x7f8ed815a860 2024-04-18T04:56:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.424+0000 7f8ee0408640 1 -- 172.21.15.96:0/4117328511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed815a860 msgr2=0x7f8ed815acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.424+0000 7f8ee0408640 1 --2- 172.21.15.96:0/4117328511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed815a860 0x7f8ed815acf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009d90 tx=0x7f8ed001c940 comp rx=0 tx=0).stop 2024-04-18T04:56:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.424+0000 7f8ee0408640 1 -- 172.21.15.96:0/4117328511 shutdown_connections 2024-04-18T04:56:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.424+0000 7f8ee0408640 1 --2- 172.21.15.96:0/4117328511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed815a860 0x7f8ed815acf0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.424+0000 7f8ee0408640 1 --2- 172.21.15.96:0/4117328511 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ed80c89a0 0x7f8ed8070fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.424+0000 7f8ee0408640 1 -- 172.21.15.96:0/4117328511 >> 172.21.15.96:0/4117328511 conn(0x7f8ed80c7e80 msgr2=0x7f8ed80c8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.424+0000 7f8ee0408640 1 -- 172.21.15.96:0/4117328511 shutdown_connections 2024-04-18T04:56:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.424+0000 7f8ee0408640 1 -- 172.21.15.96:0/4117328511 wait complete. 2024-04-18T04:56:18.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ee0408640 1 Processor -- start 2024-04-18T04:56:18.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ee0408640 1 -- start start 2024-04-18T04:56:18.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ee0408640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ed80c89a0 0x7f8ed814d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ee0408640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ed8150cb0 0x7f8ed814dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ee0408640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed815a860 0x7f8ed80c3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ee0408640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed814d210 con 0x7f8ed815a860 2024-04-18T04:56:18.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ee0408640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80c3120 con 0x7f8ed80c89a0 2024-04-18T04:56:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ee0408640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed81f1dc0 con 0x7f8ed8150cb0 2024-04-18T04:56:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ede9a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed815a860 0x7f8ed80c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ede9a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed815a860 0x7f8ed80c3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52002/0 (socket says 172.21.15.96:52002) 2024-04-18T04:56:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ede9a5640 1 -- 172.21.15.96:0/101503516 learned_addr learned my addr 172.21.15.96:0/101503516 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ede1a4640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ed80c89a0 0x7f8ed814d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8edd9a3640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ed8150cb0 0x7f8ed814dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ede9a5640 1 -- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ed8150cb0 msgr2=0x7f8ed814dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ede9a5640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ed8150cb0 0x7f8ed814dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ede9a5640 1 -- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ed80c89a0 msgr2=0x7f8ed814d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ede9a5640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ed80c89a0 0x7f8ed814d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ede9a5640 1 -- 172.21.15.96:0/101503516 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed0009a70 con 0x7f8ed815a860 2024-04-18T04:56:18.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ede9a5640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed815a860 0x7f8ed80c3730 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8ed001a570 tx=0x7f8ed00196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8eceffd640 1 -- 172.21.15.96:0/101503516 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed00bf070 con 0x7f8ed815a860 2024-04-18T04:56:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ee0408640 1 -- 172.21.15.96:0/101503516 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed8073f10 con 0x7f8ed815a860 2024-04-18T04:56:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8ee0408640 1 -- 172.21.15.96:0/101503516 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed814d460 con 0x7f8ed815a860 2024-04-18T04:56:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8eceffd640 1 -- 172.21.15.96:0/101503516 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed0009450 con 0x7f8ed815a860 2024-04-18T04:56:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.428+0000 7f8eceffd640 1 -- 172.21.15.96:0/101503516 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed00a5a00 con 0x7f8ed815a860 2024-04-18T04:56:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.432+0000 7f8ee0408640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec0002a40 0x7f8ec0004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.432+0000 7f8ee0408640 1 -- 172.21.15.96:0/101503516 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0007e90 con 0x7f8ec0002a40 2024-04-18T04:56:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.432+0000 7f8ede1a4640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec0002a40 0x7f8ec0004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.432+0000 7f8ede1a4640 1 -- 172.21.15.96:0/101503516 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ec0008050 con 0x7f8ec0002a40 2024-04-18T04:56:18.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.432+0000 7f8ede1a4640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec0002a40 0x7f8ec0004f00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4000f70 tx=0x7f8ed40019c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.432+0000 7f8eceffd640 1 -- 172.21.15.96:0/101503516 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed400f660 con 0x7f8ec0002a40 2024-04-18T04:56:18.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.432+0000 7f8eceffd640 1 -- 172.21.15.96:0/101503516 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8ed00b4050 con 0x7f8ed815a860 2024-04-18T04:56:18.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.432+0000 7f8eceffd640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8ebc066730 0x7f8ebc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.432+0000 7f8eceffd640 1 -- 172.21.15.96:0/101503516 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8ed011eaf0 con 0x7f8ed815a860 2024-04-18T04:56:18.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.432+0000 7f8edd9a3640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8ebc066730 0x7f8ebc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.432+0000 7f8eceffd640 1 -- 172.21.15.96:0/101503516 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f8ed400f7c0 con 0x7f8ec0002a40 2024-04-18T04:56:18.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.432+0000 7f8eceffd640 1 -- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec0002a40 msgr2=0x7f8ec0004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.432+0000 7f8eceffd640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec0002a40 0x7f8ec0004f00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4000f70 tx=0x7f8ed40019c0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.432+0000 7f8eceffd640 1 -- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec0002a40 msgr2=0x7f8ec0004f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:56:18.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.432+0000 7f8eceffd640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec0002a40 0x7f8ec0004f00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.432+0000 7f8edd9a3640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8ebc066730 0x7f8ebc068bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80bf190 tx=0x7f8ec8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.444+0000 7f8ee0408640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec0006f40 0x7f8ec00073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.444+0000 7f8ee0408640 1 -- 172.21.15.96:0/101503516 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0007940 con 0x7f8ec0006f40 2024-04-18T04:56:18.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.444+0000 7f8ede1a4640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec0006f40 0x7f8ec00073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.444+0000 7f8ede1a4640 1 -- 172.21.15.96:0/101503516 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8ec0007b00 con 0x7f8ec0006f40 2024-04-18T04:56:18.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.444+0000 7f8ede1a4640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec0006f40 0x7f8ec00073d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4001ec0 tx=0x7f8ed4001090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.444+0000 7f8eceffd640 1 -- 172.21.15.96:0/101503516 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4024070 con 0x7f8ec0006f40 2024-04-18T04:56:18.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.448+0000 7f8eceffd640 1 -- 172.21.15.96:0/101503516 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4806 (secure 0 0 0) 0x7f8ed401f2e0 con 0x7f8ec0006f40 2024-04-18T04:56:18.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.448+0000 7f8eceffd640 1 -- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec0006f40 msgr2=0x7f8ec00073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.448+0000 7f8eceffd640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec0006f40 0x7f8ec00073d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4001ec0 tx=0x7f8ed4001090 comp rx=0 tx=0).stop 2024-04-18T04:56:18.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.448+0000 7f8eceffd640 1 -- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec0006f40 msgr2=0x7f8ec00073d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:56:18.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.448+0000 7f8eceffd640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec0006f40 0x7f8ec00073d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.448 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:56:18.449 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:56:18.449 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:56:18.449 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:56:18.449 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 16, 2024-04-18T04:56:18.449 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:56:18.449 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:56:18.449 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:56:18.449 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:56:18.449 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.449 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 13, 2024-04-18T04:56:18.449 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:56:18.449 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:56:18.449 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:56:18.449 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:18.449 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:18.450 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:18.450 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:18.450 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:18.450 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:18.450 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:18.450 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:18.450 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:18.450 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:18.450 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.450 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:56:18.450 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:56:18.450 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:18.450 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:18.450 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:18.451 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:18.451 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:18.451 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:18.451 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:18.451 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:18.451 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:18.451 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:18.451 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.451 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:56:18.451 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:56:18.451 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:56:18.451 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:56:18.451 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:56:18.451 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:56:18.451 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:56:18.452 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:56:18.452 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:56:18.452 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:56:18.452 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:56:18.452 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:56:18.452 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:56:18.452 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:56:18.452 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:56:18.452 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:56:18.452 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:56:18.453 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:18.453 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:18.453 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:18.453 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:18.453 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:18.453 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:18.453 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:18.453 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:18.453 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:18.453 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:18.453 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.453 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:56:18.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.453 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:56:18.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.454 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:56:18.454 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:56:18.454 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:18.454 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:18.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.454 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:18.454 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:56:18.454 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.454 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:18.455 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:56:18.455 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.455 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.455 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.455 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:56:18.455 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:56:18.455 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:18.455 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:18.455 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:18.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.455 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:56:18.455 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:56:18.456 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:18.456 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:18.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.456 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:18.456 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:56:18.456 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.456 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:18.456 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:56:18.456 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.456 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.456 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.456 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:56:18.457 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:56:18.457 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:18.457 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:18.457 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:18.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.457 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:56:18.457 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:56:18.457 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:18.457 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:18.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.457 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:18.457 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:56:18.457 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.458 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:18.458 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:56:18.458 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:18.458 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.458 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.458 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:56:18.458 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:56:18.458 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:18.458 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:18.458 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:18.458 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.458 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.459 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:56:18.459 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:56:18.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.459 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:18.459 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:18.459 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:56:18.459 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.459 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.459 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:56:18.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.459 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:18.459 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:18.459 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:56:18.459 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.459 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.460 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:56:18.460 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.460 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:18.460 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:18.460 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:56:18.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.460 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:18.460 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:56:18.460 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:18.460 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:18.460 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:18.460 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:56:18.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:18.460 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:18.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:18.461 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:56:18.461 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:56:18.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.448+0000 7f8ee0408640 1 -- 172.21.15.96:0/101503516 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8ebc066730 msgr2=0x7f8ebc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.448+0000 7f8ee0408640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8ebc066730 0x7f8ebc068bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80bf190 tx=0x7f8ec8008040 comp rx=0 tx=0).stop 2024-04-18T04:56:18.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.448+0000 7f8ee0408640 1 -- 172.21.15.96:0/101503516 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed815a860 msgr2=0x7f8ed80c3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.448+0000 7f8ee0408640 1 --2- 172.21.15.96:0/101503516 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed815a860 0x7f8ed80c3730 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8ed001a570 tx=0x7f8ed00196e0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.448+0000 7f8ede9a5640 1 -- 172.21.15.96:0/101503516 reap_dead start 2024-04-18T04:56:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.448+0000 7f8ede9a5640 1 -- 172.21.15.96:0/101503516 reap_dead start 2024-04-18T04:56:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.448+0000 7f8ee0408640 1 -- 172.21.15.96:0/101503516 shutdown_connections 2024-04-18T04:56:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.448+0000 7f8ee0408640 1 -- 172.21.15.96:0/101503516 >> 172.21.15.96:0/101503516 conn(0x7f8ed80c7e80 msgr2=0x7f8ed81555b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.448+0000 7f8ee0408640 1 -- 172.21.15.96:0/101503516 shutdown_connections 2024-04-18T04:56:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.448+0000 7f8ee0408640 1 -- 172.21.15.96:0/101503516 wait complete. 2024-04-18T04:56:18.470 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:56:18.470 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-04-18T04:56:18.470 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-18T04:56:18.471 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-04-18T04:56:18.471 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-18T04:56:18.471 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-18T04:56:18.471 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:56:18.488 INFO:tasks.ceph.mon.a:Stopped 2024-04-18T04:56:18.488 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-18T04:56:18.488 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:56:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.684+0000 7f5e5337e640 1 Processor -- start 2024-04-18T04:56:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.684+0000 7f5e5337e640 1 -- start start 2024-04-18T04:56:18.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.684+0000 7f5e5337e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5e4c0c1a60 0x7f5e4c0b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.684+0000 7f5e5337e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e4c066270 con 0x7f5e4c156810 2024-04-18T04:56:18.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.684+0000 7f5e5337e640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e4c065cd0 con 0x7f5e4c14ffe0 2024-04-18T04:56:18.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.684+0000 7f5e5337e640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4c1503c0 con 0x7f5e4c0c1a60 2024-04-18T04:56:18.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.684+0000 7f5e50919640 1 -- >> v1:172.21.15.96:6789/0 conn(0x7f5e4c156810 legacy=0x7f5e4c0bfeb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.96:6789/0 2024-04-18T04:56:18.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.684+0000 7f5e5191b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5e4c0c1a60 0x7f5e4c0b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.684+0000 7f5e5191b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5e4c0c1a60 0x7f5e4c0b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:37984/0 (socket says 172.21.15.96:37984) 2024-04-18T04:56:18.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.684+0000 7f5e5191b640 1 -- 172.21.15.96:0/2279594202 learned_addr learned my addr 172.21.15.96:0/2279594202 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:18.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.688+0000 7f5e5191b640 1 -- 172.21.15.96:0/2279594202 >> v1:172.21.15.139:6789/0 conn(0x7f5e4c14ffe0 legacy=0x7f5e4c0c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.688+0000 7f5e5191b640 1 -- 172.21.15.96:0/2279594202 >> v1:172.21.15.96:6789/0 conn(0x7f5e4c156810 legacy=0x7f5e4c0bfeb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:56:18.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.688+0000 7f5e5191b640 1 -- 172.21.15.96:0/2279594202 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c065f90 con 0x7f5e4c0c1a60 2024-04-18T04:56:18.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.688+0000 7f5e5191b640 1 --2- 172.21.15.96:0/2279594202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e4c0c1a60 0x7f5e4c0b0730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009e50 tx=0x7f5e4401f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a64f9bd3cfc2fd6b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.692+0000 7f5e43fff640 1 -- 172.21.15.96:0/2279594202 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e440af400 con 0x7f5e4c0c1a60 2024-04-18T04:56:18.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.692+0000 7f5e43fff640 1 -- 172.21.15.96:0/2279594202 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e440ab050 con 0x7f5e4c0c1a60 2024-04-18T04:56:18.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.692+0000 7f5e43fff640 1 -- 172.21.15.96:0/2279594202 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e440af780 con 0x7f5e4c0c1a60 2024-04-18T04:56:18.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.692+0000 7f5e5337e640 1 -- 172.21.15.96:0/2279594202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e4c0c1a60 msgr2=0x7f5e4c0b0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.692+0000 7f5e5337e640 1 --2- 172.21.15.96:0/2279594202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e4c0c1a60 0x7f5e4c0b0730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009e50 tx=0x7f5e4401f1e0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.692+0000 7f5e5337e640 1 -- 172.21.15.96:0/2279594202 shutdown_connections 2024-04-18T04:56:18.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.692+0000 7f5e5337e640 1 --2- 172.21.15.96:0/2279594202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e4c0c1a60 0x7f5e4c0b0730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.692+0000 7f5e5337e640 1 -- 172.21.15.96:0/2279594202 >> 172.21.15.96:0/2279594202 conn(0x7f5e4c0cab90 msgr2=0x7f5e4c0cafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:18.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.692+0000 7f5e5337e640 1 -- 172.21.15.96:0/2279594202 shutdown_connections 2024-04-18T04:56:18.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.692+0000 7f5e5337e640 1 -- 172.21.15.96:0/2279594202 wait complete. 2024-04-18T04:56:18.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.692+0000 7f5e5337e640 1 Processor -- start 2024-04-18T04:56:18.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.692+0000 7f5e5337e640 1 -- start start 2024-04-18T04:56:18.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5337e640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e4c0c1a60 0x7f5e4c070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5337e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e4c14ffe0 0x7f5e4c141ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5337e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e4c156810 0x7f5e4c1421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5337e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c141810 con 0x7f5e4c14ffe0 2024-04-18T04:56:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5337e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c1ef3b0 con 0x7f5e4c156810 2024-04-18T04:56:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5337e640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c071810 con 0x7f5e4c0c1a60 2024-04-18T04:56:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e50919640 1 -- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e4c14ffe0 msgr2=0x7f5e4c141ca0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:3300/0 2024-04-18T04:56:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e50919640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e4c14ffe0 0x7f5e4c141ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5191b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e4c156810 0x7f5e4c1421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5111a640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e4c0c1a60 0x7f5e4c070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5191b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e4c156810 0x7f5e4c1421e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:37986/0 (socket says 172.21.15.96:37986) 2024-04-18T04:56:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5191b640 1 -- 172.21.15.96:0/2072169288 learned_addr learned my addr 172.21.15.96:0/2072169288 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5191b640 1 -- 172.21.15.96:0/2072169288 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e4c0c1a60 msgr2=0x7f5e4c070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5191b640 1 --2- 172.21.15.96:0/2072169288 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e4c0c1a60 0x7f5e4c070d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5191b640 1 -- 172.21.15.96:0/2072169288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e4c14ffe0 msgr2=0x7f5e4c141ca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:56:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5191b640 1 --2- 172.21.15.96:0/2072169288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e4c14ffe0 0x7f5e4c141ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5191b640 1 -- 172.21.15.96:0/2072169288 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e44009b30 con 0x7f5e4c156810 2024-04-18T04:56:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5191b640 1 --2- 172.21.15.96:0/2072169288 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e4c156810 0x7f5e4c1421e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e4401bdf0 tx=0x7f5e4401bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e41ffb640 1 -- 172.21.15.96:0/2072169288 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e440afdc0 con 0x7f5e4c156810 2024-04-18T04:56:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e41ffb640 1 -- 172.21.15.96:0/2072169288 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e44009510 con 0x7f5e4c156810 2024-04-18T04:56:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5337e640 1 -- 172.21.15.96:0/2072169288 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4c071af0 con 0x7f5e4c156810 2024-04-18T04:56:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e41ffb640 1 -- 172.21.15.96:0/2072169288 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e440b8640 con 0x7f5e4c156810 2024-04-18T04:56:18.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e5337e640 1 -- 172.21.15.96:0/2072169288 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4c1ef070 con 0x7f5e4c156810 2024-04-18T04:56:18.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.696+0000 7f5e377fe640 1 -- 172.21.15.96:0/2072169288 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e24005260 con 0x7f5e4c156810 2024-04-18T04:56:18.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.700+0000 7f5e41ffb640 1 -- 172.21.15.96:0/2072169288 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5e440b6040 con 0x7f5e4c156810 2024-04-18T04:56:18.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.700+0000 7f5e41ffb640 1 --2- 172.21.15.96:0/2072169288 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5e30066640 0x7f5e30068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:18.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.700+0000 7f5e41ffb640 1 -- 172.21.15.96:0/2072169288 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5e44122a00 con 0x7f5e4c156810 2024-04-18T04:56:18.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.700+0000 7f5e5111a640 1 --2- 172.21.15.96:0/2072169288 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5e30066640 0x7f5e30068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.700+0000 7f5e5111a640 1 --2- 172.21.15.96:0/2072169288 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5e30066640 0x7f5e30068b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e48007fd0 tx=0x7f5e48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:18.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:18.712+0000 7f5e41ffb640 1 -- 172.21.15.96:0/2072169288 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f5e440efe50 con 0x7f5e4c156810 2024-04-18T04:56:19.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:19.136+0000 7f5e377fe640 1 -- 172.21.15.96:0/2072169288 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5e240057e0 con 0x7f5e4c156810 2024-04-18T04:56:19.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:19.140+0000 7f5e41ffb640 1 -- 172.21.15.96:0/2072169288 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f5e440b4620 con 0x7f5e4c156810 2024-04-18T04:56:19.140 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:56:19.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:19.140+0000 7f5e377fe640 1 -- 172.21.15.96:0/2072169288 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5e30066640 msgr2=0x7f5e30068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:19.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:19.140+0000 7f5e377fe640 1 --2- 172.21.15.96:0/2072169288 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5e30066640 0x7f5e30068b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e48007fd0 tx=0x7f5e48009040 comp rx=0 tx=0).stop 2024-04-18T04:56:19.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:19.140+0000 7f5e377fe640 1 -- 172.21.15.96:0/2072169288 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e4c156810 msgr2=0x7f5e4c1421e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:19.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:19.140+0000 7f5e377fe640 1 --2- 172.21.15.96:0/2072169288 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e4c156810 0x7f5e4c1421e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e4401bdf0 tx=0x7f5e4401bf80 comp rx=0 tx=0).stop 2024-04-18T04:56:19.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:19.140+0000 7f5e377fe640 1 -- 172.21.15.96:0/2072169288 shutdown_connections 2024-04-18T04:56:19.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:19.140+0000 7f5e377fe640 1 --2- 172.21.15.96:0/2072169288 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5e30066640 0x7f5e30068b00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:19.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:19.140+0000 7f5e377fe640 1 --2- 172.21.15.96:0/2072169288 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e4c156810 0x7f5e4c1421e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:19.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:19.140+0000 7f5e377fe640 1 --2- 172.21.15.96:0/2072169288 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e4c14ffe0 0x7f5e4c141ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:19.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:19.140+0000 7f5e377fe640 1 --2- 172.21.15.96:0/2072169288 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e4c0c1a60 0x7f5e4c070d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:19.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:19.140+0000 7f5e377fe640 1 -- 172.21.15.96:0/2072169288 >> 172.21.15.96:0/2072169288 conn(0x7f5e4c0cab90 msgr2=0x7f5e4c0c0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:19.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:19.140+0000 7f5e377fe640 1 -- 172.21.15.96:0/2072169288 shutdown_connections 2024-04-18T04:56:19.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:19.140+0000 7f5e377fe640 1 -- 172.21.15.96:0/2072169288 wait complete. 2024-04-18T04:56:22.165 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:56:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.316+0000 7fad48a59640 1 Processor -- start 2024-04-18T04:56:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.316+0000 7fad48a59640 1 -- start start 2024-04-18T04:56:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad48a59640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fad441512c0 0x7fad440cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad48a59640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad440c76d0 con 0x7fad440c8a50 2024-04-18T04:56:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad48a59640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad44071d00 con 0x7fad44150ee0 2024-04-18T04:56:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad48a59640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad440c6c80 con 0x7fad441512c0 2024-04-18T04:56:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad42d9d640 1 -- >> v1:172.21.15.96:6789/0 conn(0x7fad440c8a50 legacy=0x7fad440c4b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.96:6789/0 2024-04-18T04:56:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad3bfff640 1 -- >> v2:172.21.15.96:3300/0 conn(0x7fad441512c0 msgr2=0x7fad440cbd20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.96:3300/0 2024-04-18T04:56:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad3bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fad441512c0 0x7fad440cbd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad4259c640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fad44150ee0 0x7fad4415a3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.96:46284/0 (socket says 172.21.15.96:46284) 2024-04-18T04:56:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad4259c640 1 -- 172.21.15.96:0/970782837 learned_addr learned my addr 172.21.15.96:0/970782837 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:56:22.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad41d9b640 1 -- 172.21.15.96:0/970782837 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605543987 0 0) 0x7fad44071d00 con 0x7fad44150ee0 2024-04-18T04:56:22.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad41d9b640 1 -- 172.21.15.96:0/970782837 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad30003530 con 0x7fad44150ee0 2024-04-18T04:56:22.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad41d9b640 1 -- 172.21.15.96:0/970782837 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1480897549 0 0) 0x7fad30003530 con 0x7fad44150ee0 2024-04-18T04:56:22.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad41d9b640 1 -- 172.21.15.96:0/970782837 >> v2:172.21.15.96:3300/0 conn(0x7fad441512c0 msgr2=0x7fad440cbd20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:56:22.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad41d9b640 1 --2- 172.21.15.96:0/970782837 >> v2:172.21.15.96:3300/0 conn(0x7fad441512c0 0x7fad440cbd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:22.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad41d9b640 1 -- 172.21.15.96:0/970782837 >> v1:172.21.15.96:6789/0 conn(0x7fad440c8a50 legacy=0x7fad440c4b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:56:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad41d9b640 1 -- 172.21.15.96:0/970782837 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad44071fe0 con 0x7fad44150ee0 2024-04-18T04:56:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad41d9b640 1 -- 172.21.15.96:0/970782837 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fad34001680 con 0x7fad44150ee0 2024-04-18T04:56:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad41d9b640 1 -- 172.21.15.96:0/970782837 >> v1:172.21.15.139:6789/0 conn(0x7fad44150ee0 legacy=0x7fad4415a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad41d9b640 1 --2- 172.21.15.96:0/970782837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad30003980 0x7fad30003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad41d9b640 1 --2- 172.21.15.96:0/970782837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad300047d0 0x7fad30004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad41d9b640 1 --2- 172.21.15.96:0/970782837 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad30005200 0x7fad3000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad41d9b640 1 -- 172.21.15.96:0/970782837 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad440c6c80 con 0x7fad30003980 2024-04-18T04:56:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad41d9b640 1 -- 172.21.15.96:0/970782837 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3000c150 con 0x7fad300047d0 2024-04-18T04:56:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad41d9b640 1 -- 172.21.15.96:0/970782837 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3000c310 con 0x7fad30005200 2024-04-18T04:56:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad4259c640 1 -- 172.21.15.96:0/970782837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad30003980 msgr2=0x7fad30003d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.96:3300/0 2024-04-18T04:56:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad4259c640 1 --2- 172.21.15.96:0/970782837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad30003980 0x7fad30003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad3bfff640 1 --2- 172.21.15.96:0/970782837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad300047d0 0x7fad30004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:22.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad42d9d640 1 --2- 172.21.15.96:0/970782837 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad30005200 0x7fad3000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:22.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad42d9d640 1 -- 172.21.15.96:0/970782837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad300047d0 msgr2=0x7fad30004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:22.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad42d9d640 1 --2- 172.21.15.96:0/970782837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad300047d0 0x7fad30004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:22.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad42d9d640 1 -- 172.21.15.96:0/970782837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad30003980 msgr2=0x7fad30003d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:56:22.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad42d9d640 1 --2- 172.21.15.96:0/970782837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad30003980 0x7fad30003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:22.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.320+0000 7fad42d9d640 1 -- 172.21.15.96:0/970782837 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad30003530 con 0x7fad30005200 2024-04-18T04:56:22.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.324+0000 7fad42d9d640 1 -- 172.21.15.96:0/970782837 reap_dead start 2024-04-18T04:56:22.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.324+0000 7fad42d9d640 1 --2- 172.21.15.96:0/970782837 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad30005200 0x7fad3000b990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009e30 tx=0x7fad3c01cb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5ae6b97857d0bf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:22.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.324+0000 7fad41d9b640 1 -- 172.21.15.96:0/970782837 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0a5a10 con 0x7fad30005200 2024-04-18T04:56:22.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.324+0000 7fad41d9b640 1 -- 172.21.15.96:0/970782837 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c0a5bb0 con 0x7fad30005200 2024-04-18T04:56:22.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.324+0000 7fad41d9b640 1 -- 172.21.15.96:0/970782837 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0ac3c0 con 0x7fad30005200 2024-04-18T04:56:22.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.328+0000 7fad48a59640 1 -- 172.21.15.96:0/970782837 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad30005200 msgr2=0x7fad3000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:22.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.328+0000 7fad48a59640 1 --2- 172.21.15.96:0/970782837 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad30005200 0x7fad3000b990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009e30 tx=0x7fad3c01cb10 comp rx=0 tx=0).stop 2024-04-18T04:56:22.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.328+0000 7fad48a59640 1 -- 172.21.15.96:0/970782837 shutdown_connections 2024-04-18T04:56:22.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.328+0000 7fad48a59640 1 --2- 172.21.15.96:0/970782837 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad30005200 0x7fad3000b990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:22.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.328+0000 7fad48a59640 1 -- 172.21.15.96:0/970782837 >> 172.21.15.96:0/970782837 conn(0x7fad44066250 msgr2=0x7fad4406eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:22.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.328+0000 7fad48a59640 1 -- 172.21.15.96:0/970782837 shutdown_connections 2024-04-18T04:56:22.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.328+0000 7fad48a59640 1 -- 172.21.15.96:0/970782837 wait complete. 2024-04-18T04:56:22.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.328+0000 7fad48a59640 1 Processor -- start 2024-04-18T04:56:22.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.328+0000 7fad48a59640 1 -- start start 2024-04-18T04:56:22.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.328+0000 7fad48a59640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad30005200 0x7fad441591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:22.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.328+0000 7fad48a59640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad441eaac0 0x7fad44153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:22.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.328+0000 7fad4259c640 1 -- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad30005200 msgr2=0x7fad441591f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:3300/0 2024-04-18T04:56:22.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.328+0000 7fad4259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad30005200 0x7fad441591f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:22.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad48a59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad4414d7e0 0x7fad4414dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:22.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad48a59640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad441e9dd0 con 0x7fad30005200 2024-04-18T04:56:22.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad48a59640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad441eddf0 con 0x7fad4414d7e0 2024-04-18T04:56:22.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad48a59640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4414e180 con 0x7fad441eaac0 2024-04-18T04:56:22.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad3bfff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad441eaac0 0x7fad44153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:22.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad42d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad4414d7e0 0x7fad4414dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:22.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad3bfff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad441eaac0 0x7fad44153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:49286/0 (socket says 172.21.15.96:49286) 2024-04-18T04:56:22.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad3bfff640 1 -- 172.21.15.96:0/1143203313 learned_addr learned my addr 172.21.15.96:0/1143203313 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:22.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad3bfff640 1 -- 172.21.15.96:0/1143203313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad4414d7e0 msgr2=0x7fad4414dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:22.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad3bfff640 1 --2- 172.21.15.96:0/1143203313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad4414d7e0 0x7fad4414dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:22.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad3bfff640 1 -- 172.21.15.96:0/1143203313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad30005200 msgr2=0x7fad441591f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:56:22.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad3bfff640 1 --2- 172.21.15.96:0/1143203313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad30005200 0x7fad441591f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:22.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad3bfff640 1 -- 172.21.15.96:0/1143203313 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad441ee040 con 0x7fad441eaac0 2024-04-18T04:56:22.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad3bfff640 1 --2- 172.21.15.96:0/1143203313 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad441eaac0 0x7fad44153b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009fd0 tx=0x7fad2c00eaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:22.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad3affd640 1 -- 172.21.15.96:0/1143203313 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c003bd0 con 0x7fad441eaac0 2024-04-18T04:56:22.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad3affd640 1 -- 172.21.15.96:0/1143203313 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2c003d30 con 0x7fad441eaac0 2024-04-18T04:56:22.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad3affd640 1 -- 172.21.15.96:0/1143203313 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c003ea0 con 0x7fad441eaac0 2024-04-18T04:56:22.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad48a59640 1 -- 172.21.15.96:0/1143203313 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad441e9fe0 con 0x7fad441eaac0 2024-04-18T04:56:22.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad48a59640 1 -- 172.21.15.96:0/1143203313 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad441ea5a0 con 0x7fad441eaac0 2024-04-18T04:56:22.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.332+0000 7fad48a59640 1 -- 172.21.15.96:0/1143203313 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad44067050 con 0x7fad441eaac0 2024-04-18T04:56:22.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.336+0000 7fad3affd640 1 -- 172.21.15.96:0/1143203313 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fad2c005310 con 0x7fad441eaac0 2024-04-18T04:56:22.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.336+0000 7fad3affd640 1 --2- 172.21.15.96:0/1143203313 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fad24066670 0x7fad24068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:22.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.336+0000 7fad3affd640 1 -- 172.21.15.96:0/1143203313 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fad2c0843a0 con 0x7fad441eaac0 2024-04-18T04:56:22.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.336+0000 7fad4259c640 1 --2- 172.21.15.96:0/1143203313 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fad24066670 0x7fad24068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:22.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.336+0000 7fad4259c640 1 --2- 172.21.15.96:0/1143203313 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fad24066670 0x7fad24068b30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fad34004880 tx=0x7fad340014a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:22.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.348+0000 7fad3affd640 1 -- 172.21.15.96:0/1143203313 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fad2c0516e0 con 0x7fad441eaac0 2024-04-18T04:56:22.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.644+0000 7fad48a59640 1 -- 172.21.15.96:0/1143203313 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fad441547f0 con 0x7fad441eaac0 2024-04-18T04:56:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.644+0000 7fad3affd640 1 -- 172.21.15.96:0/1143203313 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fad2c054d00 con 0x7fad441eaac0 2024-04-18T04:56:22.647 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:56:22.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.648+0000 7fad48a59640 1 -- 172.21.15.96:0/1143203313 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fad24066670 msgr2=0x7fad24068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.648+0000 7fad48a59640 1 --2- 172.21.15.96:0/1143203313 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fad24066670 0x7fad24068b30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fad34004880 tx=0x7fad340014a0 comp rx=0 tx=0).stop 2024-04-18T04:56:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.648+0000 7fad48a59640 1 -- 172.21.15.96:0/1143203313 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad441eaac0 msgr2=0x7fad44153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.648+0000 7fad48a59640 1 --2- 172.21.15.96:0/1143203313 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad441eaac0 0x7fad44153b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009fd0 tx=0x7fad2c00eaa0 comp rx=0 tx=0).stop 2024-04-18T04:56:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.648+0000 7fad48a59640 1 -- 172.21.15.96:0/1143203313 shutdown_connections 2024-04-18T04:56:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.648+0000 7fad48a59640 1 --2- 172.21.15.96:0/1143203313 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fad24066670 0x7fad24068b30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.648+0000 7fad48a59640 1 --2- 172.21.15.96:0/1143203313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad4414d7e0 0x7fad4414dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.648+0000 7fad48a59640 1 --2- 172.21.15.96:0/1143203313 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad441eaac0 0x7fad44153b10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.648+0000 7fad48a59640 1 --2- 172.21.15.96:0/1143203313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad30005200 0x7fad441591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.648+0000 7fad48a59640 1 -- 172.21.15.96:0/1143203313 >> 172.21.15.96:0/1143203313 conn(0x7fad44066250 msgr2=0x7fad44154f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.648+0000 7fad48a59640 1 -- 172.21.15.96:0/1143203313 shutdown_connections 2024-04-18T04:56:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:22.648+0000 7fad48a59640 1 -- 172.21.15.96:0/1143203313 wait complete. 2024-04-18T04:56:25.666 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:56:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.820+0000 7fe0f3163640 1 Processor -- start 2024-04-18T04:56:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.820+0000 7fe0f3163640 1 -- start start 2024-04-18T04:56:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.820+0000 7fe0f3163640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe0ec1532d0 0x7fe0ec158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.820+0000 7fe0f3163640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe0ec0c3fd0 0x7fe0ec0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.820+0000 7fe0f3163640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ec1536b0 con 0x7fe0ec0cacc0 2024-04-18T04:56:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.820+0000 7fe0f0eff640 1 -- >> v2:172.21.15.96:3300/0 conn(0x7fe0ec1532d0 msgr2=0x7fe0ec158f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.96:3300/0 2024-04-18T04:56:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.820+0000 7fe0f3163640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ec0c5970 con 0x7fe0ec1532d0 2024-04-18T04:56:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.820+0000 7fe0f3163640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ec1594a0 con 0x7fe0ec0c3fd0 2024-04-18T04:56:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.820+0000 7fe0f0eff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe0ec1532d0 0x7fe0ec158f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.820+0000 7fe0f1700640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe0ec0c3fd0 0x7fe0ec0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:25.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.820+0000 7fe0f1700640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe0ec0c3fd0 0x7fe0ec0ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:55520/0 (socket says 172.21.15.96:55520) 2024-04-18T04:56:25.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.820+0000 7fe0f1700640 1 -- 172.21.15.96:0/3754272837 learned_addr learned my addr 172.21.15.96:0/3754272837 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:25.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.820+0000 7fe0f1700640 1 -- 172.21.15.96:0/3754272837 >> v2:172.21.15.96:3300/0 conn(0x7fe0ec1532d0 msgr2=0x7fe0ec158f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:56:25.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.820+0000 7fe0f1700640 1 --2- 172.21.15.96:0/3754272837 >> v2:172.21.15.96:3300/0 conn(0x7fe0ec1532d0 0x7fe0ec158f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:25.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.820+0000 7fe0f1700640 1 -- 172.21.15.96:0/3754272837 >> v1:172.21.15.139:6789/0 conn(0x7fe0ec0cacc0 legacy=0x7fe0ec15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:25.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.820+0000 7fe0f1700640 1 -- 172.21.15.96:0/3754272837 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec159680 con 0x7fe0ec0c3fd0 2024-04-18T04:56:25.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.824+0000 7fe0f1700640 1 --2- 172.21.15.96:0/3754272837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ec0c3fd0 0x7fe0ec0ce740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec08c800 tx=0x7fe0e401f200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=612b84095b267184 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.824+0000 7fe0eb7fe640 1 -- 172.21.15.96:0/3754272837 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e40af400 con 0x7fe0ec0c3fd0 2024-04-18T04:56:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.824+0000 7fe0eb7fe640 1 -- 172.21.15.96:0/3754272837 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e40ab050 con 0x7fe0ec0c3fd0 2024-04-18T04:56:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.824+0000 7fe0eb7fe640 1 -- 172.21.15.96:0/3754272837 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e40af780 con 0x7fe0ec0c3fd0 2024-04-18T04:56:25.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.828+0000 7fe0f3163640 1 -- 172.21.15.96:0/3754272837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ec0c3fd0 msgr2=0x7fe0ec0ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:25.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.828+0000 7fe0f3163640 1 --2- 172.21.15.96:0/3754272837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ec0c3fd0 0x7fe0ec0ce740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec08c800 tx=0x7fe0e401f200 comp rx=0 tx=0).stop 2024-04-18T04:56:25.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.828+0000 7fe0f3163640 1 -- 172.21.15.96:0/3754272837 shutdown_connections 2024-04-18T04:56:25.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.828+0000 7fe0f3163640 1 --2- 172.21.15.96:0/3754272837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ec0c3fd0 0x7fe0ec0ce740 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:25.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.828+0000 7fe0f3163640 1 --2- 172.21.15.96:0/3754272837 >> v2:172.21.15.96:3300/0 conn(0x7fe0ec1532d0 0x7fe0ec158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.828+0000 7fe0f3163640 1 -- 172.21.15.96:0/3754272837 >> 172.21.15.96:0/3754272837 conn(0x7fe0ec071760 msgr2=0x7fe0ec06b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.828+0000 7fe0f3163640 1 -- 172.21.15.96:0/3754272837 shutdown_connections 2024-04-18T04:56:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.828+0000 7fe0f3163640 1 -- 172.21.15.96:0/3754272837 wait complete. 2024-04-18T04:56:25.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.828+0000 7fe0f3163640 1 Processor -- start 2024-04-18T04:56:25.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.828+0000 7fe0f3163640 1 -- start start 2024-04-18T04:56:25.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f3163640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0ec0c3fd0 0x7fe0ec157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:25.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f3163640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ec0cacc0 0x7fe0ec147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:25.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f3163640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0ec1532d0 0x7fe0ec0b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:25.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f3163640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec159f20 con 0x7fe0ec1532d0 2024-04-18T04:56:25.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f1700640 1 -- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0ec1532d0 msgr2=0x7fe0ec0b3d60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:3300/0 2024-04-18T04:56:25.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f3163640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec1ef1e0 con 0x7fe0ec0cacc0 2024-04-18T04:56:25.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f1700640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0ec1532d0 0x7fe0ec0b3d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:25.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f3163640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0b4530 con 0x7fe0ec0c3fd0 2024-04-18T04:56:25.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f0eff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0ec0c3fd0 0x7fe0ec157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:25.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0ebfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ec0cacc0 0x7fe0ec147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0ebfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ec0cacc0 0x7fe0ec147460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:55524/0 (socket says 172.21.15.96:55524) 2024-04-18T04:56:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f0eff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0ec0c3fd0 0x7fe0ec157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:49296/0 (socket says 172.21.15.96:49296) 2024-04-18T04:56:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0ebfff640 1 -- 172.21.15.96:0/687644035 learned_addr learned my addr 172.21.15.96:0/687644035 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f0eff640 1 -- 172.21.15.96:0/687644035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ec0cacc0 msgr2=0x7fe0ec147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f0eff640 1 --2- 172.21.15.96:0/687644035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ec0cacc0 0x7fe0ec147460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f0eff640 1 -- 172.21.15.96:0/687644035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0ec1532d0 msgr2=0x7fe0ec0b3d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:56:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f0eff640 1 --2- 172.21.15.96:0/687644035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0ec1532d0 0x7fe0ec0b3d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f0eff640 1 -- 172.21.15.96:0/687644035 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e4009b30 con 0x7fe0ec0c3fd0 2024-04-18T04:56:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f0eff640 1 --2- 172.21.15.96:0/687644035 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0ec0c3fd0 0x7fe0ec157ca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000b470 tx=0x7fe0e000b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:25.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0e97fa640 1 -- 172.21.15.96:0/687644035 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0003dd0 con 0x7fe0ec0c3fd0 2024-04-18T04:56:25.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0e97fa640 1 -- 172.21.15.96:0/687644035 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e0005070 con 0x7fe0ec0c3fd0 2024-04-18T04:56:25.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0e97fa640 1 -- 172.21.15.96:0/687644035 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0005460 con 0x7fe0ec0c3fd0 2024-04-18T04:56:25.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f3163640 1 -- 172.21.15.96:0/687644035 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ec0b42a0 con 0x7fe0ec0c3fd0 2024-04-18T04:56:25.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f3163640 1 -- 172.21.15.96:0/687644035 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ec1ee8b0 con 0x7fe0ec0c3fd0 2024-04-18T04:56:25.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.832+0000 7fe0f3163640 1 -- 172.21.15.96:0/687644035 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ec15c910 con 0x7fe0ec0c3fd0 2024-04-18T04:56:25.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.836+0000 7fe0e97fa640 1 -- 172.21.15.96:0/687644035 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe0e00055c0 con 0x7fe0ec0c3fd0 2024-04-18T04:56:25.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.836+0000 7fe0e97fa640 1 --2- 172.21.15.96:0/687644035 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe0d0066640 0x7fe0d0068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:25.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.836+0000 7fe0e97fa640 1 -- 172.21.15.96:0/687644035 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe0e0084900 con 0x7fe0ec0c3fd0 2024-04-18T04:56:25.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.836+0000 7fe0ebfff640 1 --2- 172.21.15.96:0/687644035 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe0d0066640 0x7fe0d0068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:25.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.836+0000 7fe0ebfff640 1 --2- 172.21.15.96:0/687644035 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe0d0066640 0x7fe0d0068b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec0cbcb0 tx=0x7fe0d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:25.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:25.848+0000 7fe0e97fa640 1 -- 172.21.15.96:0/687644035 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe0e0051b20 con 0x7fe0ec0c3fd0 2024-04-18T04:56:26.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:26.272+0000 7fe0f3163640 1 -- 172.21.15.96:0/687644035 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe0ec067050 con 0x7fe0ec0c3fd0 2024-04-18T04:56:26.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:26.272+0000 7fe0e97fa640 1 -- 172.21.15.96:0/687644035 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fe0e0055140 con 0x7fe0ec0c3fd0 2024-04-18T04:56:26.274 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:56:26.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:26.276+0000 7fe0f3163640 1 -- 172.21.15.96:0/687644035 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe0d0066640 msgr2=0x7fe0d0068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:26.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:26.276+0000 7fe0f3163640 1 --2- 172.21.15.96:0/687644035 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe0d0066640 0x7fe0d0068b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec0cbcb0 tx=0x7fe0d8009040 comp rx=0 tx=0).stop 2024-04-18T04:56:26.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:26.276+0000 7fe0f3163640 1 -- 172.21.15.96:0/687644035 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0ec0c3fd0 msgr2=0x7fe0ec157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:26.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:26.276+0000 7fe0f3163640 1 --2- 172.21.15.96:0/687644035 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0ec0c3fd0 0x7fe0ec157ca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000b470 tx=0x7fe0e000b930 comp rx=0 tx=0).stop 2024-04-18T04:56:26.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:26.276+0000 7fe0f3163640 1 -- 172.21.15.96:0/687644035 shutdown_connections 2024-04-18T04:56:26.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:26.276+0000 7fe0f3163640 1 --2- 172.21.15.96:0/687644035 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe0d0066640 0x7fe0d0068b00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:26.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:26.276+0000 7fe0f3163640 1 --2- 172.21.15.96:0/687644035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0ec1532d0 0x7fe0ec0b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:26.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:26.276+0000 7fe0f3163640 1 --2- 172.21.15.96:0/687644035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0ec0cacc0 0x7fe0ec147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:26.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:26.276+0000 7fe0f3163640 1 --2- 172.21.15.96:0/687644035 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0ec0c3fd0 0x7fe0ec157ca0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:26.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:26.276+0000 7fe0f3163640 1 -- 172.21.15.96:0/687644035 >> 172.21.15.96:0/687644035 conn(0x7fe0ec071760 msgr2=0x7fe0ec1494b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:26.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:26.276+0000 7fe0f3163640 1 -- 172.21.15.96:0/687644035 shutdown_connections 2024-04-18T04:56:26.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:26.276+0000 7fe0f3163640 1 -- 172.21.15.96:0/687644035 wait complete. 2024-04-18T04:56:29.299 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:56:29.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.424+0000 7fc16f4db640 1 Processor -- start 2024-04-18T04:56:29.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.424+0000 7fc16f4db640 1 -- start start 2024-04-18T04:56:29.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.424+0000 7fc16f4db640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc168071680 0x7fc1680b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:29.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.424+0000 7fc16f4db640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 0x7fc1680c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:29.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.424+0000 7fc16f4db640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc168070ef0 con 0x7fc1680c1280 2024-04-18T04:56:29.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.424+0000 7fc16f4db640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1680c5d80 con 0x7fc168071680 2024-04-18T04:56:29.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.424+0000 7fc16f4db640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc168070970 con 0x7fc1680710c0 2024-04-18T04:56:29.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.424+0000 7fc16ca76640 1 -- >> v2:172.21.15.96:3300/0 conn(0x7fc168071680 msgr2=0x7fc1680b0ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.96:3300/0 2024-04-18T04:56:29.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.424+0000 7fc16ca76640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc168071680 0x7fc1680b0ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:29.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.424+0000 7fc16da78640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 0x7fc1680c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:29.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.424+0000 7fc16da78640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 0x7fc1680c7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:47914/0 (socket says 172.21.15.96:47914) 2024-04-18T04:56:29.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.424+0000 7fc16da78640 1 -- 172.21.15.96:0/606216981 learned_addr learned my addr 172.21.15.96:0/606216981 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:29.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.424+0000 7fc16da78640 1 -- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 msgr2=0x7fc1680c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T04:56:29.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.424+0000 7fc16da78640 1 -- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 msgr2=0x7fc1680c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:29.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.424+0000 7fc16da78640 1 --2- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 0x7fc1680c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:29.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.424+0000 7fc16da78640 1 --2- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 0x7fc1680c7ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:29.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.628+0000 7fc16ca76640 1 -- 172.21.15.96:0/606216981 >> v2:172.21.15.96:3300/0 conn(0x7fc168071680 msgr2=0x7fc1680b0ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.96:3300/0 2024-04-18T04:56:29.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.628+0000 7fc16ca76640 1 --2- 172.21.15.96:0/606216981 >> v2:172.21.15.96:3300/0 conn(0x7fc168071680 0x7fc1680b0ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:56:29.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.628+0000 7fc16da78640 1 --2- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 0x7fc1680c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:29.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.628+0000 7fc16da78640 1 -- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 msgr2=0x7fc1680c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:56:29.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.628+0000 7fc16da78640 1 -- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 msgr2=0x7fc1680c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:29.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.628+0000 7fc16da78640 1 --2- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 0x7fc1680c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:29.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:29.628+0000 7fc16da78640 1 --2- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 0x7fc1680c7ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:56:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:30.032+0000 7fc16ca76640 1 -- 172.21.15.96:0/606216981 >> v2:172.21.15.96:3300/0 conn(0x7fc168071680 msgr2=0x7fc1680b0ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.96:3300/0 2024-04-18T04:56:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:30.032+0000 7fc16ca76640 1 --2- 172.21.15.96:0/606216981 >> v2:172.21.15.96:3300/0 conn(0x7fc168071680 0x7fc1680b0ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:56:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:30.032+0000 7fc16da78640 1 --2- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 0x7fc1680c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:30.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:30.032+0000 7fc16da78640 1 -- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 msgr2=0x7fc1680c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T04:56:30.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:30.032+0000 7fc16da78640 1 -- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 msgr2=0x7fc1680c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:30.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:30.032+0000 7fc16da78640 1 --2- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 0x7fc1680c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:30.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:30.032+0000 7fc16da78640 1 --2- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 0x7fc1680c7ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:56:30.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:30.836+0000 7fc16ca76640 1 -- 172.21.15.96:0/606216981 >> v2:172.21.15.96:3300/0 conn(0x7fc168071680 msgr2=0x7fc1680b0ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.96:3300/0 2024-04-18T04:56:30.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:30.836+0000 7fc16ca76640 1 --2- 172.21.15.96:0/606216981 >> v2:172.21.15.96:3300/0 conn(0x7fc168071680 0x7fc1680b0ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:56:30.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:30.836+0000 7fc16da78640 1 --2- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 0x7fc1680c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:30.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:30.836+0000 7fc16da78640 1 -- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 msgr2=0x7fc1680c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T04:56:30.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:30.836+0000 7fc16da78640 1 -- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 msgr2=0x7fc1680c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:30.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:30.836+0000 7fc16da78640 1 --2- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 0x7fc1680c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:30.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:30.836+0000 7fc16da78640 1 --2- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 0x7fc1680c7ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:56:32.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.424+0000 7fc15effd640 1 -- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 msgr2=0x7fc1680c7ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:56:32.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.424+0000 7fc15effd640 1 --2- 172.21.15.96:0/606216981 >> v2:172.21.15.139:3300/0 conn(0x7fc1680710c0 0x7fc1680c7ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:32.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.424+0000 7fc15effd640 1 -- 172.21.15.96:0/606216981 >> v2:172.21.15.96:3300/0 conn(0x7fc168071680 msgr2=0x7fc1680b0ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:56:32.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.424+0000 7fc15effd640 1 --2- 172.21.15.96:0/606216981 >> v2:172.21.15.96:3300/0 conn(0x7fc168071680 0x7fc1680b0ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:32.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.424+0000 7fc15effd640 1 -- 172.21.15.96:0/606216981 >> v1:172.21.15.139:6789/0 conn(0x7fc1680c1280 legacy=0x7fc1680c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:32.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.424+0000 7fc15effd640 1 --2- 172.21.15.96:0/606216981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc14c007390 0x7fc14c009850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:32.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.424+0000 7fc15effd640 1 -- 172.21.15.96:0/606216981 --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc168070c10 con 0x7fc14c0036a0 2024-04-18T04:56:32.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.424+0000 7fc15effd640 1 -- 172.21.15.96:0/606216981 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1680c5d80 con 0x7fc14c007390 2024-04-18T04:56:32.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.424+0000 7fc16d277640 1 -- 172.21.15.96:0/606216981 >> v1:172.21.15.96:6789/0 conn(0x7fc14c0036a0 legacy=0x7fc14c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.96:6789/0 2024-04-18T04:56:32.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.424+0000 7fc16ca76640 1 --2- 172.21.15.96:0/606216981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc14c007390 0x7fc14c009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:32.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.428+0000 7fc16ca76640 1 -- 172.21.15.96:0/606216981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc14c007390 msgr2=0x7fc14c009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:56:32.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.428+0000 7fc16ca76640 1 -- 172.21.15.96:0/606216981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc14c007390 msgr2=0x7fc14c009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:32.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.428+0000 7fc16ca76640 1 --2- 172.21.15.96:0/606216981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc14c007390 0x7fc14c009850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:32.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.428+0000 7fc16ca76640 1 --2- 172.21.15.96:0/606216981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc14c007390 0x7fc14c009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:32.610 INFO:tasks.workunit.client.0.smithi096.stderr:Note: switching to '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'. 2024-04-18T04:56:32.610 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-04-18T04:56:32.610 INFO:tasks.workunit.client.0.smithi096.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-18T04:56:32.610 INFO:tasks.workunit.client.0.smithi096.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-18T04:56:32.610 INFO:tasks.workunit.client.0.smithi096.stderr:state without impacting any branches by switching back to a branch. 2024-04-18T04:56:32.610 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-04-18T04:56:32.610 INFO:tasks.workunit.client.0.smithi096.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-18T04:56:32.610 INFO:tasks.workunit.client.0.smithi096.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-18T04:56:32.611 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-04-18T04:56:32.611 INFO:tasks.workunit.client.0.smithi096.stderr: git switch -c 2024-04-18T04:56:32.611 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-04-18T04:56:32.611 INFO:tasks.workunit.client.0.smithi096.stderr:Or undo this operation with: 2024-04-18T04:56:32.611 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-04-18T04:56:32.611 INFO:tasks.workunit.client.0.smithi096.stderr: git switch - 2024-04-18T04:56:32.611 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-04-18T04:56:32.611 INFO:tasks.workunit.client.0.smithi096.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-18T04:56:32.611 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-04-18T04:56:32.611 INFO:tasks.workunit.client.0.smithi096.stderr:HEAD is now at 646b8c7d293 Merge pull request #56968 from zdover23/wip-doc-2024-04-18-backport-56879-to-reef 2024-04-18T04:56:32.617 DEBUG:teuthology.orchestra.run.smithi096:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-18T04:56:32.624 INFO:tasks.workunit.client.0.smithi096.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-18T04:56:32.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.628+0000 7fc16d277640 1 -- 172.21.15.96:0/606216981 >> v1:172.21.15.96:6789/0 conn(0x7fc14c0036a0 legacy=0x7fc14c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.96:6789/0 2024-04-18T04:56:32.628 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-18T04:56:32.628 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-18T04:56:32.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.632+0000 7fc16ca76640 1 --2- 172.21.15.96:0/606216981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc14c007390 0x7fc14c009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:32.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.632+0000 7fc16ca76640 1 -- 172.21.15.96:0/606216981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc14c007390 msgr2=0x7fc14c009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:56:32.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.632+0000 7fc16ca76640 1 -- 172.21.15.96:0/606216981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc14c007390 msgr2=0x7fc14c009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:56:32.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.632+0000 7fc16ca76640 1 --2- 172.21.15.96:0/606216981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc14c007390 0x7fc14c009850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:32.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:32.632+0000 7fc16ca76640 1 --2- 172.21.15.96:0/606216981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc14c007390 0x7fc14c009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:56:33.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.032+0000 7fc16d277640 1 -- 172.21.15.96:0/606216981 >> v1:172.21.15.96:6789/0 conn(0x7fc14c0036a0 legacy=0x7fc14c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.96:6789/0 2024-04-18T04:56:33.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.036+0000 7fc16ca76640 1 --2- 172.21.15.96:0/606216981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc14c007390 0x7fc14c009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.036+0000 7fc16ca76640 1 -- 172.21.15.96:0/606216981 >> v1:172.21.15.96:6789/0 conn(0x7fc14c0036a0 legacy=0x7fc14c005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:56:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.036+0000 7fc16ca76640 1 -- 172.21.15.96:0/606216981 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c00b020 con 0x7fc14c007390 2024-04-18T04:56:33.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.040+0000 7fc16ca76640 1 --2- 172.21.15.96:0/606216981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc14c007390 0x7fc14c009850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc158009db0 tx=0x7fc15801d060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e400136871f7d1b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:33.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.040+0000 7fc15ffff640 1 -- 172.21.15.96:0/606216981 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1580af400 con 0x7fc14c007390 2024-04-18T04:56:33.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.040+0000 7fc15ffff640 1 -- 172.21.15.96:0/606216981 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1580a9070 con 0x7fc14c007390 2024-04-18T04:56:33.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.040+0000 7fc15ffff640 1 -- 172.21.15.96:0/606216981 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1580af780 con 0x7fc14c007390 2024-04-18T04:56:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.044+0000 7fc16f4db640 1 -- 172.21.15.96:0/606216981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc14c007390 msgr2=0x7fc14c009850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.044+0000 7fc16f4db640 1 --2- 172.21.15.96:0/606216981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc14c007390 0x7fc14c009850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc158009db0 tx=0x7fc15801d060 comp rx=0 tx=0).stop 2024-04-18T04:56:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.044+0000 7fc16da78640 1 -- 172.21.15.96:0/606216981 reap_dead start 2024-04-18T04:56:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.044+0000 7fc16f4db640 1 -- 172.21.15.96:0/606216981 shutdown_connections 2024-04-18T04:56:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.044+0000 7fc16f4db640 1 -- 172.21.15.96:0/606216981 >> 172.21.15.96:0/606216981 conn(0x7fc1680cb2b0 msgr2=0x7fc1680c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.044+0000 7fc16f4db640 1 -- 172.21.15.96:0/606216981 shutdown_connections 2024-04-18T04:56:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.044+0000 7fc16f4db640 1 -- 172.21.15.96:0/606216981 wait complete. 2024-04-18T04:56:33.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.044+0000 7fc16f4db640 1 Processor -- start 2024-04-18T04:56:33.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.044+0000 7fc16f4db640 1 -- start start 2024-04-18T04:56:33.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16f4db640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc168141700 0x7fc168141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16f4db640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc168142020 0x7fc1681483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16f4db640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1681562a0 0x7fc16814faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16f4db640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc168140a20 con 0x7fc168141700 2024-04-18T04:56:33.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16f4db640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16813f270 con 0x7fc1681562a0 2024-04-18T04:56:33.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16f4db640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1681f4060 con 0x7fc168142020 2024-04-18T04:56:33.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16d277640 1 -- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc168141700 msgr2=0x7fc168141ae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:3300/0 2024-04-18T04:56:33.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16d277640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc168141700 0x7fc168141ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:33.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16ca76640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc168142020 0x7fc1681483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:33.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16da78640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1681562a0 0x7fc16814faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:33.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16ca76640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc168142020 0x7fc1681483e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:42184/0 (socket says 172.21.15.96:42184) 2024-04-18T04:56:33.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16ca76640 1 -- 172.21.15.96:0/4207710923 learned_addr learned my addr 172.21.15.96:0/4207710923 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:33.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16ca76640 1 -- 172.21.15.96:0/4207710923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1681562a0 msgr2=0x7fc16814faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16ca76640 1 --2- 172.21.15.96:0/4207710923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1681562a0 0x7fc16814faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16ca76640 1 -- 172.21.15.96:0/4207710923 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc168141700 msgr2=0x7fc168141ae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:56:33.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16ca76640 1 --2- 172.21.15.96:0/4207710923 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc168141700 0x7fc168141ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16ca76640 1 -- 172.21.15.96:0/4207710923 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc158009a90 con 0x7fc168142020 2024-04-18T04:56:33.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16ca76640 1 --2- 172.21.15.96:0/4207710923 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc168142020 0x7fc1681483e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc1580038a0 tx=0x7fc15801b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:33.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc15dffb640 1 -- 172.21.15.96:0/4207710923 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1580be070 con 0x7fc168142020 2024-04-18T04:56:33.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc15dffb640 1 -- 172.21.15.96:0/4207710923 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc158006e90 con 0x7fc168142020 2024-04-18T04:56:33.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc15dffb640 1 -- 172.21.15.96:0/4207710923 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc158009370 con 0x7fc168142020 2024-04-18T04:56:33.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16f4db640 1 -- 172.21.15.96:0/4207710923 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16813ed40 con 0x7fc168142020 2024-04-18T04:56:33.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16f4db640 1 -- 172.21.15.96:0/4207710923 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1681f3bd0 con 0x7fc168142020 2024-04-18T04:56:33.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.048+0000 7fc16f4db640 1 -- 172.21.15.96:0/4207710923 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc168067050 con 0x7fc168142020 2024-04-18T04:56:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.052+0000 7fc15dffb640 1 -- 172.21.15.96:0/4207710923 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc1580b9620 con 0x7fc168142020 2024-04-18T04:56:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.052+0000 7fc15dffb640 1 --2- 172.21.15.96:0/4207710923 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc14c067410 0x7fc14c0698d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.052+0000 7fc15dffb640 1 -- 172.21.15.96:0/4207710923 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc15811f390 con 0x7fc168142020 2024-04-18T04:56:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.052+0000 7fc16d277640 1 --2- 172.21.15.96:0/4207710923 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc14c067410 0x7fc14c0698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.052+0000 7fc16d277640 1 --2- 172.21.15.96:0/4207710923 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc14c067410 0x7fc14c0698d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc1600011e0 tx=0x7fc160007a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.064+0000 7fc15dffb640 1 -- 172.21.15.96:0/4207710923 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc1580ec770 con 0x7fc168142020 2024-04-18T04:56:33.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.292+0000 7fc16f4db640 1 -- 172.21.15.96:0/4207710923 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc168156980 con 0x7fc168142020 2024-04-18T04:56:33.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.292+0000 7fc15dffb640 1 -- 172.21.15.96:0/4207710923 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7fc1580ab620 con 0x7fc168142020 2024-04-18T04:56:33.295 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":18,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:56:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.296+0000 7fc16f4db640 1 -- 172.21.15.96:0/4207710923 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc14c067410 msgr2=0x7fc14c0698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.296+0000 7fc16f4db640 1 --2- 172.21.15.96:0/4207710923 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc14c067410 0x7fc14c0698d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc1600011e0 tx=0x7fc160007a00 comp rx=0 tx=0).stop 2024-04-18T04:56:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.296+0000 7fc16f4db640 1 -- 172.21.15.96:0/4207710923 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc168142020 msgr2=0x7fc1681483e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.296+0000 7fc16f4db640 1 --2- 172.21.15.96:0/4207710923 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc168142020 0x7fc1681483e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc1580038a0 tx=0x7fc15801b8a0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.296+0000 7fc16f4db640 1 -- 172.21.15.96:0/4207710923 shutdown_connections 2024-04-18T04:56:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.296+0000 7fc16f4db640 1 --2- 172.21.15.96:0/4207710923 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc14c067410 0x7fc14c0698d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.296+0000 7fc16f4db640 1 --2- 172.21.15.96:0/4207710923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1681562a0 0x7fc16814faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.296+0000 7fc16f4db640 1 --2- 172.21.15.96:0/4207710923 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc168142020 0x7fc1681483e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.296+0000 7fc16f4db640 1 --2- 172.21.15.96:0/4207710923 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc168141700 0x7fc168141ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.296+0000 7fc16f4db640 1 -- 172.21.15.96:0/4207710923 >> 172.21.15.96:0/4207710923 conn(0x7fc1680cb2b0 msgr2=0x7fc1680c7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.296+0000 7fc16f4db640 1 -- 172.21.15.96:0/4207710923 shutdown_connections 2024-04-18T04:56:33.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.296+0000 7fc16f4db640 1 -- 172.21.15.96:0/4207710923 wait complete. 2024-04-18T04:56:33.314 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-18T04:56:33.314 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-04-18T04:56:33.314 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-18T04:56:33.413 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-18T04:56:33.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.460+0000 7fe8b022f640 1 Processor -- start 2024-04-18T04:56:33.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.460+0000 7fe8b022f640 1 -- start start 2024-04-18T04:56:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.464+0000 7fe8b022f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe8a8153060 0x7fe8a80c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.464+0000 7fe8b022f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe8a8158cd0 0x7fe8a80c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.464+0000 7fe8b022f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a80c9610 con 0x7fe8a8159120 2024-04-18T04:56:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.464+0000 7fe8b022f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a8153440 con 0x7fe8a8158cd0 2024-04-18T04:56:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.464+0000 7fe8b022f640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a81595f0 con 0x7fe8a8153060 2024-04-18T04:56:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.464+0000 7fe8ae7cc640 1 -- >> v1:172.21.15.96:6789/0 conn(0x7fe8a8159120 legacy=0x7fe8a80c4480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.96:6789/0 2024-04-18T04:56:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.464+0000 7fe8ad7ca640 1 -- >> v2:172.21.15.96:3300/0 conn(0x7fe8a8158cd0 msgr2=0x7fe8a80c9d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.96:3300/0 2024-04-18T04:56:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.464+0000 7fe8ad7ca640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe8a8158cd0 0x7fe8a80c9d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.464+0000 7fe8adfcb640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe8a8153060 0x7fe8a80c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.464+0000 7fe8adfcb640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe8a8153060 0x7fe8a80c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:47966/0 (socket says 172.21.15.96:47966) 2024-04-18T04:56:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.464+0000 7fe8adfcb640 1 -- 172.21.15.96:0/1391652537 learned_addr learned my addr 172.21.15.96:0/1391652537 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:33.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.464+0000 7fe8adfcb640 1 -- 172.21.15.96:0/1391652537 >> v2:172.21.15.96:3300/0 conn(0x7fe8a8158cd0 msgr2=0x7fe8a80c9d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:56:33.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.464+0000 7fe8adfcb640 1 --2- 172.21.15.96:0/1391652537 >> v2:172.21.15.96:3300/0 conn(0x7fe8a8158cd0 0x7fe8a80c9d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.464+0000 7fe8adfcb640 1 -- 172.21.15.96:0/1391652537 >> v1:172.21.15.96:6789/0 conn(0x7fe8a8159120 legacy=0x7fe8a80c4480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:56:33.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.464+0000 7fe8adfcb640 1 -- 172.21.15.96:0/1391652537 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a81598d0 con 0x7fe8a8153060 2024-04-18T04:56:33.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8adfcb640 1 --2- 172.21.15.96:0/1391652537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a8153060 0x7fe8a80c90d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80cf7d0 tx=0x7fe8a401ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b48a5c0d7d1c4ac8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:33.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8acfc9640 1 -- 172.21.15.96:0/1391652537 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40a89f0 con 0x7fe8a8153060 2024-04-18T04:56:33.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8acfc9640 1 -- 172.21.15.96:0/1391652537 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a40a8b50 con 0x7fe8a8153060 2024-04-18T04:56:33.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8acfc9640 1 -- 172.21.15.96:0/1391652537 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40b0440 con 0x7fe8a8153060 2024-04-18T04:56:33.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8b022f640 1 -- 172.21.15.96:0/1391652537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a8153060 msgr2=0x7fe8a80c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8b022f640 1 --2- 172.21.15.96:0/1391652537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a8153060 0x7fe8a80c90d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80cf7d0 tx=0x7fe8a401ecf0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8b022f640 1 -- 172.21.15.96:0/1391652537 shutdown_connections 2024-04-18T04:56:33.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8b022f640 1 --2- 172.21.15.96:0/1391652537 >> v2:172.21.15.96:3300/0 conn(0x7fe8a8158cd0 0x7fe8a80c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8b022f640 1 --2- 172.21.15.96:0/1391652537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a8153060 0x7fe8a80c90d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8b022f640 1 -- 172.21.15.96:0/1391652537 >> 172.21.15.96:0/1391652537 conn(0x7fe8a806b470 msgr2=0x7fe8a806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:33.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8b022f640 1 -- 172.21.15.96:0/1391652537 shutdown_connections 2024-04-18T04:56:33.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8b022f640 1 -- 172.21.15.96:0/1391652537 wait complete. 2024-04-18T04:56:33.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8b022f640 1 Processor -- start 2024-04-18T04:56:33.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8b022f640 1 -- start start 2024-04-18T04:56:33.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8b022f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8a8153060 0x7fe8a81f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8b022f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a8158cd0 0x7fe8a8142a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8b022f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe8a8159120 0x7fe8a81505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8b022f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a81ee770 con 0x7fe8a8153060 2024-04-18T04:56:33.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8b022f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a81ef740 con 0x7fe8a8158cd0 2024-04-18T04:56:33.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8b022f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a81e4fb0 con 0x7fe8a8159120 2024-04-18T04:56:33.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8adfcb640 1 -- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8a8153060 msgr2=0x7fe8a81f26f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:3300/0 2024-04-18T04:56:33.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8adfcb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8a8153060 0x7fe8a81f26f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:33.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8ad7ca640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a8158cd0 0x7fe8a8142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:33.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8ae7cc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe8a8159120 0x7fe8a81505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:33.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8ad7ca640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a8158cd0 0x7fe8a8142a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:47972/0 (socket says 172.21.15.96:47972) 2024-04-18T04:56:33.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.468+0000 7fe8ad7ca640 1 -- 172.21.15.96:0/626553827 learned_addr learned my addr 172.21.15.96:0/626553827 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:33.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe8ae7cc640 1 -- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a8158cd0 msgr2=0x7fe8a8142a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe8ae7cc640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a8158cd0 0x7fe8a8142a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe8ae7cc640 1 -- 172.21.15.96:0/626553827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8a8153060 msgr2=0x7fe8a81f26f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:56:33.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe8ae7cc640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8a8153060 0x7fe8a81f26f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe8ae7cc640 1 -- 172.21.15.96:0/626553827 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a40094d0 con 0x7fe8a8159120 2024-04-18T04:56:33.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe8ae7cc640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe8a8159120 0x7fe8a81505f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000bd90 tx=0x7fe8a0009eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:33.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe89e7fc640 1 -- 172.21.15.96:0/626553827 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a00064e0 con 0x7fe8a8159120 2024-04-18T04:56:33.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe89e7fc640 1 -- 172.21.15.96:0/626553827 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a000f070 con 0x7fe8a8159120 2024-04-18T04:56:33.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe8b022f640 1 -- 172.21.15.96:0/626553827 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a81f2c30 con 0x7fe8a8159120 2024-04-18T04:56:33.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe89e7fc640 1 -- 172.21.15.96:0/626553827 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a00068c0 con 0x7fe8a8159120 2024-04-18T04:56:33.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe8b022f640 1 -- 172.21.15.96:0/626553827 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a81ee980 con 0x7fe8a8159120 2024-04-18T04:56:33.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe8b022f640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a80c9870 0x7fe8a80cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe8b022f640 1 -- 172.21.15.96:0/626553827 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a8072290 con 0x7fe8a80c9870 2024-04-18T04:56:33.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe8adfcb640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a80c9870 0x7fe8a80cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:33.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe8adfcb640 1 -- 172.21.15.96:0/626553827 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe8a80c3c80 con 0x7fe8a80c9870 2024-04-18T04:56:33.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe89e7fc640 1 -- 172.21.15.96:0/626553827 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe8a0006a20 con 0x7fe8a8159120 2024-04-18T04:56:33.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe8adfcb640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a80c9870 0x7fe8a80cb6c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80c5a40 tx=0x7fe8a401d530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:33.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe89e7fc640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe88c066640 0x7fe88c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe89e7fc640 1 -- 172.21.15.96:0/626553827 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe8a00848e0 con 0x7fe8a8159120 2024-04-18T04:56:33.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.472+0000 7fe8ad7ca640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe88c066640 0x7fe88c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:33.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.476+0000 7fe89e7fc640 1 -- 172.21.15.96:0/626553827 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40b0440 con 0x7fe8a80c9870 2024-04-18T04:56:33.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.476+0000 7fe8ad7ca640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe88c066640 0x7fe88c068b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe8a81575c0 tx=0x7fe8980091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:33.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.476+0000 7fe89e7fc640 1 -- 172.21.15.96:0/626553827 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fe8a40a87f0 con 0x7fe8a80c9870 2024-04-18T04:56:33.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.476+0000 7fe89e7fc640 1 -- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a80c9870 msgr2=0x7fe8a80cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.476+0000 7fe89e7fc640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a80c9870 0x7fe8a80cb6c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80c5a40 tx=0x7fe8a401d530 comp rx=0 tx=0).stop 2024-04-18T04:56:33.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.476+0000 7fe89e7fc640 1 -- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a80c9870 msgr2=0x7fe8a80cb6c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:56:33.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.476+0000 7fe89e7fc640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a80c9870 0x7fe8a80cb6c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.480+0000 7fe8b022f640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a8142fa0 0x7fe8a80cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.480+0000 7fe8b022f640 1 -- 172.21.15.96:0/626553827 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a80c39a0 con 0x7fe8a8142fa0 2024-04-18T04:56:33.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.480+0000 7fe8adfcb640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a8142fa0 0x7fe8a80cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:33.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.480+0000 7fe8adfcb640 1 -- 172.21.15.96:0/626553827 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe8a80c3f60 con 0x7fe8a8142fa0 2024-04-18T04:56:33.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe8adfcb640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a8142fa0 0x7fe8a80cbc00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe8a401d3a0 tx=0x7fe8a401ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:33.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe89e7fc640 1 -- 172.21.15.96:0/626553827 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40c4810 con 0x7fe8a8142fa0 2024-04-18T04:56:33.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe89e7fc640 1 -- 172.21.15.96:0/626553827 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4966 (secure 0 0 0) 0x7fe8a40c8070 con 0x7fe8a8142fa0 2024-04-18T04:56:33.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe89e7fc640 1 -- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a8142fa0 msgr2=0x7fe8a80cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe89e7fc640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a8142fa0 0x7fe8a80cbc00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe8a401d3a0 tx=0x7fe8a401ba90 comp rx=0 tx=0).stop 2024-04-18T04:56:33.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe89e7fc640 1 -- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a8142fa0 msgr2=0x7fe8a80cbc00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:56:33.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe89e7fc640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8a8142fa0 0x7fe8a80cbc00 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe8a401d3a0 tx=0x7fe8a401ba90 comp rx=0 tx=0).stop 2024-04-18T04:56:33.485 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:56:33.485 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:56:33.485 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:56:33.485 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T04:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 18, 2024-04-18T04:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 0, 2024-04-18T04:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5 2024-04-18T04:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:56:33.500 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:56:33.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe8b022f640 1 -- 172.21.15.96:0/626553827 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe88c066640 msgr2=0x7fe88c068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe8b022f640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe88c066640 0x7fe88c068b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe8a81575c0 tx=0x7fe8980091c0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe8b022f640 1 -- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe8a8159120 msgr2=0x7fe8a81505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe8b022f640 1 --2- 172.21.15.96:0/626553827 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe8a8159120 0x7fe8a81505f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000bd90 tx=0x7fe8a0009eb0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe8ae7cc640 1 -- 172.21.15.96:0/626553827 reap_dead start 2024-04-18T04:56:33.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe8ae7cc640 1 -- 172.21.15.96:0/626553827 reap_dead start 2024-04-18T04:56:33.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe8b022f640 1 -- 172.21.15.96:0/626553827 shutdown_connections 2024-04-18T04:56:33.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe8b022f640 1 -- 172.21.15.96:0/626553827 >> 172.21.15.96:0/626553827 conn(0x7fe8a806b470 msgr2=0x7fe8a8156840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:33.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe8b022f640 1 -- 172.21.15.96:0/626553827 shutdown_connections 2024-04-18T04:56:33.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.484+0000 7fe8b022f640 1 -- 172.21.15.96:0/626553827 wait complete. 2024-04-18T04:56:33.502 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-18T04:56:33.502 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-18T04:56:33.503 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-18T04:56:33.503 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-18T04:56:33.531 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-18T04:56:33.532 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-18T04:56:33.532 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-18T04:56:33.572 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-18T04:56:33.575 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T04:56:33.575 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-18T04:56:33.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.612+0000 7f087322f640 1 Processor -- start 2024-04-18T04:56:33.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.612+0000 7f087322f640 1 -- start start 2024-04-18T04:56:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.616+0000 7f087322f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f086c153060 0x7f086c0c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.616+0000 7f087322f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f086c159120 0x7f086c0c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.616+0000 7f087322f640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c0c9610 con 0x7f086c158cd0 2024-04-18T04:56:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.616+0000 7f087322f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c153440 con 0x7f086c153060 2024-04-18T04:56:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.616+0000 7f087322f640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c1595f0 con 0x7f086c159120 2024-04-18T04:56:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.616+0000 7f0870fcb640 1 -- >> v2:172.21.15.96:3300/0 conn(0x7f086c153060 msgr2=0x7f086c0c90d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.96:3300/0 2024-04-18T04:56:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.616+0000 7f0870fcb640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f086c153060 0x7f086c0c90d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:33.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.616+0000 7f08717cc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f086c159120 0x7f086c0c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:33.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.616+0000 7f08717cc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f086c159120 0x7f086c0c4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:48014/0 (socket says 172.21.15.96:48014) 2024-04-18T04:56:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.616+0000 7f08717cc640 1 -- 172.21.15.96:0/903876347 learned_addr learned my addr 172.21.15.96:0/903876347 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.616+0000 7f08717cc640 1 -- 172.21.15.96:0/903876347 >> v2:172.21.15.96:3300/0 conn(0x7f086c153060 msgr2=0x7f086c0c90d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:56:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.616+0000 7f08717cc640 1 --2- 172.21.15.96:0/903876347 >> v2:172.21.15.96:3300/0 conn(0x7f086c153060 0x7f086c0c90d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.616+0000 7f08717cc640 1 -- 172.21.15.96:0/903876347 >> v1:172.21.15.139:6789/0 conn(0x7f086c158cd0 legacy=0x7f086c0c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.616+0000 7f08717cc640 1 -- 172.21.15.96:0/903876347 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c1598d0 con 0x7f086c159120 2024-04-18T04:56:33.621 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-18T04:56:33.622 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-18T04:56:33.622 DEBUG:teuthology.orchestra.run.smithi096:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=646b8c7d293d8ec31a40c69f7b3237b19c1be24d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-18T04:56:33.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f08717cc640 1 --2- 172.21.15.96:0/903876347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f086c159120 0x7f086c0c4480 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f086c0c5a40 tx=0x7f086401f200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85bb151a63e2bc3b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:33.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f086b7fe640 1 -- 172.21.15.96:0/903876347 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640af400 con 0x7f086c159120 2024-04-18T04:56:33.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f086b7fe640 1 -- 172.21.15.96:0/903876347 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08640ab050 con 0x7f086c159120 2024-04-18T04:56:33.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f086b7fe640 1 -- 172.21.15.96:0/903876347 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640af780 con 0x7f086c159120 2024-04-18T04:56:33.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f087322f640 1 -- 172.21.15.96:0/903876347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f086c159120 msgr2=0x7f086c0c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f087322f640 1 --2- 172.21.15.96:0/903876347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f086c159120 0x7f086c0c4480 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f086c0c5a40 tx=0x7f086401f200 comp rx=0 tx=0).stop 2024-04-18T04:56:33.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f087322f640 1 -- 172.21.15.96:0/903876347 shutdown_connections 2024-04-18T04:56:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f087322f640 1 --2- 172.21.15.96:0/903876347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f086c159120 0x7f086c0c4480 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f087322f640 1 --2- 172.21.15.96:0/903876347 >> v2:172.21.15.96:3300/0 conn(0x7f086c153060 0x7f086c0c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f087322f640 1 -- 172.21.15.96:0/903876347 >> 172.21.15.96:0/903876347 conn(0x7f086c06b470 msgr2=0x7f086c06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f087322f640 1 -- 172.21.15.96:0/903876347 shutdown_connections 2024-04-18T04:56:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f087322f640 1 -- 172.21.15.96:0/903876347 wait complete. 2024-04-18T04:56:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f087322f640 1 Processor -- start 2024-04-18T04:56:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f087322f640 1 -- start start 2024-04-18T04:56:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f087322f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f086c153060 0x7f086c151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f087322f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c158cd0 0x7f086c1e2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f087322f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f086c159120 0x7f086c1e32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f087322f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0ca9e0 con 0x7f086c153060 2024-04-18T04:56:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f087322f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c151680 con 0x7f086c159120 2024-04-18T04:56:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f087322f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c151960 con 0x7f086c158cd0 2024-04-18T04:56:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f0870fcb640 1 -- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f086c153060 msgr2=0x7f086c151c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:3300/0 2024-04-18T04:56:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f0870fcb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f086c153060 0x7f086c151c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f08717cc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f086c159120 0x7f086c1e32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f086bfff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c158cd0 0x7f086c1e2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f08717cc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f086c159120 0x7f086c1e32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:48030/0 (socket says 172.21.15.96:48030) 2024-04-18T04:56:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f08717cc640 1 -- 172.21.15.96:0/1811083425 learned_addr learned my addr 172.21.15.96:0/1811083425 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f08717cc640 1 -- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c158cd0 msgr2=0x7f086c1e2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f08717cc640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c158cd0 0x7f086c1e2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f08717cc640 1 -- 172.21.15.96:0/1811083425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f086c153060 msgr2=0x7f086c151c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:56:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.620+0000 7f08717cc640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f086c153060 0x7f086c151c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f08717cc640 1 -- 172.21.15.96:0/1811083425 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0864009b30 con 0x7f086c159120 2024-04-18T04:56:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f08717cc640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f086c159120 0x7f086c1e32c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f086401ce30 tx=0x7f086401bfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f08697fa640 1 -- 172.21.15.96:0/1811083425 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640afe20 con 0x7f086c159120 2024-04-18T04:56:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f08697fa640 1 -- 172.21.15.96:0/1811083425 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08640b9410 con 0x7f086c159120 2024-04-18T04:56:33.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f087322f640 1 -- 172.21.15.96:0/1811083425 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c1e22a0 con 0x7f086c159120 2024-04-18T04:56:33.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f08697fa640 1 -- 172.21.15.96:0/1811083425 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640b97c0 con 0x7f086c159120 2024-04-18T04:56:33.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f087322f640 1 -- 172.21.15.96:0/1811083425 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c1e2860 con 0x7f086c159120 2024-04-18T04:56:33.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f087322f640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c1458c0 0x7f086c0c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f087322f640 1 -- 172.21.15.96:0/1811083425 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c072290 con 0x7f086c1458c0 2024-04-18T04:56:33.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f0870fcb640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c1458c0 0x7f086c0c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f0870fcb640 1 -- 172.21.15.96:0/1811083425 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f086c0c3c80 con 0x7f086c1458c0 2024-04-18T04:56:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f0870fcb640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c1458c0 0x7f086c0c9870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f085c00b450 tx=0x7f085c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f08697fa640 1 -- 172.21.15.96:0/1811083425 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f08640b6050 con 0x7f086c159120 2024-04-18T04:56:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f08697fa640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0858066670 0x7f0858068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f08697fa640 1 -- 172.21.15.96:0/1811083425 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0864121db0 con 0x7f086c159120 2024-04-18T04:56:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f086bfff640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0858066670 0x7f0858068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f08697fa640 1 -- 172.21.15.96:0/1811083425 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c003e20 con 0x7f086c1458c0 2024-04-18T04:56:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f08697fa640 1 -- 172.21.15.96:0/1811083425 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f085c005070 con 0x7f086c1458c0 2024-04-18T04:56:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f08697fa640 1 -- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c1458c0 msgr2=0x7f086c0c9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f08697fa640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c1458c0 0x7f086c0c9870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f085c00b450 tx=0x7f085c00b910 comp rx=0 tx=0).stop 2024-04-18T04:56:33.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f08697fa640 1 -- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c1458c0 msgr2=0x7f086c0c9870 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:56:33.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.624+0000 7f08697fa640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c1458c0 0x7f086c0c9870 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f085c00b450 tx=0x7f085c00b910 comp rx=0 tx=0).stop 2024-04-18T04:56:33.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.628+0000 7f086bfff640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0858066670 0x7f0858068b30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f086c0cdff0 tx=0x7f0860009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:33.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.632+0000 7f087322f640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c1e4d00 0x7f086c0c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:33.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.632+0000 7f087322f640 1 -- 172.21.15.96:0/1811083425 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0c39a0 con 0x7f086c1e4d00 2024-04-18T04:56:33.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.632+0000 7f0870fcb640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c1e4d00 0x7f086c0c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:33.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.632+0000 7f0870fcb640 1 -- 172.21.15.96:0/1811083425 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f086c0c3f60 con 0x7f086c1e4d00 2024-04-18T04:56:33.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.632+0000 7f0870fcb640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c1e4d00 0x7f086c0c9db0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f085c00b450 tx=0x7f085c005a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:33.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.636+0000 7f08697fa640 1 -- 172.21.15.96:0/1811083425 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c020070 con 0x7f086c1e4d00 2024-04-18T04:56:33.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.636+0000 7f08697fa640 1 -- 172.21.15.96:0/1811083425 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4964 (secure 0 0 0) 0x7f085c01bc60 con 0x7f086c1e4d00 2024-04-18T04:56:33.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.636+0000 7f08697fa640 1 -- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c1e4d00 msgr2=0x7f086c0c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.636+0000 7f08697fa640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c1e4d00 0x7f086c0c9db0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f085c00b450 tx=0x7f085c005a30 comp rx=0 tx=0).stop 2024-04-18T04:56:33.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.636+0000 7f08697fa640 1 -- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c1e4d00 msgr2=0x7f086c0c9db0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:56:33.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.636+0000 7f08697fa640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f086c1e4d00 0x7f086c0c9db0 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f085c00b450 tx=0x7f085c005a30 comp rx=0 tx=0).stop 2024-04-18T04:56:33.637 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:56:33.637 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:56:33.637 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:56:33.637 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:56:33.637 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 18, 2024-04-18T04:56:33.637 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:56:33.638 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:56:33.638 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:56:33.638 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:33.638 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 0, 2024-04-18T04:56:33.638 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:56:33.638 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:56:33.638 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:56:33.638 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:33.638 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:33.638 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:33.639 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:33.639 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:33.639 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:33.639 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:33.639 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:33.639 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:33.639 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:33.639 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:33.639 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:56:33.639 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:56:33.639 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:33.639 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:33.639 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:33.639 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:33.639 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:33.640 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:33.640 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:33.640 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:33.640 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:33.640 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:33.640 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:33.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.640 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:56:33.640 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:56:33.640 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:56:33.640 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:56:33.640 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:56:33.640 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:56:33.641 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:56:33.641 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:56:33.641 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:56:33.641 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:56:33.641 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:56:33.641 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:56:33.641 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:56:33.641 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:56:33.641 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:56:33.641 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:56:33.641 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:56:33.641 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:56:33.641 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:56:33.641 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:56:33.641 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:56:33.642 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:56:33.642 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:56:33.642 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:56:33.642 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:56:33.642 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:56:33.642 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:56:33.642 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:33.642 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:56:33.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.642 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:56:33.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.642 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:56:33.642 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:56:33.643 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:33.643 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:33.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.643 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:33.643 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:56:33.643 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:33.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.643 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:33.643 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:56:33.643 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:33.643 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.643 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:33.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.643 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:56:33.644 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:56:33.644 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:33.644 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:33.644 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:33.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.644 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:56:33.644 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:56:33.644 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:33.644 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:33.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.644 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:33.644 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:56:33.644 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:33.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.645 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.645 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:33.645 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:56:33.645 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:33.645 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.645 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:33.645 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.645 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:56:33.645 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:56:33.645 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:33.645 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:33.646 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:33.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.646 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:56:33.646 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:56:33.646 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:56:33.646 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:56:33.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.646 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:56:33.646 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:56:33.646 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:33.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.646 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:56:33.647 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:56:33.647 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:56:33.647 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.647 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:33.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.647 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:56:33.647 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:56:33.647 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:56:33.647 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:56:33.647 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:56:33.647 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.647 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:33.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.647 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:56:33.647 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:56:33.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.648 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:33.648 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:33.648 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:56:33.648 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.648 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:33.648 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:56:33.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.648 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:33.648 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:33.648 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:56:33.648 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.648 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:33.648 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:56:33.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.649 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:33.649 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:33.649 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:56:33.649 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.649 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:33.649 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:56:33.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.649 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:33.649 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:33.649 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:56:33.649 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.649 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:56:33.649 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:56:33.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:56:33.650 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:56:33.650 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:56:33.650 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:56:33.650 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:56:33.650 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:56:33.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:56:33.650 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:56:33.650 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:56:33.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.636+0000 7f087322f640 1 -- 172.21.15.96:0/1811083425 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0858066670 msgr2=0x7f0858068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.636+0000 7f087322f640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0858066670 0x7f0858068b30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f086c0cdff0 tx=0x7f0860009040 comp rx=0 tx=0).stop 2024-04-18T04:56:33.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.636+0000 7f087322f640 1 -- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f086c159120 msgr2=0x7f086c1e32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:33.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.636+0000 7f087322f640 1 --2- 172.21.15.96:0/1811083425 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f086c159120 0x7f086c1e32c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f086401ce30 tx=0x7f086401bfa0 comp rx=0 tx=0).stop 2024-04-18T04:56:33.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.636+0000 7f08717cc640 1 -- 172.21.15.96:0/1811083425 reap_dead start 2024-04-18T04:56:33.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.636+0000 7f08717cc640 1 -- 172.21.15.96:0/1811083425 reap_dead start 2024-04-18T04:56:33.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.636+0000 7f087322f640 1 -- 172.21.15.96:0/1811083425 shutdown_connections 2024-04-18T04:56:33.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.636+0000 7f087322f640 1 -- 172.21.15.96:0/1811083425 >> 172.21.15.96:0/1811083425 conn(0x7f086c06b470 msgr2=0x7f086c157e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:33.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.636+0000 7f087322f640 1 -- 172.21.15.96:0/1811083425 shutdown_connections 2024-04-18T04:56:33.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:33.636+0000 7f087322f640 1 -- 172.21.15.96:0/1811083425 wait complete. 2024-04-18T04:56:33.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ mkdir -p fsstress 2024-04-18T04:56:33.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ pushd fsstress 2024-04-18T04:56:33.652 INFO:tasks.workunit.client.0.smithi096.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-18T04:56:33.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-18T04:56:33.654 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-18T04:56:33.654 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-18T04:56:34.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ tar xzf ltp-full.tgz 2024-04-18T04:56:47.684 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:56:47.686 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:56:53.654 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-18T04:56:53.655 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-04-18T04:56:53.655 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-18T04:56:53.655 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-18T04:56:53.658 INFO:tasks.ceph.mon.a:Started 2024-04-18T04:56:53.658 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-18T04:56:53.658 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:56:53.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.799+0000 7ff82af4d640 1 Processor -- start 2024-04-18T04:56:53.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.799+0000 7ff82af4d640 1 -- start start 2024-04-18T04:56:53.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff82af4d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff82406a0c0 0x7ff8241599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:53.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff82af4d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff824152a70 0x7ff824152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:53.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff82af4d640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82406f960 con 0x7ff82406a4a0 2024-04-18T04:56:53.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff82af4d640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82406f750 con 0x7ff82406a0c0 2024-04-18T04:56:53.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff82af4d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff824153460 con 0x7ff824152a70 2024-04-18T04:56:53.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff8294ea640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff824152a70 0x7ff824152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:53.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff828ce9640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff82406a0c0 0x7ff8241599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:53.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff8294ea640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff824152a70 0x7ff824152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:56264/0 (socket says 172.21.15.96:56264) 2024-04-18T04:56:53.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff8294ea640 1 -- 172.21.15.96:0/3144970300 learned_addr learned my addr 172.21.15.96:0/3144970300 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:53.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff8294ea640 1 -- 172.21.15.96:0/3144970300 >> v2:172.21.15.139:3300/0 conn(0x7ff82406a0c0 msgr2=0x7ff8241599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:53.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff8294ea640 1 --2- 172.21.15.96:0/3144970300 >> v2:172.21.15.139:3300/0 conn(0x7ff82406a0c0 0x7ff8241599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:53.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff8294ea640 1 -- 172.21.15.96:0/3144970300 >> v1:172.21.15.139:6789/0 conn(0x7ff82406a4a0 legacy=0x7ff82406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:53.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff8294ea640 1 -- 172.21.15.96:0/3144970300 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8240c9ee0 con 0x7ff824152a70 2024-04-18T04:56:53.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff8294ea640 1 --2- 172.21.15.96:0/3144970300 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff824152a70 0x7ff824152f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff81c009e80 tx=0x7ff81c01ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=373c93d5f729f9d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:53.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff8237fe640 1 -- 172.21.15.96:0/3144970300 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c0a57f0 con 0x7ff824152a70 2024-04-18T04:56:53.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff8237fe640 1 -- 172.21.15.96:0/3144970300 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c0a5950 con 0x7ff824152a70 2024-04-18T04:56:53.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.803+0000 7ff8237fe640 1 -- 172.21.15.96:0/3144970300 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c0a5ce0 con 0x7ff824152a70 2024-04-18T04:56:53.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff82af4d640 1 -- 172.21.15.96:0/3144970300 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff824152a70 msgr2=0x7ff824152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:53.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff82af4d640 1 --2- 172.21.15.96:0/3144970300 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff824152a70 0x7ff824152f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff81c009e80 tx=0x7ff81c01ca10 comp rx=0 tx=0).stop 2024-04-18T04:56:53.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff82af4d640 1 -- 172.21.15.96:0/3144970300 shutdown_connections 2024-04-18T04:56:53.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff82af4d640 1 --2- 172.21.15.96:0/3144970300 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff824152a70 0x7ff824152f20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:53.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff82af4d640 1 --2- 172.21.15.96:0/3144970300 >> v2:172.21.15.139:3300/0 conn(0x7ff82406a0c0 0x7ff8241599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:53.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff82af4d640 1 -- 172.21.15.96:0/3144970300 >> 172.21.15.96:0/3144970300 conn(0x7ff82406af70 msgr2=0x7ff82406b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:53.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff82af4d640 1 -- 172.21.15.96:0/3144970300 shutdown_connections 2024-04-18T04:56:53.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff82af4d640 1 -- 172.21.15.96:0/3144970300 wait complete. 2024-04-18T04:56:53.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff82af4d640 1 Processor -- start 2024-04-18T04:56:53.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff82af4d640 1 -- start start 2024-04-18T04:56:53.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff82af4d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff82406a0c0 0x7ff8240c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:53.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff82af4d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff82406a4a0 0x7ff82414a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:53.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff82af4d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff824152a70 0x7ff82415a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff82af4d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8240c52c0 con 0x7ff82406a4a0 2024-04-18T04:56:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff82af4d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82414ef10 con 0x7ff824152a70 2024-04-18T04:56:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff82af4d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8241f1e10 con 0x7ff82406a0c0 2024-04-18T04:56:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff823fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff82406a4a0 0x7ff82414a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff823fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff82406a4a0 0x7ff82414a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42608/0 (socket says 172.21.15.96:42608) 2024-04-18T04:56:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff823fff640 1 -- 172.21.15.96:0/2773858200 learned_addr learned my addr 172.21.15.96:0/2773858200 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:56:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff823fff640 1 -- 172.21.15.96:0/2773858200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff82406a4a0 msgr2=0x7ff82414a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-18T04:56:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff823fff640 1 -- 172.21.15.96:0/2773858200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff82406a4a0 msgr2=0x7ff82414a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T04:56:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff823fff640 1 --2- 172.21.15.96:0/2773858200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff82406a4a0 0x7ff82414a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:56:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff8294ea640 1 --2- 172.21.15.96:0/2773858200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff824152a70 0x7ff82415a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff828ce9640 1 --2- 172.21.15.96:0/2773858200 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff82406a0c0 0x7ff8240c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff823fff640 1 --2- 172.21.15.96:0/2773858200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff82406a4a0 0x7ff82414a5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:56:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff8294ea640 1 -- 172.21.15.96:0/2773858200 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff82406a0c0 msgr2=0x7ff8240c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff8294ea640 1 --2- 172.21.15.96:0/2773858200 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff82406a0c0 0x7ff8240c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:53.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff8294ea640 1 -- 172.21.15.96:0/2773858200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff82406a4a0 msgr2=0x7ff82414a5e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:56:53.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff8294ea640 1 --2- 172.21.15.96:0/2773858200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff82406a4a0 0x7ff82414a5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:53.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.807+0000 7ff8294ea640 1 -- 172.21.15.96:0/2773858200 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81c009b30 con 0x7ff824152a70 2024-04-18T04:56:53.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.811+0000 7ff8294ea640 1 --2- 172.21.15.96:0/2773858200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff824152a70 0x7ff82415a3c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0ab000 tx=0x7ff81c0197b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:53.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.811+0000 7ff8217fa640 1 -- 172.21.15.96:0/2773858200 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c0bd070 con 0x7ff824152a70 2024-04-18T04:56:53.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.811+0000 7ff82af4d640 1 -- 172.21.15.96:0/2773858200 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8241f20f0 con 0x7ff824152a70 2024-04-18T04:56:53.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.811+0000 7ff8217fa640 1 -- 172.21.15.96:0/2773858200 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c0b8470 con 0x7ff824152a70 2024-04-18T04:56:53.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.811+0000 7ff8217fa640 1 -- 172.21.15.96:0/2773858200 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c0b8840 con 0x7ff824152a70 2024-04-18T04:56:53.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.811+0000 7ff82af4d640 1 -- 172.21.15.96:0/2773858200 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8241f26b0 con 0x7ff824152a70 2024-04-18T04:56:53.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.811+0000 7ff82af4d640 1 -- 172.21.15.96:0/2773858200 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82415a0e0 con 0x7ff824152a70 2024-04-18T04:56:53.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.811+0000 7ff8217fa640 1 -- 172.21.15.96:0/2773858200 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff81c0b89a0 con 0x7ff824152a70 2024-04-18T04:56:53.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.811+0000 7ff8217fa640 1 --2- 172.21.15.96:0/2773858200 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff808066690 0x7ff808068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:53.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.811+0000 7ff8217fa640 1 -- 172.21.15.96:0/2773858200 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff81c11f370 con 0x7ff824152a70 2024-04-18T04:56:53.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.815+0000 7ff828ce9640 1 --2- 172.21.15.96:0/2773858200 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff808066690 0x7ff808068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:53.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.815+0000 7ff828ce9640 1 --2- 172.21.15.96:0/2773858200 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff808066690 0x7ff808068b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff818009ac0 tx=0x7ff818009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:53.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:53.827+0000 7ff8217fa640 1 -- 172.21.15.96:0/2773858200 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff81c0ec630 con 0x7ff824152a70 2024-04-18T04:56:54.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:54.079+0000 7ff82af4d640 1 -- 172.21.15.96:0/2773858200 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff82415a0e0 con 0x7ff824152a70 2024-04-18T04:56:59.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:58.999+0000 7ff8217fa640 1 -- 172.21.15.96:0/2773858200 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7ff82415a0e0 con 0x7ff824152a70 2024-04-18T04:56:59.001 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":22,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:56:59.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:59.003+0000 7ff82af4d640 1 -- 172.21.15.96:0/2773858200 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff808066690 msgr2=0x7ff808068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:59.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:59.003+0000 7ff82af4d640 1 --2- 172.21.15.96:0/2773858200 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff808066690 0x7ff808068b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff818009ac0 tx=0x7ff818009190 comp rx=0 tx=0).stop 2024-04-18T04:56:59.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:59.003+0000 7ff82af4d640 1 -- 172.21.15.96:0/2773858200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff824152a70 msgr2=0x7ff82415a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:59.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:59.003+0000 7ff82af4d640 1 --2- 172.21.15.96:0/2773858200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff824152a70 0x7ff82415a3c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0ab000 tx=0x7ff81c0197b0 comp rx=0 tx=0).stop 2024-04-18T04:56:59.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:59.003+0000 7ff82af4d640 1 -- 172.21.15.96:0/2773858200 shutdown_connections 2024-04-18T04:56:59.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:59.003+0000 7ff82af4d640 1 --2- 172.21.15.96:0/2773858200 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff808066690 0x7ff808068b50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:59.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:59.003+0000 7ff82af4d640 1 --2- 172.21.15.96:0/2773858200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff824152a70 0x7ff82415a3c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:59.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:59.003+0000 7ff82af4d640 1 --2- 172.21.15.96:0/2773858200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff82406a4a0 0x7ff82414a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:59.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:59.003+0000 7ff82af4d640 1 --2- 172.21.15.96:0/2773858200 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff82406a0c0 0x7ff8240c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:59.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:59.003+0000 7ff82af4d640 1 -- 172.21.15.96:0/2773858200 >> 172.21.15.96:0/2773858200 conn(0x7ff82406af70 msgr2=0x7ff8240c9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:59.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:59.003+0000 7ff82af4d640 1 -- 172.21.15.96:0/2773858200 shutdown_connections 2024-04-18T04:56:59.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:56:59.003+0000 7ff82af4d640 1 -- 172.21.15.96:0/2773858200 wait complete. 2024-04-18T04:57:02.032 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:57:02.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.167+0000 7f2a59950640 1 Processor -- start 2024-04-18T04:57:02.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.167+0000 7f2a59950640 1 -- start start 2024-04-18T04:57:02.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.167+0000 7f2a59950640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2a541530f0 0x7f2a54070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.167+0000 7f2a59950640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2a541590f0 0x7f2a54159540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.167+0000 7f2a59950640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a54159a80 con 0x7f2a54071cd0 2024-04-18T04:57:02.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.167+0000 7f2a59950640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a540c9e50 con 0x7f2a541530f0 2024-04-18T04:57:02.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.167+0000 7f2a59950640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540ca130 con 0x7f2a541590f0 2024-04-18T04:57:02.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.167+0000 7f2a52ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2a541530f0 0x7f2a54070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.167+0000 7f2a52ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2a541530f0 0x7f2a54070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49488/0 (socket says 172.21.15.96:49488) 2024-04-18T04:57:02.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.167+0000 7f2a52ffd640 1 -- 172.21.15.96:0/2582790045 learned_addr learned my addr 172.21.15.96:0/2582790045 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:02.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.167+0000 7f2a52ffd640 1 -- 172.21.15.96:0/2582790045 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2a541590f0 msgr2=0x7f2a54159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:02.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.167+0000 7f2a52ffd640 1 --2- 172.21.15.96:0/2582790045 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2a541590f0 0x7f2a54159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.167+0000 7f2a52ffd640 1 -- 172.21.15.96:0/2582790045 >> v1:172.21.15.139:6789/0 conn(0x7f2a54071cd0 legacy=0x7f2a5406f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:02.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.167+0000 7f2a52ffd640 1 -- 172.21.15.96:0/2582790045 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a540ca410 con 0x7f2a541530f0 2024-04-18T04:57:02.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.171+0000 7f2a52ffd640 1 --2- 172.21.15.96:0/2582790045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a541530f0 0x7f2a54070f70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2a540c9040 tx=0x7f2a4401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b790a0641205257 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.171+0000 7f2a51ffb640 1 -- 172.21.15.96:0/2582790045 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440ab600 con 0x7f2a541530f0 2024-04-18T04:57:02.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.171+0000 7f2a51ffb640 1 -- 172.21.15.96:0/2582790045 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a440ab760 con 0x7f2a541530f0 2024-04-18T04:57:02.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.171+0000 7f2a51ffb640 1 -- 172.21.15.96:0/2582790045 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440abaf0 con 0x7f2a541530f0 2024-04-18T04:57:02.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.171+0000 7f2a59950640 1 -- 172.21.15.96:0/2582790045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a541530f0 msgr2=0x7f2a54070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.171+0000 7f2a59950640 1 --2- 172.21.15.96:0/2582790045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a541530f0 0x7f2a54070f70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2a540c9040 tx=0x7f2a4401c440 comp rx=0 tx=0).stop 2024-04-18T04:57:02.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.171+0000 7f2a59950640 1 -- 172.21.15.96:0/2582790045 shutdown_connections 2024-04-18T04:57:02.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.171+0000 7f2a59950640 1 --2- 172.21.15.96:0/2582790045 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2a541590f0 0x7f2a54159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.171+0000 7f2a59950640 1 --2- 172.21.15.96:0/2582790045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a541530f0 0x7f2a54070f70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.171+0000 7f2a59950640 1 -- 172.21.15.96:0/2582790045 >> 172.21.15.96:0/2582790045 conn(0x7f2a5406af70 msgr2=0x7f2a5406b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:02.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.171+0000 7f2a59950640 1 -- 172.21.15.96:0/2582790045 shutdown_connections 2024-04-18T04:57:02.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.171+0000 7f2a59950640 1 -- 172.21.15.96:0/2582790045 wait complete. 2024-04-18T04:57:02.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a59950640 1 Processor -- start 2024-04-18T04:57:02.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a59950640 1 -- start start 2024-04-18T04:57:02.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a59950640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2a54071cd0 0x7f2a5414b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a59950640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a541530f0 0x7f2a54151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a59950640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a541590f0 0x7f2a5414c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a59950640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a54155290 con 0x7f2a541590f0 2024-04-18T04:57:02.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a59950640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a54153a10 con 0x7f2a541530f0 2024-04-18T04:57:02.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a59950640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a54151ea0 con 0x7f2a54071cd0 2024-04-18T04:57:02.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a537fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a541590f0 0x7f2a5414c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a537fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a541590f0 0x7f2a5414c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49498/0 (socket says 172.21.15.96:49498) 2024-04-18T04:57:02.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a537fe640 1 -- 172.21.15.96:0/3394564856 learned_addr learned my addr 172.21.15.96:0/3394564856 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:02.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a52ffd640 1 --2- 172.21.15.96:0/3394564856 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2a54071cd0 0x7f2a5414b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a527fc640 1 --2- 172.21.15.96:0/3394564856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a541530f0 0x7f2a54151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a537fe640 1 -- 172.21.15.96:0/3394564856 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2a54071cd0 msgr2=0x7f2a5414b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a537fe640 1 --2- 172.21.15.96:0/3394564856 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2a54071cd0 0x7f2a5414b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a537fe640 1 -- 172.21.15.96:0/3394564856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a541530f0 msgr2=0x7f2a54151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a537fe640 1 --2- 172.21.15.96:0/3394564856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a541530f0 0x7f2a54151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a537fe640 1 -- 172.21.15.96:0/3394564856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440094d0 con 0x7f2a541590f0 2024-04-18T04:57:02.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a537fe640 1 --2- 172.21.15.96:0/3394564856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a541590f0 0x7f2a5414c7f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00b970 tx=0x7f2a4c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a3bfff640 1 -- 172.21.15.96:0/3394564856 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00cb40 con 0x7f2a541590f0 2024-04-18T04:57:02.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a3bfff640 1 -- 172.21.15.96:0/3394564856 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c00ccc0 con 0x7f2a541590f0 2024-04-18T04:57:02.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a59950640 1 -- 172.21.15.96:0/3394564856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a54153cb0 con 0x7f2a541590f0 2024-04-18T04:57:02.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a3bfff640 1 -- 172.21.15.96:0/3394564856 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c014680 con 0x7f2a541590f0 2024-04-18T04:57:02.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a59950640 1 -- 172.21.15.96:0/3394564856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5414a230 con 0x7f2a541590f0 2024-04-18T04:57:02.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.175+0000 7f2a59950640 1 -- 172.21.15.96:0/3394564856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a54067050 con 0x7f2a541590f0 2024-04-18T04:57:02.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.179+0000 7f2a3bfff640 1 -- 172.21.15.96:0/3394564856 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2a4c01d3b0 con 0x7f2a541590f0 2024-04-18T04:57:02.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.179+0000 7f2a3bfff640 1 --2- 172.21.15.96:0/3394564856 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2a400666c0 0x7f2a40068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.179+0000 7f2a3bfff640 1 -- 172.21.15.96:0/3394564856 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2a4c084010 con 0x7f2a541590f0 2024-04-18T04:57:02.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.179+0000 7f2a52ffd640 1 --2- 172.21.15.96:0/3394564856 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2a400666c0 0x7f2a40068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.179+0000 7f2a52ffd640 1 --2- 172.21.15.96:0/3394564856 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2a400666c0 0x7f2a40068b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2a440af000 tx=0x7f2a440a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.183+0000 7f2a3bfff640 1 -- 172.21.15.96:0/3394564856 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2a4c054e80 con 0x7f2a541590f0 2024-04-18T04:57:02.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.447+0000 7f2a59950640 1 -- 172.21.15.96:0/3394564856 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2a54071ab0 con 0x7f2a541590f0 2024-04-18T04:57:02.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.447+0000 7f2a3bfff640 1 -- 172.21.15.96:0/3394564856 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f2a4c019620 con 0x7f2a541590f0 2024-04-18T04:57:02.449 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:57:02.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.447+0000 7f2a59950640 1 -- 172.21.15.96:0/3394564856 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2a400666c0 msgr2=0x7f2a40068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.447+0000 7f2a59950640 1 --2- 172.21.15.96:0/3394564856 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2a400666c0 0x7f2a40068b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2a440af000 tx=0x7f2a440a7000 comp rx=0 tx=0).stop 2024-04-18T04:57:02.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.447+0000 7f2a59950640 1 -- 172.21.15.96:0/3394564856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a541590f0 msgr2=0x7f2a5414c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.447+0000 7f2a59950640 1 --2- 172.21.15.96:0/3394564856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a541590f0 0x7f2a5414c7f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00b970 tx=0x7f2a4c00be30 comp rx=0 tx=0).stop 2024-04-18T04:57:02.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.447+0000 7f2a59950640 1 -- 172.21.15.96:0/3394564856 shutdown_connections 2024-04-18T04:57:02.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.447+0000 7f2a59950640 1 --2- 172.21.15.96:0/3394564856 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2a400666c0 0x7f2a40068b80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.447+0000 7f2a59950640 1 --2- 172.21.15.96:0/3394564856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a541590f0 0x7f2a5414c7f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.447+0000 7f2a59950640 1 --2- 172.21.15.96:0/3394564856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a541530f0 0x7f2a54151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.447+0000 7f2a59950640 1 --2- 172.21.15.96:0/3394564856 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2a54071cd0 0x7f2a5414b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.447+0000 7f2a59950640 1 -- 172.21.15.96:0/3394564856 >> 172.21.15.96:0/3394564856 conn(0x7f2a5406af70 msgr2=0x7f2a5414fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:02.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.447+0000 7f2a59950640 1 -- 172.21.15.96:0/3394564856 shutdown_connections 2024-04-18T04:57:02.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.447+0000 7f2a59950640 1 -- 172.21.15.96:0/3394564856 wait complete. 2024-04-18T04:57:02.467 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-18T04:57:02.468 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-18T04:57:02.468 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T04:57:02.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.587+0000 7f9b23ae2640 1 Processor -- start 2024-04-18T04:57:02.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.587+0000 7f9b23ae2640 1 -- start start 2024-04-18T04:57:02.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.587+0000 7f9b23ae2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9b1c0c97d0 0x7f9b1c0cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.587+0000 7f9b23ae2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9b1c159010 0x7f9b1c0c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.587+0000 7f9b23ae2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1c15c720 con 0x7f9b1c0c9bb0 2024-04-18T04:57:02.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.587+0000 7f9b23ae2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c0cf400 con 0x7f9b1c0c97d0 2024-04-18T04:57:02.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.587+0000 7f9b23ae2640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c0cc020 con 0x7f9b1c159010 2024-04-18T04:57:02.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.587+0000 7f9b2187e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9b1c0c97d0 0x7f9b1c0cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.587+0000 7f9b2107d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f9b1c0c9bb0 0x7f9b1c15cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:47630/0 (socket says 172.21.15.96:47630) 2024-04-18T04:57:02.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.587+0000 7f9b2107d640 1 -- 172.21.15.96:0/717755818 learned_addr learned my addr 172.21.15.96:0/717755818 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:57:02.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.587+0000 7f9b2207f640 1 --2- 172.21.15.96:0/717755818 >> v2:172.21.15.139:3300/0 conn(0x7f9b1c159010 0x7f9b1c0c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.587+0000 7f9b2187e640 1 -- 172.21.15.96:0/717755818 >> v2:172.21.15.139:3300/0 conn(0x7f9b1c159010 msgr2=0x7f9b1c0c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:02.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.587+0000 7f9b2187e640 1 --2- 172.21.15.96:0/717755818 >> v2:172.21.15.139:3300/0 conn(0x7f9b1c159010 0x7f9b1c0c5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.587+0000 7f9b2187e640 1 -- 172.21.15.96:0/717755818 >> v1:172.21.15.96:6789/0 conn(0x7f9b1c0c9bb0 legacy=0x7f9b1c15cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.587+0000 7f9b2087c640 1 -- 172.21.15.96:0/717755818 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651502223 0 0) 0x7f9b1c15c720 con 0x7f9b1c0c9bb0 2024-04-18T04:57:02.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.587+0000 7f9b2187e640 1 -- 172.21.15.96:0/717755818 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c0cb780 con 0x7f9b1c0c97d0 2024-04-18T04:57:02.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.591+0000 7f9b2187e640 1 --2- 172.21.15.96:0/717755818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c0c97d0 0x7f9b1c0cb0d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0c9240 tx=0x7f9b1801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f747f8ad4f127a70 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.591+0000 7f9b2087c640 1 -- 172.21.15.96:0/717755818 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b180a8950 con 0x7f9b1c0c97d0 2024-04-18T04:57:02.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.591+0000 7f9b2087c640 1 -- 172.21.15.96:0/717755818 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b180a8ab0 con 0x7f9b1c0c97d0 2024-04-18T04:57:02.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.591+0000 7f9b2087c640 1 -- 172.21.15.96:0/717755818 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b180a8e40 con 0x7f9b1c0c97d0 2024-04-18T04:57:02.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.591+0000 7f9b23ae2640 1 -- 172.21.15.96:0/717755818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c0c97d0 msgr2=0x7f9b1c0cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.591+0000 7f9b23ae2640 1 --2- 172.21.15.96:0/717755818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c0c97d0 0x7f9b1c0cb0d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0c9240 tx=0x7f9b1801ec50 comp rx=0 tx=0).stop 2024-04-18T04:57:02.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.591+0000 7f9b23ae2640 1 -- 172.21.15.96:0/717755818 shutdown_connections 2024-04-18T04:57:02.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.591+0000 7f9b23ae2640 1 --2- 172.21.15.96:0/717755818 >> v2:172.21.15.139:3300/0 conn(0x7f9b1c159010 0x7f9b1c0c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.591+0000 7f9b23ae2640 1 --2- 172.21.15.96:0/717755818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c0c97d0 0x7f9b1c0cb0d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.591+0000 7f9b23ae2640 1 -- 172.21.15.96:0/717755818 >> 172.21.15.96:0/717755818 conn(0x7f9b1c071990 msgr2=0x7f9b1c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:02.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.591+0000 7f9b23ae2640 1 -- 172.21.15.96:0/717755818 shutdown_connections 2024-04-18T04:57:02.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.591+0000 7f9b23ae2640 1 -- 172.21.15.96:0/717755818 wait complete. 2024-04-18T04:57:02.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.591+0000 7f9b23ae2640 1 Processor -- start 2024-04-18T04:57:02.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.591+0000 7f9b23ae2640 1 -- start start 2024-04-18T04:57:02.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b23ae2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c0c97d0 0x7f9b1c1ef080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b23ae2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9b1c0c9bb0 0x7f9b1c15bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b23ae2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b1c159010 0x7f9b1c0c2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b23ae2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0c3e10 con 0x7f9b1c0c97d0 2024-04-18T04:57:02.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b23ae2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c1ef5c0 con 0x7f9b1c159010 2024-04-18T04:57:02.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b23ae2640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0c35b0 con 0x7f9b1c0c9bb0 2024-04-18T04:57:02.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b2187e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c0c97d0 0x7f9b1c1ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b2187e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c0c97d0 0x7f9b1c1ef080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49508/0 (socket says 172.21.15.96:49508) 2024-04-18T04:57:02.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b2187e640 1 -- 172.21.15.96:0/776625239 learned_addr learned my addr 172.21.15.96:0/776625239 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:02.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b2207f640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b1c159010 0x7f9b1c0c2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b2107d640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9b1c0c9bb0 0x7f9b1c15bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b2187e640 1 -- 172.21.15.96:0/776625239 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9b1c0c9bb0 msgr2=0x7f9b1c15bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b2187e640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9b1c0c9bb0 0x7f9b1c15bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b2187e640 1 -- 172.21.15.96:0/776625239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b1c159010 msgr2=0x7f9b1c0c2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b2187e640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b1c159010 0x7f9b1c0c2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b2187e640 1 -- 172.21.15.96:0/776625239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b18009420 con 0x7f9b1c0c97d0 2024-04-18T04:57:02.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b2187e640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c0c97d0 0x7f9b1c1ef080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9b1801b860 tx=0x7f9b1801b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b127fc640 1 -- 172.21.15.96:0/776625239 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b180b9630 con 0x7f9b1c0c97d0 2024-04-18T04:57:02.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b127fc640 1 -- 172.21.15.96:0/776625239 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b180b97b0 con 0x7f9b1c0c97d0 2024-04-18T04:57:02.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b23ae2640 1 -- 172.21.15.96:0/776625239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1c1568f0 con 0x7f9b1c0c97d0 2024-04-18T04:57:02.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b127fc640 1 -- 172.21.15.96:0/776625239 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b180b9b60 con 0x7f9b1c0c97d0 2024-04-18T04:57:02.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b23ae2640 1 -- 172.21.15.96:0/776625239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c0c3b30 con 0x7f9b1c0c97d0 2024-04-18T04:57:02.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b23ae2640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c14f070 0x7f9b1c0c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b23ae2640 1 -- 172.21.15.96:0/776625239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c072300 con 0x7f9b1c14f070 2024-04-18T04:57:02.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b2107d640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c14f070 0x7f9b1c0c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b2107d640 1 -- 172.21.15.96:0/776625239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b1c15c9c0 con 0x7f9b1c14f070 2024-04-18T04:57:02.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b127fc640 1 -- 172.21.15.96:0/776625239 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9b180b7040 con 0x7f9b1c0c97d0 2024-04-18T04:57:02.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b2107d640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c14f070 0x7f9b1c0c3010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0011f0 tx=0x7f9b0c001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b127fc640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9b00066710 0x7f9b00068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b2207f640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9b00066710 0x7f9b00068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b127fc640 1 -- 172.21.15.96:0/776625239 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f9b18122100 con 0x7f9b1c0c97d0 2024-04-18T04:57:02.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.595+0000 7f9b127fc640 1 -- 172.21.15.96:0/776625239 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c012590 con 0x7f9b1c14f070 2024-04-18T04:57:02.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.599+0000 7f9b127fc640 1 -- 172.21.15.96:0/776625239 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f9b0c0126f0 con 0x7f9b1c14f070 2024-04-18T04:57:02.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.599+0000 7f9b127fc640 1 -- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c14f070 msgr2=0x7f9b1c0c3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.599+0000 7f9b127fc640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c14f070 0x7f9b1c0c3010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0011f0 tx=0x7f9b0c001980 comp rx=0 tx=0).stop 2024-04-18T04:57:02.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.599+0000 7f9b127fc640 1 -- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c14f070 msgr2=0x7f9b1c0c3010 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:02.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.599+0000 7f9b127fc640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c14f070 0x7f9b1c0c3010 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0011f0 tx=0x7f9b0c001980 comp rx=0 tx=0).stop 2024-04-18T04:57:02.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.599+0000 7f9b2207f640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9b00066710 0x7f9b00068bd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c159460 tx=0x7f9b14009780 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.603+0000 7f9b23ae2640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c156320 0x7f9b1c0c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.603+0000 7f9b23ae2640 1 -- 172.21.15.96:0/776625239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0cbd40 con 0x7f9b1c156320 2024-04-18T04:57:02.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.603+0000 7f9b2107d640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c156320 0x7f9b1c0c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.603+0000 7f9b2107d640 1 -- 172.21.15.96:0/776625239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9b1c0c6050 con 0x7f9b1c156320 2024-04-18T04:57:02.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.603+0000 7f9b2107d640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c156320 0x7f9b1c0c23f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0011f0 tx=0x7f9b0c001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.607+0000 7f9b127fc640 1 -- 172.21.15.96:0/776625239 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c022070 con 0x7f9b1c156320 2024-04-18T04:57:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.607+0000 7f9b127fc640 1 -- 172.21.15.96:0/776625239 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7f9b0c013420 con 0x7f9b1c156320 2024-04-18T04:57:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.607+0000 7f9b127fc640 1 -- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c156320 msgr2=0x7f9b1c0c23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.607+0000 7f9b127fc640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c156320 0x7f9b1c0c23f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0011f0 tx=0x7f9b0c001090 comp rx=0 tx=0).stop 2024-04-18T04:57:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.607+0000 7f9b127fc640 1 -- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c156320 msgr2=0x7f9b1c0c23f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.607+0000 7f9b127fc640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c156320 0x7f9b1c0c23f0 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0011f0 tx=0x7f9b0c001090 comp rx=0 tx=0).stop 2024-04-18T04:57:02.609 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:57:02.609 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:57:02.610 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:57:02.610 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T04:57:02.610 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 26, 2024-04-18T04:57:02.610 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:57:02.610 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:57:02.610 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:57:02.610 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:57:02.610 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.610 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 2, 2024-04-18T04:57:02.610 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:02.610 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:57:02.610 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:57:02.610 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:02.610 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:02.611 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:02.611 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:02.611 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:02.611 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:02.611 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:02.611 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:02.611 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:02.611 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:02.611 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.611 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:57:02.611 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:57:02.611 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:02.611 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:02.611 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:02.611 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:02.612 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:02.612 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:02.612 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:02.612 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:02.612 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:02.612 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:02.612 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.612 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:57:02.612 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:57:02.612 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:57:02.612 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:57:02.612 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:57:02.612 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:57:02.612 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:02.613 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:02.613 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:57:02.613 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:57:02.613 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:57:02.613 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:57:02.613 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:57:02.613 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:57:02.613 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:57:02.613 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:02.613 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:57:02.613 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:02.613 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:02.613 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:02.613 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:02.613 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:02.614 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:02.614 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:02.614 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:02.614 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:02.614 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:02.614 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.614 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:57:02.614 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.614 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:57:02.614 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.614 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:57:02.614 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:57:02.614 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:02.614 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:02.615 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.615 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:02.615 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:57:02.615 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.615 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.615 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.615 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:02.615 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:57:02.615 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.615 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.615 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.615 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.615 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:57:02.615 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:57:02.616 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:02.616 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:02.616 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:02.616 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.616 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:57:02.616 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:57:02.616 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:02.616 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:02.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.616 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:02.616 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:57:02.616 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.616 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.617 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:02.617 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:57:02.617 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.617 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.617 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.617 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:57:02.617 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:57:02.617 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:02.617 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:02.617 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:02.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.617 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.617 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:57:02.617 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:57:02.617 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:02.618 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:02.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.618 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:02.618 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:57:02.618 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.618 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:02.618 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:57:02.618 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.618 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.618 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.618 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:57:02.618 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:57:02.619 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:02.619 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:02.619 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:02.619 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.619 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.619 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:57:02.619 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:57:02.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.619 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:02.619 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:02.619 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:57:02.619 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.619 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.619 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:57:02.620 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.620 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:02.620 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:02.620 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:57:02.620 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.620 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.620 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:57:02.620 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:57:02.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.607+0000 7f9b23ae2640 1 -- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9b00066710 msgr2=0x7f9b00068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.607+0000 7f9b23ae2640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9b00066710 0x7f9b00068bd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c159460 tx=0x7f9b14009780 comp rx=0 tx=0).stop 2024-04-18T04:57:02.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.607+0000 7f9b23ae2640 1 -- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c0c97d0 msgr2=0x7f9b1c1ef080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.607+0000 7f9b23ae2640 1 --2- 172.21.15.96:0/776625239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b1c0c97d0 0x7f9b1c1ef080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9b1801b860 tx=0x7f9b1801b9f0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.607+0000 7f9b2207f640 1 -- 172.21.15.96:0/776625239 reap_dead start 2024-04-18T04:57:02.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.607+0000 7f9b2207f640 1 -- 172.21.15.96:0/776625239 reap_dead start 2024-04-18T04:57:02.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.607+0000 7f9b23ae2640 1 -- 172.21.15.96:0/776625239 shutdown_connections 2024-04-18T04:57:02.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.607+0000 7f9b23ae2640 1 -- 172.21.15.96:0/776625239 >> 172.21.15.96:0/776625239 conn(0x7f9b1c071990 msgr2=0x7f9b1c0c9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:02.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.607+0000 7f9b23ae2640 1 -- 172.21.15.96:0/776625239 shutdown_connections 2024-04-18T04:57:02.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.607+0000 7f9b23ae2640 1 -- 172.21.15.96:0/776625239 wait complete. 2024-04-18T04:57:02.630 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:57:02.630 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-18T04:57:02.630 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-18T04:57:02.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.763+0000 7faa2c7f0640 1 Processor -- start 2024-04-18T04:57:02.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.763+0000 7faa2c7f0640 1 -- start start 2024-04-18T04:57:02.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.763+0000 7faa2c7f0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7faa2414fe50 0x7faa240ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.763+0000 7faa2c7f0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faa240c2aa0 0x7faa24071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.763+0000 7faa2c7f0640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa240ca990 con 0x7faa240c4800 2024-04-18T04:57:02.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.763+0000 7faa2c7f0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa240c3c70 con 0x7faa240c2aa0 2024-04-18T04:57:02.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.763+0000 7faa2c7f0640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa240ca030 con 0x7faa2414fe50 2024-04-18T04:57:02.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.763+0000 7faa2ad8d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faa240c2aa0 0x7faa24071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.763+0000 7faa2ad8d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faa240c2aa0 0x7faa24071750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49528/0 (socket says 172.21.15.96:49528) 2024-04-18T04:57:02.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.763+0000 7faa2ad8d640 1 -- 172.21.15.96:0/768446151 learned_addr learned my addr 172.21.15.96:0/768446151 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:02.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.763+0000 7faa2a58c640 1 --2- 172.21.15.96:0/768446151 >> v2:172.21.15.139:3300/0 conn(0x7faa2414fe50 0x7faa240ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.763+0000 7faa2ad8d640 1 -- 172.21.15.96:0/768446151 >> v2:172.21.15.139:3300/0 conn(0x7faa2414fe50 msgr2=0x7faa240ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:02.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.763+0000 7faa2ad8d640 1 --2- 172.21.15.96:0/768446151 >> v2:172.21.15.139:3300/0 conn(0x7faa2414fe50 0x7faa240ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.763+0000 7faa2ad8d640 1 -- 172.21.15.96:0/768446151 >> v1:172.21.15.139:6789/0 conn(0x7faa240c4800 legacy=0x7faa24155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.763+0000 7faa2ad8d640 1 -- 172.21.15.96:0/768446151 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa24156390 con 0x7faa240c2aa0 2024-04-18T04:57:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2ad8d640 1 --2- 172.21.15.96:0/768446151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240c2aa0 0x7faa24071750 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faa24071490 tx=0x7faa1c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f924ea03ec3608 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2958a640 1 -- 172.21.15.96:0/768446151 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c0a5880 con 0x7faa240c2aa0 2024-04-18T04:57:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2958a640 1 -- 172.21.15.96:0/768446151 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1c0a59e0 con 0x7faa240c2aa0 2024-04-18T04:57:02.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2958a640 1 -- 172.21.15.96:0/768446151 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c0a5d70 con 0x7faa240c2aa0 2024-04-18T04:57:02.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2c7f0640 1 -- 172.21.15.96:0/768446151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240c2aa0 msgr2=0x7faa24071750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2c7f0640 1 --2- 172.21.15.96:0/768446151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240c2aa0 0x7faa24071750 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faa24071490 tx=0x7faa1c01c9c0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2c7f0640 1 -- 172.21.15.96:0/768446151 shutdown_connections 2024-04-18T04:57:02.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2c7f0640 1 --2- 172.21.15.96:0/768446151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240c2aa0 0x7faa24071750 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2c7f0640 1 --2- 172.21.15.96:0/768446151 >> v2:172.21.15.139:3300/0 conn(0x7faa2414fe50 0x7faa240ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2c7f0640 1 -- 172.21.15.96:0/768446151 >> 172.21.15.96:0/768446151 conn(0x7faa240661c0 msgr2=0x7faa2406eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:02.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2c7f0640 1 -- 172.21.15.96:0/768446151 shutdown_connections 2024-04-18T04:57:02.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2c7f0640 1 -- 172.21.15.96:0/768446151 wait complete. 2024-04-18T04:57:02.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2c7f0640 1 Processor -- start 2024-04-18T04:57:02.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2c7f0640 1 -- start start 2024-04-18T04:57:02.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2c7f0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240c2aa0 0x7faa24143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2c7f0640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa240c4800 0x7faa241f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2c7f0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa2414fe50 0x7faa241f1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2c7f0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa24159390 con 0x7faa240c2aa0 2024-04-18T04:57:02.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2c7f0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa24159f00 con 0x7faa2414fe50 2024-04-18T04:57:02.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.767+0000 7faa2c7f0640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa240cc240 con 0x7faa240c4800 2024-04-18T04:57:02.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa2a58c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240c2aa0 0x7faa24143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa2a58c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240c2aa0 0x7faa24143eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49538/0 (socket says 172.21.15.96:49538) 2024-04-18T04:57:02.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa2a58c640 1 -- 172.21.15.96:0/1632694961 learned_addr learned my addr 172.21.15.96:0/1632694961 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:02.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa29d8b640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa240c4800 0x7faa241f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa2a58c640 1 -- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa240c4800 msgr2=0x7faa241f0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa2a58c640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa240c4800 0x7faa241f0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa2a58c640 1 -- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa2414fe50 msgr2=0x7faa241f1240 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:57:02.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa2a58c640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa2414fe50 0x7faa241f1240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa2a58c640 1 -- 172.21.15.96:0/1632694961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c009b30 con 0x7faa240c2aa0 2024-04-18T04:57:02.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa2a58c640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240c2aa0 0x7faa24143eb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faa2000e870 tx=0x7faa2000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa1affd640 1 -- 172.21.15.96:0/1632694961 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa20009510 con 0x7faa240c2aa0 2024-04-18T04:57:02.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa1affd640 1 -- 172.21.15.96:0/1632694961 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2000eec0 con 0x7faa240c2aa0 2024-04-18T04:57:02.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa2c7f0640 1 -- 172.21.15.96:0/1632694961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa241ee550 con 0x7faa240c2aa0 2024-04-18T04:57:02.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa1affd640 1 -- 172.21.15.96:0/1632694961 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2000cae0 con 0x7faa240c2aa0 2024-04-18T04:57:02.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa2c7f0640 1 -- 172.21.15.96:0/1632694961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa241eeb10 con 0x7faa240c2aa0 2024-04-18T04:57:02.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa2c7f0640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa241eed30 0x7faa241ef110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa2c7f0640 1 -- 172.21.15.96:0/1632694961 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa24066b90 con 0x7faa241eed30 2024-04-18T04:57:02.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa1affd640 1 -- 172.21.15.96:0/1632694961 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faa2000ccc0 con 0x7faa240c2aa0 2024-04-18T04:57:02.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa29d8b640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa241eed30 0x7faa241ef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa1affd640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa08066690 0x7faa08068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa29d8b640 1 -- 172.21.15.96:0/1632694961 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa24150230 con 0x7faa241eed30 2024-04-18T04:57:02.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa2ad8d640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa08066690 0x7faa08068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.771+0000 7faa1affd640 1 -- 172.21.15.96:0/1632694961 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7faa200838b0 con 0x7faa240c2aa0 2024-04-18T04:57:02.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.775+0000 7faa29d8b640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa241eed30 0x7faa241ef110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa24155d40 tx=0x7faa1400fc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.775+0000 7faa1affd640 1 -- 172.21.15.96:0/1632694961 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa140050d0 con 0x7faa241eed30 2024-04-18T04:57:02.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.775+0000 7faa2ad8d640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa08066690 0x7faa08068b50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0ae000 tx=0x7faa1c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.775+0000 7faa1affd640 1 -- 172.21.15.96:0/1632694961 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7faa14005230 con 0x7faa241eed30 2024-04-18T04:57:02.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.775+0000 7faa1affd640 1 -- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa241eed30 msgr2=0x7faa241ef110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.775+0000 7faa1affd640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa241eed30 0x7faa241ef110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa24155d40 tx=0x7faa1400fc00 comp rx=0 tx=0).stop 2024-04-18T04:57:02.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.775+0000 7faa1affd640 1 -- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa241eed30 msgr2=0x7faa241ef110 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:02.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.775+0000 7faa1affd640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa241eed30 0x7faa241ef110 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.779+0000 7faa2c7f0640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa241f2cd0 0x7faa241f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.779+0000 7faa2c7f0640 1 -- 172.21.15.96:0/1632694961 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa240c9c50 con 0x7faa241f2cd0 2024-04-18T04:57:02.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa29d8b640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa241f2cd0 0x7faa241f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa29d8b640 1 -- 172.21.15.96:0/1632694961 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7faa24160d00 con 0x7faa241f2cd0 2024-04-18T04:57:02.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa29d8b640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa241f2cd0 0x7faa241f30e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa14017000 tx=0x7faa14001130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa1affd640 1 -- 172.21.15.96:0/1632694961 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14024070 con 0x7faa241f2cd0 2024-04-18T04:57:02.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa1affd640 1 -- 172.21.15.96:0/1632694961 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4975 (secure 0 0 0) 0x7faa14003b60 con 0x7faa241f2cd0 2024-04-18T04:57:02.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa1affd640 1 -- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa241f2cd0 msgr2=0x7faa241f30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa1affd640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa241f2cd0 0x7faa241f30e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa14017000 tx=0x7faa14001130 comp rx=0 tx=0).stop 2024-04-18T04:57:02.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa1affd640 1 -- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa241f2cd0 msgr2=0x7faa241f30e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:02.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa1affd640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa241f2cd0 0x7faa241f30e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.787 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:57:02.787 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:57:02.787 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:57:02.787 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:57:02.787 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 26, 2024-04-18T04:57:02.787 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:57:02.787 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:57:02.787 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:57:02.787 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:57:02.787 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.787 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 2, 2024-04-18T04:57:02.787 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:02.787 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:57:02.788 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:57:02.788 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:02.788 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:02.788 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:02.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:02.788 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:02.788 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:02.788 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:02.788 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:02.788 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:02.788 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:02.788 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.789 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:57:02.789 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:57:02.789 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:02.789 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:02.789 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:02.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:02.789 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:02.789 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:02.789 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:02.789 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:02.789 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:02.789 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:02.789 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.789 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.789 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:57:02.790 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:57:02.790 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:57:02.790 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:57:02.790 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:57:02.790 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:57:02.790 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:02.790 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:02.790 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:57:02.790 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:57:02.790 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:57:02.790 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:57:02.790 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:57:02.790 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:57:02.790 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:57:02.790 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:02.791 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:57:02.791 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:02.791 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:02.791 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:02.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:02.791 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:02.791 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:02.791 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:02.791 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:02.791 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:02.791 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:02.791 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.791 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:57:02.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.791 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:57:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:57:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:57:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:57:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:57:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.792 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.794 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.794 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:02.794 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:57:02.794 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.794 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.794 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.794 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:57:02.794 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:57:02.794 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:02.794 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:02.794 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:02.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.794 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.794 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:57:02.795 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:57:02.795 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:02.795 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:02.795 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.795 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:02.795 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:57:02.795 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.795 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.795 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.795 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:02.795 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:57:02.795 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.795 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.795 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.796 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:57:02.796 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:57:02.796 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:02.796 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:02.796 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:02.796 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.796 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.796 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:57:02.796 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:57:02.796 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.796 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:02.796 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:02.797 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:57:02.797 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.797 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.797 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:57:02.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.797 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:02.797 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:02.797 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:57:02.797 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.797 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:57:02.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.797 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:02.797 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:02.797 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:57:02.798 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.798 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.798 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:57:02.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.798 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:02.798 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:02.798 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5 2024-04-18T04:57:02.798 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.798 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.798 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:57:02.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.798 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:02.798 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:02.798 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:57:02.798 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.798 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.799 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:57:02.799 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:57:02.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa2c7f0640 1 -- 172.21.15.96:0/1632694961 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa08066690 msgr2=0x7faa08068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa2c7f0640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa08066690 0x7faa08068b50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0ae000 tx=0x7faa1c0a7070 comp rx=0 tx=0).stop 2024-04-18T04:57:02.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa2c7f0640 1 -- 172.21.15.96:0/1632694961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240c2aa0 msgr2=0x7faa24143eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa2c7f0640 1 --2- 172.21.15.96:0/1632694961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa240c2aa0 0x7faa24143eb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faa2000e870 tx=0x7faa2000ec70 comp rx=0 tx=0).stop 2024-04-18T04:57:02.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa2ad8d640 1 -- 172.21.15.96:0/1632694961 reap_dead start 2024-04-18T04:57:02.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa2ad8d640 1 -- 172.21.15.96:0/1632694961 reap_dead start 2024-04-18T04:57:02.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa2c7f0640 1 -- 172.21.15.96:0/1632694961 shutdown_connections 2024-04-18T04:57:02.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa2c7f0640 1 -- 172.21.15.96:0/1632694961 >> 172.21.15.96:0/1632694961 conn(0x7faa240661c0 msgr2=0x7faa240cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:02.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa2c7f0640 1 -- 172.21.15.96:0/1632694961 shutdown_connections 2024-04-18T04:57:02.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.783+0000 7faa2c7f0640 1 -- 172.21.15.96:0/1632694961 wait complete. 2024-04-18T04:57:02.806 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:57:02.806 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-18T04:57:02.806 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-18T04:57:02.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.935+0000 7f6e8d397640 1 Processor -- start 2024-04-18T04:57:02.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.935+0000 7f6e8d397640 1 -- start start 2024-04-18T04:57:02.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.935+0000 7f6e8d397640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6e880c89a0 0x7f6e88070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.935+0000 7f6e8d397640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e8815a860 0x7f6e8815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.935+0000 7f6e8d397640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e88157be0 con 0x7f6e88150cb0 2024-04-18T04:57:02.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.935+0000 7f6e8d397640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8815a3d0 con 0x7f6e880c89a0 2024-04-18T04:57:02.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.935+0000 7f6e8d397640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e880c5740 con 0x7f6e8815a860 2024-04-18T04:57:02.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.935+0000 7f6e867fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6e880c89a0 0x7f6e88070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.935+0000 7f6e867fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6e880c89a0 0x7f6e88070fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49544/0 (socket says 172.21.15.96:49544) 2024-04-18T04:57:02.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.935+0000 7f6e867fc640 1 -- 172.21.15.96:0/3811220485 learned_addr learned my addr 172.21.15.96:0/3811220485 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:02.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.935+0000 7f6e867fc640 1 -- 172.21.15.96:0/3811220485 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e8815a860 msgr2=0x7f6e8815acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:02.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.935+0000 7f6e867fc640 1 --2- 172.21.15.96:0/3811220485 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e8815a860 0x7f6e8815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.935+0000 7f6e867fc640 1 -- 172.21.15.96:0/3811220485 >> v1:172.21.15.139:6789/0 conn(0x7f6e88150cb0 legacy=0x7f6e880c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.935+0000 7f6e867fc640 1 -- 172.21.15.96:0/3811220485 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e88157060 con 0x7f6e880c89a0 2024-04-18T04:57:02.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.939+0000 7f6e867fc640 1 --2- 172.21.15.96:0/3811220485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e880c89a0 0x7f6e88070fc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009870 tx=0x7f6e7c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e2552022fdaf14 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.939+0000 7f6e85ffb640 1 -- 172.21.15.96:0/3811220485 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0a95f0 con 0x7f6e880c89a0 2024-04-18T04:57:02.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.939+0000 7f6e85ffb640 1 -- 172.21.15.96:0/3811220485 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c0a9750 con 0x7f6e880c89a0 2024-04-18T04:57:02.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.939+0000 7f6e85ffb640 1 -- 172.21.15.96:0/3811220485 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0a9ae0 con 0x7f6e880c89a0 2024-04-18T04:57:02.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.939+0000 7f6e8d397640 1 -- 172.21.15.96:0/3811220485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e880c89a0 msgr2=0x7f6e88070fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.939+0000 7f6e8d397640 1 --2- 172.21.15.96:0/3811220485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e880c89a0 0x7f6e88070fc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009870 tx=0x7f6e7c01c530 comp rx=0 tx=0).stop 2024-04-18T04:57:02.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.939+0000 7f6e8d397640 1 -- 172.21.15.96:0/3811220485 shutdown_connections 2024-04-18T04:57:02.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.939+0000 7f6e8d397640 1 --2- 172.21.15.96:0/3811220485 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e8815a860 0x7f6e8815acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.939+0000 7f6e8d397640 1 --2- 172.21.15.96:0/3811220485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e880c89a0 0x7f6e88070fc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.939+0000 7f6e8d397640 1 -- 172.21.15.96:0/3811220485 >> 172.21.15.96:0/3811220485 conn(0x7f6e880c7e80 msgr2=0x7f6e880c8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:02.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.939+0000 7f6e8d397640 1 -- 172.21.15.96:0/3811220485 shutdown_connections 2024-04-18T04:57:02.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.939+0000 7f6e8d397640 1 -- 172.21.15.96:0/3811220485 wait complete. 2024-04-18T04:57:02.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e8d397640 1 Processor -- start 2024-04-18T04:57:02.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e8d397640 1 -- start start 2024-04-18T04:57:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e8d397640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e880c89a0 0x7f6e8814d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e8d397640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e88150cb0 0x7f6e8814dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e8d397640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e8815a860 0x7f6e8815fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e8d397640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8815f100 con 0x7f6e88150cb0 2024-04-18T04:57:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e8d397640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e881519a0 con 0x7f6e880c89a0 2024-04-18T04:57:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e8d397640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8815f680 con 0x7f6e8815a860 2024-04-18T04:57:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e867fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e88150cb0 0x7f6e8814dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e867fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e88150cb0 0x7f6e8814dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49546/0 (socket says 172.21.15.96:49546) 2024-04-18T04:57:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e867fc640 1 -- 172.21.15.96:0/457579931 learned_addr learned my addr 172.21.15.96:0/457579931 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e86ffd640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e880c89a0 0x7f6e8814d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e877fe640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e8815a860 0x7f6e8815fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e867fc640 1 -- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e8815a860 msgr2=0x7f6e8815fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e867fc640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e8815a860 0x7f6e8815fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e867fc640 1 -- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e880c89a0 msgr2=0x7f6e8814d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e867fc640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e880c89a0 0x7f6e8814d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e867fc640 1 -- 172.21.15.96:0/457579931 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c0094d0 con 0x7f6e88150cb0 2024-04-18T04:57:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e867fc640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e88150cb0 0x7f6e8814dc90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0ab040 tx=0x7f6e7c01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e6f7fe640 1 -- 172.21.15.96:0/457579931 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0b1800 con 0x7f6e88150cb0 2024-04-18T04:57:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e6f7fe640 1 -- 172.21.15.96:0/457579931 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c0b1980 con 0x7f6e88150cb0 2024-04-18T04:57:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e8d397640 1 -- 172.21.15.96:0/457579931 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e880c3b10 con 0x7f6e88150cb0 2024-04-18T04:57:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e6f7fe640 1 -- 172.21.15.96:0/457579931 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0b1d30 con 0x7f6e88150cb0 2024-04-18T04:57:02.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e8d397640 1 -- 172.21.15.96:0/457579931 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e880c40b0 con 0x7f6e88150cb0 2024-04-18T04:57:02.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e8d397640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e8815f270 0x7f6e88160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.943+0000 7f6e8d397640 1 -- 172.21.15.96:0/457579931 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e88066b90 con 0x7f6e8815f270 2024-04-18T04:57:02.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.947+0000 7f6e86ffd640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e8815f270 0x7f6e88160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.947+0000 7f6e86ffd640 1 -- 172.21.15.96:0/457579931 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e88151090 con 0x7f6e8815f270 2024-04-18T04:57:02.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.947+0000 7f6e86ffd640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e8815f270 0x7f6e88160050 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6e78000f70 tx=0x7f6e7800fc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.947+0000 7f6e6f7fe640 1 -- 172.21.15.96:0/457579931 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6e7c0bc450 con 0x7f6e88150cb0 2024-04-18T04:57:02.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.947+0000 7f6e6f7fe640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6e74066690 0x7f6e74068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.947+0000 7f6e6f7fe640 1 -- 172.21.15.96:0/457579931 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6e7c11ef00 con 0x7f6e88150cb0 2024-04-18T04:57:02.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.947+0000 7f6e877fe640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6e74066690 0x7f6e74068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.947+0000 7f6e6f7fe640 1 -- 172.21.15.96:0/457579931 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e780050d0 con 0x7f6e8815f270 2024-04-18T04:57:02.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.947+0000 7f6e6f7fe640 1 -- 172.21.15.96:0/457579931 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f6e78005230 con 0x7f6e8815f270 2024-04-18T04:57:02.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.947+0000 7f6e6f7fe640 1 -- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e8815f270 msgr2=0x7f6e88160050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.947+0000 7f6e6f7fe640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e8815f270 0x7f6e88160050 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6e78000f70 tx=0x7f6e7800fc00 comp rx=0 tx=0).stop 2024-04-18T04:57:02.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.947+0000 7f6e6f7fe640 1 -- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e8815f270 msgr2=0x7f6e88160050 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:02.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.947+0000 7f6e6f7fe640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e8815f270 0x7f6e88160050 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.947+0000 7f6e877fe640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6e74066690 0x7f6e74068b50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009f60 tx=0x7f6e8000d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e8d397640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e881f49f0 0x7f6e8814e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:02.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e8d397640 1 -- 172.21.15.96:0/457579931 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e880670f0 con 0x7f6e881f49f0 2024-04-18T04:57:02.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e86ffd640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e881f49f0 0x7f6e8814e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:02.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e86ffd640 1 -- 172.21.15.96:0/457579931 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6e88154870 con 0x7f6e881f49f0 2024-04-18T04:57:02.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e86ffd640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e881f49f0 0x7f6e8814e9c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6e78000f70 tx=0x7f6e78001130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:02.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e6f7fe640 1 -- 172.21.15.96:0/457579931 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e78024070 con 0x7f6e881f49f0 2024-04-18T04:57:02.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e6f7fe640 1 -- 172.21.15.96:0/457579931 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4975 (secure 0 0 0) 0x7f6e78003a90 con 0x7f6e881f49f0 2024-04-18T04:57:02.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e6f7fe640 1 -- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e881f49f0 msgr2=0x7f6e8814e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e6f7fe640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e881f49f0 0x7f6e8814e9c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6e78000f70 tx=0x7f6e78001130 comp rx=0 tx=0).stop 2024-04-18T04:57:02.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e6f7fe640 1 -- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e881f49f0 msgr2=0x7f6e8814e9c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:02.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e6f7fe640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e881f49f0 0x7f6e8814e9c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:02.960 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:57:02.960 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:57:02.960 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:57:02.960 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:57:02.960 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 26, 2024-04-18T04:57:02.960 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:57:02.960 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:57:02.960 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:57:02.960 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:57:02.960 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.960 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 2, 2024-04-18T04:57:02.960 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:02.961 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:57:02.961 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:57:02.961 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:02.961 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:02.961 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:02.961 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:02.961 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:02.961 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:02.961 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:02.961 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:02.961 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:02.961 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:02.961 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.961 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:57:02.961 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:57:02.962 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:02.962 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:02.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:02.962 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:02.962 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:02.962 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:02.962 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:02.962 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:02.962 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:02.962 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:02.962 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.962 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:57:02.962 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:57:02.963 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:57:02.963 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:57:02.963 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:57:02.963 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:57:02.963 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:02.963 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:02.963 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:57:02.963 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:57:02.963 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:57:02.963 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:57:02.963 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:57:02.963 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:57:02.963 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:57:02.963 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:02.963 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:57:02.964 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:02.964 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:02.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:02.964 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:02.964 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:02.964 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:02.964 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:02.964 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:02.964 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:02.964 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:02.964 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.964 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:57:02.964 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:57:02.964 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.965 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:57:02.965 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:57:02.965 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:02.965 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:02.965 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.965 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:02.965 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:57:02.965 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.965 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.965 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.965 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:02.965 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:57:02.965 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.965 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.966 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.966 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:57:02.966 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:57:02.966 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:02.966 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:02.966 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:02.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.966 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.966 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:57:02.966 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:57:02.966 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:02.966 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:02.966 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.967 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:02.967 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:57:02.967 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.967 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.967 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:02.967 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:57:02.967 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.967 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.967 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.967 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:57:02.967 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:57:02.967 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:02.967 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:02.967 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.968 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.969 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:57:02.969 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:57:02.969 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:02.969 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:02.969 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:02.969 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.969 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.969 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:57:02.969 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:57:02.969 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.969 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:02.969 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:02.969 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:57:02.970 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.970 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.970 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:57:02.970 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.970 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:02.970 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:02.970 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:57:02.970 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.970 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.970 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:57:02.970 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.970 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:02.974 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:02.975 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:57:02.975 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.975 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.975 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:57:02.975 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.975 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:02.975 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:02.975 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:57:02.975 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.975 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:02.975 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:57:02.975 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:02.975 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:02.975 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:02.976 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:57:02.976 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:02.976 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:02.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:02.976 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:57:02.976 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:57:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e8d397640 1 -- 172.21.15.96:0/457579931 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6e74066690 msgr2=0x7f6e74068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e8d397640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6e74066690 0x7f6e74068b50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009f60 tx=0x7f6e8000d040 comp rx=0 tx=0).stop 2024-04-18T04:57:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e8d397640 1 -- 172.21.15.96:0/457579931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e88150cb0 msgr2=0x7f6e8814dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e8d397640 1 --2- 172.21.15.96:0/457579931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e88150cb0 0x7f6e8814dc90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0ab040 tx=0x7f6e7c01ad70 comp rx=0 tx=0).stop 2024-04-18T04:57:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e877fe640 1 -- 172.21.15.96:0/457579931 reap_dead start 2024-04-18T04:57:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e877fe640 1 -- 172.21.15.96:0/457579931 reap_dead start 2024-04-18T04:57:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e8d397640 1 -- 172.21.15.96:0/457579931 shutdown_connections 2024-04-18T04:57:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e8d397640 1 -- 172.21.15.96:0/457579931 >> 172.21.15.96:0/457579931 conn(0x7f6e880c7e80 msgr2=0x7f6e8806cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e8d397640 1 -- 172.21.15.96:0/457579931 shutdown_connections 2024-04-18T04:57:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:02.955+0000 7f6e8d397640 1 -- 172.21.15.96:0/457579931 wait complete. 2024-04-18T04:57:02.979 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:57:02.979 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-18T04:57:02.979 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-18T04:57:03.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.099+0000 7fab21686640 1 Processor -- start 2024-04-18T04:57:03.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.099+0000 7fab21686640 1 -- start start 2024-04-18T04:57:03.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.099+0000 7fab21686640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fab1c150ee0 0x7fab1c0cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:03.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.099+0000 7fab21686640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fab1c0c8a50 0x7fab1c0c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:03.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.099+0000 7fab21686640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab1c0c76d0 con 0x7fab1c1512c0 2024-04-18T04:57:03.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.099+0000 7fab21686640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1c0c6c80 con 0x7fab1c0c8a50 2024-04-18T04:57:03.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.099+0000 7fab21686640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c071d00 con 0x7fab1c150ee0 2024-04-18T04:57:03.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.099+0000 7fab1b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fab1c0c8a50 0x7fab1c0c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:03.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.099+0000 7fab1b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fab1c0c8a50 0x7fab1c0c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49554/0 (socket says 172.21.15.96:49554) 2024-04-18T04:57:03.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.099+0000 7fab1b7fe640 1 -- 172.21.15.96:0/1700399854 learned_addr learned my addr 172.21.15.96:0/1700399854 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:03.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.099+0000 7fab1affd640 1 --2- 172.21.15.96:0/1700399854 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fab1c150ee0 0x7fab1c0cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:03.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab1a7fc640 1 -- 172.21.15.96:0/1700399854 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008062214 0 0) 0x7fab1c0c76d0 con 0x7fab1c1512c0 2024-04-18T04:57:03.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab1a7fc640 1 -- 172.21.15.96:0/1700399854 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab08003530 con 0x7fab1c1512c0 2024-04-18T04:57:03.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab1b7fe640 1 -- 172.21.15.96:0/1700399854 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fab1c150ee0 msgr2=0x7fab1c0cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:03.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab1b7fe640 1 --2- 172.21.15.96:0/1700399854 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fab1c150ee0 0x7fab1c0cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:03.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab1b7fe640 1 -- 172.21.15.96:0/1700399854 >> v1:172.21.15.96:6789/0 conn(0x7fab1c1512c0 legacy=0x7fab1c15a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:03.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab1b7fe640 1 -- 172.21.15.96:0/1700399854 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c071fe0 con 0x7fab1c0c8a50 2024-04-18T04:57:03.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab1affd640 1 --2- 172.21.15.96:0/1700399854 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fab1c150ee0 0x7fab1c0cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:57:03.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab1b7fe640 1 --2- 172.21.15.96:0/1700399854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab1c0c8a50 0x7fab1c0c4b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab14009e50 tx=0x7fab1401f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f35659ed8701ea0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:03.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab1a7fc640 1 -- 172.21.15.96:0/1700399854 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab140af400 con 0x7fab1c0c8a50 2024-04-18T04:57:03.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab1a7fc640 1 -- 172.21.15.96:0/1700399854 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab140ab050 con 0x7fab1c0c8a50 2024-04-18T04:57:03.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab1a7fc640 1 -- 172.21.15.96:0/1700399854 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab140af780 con 0x7fab1c0c8a50 2024-04-18T04:57:03.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab21686640 1 -- 172.21.15.96:0/1700399854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab1c0c8a50 msgr2=0x7fab1c0c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:03.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab21686640 1 --2- 172.21.15.96:0/1700399854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab1c0c8a50 0x7fab1c0c4b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab14009e50 tx=0x7fab1401f210 comp rx=0 tx=0).stop 2024-04-18T04:57:03.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab21686640 1 -- 172.21.15.96:0/1700399854 shutdown_connections 2024-04-18T04:57:03.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab21686640 1 --2- 172.21.15.96:0/1700399854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab1c0c8a50 0x7fab1c0c4b90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:03.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab21686640 1 --2- 172.21.15.96:0/1700399854 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fab1c150ee0 0x7fab1c0cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:03.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab21686640 1 -- 172.21.15.96:0/1700399854 >> 172.21.15.96:0/1700399854 conn(0x7fab1c066250 msgr2=0x7fab1c06eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:03.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab21686640 1 -- 172.21.15.96:0/1700399854 shutdown_connections 2024-04-18T04:57:03.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.103+0000 7fab21686640 1 -- 172.21.15.96:0/1700399854 wait complete. 2024-04-18T04:57:03.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab21686640 1 Processor -- start 2024-04-18T04:57:03.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab21686640 1 -- start start 2024-04-18T04:57:03.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab21686640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab1c0c8a50 0x7fab1c159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:03.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab21686640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fab1c150ee0 0x7fab1c14d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:03.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab21686640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab1c1512c0 0x7fab1c13d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:03.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab21686640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c13d9c0 con 0x7fab1c1512c0 2024-04-18T04:57:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab21686640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c1532f0 con 0x7fab1c0c8a50 2024-04-18T04:57:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab21686640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c158920 con 0x7fab1c150ee0 2024-04-18T04:57:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab1b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab1c1512c0 0x7fab1c13d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab1b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab1c1512c0 0x7fab1c13d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:49556/0 (socket says 172.21.15.96:49556) 2024-04-18T04:57:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab1b7fe640 1 -- 172.21.15.96:0/18093693 learned_addr learned my addr 172.21.15.96:0/18093693 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab1affd640 1 --2- 172.21.15.96:0/18093693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab1c0c8a50 0x7fab1c159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab13fff640 1 --2- 172.21.15.96:0/18093693 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fab1c150ee0 0x7fab1c14d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab1b7fe640 1 -- 172.21.15.96:0/18093693 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fab1c150ee0 msgr2=0x7fab1c14d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab1b7fe640 1 --2- 172.21.15.96:0/18093693 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fab1c150ee0 0x7fab1c14d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab1b7fe640 1 -- 172.21.15.96:0/18093693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab1c0c8a50 msgr2=0x7fab1c159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab1b7fe640 1 --2- 172.21.15.96:0/18093693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab1c0c8a50 0x7fab1c159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab1b7fe640 1 -- 172.21.15.96:0/18093693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab14009b30 con 0x7fab1c1512c0 2024-04-18T04:57:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab1b7fe640 1 --2- 172.21.15.96:0/18093693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab1c1512c0 0x7fab1c13d480 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fab1401ce40 tx=0x7fab1401bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab137fe640 1 -- 172.21.15.96:0/18093693 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab140afcb0 con 0x7fab1c1512c0 2024-04-18T04:57:03.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab137fe640 1 -- 172.21.15.96:0/18093693 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab140afe10 con 0x7fab1c1512c0 2024-04-18T04:57:03.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab21686640 1 -- 172.21.15.96:0/18093693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1c158c00 con 0x7fab1c1512c0 2024-04-18T04:57:03.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab137fe640 1 -- 172.21.15.96:0/18093693 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab140b9650 con 0x7fab1c1512c0 2024-04-18T04:57:03.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.107+0000 7fab21686640 1 -- 172.21.15.96:0/18093693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1c1591c0 con 0x7fab1c1512c0 2024-04-18T04:57:03.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.111+0000 7fab21686640 1 -- 172.21.15.96:0/18093693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1c067050 con 0x7fab1c1512c0 2024-04-18T04:57:03.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.111+0000 7fab137fe640 1 -- 172.21.15.96:0/18093693 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fab140b6070 con 0x7fab1c1512c0 2024-04-18T04:57:03.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.111+0000 7fab137fe640 1 --2- 172.21.15.96:0/18093693 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faafc066690 0x7faafc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:03.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.111+0000 7fab137fe640 1 -- 172.21.15.96:0/18093693 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fab14121ef0 con 0x7fab1c1512c0 2024-04-18T04:57:03.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.111+0000 7fab1affd640 1 --2- 172.21.15.96:0/18093693 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faafc066690 0x7faafc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:03.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.111+0000 7fab1affd640 1 --2- 172.21.15.96:0/18093693 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faafc066690 0x7faafc068b50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009950 tx=0x7fab0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:03.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.115+0000 7fab137fe640 1 -- 172.21.15.96:0/18093693 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fab140ef2f0 con 0x7fab1c1512c0 2024-04-18T04:57:03.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.359+0000 7fab21686640 1 -- 172.21.15.96:0/18093693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fab1c140ea0 con 0x7fab1c1512c0 2024-04-18T04:57:03.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.363+0000 7fab137fe640 1 -- 172.21.15.96:0/18093693 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fab140f2910 con 0x7fab1c1512c0 2024-04-18T04:57:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.363+0000 7fab21686640 1 -- 172.21.15.96:0/18093693 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faafc066690 msgr2=0x7faafc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.363+0000 7fab21686640 1 --2- 172.21.15.96:0/18093693 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faafc066690 0x7faafc068b50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009950 tx=0x7fab0c008040 comp rx=0 tx=0).stop 2024-04-18T04:57:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.363+0000 7fab21686640 1 -- 172.21.15.96:0/18093693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab1c1512c0 msgr2=0x7fab1c13d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.363+0000 7fab21686640 1 --2- 172.21.15.96:0/18093693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab1c1512c0 0x7fab1c13d480 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fab1401ce40 tx=0x7fab1401bfb0 comp rx=0 tx=0).stop 2024-04-18T04:57:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.363+0000 7fab21686640 1 -- 172.21.15.96:0/18093693 shutdown_connections 2024-04-18T04:57:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.363+0000 7fab21686640 1 --2- 172.21.15.96:0/18093693 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faafc066690 0x7faafc068b50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.363+0000 7fab21686640 1 --2- 172.21.15.96:0/18093693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab1c1512c0 0x7fab1c13d480 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.363+0000 7fab21686640 1 --2- 172.21.15.96:0/18093693 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fab1c150ee0 0x7fab1c14d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:03.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.363+0000 7fab21686640 1 --2- 172.21.15.96:0/18093693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab1c0c8a50 0x7fab1c159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:03.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.363+0000 7fab21686640 1 -- 172.21.15.96:0/18093693 >> 172.21.15.96:0/18093693 conn(0x7fab1c066250 msgr2=0x7fab1c0c9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:03.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.363+0000 7fab21686640 1 -- 172.21.15.96:0/18093693 shutdown_connections 2024-04-18T04:57:03.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:03.363+0000 7fab21686640 1 -- 172.21.15.96:0/18093693 wait complete. 2024-04-18T04:57:03.384 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-18T04:57:13.385 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-18T04:57:13.386 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:57:13.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.523+0000 7f20f0b9a640 1 Processor -- start 2024-04-18T04:57:13.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.523+0000 7f20f0b9a640 1 -- start start 2024-04-18T04:57:13.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.523+0000 7f20f0b9a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20ec070f70 0x7f20ec06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:13.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.523+0000 7f20f0b9a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f20ec06f5f0 0x7f20ec1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:13.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.523+0000 7f20f0b9a640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec0c9e50 con 0x7f20ec1530f0 2024-04-18T04:57:13.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.523+0000 7f20f0b9a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ec06fa00 con 0x7f20ec070f70 2024-04-18T04:57:13.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.523+0000 7f20f0b9a640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ec0713e0 con 0x7f20ec06f5f0 2024-04-18T04:57:13.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.523+0000 7f20e9d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20ec070f70 0x7f20ec06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:13.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20e9d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20ec070f70 0x7f20ec06f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58666/0 (socket says 172.21.15.96:58666) 2024-04-18T04:57:13.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20e9d9b640 1 -- 172.21.15.96:0/2017007761 learned_addr learned my addr 172.21.15.96:0/2017007761 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:13.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20e9d9b640 1 -- 172.21.15.96:0/2017007761 >> v2:172.21.15.139:3300/0 conn(0x7f20ec06f5f0 msgr2=0x7f20ec1590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:13.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20ead9d640 1 --2- 172.21.15.96:0/2017007761 >> v2:172.21.15.139:3300/0 conn(0x7f20ec06f5f0 0x7f20ec1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:13.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20e9d9b640 1 --2- 172.21.15.96:0/2017007761 >> v2:172.21.15.139:3300/0 conn(0x7f20ec06f5f0 0x7f20ec1590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20e9d9b640 1 -- 172.21.15.96:0/2017007761 >> v1:172.21.15.139:6789/0 conn(0x7f20ec1530f0 legacy=0x7f20ec071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:13.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20e9d9b640 1 -- 172.21.15.96:0/2017007761 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0ca130 con 0x7f20ec070f70 2024-04-18T04:57:13.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20e9d9b640 1 --2- 172.21.15.96:0/2017007761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20ec070f70 0x7f20ec06f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0723e0 tx=0x7f20dc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70bcbf032c87218 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:13.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20e959a640 1 -- 172.21.15.96:0/2017007761 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0ab620 con 0x7f20ec070f70 2024-04-18T04:57:13.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20e959a640 1 -- 172.21.15.96:0/2017007761 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc0ab780 con 0x7f20ec070f70 2024-04-18T04:57:13.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20e959a640 1 -- 172.21.15.96:0/2017007761 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0abb10 con 0x7f20ec070f70 2024-04-18T04:57:13.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20f0b9a640 1 -- 172.21.15.96:0/2017007761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20ec070f70 msgr2=0x7f20ec06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:13.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20f0b9a640 1 --2- 172.21.15.96:0/2017007761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20ec070f70 0x7f20ec06f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0723e0 tx=0x7f20dc01c420 comp rx=0 tx=0).stop 2024-04-18T04:57:13.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20f0b9a640 1 -- 172.21.15.96:0/2017007761 shutdown_connections 2024-04-18T04:57:13.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20f0b9a640 1 --2- 172.21.15.96:0/2017007761 >> v2:172.21.15.139:3300/0 conn(0x7f20ec06f5f0 0x7f20ec1590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20f0b9a640 1 --2- 172.21.15.96:0/2017007761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20ec070f70 0x7f20ec06f0b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20f0b9a640 1 -- 172.21.15.96:0/2017007761 >> 172.21.15.96:0/2017007761 conn(0x7f20ec06af70 msgr2=0x7f20ec06b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:13.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20f0b9a640 1 -- 172.21.15.96:0/2017007761 shutdown_connections 2024-04-18T04:57:13.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.527+0000 7f20f0b9a640 1 -- 172.21.15.96:0/2017007761 wait complete. 2024-04-18T04:57:13.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20f0b9a640 1 Processor -- start 2024-04-18T04:57:13.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20f0b9a640 1 -- start start 2024-04-18T04:57:13.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20f0b9a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20ec06f5f0 0x7f20ec1f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:13.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20f0b9a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20ec070f70 0x7f20ec0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:13.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20f0b9a640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20ec1530f0 0x7f20ec14bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:13.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20f0b9a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0c7690 con 0x7f20ec06f5f0 2024-04-18T04:57:13.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20f0b9a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0c4d40 con 0x7f20ec070f70 2024-04-18T04:57:13.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20f0b9a640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0c5020 con 0x7f20ec1530f0 2024-04-18T04:57:13.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20ea59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20ec06f5f0 0x7f20ec1f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:13.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20ea59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20ec06f5f0 0x7f20ec1f4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58682/0 (socket says 172.21.15.96:58682) 2024-04-18T04:57:13.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20ea59c640 1 -- 172.21.15.96:0/4030292330 learned_addr learned my addr 172.21.15.96:0/4030292330 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:13.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20ead9d640 1 --2- 172.21.15.96:0/4030292330 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20ec1530f0 0x7f20ec14bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:13.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20ea59c640 1 -- 172.21.15.96:0/4030292330 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20ec1530f0 msgr2=0x7f20ec14bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:13.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20ea59c640 1 --2- 172.21.15.96:0/4030292330 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20ec1530f0 0x7f20ec14bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20ea59c640 1 -- 172.21.15.96:0/4030292330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20ec070f70 msgr2=0x7f20ec0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:13.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20e9d9b640 1 --2- 172.21.15.96:0/4030292330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20ec070f70 0x7f20ec0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:13.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20ea59c640 1 --2- 172.21.15.96:0/4030292330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20ec070f70 0x7f20ec0cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20ea59c640 1 -- 172.21.15.96:0/4030292330 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc0094d0 con 0x7f20ec06f5f0 2024-04-18T04:57:13.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20ead9d640 1 --2- 172.21.15.96:0/4030292330 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20ec1530f0 0x7f20ec14bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:57:13.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20ea59c640 1 --2- 172.21.15.96:0/4030292330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20ec06f5f0 0x7f20ec1f4a20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f20e000c490 tx=0x7f20e0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:13.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20daffd640 1 -- 172.21.15.96:0/4030292330 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0003600 con 0x7f20ec06f5f0 2024-04-18T04:57:13.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20daffd640 1 -- 172.21.15.96:0/4030292330 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e0003780 con 0x7f20ec06f5f0 2024-04-18T04:57:13.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20f0b9a640 1 -- 172.21.15.96:0/4030292330 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec0c5300 con 0x7f20ec06f5f0 2024-04-18T04:57:13.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20daffd640 1 -- 172.21.15.96:0/4030292330 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0003b70 con 0x7f20ec06f5f0 2024-04-18T04:57:13.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.531+0000 7f20f0b9a640 1 -- 172.21.15.96:0/4030292330 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec1f4f60 con 0x7f20ec06f5f0 2024-04-18T04:57:13.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.535+0000 7f20f0b9a640 1 -- 172.21.15.96:0/4030292330 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec067050 con 0x7f20ec06f5f0 2024-04-18T04:57:13.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.535+0000 7f20daffd640 1 -- 172.21.15.96:0/4030292330 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f20e0003cd0 con 0x7f20ec06f5f0 2024-04-18T04:57:13.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.535+0000 7f20daffd640 1 --2- 172.21.15.96:0/4030292330 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f20cc0666c0 0x7f20cc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:13.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.535+0000 7f20daffd640 1 -- 172.21.15.96:0/4030292330 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f20e0083450 con 0x7f20ec06f5f0 2024-04-18T04:57:13.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.535+0000 7f20e9d9b640 1 --2- 172.21.15.96:0/4030292330 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f20cc0666c0 0x7f20cc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:13.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.535+0000 7f20e9d9b640 1 --2- 172.21.15.96:0/4030292330 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f20cc0666c0 0x7f20cc068b80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0af000 tx=0x7f20dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:13.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.539+0000 7f20daffd640 1 -- 172.21.15.96:0/4030292330 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f20e0050710 con 0x7f20ec06f5f0 2024-04-18T04:57:13.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.787+0000 7f20f0b9a640 1 -- 172.21.15.96:0/4030292330 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f20ec0c2be0 con 0x7f20ec06f5f0 2024-04-18T04:57:13.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.787+0000 7f20daffd640 1 -- 172.21.15.96:0/4030292330 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f20e0053d30 con 0x7f20ec06f5f0 2024-04-18T04:57:13.790 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:57:13.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.791+0000 7f20f0b9a640 1 -- 172.21.15.96:0/4030292330 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f20cc0666c0 msgr2=0x7f20cc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:13.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.791+0000 7f20f0b9a640 1 --2- 172.21.15.96:0/4030292330 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f20cc0666c0 0x7f20cc068b80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0af000 tx=0x7f20dc008040 comp rx=0 tx=0).stop 2024-04-18T04:57:13.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.791+0000 7f20f0b9a640 1 -- 172.21.15.96:0/4030292330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20ec06f5f0 msgr2=0x7f20ec1f4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:13.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.791+0000 7f20f0b9a640 1 --2- 172.21.15.96:0/4030292330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20ec06f5f0 0x7f20ec1f4a20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f20e000c490 tx=0x7f20e0001e80 comp rx=0 tx=0).stop 2024-04-18T04:57:13.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.791+0000 7f20f0b9a640 1 -- 172.21.15.96:0/4030292330 shutdown_connections 2024-04-18T04:57:13.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.791+0000 7f20f0b9a640 1 --2- 172.21.15.96:0/4030292330 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f20cc0666c0 0x7f20cc068b80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.791+0000 7f20f0b9a640 1 --2- 172.21.15.96:0/4030292330 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20ec1530f0 0x7f20ec14bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.791+0000 7f20f0b9a640 1 --2- 172.21.15.96:0/4030292330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20ec070f70 0x7f20ec0cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.791+0000 7f20f0b9a640 1 --2- 172.21.15.96:0/4030292330 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20ec06f5f0 0x7f20ec1f4a20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.791+0000 7f20f0b9a640 1 -- 172.21.15.96:0/4030292330 >> 172.21.15.96:0/4030292330 conn(0x7f20ec06af70 msgr2=0x7f20ec071cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:13.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.791+0000 7f20f0b9a640 1 -- 172.21.15.96:0/4030292330 shutdown_connections 2024-04-18T04:57:13.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.791+0000 7f20f0b9a640 1 -- 172.21.15.96:0/4030292330 wait complete. 2024-04-18T04:57:13.810 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-18T04:57:13.810 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-18T04:57:13.810 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-18T04:57:13.810 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T04:57:13.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.931+0000 7fceb92ff640 1 Processor -- start 2024-04-18T04:57:13.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.931+0000 7fceb92ff640 1 -- start start 2024-04-18T04:57:13.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.931+0000 7fceb92ff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fceb4158cd0 0x7fceb40c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:13.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.931+0000 7fceb92ff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fceb41590f0 0x7fceb40ca270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:13.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.931+0000 7fceb92ff640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb41595f0 con 0x7fceb4153060 2024-04-18T04:57:13.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.931+0000 7fceb92ff640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb4153440 con 0x7fceb41590f0 2024-04-18T04:57:13.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.931+0000 7fceb92ff640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb41598d0 con 0x7fceb4158cd0 2024-04-18T04:57:13.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.931+0000 7fceb37fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fceb41590f0 0x7fceb40ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:13.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.931+0000 7fceb37fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fceb41590f0 0x7fceb40ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58690/0 (socket says 172.21.15.96:58690) 2024-04-18T04:57:13.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.931+0000 7fceb37fe640 1 -- 172.21.15.96:0/350655130 learned_addr learned my addr 172.21.15.96:0/350655130 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:13.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.931+0000 7fceaa7fc640 1 --2- 172.21.15.96:0/350655130 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fceb4158cd0 0x7fceb40c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:13.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.931+0000 7fceb37fe640 1 -- 172.21.15.96:0/350655130 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fceb4158cd0 msgr2=0x7fceb40c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:13.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.931+0000 7fceb37fe640 1 --2- 172.21.15.96:0/350655130 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fceb4158cd0 0x7fceb40c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.931+0000 7fceb37fe640 1 -- 172.21.15.96:0/350655130 >> v1:172.21.15.139:6789/0 conn(0x7fceb4153060 legacy=0x7fceb40c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:13.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.931+0000 7fceb37fe640 1 -- 172.21.15.96:0/350655130 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb4159bb0 con 0x7fceb41590f0 2024-04-18T04:57:13.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.935+0000 7fceb37fe640 1 --2- 172.21.15.96:0/350655130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb41590f0 0x7fceb40ca270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fceac009e50 tx=0x7fceac01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1b4739d3569c82 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:13.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.935+0000 7fceb27fc640 1 -- 172.21.15.96:0/350655130 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0af400 con 0x7fceb41590f0 2024-04-18T04:57:13.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.935+0000 7fceb27fc640 1 -- 172.21.15.96:0/350655130 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac0ab050 con 0x7fceb41590f0 2024-04-18T04:57:13.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.935+0000 7fceb27fc640 1 -- 172.21.15.96:0/350655130 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0af780 con 0x7fceb41590f0 2024-04-18T04:57:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.935+0000 7fceb92ff640 1 -- 172.21.15.96:0/350655130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb41590f0 msgr2=0x7fceb40ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.935+0000 7fceb92ff640 1 --2- 172.21.15.96:0/350655130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb41590f0 0x7fceb40ca270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fceac009e50 tx=0x7fceac01f210 comp rx=0 tx=0).stop 2024-04-18T04:57:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.935+0000 7fceb92ff640 1 -- 172.21.15.96:0/350655130 shutdown_connections 2024-04-18T04:57:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.935+0000 7fceb92ff640 1 --2- 172.21.15.96:0/350655130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb41590f0 0x7fceb40ca270 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.935+0000 7fceb92ff640 1 --2- 172.21.15.96:0/350655130 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fceb4158cd0 0x7fceb40c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.935+0000 7fceb92ff640 1 -- 172.21.15.96:0/350655130 >> 172.21.15.96:0/350655130 conn(0x7fceb406b470 msgr2=0x7fceb406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.935+0000 7fceb92ff640 1 -- 172.21.15.96:0/350655130 shutdown_connections 2024-04-18T04:57:13.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.935+0000 7fceb92ff640 1 -- 172.21.15.96:0/350655130 wait complete. 2024-04-18T04:57:13.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.935+0000 7fceb92ff640 1 Processor -- start 2024-04-18T04:57:13.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.935+0000 7fceb92ff640 1 -- start start 2024-04-18T04:57:13.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceb92ff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fceb4153060 0x7fceb40cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:13.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceb92ff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb4158cd0 0x7fceb40cd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:13.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceb92ff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fceb41590f0 0x7fceb413ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:13.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceb92ff640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40cb4d0 con 0x7fceb4158cd0 2024-04-18T04:57:13.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceb92ff640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40ca9e0 con 0x7fceb4153060 2024-04-18T04:57:13.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceb92ff640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40cce40 con 0x7fceb41590f0 2024-04-18T04:57:13.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceaa7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb4158cd0 0x7fceb40cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceaa7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb4158cd0 0x7fceb40cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58702/0 (socket says 172.21.15.96:58702) 2024-04-18T04:57:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceaa7fc640 1 -- 172.21.15.96:0/3709533060 learned_addr learned my addr 172.21.15.96:0/3709533060 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceb37fe640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fceb41590f0 0x7fceb413ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceb2ffd640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fceb4153060 0x7fceb40cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceaa7fc640 1 -- 172.21.15.96:0/3709533060 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fceb41590f0 msgr2=0x7fceb413ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceaa7fc640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fceb41590f0 0x7fceb413ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceaa7fc640 1 -- 172.21.15.96:0/3709533060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fceb4153060 msgr2=0x7fceb40cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceaa7fc640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fceb4153060 0x7fceb40cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceaa7fc640 1 -- 172.21.15.96:0/3709533060 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac009b30 con 0x7fceb4158cd0 2024-04-18T04:57:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceb37fe640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fceb41590f0 0x7fceb413ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:57:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceaa7fc640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb4158cd0 0x7fceb40cd810 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00d830 tx=0x7fce9c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceabfff640 1 -- 172.21.15.96:0/3709533060 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c00b6c0 con 0x7fceb4158cd0 2024-04-18T04:57:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceabfff640 1 -- 172.21.15.96:0/3709533060 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c00b820 con 0x7fceb4158cd0 2024-04-18T04:57:13.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceb92ff640 1 -- 172.21.15.96:0/3709533060 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb415cf00 con 0x7fceb4158cd0 2024-04-18T04:57:13.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceabfff640 1 -- 172.21.15.96:0/3709533060 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c00bb90 con 0x7fceb4158cd0 2024-04-18T04:57:13.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceb92ff640 1 -- 172.21.15.96:0/3709533060 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb40caf10 con 0x7fceb4158cd0 2024-04-18T04:57:13.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceb92ff640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb40c9870 0x7fceb40cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:13.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceb92ff640 1 -- 172.21.15.96:0/3709533060 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb4072290 con 0x7fceb40c9870 2024-04-18T04:57:13.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceb2ffd640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb40c9870 0x7fceb40cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:13.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceb2ffd640 1 -- 172.21.15.96:0/3709533060 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fceb40c3f60 con 0x7fceb40c9870 2024-04-18T04:57:13.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceabfff640 1 -- 172.21.15.96:0/3709533060 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fce9c01e460 con 0x7fceb4158cd0 2024-04-18T04:57:13.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceb2ffd640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb40c9870 0x7fceb40cc780 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcea400e400 tx=0x7fcea400e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:13.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.939+0000 7fceabfff640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fce940666c0 0x7fce94068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:13.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.943+0000 7fceb37fe640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fce940666c0 0x7fce94068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:13.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.943+0000 7fceabfff640 1 -- 172.21.15.96:0/3709533060 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fce9c084910 con 0x7fceb4158cd0 2024-04-18T04:57:13.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.943+0000 7fceabfff640 1 -- 172.21.15.96:0/3709533060 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40052e0 con 0x7fceb40c9870 2024-04-18T04:57:13.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.943+0000 7fceabfff640 1 -- 172.21.15.96:0/3709533060 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fcea4005440 con 0x7fceb40c9870 2024-04-18T04:57:13.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.943+0000 7fceabfff640 1 -- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb40c9870 msgr2=0x7fceb40cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:13.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.943+0000 7fceabfff640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb40c9870 0x7fceb40cc780 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcea400e400 tx=0x7fcea400e8c0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.943+0000 7fceabfff640 1 -- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb40c9870 msgr2=0x7fceb40cc780 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:13.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.943+0000 7fceabfff640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb40c9870 0x7fceb40cc780 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcea400e400 tx=0x7fcea400e8c0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.943+0000 7fceb37fe640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fce940666c0 0x7fce94068b80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fceac0b1000 tx=0x7fceac0aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:13.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.947+0000 7fceb92ff640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb40cddd0 0x7fceb413f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:13.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.947+0000 7fceb92ff640 1 -- 172.21.15.96:0/3709533060 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40c3c80 con 0x7fceb40cddd0 2024-04-18T04:57:13.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.947+0000 7fceb2ffd640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb40cddd0 0x7fceb413f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:13.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.947+0000 7fceb2ffd640 1 -- 172.21.15.96:0/3709533060 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fceb40c4480 con 0x7fceb40cddd0 2024-04-18T04:57:13.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.947+0000 7fceb2ffd640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb40cddd0 0x7fceb413f320 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcea400e400 tx=0x7fcea4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:13.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.947+0000 7fceabfff640 1 -- 172.21.15.96:0/3709533060 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40146a0 con 0x7fceb40cddd0 2024-04-18T04:57:13.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.951+0000 7fceabfff640 1 -- 172.21.15.96:0/3709533060 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4468 (secure 0 0 0) 0x7fcea4014800 con 0x7fceb40cddd0 2024-04-18T04:57:13.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.951+0000 7fceabfff640 1 -- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb40cddd0 msgr2=0x7fceb413f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:13.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.951+0000 7fceabfff640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb40cddd0 0x7fceb413f320 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcea400e400 tx=0x7fcea4000ee0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.951+0000 7fceabfff640 1 -- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb40cddd0 msgr2=0x7fceb413f320 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:13.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.951+0000 7fceabfff640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb40cddd0 0x7fceb413f320 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.953 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:57:13.953 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:57:13.953 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:57:13.953 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T04:57:13.953 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 26, 2024-04-18T04:57:13.953 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:57:13.953 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:57:13.953 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:57:13.953 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:57:13.954 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:13.954 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 13, 2024-04-18T04:57:13.954 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:13.954 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:57:13.954 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:57:13.954 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:13.954 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:13.954 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:13.954 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:13.954 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:13.954 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:13.954 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:13.954 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:13.955 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:13.955 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:13.955 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:13.955 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:57:13.955 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:57:13.955 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:13.955 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:13.955 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:13.955 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:13.955 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:13.955 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:13.955 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:13.955 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:13.955 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:13.955 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:13.956 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:13.956 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:13.956 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:57:13.956 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:57:13.956 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:57:13.956 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:57:13.956 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:57:13.956 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:57:13.956 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:13.956 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:13.956 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:57:13.956 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:57:13.956 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:57:13.956 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:57:13.956 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:57:13.957 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:57:13.957 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:57:13.957 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:13.957 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:57:13.957 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:13.957 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:13.957 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:13.957 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:13.957 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:13.957 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:13.957 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:13.957 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:13.957 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:13.957 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:13.957 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:13.958 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:57:13.958 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:13.958 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:57:13.958 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:13.958 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:57:13.958 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:57:13.958 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:13.958 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:13.958 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:13.958 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:13.958 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:57:13.958 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:13.958 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:13.958 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:13.959 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:13.959 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:57:13.959 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:13.959 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:13.959 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:13.959 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:13.959 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:57:13.959 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:57:13.959 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:13.959 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:13.959 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:13.959 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:13.959 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:13.959 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:57:13.959 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:57:13.960 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:13.960 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:13.960 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:13.960 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:13.960 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:57:13.960 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:13.960 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:13.960 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:13.960 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:13.960 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:57:13.960 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:13.960 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:13.960 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:13.960 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:13.960 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:57:13.961 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:57:13.961 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:13.961 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:13.961 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:13.961 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:13.961 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:13.961 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:57:13.961 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:57:13.961 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:13.961 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:13.961 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:13.961 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:13.961 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:57:13.961 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:13.961 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:13.962 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:13.962 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:13.962 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:57:13.962 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:13.962 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:13.962 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:13.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:13.962 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:57:13.962 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:57:13.962 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:13.962 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:13.962 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:13.962 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:13.962 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:13.963 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:13.963 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:57:13.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:57:13.963 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:13.963 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:13.963 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:13.963 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:57:13.963 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:13.963 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:13.963 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:57:13.963 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:13.963 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:13.963 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:13.963 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:57:13.963 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:13.963 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:13.964 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:13.964 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:57:13.964 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:57:13.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.951+0000 7fceb92ff640 1 -- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fce940666c0 msgr2=0x7fce94068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:13.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.951+0000 7fceb92ff640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fce940666c0 0x7fce94068b80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fceac0b1000 tx=0x7fceac0aa000 comp rx=0 tx=0).stop 2024-04-18T04:57:13.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.951+0000 7fceb92ff640 1 -- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb4158cd0 msgr2=0x7fceb40cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:13.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.951+0000 7fceb92ff640 1 --2- 172.21.15.96:0/3709533060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceb4158cd0 0x7fceb40cd810 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00d830 tx=0x7fce9c00dcf0 comp rx=0 tx=0).stop 2024-04-18T04:57:13.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.951+0000 7fceb37fe640 1 -- 172.21.15.96:0/3709533060 reap_dead start 2024-04-18T04:57:13.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.951+0000 7fceb37fe640 1 -- 172.21.15.96:0/3709533060 reap_dead start 2024-04-18T04:57:13.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.951+0000 7fceb92ff640 1 -- 172.21.15.96:0/3709533060 shutdown_connections 2024-04-18T04:57:13.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.951+0000 7fceb92ff640 1 -- 172.21.15.96:0/3709533060 >> 172.21.15.96:0/3709533060 conn(0x7fceb406b470 msgr2=0x7fceb4151e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:13.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.951+0000 7fceb92ff640 1 -- 172.21.15.96:0/3709533060 shutdown_connections 2024-04-18T04:57:13.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:13.951+0000 7fceb92ff640 1 -- 172.21.15.96:0/3709533060 wait complete. 2024-04-18T04:57:13.970 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:57:13.970 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-18T04:57:13.970 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-18T04:57:14.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.091+0000 7f5024ae4640 1 Processor -- start 2024-04-18T04:57:14.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.091+0000 7f5024ae4640 1 -- start start 2024-04-18T04:57:14.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f5024ae4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5020157130 0x7f5020070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f5024ae4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5020157510 0x7f502006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f5024ae4640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5020069e60 0x7f502006a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f5024ae4640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5020071aa0 con 0x7f5020157130 2024-04-18T04:57:14.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f5024ae4640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502015d150 con 0x7f5020069e60 2024-04-18T04:57:14.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f5024ae4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50201578f0 con 0x7f5020157510 2024-04-18T04:57:14.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f501e59c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5020157130 0x7f5020070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f501e59c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5020157130 0x7f5020070f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58742/0 (socket says 172.21.15.96:58742) 2024-04-18T04:57:14.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f501e59c640 1 -- 172.21.15.96:0/3891499562 learned_addr learned my addr 172.21.15.96:0/3891499562 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:14.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f501ed9d640 1 --2- 172.21.15.96:0/3891499562 >> v2:172.21.15.139:3300/0 conn(0x7f5020069e60 0x7f502006a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f501dd9b640 1 --2- 172.21.15.96:0/3891499562 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5020157510 0x7f502006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f501e59c640 1 -- 172.21.15.96:0/3891499562 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5020157510 msgr2=0x7f502006f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:14.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f501e59c640 1 --2- 172.21.15.96:0/3891499562 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5020157510 0x7f502006f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f501e59c640 1 -- 172.21.15.96:0/3891499562 >> v2:172.21.15.139:3300/0 conn(0x7f5020069e60 msgr2=0x7f502006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:14.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f501e59c640 1 --2- 172.21.15.96:0/3891499562 >> v2:172.21.15.139:3300/0 conn(0x7f5020069e60 0x7f502006a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f501e59c640 1 -- 172.21.15.96:0/3891499562 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502015dc90 con 0x7f5020157130 2024-04-18T04:57:14.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f501e59c640 1 --2- 172.21.15.96:0/3891499562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5020157130 0x7f5020070f50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f50200c51d0 tx=0x7f501801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3d621d7ef3d198 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:14.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f501d59a640 1 -- 172.21.15.96:0/3891499562 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180af400 con 0x7f5020157130 2024-04-18T04:57:14.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f501d59a640 1 -- 172.21.15.96:0/3891499562 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50180ab050 con 0x7f5020157130 2024-04-18T04:57:14.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f501d59a640 1 -- 172.21.15.96:0/3891499562 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180af780 con 0x7f5020157130 2024-04-18T04:57:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f5024ae4640 1 -- 172.21.15.96:0/3891499562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5020157130 msgr2=0x7f5020070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f5024ae4640 1 --2- 172.21.15.96:0/3891499562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5020157130 0x7f5020070f50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f50200c51d0 tx=0x7f501801f1e0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f5024ae4640 1 -- 172.21.15.96:0/3891499562 shutdown_connections 2024-04-18T04:57:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f5024ae4640 1 --2- 172.21.15.96:0/3891499562 >> v2:172.21.15.139:3300/0 conn(0x7f5020069e60 0x7f502006a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f5024ae4640 1 --2- 172.21.15.96:0/3891499562 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5020157510 0x7f502006f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f5024ae4640 1 --2- 172.21.15.96:0/3891499562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5020157130 0x7f5020070f50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f5024ae4640 1 -- 172.21.15.96:0/3891499562 >> 172.21.15.96:0/3891499562 conn(0x7f502006d2a0 msgr2=0x7f502006afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f5024ae4640 1 -- 172.21.15.96:0/3891499562 shutdown_connections 2024-04-18T04:57:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.095+0000 7f5024ae4640 1 -- 172.21.15.96:0/3891499562 wait complete. 2024-04-18T04:57:14.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f5024ae4640 1 Processor -- start 2024-04-18T04:57:14.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f5024ae4640 1 -- start start 2024-04-18T04:57:14.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f5024ae4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5020069e60 0x7f50201515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f5024ae4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5020157130 0x7f50201608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f5024ae4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5020157510 0x7f502014ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f5024ae4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5020151110 con 0x7f5020069e60 2024-04-18T04:57:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f5024ae4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502014ffa0 con 0x7f5020157130 2024-04-18T04:57:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f5024ae4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5020151ae0 con 0x7f5020157510 2024-04-18T04:57:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f501e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5020069e60 0x7f50201515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f501e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5020069e60 0x7f50201515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58748/0 (socket says 172.21.15.96:58748) 2024-04-18T04:57:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f501e59c640 1 -- 172.21.15.96:0/1741152815 learned_addr learned my addr 172.21.15.96:0/1741152815 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f501dd9b640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5020157130 0x7f50201608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f501ed9d640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5020157510 0x7f502014ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f501e59c640 1 -- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5020157510 msgr2=0x7f502014ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f501e59c640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5020157510 0x7f502014ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f501e59c640 1 -- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5020157130 msgr2=0x7f50201608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f501e59c640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5020157130 0x7f50201608c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f501e59c640 1 -- 172.21.15.96:0/1741152815 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5018009b30 con 0x7f5020069e60 2024-04-18T04:57:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f501ed9d640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5020157510 0x7f502014ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:57:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f501e59c640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5020069e60 0x7f50201515a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f501801fa80 tx=0x7f501801bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f5016ffd640 1 -- 172.21.15.96:0/1741152815 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180afe60 con 0x7f5020069e60 2024-04-18T04:57:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f5016ffd640 1 -- 172.21.15.96:0/1741152815 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5018009510 con 0x7f5020069e60 2024-04-18T04:57:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f5016ffd640 1 -- 172.21.15.96:0/1741152815 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180ba640 con 0x7f5020069e60 2024-04-18T04:57:14.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f5024ae4640 1 -- 172.21.15.96:0/1741152815 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5020150220 con 0x7f5020069e60 2024-04-18T04:57:14.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.099+0000 7f5024ae4640 1 -- 172.21.15.96:0/1741152815 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50201507e0 con 0x7f5020069e60 2024-04-18T04:57:14.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.103+0000 7f5024ae4640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50201529e0 0x7f50201509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.103+0000 7f5024ae4640 1 -- 172.21.15.96:0/1741152815 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5020066b20 con 0x7f50201529e0 2024-04-18T04:57:14.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.103+0000 7f501dd9b640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50201529e0 0x7f50201509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.103+0000 7f501dd9b640 1 -- 172.21.15.96:0/1741152815 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f502015d360 con 0x7f50201529e0 2024-04-18T04:57:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.103+0000 7f5016ffd640 1 -- 172.21.15.96:0/1741152815 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50180b6040 con 0x7f5020069e60 2024-04-18T04:57:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.103+0000 7f501dd9b640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50201529e0 0x7f50201509d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f502014f4f0 tx=0x7f501000fc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.103+0000 7f5016ffd640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5000066690 0x7f5000068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.103+0000 7f5016ffd640 1 -- 172.21.15.96:0/1741152815 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5018122380 con 0x7f5020069e60 2024-04-18T04:57:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.103+0000 7f501ed9d640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5000066690 0x7f5000068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.103+0000 7f5016ffd640 1 -- 172.21.15.96:0/1741152815 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010004220 con 0x7f50201529e0 2024-04-18T04:57:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.103+0000 7f501ed9d640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5000066690 0x7f5000068b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f500800b970 tx=0x7f5008008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.103+0000 7f5016ffd640 1 -- 172.21.15.96:0/1741152815 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f501000c040 con 0x7f50201529e0 2024-04-18T04:57:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.103+0000 7f5016ffd640 1 -- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50201529e0 msgr2=0x7f50201509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.103+0000 7f5016ffd640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50201529e0 0x7f50201509d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f502014f4f0 tx=0x7f501000fc70 comp rx=0 tx=0).stop 2024-04-18T04:57:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.103+0000 7f5016ffd640 1 -- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50201529e0 msgr2=0x7f50201509d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:14.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.103+0000 7f5016ffd640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50201529e0 0x7f50201509d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f5024ae4640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5020158e00 0x7f502014bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f5024ae4640 1 -- 172.21.15.96:0/1741152815 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5020071540 con 0x7f5020158e00 2024-04-18T04:57:14.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f501dd9b640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5020158e00 0x7f502014bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f501dd9b640 1 -- 172.21.15.96:0/1741152815 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f502015d640 con 0x7f5020158e00 2024-04-18T04:57:14.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f501dd9b640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5020158e00 0x7f502014bf50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f501000afd0 tx=0x7f50100046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:14.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f5016ffd640 1 -- 172.21.15.96:0/1741152815 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010022070 con 0x7f5020158e00 2024-04-18T04:57:14.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f5016ffd640 1 -- 172.21.15.96:0/1741152815 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7f5010003830 con 0x7f5020158e00 2024-04-18T04:57:14.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f5016ffd640 1 -- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5020158e00 msgr2=0x7f502014bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f5016ffd640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5020158e00 0x7f502014bf50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f501000afd0 tx=0x7f50100046d0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f5016ffd640 1 -- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5020158e00 msgr2=0x7f502014bf50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:14.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f5016ffd640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5020158e00 0x7f502014bf50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.116 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:57:14.116 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:57:14.116 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:57:14.116 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:57:14.116 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 26, 2024-04-18T04:57:14.116 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:57:14.116 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:57:14.116 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:57:14.116 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:57:14.117 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:14.117 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 14, 2024-04-18T04:57:14.117 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:14.117 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:57:14.117 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:57:14.117 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:14.117 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:14.117 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:14.117 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:14.117 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:14.117 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:14.117 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:14.117 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:14.118 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:14.118 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:14.118 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:14.118 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:57:14.118 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:57:14.118 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:14.118 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:14.118 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:14.118 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:14.118 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:14.118 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:14.119 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:14.119 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:14.119 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:14.119 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:14.119 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:14.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.119 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:57:14.119 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:57:14.119 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:57:14.119 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:57:14.120 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:57:14.120 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:57:14.120 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:14.120 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:14.120 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:57:14.120 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:57:14.120 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:57:14.120 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:57:14.120 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:57:14.120 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:57:14.121 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:57:14.121 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:14.121 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:57:14.121 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:14.121 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:14.121 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:14.121 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:14.121 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:14.121 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:14.121 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:14.121 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:14.121 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:14.121 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:14.122 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:14.122 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:57:14.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.122 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:57:14.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.122 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:57:14.122 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:57:14.122 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:14.122 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:14.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.123 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:14.123 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:57:14.123 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:14.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.123 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:14.123 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:57:14.123 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:14.123 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.123 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:14.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.123 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:57:14.124 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:57:14.124 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:14.124 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:14.124 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:14.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.124 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:57:14.124 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:57:14.124 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:14.124 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:14.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.125 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:14.125 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:57:14.125 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:14.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.125 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:14.125 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:57:14.125 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:14.125 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.125 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:14.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.126 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:57:14.126 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:57:14.126 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:14.126 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:14.126 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:14.126 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.126 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.126 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:57:14.126 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:57:14.126 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:14.126 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:14.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.127 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:14.127 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:57:14.127 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:14.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.127 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:14.127 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:57:14.127 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:14.127 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.127 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:14.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.127 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:57:14.128 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:57:14.128 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:14.128 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:14.128 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:14.128 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.128 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:14.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.128 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:57:14.128 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:57:14.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.128 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:14.128 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:14.128 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:57:14.129 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.129 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:14.129 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:57:14.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.129 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:14.129 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:14.129 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:57:14.129 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.129 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:14.129 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:57:14.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.129 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:14.130 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:14.130 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:57:14.130 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.130 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:14.130 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:57:14.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.130 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:14.130 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:14.130 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5 2024-04-18T04:57:14.130 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.130 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:14.131 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:57:14.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.131 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:14.131 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:14.131 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:57:14.131 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.131 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:14.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.131 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:57:14.131 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:57:14.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f5024ae4640 1 -- 172.21.15.96:0/1741152815 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5000066690 msgr2=0x7f5000068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f5024ae4640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5000066690 0x7f5000068b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f500800b970 tx=0x7f5008008040 comp rx=0 tx=0).stop 2024-04-18T04:57:14.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f5024ae4640 1 -- 172.21.15.96:0/1741152815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5020069e60 msgr2=0x7f50201515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f5024ae4640 1 --2- 172.21.15.96:0/1741152815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5020069e60 0x7f50201515a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f501801fa80 tx=0x7f501801bf80 comp rx=0 tx=0).stop 2024-04-18T04:57:14.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f501ed9d640 1 -- 172.21.15.96:0/1741152815 reap_dead start 2024-04-18T04:57:14.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f501ed9d640 1 -- 172.21.15.96:0/1741152815 reap_dead start 2024-04-18T04:57:14.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f5024ae4640 1 -- 172.21.15.96:0/1741152815 shutdown_connections 2024-04-18T04:57:14.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f5024ae4640 1 -- 172.21.15.96:0/1741152815 >> 172.21.15.96:0/1741152815 conn(0x7f502006d2a0 msgr2=0x7f5020156910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:14.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f5024ae4640 1 -- 172.21.15.96:0/1741152815 shutdown_connections 2024-04-18T04:57:14.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.111+0000 7f5024ae4640 1 -- 172.21.15.96:0/1741152815 wait complete. 2024-04-18T04:57:14.134 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:57:14.134 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-18T04:57:14.134 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-18T04:57:14.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.251+0000 7ff588676640 1 Processor -- start 2024-04-18T04:57:14.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.251+0000 7ff588676640 1 -- start start 2024-04-18T04:57:14.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.255+0000 7ff588676640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff580150cb0 0x7ff5800c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.255+0000 7ff588676640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff580070e80 0x7ff58006ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.255+0000 7ff588676640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5800c7d60 con 0x7ff580151090 2024-04-18T04:57:14.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.255+0000 7ff588676640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5800c7330 con 0x7ff580150cb0 2024-04-18T04:57:14.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.255+0000 7ff588676640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5800c65c0 con 0x7ff580070e80 2024-04-18T04:57:14.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.255+0000 7ff585c11640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff580070e80 0x7ff58006ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.255+0000 7ff586412640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff580150cb0 0x7ff5800c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.255+0000 7ff586412640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff580150cb0 0x7ff5800c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:41970/0 (socket says 172.21.15.96:41970) 2024-04-18T04:57:14.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.255+0000 7ff586412640 1 -- 172.21.15.96:0/331904487 learned_addr learned my addr 172.21.15.96:0/331904487 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:14.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.255+0000 7ff586412640 1 -- 172.21.15.96:0/331904487 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff580070e80 msgr2=0x7ff58006ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:14.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.255+0000 7ff586412640 1 --2- 172.21.15.96:0/331904487 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff580070e80 0x7ff58006ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.255+0000 7ff586412640 1 -- 172.21.15.96:0/331904487 >> v1:172.21.15.139:6789/0 conn(0x7ff580151090 legacy=0x7ff580156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.255+0000 7ff586412640 1 -- 172.21.15.96:0/331904487 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5800c6350 con 0x7ff580150cb0 2024-04-18T04:57:14.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.255+0000 7ff586412640 1 --2- 172.21.15.96:0/331904487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff580150cb0 0x7ff5800c5e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009870 tx=0x7ff57c01ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ce3406b03a9bbfd server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:14.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff585410640 1 -- 172.21.15.96:0/331904487 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0a8a50 con 0x7ff580150cb0 2024-04-18T04:57:14.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff585410640 1 -- 172.21.15.96:0/331904487 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c0a8bb0 con 0x7ff580150cb0 2024-04-18T04:57:14.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff585410640 1 -- 172.21.15.96:0/331904487 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0b0440 con 0x7ff580150cb0 2024-04-18T04:57:14.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff588676640 1 -- 172.21.15.96:0/331904487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff580150cb0 msgr2=0x7ff5800c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff588676640 1 --2- 172.21.15.96:0/331904487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff580150cb0 0x7ff5800c5e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009870 tx=0x7ff57c01ed50 comp rx=0 tx=0).stop 2024-04-18T04:57:14.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff588676640 1 -- 172.21.15.96:0/331904487 shutdown_connections 2024-04-18T04:57:14.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff588676640 1 --2- 172.21.15.96:0/331904487 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff580070e80 0x7ff58006ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff588676640 1 --2- 172.21.15.96:0/331904487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff580150cb0 0x7ff5800c5e10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff588676640 1 -- 172.21.15.96:0/331904487 >> 172.21.15.96:0/331904487 conn(0x7ff58006b140 msgr2=0x7ff58006b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:14.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff588676640 1 -- 172.21.15.96:0/331904487 shutdown_connections 2024-04-18T04:57:14.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff588676640 1 -- 172.21.15.96:0/331904487 wait complete. 2024-04-18T04:57:14.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff588676640 1 Processor -- start 2024-04-18T04:57:14.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff588676640 1 -- start start 2024-04-18T04:57:14.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff588676640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff580070e80 0x7ff5801e4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff588676640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff580150cb0 0x7ff580153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff588676640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff580151090 0x7ff580153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff588676640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58014cf30 con 0x7ff580151090 2024-04-18T04:57:14.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff588676640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5801469a0 con 0x7ff580070e80 2024-04-18T04:57:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff588676640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5801ef690 con 0x7ff580150cb0 2024-04-18T04:57:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff586c13640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff580151090 0x7ff580153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff586c13640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff580151090 0x7ff580153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58750/0 (socket says 172.21.15.96:58750) 2024-04-18T04:57:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff586c13640 1 -- 172.21.15.96:0/604643348 learned_addr learned my addr 172.21.15.96:0/604643348 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff586412640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff580070e80 0x7ff5801e4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff585c11640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff580150cb0 0x7ff580153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff586c13640 1 -- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff580150cb0 msgr2=0x7ff580153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff586c13640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff580150cb0 0x7ff580153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff586c13640 1 -- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff580070e80 msgr2=0x7ff5801e4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff586c13640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff580070e80 0x7ff5801e4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff586c13640 1 -- 172.21.15.96:0/604643348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c0094d0 con 0x7ff580151090 2024-04-18T04:57:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff585c11640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff580150cb0 0x7ff580153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:57:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.259+0000 7ff586c13640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff580151090 0x7ff580153680 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff57800c760 tx=0x7ff57800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:14.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff576ffd640 1 -- 172.21.15.96:0/604643348 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff578003b80 con 0x7ff580151090 2024-04-18T04:57:14.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff576ffd640 1 -- 172.21.15.96:0/604643348 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff578003ce0 con 0x7ff580151090 2024-04-18T04:57:14.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff588676640 1 -- 172.21.15.96:0/604643348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58014b440 con 0x7ff580151090 2024-04-18T04:57:14.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff576ffd640 1 -- 172.21.15.96:0/604643348 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57800aa30 con 0x7ff580151090 2024-04-18T04:57:14.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff588676640 1 -- 172.21.15.96:0/604643348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5801e5a50 con 0x7ff580151090 2024-04-18T04:57:14.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff588676640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff568002a40 0x7ff568004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff588676640 1 -- 172.21.15.96:0/604643348 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff568007e90 con 0x7ff568002a40 2024-04-18T04:57:14.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff586412640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff568002a40 0x7ff568004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff576ffd640 1 -- 172.21.15.96:0/604643348 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff57800ab90 con 0x7ff580151090 2024-04-18T04:57:14.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff586412640 1 -- 172.21.15.96:0/604643348 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff568008050 con 0x7ff568002a40 2024-04-18T04:57:14.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff576ffd640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff564066690 0x7ff564068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff585c11640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff564066690 0x7ff564068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff576ffd640 1 -- 172.21.15.96:0/604643348 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff578083d90 con 0x7ff580151090 2024-04-18T04:57:14.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff586412640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff568002a40 0x7ff568004f00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff580154790 tx=0x7ff57c01d590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:14.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff576ffd640 1 -- 172.21.15.96:0/604643348 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0b0e20 con 0x7ff568002a40 2024-04-18T04:57:14.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff585c11640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff564066690 0x7ff564068b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff58006f8f0 tx=0x7ff570008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:14.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff576ffd640 1 -- 172.21.15.96:0/604643348 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7ff57c0bb420 con 0x7ff568002a40 2024-04-18T04:57:14.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff576ffd640 1 -- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff568002a40 msgr2=0x7ff568004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff576ffd640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff568002a40 0x7ff568004f00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff580154790 tx=0x7ff57c01d590 comp rx=0 tx=0).stop 2024-04-18T04:57:14.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff576ffd640 1 -- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff568002a40 msgr2=0x7ff568004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:14.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.263+0000 7ff576ffd640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff568002a40 0x7ff568004f00 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff580154790 tx=0x7ff57c01d590 comp rx=0 tx=0).stop 2024-04-18T04:57:14.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.271+0000 7ff588676640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff568006df0 0x7ff568007260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.271+0000 7ff588676640 1 -- 172.21.15.96:0/604643348 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff568007850 con 0x7ff568006df0 2024-04-18T04:57:14.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.271+0000 7ff586412640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff568006df0 0x7ff568007260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.271+0000 7ff586412640 1 -- 172.21.15.96:0/604643348 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff568007a10 con 0x7ff568006df0 2024-04-18T04:57:14.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.271+0000 7ff586412640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff568006df0 0x7ff568007260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff57c01c980 tx=0x7ff57c01baf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:14.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.275+0000 7ff576ffd640 1 -- 172.21.15.96:0/604643348 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0c8070 con 0x7ff568006df0 2024-04-18T04:57:14.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.275+0000 7ff576ffd640 1 -- 172.21.15.96:0/604643348 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7ff57c0bb590 con 0x7ff568006df0 2024-04-18T04:57:14.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.275+0000 7ff576ffd640 1 -- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff568006df0 msgr2=0x7ff568007260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.275+0000 7ff576ffd640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff568006df0 0x7ff568007260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff57c01c980 tx=0x7ff57c01baf0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.275+0000 7ff576ffd640 1 -- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff568006df0 msgr2=0x7ff568007260 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:14.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.275+0000 7ff576ffd640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff568006df0 0x7ff568007260 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.277 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:57:14.277 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:57:14.278 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:57:14.278 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:57:14.278 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 26, 2024-04-18T04:57:14.278 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:57:14.278 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:57:14.278 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:57:14.278 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:57:14.278 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:14.278 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 14, 2024-04-18T04:57:14.278 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:14.278 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:57:14.278 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:57:14.278 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:14.278 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:14.279 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:14.279 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:14.279 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:14.279 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:14.279 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:14.279 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:14.279 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:14.279 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:14.279 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:14.279 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:57:14.279 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:57:14.279 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:14.279 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:14.279 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:14.280 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:14.280 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:14.280 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:14.280 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:14.280 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:14.280 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:14.280 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:14.280 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:14.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.280 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:57:14.280 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:57:14.280 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:57:14.280 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:57:14.280 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:57:14.280 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:57:14.280 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:14.281 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:14.282 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:14.282 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:14.282 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:14.282 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:14.282 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:57:14.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.282 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:57:14.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.282 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:57:14.282 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:57:14.282 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:14.282 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:14.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.282 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:14.283 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:57:14.283 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:14.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.283 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.283 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:14.283 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:57:14.283 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:14.283 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.283 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:14.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.283 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:57:14.283 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:57:14.283 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:14.283 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:14.283 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:14.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.284 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:57:14.284 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:57:14.284 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:14.284 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:14.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.284 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:14.284 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:57:14.284 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:14.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.284 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:14.284 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:57:14.285 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:14.285 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.285 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:14.285 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.285 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:57:14.285 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:57:14.285 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:14.285 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:14.285 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:14.285 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.285 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.285 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:57:14.285 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:57:14.285 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:14.286 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:14.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.286 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:14.286 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:57:14.286 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:14.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.286 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:14.286 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:57:14.286 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:14.286 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.286 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:14.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.286 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:57:14.287 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:57:14.287 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:14.287 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:14.287 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:14.287 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.287 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:14.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.287 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:57:14.287 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:57:14.287 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.287 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:14.287 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:14.287 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:57:14.287 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.288 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:14.288 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:57:14.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.288 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:14.288 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:14.288 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:57:14.288 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.288 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:14.288 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:57:14.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.288 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:14.288 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:14.288 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:57:14.288 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.288 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:14.289 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:57:14.289 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.289 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:14.289 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:14.289 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:57:14.289 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.289 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:14.289 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:57:14.289 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:14.289 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:14.289 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:14.289 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:57:14.289 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:14.289 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:14.289 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:14.290 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:57:14.290 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:57:14.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.275+0000 7ff588676640 1 -- 172.21.15.96:0/604643348 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff564066690 msgr2=0x7ff564068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.275+0000 7ff588676640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff564066690 0x7ff564068b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff58006f8f0 tx=0x7ff570008040 comp rx=0 tx=0).stop 2024-04-18T04:57:14.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.275+0000 7ff588676640 1 -- 172.21.15.96:0/604643348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff580151090 msgr2=0x7ff580153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.275+0000 7ff588676640 1 --2- 172.21.15.96:0/604643348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff580151090 0x7ff580153680 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff57800c760 tx=0x7ff57800cc20 comp rx=0 tx=0).stop 2024-04-18T04:57:14.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.275+0000 7ff586c13640 1 -- 172.21.15.96:0/604643348 reap_dead start 2024-04-18T04:57:14.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.275+0000 7ff586c13640 1 -- 172.21.15.96:0/604643348 reap_dead start 2024-04-18T04:57:14.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.275+0000 7ff588676640 1 -- 172.21.15.96:0/604643348 shutdown_connections 2024-04-18T04:57:14.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.275+0000 7ff588676640 1 -- 172.21.15.96:0/604643348 >> 172.21.15.96:0/604643348 conn(0x7ff58006b140 msgr2=0x7ff58014db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:14.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.275+0000 7ff588676640 1 -- 172.21.15.96:0/604643348 shutdown_connections 2024-04-18T04:57:14.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.275+0000 7ff588676640 1 -- 172.21.15.96:0/604643348 wait complete. 2024-04-18T04:57:14.294 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:57:14.294 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-04-18T04:57:14.294 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-18T04:57:14.295 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-04-18T04:57:14.295 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-18T04:57:14.295 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-18T04:57:14.295 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:57:14.319 INFO:tasks.ceph.mon.b:Stopped 2024-04-18T04:57:14.319 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-18T04:57:14.319 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:57:14.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.431+0000 7f5f12ed1640 1 Processor -- start 2024-04-18T04:57:14.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.431+0000 7f5f12ed1640 1 -- start start 2024-04-18T04:57:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.431+0000 7f5f12ed1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5f0c150dd0 0x7f5f0c156db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.431+0000 7f5f12ed1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0c1511b0 con 0x7f5f0c1572f0 2024-04-18T04:57:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.431+0000 7f5f12ed1640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0c157760 con 0x7f5f0c0cbd30 2024-04-18T04:57:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.431+0000 7f5f12ed1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c0c9ac0 con 0x7f5f0c150dd0 2024-04-18T04:57:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.431+0000 7f5f0bfff640 1 -- >> v1:172.21.15.139:6789/0 conn(0x7f5f0c0cbd30 legacy=0x7f5f0c06e960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:57:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.431+0000 7f5f1146e640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5f0c1572f0 0x7f5f0c06f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:58890/0 (socket says 172.21.15.96:58890) 2024-04-18T04:57:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.431+0000 7f5f1146e640 1 -- 172.21.15.96:0/546669684 learned_addr learned my addr 172.21.15.96:0/546669684 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:57:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.431+0000 7f5f10c6d640 1 --2- 172.21.15.96:0/546669684 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5f0c150dd0 0x7f5f0c156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.431+0000 7f5f0b7fe640 1 -- 172.21.15.96:0/546669684 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413994138 0 0) 0x7f5f0c1511b0 con 0x7f5f0c1572f0 2024-04-18T04:57:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.431+0000 7f5f0b7fe640 1 -- 172.21.15.96:0/546669684 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5efc003530 con 0x7f5f0c1572f0 2024-04-18T04:57:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0b7fe640 1 -- 172.21.15.96:0/546669684 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2063820275 0 0) 0x7f5efc003530 con 0x7f5f0c1572f0 2024-04-18T04:57:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0b7fe640 1 -- 172.21.15.96:0/546669684 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5f0c150dd0 msgr2=0x7f5f0c156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:14.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0b7fe640 1 --2- 172.21.15.96:0/546669684 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5f0c150dd0 0x7f5f0c156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0b7fe640 1 -- 172.21.15.96:0/546669684 >> v1:172.21.15.139:6789/0 conn(0x7f5f0c0cbd30 legacy=0x7f5f0c06e960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:57:14.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0b7fe640 1 -- 172.21.15.96:0/546669684 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c071d70 con 0x7f5f0c1572f0 2024-04-18T04:57:14.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0b7fe640 1 -- 172.21.15.96:0/546669684 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f5f04001a00 con 0x7f5f0c1572f0 2024-04-18T04:57:14.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0b7fe640 1 -- 172.21.15.96:0/546669684 >> v1:172.21.15.96:6789/0 conn(0x7f5f0c1572f0 legacy=0x7f5f0c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0b7fe640 1 --2- 172.21.15.96:0/546669684 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5f0c150dd0 0x7f5efc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0b7fe640 1 --2- 172.21.15.96:0/546669684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5efc003f10 0x7f5efc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0b7fe640 1 --2- 172.21.15.96:0/546669684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5efc004d10 0x7f5efc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0b7fe640 1 -- 172.21.15.96:0/546669684 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c0c9ac0 con 0x7f5efc003f10 2024-04-18T04:57:14.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0b7fe640 1 -- 172.21.15.96:0/546669684 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc00baa0 con 0x7f5efc004d10 2024-04-18T04:57:14.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0b7fe640 1 -- 172.21.15.96:0/546669684 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc00bc60 con 0x7f5f0c150dd0 2024-04-18T04:57:14.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0bfff640 1 --2- 172.21.15.96:0/546669684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5efc003f10 0x7f5efc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f1146e640 1 -- 172.21.15.96:0/546669684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5efc004d10 msgr2=0x7f5efc005190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:57:14.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f1146e640 1 --2- 172.21.15.96:0/546669684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5efc004d10 0x7f5efc005190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:14.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f10c6d640 1 --2- 172.21.15.96:0/546669684 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5f0c150dd0 0x7f5efc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0bfff640 1 -- 172.21.15.96:0/546669684 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5f0c150dd0 msgr2=0x7f5efc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:14.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0bfff640 1 --2- 172.21.15.96:0/546669684 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5f0c150dd0 0x7f5efc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0bfff640 1 -- 172.21.15.96:0/546669684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5efc004d10 msgr2=0x7f5efc005190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:57:14.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0bfff640 1 --2- 172.21.15.96:0/546669684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5efc004d10 0x7f5efc005190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0bfff640 1 -- 172.21.15.96:0/546669684 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc003530 con 0x7f5efc003f10 2024-04-18T04:57:14.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0bfff640 1 --2- 172.21.15.96:0/546669684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5efc003f10 0x7f5efc0047d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8003940 tx=0x7f5ef801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a1620b4bd5004c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:14.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0b7fe640 1 -- 172.21.15.96:0/546669684 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8003bc0 con 0x7f5efc003f10 2024-04-18T04:57:14.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0b7fe640 1 -- 172.21.15.96:0/546669684 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef8003d20 con 0x7f5efc003f10 2024-04-18T04:57:14.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f0b7fe640 1 -- 172.21.15.96:0/546669684 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef80052b0 con 0x7f5efc003f10 2024-04-18T04:57:14.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f12ed1640 1 -- 172.21.15.96:0/546669684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5efc003f10 msgr2=0x7f5efc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f12ed1640 1 --2- 172.21.15.96:0/546669684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5efc003f10 0x7f5efc0047d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8003940 tx=0x7f5ef801c4d0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f1146e640 1 -- 172.21.15.96:0/546669684 reap_dead start 2024-04-18T04:57:14.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f12ed1640 1 -- 172.21.15.96:0/546669684 shutdown_connections 2024-04-18T04:57:14.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f12ed1640 1 -- 172.21.15.96:0/546669684 >> 172.21.15.96:0/546669684 conn(0x7f5f0c06af70 msgr2=0x7f5f0c06b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f12ed1640 1 -- 172.21.15.96:0/546669684 shutdown_connections 2024-04-18T04:57:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.435+0000 7f5f12ed1640 1 -- 172.21.15.96:0/546669684 wait complete. 2024-04-18T04:57:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f12ed1640 1 Processor -- start 2024-04-18T04:57:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f12ed1640 1 -- start start 2024-04-18T04:57:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f12ed1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5efc003f10 0x7f5f0c0c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f12ed1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5f0c1540e0 0x7f5f0c1449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f12ed1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f0c144f20 0x7f5f0c141150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f12ed1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c159990 con 0x7f5f0c144f20 2024-04-18T04:57:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f12ed1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c144590 con 0x7f5efc003f10 2024-04-18T04:57:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f12ed1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c1453a0 con 0x7f5f0c1540e0 2024-04-18T04:57:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f10c6d640 1 -- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5efc003f10 msgr2=0x7f5f0c0c3760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:57:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f10c6d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5efc003f10 0x7f5f0c0c3760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f1146e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f0c144f20 0x7f5f0c141150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f1146e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f0c144f20 0x7f5f0c141150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58868/0 (socket says 172.21.15.96:58868) 2024-04-18T04:57:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f1146e640 1 -- 172.21.15.96:0/2532839003 learned_addr learned my addr 172.21.15.96:0/2532839003 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:14.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f0bfff640 1 --2- 172.21.15.96:0/2532839003 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5f0c1540e0 0x7f5f0c1449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f1146e640 1 -- 172.21.15.96:0/2532839003 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5f0c1540e0 msgr2=0x7f5f0c1449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f1146e640 1 --2- 172.21.15.96:0/2532839003 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5f0c1540e0 0x7f5f0c1449e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f1146e640 1 -- 172.21.15.96:0/2532839003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5efc003f10 msgr2=0x7f5f0c0c3760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:57:14.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f1146e640 1 --2- 172.21.15.96:0/2532839003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5efc003f10 0x7f5f0c0c3760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f1146e640 1 -- 172.21.15.96:0/2532839003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c15a3c0 con 0x7f5f0c144f20 2024-04-18T04:57:14.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f1146e640 1 --2- 172.21.15.96:0/2532839003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f0c144f20 0x7f5f0c141150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5f04001570 tx=0x7f5f0400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:14.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f097fa640 1 -- 172.21.15.96:0/2532839003 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400a610 con 0x7f5f0c144f20 2024-04-18T04:57:14.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f097fa640 1 -- 172.21.15.96:0/2532839003 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0400a790 con 0x7f5f0c144f20 2024-04-18T04:57:14.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f097fa640 1 -- 172.21.15.96:0/2532839003 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400ab40 con 0x7f5f0c144f20 2024-04-18T04:57:14.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f12ed1640 1 -- 172.21.15.96:0/2532839003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0c158610 con 0x7f5f0c144f20 2024-04-18T04:57:14.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.439+0000 7f5f12ed1640 1 -- 172.21.15.96:0/2532839003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0c158bd0 con 0x7f5f0c144f20 2024-04-18T04:57:14.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.443+0000 7f5f12ed1640 1 -- 172.21.15.96:0/2532839003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0c1570a0 con 0x7f5f0c144f20 2024-04-18T04:57:14.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.443+0000 7f5f097fa640 1 -- 172.21.15.96:0/2532839003 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5f0400aca0 con 0x7f5f0c144f20 2024-04-18T04:57:14.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.443+0000 7f5f097fa640 1 --2- 172.21.15.96:0/2532839003 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ef0066640 0x7f5ef0068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:14.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.443+0000 7f5f097fa640 1 -- 172.21.15.96:0/2532839003 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5f04083a40 con 0x7f5f0c144f20 2024-04-18T04:57:14.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.443+0000 7f5f10c6d640 1 --2- 172.21.15.96:0/2532839003 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ef0066640 0x7f5ef0068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:14.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.443+0000 7f5f10c6d640 1 --2- 172.21.15.96:0/2532839003 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ef0066640 0x7f5ef0068b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5f000099d0 tx=0x7f5f00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:14.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.447+0000 7f5f097fa640 1 -- 172.21.15.96:0/2532839003 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f5f04085e60 con 0x7f5f0c144f20 2024-04-18T04:57:14.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.675+0000 7f5f12ed1640 1 -- 172.21.15.96:0/2532839003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5f0c0722f0 con 0x7f5f0c144f20 2024-04-18T04:57:14.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.675+0000 7f5f097fa640 1 -- 172.21.15.96:0/2532839003 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f5f0401a070 con 0x7f5f0c144f20 2024-04-18T04:57:14.678 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:57:14.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.675+0000 7f5f12ed1640 1 -- 172.21.15.96:0/2532839003 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ef0066640 msgr2=0x7f5ef0068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.675+0000 7f5f12ed1640 1 --2- 172.21.15.96:0/2532839003 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ef0066640 0x7f5ef0068b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5f000099d0 tx=0x7f5f00008040 comp rx=0 tx=0).stop 2024-04-18T04:57:14.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.675+0000 7f5f12ed1640 1 -- 172.21.15.96:0/2532839003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f0c144f20 msgr2=0x7f5f0c141150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:14.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.675+0000 7f5f12ed1640 1 --2- 172.21.15.96:0/2532839003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f0c144f20 0x7f5f0c141150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5f04001570 tx=0x7f5f0400ccf0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.679+0000 7f5f12ed1640 1 -- 172.21.15.96:0/2532839003 shutdown_connections 2024-04-18T04:57:14.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.679+0000 7f5f12ed1640 1 --2- 172.21.15.96:0/2532839003 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5ef0066640 0x7f5ef0068b00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.679+0000 7f5f12ed1640 1 --2- 172.21.15.96:0/2532839003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f0c144f20 0x7f5f0c141150 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.679+0000 7f5f12ed1640 1 --2- 172.21.15.96:0/2532839003 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5f0c1540e0 0x7f5f0c1449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.679+0000 7f5f12ed1640 1 --2- 172.21.15.96:0/2532839003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5efc003f10 0x7f5f0c0c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:14.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.679+0000 7f5f12ed1640 1 -- 172.21.15.96:0/2532839003 >> 172.21.15.96:0/2532839003 conn(0x7f5f0c06af70 msgr2=0x7f5f0c0c2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:14.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.679+0000 7f5f12ed1640 1 -- 172.21.15.96:0/2532839003 shutdown_connections 2024-04-18T04:57:14.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:14.679+0000 7f5f12ed1640 1 -- 172.21.15.96:0/2532839003 wait complete. 2024-04-18T04:57:17.698 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:57:17.727 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:57:17.745 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:57:17.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.831+0000 7f0926262640 1 Processor -- start 2024-04-18T04:57:17.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.831+0000 7f0926262640 1 -- start start 2024-04-18T04:57:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.831+0000 7f0926262640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f09201530f0 0x7f0920070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.831+0000 7f0926262640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0920071cd0 0x7f092006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.831+0000 7f0926262640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09200c9e50 con 0x7f092006f5f0 2024-04-18T04:57:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.831+0000 7f0926262640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09200ca130 con 0x7f0920071cd0 2024-04-18T04:57:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.831+0000 7f0926262640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09200ca410 con 0x7f09201530f0 2024-04-18T04:57:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.831+0000 7f091ffff640 1 -- >> v1:172.21.15.139:6789/0 conn(0x7f092006f5f0 legacy=0x7f09201590f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:57:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.831+0000 7f0917fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0920071cd0 0x7f092006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.831+0000 7f0917fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0920071cd0 0x7f092006f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58882/0 (socket says 172.21.15.96:58882) 2024-04-18T04:57:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.831+0000 7f0917fff640 1 -- 172.21.15.96:0/3927693681 learned_addr learned my addr 172.21.15.96:0/3927693681 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.831+0000 7f091f7fe640 1 --2- 172.21.15.96:0/3927693681 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f09201530f0 0x7f0920070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:17.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.831+0000 7f0917fff640 1 -- 172.21.15.96:0/3927693681 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f09201530f0 msgr2=0x7f0920070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:17.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.831+0000 7f0917fff640 1 --2- 172.21.15.96:0/3927693681 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f09201530f0 0x7f0920070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:17.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.831+0000 7f0917fff640 1 -- 172.21.15.96:0/3927693681 >> v1:172.21.15.139:6789/0 conn(0x7f092006f5f0 legacy=0x7f09201590f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:57:17.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.831+0000 7f0917fff640 1 -- 172.21.15.96:0/3927693681 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09200ca6f0 con 0x7f0920071cd0 2024-04-18T04:57:17.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.835+0000 7f0917fff640 1 --2- 172.21.15.96:0/3927693681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0920071cd0 0x7f092006f0b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0908009870 tx=0x7f090801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c674ee6533e89fb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:17.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.835+0000 7f091effd640 1 -- 172.21.15.96:0/3927693681 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080ab600 con 0x7f0920071cd0 2024-04-18T04:57:17.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.835+0000 7f091effd640 1 -- 172.21.15.96:0/3927693681 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09080a7050 con 0x7f0920071cd0 2024-04-18T04:57:17.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.835+0000 7f091effd640 1 -- 172.21.15.96:0/3927693681 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080ab980 con 0x7f0920071cd0 2024-04-18T04:57:17.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.835+0000 7f0926262640 1 -- 172.21.15.96:0/3927693681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0920071cd0 msgr2=0x7f092006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.835+0000 7f0926262640 1 --2- 172.21.15.96:0/3927693681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0920071cd0 0x7f092006f0b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0908009870 tx=0x7f090801c490 comp rx=0 tx=0).stop 2024-04-18T04:57:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.835+0000 7f0926262640 1 -- 172.21.15.96:0/3927693681 shutdown_connections 2024-04-18T04:57:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.835+0000 7f0926262640 1 --2- 172.21.15.96:0/3927693681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0920071cd0 0x7f092006f0b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.835+0000 7f0926262640 1 --2- 172.21.15.96:0/3927693681 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f09201530f0 0x7f0920070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.835+0000 7f0926262640 1 -- 172.21.15.96:0/3927693681 >> 172.21.15.96:0/3927693681 conn(0x7f092006af70 msgr2=0x7f092006b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.835+0000 7f0926262640 1 -- 172.21.15.96:0/3927693681 shutdown_connections 2024-04-18T04:57:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.835+0000 7f0926262640 1 -- 172.21.15.96:0/3927693681 wait complete. 2024-04-18T04:57:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.835+0000 7f0926262640 1 Processor -- start 2024-04-18T04:57:17.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.835+0000 7f0926262640 1 -- start start 2024-04-18T04:57:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0926262640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f092006f5f0 0x7f0920153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0926262640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0920071cd0 0x7f0920154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0926262640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f09201530f0 0x7f09201eaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0926262640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0920155180 con 0x7f0920071cd0 2024-04-18T04:57:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0926262640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09201f16e0 con 0x7f09201530f0 2024-04-18T04:57:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0926262640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09201f5bc0 con 0x7f092006f5f0 2024-04-18T04:57:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0917fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0920071cd0 0x7f0920154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f091ffff640 1 -- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f09201530f0 msgr2=0x7f09201eaf30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:57:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f091ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f09201530f0 0x7f09201eaf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0917fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0920071cd0 0x7f0920154010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58892/0 (socket says 172.21.15.96:58892) 2024-04-18T04:57:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0917fff640 1 -- 172.21.15.96:0/56186336 learned_addr learned my addr 172.21.15.96:0/56186336 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f091f7fe640 1 --2- 172.21.15.96:0/56186336 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f092006f5f0 0x7f0920153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:17.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0917fff640 1 -- 172.21.15.96:0/56186336 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f092006f5f0 msgr2=0x7f0920153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:17.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0917fff640 1 --2- 172.21.15.96:0/56186336 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f092006f5f0 0x7f0920153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:17.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0917fff640 1 -- 172.21.15.96:0/56186336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f09201530f0 msgr2=0x7f09201eaf30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:57:17.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0917fff640 1 --2- 172.21.15.96:0/56186336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f09201530f0 0x7f09201eaf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:17.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0917fff640 1 -- 172.21.15.96:0/56186336 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09080094d0 con 0x7f0920071cd0 2024-04-18T04:57:17.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0917fff640 1 --2- 172.21.15.96:0/56186336 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0920071cd0 0x7f0920154010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f09080ae040 tx=0x7f0908019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:17.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f091cff9640 1 -- 172.21.15.96:0/56186336 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080b4660 con 0x7f0920071cd0 2024-04-18T04:57:17.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f091cff9640 1 -- 172.21.15.96:0/56186336 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09080b47c0 con 0x7f0920071cd0 2024-04-18T04:57:17.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0926262640 1 -- 172.21.15.96:0/56186336 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09201f24c0 con 0x7f0920071cd0 2024-04-18T04:57:17.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f091cff9640 1 -- 172.21.15.96:0/56186336 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080b4b70 con 0x7f0920071cd0 2024-04-18T04:57:17.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0926262640 1 -- 172.21.15.96:0/56186336 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09201f18f0 con 0x7f0920071cd0 2024-04-18T04:57:17.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f0926262640 1 -- 172.21.15.96:0/56186336 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09201f2650 con 0x7f0920071cd0 2024-04-18T04:57:17.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f091cff9640 1 -- 172.21.15.96:0/56186336 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f09080b2070 con 0x7f0920071cd0 2024-04-18T04:57:17.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f091cff9640 1 --2- 172.21.15.96:0/56186336 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0900066640 0x7f0900068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:17.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f091cff9640 1 -- 172.21.15.96:0/56186336 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f090811d9c0 con 0x7f0920071cd0 2024-04-18T04:57:17.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.839+0000 7f091f7fe640 1 --2- 172.21.15.96:0/56186336 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0900066640 0x7f0900068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:17.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.843+0000 7f091f7fe640 1 --2- 172.21.15.96:0/56186336 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0900066640 0x7f0900068b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0910007a60 tx=0x7f0910008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:17.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:17.847+0000 7f091cff9640 1 -- 172.21.15.96:0/56186336 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f09080eadc0 con 0x7f0920071cd0 2024-04-18T04:57:18.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:18.099+0000 7f0926262640 1 -- 172.21.15.96:0/56186336 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0920067050 con 0x7f0920071cd0 2024-04-18T04:57:18.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:18.099+0000 7f091cff9640 1 -- 172.21.15.96:0/56186336 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f09080b0620 con 0x7f0920071cd0 2024-04-18T04:57:18.102 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:57:18.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:18.103+0000 7f0926262640 1 -- 172.21.15.96:0/56186336 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0900066640 msgr2=0x7f0900068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:18.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:18.103+0000 7f0926262640 1 --2- 172.21.15.96:0/56186336 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0900066640 0x7f0900068b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0910007a60 tx=0x7f0910008040 comp rx=0 tx=0).stop 2024-04-18T04:57:18.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:18.103+0000 7f0926262640 1 -- 172.21.15.96:0/56186336 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0920071cd0 msgr2=0x7f0920154010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:18.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:18.103+0000 7f0926262640 1 --2- 172.21.15.96:0/56186336 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0920071cd0 0x7f0920154010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f09080ae040 tx=0x7f0908019230 comp rx=0 tx=0).stop 2024-04-18T04:57:18.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:18.103+0000 7f0926262640 1 -- 172.21.15.96:0/56186336 shutdown_connections 2024-04-18T04:57:18.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:18.103+0000 7f0926262640 1 --2- 172.21.15.96:0/56186336 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0900066640 0x7f0900068b00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:18.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:18.103+0000 7f0926262640 1 --2- 172.21.15.96:0/56186336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f09201530f0 0x7f09201eaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:18.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:18.103+0000 7f0926262640 1 --2- 172.21.15.96:0/56186336 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0920071cd0 0x7f0920154010 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:18.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:18.103+0000 7f0926262640 1 --2- 172.21.15.96:0/56186336 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f092006f5f0 0x7f0920153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:18.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:18.103+0000 7f0926262640 1 -- 172.21.15.96:0/56186336 >> 172.21.15.96:0/56186336 conn(0x7f092006af70 msgr2=0x7f0920146760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:18.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:18.103+0000 7f0926262640 1 -- 172.21.15.96:0/56186336 shutdown_connections 2024-04-18T04:57:18.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:18.103+0000 7f0926262640 1 -- 172.21.15.96:0/56186336 wait complete. 2024-04-18T04:57:21.124 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:57:21.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.263+0000 7f8273ec8640 1 Processor -- start 2024-04-18T04:57:21.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.263+0000 7f8273ec8640 1 -- start start 2024-04-18T04:57:21.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.263+0000 7f8273ec8640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f826c0c60e0 0x7f826c14fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:21.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.263+0000 7f8273ec8640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826c159380 con 0x7f826c0701b0 2024-04-18T04:57:21.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.263+0000 7f8273ec8640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826c159620 con 0x7f826c070a40 2024-04-18T04:57:21.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.263+0000 7f8273ec8640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826c15a1a0 con 0x7f826c0c60e0 2024-04-18T04:57:21.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.263+0000 7f8271463640 1 -- >> v1:172.21.15.139:6789/0 conn(0x7f826c070a40 legacy=0x7f826c156130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:57:21.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.263+0000 7f8271c64640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f826c0c60e0 0x7f826c14fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:21.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.263+0000 7f8272465640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f826c0701b0 0x7f826c160600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55640/0 (socket says 172.21.15.96:55640) 2024-04-18T04:57:21.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.263+0000 7f8272465640 1 -- 172.21.15.96:0/315260261 learned_addr learned my addr 172.21.15.96:0/315260261 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:57:21.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.263+0000 7f8271c64640 1 -- 172.21.15.96:0/315260261 >> v1:172.21.15.139:6789/0 conn(0x7f826c070a40 legacy=0x7f826c156130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:57:21.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.263+0000 7f8271c64640 1 -- 172.21.15.96:0/315260261 >> v1:172.21.15.96:6789/0 conn(0x7f826c0701b0 legacy=0x7f826c160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:21.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.263+0000 7f8271c64640 1 -- 172.21.15.96:0/315260261 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c159900 con 0x7f826c0c60e0 2024-04-18T04:57:21.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.267+0000 7f8271c64640 1 --2- 172.21.15.96:0/315260261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f826c0c60e0 0x7f826c14fb50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f82680097c0 tx=0x7f826801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafc2b30d7020047 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:21.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.267+0000 7f8270c62640 1 -- 172.21.15.96:0/315260261 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82680ab600 con 0x7f826c0c60e0 2024-04-18T04:57:21.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.267+0000 7f8270c62640 1 -- 172.21.15.96:0/315260261 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82680a7050 con 0x7f826c0c60e0 2024-04-18T04:57:21.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.267+0000 7f8270c62640 1 -- 172.21.15.96:0/315260261 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82680ab980 con 0x7f826c0c60e0 2024-04-18T04:57:21.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.267+0000 7f8273ec8640 1 -- 172.21.15.96:0/315260261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f826c0c60e0 msgr2=0x7f826c14fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:21.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.267+0000 7f8273ec8640 1 --2- 172.21.15.96:0/315260261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f826c0c60e0 0x7f826c14fb50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f82680097c0 tx=0x7f826801c460 comp rx=0 tx=0).stop 2024-04-18T04:57:21.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.267+0000 7f8273ec8640 1 -- 172.21.15.96:0/315260261 shutdown_connections 2024-04-18T04:57:21.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.267+0000 7f8273ec8640 1 --2- 172.21.15.96:0/315260261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f826c0c60e0 0x7f826c14fb50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:21.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.267+0000 7f8273ec8640 1 -- 172.21.15.96:0/315260261 >> 172.21.15.96:0/315260261 conn(0x7f826c06c750 msgr2=0x7f826c0c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:21.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.267+0000 7f8273ec8640 1 -- 172.21.15.96:0/315260261 shutdown_connections 2024-04-18T04:57:21.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.267+0000 7f8273ec8640 1 -- 172.21.15.96:0/315260261 wait complete. 2024-04-18T04:57:21.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.267+0000 7f8273ec8640 1 Processor -- start 2024-04-18T04:57:21.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.267+0000 7f8273ec8640 1 -- start start 2024-04-18T04:57:21.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.267+0000 7f8273ec8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f826c0701b0 0x7f826c13f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:21.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.267+0000 7f8273ec8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f826c0c60e0 0x7f826c14a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:21.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.267+0000 7f8273ec8640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f826c0c8b80 0x7f826c156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:21.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8273ec8640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c157f80 con 0x7f826c0701b0 2024-04-18T04:57:21.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8273ec8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c140910 con 0x7f826c0c60e0 2024-04-18T04:57:21.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8273ec8640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826c0c9be0 con 0x7f826c0c8b80 2024-04-18T04:57:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8271463640 1 -- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f826c0c60e0 msgr2=0x7f826c14a060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:57:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8271c64640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f826c0701b0 0x7f826c13f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8271463640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f826c0c60e0 0x7f826c14a060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8271c64640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f826c0701b0 0x7f826c13f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34372/0 (socket says 172.21.15.96:34372) 2024-04-18T04:57:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8271c64640 1 -- 172.21.15.96:0/3994465855 learned_addr learned my addr 172.21.15.96:0/3994465855 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8272465640 1 --2- 172.21.15.96:0/3994465855 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f826c0c8b80 0x7f826c156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8271c64640 1 -- 172.21.15.96:0/3994465855 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f826c0c8b80 msgr2=0x7f826c156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8271c64640 1 --2- 172.21.15.96:0/3994465855 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f826c0c8b80 0x7f826c156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8271c64640 1 -- 172.21.15.96:0/3994465855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f826c0c60e0 msgr2=0x7f826c14a060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:57:21.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8271c64640 1 --2- 172.21.15.96:0/3994465855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f826c0c60e0 0x7f826c14a060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:21.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8271c64640 1 -- 172.21.15.96:0/3994465855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8268009420 con 0x7f826c0701b0 2024-04-18T04:57:21.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8272465640 1 --2- 172.21.15.96:0/3994465855 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f826c0c8b80 0x7f826c156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:57:21.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8271c64640 1 --2- 172.21.15.96:0/3994465855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f826c0701b0 0x7f826c13f890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f82680ae040 tx=0x7f826801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:21.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f82627fc640 1 -- 172.21.15.96:0/3994465855 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82680b7650 con 0x7f826c0701b0 2024-04-18T04:57:21.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f82627fc640 1 -- 172.21.15.96:0/3994465855 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82680b77b0 con 0x7f826c0701b0 2024-04-18T04:57:21.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8273ec8640 1 -- 172.21.15.96:0/3994465855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f826c0c9ec0 con 0x7f826c0701b0 2024-04-18T04:57:21.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f82627fc640 1 -- 172.21.15.96:0/3994465855 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82680b7b60 con 0x7f826c0701b0 2024-04-18T04:57:21.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8273ec8640 1 -- 172.21.15.96:0/3994465855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826c149cf0 con 0x7f826c0701b0 2024-04-18T04:57:21.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8273ec8640 1 -- 172.21.15.96:0/3994465855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f826c067050 con 0x7f826c0701b0 2024-04-18T04:57:21.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f82627fc640 1 -- 172.21.15.96:0/3994465855 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f82680b7cc0 con 0x7f826c0701b0 2024-04-18T04:57:21.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f82627fc640 1 --2- 172.21.15.96:0/3994465855 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8250066670 0x7f8250068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:21.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f82627fc640 1 -- 172.21.15.96:0/3994465855 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f826811e9f0 con 0x7f826c0701b0 2024-04-18T04:57:21.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8271463640 1 --2- 172.21.15.96:0/3994465855 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8250066670 0x7f8250068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:21.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.271+0000 7f8271463640 1 --2- 172.21.15.96:0/3994465855 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8250066670 0x7f8250068b30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f826c04ebf0 tx=0x7f825c006d90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:21.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.275+0000 7f82627fc640 1 -- 172.21.15.96:0/3994465855 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f82680ebd40 con 0x7f826c0701b0 2024-04-18T04:57:21.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.507+0000 7f8273ec8640 1 -- 172.21.15.96:0/3994465855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f826c14f5e0 con 0x7f826c0701b0 2024-04-18T04:57:21.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.507+0000 7f82627fc640 1 -- 172.21.15.96:0/3994465855 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f82680b0020 con 0x7f826c0701b0 2024-04-18T04:57:21.510 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:57:21.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.507+0000 7f8273ec8640 1 -- 172.21.15.96:0/3994465855 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8250066670 msgr2=0x7f8250068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:21.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.507+0000 7f8273ec8640 1 --2- 172.21.15.96:0/3994465855 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8250066670 0x7f8250068b30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f826c04ebf0 tx=0x7f825c006d90 comp rx=0 tx=0).stop 2024-04-18T04:57:21.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.507+0000 7f8273ec8640 1 -- 172.21.15.96:0/3994465855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f826c0701b0 msgr2=0x7f826c13f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:21.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.507+0000 7f8273ec8640 1 --2- 172.21.15.96:0/3994465855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f826c0701b0 0x7f826c13f890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f82680ae040 tx=0x7f826801aca0 comp rx=0 tx=0).stop 2024-04-18T04:57:21.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.511+0000 7f8273ec8640 1 -- 172.21.15.96:0/3994465855 shutdown_connections 2024-04-18T04:57:21.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.511+0000 7f8273ec8640 1 --2- 172.21.15.96:0/3994465855 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8250066670 0x7f8250068b30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:21.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.511+0000 7f8273ec8640 1 --2- 172.21.15.96:0/3994465855 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f826c0c8b80 0x7f826c156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:21.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.511+0000 7f8273ec8640 1 --2- 172.21.15.96:0/3994465855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f826c0c60e0 0x7f826c14a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:21.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.511+0000 7f8273ec8640 1 --2- 172.21.15.96:0/3994465855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f826c0701b0 0x7f826c13f890 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:21.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.511+0000 7f8273ec8640 1 -- 172.21.15.96:0/3994465855 >> 172.21.15.96:0/3994465855 conn(0x7f826c06c750 msgr2=0x7f826c0c1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:21.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.511+0000 7f8273ec8640 1 -- 172.21.15.96:0/3994465855 shutdown_connections 2024-04-18T04:57:21.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:21.511+0000 7f8273ec8640 1 -- 172.21.15.96:0/3994465855 wait complete. 2024-04-18T04:57:24.529 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:57:24.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca6c8b8640 1 Processor -- start 2024-04-18T04:57:24.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca6c8b8640 1 -- start start 2024-04-18T04:57:24.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca6c8b8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fca68150db0 0x7fca68071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:24.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca6c8b8640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 0x7fca680c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:24.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca6c8b8640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca68157160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:24.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca6c8b8640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca68156d30 con 0x7fca6806a5f0 2024-04-18T04:57:24.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca6c8b8640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca68072230 con 0x7fca68150db0 2024-04-18T04:57:24.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca6c8b8640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca680cae90 con 0x7fca680c50d0 2024-04-18T04:57:24.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca6659c640 1 -- >> v2:172.21.15.139:3300/0 conn(0x7fca68150db0 msgr2=0x7fca68071cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:57:24.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca5ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 0x7fca680c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:24.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca6659c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fca68150db0 0x7fca68071cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:24.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca5ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 0x7fca680c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34380/0 (socket says 172.21.15.96:34380) 2024-04-18T04:57:24.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca5ffff640 1 -- 172.21.15.96:0/819942202 learned_addr learned my addr 172.21.15.96:0/819942202 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca5ffff640 1 -- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 msgr2=0x7fca680c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:57:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca5ffff640 1 -- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 msgr2=0x7fca680c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca5ffff640 1 --2- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 0x7fca680c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca5ffff640 1 --2- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 0x7fca680c4b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca66d9d640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca68157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca66d9d640 1 -- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 msgr2=0x7fca68157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T04:57:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca66d9d640 1 -- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 msgr2=0x7fca68157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca66d9d640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca68157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.662+0000 7fca66d9d640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca68157160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:24.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.866+0000 7fca6659c640 1 -- 172.21.15.96:0/819942202 >> v2:172.21.15.139:3300/0 conn(0x7fca68150db0 msgr2=0x7fca68071cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:57:24.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.866+0000 7fca6659c640 1 --2- 172.21.15.96:0/819942202 >> v2:172.21.15.139:3300/0 conn(0x7fca68150db0 0x7fca68071cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:57:24.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.866+0000 7fca5ffff640 1 --2- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 0x7fca680c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:24.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.866+0000 7fca66d9d640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca68157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:24.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.866+0000 7fca5ffff640 1 -- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 msgr2=0x7fca680c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T04:57:24.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.866+0000 7fca5ffff640 1 -- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 msgr2=0x7fca680c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:24.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.866+0000 7fca5ffff640 1 --2- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 0x7fca680c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:24.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.866+0000 7fca5ffff640 1 --2- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 0x7fca680c4b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:57:24.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.866+0000 7fca66d9d640 1 -- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 msgr2=0x7fca68157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:57:24.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.866+0000 7fca66d9d640 1 -- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 msgr2=0x7fca68157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:24.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.866+0000 7fca66d9d640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca68157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:24.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:24.866+0000 7fca66d9d640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca68157160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:57:25.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:25.270+0000 7fca6659c640 1 -- 172.21.15.96:0/819942202 >> v2:172.21.15.139:3300/0 conn(0x7fca68150db0 msgr2=0x7fca68071cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:57:25.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:25.270+0000 7fca6659c640 1 --2- 172.21.15.96:0/819942202 >> v2:172.21.15.139:3300/0 conn(0x7fca68150db0 0x7fca68071cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:57:25.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:25.270+0000 7fca5ffff640 1 --2- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 0x7fca680c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:25.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:25.270+0000 7fca66d9d640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca68157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:25.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:25.270+0000 7fca5ffff640 1 -- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 msgr2=0x7fca680c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:57:25.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:25.270+0000 7fca5ffff640 1 -- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 msgr2=0x7fca680c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:25.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:25.270+0000 7fca5ffff640 1 --2- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 0x7fca680c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:25.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:25.270+0000 7fca5ffff640 1 --2- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 0x7fca680c4b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:57:25.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:25.270+0000 7fca66d9d640 1 -- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 msgr2=0x7fca68157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:57:25.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:25.270+0000 7fca66d9d640 1 -- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 msgr2=0x7fca68157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:25.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:25.270+0000 7fca66d9d640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca68157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:25.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:25.270+0000 7fca66d9d640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca68157160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:57:26.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:26.074+0000 7fca6659c640 1 -- 172.21.15.96:0/819942202 >> v2:172.21.15.139:3300/0 conn(0x7fca68150db0 msgr2=0x7fca68071cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:57:26.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:26.074+0000 7fca6659c640 1 --2- 172.21.15.96:0/819942202 >> v2:172.21.15.139:3300/0 conn(0x7fca68150db0 0x7fca68071cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:57:26.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:26.074+0000 7fca5ffff640 1 --2- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 0x7fca680c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:26.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:26.074+0000 7fca66d9d640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca68157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:26.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:26.074+0000 7fca5ffff640 1 -- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 msgr2=0x7fca680c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T04:57:26.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:26.074+0000 7fca5ffff640 1 -- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 msgr2=0x7fca680c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:26.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:26.074+0000 7fca5ffff640 1 --2- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 0x7fca680c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:26.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:26.074+0000 7fca66d9d640 1 -- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 msgr2=0x7fca68157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:57:26.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:26.074+0000 7fca66d9d640 1 -- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 msgr2=0x7fca68157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:26.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:26.074+0000 7fca66d9d640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca68157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:26.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:26.074+0000 7fca5ffff640 1 --2- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 0x7fca680c4b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:57:26.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:26.074+0000 7fca66d9d640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca68157160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:57:27.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:27.662+0000 7fca64d99640 1 -- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 msgr2=0x7fca68157160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:57:27.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:27.662+0000 7fca64d99640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca68157160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:27.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:27.662+0000 7fca64d99640 1 -- 172.21.15.96:0/819942202 >> v2:172.21.15.139:3300/0 conn(0x7fca68150db0 msgr2=0x7fca68071cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:57:27.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:27.662+0000 7fca64d99640 1 --2- 172.21.15.96:0/819942202 >> v2:172.21.15.139:3300/0 conn(0x7fca68150db0 0x7fca68071cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:27.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:27.662+0000 7fca64d99640 1 -- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 msgr2=0x7fca680c4b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:57:27.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:27.662+0000 7fca64d99640 1 --2- 172.21.15.96:0/819942202 >> v2:172.21.15.96:3300/0 conn(0x7fca6806a5f0 0x7fca680c4b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:27.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:27.662+0000 7fca64d99640 1 -- 172.21.15.96:0/819942202 --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca680cb400 con 0x7fca48007360 2024-04-18T04:57:27.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:27.662+0000 7fca64d99640 1 -- 172.21.15.96:0/819942202 --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4800c090 con 0x7fca480036d0 2024-04-18T04:57:27.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:27.662+0000 7fca6659c640 1 -- 172.21.15.96:0/819942202 >> v1:172.21.15.139:6789/0 conn(0x7fca480036d0 legacy=0x7fca48005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:57:27.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:27.866+0000 7fca6659c640 1 -- 172.21.15.96:0/819942202 >> v1:172.21.15.139:6789/0 conn(0x7fca480036d0 legacy=0x7fca48005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:57:28.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.270+0000 7fca6659c640 1 -- 172.21.15.96:0/819942202 >> v1:172.21.15.139:6789/0 conn(0x7fca480036d0 legacy=0x7fca48005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:57:28.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.754+0000 7fca65d9b640 1 -- 172.21.15.96:0/819942202 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516036340 0 0) 0x7fca680cb400 con 0x7fca48007360 2024-04-18T04:57:28.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.754+0000 7fca65d9b640 1 -- 172.21.15.96:0/819942202 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca54003530 con 0x7fca48007360 2024-04-18T04:57:28.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca65d9b640 1 -- 172.21.15.96:0/819942202 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3435021410 0 0) 0x7fca54003530 con 0x7fca48007360 2024-04-18T04:57:28.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca65d9b640 1 -- 172.21.15.96:0/819942202 >> v1:172.21.15.139:6789/0 conn(0x7fca480036d0 legacy=0x7fca48005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:57:28.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca65d9b640 1 -- 172.21.15.96:0/819942202 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4800d2f0 con 0x7fca48007360 2024-04-18T04:57:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca65d9b640 1 -- 172.21.15.96:0/819942202 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fca5000c570 con 0x7fca48007360 2024-04-18T04:57:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca65d9b640 1 -- 172.21.15.96:0/819942202 >> v1:172.21.15.96:6789/0 conn(0x7fca48007360 legacy=0x7fca48009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca65d9b640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca540039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca66d9d640 1 -- 172.21.15.96:0/819942202 reap_dead start 2024-04-18T04:57:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca65d9b640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca54004080 0x7fca540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca65d9b640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca54004d60 0x7fca540051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca65d9b640 1 -- 172.21.15.96:0/819942202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5400bc40 con 0x7fca54004d60 2024-04-18T04:57:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca65d9b640 1 -- 172.21.15.96:0/819942202 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5400bdb0 con 0x7fca54004080 2024-04-18T04:57:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca65d9b640 1 -- 172.21.15.96:0/819942202 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5400bf70 con 0x7fca680c50d0 2024-04-18T04:57:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca5ffff640 1 -- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca54004080 msgr2=0x7fca540047d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:57:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca5ffff640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca54004080 0x7fca540047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca66d9d640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca54004d60 0x7fca540051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:28.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca6659c640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca540039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:28.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca66d9d640 1 -- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 msgr2=0x7fca540039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:28.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca66d9d640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca540039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:28.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca66d9d640 1 -- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca54004080 msgr2=0x7fca540047d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:57:28.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca66d9d640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca54004080 0x7fca540047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:28.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.758+0000 7fca66d9d640 1 -- 172.21.15.96:0/819942202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca54003530 con 0x7fca54004d60 2024-04-18T04:57:28.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.766+0000 7fca66d9d640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca54004d60 0x7fca540051e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fca680c8ff0 tx=0x7fca6001d220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25473694b7846df6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:28.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.766+0000 7fca65d9b640 1 -- 172.21.15.96:0/819942202 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca600ae410 con 0x7fca54004d60 2024-04-18T04:57:28.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.766+0000 7fca65d9b640 1 -- 172.21.15.96:0/819942202 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca600a8030 con 0x7fca54004d60 2024-04-18T04:57:28.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.766+0000 7fca65d9b640 1 -- 172.21.15.96:0/819942202 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca600ae7b0 con 0x7fca54004d60 2024-04-18T04:57:28.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.766+0000 7fca6c8b8640 1 -- 172.21.15.96:0/819942202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca54004d60 msgr2=0x7fca540051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:28.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.766+0000 7fca6c8b8640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca54004d60 0x7fca540051e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fca680c8ff0 tx=0x7fca6001d220 comp rx=0 tx=0).stop 2024-04-18T04:57:28.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.766+0000 7fca6c8b8640 1 -- 172.21.15.96:0/819942202 shutdown_connections 2024-04-18T04:57:28.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.766+0000 7fca6c8b8640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca54004080 0x7fca540047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:28.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.766+0000 7fca6c8b8640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca54004d60 0x7fca540051e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:28.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.766+0000 7fca6c8b8640 1 --2- 172.21.15.96:0/819942202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca540039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:28.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.766+0000 7fca6c8b8640 1 -- 172.21.15.96:0/819942202 >> 172.21.15.96:0/819942202 conn(0x7fca68066250 msgr2=0x7fca6806eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:28.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.770+0000 7fca6c8b8640 1 -- 172.21.15.96:0/819942202 shutdown_connections 2024-04-18T04:57:28.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.770+0000 7fca6c8b8640 1 -- 172.21.15.96:0/819942202 wait complete. 2024-04-18T04:57:28.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.770+0000 7fca6c8b8640 1 Processor -- start 2024-04-18T04:57:28.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6c8b8640 1 -- start start 2024-04-18T04:57:28.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6c8b8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca54004080 0x7fca6814a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6c8b8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca54004d60 0x7fca6814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6c8b8640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca680c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6c8b8640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca68149f20 con 0x7fca54004080 2024-04-18T04:57:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6c8b8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca68147c20 con 0x7fca54004d60 2024-04-18T04:57:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6c8b8640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca68147f00 con 0x7fca680c50d0 2024-04-18T04:57:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca5ffff640 1 -- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca54004d60 msgr2=0x7fca6814c4d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:57:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca5ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca54004d60 0x7fca6814c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6659c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca54004080 0x7fca6814a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6659c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca54004080 0x7fca6814a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34422/0 (socket says 172.21.15.96:34422) 2024-04-18T04:57:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6659c640 1 -- 172.21.15.96:0/1934122201 learned_addr learned my addr 172.21.15.96:0/1934122201 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca66d9d640 1 --2- 172.21.15.96:0/1934122201 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca680c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6659c640 1 -- 172.21.15.96:0/1934122201 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 msgr2=0x7fca680c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6659c640 1 --2- 172.21.15.96:0/1934122201 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca680c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6659c640 1 -- 172.21.15.96:0/1934122201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca54004d60 msgr2=0x7fca6814c4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:57:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6659c640 1 --2- 172.21.15.96:0/1934122201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca54004d60 0x7fca6814c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6659c640 1 -- 172.21.15.96:0/1934122201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca681498d0 con 0x7fca54004080 2024-04-18T04:57:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6659c640 1 --2- 172.21.15.96:0/1934122201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca54004080 0x7fca6814a9a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca58003dd0 tx=0x7fca58003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca5effd640 1 -- 172.21.15.96:0/1934122201 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5800daa0 con 0x7fca54004080 2024-04-18T04:57:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca5effd640 1 -- 172.21.15.96:0/1934122201 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5800dc00 con 0x7fca54004080 2024-04-18T04:57:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6c8b8640 1 -- 172.21.15.96:0/1934122201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca68149bb0 con 0x7fca54004080 2024-04-18T04:57:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca5effd640 1 -- 172.21.15.96:0/1934122201 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58013430 con 0x7fca54004080 2024-04-18T04:57:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6c8b8640 1 -- 172.21.15.96:0/1934122201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6806eaa0 con 0x7fca54004080 2024-04-18T04:57:28.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.774+0000 7fca6c8b8640 1 -- 172.21.15.96:0/1934122201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6814a0d0 con 0x7fca54004080 2024-04-18T04:57:28.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.778+0000 7fca5effd640 1 -- 172.21.15.96:0/1934122201 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fca58011040 con 0x7fca54004080 2024-04-18T04:57:28.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.778+0000 7fca5effd640 1 --2- 172.21.15.96:0/1934122201 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca48066e70 0x7fca48069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:28.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.778+0000 7fca5ffff640 1 --2- 172.21.15.96:0/1934122201 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca48066e70 0x7fca48069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:28.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.778+0000 7fca5effd640 1 -- 172.21.15.96:0/1934122201 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fca5800e040 con 0x7fca54004080 2024-04-18T04:57:28.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.778+0000 7fca5ffff640 1 --2- 172.21.15.96:0/1934122201 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca48066e70 0x7fca48069330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fca50001ec0 tx=0x7fca50008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:28.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:28.782+0000 7fca5effd640 1 -- 172.21.15.96:0/1934122201 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fca6814a0d0 con 0x7fca54004080 2024-04-18T04:57:29.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.026+0000 7fca6c8b8640 1 -- 172.21.15.96:0/1934122201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fca68067050 con 0x7fca54004080 2024-04-18T04:57:29.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.026+0000 7fca5effd640 1 -- 172.21.15.96:0/1934122201 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7fca58051690 con 0x7fca54004080 2024-04-18T04:57:29.030 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":30,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:57:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.030+0000 7fca6c8b8640 1 -- 172.21.15.96:0/1934122201 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca48066e70 msgr2=0x7fca48069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.030+0000 7fca6c8b8640 1 --2- 172.21.15.96:0/1934122201 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca48066e70 0x7fca48069330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fca50001ec0 tx=0x7fca50008040 comp rx=0 tx=0).stop 2024-04-18T04:57:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.030+0000 7fca6c8b8640 1 -- 172.21.15.96:0/1934122201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca54004080 msgr2=0x7fca6814a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.030+0000 7fca6c8b8640 1 --2- 172.21.15.96:0/1934122201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca54004080 0x7fca6814a9a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca58003dd0 tx=0x7fca58003970 comp rx=0 tx=0).stop 2024-04-18T04:57:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.030+0000 7fca6c8b8640 1 -- 172.21.15.96:0/1934122201 shutdown_connections 2024-04-18T04:57:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.030+0000 7fca6c8b8640 1 --2- 172.21.15.96:0/1934122201 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca48066e70 0x7fca48069330 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.030+0000 7fca6c8b8640 1 --2- 172.21.15.96:0/1934122201 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca680c50d0 0x7fca680c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.030+0000 7fca6c8b8640 1 --2- 172.21.15.96:0/1934122201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca54004d60 0x7fca6814c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.030+0000 7fca6c8b8640 1 --2- 172.21.15.96:0/1934122201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca54004080 0x7fca6814a9a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.030+0000 7fca6c8b8640 1 -- 172.21.15.96:0/1934122201 >> 172.21.15.96:0/1934122201 conn(0x7fca68066250 msgr2=0x7fca6814fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.030+0000 7fca6c8b8640 1 -- 172.21.15.96:0/1934122201 shutdown_connections 2024-04-18T04:57:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.030+0000 7fca6c8b8640 1 -- 172.21.15.96:0/1934122201 wait complete. 2024-04-18T04:57:29.051 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-18T04:57:29.051 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-04-18T04:57:29.051 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T04:57:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.182+0000 7fd21e5c2640 1 Processor -- start 2024-04-18T04:57:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.182+0000 7fd21e5c2640 1 -- start start 2024-04-18T04:57:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.182+0000 7fd21e5c2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd2180c8a90 0x7fd2180cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.182+0000 7fd21e5c2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2180ccea0 0x7fd21815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.182+0000 7fd21e5c2640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2180c8ee0 con 0x7fd218156610 2024-04-18T04:57:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.182+0000 7fd21e5c2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd21806c1b0 con 0x7fd2180c8a90 2024-04-18T04:57:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.182+0000 7fd21e5c2640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2181569f0 con 0x7fd2180ccea0 2024-04-18T04:57:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.182+0000 7fd217fff640 1 -- >> v1:172.21.15.139:6789/0 conn(0x7fd218156610 legacy=0x7fd21806af70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:57:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.182+0000 7fd2177fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd2180c8a90 0x7fd2180cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.182+0000 7fd2177fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd2180c8a90 0x7fd2180cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41772/0 (socket says 172.21.15.96:41772) 2024-04-18T04:57:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.182+0000 7fd2177fe640 1 -- 172.21.15.96:0/2182721356 learned_addr learned my addr 172.21.15.96:0/2182721356 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.182+0000 7fd21cb5f640 1 --2- 172.21.15.96:0/2182721356 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2180ccea0 0x7fd21815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.186+0000 7fd2177fe640 1 -- 172.21.15.96:0/2182721356 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2180ccea0 msgr2=0x7fd21815c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:29.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.186+0000 7fd2177fe640 1 --2- 172.21.15.96:0/2182721356 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2180ccea0 0x7fd21815c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.186+0000 7fd2177fe640 1 -- 172.21.15.96:0/2182721356 >> v1:172.21.15.139:6789/0 conn(0x7fd218156610 legacy=0x7fd21806af70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:57:29.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.186+0000 7fd2177fe640 1 -- 172.21.15.96:0/2182721356 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2180c7800 con 0x7fd2180c8a90 2024-04-18T04:57:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.186+0000 7fd2177fe640 1 --2- 172.21.15.96:0/2182721356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2180c8a90 0x7fd2180cc960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0098a0 tx=0x7fd20c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf21073726540cc server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.186+0000 7fd216ffd640 1 -- 172.21.15.96:0/2182721356 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0ac600 con 0x7fd2180c8a90 2024-04-18T04:57:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.186+0000 7fd216ffd640 1 -- 172.21.15.96:0/2182721356 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c0a8050 con 0x7fd2180c8a90 2024-04-18T04:57:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.186+0000 7fd216ffd640 1 -- 172.21.15.96:0/2182721356 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0ac980 con 0x7fd2180c8a90 2024-04-18T04:57:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21e5c2640 1 -- 172.21.15.96:0/2182721356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2180c8a90 msgr2=0x7fd2180cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21e5c2640 1 --2- 172.21.15.96:0/2182721356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2180c8a90 0x7fd2180cc960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0098a0 tx=0x7fd20c01c4d0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21e5c2640 1 -- 172.21.15.96:0/2182721356 shutdown_connections 2024-04-18T04:57:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21e5c2640 1 --2- 172.21.15.96:0/2182721356 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2180ccea0 0x7fd21815c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21e5c2640 1 --2- 172.21.15.96:0/2182721356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2180c8a90 0x7fd2180cc960 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0098a0 tx=0x7fd20c01c4d0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21e5c2640 1 -- 172.21.15.96:0/2182721356 >> 172.21.15.96:0/2182721356 conn(0x7fd218065d90 msgr2=0x7fd2180661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:29.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21e5c2640 1 -- 172.21.15.96:0/2182721356 shutdown_connections 2024-04-18T04:57:29.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21e5c2640 1 -- 172.21.15.96:0/2182721356 wait complete. 2024-04-18T04:57:29.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21e5c2640 1 Processor -- start 2024-04-18T04:57:29.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21e5c2640 1 -- start start 2024-04-18T04:57:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21e5c2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2180ccea0 0x7fd2180c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21e5c2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd218156610 0x7fd2180b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21e5c2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2181f6240 0x7fd2181465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21e5c2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21815bee0 con 0x7fd218156610 2024-04-18T04:57:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21e5c2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2181514b0 con 0x7fd2180ccea0 2024-04-18T04:57:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21e5c2640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2180c2a60 con 0x7fd2181f6240 2024-04-18T04:57:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd217fff640 1 -- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2180ccea0 msgr2=0x7fd2180c2f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:57:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd2177fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd218156610 0x7fd2180b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd217fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2180ccea0 0x7fd2180c2f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd2177fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd218156610 0x7fd2180b0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41780/0 (socket says 172.21.15.96:41780) 2024-04-18T04:57:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd2177fe640 1 -- 172.21.15.96:0/2422962841 learned_addr learned my addr 172.21.15.96:0/2422962841 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd21cb5f640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2181f6240 0x7fd2181465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd2177fe640 1 -- 172.21.15.96:0/2422962841 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2181f6240 msgr2=0x7fd2181465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd2177fe640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2181f6240 0x7fd2181465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd2177fe640 1 -- 172.21.15.96:0/2422962841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2180ccea0 msgr2=0x7fd2180c2f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:57:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd2177fe640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2180ccea0 0x7fd2180c2f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd2177fe640 1 -- 172.21.15.96:0/2422962841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c0094d0 con 0x7fd218156610 2024-04-18T04:57:29.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.190+0000 7fd2177fe640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd218156610 0x7fd2180b0920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd20c01c510 tx=0x7fd20c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd214ff9640 1 -- 172.21.15.96:0/2422962841 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c004030 con 0x7fd218156610 2024-04-18T04:57:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd214ff9640 1 -- 172.21.15.96:0/2422962841 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c004190 con 0x7fd218156610 2024-04-18T04:57:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd214ff9640 1 -- 172.21.15.96:0/2422962841 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c004500 con 0x7fd218156610 2024-04-18T04:57:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd21e5c2640 1 -- 172.21.15.96:0/2422962841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd218151700 con 0x7fd218156610 2024-04-18T04:57:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd21e5c2640 1 -- 172.21.15.96:0/2422962841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2181519e0 con 0x7fd218156610 2024-04-18T04:57:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd21e5c2640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd21815c200 0x7fd218146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd21e5c2640 1 -- 172.21.15.96:0/2422962841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd218147070 con 0x7fd21815c200 2024-04-18T04:57:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd217fff640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd21815c200 0x7fd218146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd217fff640 1 -- 172.21.15.96:0/2422962841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd21815bcd0 con 0x7fd21815c200 2024-04-18T04:57:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd217fff640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd21815c200 0x7fd218146b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd20800b450 tx=0x7fd20800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:29.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd214ff9640 1 -- 172.21.15.96:0/2422962841 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd20c0b3040 con 0x7fd218156610 2024-04-18T04:57:29.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd214ff9640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd204066670 0x7fd204068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:29.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd214ff9640 1 -- 172.21.15.96:0/2422962841 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd20c11d5c0 con 0x7fd218156610 2024-04-18T04:57:29.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd21cb5f640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd204066670 0x7fd204068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:29.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd214ff9640 1 -- 172.21.15.96:0/2422962841 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208003e20 con 0x7fd21815c200 2024-04-18T04:57:29.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd214ff9640 1 -- 172.21.15.96:0/2422962841 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fd208005070 con 0x7fd21815c200 2024-04-18T04:57:29.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd214ff9640 1 -- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd21815c200 msgr2=0x7fd218146b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:29.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd214ff9640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd21815c200 0x7fd218146b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd20800b450 tx=0x7fd20800b910 comp rx=0 tx=0).stop 2024-04-18T04:57:29.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd214ff9640 1 -- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd21815c200 msgr2=0x7fd218146b30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:29.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.194+0000 7fd214ff9640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd21815c200 0x7fd218146b30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.198+0000 7fd21cb5f640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd204066670 0x7fd204068b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd210009f80 tx=0x7fd21000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd21e5c2640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2181f6650 0x7fd2181f97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd21e5c2640 1 -- 172.21.15.96:0/2422962841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21806ac70 con 0x7fd2181f6650 2024-04-18T04:57:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd217fff640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2181f6650 0x7fd2181f97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:29.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd217fff640 1 -- 172.21.15.96:0/2422962841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd2180c8380 con 0x7fd2181f6650 2024-04-18T04:57:29.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd217fff640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2181f6650 0x7fd2181f97b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd20800b450 tx=0x7fd208005a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:29.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd214ff9640 1 -- 172.21.15.96:0/2422962841 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208020070 con 0x7fd2181f6650 2024-04-18T04:57:29.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd214ff9640 1 -- 172.21.15.96:0/2422962841 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4966 (secure 0 0 0) 0x7fd20801bd80 con 0x7fd2181f6650 2024-04-18T04:57:29.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd214ff9640 1 -- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2181f6650 msgr2=0x7fd2181f97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:29.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd214ff9640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2181f6650 0x7fd2181f97b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd20800b450 tx=0x7fd208005a30 comp rx=0 tx=0).stop 2024-04-18T04:57:29.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd214ff9640 1 -- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2181f6650 msgr2=0x7fd2181f97b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:29.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd214ff9640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2181f6650 0x7fd2181f97b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.208 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:57:29.208 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:57:29.208 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:57:29.208 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T04:57:29.208 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 30, 2024-04-18T04:57:29.208 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:57:29.208 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:57:29.208 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:57:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 0, 2024-04-18T04:57:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:57:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:57:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:29.209 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:29.210 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:29.210 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:57:29.210 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:57:29.210 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:29.210 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:29.210 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:29.210 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:29.210 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:29.210 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:29.210 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:29.210 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:29.210 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:29.210 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:29.210 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:29.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.211 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:57:29.211 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:57:29.211 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:57:29.211 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:57:29.211 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:57:29.211 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:57:29.211 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:29.211 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:29.211 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:57:29.211 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:57:29.211 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:57:29.211 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:57:29.211 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:57:29.211 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:57:29.212 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:57:29.212 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:29.212 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:57:29.212 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:29.212 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:29.212 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:29.212 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:29.212 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:29.212 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:29.212 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:29.212 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:29.212 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:29.212 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:29.213 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:29.213 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:57:29.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.213 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:57:29.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.213 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:57:29.213 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:57:29.213 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:29.213 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:29.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.213 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:29.213 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:57:29.213 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:29.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.214 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:29.214 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:57:29.214 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:29.214 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.214 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:29.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.214 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:57:29.214 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:57:29.214 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:29.214 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:29.214 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:29.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.214 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:57:29.215 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:57:29.215 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:29.215 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:29.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.215 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:29.215 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:57:29.215 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:29.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.215 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:29.215 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:57:29.215 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:29.215 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.215 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:29.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.216 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:57:29.216 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:57:29.216 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:29.216 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:29.216 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:29.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.216 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:57:29.216 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:57:29.216 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:29.216 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:29.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.216 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:29.216 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:57:29.216 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:57:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:57:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:57:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:29.217 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:57:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:57:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:57:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:57:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.218 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:29.219 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:29.219 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:57:29.219 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.219 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:29.219 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:57:29.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.219 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:29.219 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:29.219 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:57:29.219 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.219 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:29.219 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:57:29.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.219 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:29.219 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:29.220 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5 2024-04-18T04:57:29.220 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.220 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:29.220 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:57:29.220 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.220 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:29.220 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:29.220 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:57:29.220 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.220 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:29.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.220 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:57:29.220 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:57:29.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd21e5c2640 1 -- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd204066670 msgr2=0x7fd204068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:29.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd21e5c2640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd204066670 0x7fd204068b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd210009f80 tx=0x7fd21000b040 comp rx=0 tx=0).stop 2024-04-18T04:57:29.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd21e5c2640 1 -- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd218156610 msgr2=0x7fd2180b0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:29.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd21e5c2640 1 --2- 172.21.15.96:0/2422962841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd218156610 0x7fd2180b0920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd20c01c510 tx=0x7fd20c01ad10 comp rx=0 tx=0).stop 2024-04-18T04:57:29.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd21cb5f640 1 -- 172.21.15.96:0/2422962841 reap_dead start 2024-04-18T04:57:29.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd21cb5f640 1 -- 172.21.15.96:0/2422962841 reap_dead start 2024-04-18T04:57:29.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd21e5c2640 1 -- 172.21.15.96:0/2422962841 shutdown_connections 2024-04-18T04:57:29.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.202+0000 7fd21e5c2640 1 -- 172.21.15.96:0/2422962841 >> 172.21.15.96:0/2422962841 conn(0x7fd218065d90 msgr2=0x7fd218155860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:29.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.206+0000 7fd21e5c2640 1 -- 172.21.15.96:0/2422962841 shutdown_connections 2024-04-18T04:57:29.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.206+0000 7fd21e5c2640 1 -- 172.21.15.96:0/2422962841 wait complete. 2024-04-18T04:57:29.227 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-18T04:57:29.227 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-18T04:57:29.227 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-18T04:57:29.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.346+0000 7fcf005a4640 1 Processor -- start 2024-04-18T04:57:29.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.346+0000 7fcf005a4640 1 -- start start 2024-04-18T04:57:29.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.350+0000 7fcf005a4640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fcef80c20c0 0x7fcef8156d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:29.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.350+0000 7fcf005a4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcef80c8640 0x7fcef80cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.350+0000 7fcf005a4640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef80c7bf0 con 0x7fcef8150f50 2024-04-18T04:57:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.350+0000 7fcf005a4640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef80c7130 con 0x7fcef80c8640 2024-04-18T04:57:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.350+0000 7fcf005a4640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef80c7410 con 0x7fcef80c20c0 2024-04-18T04:57:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.350+0000 7fcefe340640 1 -- >> v1:172.21.15.139:6789/0 conn(0x7fcef8150f50 legacy=0x7fcef806ead0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:57:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.350+0000 7fcefdb3f640 1 -- >> v2:172.21.15.139:3300/0 conn(0x7fcef80c20c0 msgr2=0x7fcef8156d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:57:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.350+0000 7fcefdb3f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fcef80c20c0 0x7fcef8156d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.350+0000 7fcefeb41640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcef80c8640 0x7fcef80cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.350+0000 7fcefeb41640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcef80c8640 0x7fcef80cc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41808/0 (socket says 172.21.15.96:41808) 2024-04-18T04:57:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.350+0000 7fcefeb41640 1 -- 172.21.15.96:0/3576351388 learned_addr learned my addr 172.21.15.96:0/3576351388 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.350+0000 7fcefeb41640 1 -- 172.21.15.96:0/3576351388 >> v2:172.21.15.139:3300/0 conn(0x7fcef80c20c0 msgr2=0x7fcef8156d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:57:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.350+0000 7fcefeb41640 1 --2- 172.21.15.96:0/3576351388 >> v2:172.21.15.139:3300/0 conn(0x7fcef80c20c0 0x7fcef8156d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.350+0000 7fcefeb41640 1 -- 172.21.15.96:0/3576351388 >> v1:172.21.15.139:6789/0 conn(0x7fcef8150f50 legacy=0x7fcef806ead0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:57:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.350+0000 7fcefeb41640 1 -- 172.21.15.96:0/3576351388 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef80c76f0 con 0x7fcef80c8640 2024-04-18T04:57:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcefeb41640 1 --2- 172.21.15.96:0/3576351388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef80c8640 0x7fcef80cc9b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcef80c3a30 tx=0x7fcef001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6215723a53a85f9e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcefd33e640 1 -- 172.21.15.96:0/3576351388 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef00a5860 con 0x7fcef80c8640 2024-04-18T04:57:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcefd33e640 1 -- 172.21.15.96:0/3576351388 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef00a59c0 con 0x7fcef80c8640 2024-04-18T04:57:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcefd33e640 1 -- 172.21.15.96:0/3576351388 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef00a5d50 con 0x7fcef80c8640 2024-04-18T04:57:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcf005a4640 1 -- 172.21.15.96:0/3576351388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef80c8640 msgr2=0x7fcef80cc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcf005a4640 1 --2- 172.21.15.96:0/3576351388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef80c8640 0x7fcef80cc9b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcef80c3a30 tx=0x7fcef001c9a0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcf005a4640 1 -- 172.21.15.96:0/3576351388 shutdown_connections 2024-04-18T04:57:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcf005a4640 1 --2- 172.21.15.96:0/3576351388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef80c8640 0x7fcef80cc9b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcf005a4640 1 --2- 172.21.15.96:0/3576351388 >> v2:172.21.15.139:3300/0 conn(0x7fcef80c20c0 0x7fcef8156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcf005a4640 1 -- 172.21.15.96:0/3576351388 >> 172.21.15.96:0/3576351388 conn(0x7fcef8065d90 msgr2=0x7fcef80661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:29.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcf005a4640 1 -- 172.21.15.96:0/3576351388 shutdown_connections 2024-04-18T04:57:29.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcf005a4640 1 -- 172.21.15.96:0/3576351388 wait complete. 2024-04-18T04:57:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcf005a4640 1 Processor -- start 2024-04-18T04:57:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcf005a4640 1 -- start start 2024-04-18T04:57:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcf005a4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef80c8640 0x7fcef8144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcf005a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcef8150f50 0x7fcef8144540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcf005a4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef814ffb0 0x7fcef8155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcf005a4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8153880 con 0x7fcef80c8640 2024-04-18T04:57:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcf005a4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef81f0340 con 0x7fcef8150f50 2024-04-18T04:57:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.354+0000 7fcf005a4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8154560 con 0x7fcef814ffb0 2024-04-18T04:57:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefdb3f640 1 -- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcef8150f50 msgr2=0x7fcef8144540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:57:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefdb3f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcef8150f50 0x7fcef8144540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefe340640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef80c8640 0x7fcef8144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefe340640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef80c8640 0x7fcef8144000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41812/0 (socket says 172.21.15.96:41812) 2024-04-18T04:57:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefe340640 1 -- 172.21.15.96:0/1075321834 learned_addr learned my addr 172.21.15.96:0/1075321834 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefeb41640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef814ffb0 0x7fcef8155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefe340640 1 -- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef814ffb0 msgr2=0x7fcef8155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefe340640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef814ffb0 0x7fcef8155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefe340640 1 -- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcef8150f50 msgr2=0x7fcef8144540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:57:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefe340640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcef8150f50 0x7fcef8144540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefe340640 1 -- 172.21.15.96:0/1075321834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef0009b30 con 0x7fcef80c8640 2024-04-18T04:57:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefe340640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef80c8640 0x7fcef8144000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcef400b560 tx=0x7fcef400ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fceeeffd640 1 -- 172.21.15.96:0/1075321834 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4003dd0 con 0x7fcef80c8640 2024-04-18T04:57:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fceeeffd640 1 -- 172.21.15.96:0/1075321834 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef4005070 con 0x7fcef80c8640 2024-04-18T04:57:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcf005a4640 1 -- 172.21.15.96:0/1075321834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef81efde0 con 0x7fcef80c8640 2024-04-18T04:57:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fceeeffd640 1 -- 172.21.15.96:0/1075321834 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4005420 con 0x7fcef80c8640 2024-04-18T04:57:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcf005a4640 1 -- 172.21.15.96:0/1075321834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef814f4d0 con 0x7fcef80c8640 2024-04-18T04:57:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcf005a4640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef80c20c0 0x7fcef8155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcf005a4640 1 -- 172.21.15.96:0/1075321834 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef806ac70 con 0x7fcef80c20c0 2024-04-18T04:57:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefdb3f640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef80c20c0 0x7fcef8155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fceeeffd640 1 -- 172.21.15.96:0/1075321834 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcef4005580 con 0x7fcef80c8640 2024-04-18T04:57:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fceeeffd640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcedc066640 0x7fcedc068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:29.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fceeeffd640 1 -- 172.21.15.96:0/1075321834 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fcef4084190 con 0x7fcef80c8640 2024-04-18T04:57:29.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefeb41640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcedc066640 0x7fcedc068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:29.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefdb3f640 1 -- 172.21.15.96:0/1075321834 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcef8163dc0 con 0x7fcef80c20c0 2024-04-18T04:57:29.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefdb3f640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef80c20c0 0x7fcef8155890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcef8154840 tx=0x7fcee800b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:29.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fcefeb41640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcedc066640 0x7fcedc068b00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcef00ae000 tx=0x7fcef00a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:29.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.358+0000 7fceeeffd640 1 -- 172.21.15.96:0/1075321834 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8003d50 con 0x7fcef80c20c0 2024-04-18T04:57:29.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.362+0000 7fceeeffd640 1 -- 172.21.15.96:0/1075321834 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fcee8005070 con 0x7fcef80c20c0 2024-04-18T04:57:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.362+0000 7fceeeffd640 1 -- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef80c20c0 msgr2=0x7fcef8155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.362+0000 7fceeeffd640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef80c20c0 0x7fcef8155890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcef8154840 tx=0x7fcee800b8e0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.362+0000 7fceeeffd640 1 -- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef80c20c0 msgr2=0x7fcef8155890 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.362+0000 7fceeeffd640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef80c20c0 0x7fcef8155890 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcef8154840 tx=0x7fcee800b8e0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.366+0000 7fcf005a4640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef8154130 0x7fcef814e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:29.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.366+0000 7fcf005a4640 1 -- 172.21.15.96:0/1075321834 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8153dc0 con 0x7fcef8154130 2024-04-18T04:57:29.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.366+0000 7fcefdb3f640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef8154130 0x7fcef814e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fcefdb3f640 1 -- 172.21.15.96:0/1075321834 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcef81546a0 con 0x7fcef8154130 2024-04-18T04:57:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fcefdb3f640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef8154130 0x7fcef814e3e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcee8013000 tx=0x7fcee80059a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fceeeffd640 1 -- 172.21.15.96:0/1075321834 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee801b670 con 0x7fcef8154130 2024-04-18T04:57:29.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fceeeffd640 1 -- 172.21.15.96:0/1075321834 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4964 (secure 0 0 0) 0x7fcee801b7d0 con 0x7fcef8154130 2024-04-18T04:57:29.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fceeeffd640 1 -- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef8154130 msgr2=0x7fcef814e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:29.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fceeeffd640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef8154130 0x7fcef814e3e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcee8013000 tx=0x7fcee80059a0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fceeeffd640 1 -- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef8154130 msgr2=0x7fcef814e3e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:29.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fceeeffd640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcef8154130 0x7fcef814e3e0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcee8013000 tx=0x7fcee80059a0 comp rx=0 tx=0).stop 2024-04-18T04:57:29.374 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:57:29.374 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:57:29.374 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:57:29.374 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:57:29.374 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 30, 2024-04-18T04:57:29.375 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:57:29.375 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:57:29.375 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:57:29.375 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:29.375 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 0, 2024-04-18T04:57:29.375 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:29.375 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:57:29.375 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:57:29.375 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:29.375 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:29.375 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:29.375 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:29.375 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:29.375 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:29.375 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:29.375 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:29.376 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:29.376 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:29.376 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:29.376 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:57:29.376 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:57:29.376 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:29.376 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:29.376 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:29.376 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:29.376 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:29.376 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:29.376 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:29.376 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:29.376 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:29.376 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:29.376 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:29.377 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.377 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:57:29.377 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:57:29.377 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:57:29.377 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:57:29.377 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:57:29.377 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:57:29.377 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:29.377 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:29.377 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:57:29.377 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:57:29.377 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:57:29.377 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:57:29.377 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:57:29.377 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:57:29.377 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:57:29.378 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:29.378 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:57:29.378 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:29.378 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:29.378 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:29.378 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:29.378 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:29.378 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:29.378 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:29.378 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:29.378 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:29.378 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:29.378 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:29.378 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:57:29.378 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.379 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:57:29.379 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.379 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:57:29.379 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:57:29.379 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:29.379 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:29.379 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.379 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:29.379 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:57:29.379 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:29.379 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.379 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.379 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:29.379 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:57:29.379 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:29.380 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:57:29.381 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:29.381 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.381 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.381 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:29.381 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:57:29.381 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:29.381 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.381 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:29.381 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.381 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:57:29.381 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:57:29.381 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:29.381 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:29.381 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:29.381 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.382 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.382 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:57:29.382 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:57:29.382 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:29.382 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:29.382 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.382 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:29.382 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:57:29.382 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:29.382 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.382 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.382 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:29.382 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:57:29.382 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:29.383 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.383 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:29.383 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.383 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:57:29.383 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:57:29.383 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:29.383 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:29.383 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:29.383 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.383 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:29.383 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.383 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:57:29.383 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:57:29.383 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.383 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:29.383 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:29.384 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:57:29.384 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.384 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:29.384 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:57:29.384 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.384 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:29.384 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:29.384 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:57:29.384 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.384 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:29.384 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:57:29.384 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.384 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:29.384 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:29.384 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:57:29.385 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.385 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:29.385 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:57:29.385 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.385 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:29.385 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:29.385 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:57:29.385 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.385 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:29.385 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:57:29.385 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:29.385 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:29.385 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:29.385 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:57:29.385 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:29.386 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:29.386 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:29.386 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:57:29.386 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:57:29.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fcf005a4640 1 -- 172.21.15.96:0/1075321834 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcedc066640 msgr2=0x7fcedc068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:29.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fcf005a4640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcedc066640 0x7fcedc068b00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcef00ae000 tx=0x7fcef00a7070 comp rx=0 tx=0).stop 2024-04-18T04:57:29.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fcf005a4640 1 -- 172.21.15.96:0/1075321834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef80c8640 msgr2=0x7fcef8144000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:29.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fcf005a4640 1 --2- 172.21.15.96:0/1075321834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcef80c8640 0x7fcef8144000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcef400b560 tx=0x7fcef400ba20 comp rx=0 tx=0).stop 2024-04-18T04:57:29.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fcefeb41640 1 -- 172.21.15.96:0/1075321834 reap_dead start 2024-04-18T04:57:29.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fcefeb41640 1 -- 172.21.15.96:0/1075321834 reap_dead start 2024-04-18T04:57:29.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fcf005a4640 1 -- 172.21.15.96:0/1075321834 shutdown_connections 2024-04-18T04:57:29.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fcf005a4640 1 -- 172.21.15.96:0/1075321834 >> 172.21.15.96:0/1075321834 conn(0x7fcef8065d90 msgr2=0x7fcef80caa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:29.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fcf005a4640 1 -- 172.21.15.96:0/1075321834 shutdown_connections 2024-04-18T04:57:29.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:29.370+0000 7fcf005a4640 1 -- 172.21.15.96:0/1075321834 wait complete. 2024-04-18T04:57:29.392 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-18T04:57:29.392 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-18T04:57:47.874 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:57:47.877 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:57:49.393 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-18T04:57:49.393 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-04-18T04:57:49.393 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-18T04:57:49.394 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-18T04:57:49.396 INFO:tasks.ceph.mon.b:Started 2024-04-18T04:57:49.396 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-18T04:57:49.396 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:57:49.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f6501c04640 1 Processor -- start 2024-04-18T04:57:49.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f6501c04640 1 -- start start 2024-04-18T04:57:49.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f6501c04640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc0c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:49.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f6501c04640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 0x7f64fc15cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:49.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f6501c04640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64fc1533c0 con 0x7f64fc0c4510 2024-04-18T04:57:49.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f6501c04640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64fc0ca390 con 0x7f64fc0c9f00 2024-04-18T04:57:49.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f6501c04640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0c4950 con 0x7f64fc152fe0 2024-04-18T04:57:49.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f64fb7fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:49.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f64fbfff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 0x7f64fc15cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:49.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f64fb7fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc0c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:48404/0 (socket says 172.21.15.96:48404) 2024-04-18T04:57:49.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f64faffd640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f64fc0c4510 0x7f64fc15c480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.96:41550/0 (socket says 172.21.15.96:41550) 2024-04-18T04:57:49.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 learned_addr learned my addr 172.21.15.96:0/4107782311 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:49.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f64fbfff640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 msgr2=0x7f64fc15cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T04:57:49.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f64fbfff640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 msgr2=0x7f64fc15cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:49.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f64fbfff640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 0x7f64fc15cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:49.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f64fbfff640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 0x7f64fc15cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:49.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 msgr2=0x7f64fc0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:57:49.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 msgr2=0x7f64fc0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:49.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc0c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:49.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.538+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc0c9160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:49.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.742+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:49.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.742+0000 7f64fbfff640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 0x7f64fc15cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:49.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.742+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 msgr2=0x7f64fc0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:57:49.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.742+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 msgr2=0x7f64fc0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:49.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.742+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc0c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:49.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.742+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc0c9160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:57:49.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.742+0000 7f64fbfff640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 msgr2=0x7f64fc15cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T04:57:49.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.742+0000 7f64fbfff640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 msgr2=0x7f64fc15cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:49.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.742+0000 7f64fbfff640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 0x7f64fc15cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:49.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:49.742+0000 7f64fbfff640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 0x7f64fc15cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:57:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.146+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.146+0000 7f64fbfff640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 0x7f64fc15cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.146+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 msgr2=0x7f64fc0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:57:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.146+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 msgr2=0x7f64fc0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:50.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.146+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc0c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:50.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.146+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc0c9160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:57:50.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.146+0000 7f64fbfff640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 msgr2=0x7f64fc15cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T04:57:50.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.146+0000 7f64fbfff640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 msgr2=0x7f64fc15cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:50.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.146+0000 7f64fbfff640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 0x7f64fc15cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:50.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.146+0000 7f64fbfff640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 0x7f64fc15cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:57:50.519 INFO:tasks.workunit.client.0.smithi096.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-18T04:57:50.530 INFO:tasks.workunit.client.0.smithi096.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-18T04:57:50.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ make 2024-04-18T04:57:50.658 INFO:tasks.workunit.client.0.smithi096.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-18T04:57:50.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.950+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:50.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.950+0000 7f64fbfff640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 0x7f64fc15cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:50.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.950+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 msgr2=0x7f64fc0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T04:57:50.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.950+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 msgr2=0x7f64fc0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.950+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc0c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.950+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc0c9160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:57:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.950+0000 7f64fbfff640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 msgr2=0x7f64fc15cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:57:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.950+0000 7f64fbfff640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 msgr2=0x7f64fc15cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.950+0000 7f64fbfff640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 0x7f64fc15cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:50.950+0000 7f64fbfff640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 0x7f64fc15cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:57:51.595 INFO:tasks.workunit.client.0.smithi096.stderr:++ readlink -f fsstress 2024-04-18T04:57:51.597 INFO:tasks.workunit.client.0.smithi096.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-18T04:57:51.597 INFO:tasks.workunit.client.0.smithi096.stderr:+ popd 2024-04-18T04:57:51.599 INFO:tasks.workunit.client.0.smithi096.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-18T04:57:51.599 INFO:tasks.workunit.client.0.smithi096.stderr:+ popd 2024-04-18T04:57:51.600 INFO:tasks.workunit.client.0.smithi096.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-18T04:57:51.600 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp -d -p . 2024-04-18T04:57:51.604 INFO:tasks.workunit.client.0.smithi096.stderr:+ T=./tmp.vgR2QHme0q 2024-04-18T04:57:51.605 INFO:tasks.workunit.client.0.smithi096.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.vgR2QHme0q -l 1 -n 1000 -p 10 -v 2024-04-18T04:57:51.611 INFO:tasks.workunit.client.0.smithi096.stdout:seed = 1714026121 2024-04-18T04:57:51.619 INFO:tasks.workunit.client.0.smithi096.stdout:0/0: dwrite - no filename 2024-04-18T04:57:51.619 INFO:tasks.workunit.client.0.smithi096.stdout:0/1: write - no filename 2024-04-18T04:57:51.622 INFO:tasks.workunit.client.0.smithi096.stdout:1/0: dwrite - no filename 2024-04-18T04:57:51.622 INFO:tasks.workunit.client.0.smithi096.stdout:1/1: link - no file 2024-04-18T04:57:51.622 INFO:tasks.workunit.client.0.smithi096.stdout:1/2: unlink - no file 2024-04-18T04:57:51.622 INFO:tasks.workunit.client.0.smithi096.stdout:1/3: unlink - no file 2024-04-18T04:57:51.622 INFO:tasks.workunit.client.0.smithi096.stdout:1/4: dwrite - no filename 2024-04-18T04:57:51.622 INFO:tasks.workunit.client.0.smithi096.stdout:1/5: chown . 1 1 2024-04-18T04:57:51.622 INFO:tasks.workunit.client.0.smithi096.stdout:1/6: truncate - no filename 2024-04-18T04:57:51.622 INFO:tasks.workunit.client.0.smithi096.stdout:1/7: dwrite - no filename 2024-04-18T04:57:51.623 INFO:tasks.workunit.client.0.smithi096.stdout:1/8: read - no filename 2024-04-18T04:57:51.623 INFO:tasks.workunit.client.0.smithi096.stdout:1/9: truncate - no filename 2024-04-18T04:57:51.623 INFO:tasks.workunit.client.0.smithi096.stdout:1/10: stat - no entries 2024-04-18T04:57:51.623 INFO:tasks.workunit.client.0.smithi096.stdout:1/11: dread - no filename 2024-04-18T04:57:51.623 INFO:tasks.workunit.client.0.smithi096.stdout:1/12: dwrite - no filename 2024-04-18T04:57:51.623 INFO:tasks.workunit.client.0.smithi096.stdout:0/2: mknod c0 0 2024-04-18T04:57:51.625 INFO:tasks.workunit.client.0.smithi096.stdout:2/0: truncate - no filename 2024-04-18T04:57:51.627 INFO:tasks.workunit.client.0.smithi096.stdout:0/3: symlink l1 0 2024-04-18T04:57:51.628 INFO:tasks.workunit.client.0.smithi096.stdout:1/13: creat f0 x:0 0 0 2024-04-18T04:57:51.631 INFO:tasks.workunit.client.0.smithi096.stdout:3/0: dread - no filename 2024-04-18T04:57:51.631 INFO:tasks.workunit.client.0.smithi096.stdout:3/1: fsync - no filename 2024-04-18T04:57:51.633 INFO:tasks.workunit.client.0.smithi096.stdout:2/1: creat f0 x:0 0 0 2024-04-18T04:57:51.636 INFO:tasks.workunit.client.0.smithi096.stdout:4/0: rmdir - no directory 2024-04-18T04:57:51.636 INFO:tasks.workunit.client.0.smithi096.stdout:4/1: dwrite - no filename 2024-04-18T04:57:51.638 INFO:tasks.workunit.client.0.smithi096.stdout:2/2: mknod c1 0 2024-04-18T04:57:51.639 INFO:tasks.workunit.client.0.smithi096.stdout:3/2: creat f0 x:0 0 0 2024-04-18T04:57:51.646 INFO:tasks.workunit.client.0.smithi096.stdout:2/3: unlink c1 0 2024-04-18T04:57:51.648 INFO:tasks.workunit.client.0.smithi096.stdout:4/2: creat f0 x:0 0 0 2024-04-18T04:57:51.648 INFO:tasks.workunit.client.0.smithi096.stdout:4/3: dread - f0 zero size 2024-04-18T04:57:51.649 INFO:tasks.workunit.client.0.smithi096.stdout:6/0: truncate - no filename 2024-04-18T04:57:51.649 INFO:tasks.workunit.client.0.smithi096.stdout:6/1: dwrite - no filename 2024-04-18T04:57:51.649 INFO:tasks.workunit.client.0.smithi096.stdout:6/2: stat - no entries 2024-04-18T04:57:51.649 INFO:tasks.workunit.client.0.smithi096.stdout:6/3: truncate - no filename 2024-04-18T04:57:51.650 INFO:tasks.workunit.client.0.smithi096.stdout:6/4: dwrite - no filename 2024-04-18T04:57:51.650 INFO:tasks.workunit.client.0.smithi096.stdout:6/5: stat - no entries 2024-04-18T04:57:51.650 INFO:tasks.workunit.client.0.smithi096.stdout:6/6: write - no filename 2024-04-18T04:57:51.650 INFO:tasks.workunit.client.0.smithi096.stdout:6/7: truncate - no filename 2024-04-18T04:57:51.653 INFO:tasks.workunit.client.0.smithi096.stdout:2/4: creat f2 x:0 0 0 2024-04-18T04:57:51.656 INFO:tasks.workunit.client.0.smithi096.stdout:7/0: write - no filename 2024-04-18T04:57:51.656 INFO:tasks.workunit.client.0.smithi096.stdout:7/1: chown . 2 1 2024-04-18T04:57:51.656 INFO:tasks.workunit.client.0.smithi096.stdout:7/2: chown . 53641 1 2024-04-18T04:57:51.656 INFO:tasks.workunit.client.0.smithi096.stdout:7/3: dwrite - no filename 2024-04-18T04:57:51.657 INFO:tasks.workunit.client.0.smithi096.stdout:7/4: truncate - no filename 2024-04-18T04:57:51.657 INFO:tasks.workunit.client.0.smithi096.stdout:7/5: dread - no filename 2024-04-18T04:57:51.657 INFO:tasks.workunit.client.0.smithi096.stdout:5/0: creat f0 x:0 0 0 2024-04-18T04:57:51.659 INFO:tasks.workunit.client.0.smithi096.stdout:5/1: write f0 [398536,104124] 0 2024-04-18T04:57:51.659 INFO:tasks.workunit.client.0.smithi096.stdout:4/4: dwrite f0 [0,4194304] 0 2024-04-18T04:57:51.659 INFO:tasks.workunit.client.0.smithi096.stdout:2/5: symlink l3 0 2024-04-18T04:57:51.662 INFO:tasks.workunit.client.0.smithi096.stdout:6/8: mkdir d0 0 2024-04-18T04:57:51.662 INFO:tasks.workunit.client.0.smithi096.stdout:6/9: dread - no filename 2024-04-18T04:57:51.665 INFO:tasks.workunit.client.0.smithi096.stdout:8/0: write - no filename 2024-04-18T04:57:51.666 INFO:tasks.workunit.client.0.smithi096.stdout:8/1: chown . 7353 1 2024-04-18T04:57:51.666 INFO:tasks.workunit.client.0.smithi096.stdout:8/2: fsync - no filename 2024-04-18T04:57:51.666 INFO:tasks.workunit.client.0.smithi096.stdout:8/3: write - no filename 2024-04-18T04:57:51.666 INFO:tasks.workunit.client.0.smithi096.stdout:8/4: dread - no filename 2024-04-18T04:57:51.672 INFO:tasks.workunit.client.0.smithi096.stdout:5/2: dread f0 [0,4194304] 0 2024-04-18T04:57:51.673 INFO:tasks.workunit.client.0.smithi096.stdout:2/6: dwrite f2 [0,4194304] 0 2024-04-18T04:57:51.674 INFO:tasks.workunit.client.0.smithi096.stdout:9/0: dwrite - no filename 2024-04-18T04:57:51.674 INFO:tasks.workunit.client.0.smithi096.stdout:7/6: getdents . 0 2024-04-18T04:57:51.675 INFO:tasks.workunit.client.0.smithi096.stdout:7/7: readlink - no filename 2024-04-18T04:57:51.675 INFO:tasks.workunit.client.0.smithi096.stdout:5/3: dread f0 [0,4194304] 0 2024-04-18T04:57:51.675 INFO:tasks.workunit.client.0.smithi096.stdout:2/7: dread - f0 zero size 2024-04-18T04:57:51.679 INFO:tasks.workunit.client.0.smithi096.stdout:2/8: dread f2 [0,4194304] 0 2024-04-18T04:57:51.681 INFO:tasks.workunit.client.0.smithi096.stdout:6/10: mkdir d0/d1 0 2024-04-18T04:57:51.681 INFO:tasks.workunit.client.0.smithi096.stdout:6/11: dwrite - no filename 2024-04-18T04:57:51.681 INFO:tasks.workunit.client.0.smithi096.stdout:6/12: truncate - no filename 2024-04-18T04:57:51.681 INFO:tasks.workunit.client.0.smithi096.stdout:6/13: truncate - no filename 2024-04-18T04:57:51.681 INFO:tasks.workunit.client.0.smithi096.stdout:6/14: dread - no filename 2024-04-18T04:57:51.681 INFO:tasks.workunit.client.0.smithi096.stdout:6/15: link - no file 2024-04-18T04:57:51.681 INFO:tasks.workunit.client.0.smithi096.stdout:6/16: unlink - no file 2024-04-18T04:57:51.690 INFO:tasks.workunit.client.0.smithi096.stdout:8/5: mkdir d0 0 2024-04-18T04:57:51.690 INFO:tasks.workunit.client.0.smithi096.stdout:8/6: read - no filename 2024-04-18T04:57:51.690 INFO:tasks.workunit.client.0.smithi096.stdout:8/7: dread - no filename 2024-04-18T04:57:51.693 INFO:tasks.workunit.client.0.smithi096.stdout:2/9: creat f4 x:0 0 0 2024-04-18T04:57:51.695 INFO:tasks.workunit.client.0.smithi096.stdout:6/17: mknod d0/c2 0 2024-04-18T04:57:51.697 INFO:tasks.workunit.client.0.smithi096.stdout:9/1: getdents . 0 2024-04-18T04:57:51.697 INFO:tasks.workunit.client.0.smithi096.stdout:9/2: read - no filename 2024-04-18T04:57:51.697 INFO:tasks.workunit.client.0.smithi096.stdout:9/3: rename - no filename 2024-04-18T04:57:51.704 INFO:tasks.workunit.client.0.smithi096.stdout:2/10: write f2 [1130143,88578] 0 2024-04-18T04:57:51.704 INFO:tasks.workunit.client.0.smithi096.stdout:6/18: rmdir d0 39 2024-04-18T04:57:51.704 INFO:tasks.workunit.client.0.smithi096.stdout:6/19: dread - no filename 2024-04-18T04:57:51.704 INFO:tasks.workunit.client.0.smithi096.stdout:6/20: write - no filename 2024-04-18T04:57:51.704 INFO:tasks.workunit.client.0.smithi096.stdout:6/21: dread - no filename 2024-04-18T04:57:51.707 INFO:tasks.workunit.client.0.smithi096.stdout:8/8: symlink d0/l1 0 2024-04-18T04:57:51.707 INFO:tasks.workunit.client.0.smithi096.stdout:8/9: dread - no filename 2024-04-18T04:57:51.709 INFO:tasks.workunit.client.0.smithi096.stdout:2/11: mknod c5 0 2024-04-18T04:57:51.711 INFO:tasks.workunit.client.0.smithi096.stdout:9/4: mkdir d0 0 2024-04-18T04:57:51.712 INFO:tasks.workunit.client.0.smithi096.stdout:9/5: write - no filename 2024-04-18T04:57:51.712 INFO:tasks.workunit.client.0.smithi096.stdout:9/6: chown d0 44 1 2024-04-18T04:57:51.712 INFO:tasks.workunit.client.0.smithi096.stdout:9/7: truncate - no filename 2024-04-18T04:57:51.714 INFO:tasks.workunit.client.0.smithi096.stdout:2/12: rename l3 to l6 0 2024-04-18T04:57:51.717 INFO:tasks.workunit.client.0.smithi096.stdout:2/13: mknod c7 0 2024-04-18T04:57:51.718 INFO:tasks.workunit.client.0.smithi096.stdout:9/8: getdents d0 0 2024-04-18T04:57:51.718 INFO:tasks.workunit.client.0.smithi096.stdout:9/9: dwrite - no filename 2024-04-18T04:57:51.718 INFO:tasks.workunit.client.0.smithi096.stdout:9/10: stat d0 0 2024-04-18T04:57:51.721 INFO:tasks.workunit.client.0.smithi096.stdout:2/14: mknod c8 0 2024-04-18T04:57:51.724 INFO:tasks.workunit.client.0.smithi096.stdout:9/11: getdents d0 0 2024-04-18T04:57:51.725 INFO:tasks.workunit.client.0.smithi096.stdout:9/12: dread - no filename 2024-04-18T04:57:51.725 INFO:tasks.workunit.client.0.smithi096.stdout:2/15: dread f2 [0,4194304] 0 2024-04-18T04:57:51.728 INFO:tasks.workunit.client.0.smithi096.stdout:2/16: creat f9 x:0 0 0 2024-04-18T04:57:51.729 INFO:tasks.workunit.client.0.smithi096.stdout:9/13: symlink d0/l1 0 2024-04-18T04:57:51.732 INFO:tasks.workunit.client.0.smithi096.stdout:9/14: creat d0/f2 x:0 0 0 2024-04-18T04:57:51.739 INFO:tasks.workunit.client.0.smithi096.stdout:2/17: dwrite f0 [0,4194304] 0 2024-04-18T04:57:51.747 INFO:tasks.workunit.client.0.smithi096.stdout:9/15: dwrite d0/f2 [0,4194304] 0 2024-04-18T04:57:51.752 INFO:tasks.workunit.client.0.smithi096.stdout:2/18: dwrite f9 [0,4194304] 0 2024-04-18T04:57:51.763 INFO:tasks.workunit.client.0.smithi096.stdout:2/19: dwrite f4 [0,4194304] 0 2024-04-18T04:57:51.766 INFO:tasks.workunit.client.0.smithi096.stdout:2/20: write f2 [864203,116474] 0 2024-04-18T04:57:51.787 INFO:tasks.workunit.client.0.smithi096.stdout:1/14: getdents . 0 2024-04-18T04:57:51.787 INFO:tasks.workunit.client.0.smithi096.stdout:1/15: chown f0 4 1 2024-04-18T04:57:51.788 INFO:tasks.workunit.client.0.smithi096.stdout:1/16: write f0 [205205,4368] 0 2024-04-18T04:57:51.791 INFO:tasks.workunit.client.0.smithi096.stdout:1/17: symlink l1 0 2024-04-18T04:57:51.792 INFO:tasks.workunit.client.0.smithi096.stdout:1/18: write f0 [540818,92190] 0 2024-04-18T04:57:51.794 INFO:tasks.workunit.client.0.smithi096.stdout:5/4: fsync f0 0 2024-04-18T04:57:51.794 INFO:tasks.workunit.client.0.smithi096.stdout:5/5: rmdir - no directory 2024-04-18T04:57:51.796 INFO:tasks.workunit.client.0.smithi096.stdout:5/6: creat f1 x:0 0 0 2024-04-18T04:57:51.796 INFO:tasks.workunit.client.0.smithi096.stdout:4/5: write f0 [4819661,50577] 0 2024-04-18T04:57:51.799 INFO:tasks.workunit.client.0.smithi096.stdout:5/7: unlink f1 0 2024-04-18T04:57:51.801 INFO:tasks.workunit.client.0.smithi096.stdout:6/22: rmdir d0 39 2024-04-18T04:57:51.801 INFO:tasks.workunit.client.0.smithi096.stdout:6/23: write - no filename 2024-04-18T04:57:51.801 INFO:tasks.workunit.client.0.smithi096.stdout:6/24: fsync - no filename 2024-04-18T04:57:51.801 INFO:tasks.workunit.client.0.smithi096.stdout:6/25: fdatasync - no filename 2024-04-18T04:57:51.803 INFO:tasks.workunit.client.0.smithi096.stdout:4/6: dread f0 [0,4194304] 0 2024-04-18T04:57:51.803 INFO:tasks.workunit.client.0.smithi096.stdout:5/8: rename f0 to f2 0 2024-04-18T04:57:51.804 INFO:tasks.workunit.client.0.smithi096.stdout:6/26: chown d0/d1 59940 1 2024-04-18T04:57:51.804 INFO:tasks.workunit.client.0.smithi096.stdout:6/27: read - no filename 2024-04-18T04:57:51.804 INFO:tasks.workunit.client.0.smithi096.stdout:6/28: truncate - no filename 2024-04-18T04:57:51.808 INFO:tasks.workunit.client.0.smithi096.stdout:6/29: symlink d0/l3 0 2024-04-18T04:57:51.808 INFO:tasks.workunit.client.0.smithi096.stdout:6/30: dwrite - no filename 2024-04-18T04:57:51.809 INFO:tasks.workunit.client.0.smithi096.stdout:8/10: getdents d0 0 2024-04-18T04:57:51.809 INFO:tasks.workunit.client.0.smithi096.stdout:8/11: read - no filename 2024-04-18T04:57:51.812 INFO:tasks.workunit.client.0.smithi096.stdout:8/12: creat d0/f2 x:0 0 0 2024-04-18T04:57:51.813 INFO:tasks.workunit.client.0.smithi096.stdout:6/31: mknod d0/d1/c4 0 2024-04-18T04:57:51.813 INFO:tasks.workunit.client.0.smithi096.stdout:6/32: dread - no filename 2024-04-18T04:57:51.814 INFO:tasks.workunit.client.0.smithi096.stdout:8/13: mkdir d0/d3 0 2024-04-18T04:57:51.814 INFO:tasks.workunit.client.0.smithi096.stdout:4/7: dwrite f0 [0,4194304] 0 2024-04-18T04:57:51.815 INFO:tasks.workunit.client.0.smithi096.stdout:6/33: creat d0/f5 x:0 0 0 2024-04-18T04:57:51.818 INFO:tasks.workunit.client.0.smithi096.stdout:8/14: creat d0/d3/f4 x:0 0 0 2024-04-18T04:57:51.819 INFO:tasks.workunit.client.0.smithi096.stdout:9/16: truncate d0/f2 1469029 0 2024-04-18T04:57:51.822 INFO:tasks.workunit.client.0.smithi096.stdout:2/21: truncate f0 4058033 0 2024-04-18T04:57:51.824 INFO:tasks.workunit.client.0.smithi096.stdout:1/19: getdents . 0 2024-04-18T04:57:51.825 INFO:tasks.workunit.client.0.smithi096.stdout:1/20: fdatasync f0 0 2024-04-18T04:57:51.826 INFO:tasks.workunit.client.0.smithi096.stdout:1/21: readlink l1 0 2024-04-18T04:57:51.827 INFO:tasks.workunit.client.0.smithi096.stdout:6/34: dwrite d0/f5 [0,4194304] 0 2024-04-18T04:57:51.828 INFO:tasks.workunit.client.0.smithi096.stdout:1/22: write f0 [414803,85527] 0 2024-04-18T04:57:51.828 INFO:tasks.workunit.client.0.smithi096.stdout:4/8: fdatasync f0 0 2024-04-18T04:57:51.830 INFO:tasks.workunit.client.0.smithi096.stdout:4/9: write f0 [1452456,80923] 0 2024-04-18T04:57:51.831 INFO:tasks.workunit.client.0.smithi096.stdout:5/9: rename f2 to f3 0 2024-04-18T04:57:51.834 INFO:tasks.workunit.client.0.smithi096.stdout:1/23: rename l1 to l2 0 2024-04-18T04:57:51.836 INFO:tasks.workunit.client.0.smithi096.stdout:4/10: rename f0 to f1 0 2024-04-18T04:57:51.837 INFO:tasks.workunit.client.0.smithi096.stdout:6/35: rename d0/d1 to d0/d6 0 2024-04-18T04:57:51.840 INFO:tasks.workunit.client.0.smithi096.stdout:4/11: dread f1 [0,4194304] 0 2024-04-18T04:57:51.840 INFO:tasks.workunit.client.0.smithi096.stdout:6/36: creat d0/d6/f7 x:0 0 0 2024-04-18T04:57:51.841 INFO:tasks.workunit.client.0.smithi096.stdout:6/37: dread - d0/d6/f7 zero size 2024-04-18T04:57:51.842 INFO:tasks.workunit.client.0.smithi096.stdout:6/38: truncate d0/d6/f7 913596 0 2024-04-18T04:57:51.842 INFO:tasks.workunit.client.0.smithi096.stdout:8/15: rmdir d0 39 2024-04-18T04:57:51.849 INFO:tasks.workunit.client.0.smithi096.stdout:8/16: dread - d0/f2 zero size 2024-04-18T04:57:51.852 INFO:tasks.workunit.client.0.smithi096.stdout:1/24: getdents . 0 2024-04-18T04:57:51.853 INFO:tasks.workunit.client.0.smithi096.stdout:8/17: read - d0/f2 zero size 2024-04-18T04:57:51.857 INFO:tasks.workunit.client.0.smithi096.stdout:9/17: dwrite d0/f2 [0,4194304] 0 2024-04-18T04:57:51.858 INFO:tasks.workunit.client.0.smithi096.stdout:1/25: symlink l3 0 2024-04-18T04:57:51.859 INFO:tasks.workunit.client.0.smithi096.stdout:8/18: mknod d0/c5 0 2024-04-18T04:57:51.860 INFO:tasks.workunit.client.0.smithi096.stdout:4/12: dwrite f1 [0,4194304] 0 2024-04-18T04:57:51.861 INFO:tasks.workunit.client.0.smithi096.stdout:6/39: dwrite d0/d6/f7 [0,4194304] 0 2024-04-18T04:57:51.862 INFO:tasks.workunit.client.0.smithi096.stdout:1/26: fdatasync f0 0 2024-04-18T04:57:51.862 INFO:tasks.workunit.client.0.smithi096.stdout:8/19: readlink d0/l1 0 2024-04-18T04:57:51.862 INFO:tasks.workunit.client.0.smithi096.stdout:2/22: dread f0 [0,4194304] 0 2024-04-18T04:57:51.863 INFO:tasks.workunit.client.0.smithi096.stdout:2/23: stat c5 0 2024-04-18T04:57:51.867 INFO:tasks.workunit.client.0.smithi096.stdout:9/18: rename d0/f2 to d0/f3 0 2024-04-18T04:57:51.872 INFO:tasks.workunit.client.0.smithi096.stdout:2/24: write f9 [2712357,75451] 0 2024-04-18T04:57:51.873 INFO:tasks.workunit.client.0.smithi096.stdout:4/13: mknod c2 0 2024-04-18T04:57:51.874 INFO:tasks.workunit.client.0.smithi096.stdout:1/27: creat f4 x:0 0 0 2024-04-18T04:57:51.876 INFO:tasks.workunit.client.0.smithi096.stdout:4/14: symlink l3 0 2024-04-18T04:57:51.877 INFO:tasks.workunit.client.0.smithi096.stdout:2/25: write f0 [889705,67183] 0 2024-04-18T04:57:51.881 INFO:tasks.workunit.client.0.smithi096.stdout:4/15: mkdir d4 0 2024-04-18T04:57:51.883 INFO:tasks.workunit.client.0.smithi096.stdout:4/16: fdatasync f1 0 2024-04-18T04:57:51.884 INFO:tasks.workunit.client.0.smithi096.stdout:8/20: dwrite d0/d3/f4 [0,4194304] 0 2024-04-18T04:57:51.886 INFO:tasks.workunit.client.0.smithi096.stdout:9/19: truncate d0/f3 709214 0 2024-04-18T04:57:51.887 INFO:tasks.workunit.client.0.smithi096.stdout:6/40: dwrite d0/d6/f7 [0,4194304] 0 2024-04-18T04:57:51.891 INFO:tasks.workunit.client.0.smithi096.stdout:1/28: dwrite f4 [0,4194304] 0 2024-04-18T04:57:51.894 INFO:tasks.workunit.client.0.smithi096.stdout:8/21: rename d0/c5 to d0/c6 0 2024-04-18T04:57:51.894 INFO:tasks.workunit.client.0.smithi096.stdout:9/20: symlink d0/l4 0 2024-04-18T04:57:51.894 INFO:tasks.workunit.client.0.smithi096.stdout:8/22: fsync d0/f2 0 2024-04-18T04:57:51.894 INFO:tasks.workunit.client.0.smithi096.stdout:2/26: dread f0 [0,4194304] 0 2024-04-18T04:57:51.895 INFO:tasks.workunit.client.0.smithi096.stdout:2/27: fdatasync f4 0 2024-04-18T04:57:51.895 INFO:tasks.workunit.client.0.smithi096.stdout:8/23: read d0/d3/f4 [2721886,67954] 0 2024-04-18T04:57:51.899 INFO:tasks.workunit.client.0.smithi096.stdout:6/41: dread d0/d6/f7 [0,4194304] 0 2024-04-18T04:57:51.899 INFO:tasks.workunit.client.0.smithi096.stdout:4/17: truncate f1 2937534 0 2024-04-18T04:57:51.900 INFO:tasks.workunit.client.0.smithi096.stdout:1/29: rename f0 to f5 0 2024-04-18T04:57:51.901 INFO:tasks.workunit.client.0.smithi096.stdout:1/30: truncate f5 1568849 0 2024-04-18T04:57:51.901 INFO:tasks.workunit.client.0.smithi096.stdout:1/31: stat f5 0 2024-04-18T04:57:51.902 INFO:tasks.workunit.client.0.smithi096.stdout:8/24: dread d0/d3/f4 [0,4194304] 0 2024-04-18T04:57:51.904 INFO:tasks.workunit.client.0.smithi096.stdout:9/21: rmdir d0 39 2024-04-18T04:57:51.906 INFO:tasks.workunit.client.0.smithi096.stdout:2/28: readlink l6 0 2024-04-18T04:57:51.907 INFO:tasks.workunit.client.0.smithi096.stdout:6/42: write d0/d6/f7 [3151639,28834] 0 2024-04-18T04:57:51.908 INFO:tasks.workunit.client.0.smithi096.stdout:1/32: fdatasync f5 0 2024-04-18T04:57:51.911 INFO:tasks.workunit.client.0.smithi096.stdout:9/22: chown d0 150 1 2024-04-18T04:57:51.912 INFO:tasks.workunit.client.0.smithi096.stdout:2/29: rename c5 to ca 0 2024-04-18T04:57:51.913 INFO:tasks.workunit.client.0.smithi096.stdout:4/18: truncate f1 1911124 0 2024-04-18T04:57:51.913 INFO:tasks.workunit.client.0.smithi096.stdout:1/33: creat f6 x:0 0 0 2024-04-18T04:57:51.913 INFO:tasks.workunit.client.0.smithi096.stdout:2/30: write f4 [1317608,99129] 0 2024-04-18T04:57:51.914 INFO:tasks.workunit.client.0.smithi096.stdout:8/25: unlink d0/d3/f4 0 2024-04-18T04:57:51.915 INFO:tasks.workunit.client.0.smithi096.stdout:1/34: mknod c7 0 2024-04-18T04:57:51.916 INFO:tasks.workunit.client.0.smithi096.stdout:1/35: chown l3 490760889 1 2024-04-18T04:57:51.917 INFO:tasks.workunit.client.0.smithi096.stdout:2/31: unlink l6 0 2024-04-18T04:57:51.918 INFO:tasks.workunit.client.0.smithi096.stdout:8/26: mkdir d0/d7 0 2024-04-18T04:57:51.918 INFO:tasks.workunit.client.0.smithi096.stdout:2/32: chown f2 47 1 2024-04-18T04:57:51.918 INFO:tasks.workunit.client.0.smithi096.stdout:6/43: dwrite d0/d6/f7 [4194304,4194304] 0 2024-04-18T04:57:51.918 INFO:tasks.workunit.client.0.smithi096.stdout:9/23: link d0/l1 d0/l5 0 2024-04-18T04:57:51.919 INFO:tasks.workunit.client.0.smithi096.stdout:6/44: fsync d0/f5 0 2024-04-18T04:57:51.920 INFO:tasks.workunit.client.0.smithi096.stdout:6/45: chown d0 31683464 1 2024-04-18T04:57:51.920 INFO:tasks.workunit.client.0.smithi096.stdout:8/27: creat d0/d3/f8 x:0 0 0 2024-04-18T04:57:51.920 INFO:tasks.workunit.client.0.smithi096.stdout:9/24: rmdir d0 39 2024-04-18T04:57:51.922 INFO:tasks.workunit.client.0.smithi096.stdout:6/46: creat d0/d6/f8 x:0 0 0 2024-04-18T04:57:51.925 INFO:tasks.workunit.client.0.smithi096.stdout:9/25: creat d0/f6 x:0 0 0 2024-04-18T04:57:51.925 INFO:tasks.workunit.client.0.smithi096.stdout:9/26: rename d0 to d0/d7 22 2024-04-18T04:57:51.926 INFO:tasks.workunit.client.0.smithi096.stdout:4/19: write f1 [1397398,13963] 0 2024-04-18T04:57:51.927 INFO:tasks.workunit.client.0.smithi096.stdout:1/36: fsync f6 0 2024-04-18T04:57:51.927 INFO:tasks.workunit.client.0.smithi096.stdout:1/37: rmdir - no directory 2024-04-18T04:57:51.927 INFO:tasks.workunit.client.0.smithi096.stdout:4/20: write f1 [778547,114576] 0 2024-04-18T04:57:51.928 INFO:tasks.workunit.client.0.smithi096.stdout:8/28: link d0/d3/f8 d0/f9 0 2024-04-18T04:57:51.935 INFO:tasks.workunit.client.0.smithi096.stdout:4/21: creat d4/f5 x:0 0 0 2024-04-18T04:57:51.936 INFO:tasks.workunit.client.0.smithi096.stdout:1/38: dwrite f6 [0,4194304] 0 2024-04-18T04:57:51.938 INFO:tasks.workunit.client.0.smithi096.stdout:6/47: getdents d0/d6 0 2024-04-18T04:57:51.938 INFO:tasks.workunit.client.0.smithi096.stdout:2/33: truncate f2 3886548 0 2024-04-18T04:57:51.939 INFO:tasks.workunit.client.0.smithi096.stdout:9/27: rmdir d0 39 2024-04-18T04:57:51.940 INFO:tasks.workunit.client.0.smithi096.stdout:6/48: write d0/d6/f8 [49853,88897] 0 2024-04-18T04:57:51.944 INFO:tasks.workunit.client.0.smithi096.stdout:6/49: write d0/d6/f7 [7790018,116603] 0 2024-04-18T04:57:51.951 INFO:tasks.workunit.client.0.smithi096.stdout:9/28: dread d0/f3 [0,4194304] 0 2024-04-18T04:57:51.952 INFO:tasks.workunit.client.0.smithi096.stdout:4/22: dwrite f1 [0,4194304] 0 2024-04-18T04:57:51.952 INFO:tasks.workunit.client.0.smithi096.stdout:2/34: dread f9 [0,4194304] 0 2024-04-18T04:57:51.953 INFO:tasks.workunit.client.0.smithi096.stdout:1/39: dwrite f6 [0,4194304] 0 2024-04-18T04:57:51.954 INFO:tasks.workunit.client.0.smithi096.stdout:9/29: dread d0/f3 [0,4194304] 0 2024-04-18T04:57:51.955 INFO:tasks.workunit.client.0.smithi096.stdout:4/23: rmdir d4 39 2024-04-18T04:57:51.956 INFO:tasks.workunit.client.0.smithi096.stdout:1/40: rename c7 to c8 0 2024-04-18T04:57:51.957 INFO:tasks.workunit.client.0.smithi096.stdout:9/30: mknod d0/c8 0 2024-04-18T04:57:51.960 INFO:tasks.workunit.client.0.smithi096.stdout:4/24: symlink d4/l6 0 2024-04-18T04:57:51.960 INFO:tasks.workunit.client.0.smithi096.stdout:9/31: chown d0/l5 1 1 2024-04-18T04:57:51.962 INFO:tasks.workunit.client.0.smithi096.stdout:4/25: write d4/f5 [187591,79902] 0 2024-04-18T04:57:51.962 INFO:tasks.workunit.client.0.smithi096.stdout:4/26: readlink l3 0 2024-04-18T04:57:51.963 INFO:tasks.workunit.client.0.smithi096.stdout:4/27: truncate d4/f5 575722 0 2024-04-18T04:57:51.967 INFO:tasks.workunit.client.0.smithi096.stdout:1/41: dread f6 [0,4194304] 0 2024-04-18T04:57:51.968 INFO:tasks.workunit.client.0.smithi096.stdout:2/35: dwrite f0 [0,4194304] 0 2024-04-18T04:57:51.971 INFO:tasks.workunit.client.0.smithi096.stdout:4/28: dread f1 [0,4194304] 0 2024-04-18T04:57:51.971 INFO:tasks.workunit.client.0.smithi096.stdout:2/36: unlink c7 0 2024-04-18T04:57:51.971 INFO:tasks.workunit.client.0.smithi096.stdout:4/29: chown d4/l6 10 1 2024-04-18T04:57:51.972 INFO:tasks.workunit.client.0.smithi096.stdout:2/37: write f4 [2507315,55815] 0 2024-04-18T04:57:51.975 INFO:tasks.workunit.client.0.smithi096.stdout:2/38: write f9 [220424,118118] 0 2024-04-18T04:57:51.977 INFO:tasks.workunit.client.0.smithi096.stdout:4/30: link c2 d4/c7 0 2024-04-18T04:57:51.977 INFO:tasks.workunit.client.0.smithi096.stdout:4/31: chown l3 3701 1 2024-04-18T04:57:51.978 INFO:tasks.workunit.client.0.smithi096.stdout:1/42: truncate f5 494373 0 2024-04-18T04:57:51.978 INFO:tasks.workunit.client.0.smithi096.stdout:4/32: fdatasync d4/f5 0 2024-04-18T04:57:51.980 INFO:tasks.workunit.client.0.smithi096.stdout:2/39: dread f9 [0,4194304] 0 2024-04-18T04:57:51.986 INFO:tasks.workunit.client.0.smithi096.stdout:4/33: dwrite f1 [0,4194304] 0 2024-04-18T04:57:51.986 INFO:tasks.workunit.client.0.smithi096.stdout:2/40: truncate f4 3317051 0 2024-04-18T04:57:51.987 INFO:tasks.workunit.client.0.smithi096.stdout:4/34: mknod d4/c8 0 2024-04-18T04:57:51.988 INFO:tasks.workunit.client.0.smithi096.stdout:2/41: creat fb x:0 0 0 2024-04-18T04:57:51.989 INFO:tasks.workunit.client.0.smithi096.stdout:4/35: write f1 [308834,105949] 0 2024-04-18T04:57:51.989 INFO:tasks.workunit.client.0.smithi096.stdout:1/43: dread f5 [0,4194304] 0 2024-04-18T04:57:51.991 INFO:tasks.workunit.client.0.smithi096.stdout:4/36: creat d4/f9 x:0 0 0 2024-04-18T04:57:51.996 INFO:tasks.workunit.client.0.smithi096.stdout:2/42: dread f0 [0,4194304] 0 2024-04-18T04:57:51.996 INFO:tasks.workunit.client.0.smithi096.stdout:1/44: getdents . 0 2024-04-18T04:57:51.996 INFO:tasks.workunit.client.0.smithi096.stdout:2/43: readlink - no filename 2024-04-18T04:57:51.997 INFO:tasks.workunit.client.0.smithi096.stdout:4/37: dread f1 [0,4194304] 0 2024-04-18T04:57:51.998 INFO:tasks.workunit.client.0.smithi096.stdout:1/45: fsync f5 0 2024-04-18T04:57:51.999 INFO:tasks.workunit.client.0.smithi096.stdout:2/44: creat fc x:0 0 0 2024-04-18T04:57:52.001 INFO:tasks.workunit.client.0.smithi096.stdout:1/46: creat f9 x:0 0 0 2024-04-18T04:57:52.001 INFO:tasks.workunit.client.0.smithi096.stdout:1/47: chown f4 29605096 1 2024-04-18T04:57:52.001 INFO:tasks.workunit.client.0.smithi096.stdout:4/38: fsync d4/f9 0 2024-04-18T04:57:52.002 INFO:tasks.workunit.client.0.smithi096.stdout:4/39: chown d4/c8 235434 1 2024-04-18T04:57:52.005 INFO:tasks.workunit.client.0.smithi096.stdout:1/48: link f9 fa 0 2024-04-18T04:57:52.007 INFO:tasks.workunit.client.0.smithi096.stdout:2/45: getdents . 0 2024-04-18T04:57:52.009 INFO:tasks.workunit.client.0.smithi096.stdout:1/49: rename f5 to fb 0 2024-04-18T04:57:52.010 INFO:tasks.workunit.client.0.smithi096.stdout:1/50: chown l3 65 1 2024-04-18T04:57:52.010 INFO:tasks.workunit.client.0.smithi096.stdout:4/40: dwrite d4/f9 [0,4194304] 0 2024-04-18T04:57:52.014 INFO:tasks.workunit.client.0.smithi096.stdout:1/51: fdatasync f6 0 2024-04-18T04:57:52.014 INFO:tasks.workunit.client.0.smithi096.stdout:2/46: dread f9 [0,4194304] 0 2024-04-18T04:57:52.014 INFO:tasks.workunit.client.0.smithi096.stdout:1/52: read f4 [3889952,3785] 0 2024-04-18T04:57:52.014 INFO:tasks.workunit.client.0.smithi096.stdout:4/41: write f1 [1950567,79360] 0 2024-04-18T04:57:52.015 INFO:tasks.workunit.client.0.smithi096.stdout:2/47: write fb [928067,20463] 0 2024-04-18T04:57:52.017 INFO:tasks.workunit.client.0.smithi096.stdout:2/48: creat fd x:0 0 0 2024-04-18T04:57:52.017 INFO:tasks.workunit.client.0.smithi096.stdout:2/49: chown fd 27 1 2024-04-18T04:57:52.019 INFO:tasks.workunit.client.0.smithi096.stdout:2/50: fdatasync f0 0 2024-04-18T04:57:52.019 INFO:tasks.workunit.client.0.smithi096.stdout:1/53: dread f4 [0,4194304] 0 2024-04-18T04:57:52.021 INFO:tasks.workunit.client.0.smithi096.stdout:1/54: symlink lc 0 2024-04-18T04:57:52.021 INFO:tasks.workunit.client.0.smithi096.stdout:1/55: read fb [351290,26629] 0 2024-04-18T04:57:52.022 INFO:tasks.workunit.client.0.smithi096.stdout:1/56: write fb [129375,45011] 0 2024-04-18T04:57:52.030 INFO:tasks.workunit.client.0.smithi096.stdout:1/57: dwrite f4 [0,4194304] 0 2024-04-18T04:57:52.033 INFO:tasks.workunit.client.0.smithi096.stdout:1/58: creat fd x:0 0 0 2024-04-18T04:57:52.035 INFO:tasks.workunit.client.0.smithi096.stdout:1/59: mkdir de 0 2024-04-18T04:57:52.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.538+0000 7f64f97fa640 1 -- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 msgr2=0x7f64fc0c9160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:57:52.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.538+0000 7f64f97fa640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc0c9160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:52.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.538+0000 7f64f97fa640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 msgr2=0x7f64fc15cb90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:57:52.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.538+0000 7f64f97fa640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.139:3300/0 conn(0x7f64fc0c9f00 0x7f64fc15cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:52.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.538+0000 7f64f97fa640 1 -- 172.21.15.96:0/4107782311 >> v1:172.21.15.139:6789/0 conn(0x7f64fc0c4510 legacy=0x7f64fc15c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:52.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.538+0000 7f64f97fa640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 0x7f64e8005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:52.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.538+0000 7f64f97fa640 1 -- 172.21.15.96:0/4107782311 --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64fc066940 con 0x7f64e8006210 2024-04-18T04:57:52.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.538+0000 7f64f97fa640 1 -- 172.21.15.96:0/4107782311 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64fc0ca390 con 0x7f64e80036d0 2024-04-18T04:57:52.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.538+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 0x7f64e8005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:52.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.538+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 msgr2=0x7f64e8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:57:52.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.538+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 msgr2=0x7f64e8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:52.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.538+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 0x7f64e8005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:52.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.538+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 0x7f64e8005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:52.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.742+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 0x7f64e8005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:52.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.742+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 msgr2=0x7f64e8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:57:52.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.742+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 msgr2=0x7f64e8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:52.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.742+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 0x7f64e8005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:52.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:52.742+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 0x7f64e8005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:57:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:53.146+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 0x7f64e8005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:53.146+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 msgr2=0x7f64e8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:57:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:53.146+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 msgr2=0x7f64e8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:53.146+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 0x7f64e8005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:53.146+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 0x7f64e8005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:57:53.402 INFO:tasks.workunit.client.0.smithi096.stdout:0/4: sync 2024-04-18T04:57:53.403 INFO:tasks.workunit.client.0.smithi096.stdout:2/51: sync 2024-04-18T04:57:53.403 INFO:tasks.workunit.client.0.smithi096.stdout:3/3: sync 2024-04-18T04:57:53.403 INFO:tasks.workunit.client.0.smithi096.stdout:9/32: sync 2024-04-18T04:57:53.403 INFO:tasks.workunit.client.0.smithi096.stdout:4/42: sync 2024-04-18T04:57:53.403 INFO:tasks.workunit.client.0.smithi096.stdout:6/50: sync 2024-04-18T04:57:53.403 INFO:tasks.workunit.client.0.smithi096.stdout:8/29: sync 2024-04-18T04:57:53.403 INFO:tasks.workunit.client.0.smithi096.stdout:1/60: sync 2024-04-18T04:57:53.404 INFO:tasks.workunit.client.0.smithi096.stdout:7/8: sync 2024-04-18T04:57:53.404 INFO:tasks.workunit.client.0.smithi096.stdout:7/9: read - no filename 2024-04-18T04:57:53.404 INFO:tasks.workunit.client.0.smithi096.stdout:5/10: sync 2024-04-18T04:57:53.410 INFO:tasks.workunit.client.0.smithi096.stdout:6/51: dread d0/d6/f7 [4194304,4194304] 0 2024-04-18T04:57:53.419 INFO:tasks.workunit.client.0.smithi096.stdout:6/52: dwrite d0/d6/f8 [0,4194304] 0 2024-04-18T04:57:53.436 INFO:tasks.workunit.client.0.smithi096.stdout:4/43: chown d4 261662 1 2024-04-18T04:57:53.436 INFO:tasks.workunit.client.0.smithi096.stdout:3/4: chown f0 45332221 1 2024-04-18T04:57:53.438 INFO:tasks.workunit.client.0.smithi096.stdout:8/30: write d0/f2 [403987,61590] 0 2024-04-18T04:57:53.438 INFO:tasks.workunit.client.0.smithi096.stdout:3/5: write f0 [305845,4359] 0 2024-04-18T04:57:53.441 INFO:tasks.workunit.client.0.smithi096.stdout:2/52: dread f2 [0,4194304] 0 2024-04-18T04:57:53.442 INFO:tasks.workunit.client.0.smithi096.stdout:2/53: write fd [150,72518] 0 2024-04-18T04:57:53.472 INFO:tasks.workunit.client.0.smithi096.stdout:0/5: unlink l1 0 2024-04-18T04:57:53.475 INFO:tasks.workunit.client.0.smithi096.stdout:6/53: rename d0/f5 to d0/f9 0 2024-04-18T04:57:53.476 INFO:tasks.workunit.client.0.smithi096.stdout:9/33: unlink d0/l5 0 2024-04-18T04:57:53.478 INFO:tasks.workunit.client.0.smithi096.stdout:4/44: unlink d4/f9 0 2024-04-18T04:57:53.479 INFO:tasks.workunit.client.0.smithi096.stdout:3/6: mknod c1 0 2024-04-18T04:57:53.483 INFO:tasks.workunit.client.0.smithi096.stdout:1/61: creat de/ff x:0 0 0 2024-04-18T04:57:53.483 INFO:tasks.workunit.client.0.smithi096.stdout:7/10: getdents . 0 2024-04-18T04:57:53.484 INFO:tasks.workunit.client.0.smithi096.stdout:7/11: truncate - no filename 2024-04-18T04:57:53.485 INFO:tasks.workunit.client.0.smithi096.stdout:9/34: creat d0/f9 x:0 0 0 2024-04-18T04:57:53.486 INFO:tasks.workunit.client.0.smithi096.stdout:3/7: rename f0 to f2 0 2024-04-18T04:57:53.487 INFO:tasks.workunit.client.0.smithi096.stdout:6/54: getdents d0/d6 0 2024-04-18T04:57:53.488 INFO:tasks.workunit.client.0.smithi096.stdout:7/12: mknod c0 0 2024-04-18T04:57:53.489 INFO:tasks.workunit.client.0.smithi096.stdout:9/35: write d0/f9 [93917,3967] 0 2024-04-18T04:57:53.493 INFO:tasks.workunit.client.0.smithi096.stdout:4/45: dread f1 [0,4194304] 0 2024-04-18T04:57:53.493 INFO:tasks.workunit.client.0.smithi096.stdout:2/54: getdents . 0 2024-04-18T04:57:53.494 INFO:tasks.workunit.client.0.smithi096.stdout:5/11: dwrite f3 [0,4194304] 0 2024-04-18T04:57:53.494 INFO:tasks.workunit.client.0.smithi096.stdout:7/13: creat f1 x:0 0 0 2024-04-18T04:57:53.494 INFO:tasks.workunit.client.0.smithi096.stdout:1/62: link l2 de/l10 0 2024-04-18T04:57:53.495 INFO:tasks.workunit.client.0.smithi096.stdout:9/36: mknod d0/ca 0 2024-04-18T04:57:53.497 INFO:tasks.workunit.client.0.smithi096.stdout:2/55: fsync f9 0 2024-04-18T04:57:53.498 INFO:tasks.workunit.client.0.smithi096.stdout:7/14: write f1 [789909,23100] 0 2024-04-18T04:57:53.498 INFO:tasks.workunit.client.0.smithi096.stdout:9/37: read - d0/f6 zero size 2024-04-18T04:57:53.499 INFO:tasks.workunit.client.0.smithi096.stdout:4/46: symlink d4/la 0 2024-04-18T04:57:53.501 INFO:tasks.workunit.client.0.smithi096.stdout:4/47: chown d4 21792 1 2024-04-18T04:57:53.502 INFO:tasks.workunit.client.0.smithi096.stdout:5/12: rename f3 to f4 0 2024-04-18T04:57:53.502 INFO:tasks.workunit.client.0.smithi096.stdout:1/63: fdatasync de/ff 0 2024-04-18T04:57:53.507 INFO:tasks.workunit.client.0.smithi096.stdout:1/64: truncate fd 106478 0 2024-04-18T04:57:53.510 INFO:tasks.workunit.client.0.smithi096.stdout:5/13: symlink l5 0 2024-04-18T04:57:53.512 INFO:tasks.workunit.client.0.smithi096.stdout:4/48: creat d4/fb x:0 0 0 2024-04-18T04:57:53.512 INFO:tasks.workunit.client.0.smithi096.stdout:3/8: dwrite f2 [0,4194304] 0 2024-04-18T04:57:53.513 INFO:tasks.workunit.client.0.smithi096.stdout:1/65: creat de/f11 x:0 0 0 2024-04-18T04:57:53.513 INFO:tasks.workunit.client.0.smithi096.stdout:5/14: creat f6 x:0 0 0 2024-04-18T04:57:53.514 INFO:tasks.workunit.client.0.smithi096.stdout:7/15: link c0 c2 0 2024-04-18T04:57:53.515 INFO:tasks.workunit.client.0.smithi096.stdout:3/9: chown c1 1 1 2024-04-18T04:57:53.515 INFO:tasks.workunit.client.0.smithi096.stdout:5/15: chown f4 272442172 1 2024-04-18T04:57:53.515 INFO:tasks.workunit.client.0.smithi096.stdout:2/56: dread f9 [0,4194304] 0 2024-04-18T04:57:53.517 INFO:tasks.workunit.client.0.smithi096.stdout:7/16: mknod c3 0 2024-04-18T04:57:53.517 INFO:tasks.workunit.client.0.smithi096.stdout:2/57: chown fd 53 1 2024-04-18T04:57:53.518 INFO:tasks.workunit.client.0.smithi096.stdout:3/10: creat f3 x:0 0 0 2024-04-18T04:57:53.520 INFO:tasks.workunit.client.0.smithi096.stdout:7/17: chown f1 3 1 2024-04-18T04:57:53.522 INFO:tasks.workunit.client.0.smithi096.stdout:2/58: creat fe x:0 0 0 2024-04-18T04:57:53.523 INFO:tasks.workunit.client.0.smithi096.stdout:2/59: rmdir - no directory 2024-04-18T04:57:53.523 INFO:tasks.workunit.client.0.smithi096.stdout:2/60: rmdir - no directory 2024-04-18T04:57:53.523 INFO:tasks.workunit.client.0.smithi096.stdout:3/11: symlink l4 0 2024-04-18T04:57:53.524 INFO:tasks.workunit.client.0.smithi096.stdout:3/12: dread - f3 zero size 2024-04-18T04:57:53.524 INFO:tasks.workunit.client.0.smithi096.stdout:2/61: write f9 [2229827,117941] 0 2024-04-18T04:57:53.525 INFO:tasks.workunit.client.0.smithi096.stdout:7/18: symlink l4 0 2024-04-18T04:57:53.526 INFO:tasks.workunit.client.0.smithi096.stdout:1/66: dread f6 [0,4194304] 0 2024-04-18T04:57:53.527 INFO:tasks.workunit.client.0.smithi096.stdout:4/49: dwrite d4/fb [0,4194304] 0 2024-04-18T04:57:53.528 INFO:tasks.workunit.client.0.smithi096.stdout:5/16: dread f4 [0,4194304] 0 2024-04-18T04:57:53.531 INFO:tasks.workunit.client.0.smithi096.stdout:2/62: mkdir df 0 2024-04-18T04:57:53.532 INFO:tasks.workunit.client.0.smithi096.stdout:7/19: creat f5 x:0 0 0 2024-04-18T04:57:53.534 INFO:tasks.workunit.client.0.smithi096.stdout:5/17: mkdir d7 0 2024-04-18T04:57:53.534 INFO:tasks.workunit.client.0.smithi096.stdout:5/18: dread - f6 zero size 2024-04-18T04:57:53.537 INFO:tasks.workunit.client.0.smithi096.stdout:2/63: link fd df/f10 0 2024-04-18T04:57:53.546 INFO:tasks.workunit.client.0.smithi096.stdout:7/20: dwrite f1 [0,4194304] 0 2024-04-18T04:57:53.546 INFO:tasks.workunit.client.0.smithi096.stdout:5/19: dread f4 [0,4194304] 0 2024-04-18T04:57:53.550 INFO:tasks.workunit.client.0.smithi096.stdout:5/20: mknod d7/c8 0 2024-04-18T04:57:53.551 INFO:tasks.workunit.client.0.smithi096.stdout:5/21: rename d7 to d7/d9 22 2024-04-18T04:57:53.553 INFO:tasks.workunit.client.0.smithi096.stdout:2/64: dwrite f9 [0,4194304] 0 2024-04-18T04:57:53.554 INFO:tasks.workunit.client.0.smithi096.stdout:0/6: sync 2024-04-18T04:57:53.554 INFO:tasks.workunit.client.0.smithi096.stdout:0/7: dwrite - no filename 2024-04-18T04:57:53.555 INFO:tasks.workunit.client.0.smithi096.stdout:2/65: chown f2 0 1 2024-04-18T04:57:53.557 INFO:tasks.workunit.client.0.smithi096.stdout:0/8: chown c0 359780 1 2024-04-18T04:57:53.557 INFO:tasks.workunit.client.0.smithi096.stdout:0/9: write - no filename 2024-04-18T04:57:53.558 INFO:tasks.workunit.client.0.smithi096.stdout:2/66: write fe [876179,75112] 0 2024-04-18T04:57:53.562 INFO:tasks.workunit.client.0.smithi096.stdout:0/10: rename c0 to c2 0 2024-04-18T04:57:53.564 INFO:tasks.workunit.client.0.smithi096.stdout:7/21: dwrite f1 [0,4194304] 0 2024-04-18T04:57:53.565 INFO:tasks.workunit.client.0.smithi096.stdout:2/67: rename ca to df/c11 0 2024-04-18T04:57:53.567 INFO:tasks.workunit.client.0.smithi096.stdout:5/22: dwrite f6 [0,4194304] 0 2024-04-18T04:57:53.569 INFO:tasks.workunit.client.0.smithi096.stdout:0/11: symlink l3 0 2024-04-18T04:57:53.573 INFO:tasks.workunit.client.0.smithi096.stdout:2/68: creat df/f12 x:0 0 0 2024-04-18T04:57:53.574 INFO:tasks.workunit.client.0.smithi096.stdout:5/23: fdatasync f4 0 2024-04-18T04:57:53.576 INFO:tasks.workunit.client.0.smithi096.stdout:0/12: creat f4 x:0 0 0 2024-04-18T04:57:53.576 INFO:tasks.workunit.client.0.smithi096.stdout:7/22: chown c2 2 1 2024-04-18T04:57:53.581 INFO:tasks.workunit.client.0.smithi096.stdout:0/13: symlink l5 0 2024-04-18T04:57:53.582 INFO:tasks.workunit.client.0.smithi096.stdout:7/23: mknod c6 0 2024-04-18T04:57:53.583 INFO:tasks.workunit.client.0.smithi096.stdout:0/14: mknod c6 0 2024-04-18T04:57:53.583 INFO:tasks.workunit.client.0.smithi096.stdout:0/15: truncate f4 453956 0 2024-04-18T04:57:53.583 INFO:tasks.workunit.client.0.smithi096.stdout:7/24: creat f7 x:0 0 0 2024-04-18T04:57:53.585 INFO:tasks.workunit.client.0.smithi096.stdout:0/16: creat f7 x:0 0 0 2024-04-18T04:57:53.586 INFO:tasks.workunit.client.0.smithi096.stdout:0/17: write f7 [221567,46558] 0 2024-04-18T04:57:53.587 INFO:tasks.workunit.client.0.smithi096.stdout:7/25: link c0 c8 0 2024-04-18T04:57:53.587 INFO:tasks.workunit.client.0.smithi096.stdout:0/18: chown c6 80696 1 2024-04-18T04:57:53.589 INFO:tasks.workunit.client.0.smithi096.stdout:7/26: creat f9 x:0 0 0 2024-04-18T04:57:53.589 INFO:tasks.workunit.client.0.smithi096.stdout:0/19: mknod c8 0 2024-04-18T04:57:53.590 INFO:tasks.workunit.client.0.smithi096.stdout:7/27: creat fa x:0 0 0 2024-04-18T04:57:53.591 INFO:tasks.workunit.client.0.smithi096.stdout:0/20: dread f7 [0,4194304] 0 2024-04-18T04:57:53.593 INFO:tasks.workunit.client.0.smithi096.stdout:0/21: dread f4 [0,4194304] 0 2024-04-18T04:57:53.594 INFO:tasks.workunit.client.0.smithi096.stdout:0/22: dread f7 [0,4194304] 0 2024-04-18T04:57:53.597 INFO:tasks.workunit.client.0.smithi096.stdout:0/23: dread f7 [0,4194304] 0 2024-04-18T04:57:53.599 INFO:tasks.workunit.client.0.smithi096.stdout:0/24: symlink l9 0 2024-04-18T04:57:53.601 INFO:tasks.workunit.client.0.smithi096.stdout:0/25: chown c8 62362 1 2024-04-18T04:57:53.601 INFO:tasks.workunit.client.0.smithi096.stdout:7/28: dwrite f9 [0,4194304] 0 2024-04-18T04:57:53.601 INFO:tasks.workunit.client.0.smithi096.stdout:0/26: stat l9 0 2024-04-18T04:57:53.601 INFO:tasks.workunit.client.0.smithi096.stdout:0/27: stat l9 0 2024-04-18T04:57:53.602 INFO:tasks.workunit.client.0.smithi096.stdout:7/29: write f7 [652929,63700] 0 2024-04-18T04:57:53.613 INFO:tasks.workunit.client.0.smithi096.stdout:0/28: dwrite f7 [0,4194304] 0 2024-04-18T04:57:53.616 INFO:tasks.workunit.client.0.smithi096.stdout:0/29: rename c6 to ca 0 2024-04-18T04:57:53.618 INFO:tasks.workunit.client.0.smithi096.stdout:0/30: dread f4 [0,4194304] 0 2024-04-18T04:57:53.618 INFO:tasks.workunit.client.0.smithi096.stdout:0/31: rmdir - no directory 2024-04-18T04:57:53.619 INFO:tasks.workunit.client.0.smithi096.stdout:0/32: write f7 [1236824,83206] 0 2024-04-18T04:57:53.628 INFO:tasks.workunit.client.0.smithi096.stdout:6/55: fsync d0/f9 0 2024-04-18T04:57:53.630 INFO:tasks.workunit.client.0.smithi096.stdout:6/56: write d0/d6/f7 [7554326,22378] 0 2024-04-18T04:57:53.631 INFO:tasks.workunit.client.0.smithi096.stdout:6/57: readlink d0/l3 0 2024-04-18T04:57:53.636 INFO:tasks.workunit.client.0.smithi096.stdout:6/58: getdents d0 0 2024-04-18T04:57:53.637 INFO:tasks.workunit.client.0.smithi096.stdout:8/31: dwrite d0/d3/f8 [0,4194304] 0 2024-04-18T04:57:53.638 INFO:tasks.workunit.client.0.smithi096.stdout:4/50: getdents d4 0 2024-04-18T04:57:53.640 INFO:tasks.workunit.client.0.smithi096.stdout:6/59: unlink d0/d6/f8 0 2024-04-18T04:57:53.640 INFO:tasks.workunit.client.0.smithi096.stdout:8/32: write d0/f2 [1063455,7237] 0 2024-04-18T04:57:53.640 INFO:tasks.workunit.client.0.smithi096.stdout:6/60: chown d0 2155 1 2024-04-18T04:57:53.641 INFO:tasks.workunit.client.0.smithi096.stdout:4/51: fsync f1 0 2024-04-18T04:57:53.644 INFO:tasks.workunit.client.0.smithi096.stdout:6/61: read d0/f9 [3608788,111457] 0 2024-04-18T04:57:53.647 INFO:tasks.workunit.client.0.smithi096.stdout:4/52: write d4/fb [3678144,110979] 0 2024-04-18T04:57:53.648 INFO:tasks.workunit.client.0.smithi096.stdout:8/33: truncate d0/d3/f8 5157911 0 2024-04-18T04:57:53.652 INFO:tasks.workunit.client.0.smithi096.stdout:9/38: dwrite d0/f3 [0,4194304] 0 2024-04-18T04:57:53.653 INFO:tasks.workunit.client.0.smithi096.stdout:2/69: fsync df/f12 0 2024-04-18T04:57:53.654 INFO:tasks.workunit.client.0.smithi096.stdout:4/53: chown d4/c8 12799356 1 2024-04-18T04:57:53.660 INFO:tasks.workunit.client.0.smithi096.stdout:3/13: dwrite f2 [4194304,4194304] 0 2024-04-18T04:57:53.661 INFO:tasks.workunit.client.0.smithi096.stdout:7/30: truncate f1 793357 0 2024-04-18T04:57:53.661 INFO:tasks.workunit.client.0.smithi096.stdout:7/31: rmdir - no directory 2024-04-18T04:57:53.663 INFO:tasks.workunit.client.0.smithi096.stdout:1/67: dwrite fa [0,4194304] 0 2024-04-18T04:57:53.663 INFO:tasks.workunit.client.0.smithi096.stdout:8/34: dread d0/f2 [0,4194304] 0 2024-04-18T04:57:53.665 INFO:tasks.workunit.client.0.smithi096.stdout:0/33: truncate f7 584736 0 2024-04-18T04:57:53.666 INFO:tasks.workunit.client.0.smithi096.stdout:9/39: rename d0/ca to d0/cb 0 2024-04-18T04:57:53.666 INFO:tasks.workunit.client.0.smithi096.stdout:2/70: truncate f4 3588739 0 2024-04-18T04:57:53.667 INFO:tasks.workunit.client.0.smithi096.stdout:3/14: symlink l5 0 2024-04-18T04:57:53.668 INFO:tasks.workunit.client.0.smithi096.stdout:7/32: mkdir db 0 2024-04-18T04:57:53.668 INFO:tasks.workunit.client.0.smithi096.stdout:3/15: chown f3 486 1 2024-04-18T04:57:53.668 INFO:tasks.workunit.client.0.smithi096.stdout:3/16: rmdir - no directory 2024-04-18T04:57:53.670 INFO:tasks.workunit.client.0.smithi096.stdout:9/40: creat d0/fc x:0 0 0 2024-04-18T04:57:53.670 INFO:tasks.workunit.client.0.smithi096.stdout:3/17: write f2 [6368015,754] 0 2024-04-18T04:57:53.670 INFO:tasks.workunit.client.0.smithi096.stdout:2/71: symlink df/l13 0 2024-04-18T04:57:53.671 INFO:tasks.workunit.client.0.smithi096.stdout:4/54: rename d4/c7 to d4/cc 0 2024-04-18T04:57:53.671 INFO:tasks.workunit.client.0.smithi096.stdout:5/24: sync 2024-04-18T04:57:53.672 INFO:tasks.workunit.client.0.smithi096.stdout:5/25: fdatasync f6 0 2024-04-18T04:57:53.672 INFO:tasks.workunit.client.0.smithi096.stdout:2/72: write fe [860353,70462] 0 2024-04-18T04:57:53.673 INFO:tasks.workunit.client.0.smithi096.stdout:6/62: link d0/d6/c4 d0/ca 0 2024-04-18T04:57:53.674 INFO:tasks.workunit.client.0.smithi096.stdout:5/26: fsync f6 0 2024-04-18T04:57:53.680 INFO:tasks.workunit.client.0.smithi096.stdout:6/63: write d0/d6/f7 [6140187,6069] 0 2024-04-18T04:57:53.680 INFO:tasks.workunit.client.0.smithi096.stdout:1/68: getdents de 0 2024-04-18T04:57:53.681 INFO:tasks.workunit.client.0.smithi096.stdout:5/27: creat d7/fa x:0 0 0 2024-04-18T04:57:53.684 INFO:tasks.workunit.client.0.smithi096.stdout:7/33: dread f9 [0,4194304] 0 2024-04-18T04:57:53.685 INFO:tasks.workunit.client.0.smithi096.stdout:8/35: truncate d0/f9 1846720 0 2024-04-18T04:57:53.685 INFO:tasks.workunit.client.0.smithi096.stdout:6/64: stat d0/ca 0 2024-04-18T04:57:53.687 INFO:tasks.workunit.client.0.smithi096.stdout:1/69: unlink fd 0 2024-04-18T04:57:53.687 INFO:tasks.workunit.client.0.smithi096.stdout:9/41: dwrite d0/f9 [0,4194304] 0 2024-04-18T04:57:53.688 INFO:tasks.workunit.client.0.smithi096.stdout:4/55: link d4/la d4/ld 0 2024-04-18T04:57:53.688 INFO:tasks.workunit.client.0.smithi096.stdout:3/18: dwrite f3 [0,4194304] 0 2024-04-18T04:57:53.690 INFO:tasks.workunit.client.0.smithi096.stdout:0/34: truncate f7 1416922 0 2024-04-18T04:57:53.690 INFO:tasks.workunit.client.0.smithi096.stdout:6/65: read d0/d6/f7 [3371491,39450] 0 2024-04-18T04:57:53.693 INFO:tasks.workunit.client.0.smithi096.stdout:2/73: getdents df 0 2024-04-18T04:57:53.695 INFO:tasks.workunit.client.0.smithi096.stdout:0/35: chown ca 57142 1 2024-04-18T04:57:53.695 INFO:tasks.workunit.client.0.smithi096.stdout:0/36: readlink l9 0 2024-04-18T04:57:53.695 INFO:tasks.workunit.client.0.smithi096.stdout:0/37: readlink l9 0 2024-04-18T04:57:53.696 INFO:tasks.workunit.client.0.smithi096.stdout:5/28: link f6 d7/fb 0 2024-04-18T04:57:53.696 INFO:tasks.workunit.client.0.smithi096.stdout:1/70: dread f4 [0,4194304] 0 2024-04-18T04:57:53.700 INFO:tasks.workunit.client.0.smithi096.stdout:9/42: rename d0/l1 to d0/ld 0 2024-04-18T04:57:53.700 INFO:tasks.workunit.client.0.smithi096.stdout:6/66: dread d0/d6/f7 [0,4194304] 0 2024-04-18T04:57:53.701 INFO:tasks.workunit.client.0.smithi096.stdout:2/74: creat df/f14 x:0 0 0 2024-04-18T04:57:53.702 INFO:tasks.workunit.client.0.smithi096.stdout:2/75: read fe [196168,21691] 0 2024-04-18T04:57:53.703 INFO:tasks.workunit.client.0.smithi096.stdout:3/19: link f2 f6 0 2024-04-18T04:57:53.705 INFO:tasks.workunit.client.0.smithi096.stdout:1/71: creat de/f12 x:0 0 0 2024-04-18T04:57:53.706 INFO:tasks.workunit.client.0.smithi096.stdout:9/43: mkdir d0/de 0 2024-04-18T04:57:53.706 INFO:tasks.workunit.client.0.smithi096.stdout:9/44: write d0/fc [466862,67481] 0 2024-04-18T04:57:53.707 INFO:tasks.workunit.client.0.smithi096.stdout:5/29: rmdir d7 39 2024-04-18T04:57:53.707 INFO:tasks.workunit.client.0.smithi096.stdout:8/36: dread d0/f9 [0,4194304] 0 2024-04-18T04:57:53.707 INFO:tasks.workunit.client.0.smithi096.stdout:5/30: chown l5 26 1 2024-04-18T04:57:53.709 INFO:tasks.workunit.client.0.smithi096.stdout:2/76: mknod df/c15 0 2024-04-18T04:57:53.709 INFO:tasks.workunit.client.0.smithi096.stdout:2/77: dread - fc zero size 2024-04-18T04:57:53.710 INFO:tasks.workunit.client.0.smithi096.stdout:1/72: mknod de/c13 0 2024-04-18T04:57:53.711 INFO:tasks.workunit.client.0.smithi096.stdout:1/73: stat de/f12 0 2024-04-18T04:57:53.712 INFO:tasks.workunit.client.0.smithi096.stdout:1/74: stat f9 0 2024-04-18T04:57:53.713 INFO:tasks.workunit.client.0.smithi096.stdout:1/75: chown c8 73185 1 2024-04-18T04:57:53.714 INFO:tasks.workunit.client.0.smithi096.stdout:0/38: write f7 [583783,46996] 0 2024-04-18T04:57:53.716 INFO:tasks.workunit.client.0.smithi096.stdout:4/56: getdents d4 0 2024-04-18T04:57:53.717 INFO:tasks.workunit.client.0.smithi096.stdout:9/45: dwrite d0/f3 [0,4194304] 0 2024-04-18T04:57:53.718 INFO:tasks.workunit.client.0.smithi096.stdout:6/67: link d0/ca d0/cb 0 2024-04-18T04:57:53.718 INFO:tasks.workunit.client.0.smithi096.stdout:5/31: creat d7/fc x:0 0 0 2024-04-18T04:57:53.718 INFO:tasks.workunit.client.0.smithi096.stdout:4/57: write d4/f5 [725200,37859] 0 2024-04-18T04:57:53.720 INFO:tasks.workunit.client.0.smithi096.stdout:3/20: truncate f6 7728508 0 2024-04-18T04:57:53.720 INFO:tasks.workunit.client.0.smithi096.stdout:8/37: creat d0/d7/fa x:0 0 0 2024-04-18T04:57:53.721 INFO:tasks.workunit.client.0.smithi096.stdout:1/76: symlink de/l14 0 2024-04-18T04:57:53.722 INFO:tasks.workunit.client.0.smithi096.stdout:6/68: unlink d0/f9 0 2024-04-18T04:57:53.725 INFO:tasks.workunit.client.0.smithi096.stdout:6/69: chown d0/d6/f7 49 1 2024-04-18T04:57:53.725 INFO:tasks.workunit.client.0.smithi096.stdout:6/70: stat d0/d6 0 2024-04-18T04:57:53.725 INFO:tasks.workunit.client.0.smithi096.stdout:6/71: readlink d0/l3 0 2024-04-18T04:57:53.725 INFO:tasks.workunit.client.0.smithi096.stdout:6/72: chown d0 5935 1 2024-04-18T04:57:53.727 INFO:tasks.workunit.client.0.smithi096.stdout:5/32: mkdir d7/dd 0 2024-04-18T04:57:53.727 INFO:tasks.workunit.client.0.smithi096.stdout:4/58: read d4/f5 [258222,85788] 0 2024-04-18T04:57:53.729 INFO:tasks.workunit.client.0.smithi096.stdout:8/38: rmdir d0 39 2024-04-18T04:57:53.729 INFO:tasks.workunit.client.0.smithi096.stdout:1/77: unlink f4 0 2024-04-18T04:57:53.731 INFO:tasks.workunit.client.0.smithi096.stdout:5/33: creat d7/fe x:0 0 0 2024-04-18T04:57:53.733 INFO:tasks.workunit.client.0.smithi096.stdout:1/78: dread - de/f12 zero size 2024-04-18T04:57:53.734 INFO:tasks.workunit.client.0.smithi096.stdout:9/46: link d0/l4 d0/lf 0 2024-04-18T04:57:53.734 INFO:tasks.workunit.client.0.smithi096.stdout:5/34: write f4 [3515943,94619] 0 2024-04-18T04:57:53.735 INFO:tasks.workunit.client.0.smithi096.stdout:4/59: unlink d4/ld 0 2024-04-18T04:57:53.738 INFO:tasks.workunit.client.0.smithi096.stdout:4/60: readlink d4/l6 0 2024-04-18T04:57:53.738 INFO:tasks.workunit.client.0.smithi096.stdout:2/78: dwrite f2 [4194304,4194304] 0 2024-04-18T04:57:53.742 INFO:tasks.workunit.client.0.smithi096.stdout:6/73: truncate d0/d6/f7 7150947 0 2024-04-18T04:57:53.742 INFO:tasks.workunit.client.0.smithi096.stdout:8/39: unlink d0/d3/f8 0 2024-04-18T04:57:53.742 INFO:tasks.workunit.client.0.smithi096.stdout:0/39: dwrite f4 [0,4194304] 0 2024-04-18T04:57:53.742 INFO:tasks.workunit.client.0.smithi096.stdout:9/47: unlink d0/f9 0 2024-04-18T04:57:53.742 INFO:tasks.workunit.client.0.smithi096.stdout:1/79: symlink de/l15 0 2024-04-18T04:57:53.744 INFO:tasks.workunit.client.0.smithi096.stdout:3/21: dread f6 [0,4194304] 0 2024-04-18T04:57:53.744 INFO:tasks.workunit.client.0.smithi096.stdout:1/80: dread - de/f12 zero size 2024-04-18T04:57:53.744 INFO:tasks.workunit.client.0.smithi096.stdout:5/35: creat d7/ff x:0 0 0 2024-04-18T04:57:53.745 INFO:tasks.workunit.client.0.smithi096.stdout:8/40: truncate d0/d7/fa 209864 0 2024-04-18T04:57:53.746 INFO:tasks.workunit.client.0.smithi096.stdout:1/81: chown c8 113564444 1 2024-04-18T04:57:53.747 INFO:tasks.workunit.client.0.smithi096.stdout:1/82: fdatasync de/f11 0 2024-04-18T04:57:53.749 INFO:tasks.workunit.client.0.smithi096.stdout:4/61: rename d4/la to d4/le 0 2024-04-18T04:57:53.755 INFO:tasks.workunit.client.0.smithi096.stdout:9/48: creat d0/de/f10 x:0 0 0 2024-04-18T04:57:53.757 INFO:tasks.workunit.client.0.smithi096.stdout:4/62: creat d4/ff x:0 0 0 2024-04-18T04:57:53.757 INFO:tasks.workunit.client.0.smithi096.stdout:0/40: dwrite f7 [0,4194304] 0 2024-04-18T04:57:53.758 INFO:tasks.workunit.client.0.smithi096.stdout:4/63: fdatasync f1 0 2024-04-18T04:57:53.759 INFO:tasks.workunit.client.0.smithi096.stdout:3/22: dwrite f3 [0,4194304] 0 2024-04-18T04:57:53.761 INFO:tasks.workunit.client.0.smithi096.stdout:9/49: dread d0/fc [0,4194304] 0 2024-04-18T04:57:53.763 INFO:tasks.workunit.client.0.smithi096.stdout:2/79: getdents df 0 2024-04-18T04:57:53.764 INFO:tasks.workunit.client.0.smithi096.stdout:2/80: chown fe 3839 1 2024-04-18T04:57:53.765 INFO:tasks.workunit.client.0.smithi096.stdout:0/41: mknod cb 0 2024-04-18T04:57:53.766 INFO:tasks.workunit.client.0.smithi096.stdout:1/83: truncate fa 1055184 0 2024-04-18T04:57:53.766 INFO:tasks.workunit.client.0.smithi096.stdout:4/64: symlink d4/l10 0 2024-04-18T04:57:53.767 INFO:tasks.workunit.client.0.smithi096.stdout:6/74: link d0/d6/f7 d0/fc 0 2024-04-18T04:57:53.767 INFO:tasks.workunit.client.0.smithi096.stdout:4/65: chown d4 14 1 2024-04-18T04:57:53.768 INFO:tasks.workunit.client.0.smithi096.stdout:2/81: creat df/f16 x:0 0 0 2024-04-18T04:57:53.768 INFO:tasks.workunit.client.0.smithi096.stdout:4/66: chown l3 6729119 1 2024-04-18T04:57:53.770 INFO:tasks.workunit.client.0.smithi096.stdout:5/36: dwrite d7/fb [4194304,4194304] 0 2024-04-18T04:57:53.770 INFO:tasks.workunit.client.0.smithi096.stdout:0/42: mknod cc 0 2024-04-18T04:57:53.770 INFO:tasks.workunit.client.0.smithi096.stdout:0/43: stat cb 0 2024-04-18T04:57:53.771 INFO:tasks.workunit.client.0.smithi096.stdout:5/37: write d7/fb [5392184,5388] 0 2024-04-18T04:57:53.773 INFO:tasks.workunit.client.0.smithi096.stdout:9/50: link d0/de/f10 d0/f11 0 2024-04-18T04:57:53.774 INFO:tasks.workunit.client.0.smithi096.stdout:1/84: fdatasync fa 0 2024-04-18T04:57:53.775 INFO:tasks.workunit.client.0.smithi096.stdout:1/85: chown c8 0 1 2024-04-18T04:57:53.775 INFO:tasks.workunit.client.0.smithi096.stdout:4/67: mkdir d4/d11 0 2024-04-18T04:57:53.776 INFO:tasks.workunit.client.0.smithi096.stdout:0/44: dread f4 [0,4194304] 0 2024-04-18T04:57:53.778 INFO:tasks.workunit.client.0.smithi096.stdout:3/23: truncate f6 5365330 0 2024-04-18T04:57:53.778 INFO:tasks.workunit.client.0.smithi096.stdout:3/24: stat f3 0 2024-04-18T04:57:53.780 INFO:tasks.workunit.client.0.smithi096.stdout:8/41: rename d0/f9 to d0/d3/fb 0 2024-04-18T04:57:53.781 INFO:tasks.workunit.client.0.smithi096.stdout:5/38: symlink d7/l10 0 2024-04-18T04:57:53.781 INFO:tasks.workunit.client.0.smithi096.stdout:9/51: stat d0/ld 0 2024-04-18T04:57:53.782 INFO:tasks.workunit.client.0.smithi096.stdout:1/86: rmdir de 39 2024-04-18T04:57:53.783 INFO:tasks.workunit.client.0.smithi096.stdout:4/68: mknod d4/c12 0 2024-04-18T04:57:53.785 INFO:tasks.workunit.client.0.smithi096.stdout:2/82: link fb df/f17 0 2024-04-18T04:57:53.787 INFO:tasks.workunit.client.0.smithi096.stdout:3/25: mknod c7 0 2024-04-18T04:57:53.790 INFO:tasks.workunit.client.0.smithi096.stdout:0/45: dwrite f7 [0,4194304] 0 2024-04-18T04:57:53.792 INFO:tasks.workunit.client.0.smithi096.stdout:4/69: symlink d4/l13 0 2024-04-18T04:57:53.794 INFO:tasks.workunit.client.0.smithi096.stdout:2/83: mkdir df/d18 0 2024-04-18T04:57:53.796 INFO:tasks.workunit.client.0.smithi096.stdout:5/39: creat d7/dd/f11 x:0 0 0 2024-04-18T04:57:53.796 INFO:tasks.workunit.client.0.smithi096.stdout:0/46: creat fd x:0 0 0 2024-04-18T04:57:53.797 INFO:tasks.workunit.client.0.smithi096.stdout:9/52: rename d0/l4 to d0/de/l12 0 2024-04-18T04:57:53.798 INFO:tasks.workunit.client.0.smithi096.stdout:1/87: creat de/f16 x:0 0 0 2024-04-18T04:57:53.798 INFO:tasks.workunit.client.0.smithi096.stdout:8/42: dread d0/d3/fb [0,4194304] 0 2024-04-18T04:57:53.802 INFO:tasks.workunit.client.0.smithi096.stdout:0/47: read f4 [447679,107797] 0 2024-04-18T04:57:53.802 INFO:tasks.workunit.client.0.smithi096.stdout:0/48: readlink l5 0 2024-04-18T04:57:53.802 INFO:tasks.workunit.client.0.smithi096.stdout:5/40: mkdir d7/d12 0 2024-04-18T04:57:53.802 INFO:tasks.workunit.client.0.smithi096.stdout:0/49: fsync fd 0 2024-04-18T04:57:53.803 INFO:tasks.workunit.client.0.smithi096.stdout:1/88: creat de/f17 x:0 0 0 2024-04-18T04:57:53.803 INFO:tasks.workunit.client.0.smithi096.stdout:0/50: truncate fd 904277 0 2024-04-18T04:57:53.803 INFO:tasks.workunit.client.0.smithi096.stdout:0/51: fdatasync f7 0 2024-04-18T04:57:53.869 INFO:tasks.workunit.client.0.smithi096.stdout:2/84: mknod df/d18/c19 0 2024-04-18T04:57:53.869 INFO:tasks.workunit.client.0.smithi096.stdout:7/34: sync 2024-04-18T04:57:53.873 INFO:tasks.workunit.client.0.smithi096.stdout:1/89: creat de/f18 x:0 0 0 2024-04-18T04:57:53.878 INFO:tasks.workunit.client.0.smithi096.stdout:0/52: creat fe x:0 0 0 2024-04-18T04:57:53.879 INFO:tasks.workunit.client.0.smithi096.stdout:5/41: dread d7/fb [4194304,4194304] 0 2024-04-18T04:57:53.882 INFO:tasks.workunit.client.0.smithi096.stdout:1/90: symlink de/l19 0 2024-04-18T04:57:53.883 INFO:tasks.workunit.client.0.smithi096.stdout:3/26: write f6 [6215668,102931] 0 2024-04-18T04:57:53.885 INFO:tasks.workunit.client.0.smithi096.stdout:0/53: creat ff x:0 0 0 2024-04-18T04:57:53.890 INFO:tasks.workunit.client.0.smithi096.stdout:1/91: chown l2 386 1 2024-04-18T04:57:53.892 INFO:tasks.workunit.client.0.smithi096.stdout:7/35: dread f1 [0,4194304] 0 2024-04-18T04:57:53.893 INFO:tasks.workunit.client.0.smithi096.stdout:4/70: dwrite d4/f5 [0,4194304] 0 2024-04-18T04:57:53.893 INFO:tasks.workunit.client.0.smithi096.stdout:3/27: fdatasync f6 0 2024-04-18T04:57:53.894 INFO:tasks.workunit.client.0.smithi096.stdout:0/54: symlink l10 0 2024-04-18T04:57:53.894 INFO:tasks.workunit.client.0.smithi096.stdout:5/42: write f6 [3727952,88696] 0 2024-04-18T04:57:53.898 INFO:tasks.workunit.client.0.smithi096.stdout:7/36: stat f9 0 2024-04-18T04:57:53.900 INFO:tasks.workunit.client.0.smithi096.stdout:4/71: stat d4/l13 0 2024-04-18T04:57:53.900 INFO:tasks.workunit.client.0.smithi096.stdout:7/37: fsync fa 0 2024-04-18T04:57:53.902 INFO:tasks.workunit.client.0.smithi096.stdout:8/43: dwrite d0/d3/fb [0,4194304] 0 2024-04-18T04:57:53.902 INFO:tasks.workunit.client.0.smithi096.stdout:3/28: chown f6 3233218 1 2024-04-18T04:57:53.905 INFO:tasks.workunit.client.0.smithi096.stdout:5/43: rmdir d7 39 2024-04-18T04:57:53.907 INFO:tasks.workunit.client.0.smithi096.stdout:3/29: chown c7 85459827 1 2024-04-18T04:57:53.911 INFO:tasks.workunit.client.0.smithi096.stdout:8/44: mkdir d0/d3/dc 0 2024-04-18T04:57:53.913 INFO:tasks.workunit.client.0.smithi096.stdout:2/85: dwrite f4 [0,4194304] 0 2024-04-18T04:57:53.913 INFO:tasks.workunit.client.0.smithi096.stdout:4/72: rmdir d4/d11 0 2024-04-18T04:57:53.915 INFO:tasks.workunit.client.0.smithi096.stdout:1/92: dread f6 [0,4194304] 0 2024-04-18T04:57:53.916 INFO:tasks.workunit.client.0.smithi096.stdout:5/44: creat d7/f13 x:0 0 0 2024-04-18T04:57:53.916 INFO:tasks.workunit.client.0.smithi096.stdout:0/55: dread f7 [0,4194304] 0 2024-04-18T04:57:53.921 INFO:tasks.workunit.client.0.smithi096.stdout:4/73: mkdir d4/d14 0 2024-04-18T04:57:53.922 INFO:tasks.workunit.client.0.smithi096.stdout:2/86: mknod df/d18/c1a 0 2024-04-18T04:57:53.923 INFO:tasks.workunit.client.0.smithi096.stdout:8/45: truncate d0/d7/fa 400853 0 2024-04-18T04:57:53.924 INFO:tasks.workunit.client.0.smithi096.stdout:1/93: creat de/f1a x:0 0 0 2024-04-18T04:57:53.927 INFO:tasks.workunit.client.0.smithi096.stdout:4/74: fsync d4/f5 0 2024-04-18T04:57:53.930 INFO:tasks.workunit.client.0.smithi096.stdout:0/56: dread fd [0,4194304] 0 2024-04-18T04:57:53.930 INFO:tasks.workunit.client.0.smithi096.stdout:2/87: write f4 [3669523,16771] 0 2024-04-18T04:57:53.930 INFO:tasks.workunit.client.0.smithi096.stdout:5/45: link d7/l10 d7/l14 0 2024-04-18T04:57:53.933 INFO:tasks.workunit.client.0.smithi096.stdout:4/75: dread - d4/ff zero size 2024-04-18T04:57:53.933 INFO:tasks.workunit.client.0.smithi096.stdout:3/30: dwrite f6 [4194304,4194304] 0 2024-04-18T04:57:53.935 INFO:tasks.workunit.client.0.smithi096.stdout:1/94: write de/f17 [1002069,90665] 0 2024-04-18T04:57:53.935 INFO:tasks.workunit.client.0.smithi096.stdout:0/57: chown cb 14 1 2024-04-18T04:57:53.935 INFO:tasks.workunit.client.0.smithi096.stdout:2/88: chown df/f16 87 1 2024-04-18T04:57:53.936 INFO:tasks.workunit.client.0.smithi096.stdout:7/38: dwrite f1 [0,4194304] 0 2024-04-18T04:57:53.938 INFO:tasks.workunit.client.0.smithi096.stdout:2/89: chown df/l13 682813189 1 2024-04-18T04:57:53.939 INFO:tasks.workunit.client.0.smithi096.stdout:4/76: symlink d4/l15 0 2024-04-18T04:57:53.941 INFO:tasks.workunit.client.0.smithi096.stdout:0/58: creat f11 x:0 0 0 2024-04-18T04:57:53.945 INFO:tasks.workunit.client.0.smithi096.stdout:5/46: creat d7/d12/f15 x:0 0 0 2024-04-18T04:57:53.945 INFO:tasks.workunit.client.0.smithi096.stdout:0/59: dread - ff zero size 2024-04-18T04:57:53.945 INFO:tasks.workunit.client.0.smithi096.stdout:5/47: write d7/fa [151869,20066] 0 2024-04-18T04:57:53.947 INFO:tasks.workunit.client.0.smithi096.stdout:1/95: rename de/l10 to de/l1b 0 2024-04-18T04:57:53.948 INFO:tasks.workunit.client.0.smithi096.stdout:8/46: dwrite d0/d7/fa [0,4194304] 0 2024-04-18T04:57:53.949 INFO:tasks.workunit.client.0.smithi096.stdout:1/96: stat f6 0 2024-04-18T04:57:53.950 INFO:tasks.workunit.client.0.smithi096.stdout:7/39: rename c3 to db/cc 0 2024-04-18T04:57:53.950 INFO:tasks.workunit.client.0.smithi096.stdout:5/48: truncate d7/dd/f11 914935 0 2024-04-18T04:57:53.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:53.950+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 0x7f64e8005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:53.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:53.950+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 msgr2=0x7f64e8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:57:53.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:53.950+0000 7f64fb7fe640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 msgr2=0x7f64e8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:53.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:53.950+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 0x7f64e8005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:53.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:53.950+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 0x7f64e8005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:57:53.953 INFO:tasks.workunit.client.0.smithi096.stdout:3/31: link f6 f8 0 2024-04-18T04:57:53.954 INFO:tasks.workunit.client.0.smithi096.stdout:6/75: sync 2024-04-18T04:57:53.957 INFO:tasks.workunit.client.0.smithi096.stdout:8/47: creat d0/d7/fd x:0 0 0 2024-04-18T04:57:53.959 INFO:tasks.workunit.client.0.smithi096.stdout:4/77: dwrite d4/fb [0,4194304] 0 2024-04-18T04:57:53.969 INFO:tasks.workunit.client.0.smithi096.stdout:2/90: getdents df 0 2024-04-18T04:57:53.972 INFO:tasks.workunit.client.0.smithi096.stdout:5/49: dwrite d7/d12/f15 [0,4194304] 0 2024-04-18T04:57:53.973 INFO:tasks.workunit.client.0.smithi096.stdout:2/91: chown f0 2853570 1 2024-04-18T04:57:53.973 INFO:tasks.workunit.client.0.smithi096.stdout:7/40: link c0 db/cd 0 2024-04-18T04:57:53.974 INFO:tasks.workunit.client.0.smithi096.stdout:1/97: dwrite de/f1a [0,4194304] 0 2024-04-18T04:57:53.977 INFO:tasks.workunit.client.0.smithi096.stdout:1/98: read - de/f12 zero size 2024-04-18T04:57:53.977 INFO:tasks.workunit.client.0.smithi096.stdout:2/92: creat df/f1b x:0 0 0 2024-04-18T04:57:53.978 INFO:tasks.workunit.client.0.smithi096.stdout:7/41: creat db/fe x:0 0 0 2024-04-18T04:57:53.979 INFO:tasks.workunit.client.0.smithi096.stdout:4/78: dread d4/fb [0,4194304] 0 2024-04-18T04:57:53.980 INFO:tasks.workunit.client.0.smithi096.stdout:6/76: write d0/fc [1431421,70252] 0 2024-04-18T04:57:53.981 INFO:tasks.workunit.client.0.smithi096.stdout:2/93: mkdir df/d1c 0 2024-04-18T04:57:53.981 INFO:tasks.workunit.client.0.smithi096.stdout:3/32: dwrite f6 [4194304,4194304] 0 2024-04-18T04:57:53.982 INFO:tasks.workunit.client.0.smithi096.stdout:1/99: truncate de/f16 826014 0 2024-04-18T04:57:53.984 INFO:tasks.workunit.client.0.smithi096.stdout:6/77: readlink d0/l3 0 2024-04-18T04:57:53.985 INFO:tasks.workunit.client.0.smithi096.stdout:1/100: dread f9 [0,4194304] 0 2024-04-18T04:57:53.985 INFO:tasks.workunit.client.0.smithi096.stdout:4/79: mkdir d4/d14/d16 0 2024-04-18T04:57:53.986 INFO:tasks.workunit.client.0.smithi096.stdout:1/101: fdatasync f9 0 2024-04-18T04:57:53.988 INFO:tasks.workunit.client.0.smithi096.stdout:2/94: creat df/d18/f1d x:0 0 0 2024-04-18T04:57:53.991 INFO:tasks.workunit.client.0.smithi096.stdout:7/42: truncate f7 317495 0 2024-04-18T04:57:53.992 INFO:tasks.workunit.client.0.smithi096.stdout:3/33: dread f8 [0,4194304] 0 2024-04-18T04:57:53.993 INFO:tasks.workunit.client.0.smithi096.stdout:4/80: dread d4/f5 [0,4194304] 0 2024-04-18T04:57:53.994 INFO:tasks.workunit.client.0.smithi096.stdout:3/34: chown l5 419 1 2024-04-18T04:57:53.994 INFO:tasks.workunit.client.0.smithi096.stdout:7/43: creat db/ff x:0 0 0 2024-04-18T04:57:53.996 INFO:tasks.workunit.client.0.smithi096.stdout:6/78: dwrite d0/d6/f7 [0,4194304] 0 2024-04-18T04:57:53.997 INFO:tasks.workunit.client.0.smithi096.stdout:7/44: truncate f1 4950655 0 2024-04-18T04:57:53.997 INFO:tasks.workunit.client.0.smithi096.stdout:2/95: link c8 df/c1e 0 2024-04-18T04:57:53.998 INFO:tasks.workunit.client.0.smithi096.stdout:1/102: dwrite de/f17 [0,4194304] 0 2024-04-18T04:57:54.001 INFO:tasks.workunit.client.0.smithi096.stdout:2/96: truncate df/f14 224067 0 2024-04-18T04:57:54.004 INFO:tasks.workunit.client.0.smithi096.stdout:1/103: unlink de/f11 0 2024-04-18T04:57:54.006 INFO:tasks.workunit.client.0.smithi096.stdout:4/81: dread d4/f5 [0,4194304] 0 2024-04-18T04:57:54.009 INFO:tasks.workunit.client.0.smithi096.stdout:2/97: truncate f0 3654606 0 2024-04-18T04:57:54.009 INFO:tasks.workunit.client.0.smithi096.stdout:3/35: dwrite f3 [4194304,4194304] 0 2024-04-18T04:57:54.012 INFO:tasks.workunit.client.0.smithi096.stdout:4/82: mknod d4/d14/d16/c17 0 2024-04-18T04:57:54.015 INFO:tasks.workunit.client.0.smithi096.stdout:6/79: dwrite d0/fc [0,4194304] 0 2024-04-18T04:57:54.019 INFO:tasks.workunit.client.0.smithi096.stdout:4/83: rename d4/ff to d4/f18 0 2024-04-18T04:57:54.022 INFO:tasks.workunit.client.0.smithi096.stdout:7/45: getdents db 0 2024-04-18T04:57:54.022 INFO:tasks.workunit.client.0.smithi096.stdout:1/104: dwrite de/f18 [0,4194304] 0 2024-04-18T04:57:54.023 INFO:tasks.workunit.client.0.smithi096.stdout:1/105: stat f6 0 2024-04-18T04:57:54.024 INFO:tasks.workunit.client.0.smithi096.stdout:7/46: dread - fa zero size 2024-04-18T04:57:54.025 INFO:tasks.workunit.client.0.smithi096.stdout:6/80: write d0/d6/f7 [1812596,47348] 0 2024-04-18T04:57:54.025 INFO:tasks.workunit.client.0.smithi096.stdout:4/84: creat d4/f19 x:0 0 0 2024-04-18T04:57:54.029 INFO:tasks.workunit.client.0.smithi096.stdout:2/98: dwrite df/f16 [0,4194304] 0 2024-04-18T04:57:54.030 INFO:tasks.workunit.client.0.smithi096.stdout:7/47: stat c2 0 2024-04-18T04:57:54.031 INFO:tasks.workunit.client.0.smithi096.stdout:6/81: write d0/d6/f7 [2771620,67606] 0 2024-04-18T04:57:54.032 INFO:tasks.workunit.client.0.smithi096.stdout:3/36: dread f6 [0,4194304] 0 2024-04-18T04:57:54.032 INFO:tasks.workunit.client.0.smithi096.stdout:6/82: write d0/d6/f7 [133272,66506] 0 2024-04-18T04:57:54.033 INFO:tasks.workunit.client.0.smithi096.stdout:7/48: getdents db 0 2024-04-18T04:57:54.034 INFO:tasks.workunit.client.0.smithi096.stdout:3/37: symlink l9 0 2024-04-18T04:57:54.035 INFO:tasks.workunit.client.0.smithi096.stdout:1/106: dread f6 [0,4194304] 0 2024-04-18T04:57:54.036 INFO:tasks.workunit.client.0.smithi096.stdout:4/85: rmdir d4 39 2024-04-18T04:57:54.038 INFO:tasks.workunit.client.0.smithi096.stdout:7/49: rename db/cc to db/c10 0 2024-04-18T04:57:54.042 INFO:tasks.workunit.client.0.smithi096.stdout:1/107: symlink de/l1c 0 2024-04-18T04:57:54.043 INFO:tasks.workunit.client.0.smithi096.stdout:4/86: fsync d4/f19 0 2024-04-18T04:57:54.044 INFO:tasks.workunit.client.0.smithi096.stdout:7/50: creat db/f11 x:0 0 0 2024-04-18T04:57:54.047 INFO:tasks.workunit.client.0.smithi096.stdout:1/108: mkdir de/d1d 0 2024-04-18T04:57:54.047 INFO:tasks.workunit.client.0.smithi096.stdout:7/51: fdatasync f1 0 2024-04-18T04:57:54.047 INFO:tasks.workunit.client.0.smithi096.stdout:4/87: stat d4/d14/d16 0 2024-04-18T04:57:54.048 INFO:tasks.workunit.client.0.smithi096.stdout:6/83: dread d0/fc [0,4194304] 0 2024-04-18T04:57:54.049 INFO:tasks.workunit.client.0.smithi096.stdout:2/99: dwrite df/f1b [0,4194304] 0 2024-04-18T04:57:54.050 INFO:tasks.workunit.client.0.smithi096.stdout:3/38: dread f6 [4194304,4194304] 0 2024-04-18T04:57:54.050 INFO:tasks.workunit.client.0.smithi096.stdout:7/52: write f9 [3244582,123978] 0 2024-04-18T04:57:54.051 INFO:tasks.workunit.client.0.smithi096.stdout:4/88: creat d4/d14/f1a x:0 0 0 2024-04-18T04:57:54.052 INFO:tasks.workunit.client.0.smithi096.stdout:2/100: chown df/f17 13872 1 2024-04-18T04:57:54.056 INFO:tasks.workunit.client.0.smithi096.stdout:7/53: write f9 [4419606,27515] 0 2024-04-18T04:57:54.056 INFO:tasks.workunit.client.0.smithi096.stdout:1/109: dread de/f18 [0,4194304] 0 2024-04-18T04:57:54.059 INFO:tasks.workunit.client.0.smithi096.stdout:3/39: dread f3 [4194304,4194304] 0 2024-04-18T04:57:54.059 INFO:tasks.workunit.client.0.smithi096.stdout:4/89: rename d4/cc to d4/c1b 0 2024-04-18T04:57:54.060 INFO:tasks.workunit.client.0.smithi096.stdout:7/54: write db/fe [715606,48752] 0 2024-04-18T04:57:54.061 INFO:tasks.workunit.client.0.smithi096.stdout:6/84: dread d0/fc [0,4194304] 0 2024-04-18T04:57:54.061 INFO:tasks.workunit.client.0.smithi096.stdout:1/110: rename l3 to de/l1e 0 2024-04-18T04:57:54.064 INFO:tasks.workunit.client.0.smithi096.stdout:4/90: mknod d4/d14/c1c 0 2024-04-18T04:57:54.064 INFO:tasks.workunit.client.0.smithi096.stdout:3/40: write f8 [1975148,28504] 0 2024-04-18T04:57:54.066 INFO:tasks.workunit.client.0.smithi096.stdout:6/85: chown d0/ca 43837 1 2024-04-18T04:57:54.066 INFO:tasks.workunit.client.0.smithi096.stdout:4/91: chown d4/c12 67455 1 2024-04-18T04:57:54.068 INFO:tasks.workunit.client.0.smithi096.stdout:7/55: truncate f7 730340 0 2024-04-18T04:57:54.069 INFO:tasks.workunit.client.0.smithi096.stdout:2/101: dwrite f4 [4194304,4194304] 0 2024-04-18T04:57:54.069 INFO:tasks.workunit.client.0.smithi096.stdout:1/111: truncate fa 725764 0 2024-04-18T04:57:54.072 INFO:tasks.workunit.client.0.smithi096.stdout:2/102: symlink df/l1f 0 2024-04-18T04:57:54.073 INFO:tasks.workunit.client.0.smithi096.stdout:4/92: dread d4/fb [0,4194304] 0 2024-04-18T04:57:54.073 INFO:tasks.workunit.client.0.smithi096.stdout:6/86: dread d0/fc [0,4194304] 0 2024-04-18T04:57:54.073 INFO:tasks.workunit.client.0.smithi096.stdout:4/93: dread - d4/d14/f1a zero size 2024-04-18T04:57:54.074 INFO:tasks.workunit.client.0.smithi096.stdout:1/112: dread de/f18 [0,4194304] 0 2024-04-18T04:57:54.075 INFO:tasks.workunit.client.0.smithi096.stdout:3/41: link f8 fa 0 2024-04-18T04:57:54.075 INFO:tasks.workunit.client.0.smithi096.stdout:1/113: fsync de/ff 0 2024-04-18T04:57:54.076 INFO:tasks.workunit.client.0.smithi096.stdout:6/87: mknod d0/d6/cd 0 2024-04-18T04:57:54.078 INFO:tasks.workunit.client.0.smithi096.stdout:4/94: dread d4/f5 [0,4194304] 0 2024-04-18T04:57:54.078 INFO:tasks.workunit.client.0.smithi096.stdout:3/42: mknod cb 0 2024-04-18T04:57:54.079 INFO:tasks.workunit.client.0.smithi096.stdout:4/95: fsync d4/f5 0 2024-04-18T04:57:54.079 INFO:tasks.workunit.client.0.smithi096.stdout:6/88: write d0/fc [125311,60693] 0 2024-04-18T04:57:54.081 INFO:tasks.workunit.client.0.smithi096.stdout:4/96: write f1 [4138219,45189] 0 2024-04-18T04:57:54.082 INFO:tasks.workunit.client.0.smithi096.stdout:2/103: link df/f14 df/f20 0 2024-04-18T04:57:54.082 INFO:tasks.workunit.client.0.smithi096.stdout:6/89: mkdir d0/de 0 2024-04-18T04:57:54.084 INFO:tasks.workunit.client.0.smithi096.stdout:2/104: fdatasync fb 0 2024-04-18T04:57:54.085 INFO:tasks.workunit.client.0.smithi096.stdout:4/97: mkdir d4/d14/d1d 0 2024-04-18T04:57:54.086 INFO:tasks.workunit.client.0.smithi096.stdout:1/114: dwrite fb [0,4194304] 0 2024-04-18T04:57:54.087 INFO:tasks.workunit.client.0.smithi096.stdout:6/90: mknod d0/de/cf 0 2024-04-18T04:57:54.089 INFO:tasks.workunit.client.0.smithi096.stdout:4/98: symlink d4/l1e 0 2024-04-18T04:57:54.093 INFO:tasks.workunit.client.0.smithi096.stdout:6/91: mkdir d0/d6/d10 0 2024-04-18T04:57:54.094 INFO:tasks.workunit.client.0.smithi096.stdout:1/115: symlink de/d1d/l1f 0 2024-04-18T04:57:54.095 INFO:tasks.workunit.client.0.smithi096.stdout:1/116: readlink de/l1c 0 2024-04-18T04:57:54.095 INFO:tasks.workunit.client.0.smithi096.stdout:6/92: read d0/fc [960012,130456] 0 2024-04-18T04:57:54.095 INFO:tasks.workunit.client.0.smithi096.stdout:2/105: dwrite fc [0,4194304] 0 2024-04-18T04:57:54.097 INFO:tasks.workunit.client.0.smithi096.stdout:2/106: read fc [508278,40667] 0 2024-04-18T04:57:54.098 INFO:tasks.workunit.client.0.smithi096.stdout:4/99: rename d4/d14/c1c to d4/d14/d1d/c1f 0 2024-04-18T04:57:54.100 INFO:tasks.workunit.client.0.smithi096.stdout:1/117: creat de/f20 x:0 0 0 2024-04-18T04:57:54.106 INFO:tasks.workunit.client.0.smithi096.stdout:2/107: dwrite df/f1b [0,4194304] 0 2024-04-18T04:57:54.107 INFO:tasks.workunit.client.0.smithi096.stdout:4/100: rename d4/l13 to d4/d14/d1d/l20 0 2024-04-18T04:57:54.108 INFO:tasks.workunit.client.0.smithi096.stdout:9/53: sync 2024-04-18T04:57:54.109 INFO:tasks.workunit.client.0.smithi096.stdout:1/118: chown de/l1e 639 1 2024-04-18T04:57:54.109 INFO:tasks.workunit.client.0.smithi096.stdout:6/93: link d0/d6/f7 d0/de/f11 0 2024-04-18T04:57:54.112 INFO:tasks.workunit.client.0.smithi096.stdout:9/54: readlink d0/de/l12 0 2024-04-18T04:57:54.113 INFO:tasks.workunit.client.0.smithi096.stdout:1/119: dread f9 [0,4194304] 0 2024-04-18T04:57:54.114 INFO:tasks.workunit.client.0.smithi096.stdout:4/101: chown d4/d14/d1d/l20 851 1 2024-04-18T04:57:54.115 INFO:tasks.workunit.client.0.smithi096.stdout:6/94: rename d0/de/cf to d0/d6/c12 0 2024-04-18T04:57:54.116 INFO:tasks.workunit.client.0.smithi096.stdout:6/95: stat d0/d6/d10 0 2024-04-18T04:57:54.116 INFO:tasks.workunit.client.0.smithi096.stdout:9/55: mkdir d0/de/d13 0 2024-04-18T04:57:54.149 INFO:tasks.workunit.client.0.smithi096.stdout:1/120: symlink de/l21 0 2024-04-18T04:57:54.151 INFO:tasks.workunit.client.0.smithi096.stdout:4/102: mknod d4/d14/c21 0 2024-04-18T04:57:54.151 INFO:tasks.workunit.client.0.smithi096.stdout:6/96: unlink d0/d6/cd 0 2024-04-18T04:57:54.153 INFO:tasks.workunit.client.0.smithi096.stdout:1/121: write de/f12 [666459,59768] 0 2024-04-18T04:57:54.155 INFO:tasks.workunit.client.0.smithi096.stdout:9/56: rename d0/c8 to d0/de/d13/c14 0 2024-04-18T04:57:54.155 INFO:tasks.workunit.client.0.smithi096.stdout:2/108: dwrite f0 [0,4194304] 0 2024-04-18T04:57:54.158 INFO:tasks.workunit.client.0.smithi096.stdout:6/97: rename d0/c2 to d0/de/c13 0 2024-04-18T04:57:54.159 INFO:tasks.workunit.client.0.smithi096.stdout:1/122: link c8 de/c22 0 2024-04-18T04:57:54.159 INFO:tasks.workunit.client.0.smithi096.stdout:1/123: write de/ff [966278,103237] 0 2024-04-18T04:57:54.161 INFO:tasks.workunit.client.0.smithi096.stdout:2/109: link df/f14 df/d1c/f21 0 2024-04-18T04:57:54.163 INFO:tasks.workunit.client.0.smithi096.stdout:1/124: mknod de/c23 0 2024-04-18T04:57:54.163 INFO:tasks.workunit.client.0.smithi096.stdout:1/125: read de/f18 [3769097,89028] 0 2024-04-18T04:57:54.165 INFO:tasks.workunit.client.0.smithi096.stdout:1/126: symlink de/l24 0 2024-04-18T04:57:54.165 INFO:tasks.workunit.client.0.smithi096.stdout:1/127: chown de/f17 21 1 2024-04-18T04:57:54.168 INFO:tasks.workunit.client.0.smithi096.stdout:1/128: chown l2 0 1 2024-04-18T04:57:54.169 INFO:tasks.workunit.client.0.smithi096.stdout:1/129: read - de/f20 zero size 2024-04-18T04:57:54.172 INFO:tasks.workunit.client.0.smithi096.stdout:1/130: rename de/f1a to de/d1d/f25 0 2024-04-18T04:57:54.182 INFO:tasks.workunit.client.0.smithi096.stdout:6/98: write d0/fc [892876,63873] 0 2024-04-18T04:57:54.183 INFO:tasks.workunit.client.0.smithi096.stdout:2/110: write df/d1c/f21 [152485,81253] 0 2024-04-18T04:57:54.186 INFO:tasks.workunit.client.0.smithi096.stdout:6/99: mknod d0/d6/d10/c14 0 2024-04-18T04:57:54.188 INFO:tasks.workunit.client.0.smithi096.stdout:2/111: unlink df/l13 0 2024-04-18T04:57:54.189 INFO:tasks.workunit.client.0.smithi096.stdout:1/131: truncate de/f17 3486137 0 2024-04-18T04:57:54.192 INFO:tasks.workunit.client.0.smithi096.stdout:6/100: rename d0/de/f11 to d0/d6/f15 0 2024-04-18T04:57:54.193 INFO:tasks.workunit.client.0.smithi096.stdout:2/112: rmdir df/d18 39 2024-04-18T04:57:54.194 INFO:tasks.workunit.client.0.smithi096.stdout:2/113: dread fd [0,4194304] 0 2024-04-18T04:57:54.194 INFO:tasks.workunit.client.0.smithi096.stdout:1/132: stat c8 0 2024-04-18T04:57:54.198 INFO:tasks.workunit.client.0.smithi096.stdout:1/133: dread f6 [0,4194304] 0 2024-04-18T04:57:54.198 INFO:tasks.workunit.client.0.smithi096.stdout:1/134: dread - de/f20 zero size 2024-04-18T04:57:54.203 INFO:tasks.workunit.client.0.smithi096.stdout:6/101: dwrite d0/fc [0,4194304] 0 2024-04-18T04:57:54.204 INFO:tasks.workunit.client.0.smithi096.stdout:2/114: chown df/d18/f1d 5 1 2024-04-18T04:57:54.207 INFO:tasks.workunit.client.0.smithi096.stdout:1/135: rmdir de 39 2024-04-18T04:57:54.209 INFO:tasks.workunit.client.0.smithi096.stdout:6/102: mkdir d0/d6/d10/d16 0 2024-04-18T04:57:54.210 INFO:tasks.workunit.client.0.smithi096.stdout:2/115: creat df/d18/f22 x:0 0 0 2024-04-18T04:57:54.211 INFO:tasks.workunit.client.0.smithi096.stdout:2/116: chown df/d18/f1d 3321 1 2024-04-18T04:57:54.215 INFO:tasks.workunit.client.0.smithi096.stdout:1/136: mknod de/d1d/c26 0 2024-04-18T04:57:54.216 INFO:tasks.workunit.client.0.smithi096.stdout:6/103: unlink d0/de/c13 0 2024-04-18T04:57:54.217 INFO:tasks.workunit.client.0.smithi096.stdout:1/137: symlink de/d1d/l27 0 2024-04-18T04:57:54.218 INFO:tasks.workunit.client.0.smithi096.stdout:2/117: dwrite df/f20 [0,4194304] 0 2024-04-18T04:57:54.219 INFO:tasks.workunit.client.0.smithi096.stdout:1/138: write de/f18 [1157831,92682] 0 2024-04-18T04:57:54.221 INFO:tasks.workunit.client.0.smithi096.stdout:2/118: creat df/d18/f23 x:0 0 0 2024-04-18T04:57:54.221 INFO:tasks.workunit.client.0.smithi096.stdout:1/139: stat de/d1d/c26 0 2024-04-18T04:57:54.223 INFO:tasks.workunit.client.0.smithi096.stdout:2/119: write df/f20 [1449731,90314] 0 2024-04-18T04:57:54.225 INFO:tasks.workunit.client.0.smithi096.stdout:1/140: unlink de/c22 0 2024-04-18T04:57:54.226 INFO:tasks.workunit.client.0.smithi096.stdout:6/104: dwrite d0/fc [4194304,4194304] 0 2024-04-18T04:57:54.226 INFO:tasks.workunit.client.0.smithi096.stdout:2/120: mkdir df/d18/d24 0 2024-04-18T04:57:54.228 INFO:tasks.workunit.client.0.smithi096.stdout:2/121: write df/d1c/f21 [870484,59385] 0 2024-04-18T04:57:54.229 INFO:tasks.workunit.client.0.smithi096.stdout:1/141: creat de/f28 x:0 0 0 2024-04-18T04:57:54.237 INFO:tasks.workunit.client.0.smithi096.stdout:2/122: dwrite f9 [0,4194304] 0 2024-04-18T04:57:54.237 INFO:tasks.workunit.client.0.smithi096.stdout:1/142: dread de/f17 [0,4194304] 0 2024-04-18T04:57:54.238 INFO:tasks.workunit.client.0.smithi096.stdout:1/143: chown de/f12 316780141 1 2024-04-18T04:57:54.238 INFO:tasks.workunit.client.0.smithi096.stdout:2/123: write df/d1c/f21 [2873223,117245] 0 2024-04-18T04:57:54.239 INFO:tasks.workunit.client.0.smithi096.stdout:6/105: truncate d0/d6/f15 6658914 0 2024-04-18T04:57:54.239 INFO:tasks.workunit.client.0.smithi096.stdout:1/144: truncate de/ff 1614300 0 2024-04-18T04:57:54.242 INFO:tasks.workunit.client.0.smithi096.stdout:1/145: creat de/f29 x:0 0 0 2024-04-18T04:57:54.243 INFO:tasks.workunit.client.0.smithi096.stdout:1/146: dread - de/f28 zero size 2024-04-18T04:57:54.243 INFO:tasks.workunit.client.0.smithi096.stdout:1/147: stat de/f28 0 2024-04-18T04:57:54.243 INFO:tasks.workunit.client.0.smithi096.stdout:2/124: link f4 df/d18/f25 0 2024-04-18T04:57:54.244 INFO:tasks.workunit.client.0.smithi096.stdout:1/148: write de/f12 [1578010,51695] 0 2024-04-18T04:57:54.246 INFO:tasks.workunit.client.0.smithi096.stdout:2/125: write df/d18/f25 [1396495,50390] 0 2024-04-18T04:57:54.247 INFO:tasks.workunit.client.0.smithi096.stdout:2/126: write df/f12 [521040,7325] 0 2024-04-18T04:57:54.247 INFO:tasks.workunit.client.0.smithi096.stdout:6/106: link d0/d6/c12 d0/d6/c17 0 2024-04-18T04:57:54.247 INFO:tasks.workunit.client.0.smithi096.stdout:2/127: readlink df/l1f 0 2024-04-18T04:57:54.248 INFO:tasks.workunit.client.0.smithi096.stdout:2/128: dread - df/d18/f23 zero size 2024-04-18T04:57:54.250 INFO:tasks.workunit.client.0.smithi096.stdout:1/149: rmdir de 39 2024-04-18T04:57:54.253 INFO:tasks.workunit.client.0.smithi096.stdout:1/150: stat de/f12 0 2024-04-18T04:57:54.254 INFO:tasks.workunit.client.0.smithi096.stdout:1/151: write de/ff [2140463,10633] 0 2024-04-18T04:57:54.255 INFO:tasks.workunit.client.0.smithi096.stdout:1/152: chown f6 122051294 1 2024-04-18T04:57:54.256 INFO:tasks.workunit.client.0.smithi096.stdout:1/153: rmdir de/d1d 39 2024-04-18T04:57:54.257 INFO:tasks.workunit.client.0.smithi096.stdout:6/107: dwrite d0/d6/f7 [0,4194304] 0 2024-04-18T04:57:54.257 INFO:tasks.workunit.client.0.smithi096.stdout:1/154: chown c8 13268602 1 2024-04-18T04:57:54.258 INFO:tasks.workunit.client.0.smithi096.stdout:6/108: write d0/d6/f15 [3079184,85935] 0 2024-04-18T04:57:54.258 INFO:tasks.workunit.client.0.smithi096.stdout:1/155: write f6 [4644199,101313] 0 2024-04-18T04:57:54.260 INFO:tasks.workunit.client.0.smithi096.stdout:6/109: read d0/fc [282111,86816] 0 2024-04-18T04:57:54.260 INFO:tasks.workunit.client.0.smithi096.stdout:6/110: chown d0/de 55 1 2024-04-18T04:57:54.264 INFO:tasks.workunit.client.0.smithi096.stdout:6/111: getdents d0/d6/d10 0 2024-04-18T04:57:54.266 INFO:tasks.workunit.client.0.smithi096.stdout:6/112: truncate d0/d6/f7 7254345 0 2024-04-18T04:57:54.267 INFO:tasks.workunit.client.0.smithi096.stdout:1/156: dwrite de/f12 [0,4194304] 0 2024-04-18T04:57:54.269 INFO:tasks.workunit.client.0.smithi096.stdout:6/113: rename d0/de to d0/d6/d10/d18 0 2024-04-18T04:57:54.271 INFO:tasks.workunit.client.0.smithi096.stdout:1/157: mknod de/c2a 0 2024-04-18T04:57:54.271 INFO:tasks.workunit.client.0.smithi096.stdout:1/158: dread - de/f20 zero size 2024-04-18T04:57:54.272 INFO:tasks.workunit.client.0.smithi096.stdout:1/159: chown de/f16 1190492 1 2024-04-18T04:57:54.279 INFO:tasks.workunit.client.0.smithi096.stdout:1/160: dwrite de/f12 [0,4194304] 0 2024-04-18T04:57:54.280 INFO:tasks.workunit.client.0.smithi096.stdout:6/114: truncate d0/fc 6007045 0 2024-04-18T04:57:54.280 INFO:tasks.workunit.client.0.smithi096.stdout:6/115: chown d0 400 1 2024-04-18T04:57:54.282 INFO:tasks.workunit.client.0.smithi096.stdout:1/161: rename de/l14 to de/d1d/l2b 0 2024-04-18T04:57:54.284 INFO:tasks.workunit.client.0.smithi096.stdout:1/162: mknod de/d1d/c2c 0 2024-04-18T04:57:54.284 INFO:tasks.workunit.client.0.smithi096.stdout:1/163: readlink de/l15 0 2024-04-18T04:57:54.284 INFO:tasks.workunit.client.0.smithi096.stdout:1/164: chown de/d1d/c26 3476 1 2024-04-18T04:57:54.290 INFO:tasks.workunit.client.0.smithi096.stdout:6/116: dread d0/d6/f7 [0,4194304] 0 2024-04-18T04:57:54.292 INFO:tasks.workunit.client.0.smithi096.stdout:0/60: sync 2024-04-18T04:57:54.293 INFO:tasks.workunit.client.0.smithi096.stdout:0/61: write f7 [282287,128082] 0 2024-04-18T04:57:54.294 INFO:tasks.workunit.client.0.smithi096.stdout:6/117: write d0/fc [6587973,55665] 0 2024-04-18T04:57:54.295 INFO:tasks.workunit.client.0.smithi096.stdout:0/62: symlink l12 0 2024-04-18T04:57:54.297 INFO:tasks.workunit.client.0.smithi096.stdout:6/118: unlink d0/d6/d10/c14 0 2024-04-18T04:57:54.297 INFO:tasks.workunit.client.0.smithi096.stdout:0/63: mknod c13 0 2024-04-18T04:57:54.299 INFO:tasks.workunit.client.0.smithi096.stdout:0/64: mknod c14 0 2024-04-18T04:57:54.300 INFO:tasks.workunit.client.0.smithi096.stdout:1/165: dwrite f9 [0,4194304] 0 2024-04-18T04:57:54.300 INFO:tasks.workunit.client.0.smithi096.stdout:0/65: chown c2 0 1 2024-04-18T04:57:54.302 INFO:tasks.workunit.client.0.smithi096.stdout:6/119: link d0/fc d0/d6/d10/f19 0 2024-04-18T04:57:54.302 INFO:tasks.workunit.client.0.smithi096.stdout:1/166: rmdir de/d1d 39 2024-04-18T04:57:54.306 INFO:tasks.workunit.client.0.smithi096.stdout:0/66: dread f4 [0,4194304] 0 2024-04-18T04:57:54.306 INFO:tasks.workunit.client.0.smithi096.stdout:6/120: rmdir d0/d6/d10/d16 0 2024-04-18T04:57:54.307 INFO:tasks.workunit.client.0.smithi096.stdout:0/67: rename c8 to c15 0 2024-04-18T04:57:54.308 INFO:tasks.workunit.client.0.smithi096.stdout:1/167: link de/d1d/l27 de/d1d/l2d 0 2024-04-18T04:57:54.310 INFO:tasks.workunit.client.0.smithi096.stdout:1/168: read f6 [1352566,16089] 0 2024-04-18T04:57:54.310 INFO:tasks.workunit.client.0.smithi096.stdout:6/121: fdatasync d0/d6/f15 0 2024-04-18T04:57:54.310 INFO:tasks.workunit.client.0.smithi096.stdout:0/68: mkdir d16 0 2024-04-18T04:57:54.311 INFO:tasks.workunit.client.0.smithi096.stdout:0/69: dread - fe zero size 2024-04-18T04:57:54.311 INFO:tasks.workunit.client.0.smithi096.stdout:1/169: dread - de/f20 zero size 2024-04-18T04:57:54.311 INFO:tasks.workunit.client.0.smithi096.stdout:0/70: rename d16 to d16/d17 22 2024-04-18T04:57:54.313 INFO:tasks.workunit.client.0.smithi096.stdout:6/122: unlink d0/d6/d10/f19 0 2024-04-18T04:57:54.316 INFO:tasks.workunit.client.0.smithi096.stdout:1/170: creat de/f2e x:0 0 0 2024-04-18T04:57:54.317 INFO:tasks.workunit.client.0.smithi096.stdout:6/123: write d0/d6/f15 [2488986,26328] 0 2024-04-18T04:57:54.319 INFO:tasks.workunit.client.0.smithi096.stdout:1/171: creat de/f2f x:0 0 0 2024-04-18T04:57:54.321 INFO:tasks.workunit.client.0.smithi096.stdout:0/71: dwrite f11 [0,4194304] 0 2024-04-18T04:57:54.339 INFO:tasks.workunit.client.0.smithi096.stdout:1/172: dwrite f9 [0,4194304] 0 2024-04-18T04:57:54.340 INFO:tasks.workunit.client.0.smithi096.stdout:6/124: dwrite d0/fc [0,4194304] 0 2024-04-18T04:57:54.342 INFO:tasks.workunit.client.0.smithi096.stdout:1/173: write de/f18 [4430861,60079] 0 2024-04-18T04:57:54.342 INFO:tasks.workunit.client.0.smithi096.stdout:0/72: dwrite f7 [0,4194304] 0 2024-04-18T04:57:54.344 INFO:tasks.workunit.client.0.smithi096.stdout:0/73: write f11 [610247,69743] 0 2024-04-18T04:57:54.344 INFO:tasks.workunit.client.0.smithi096.stdout:0/74: dread - fe zero size 2024-04-18T04:57:54.348 INFO:tasks.workunit.client.0.smithi096.stdout:1/174: dread de/f18 [0,4194304] 0 2024-04-18T04:57:54.400 INFO:tasks.workunit.client.0.smithi096.stdout:6/125: rename d0/d6/d10/d18 to d0/d6/d10/d1a 0 2024-04-18T04:57:54.401 INFO:tasks.workunit.client.0.smithi096.stdout:1/175: creat de/d1d/f30 x:0 0 0 2024-04-18T04:57:54.402 INFO:tasks.workunit.client.0.smithi096.stdout:0/75: symlink d16/l18 0 2024-04-18T04:57:54.405 INFO:tasks.workunit.client.0.smithi096.stdout:1/176: symlink de/d1d/l31 0 2024-04-18T04:57:54.407 INFO:tasks.workunit.client.0.smithi096.stdout:1/177: chown lc 194906319 1 2024-04-18T04:57:54.410 INFO:tasks.workunit.client.0.smithi096.stdout:6/126: dread d0/d6/f15 [4194304,4194304] 0 2024-04-18T04:57:54.411 INFO:tasks.workunit.client.0.smithi096.stdout:1/178: mkdir de/d1d/d32 0 2024-04-18T04:57:54.413 INFO:tasks.workunit.client.0.smithi096.stdout:1/179: readlink de/d1d/l2b 0 2024-04-18T04:57:54.413 INFO:tasks.workunit.client.0.smithi096.stdout:0/76: dread f11 [0,4194304] 0 2024-04-18T04:57:54.417 INFO:tasks.workunit.client.0.smithi096.stdout:6/127: rename d0/d6/c12 to d0/d6/d10/d1a/c1b 0 2024-04-18T04:57:54.420 INFO:tasks.workunit.client.0.smithi096.stdout:0/77: rename f4 to d16/f19 0 2024-04-18T04:57:54.421 INFO:tasks.workunit.client.0.smithi096.stdout:6/128: symlink d0/l1c 0 2024-04-18T04:57:54.427 INFO:tasks.workunit.client.0.smithi096.stdout:8/48: sync 2024-04-18T04:57:54.431 INFO:tasks.workunit.client.0.smithi096.stdout:8/49: chown d0/l1 2380311 1 2024-04-18T04:57:54.433 INFO:tasks.workunit.client.0.smithi096.stdout:0/78: dwrite fe [0,4194304] 0 2024-04-18T04:57:54.436 INFO:tasks.workunit.client.0.smithi096.stdout:6/129: dwrite d0/d6/f15 [0,4194304] 0 2024-04-18T04:57:54.439 INFO:tasks.workunit.client.0.smithi096.stdout:6/130: write d0/fc [2281183,61753] 0 2024-04-18T04:57:54.446 INFO:tasks.workunit.client.0.smithi096.stdout:6/131: creat d0/d6/f1d x:0 0 0 2024-04-18T04:57:54.448 INFO:tasks.workunit.client.0.smithi096.stdout:8/50: dwrite d0/d7/fd [0,4194304] 0 2024-04-18T04:57:54.448 INFO:tasks.workunit.client.0.smithi096.stdout:0/79: dwrite fe [0,4194304] 0 2024-04-18T04:57:54.454 INFO:tasks.workunit.client.0.smithi096.stdout:0/80: write f11 [4186914,2009] 0 2024-04-18T04:57:54.454 INFO:tasks.workunit.client.0.smithi096.stdout:6/132: dread d0/d6/f15 [4194304,4194304] 0 2024-04-18T04:57:54.455 INFO:tasks.workunit.client.0.smithi096.stdout:8/51: dread d0/f2 [0,4194304] 0 2024-04-18T04:57:54.456 INFO:tasks.workunit.client.0.smithi096.stdout:6/133: rename d0/d6 to d0/d6/d10/d1a/d1e 22 2024-04-18T04:57:54.456 INFO:tasks.workunit.client.0.smithi096.stdout:8/52: read d0/f2 [456199,102905] 0 2024-04-18T04:57:54.457 INFO:tasks.workunit.client.0.smithi096.stdout:0/81: creat d16/f1a x:0 0 0 2024-04-18T04:57:54.459 INFO:tasks.workunit.client.0.smithi096.stdout:6/134: unlink d0/l3 0 2024-04-18T04:57:54.461 INFO:tasks.workunit.client.0.smithi096.stdout:8/53: mknod d0/d7/ce 0 2024-04-18T04:57:54.463 INFO:tasks.workunit.client.0.smithi096.stdout:6/135: symlink d0/l1f 0 2024-04-18T04:57:54.466 INFO:tasks.workunit.client.0.smithi096.stdout:6/136: creat d0/d6/f20 x:0 0 0 2024-04-18T04:57:54.466 INFO:tasks.workunit.client.0.smithi096.stdout:8/54: mknod d0/d3/dc/cf 0 2024-04-18T04:57:54.467 INFO:tasks.workunit.client.0.smithi096.stdout:6/137: mknod d0/c21 0 2024-04-18T04:57:54.468 INFO:tasks.workunit.client.0.smithi096.stdout:6/138: readlink d0/l1c 0 2024-04-18T04:57:54.471 INFO:tasks.workunit.client.0.smithi096.stdout:6/139: dread d0/d6/f15 [4194304,4194304] 0 2024-04-18T04:57:54.472 INFO:tasks.workunit.client.0.smithi096.stdout:6/140: stat d0/l1f 0 2024-04-18T04:57:54.473 INFO:tasks.workunit.client.0.smithi096.stdout:8/55: dwrite d0/d7/fd [0,4194304] 0 2024-04-18T04:57:54.476 INFO:tasks.workunit.client.0.smithi096.stdout:8/56: mkdir d0/d7/d10 0 2024-04-18T04:57:54.478 INFO:tasks.workunit.client.0.smithi096.stdout:8/57: write d0/d7/fd [3007068,125166] 0 2024-04-18T04:57:54.482 INFO:tasks.workunit.client.0.smithi096.stdout:8/58: creat d0/d7/d10/f11 x:0 0 0 2024-04-18T04:57:54.482 INFO:tasks.workunit.client.0.smithi096.stdout:6/141: dwrite d0/d6/f15 [4194304,4194304] 0 2024-04-18T04:57:54.484 INFO:tasks.workunit.client.0.smithi096.stdout:1/180: truncate fa 2309356 0 2024-04-18T04:57:54.486 INFO:tasks.workunit.client.0.smithi096.stdout:6/142: creat d0/d6/d10/f22 x:0 0 0 2024-04-18T04:57:54.490 INFO:tasks.workunit.client.0.smithi096.stdout:6/143: unlink d0/fc 0 2024-04-18T04:57:54.495 INFO:tasks.workunit.client.0.smithi096.stdout:1/181: link de/c23 de/d1d/c33 0 2024-04-18T04:57:54.495 INFO:tasks.workunit.client.0.smithi096.stdout:1/182: chown de/f16 4 1 2024-04-18T04:57:54.497 INFO:tasks.workunit.client.0.smithi096.stdout:0/82: truncate f11 2080190 0 2024-04-18T04:57:54.498 INFO:tasks.workunit.client.0.smithi096.stdout:0/83: write fe [3320141,124524] 0 2024-04-18T04:57:54.500 INFO:tasks.workunit.client.0.smithi096.stdout:1/183: creat de/f34 x:0 0 0 2024-04-18T04:57:54.503 INFO:tasks.workunit.client.0.smithi096.stdout:6/144: dwrite d0/d6/f7 [4194304,4194304] 0 2024-04-18T04:57:54.504 INFO:tasks.workunit.client.0.smithi096.stdout:0/84: getdents d16 0 2024-04-18T04:57:54.504 INFO:tasks.workunit.client.0.smithi096.stdout:6/145: write d0/d6/f20 [786607,113360] 0 2024-04-18T04:57:54.504 INFO:tasks.workunit.client.0.smithi096.stdout:8/59: getdents d0/d7/d10 0 2024-04-18T04:57:54.507 INFO:tasks.workunit.client.0.smithi096.stdout:0/85: creat d16/f1b x:0 0 0 2024-04-18T04:57:54.510 INFO:tasks.workunit.client.0.smithi096.stdout:0/86: unlink ca 0 2024-04-18T04:57:54.510 INFO:tasks.workunit.client.0.smithi096.stdout:0/87: fsync ff 0 2024-04-18T04:57:54.510 INFO:tasks.workunit.client.0.smithi096.stdout:6/146: symlink d0/d6/d10/d1a/l23 0 2024-04-18T04:57:54.511 INFO:tasks.workunit.client.0.smithi096.stdout:8/60: dread d0/d7/fd [0,4194304] 0 2024-04-18T04:57:54.512 INFO:tasks.workunit.client.0.smithi096.stdout:0/88: mkdir d16/d1c 0 2024-04-18T04:57:54.513 INFO:tasks.workunit.client.0.smithi096.stdout:6/147: creat d0/d6/f24 x:0 0 0 2024-04-18T04:57:54.515 INFO:tasks.workunit.client.0.smithi096.stdout:0/89: truncate fd 1360094 0 2024-04-18T04:57:54.516 INFO:tasks.workunit.client.0.smithi096.stdout:6/148: mknod d0/d6/d10/d1a/c25 0 2024-04-18T04:57:54.518 INFO:tasks.workunit.client.0.smithi096.stdout:0/90: mkdir d16/d1d 0 2024-04-18T04:57:54.519 INFO:tasks.workunit.client.0.smithi096.stdout:0/91: truncate d16/f1a 320749 0 2024-04-18T04:57:54.519 INFO:tasks.workunit.client.0.smithi096.stdout:0/92: stat fe 0 2024-04-18T04:57:54.521 INFO:tasks.workunit.client.0.smithi096.stdout:8/61: dwrite d0/f2 [0,4194304] 0 2024-04-18T04:57:54.522 INFO:tasks.workunit.client.0.smithi096.stdout:6/149: link d0/d6/f20 d0/f26 0 2024-04-18T04:57:54.523 INFO:tasks.workunit.client.0.smithi096.stdout:6/150: write d0/d6/d10/f22 [17954,12669] 0 2024-04-18T04:57:54.525 INFO:tasks.workunit.client.0.smithi096.stdout:8/62: unlink d0/d3/dc/cf 0 2024-04-18T04:57:54.525 INFO:tasks.workunit.client.0.smithi096.stdout:8/63: readlink d0/l1 0 2024-04-18T04:57:54.527 INFO:tasks.workunit.client.0.smithi096.stdout:0/93: creat d16/d1d/f1e x:0 0 0 2024-04-18T04:57:54.530 INFO:tasks.workunit.client.0.smithi096.stdout:6/151: dwrite d0/d6/f7 [4194304,4194304] 0 2024-04-18T04:57:54.530 INFO:tasks.workunit.client.0.smithi096.stdout:8/64: mknod d0/c12 0 2024-04-18T04:57:54.531 INFO:tasks.workunit.client.0.smithi096.stdout:6/152: dread - d0/d6/f1d zero size 2024-04-18T04:57:54.533 INFO:tasks.workunit.client.0.smithi096.stdout:6/153: fsync d0/d6/d10/f22 0 2024-04-18T04:57:54.534 INFO:tasks.workunit.client.0.smithi096.stdout:8/65: creat d0/f13 x:0 0 0 2024-04-18T04:57:54.535 INFO:tasks.workunit.client.0.smithi096.stdout:6/154: write d0/d6/f1d [518259,111460] 0 2024-04-18T04:57:54.536 INFO:tasks.workunit.client.0.smithi096.stdout:0/94: dwrite fe [0,4194304] 0 2024-04-18T04:57:54.537 INFO:tasks.workunit.client.0.smithi096.stdout:0/95: write d16/d1d/f1e [530653,103756] 0 2024-04-18T04:57:54.538 INFO:tasks.workunit.client.0.smithi096.stdout:8/66: symlink d0/l14 0 2024-04-18T04:57:54.539 INFO:tasks.workunit.client.0.smithi096.stdout:0/96: creat d16/f1f x:0 0 0 2024-04-18T04:57:54.542 INFO:tasks.workunit.client.0.smithi096.stdout:0/97: unlink d16/l18 0 2024-04-18T04:57:54.544 INFO:tasks.workunit.client.0.smithi096.stdout:0/98: mknod d16/c20 0 2024-04-18T04:57:54.545 INFO:tasks.workunit.client.0.smithi096.stdout:6/155: link d0/d6/d10/d1a/c1b d0/d6/d10/d1a/c27 0 2024-04-18T04:57:54.546 INFO:tasks.workunit.client.0.smithi096.stdout:6/156: stat d0/d6/f20 0 2024-04-18T04:57:54.547 INFO:tasks.workunit.client.0.smithi096.stdout:8/67: rmdir d0/d3 39 2024-04-18T04:57:54.547 INFO:tasks.workunit.client.0.smithi096.stdout:6/157: write d0/d6/f1d [1447561,11413] 0 2024-04-18T04:57:54.549 INFO:tasks.workunit.client.0.smithi096.stdout:6/158: mknod d0/d6/d10/d1a/c28 0 2024-04-18T04:57:54.551 INFO:tasks.workunit.client.0.smithi096.stdout:6/159: mkdir d0/d6/d29 0 2024-04-18T04:57:54.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fa7fc640 1 -- 172.21.15.96:0/4107782311 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412049453 0 0) 0x7f64fc066940 con 0x7f64e8006210 2024-04-18T04:57:54.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fa7fc640 1 -- 172.21.15.96:0/4107782311 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64e4003530 con 0x7f64e8006210 2024-04-18T04:57:54.554 INFO:tasks.workunit.client.0.smithi096.stdout:6/160: rename d0/l1f to d0/d6/d10/l2a 0 2024-04-18T04:57:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fa7fc640 1 -- 172.21.15.96:0/4107782311 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1513146808 0 0) 0x7f64e4003530 con 0x7f64e8006210 2024-04-18T04:57:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fa7fc640 1 -- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 msgr2=0x7f64e8005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:57:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fa7fc640 1 --2- 172.21.15.96:0/4107782311 >> v2:172.21.15.96:3300/0 conn(0x7f64e80036d0 0x7f64e8005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fa7fc640 1 -- 172.21.15.96:0/4107782311 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e800b010 con 0x7f64e8006210 2024-04-18T04:57:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fa7fc640 1 -- 172.21.15.96:0/4107782311 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f64f0001700 con 0x7f64e8006210 2024-04-18T04:57:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fa7fc640 1 -- 172.21.15.96:0/4107782311 >> v1:172.21.15.96:6789/0 conn(0x7f64e8006210 legacy=0x7f64e80086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fa7fc640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64e4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fbfff640 1 -- 172.21.15.96:0/4107782311 reap_dead start 2024-04-18T04:57:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fa7fc640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64e4003fe0 0x7f64e40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fa7fc640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64e4004d60 0x7f64e40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:54.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fa7fc640 1 -- 172.21.15.96:0/4107782311 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0ca390 con 0x7f64e4004d60 2024-04-18T04:57:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fa7fc640 1 -- 172.21.15.96:0/4107782311 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e400bc70 con 0x7f64e4003fe0 2024-04-18T04:57:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fa7fc640 1 -- 172.21.15.96:0/4107782311 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e400be30 con 0x7f64fc152fe0 2024-04-18T04:57:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fbfff640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64e4004d60 0x7f64e40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64e4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64faffd640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64e4003fe0 0x7f64e40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fbfff640 1 -- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 msgr2=0x7f64e4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fbfff640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64e4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fbfff640 1 -- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64e4003fe0 msgr2=0x7f64e40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fbfff640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64e4003fe0 0x7f64e40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:54.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.554+0000 7f64fbfff640 1 -- 172.21.15.96:0/4107782311 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e4003530 con 0x7f64e4004d60 2024-04-18T04:57:54.558 INFO:tasks.workunit.client.0.smithi096.stdout:6/161: write d0/d6/f15 [9230809,54069] 0 2024-04-18T04:57:54.558 INFO:tasks.workunit.client.0.smithi096.stdout:8/68: truncate d0/d7/fd 1269067 0 2024-04-18T04:57:54.558 INFO:tasks.workunit.client.0.smithi096.stdout:6/162: mkdir d0/d6/d2b 0 2024-04-18T04:57:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.558+0000 7f64fbfff640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64e4004d60 0x7f64e40051e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0ca2e0 tx=0x7f64f401d210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e848f38a7d18b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.558+0000 7f64fa7fc640 1 -- 172.21.15.96:0/4107782311 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f40ae410 con 0x7f64e4004d60 2024-04-18T04:57:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.558+0000 7f64fa7fc640 1 -- 172.21.15.96:0/4107782311 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f40a8030 con 0x7f64e4004d60 2024-04-18T04:57:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.558+0000 7f64fa7fc640 1 -- 172.21.15.96:0/4107782311 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f40ae5d0 con 0x7f64e4004d60 2024-04-18T04:57:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.558+0000 7f6501c04640 1 -- 172.21.15.96:0/4107782311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64e4004d60 msgr2=0x7f64e40051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.558+0000 7f6501c04640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64e4004d60 0x7f64e40051e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0ca2e0 tx=0x7f64f401d210 comp rx=0 tx=0).stop 2024-04-18T04:57:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.558+0000 7f6501c04640 1 -- 172.21.15.96:0/4107782311 shutdown_connections 2024-04-18T04:57:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.558+0000 7f6501c04640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64e4004d60 0x7f64e40051e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.558+0000 7f6501c04640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64e4003fe0 0x7f64e40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.558+0000 7f6501c04640 1 --2- 172.21.15.96:0/4107782311 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64e4003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.558+0000 7f6501c04640 1 -- 172.21.15.96:0/4107782311 >> 172.21.15.96:0/4107782311 conn(0x7f64fc071760 msgr2=0x7f64fc065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:54.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.558+0000 7f6501c04640 1 -- 172.21.15.96:0/4107782311 shutdown_connections 2024-04-18T04:57:54.563 INFO:tasks.workunit.client.0.smithi096.stdout:8/69: read d0/d3/fb [2646688,34211] 0 2024-04-18T04:57:54.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.558+0000 7f6501c04640 1 -- 172.21.15.96:0/4107782311 wait complete. 2024-04-18T04:57:54.563 INFO:tasks.workunit.client.0.smithi096.stdout:0/99: dwrite fd [0,4194304] 0 2024-04-18T04:57:54.563 INFO:tasks.workunit.client.0.smithi096.stdout:6/163: creat d0/d6/f2c x:0 0 0 2024-04-18T04:57:54.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f6501c04640 1 Processor -- start 2024-04-18T04:57:54.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f6501c04640 1 -- start start 2024-04-18T04:57:54.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f6501c04640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64e4003fe0 0x7f64fc0cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:54.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f6501c04640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64e4004d60 0x7f64fc0cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:54.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f6501c04640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:54.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f6501c04640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc14ec40 con 0x7f64e4003fe0 2024-04-18T04:57:54.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f6501c04640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0cc5f0 con 0x7f64e4004d60 2024-04-18T04:57:54.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f6501c04640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0cee10 con 0x7f64fc152fe0 2024-04-18T04:57:54.565 INFO:tasks.workunit.client.0.smithi096.stdout:8/70: mkdir d0/d15 0 2024-04-18T04:57:54.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64fb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64e4003fe0 0x7f64fc0cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:54.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64fb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64e4003fe0 0x7f64fc0cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41970/0 (socket says 172.21.15.96:41970) 2024-04-18T04:57:54.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64fb7fe640 1 -- 172.21.15.96:0/1165974789 learned_addr learned my addr 172.21.15.96:0/1165974789 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:54.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64faffd640 1 --2- 172.21.15.96:0/1165974789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64e4004d60 0x7f64fc0cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:54.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64fbfff640 1 --2- 172.21.15.96:0/1165974789 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:54.566 INFO:tasks.workunit.client.0.smithi096.stdout:6/164: write d0/d6/f15 [9708488,57726] 0 2024-04-18T04:57:54.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64faffd640 1 -- 172.21.15.96:0/1165974789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64e4004d60 msgr2=0x7f64fc0cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-18T04:57:54.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64faffd640 1 -- 172.21.15.96:0/1165974789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64e4004d60 msgr2=0x7f64fc0cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T04:57:54.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64faffd640 1 --2- 172.21.15.96:0/1165974789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64e4004d60 0x7f64fc0cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:54.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64fb7fe640 1 -- 172.21.15.96:0/1165974789 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 msgr2=0x7f64fc148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:54.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/1165974789 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:54.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64faffd640 1 --2- 172.21.15.96:0/1165974789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64e4004d60 0x7f64fc0cd5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:54.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64fb7fe640 1 -- 172.21.15.96:0/1165974789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64e4004d60 msgr2=0x7f64fc0cd5a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:57:54.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/1165974789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64e4004d60 0x7f64fc0cd5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:54.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64fb7fe640 1 -- 172.21.15.96:0/1165974789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0cf0f0 con 0x7f64e4003fe0 2024-04-18T04:57:54.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64fb7fe640 1 --2- 172.21.15.96:0/1165974789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64e4003fe0 0x7f64fc0cd060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0169c0 tx=0x7f64ec016e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:54.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64e3fff640 1 -- 172.21.15.96:0/1165974789 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec01e050 con 0x7f64e4003fe0 2024-04-18T04:57:54.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64e3fff640 1 -- 172.21.15.96:0/1165974789 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec01f040 con 0x7f64e4003fe0 2024-04-18T04:57:54.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f6501c04640 1 -- 172.21.15.96:0/1165974789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc0cc860 con 0x7f64e4003fe0 2024-04-18T04:57:54.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f64e3fff640 1 -- 172.21.15.96:0/1165974789 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec023640 con 0x7f64e4003fe0 2024-04-18T04:57:54.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.562+0000 7f6501c04640 1 -- 172.21.15.96:0/1165974789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64fc0cf3d0 con 0x7f64e4003fe0 2024-04-18T04:57:54.568 INFO:tasks.workunit.client.0.smithi096.stdout:0/100: truncate d16/f19 439448 0 2024-04-18T04:57:54.569 INFO:tasks.workunit.client.0.smithi096.stdout:0/101: dread - ff zero size 2024-04-18T04:57:54.569 INFO:tasks.workunit.client.0.smithi096.stdout:8/71: mknod d0/d7/c16 0 2024-04-18T04:57:54.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.566+0000 7f64e3fff640 1 -- 172.21.15.96:0/1165974789 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f64ec0237a0 con 0x7f64e4003fe0 2024-04-18T04:57:54.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.566+0000 7f6501c04640 1 -- 172.21.15.96:0/1165974789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64fc067050 con 0x7f64e4003fe0 2024-04-18T04:57:54.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.566+0000 7f64e3fff640 1 --2- 172.21.15.96:0/1165974789 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f64e8066f50 0x7f64e8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:54.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.566+0000 7f64e3fff640 1 -- 172.21.15.96:0/1165974789 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f64ec085a60 con 0x7f64e4003fe0 2024-04-18T04:57:54.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.566+0000 7f64faffd640 1 --2- 172.21.15.96:0/1165974789 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f64e8066f50 0x7f64e8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:54.570 INFO:tasks.workunit.client.0.smithi096.stdout:8/72: dread - d0/d7/d10/f11 zero size 2024-04-18T04:57:54.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.566+0000 7f64faffd640 1 --2- 172.21.15.96:0/1165974789 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f64e8066f50 0x7f64e8069410 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f64f0001060 tx=0x7f64f0001bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:54.571 INFO:tasks.workunit.client.0.smithi096.stdout:6/165: mknod d0/d6/c2d 0 2024-04-18T04:57:54.571 INFO:tasks.workunit.client.0.smithi096.stdout:0/102: unlink c14 0 2024-04-18T04:57:54.571 INFO:tasks.workunit.client.0.smithi096.stdout:6/166: rename d0/d6/d10 to d0/d6/d2e 0 2024-04-18T04:57:54.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.570+0000 7f64e3fff640 1 -- 172.21.15.96:0/1165974789 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f64ec052db0 con 0x7f64e4003fe0 2024-04-18T04:57:54.572 INFO:tasks.workunit.client.0.smithi096.stdout:8/73: creat d0/d15/f17 x:0 0 0 2024-04-18T04:57:54.574 INFO:tasks.workunit.client.0.smithi096.stdout:7/56: sync 2024-04-18T04:57:54.575 INFO:tasks.workunit.client.0.smithi096.stdout:5/50: sync 2024-04-18T04:57:54.577 INFO:tasks.workunit.client.0.smithi096.stdout:7/57: creat db/f12 x:0 0 0 2024-04-18T04:57:54.577 INFO:tasks.workunit.client.0.smithi096.stdout:5/51: write d7/fb [2275321,60220] 0 2024-04-18T04:57:54.579 INFO:tasks.workunit.client.0.smithi096.stdout:7/58: write db/ff [131682,10778] 0 2024-04-18T04:57:54.580 INFO:tasks.workunit.client.0.smithi096.stdout:7/59: chown db/fe 9 1 2024-04-18T04:57:54.582 INFO:tasks.workunit.client.0.smithi096.stdout:6/167: dwrite d0/d6/f1d [0,4194304] 0 2024-04-18T04:57:54.582 INFO:tasks.workunit.client.0.smithi096.stdout:5/52: mkdir d7/d12/d16 0 2024-04-18T04:57:54.582 INFO:tasks.workunit.client.0.smithi096.stdout:5/53: fsync d7/ff 0 2024-04-18T04:57:54.582 INFO:tasks.workunit.client.0.smithi096.stdout:7/60: mknod db/c13 0 2024-04-18T04:57:54.583 INFO:tasks.workunit.client.0.smithi096.stdout:7/61: chown db/f12 362928359 1 2024-04-18T04:57:54.585 INFO:tasks.workunit.client.0.smithi096.stdout:6/168: mkdir d0/d2f 0 2024-04-18T04:57:54.586 INFO:tasks.workunit.client.0.smithi096.stdout:5/54: creat d7/f17 x:0 0 0 2024-04-18T04:57:54.586 INFO:tasks.workunit.client.0.smithi096.stdout:7/62: mknod db/c14 0 2024-04-18T04:57:54.589 INFO:tasks.workunit.client.0.smithi096.stdout:6/169: unlink d0/d6/d2e/d1a/c25 0 2024-04-18T04:57:54.589 INFO:tasks.workunit.client.0.smithi096.stdout:7/63: chown db/c13 1209427 1 2024-04-18T04:57:54.591 INFO:tasks.workunit.client.0.smithi096.stdout:8/74: dread d0/d7/fd [0,4194304] 0 2024-04-18T04:57:54.591 INFO:tasks.workunit.client.0.smithi096.stdout:0/103: dwrite d16/f19 [0,4194304] 0 2024-04-18T04:57:54.592 INFO:tasks.workunit.client.0.smithi096.stdout:8/75: dread - d0/d15/f17 zero size 2024-04-18T04:57:54.593 INFO:tasks.workunit.client.0.smithi096.stdout:7/64: creat db/f15 x:0 0 0 2024-04-18T04:57:54.594 INFO:tasks.workunit.client.0.smithi096.stdout:5/55: link d7/dd/f11 d7/f18 0 2024-04-18T04:57:54.594 INFO:tasks.workunit.client.0.smithi096.stdout:5/56: stat d7/dd/f11 0 2024-04-18T04:57:54.598 INFO:tasks.workunit.client.0.smithi096.stdout:6/170: creat d0/d6/d29/f30 x:0 0 0 2024-04-18T04:57:54.600 INFO:tasks.workunit.client.0.smithi096.stdout:8/76: rename d0/d7/d10 to d0/d3/dc/d18 0 2024-04-18T04:57:54.603 INFO:tasks.workunit.client.0.smithi096.stdout:8/77: stat d0/d3/dc 0 2024-04-18T04:57:54.603 INFO:tasks.workunit.client.0.smithi096.stdout:5/57: rename d7/dd/f11 to d7/dd/f19 0 2024-04-18T04:57:54.605 INFO:tasks.workunit.client.0.smithi096.stdout:5/58: fsync d7/fe 0 2024-04-18T04:57:54.609 INFO:tasks.workunit.client.0.smithi096.stdout:8/78: creat d0/d3/dc/d18/f19 x:0 0 0 2024-04-18T04:57:54.609 INFO:tasks.workunit.client.0.smithi096.stdout:0/104: dwrite d16/f19 [4194304,4194304] 0 2024-04-18T04:57:54.609 INFO:tasks.workunit.client.0.smithi096.stdout:5/59: creat d7/f1a x:0 0 0 2024-04-18T04:57:54.609 INFO:tasks.workunit.client.0.smithi096.stdout:7/65: dwrite db/f11 [0,4194304] 0 2024-04-18T04:57:54.611 INFO:tasks.workunit.client.0.smithi096.stdout:7/66: chown l4 118723833 1 2024-04-18T04:57:54.612 INFO:tasks.workunit.client.0.smithi096.stdout:7/67: write f5 [16995,1240] 0 2024-04-18T04:57:54.615 INFO:tasks.workunit.client.0.smithi096.stdout:6/171: dread d0/d6/f7 [0,4194304] 0 2024-04-18T04:57:54.617 INFO:tasks.workunit.client.0.smithi096.stdout:8/79: read d0/d3/fb [2143860,85888] 0 2024-04-18T04:57:54.622 INFO:tasks.workunit.client.0.smithi096.stdout:5/60: symlink d7/d12/d16/l1b 0 2024-04-18T04:57:54.622 INFO:tasks.workunit.client.0.smithi096.stdout:0/105: creat d16/f21 x:0 0 0 2024-04-18T04:57:54.623 INFO:tasks.workunit.client.0.smithi096.stdout:8/80: rename d0/d7/fd to d0/d3/dc/d18/f1a 0 2024-04-18T04:57:54.626 INFO:tasks.workunit.client.0.smithi096.stdout:7/68: dwrite f5 [0,4194304] 0 2024-04-18T04:57:54.630 INFO:tasks.workunit.client.0.smithi096.stdout:5/61: symlink d7/dd/l1c 0 2024-04-18T04:57:54.630 INFO:tasks.workunit.client.0.smithi096.stdout:8/81: mknod d0/d15/c1b 0 2024-04-18T04:57:54.631 INFO:tasks.workunit.client.0.smithi096.stdout:3/43: sync 2024-04-18T04:57:54.631 INFO:tasks.workunit.client.0.smithi096.stdout:4/103: sync 2024-04-18T04:57:54.631 INFO:tasks.workunit.client.0.smithi096.stdout:7/69: mknod db/c16 0 2024-04-18T04:57:54.632 INFO:tasks.workunit.client.0.smithi096.stdout:9/57: sync 2024-04-18T04:57:54.633 INFO:tasks.workunit.client.0.smithi096.stdout:5/62: mknod d7/c1d 0 2024-04-18T04:57:54.635 INFO:tasks.workunit.client.0.smithi096.stdout:3/44: unlink l9 0 2024-04-18T04:57:54.637 INFO:tasks.workunit.client.0.smithi096.stdout:7/70: rename db/c16 to db/c17 0 2024-04-18T04:57:54.641 INFO:tasks.workunit.client.0.smithi096.stdout:5/63: write f6 [7256778,94397] 0 2024-04-18T04:57:54.643 INFO:tasks.workunit.client.0.smithi096.stdout:6/172: dwrite d0/d6/f20 [0,4194304] 0 2024-04-18T04:57:54.646 INFO:tasks.workunit.client.0.smithi096.stdout:7/71: write db/fe [556734,99960] 0 2024-04-18T04:57:54.647 INFO:tasks.workunit.client.0.smithi096.stdout:8/82: link d0/c12 d0/d3/dc/d18/c1c 0 2024-04-18T04:57:54.647 INFO:tasks.workunit.client.0.smithi096.stdout:0/106: dwrite d16/f1a [0,4194304] 0 2024-04-18T04:57:54.650 INFO:tasks.workunit.client.0.smithi096.stdout:5/64: mknod d7/c1e 0 2024-04-18T04:57:54.651 INFO:tasks.workunit.client.0.smithi096.stdout:6/173: rmdir d0/d6/d2e/d1a 39 2024-04-18T04:57:54.654 INFO:tasks.workunit.client.0.smithi096.stdout:7/72: creat db/f18 x:0 0 0 2024-04-18T04:57:54.654 INFO:tasks.workunit.client.0.smithi096.stdout:5/65: fsync d7/f17 0 2024-04-18T04:57:54.659 INFO:tasks.workunit.client.0.smithi096.stdout:7/73: write f1 [1219081,35209] 0 2024-04-18T04:57:54.659 INFO:tasks.workunit.client.0.smithi096.stdout:4/104: dwrite f1 [0,4194304] 0 2024-04-18T04:57:54.661 INFO:tasks.workunit.client.0.smithi096.stdout:9/58: dwrite d0/f6 [0,4194304] 0 2024-04-18T04:57:54.661 INFO:tasks.workunit.client.0.smithi096.stdout:0/107: mkdir d16/d1c/d22 0 2024-04-18T04:57:54.661 INFO:tasks.workunit.client.0.smithi096.stdout:5/66: write d7/f1a [1035070,93611] 0 2024-04-18T04:57:54.663 INFO:tasks.workunit.client.0.smithi096.stdout:7/74: chown c0 129 1 2024-04-18T04:57:54.665 INFO:tasks.workunit.client.0.smithi096.stdout:3/45: dwrite f2 [4194304,4194304] 0 2024-04-18T04:57:54.665 INFO:tasks.workunit.client.0.smithi096.stdout:9/59: truncate d0/f11 480957 0 2024-04-18T04:57:54.666 INFO:tasks.workunit.client.0.smithi096.stdout:4/105: mknod d4/d14/d1d/c22 0 2024-04-18T04:57:54.667 INFO:tasks.workunit.client.0.smithi096.stdout:7/75: write f5 [5210460,126333] 0 2024-04-18T04:57:54.668 INFO:tasks.workunit.client.0.smithi096.stdout:0/108: mknod d16/d1d/c23 0 2024-04-18T04:57:54.670 INFO:tasks.workunit.client.0.smithi096.stdout:6/174: creat d0/d6/d2e/f31 x:0 0 0 2024-04-18T04:57:54.670 INFO:tasks.workunit.client.0.smithi096.stdout:7/76: mknod db/c19 0 2024-04-18T04:57:54.671 INFO:tasks.workunit.client.0.smithi096.stdout:8/83: getdents d0/d3/dc/d18 0 2024-04-18T04:57:54.671 INFO:tasks.workunit.client.0.smithi096.stdout:8/84: chown d0 359526 1 2024-04-18T04:57:54.674 INFO:tasks.workunit.client.0.smithi096.stdout:4/106: symlink d4/l23 0 2024-04-18T04:57:54.674 INFO:tasks.workunit.client.0.smithi096.stdout:5/67: creat d7/d12/f1f x:0 0 0 2024-04-18T04:57:54.675 INFO:tasks.workunit.client.0.smithi096.stdout:9/60: write d0/fc [925585,1020] 0 2024-04-18T04:57:54.679 INFO:tasks.workunit.client.0.smithi096.stdout:0/109: dwrite ff [0,4194304] 0 2024-04-18T04:57:54.680 INFO:tasks.workunit.client.0.smithi096.stdout:6/175: symlink d0/l32 0 2024-04-18T04:57:54.680 INFO:tasks.workunit.client.0.smithi096.stdout:9/61: dread d0/de/f10 [0,4194304] 0 2024-04-18T04:57:54.681 INFO:tasks.workunit.client.0.smithi096.stdout:8/85: symlink d0/d7/l1d 0 2024-04-18T04:57:54.682 INFO:tasks.workunit.client.0.smithi096.stdout:4/107: rename f1 to d4/f24 0 2024-04-18T04:57:54.682 INFO:tasks.workunit.client.0.smithi096.stdout:9/62: stat d0/de/f10 0 2024-04-18T04:57:54.684 INFO:tasks.workunit.client.0.smithi096.stdout:6/176: creat d0/f33 x:0 0 0 2024-04-18T04:57:54.687 INFO:tasks.workunit.client.0.smithi096.stdout:5/68: link d7/fa d7/d12/d16/f20 0 2024-04-18T04:57:54.687 INFO:tasks.workunit.client.0.smithi096.stdout:6/177: dread - d0/d6/d29/f30 zero size 2024-04-18T04:57:54.688 INFO:tasks.workunit.client.0.smithi096.stdout:4/108: creat d4/d14/d1d/f25 x:0 0 0 2024-04-18T04:57:54.690 INFO:tasks.workunit.client.0.smithi096.stdout:9/63: dread d0/fc [0,4194304] 0 2024-04-18T04:57:54.690 INFO:tasks.workunit.client.0.smithi096.stdout:5/69: read d7/f18 [745657,72944] 0 2024-04-18T04:57:54.691 INFO:tasks.workunit.client.0.smithi096.stdout:4/109: mknod d4/c26 0 2024-04-18T04:57:54.693 INFO:tasks.workunit.client.0.smithi096.stdout:9/64: creat d0/de/f15 x:0 0 0 2024-04-18T04:57:54.695 INFO:tasks.workunit.client.0.smithi096.stdout:5/70: creat d7/dd/f21 x:0 0 0 2024-04-18T04:57:54.695 INFO:tasks.workunit.client.0.smithi096.stdout:9/65: dread d0/de/f10 [0,4194304] 0 2024-04-18T04:57:54.696 INFO:tasks.workunit.client.0.smithi096.stdout:6/178: dread d0/d6/f1d [0,4194304] 0 2024-04-18T04:57:54.696 INFO:tasks.workunit.client.0.smithi096.stdout:4/110: write d4/f24 [3726355,20904] 0 2024-04-18T04:57:54.696 INFO:tasks.workunit.client.0.smithi096.stdout:6/179: stat d0/ca 0 2024-04-18T04:57:54.697 INFO:tasks.workunit.client.0.smithi096.stdout:8/86: rename d0/d15/f17 to d0/f1e 0 2024-04-18T04:57:54.699 INFO:tasks.workunit.client.0.smithi096.stdout:6/180: creat d0/d6/f34 x:0 0 0 2024-04-18T04:57:54.699 INFO:tasks.workunit.client.0.smithi096.stdout:8/87: creat d0/d3/dc/f1f x:0 0 0 2024-04-18T04:57:54.700 INFO:tasks.workunit.client.0.smithi096.stdout:6/181: read - d0/d6/d2e/f31 zero size 2024-04-18T04:57:54.700 INFO:tasks.workunit.client.0.smithi096.stdout:8/88: chown d0/d7/fa 34149479 1 2024-04-18T04:57:54.701 INFO:tasks.workunit.client.0.smithi096.stdout:6/182: read - d0/f33 zero size 2024-04-18T04:57:54.702 INFO:tasks.workunit.client.0.smithi096.stdout:8/89: dread - d0/d3/dc/d18/f11 zero size 2024-04-18T04:57:54.702 INFO:tasks.workunit.client.0.smithi096.stdout:6/183: read - d0/d6/f2c zero size 2024-04-18T04:57:54.702 INFO:tasks.workunit.client.0.smithi096.stdout:2/129: sync 2024-04-18T04:57:54.702 INFO:tasks.workunit.client.0.smithi096.stdout:1/184: sync 2024-04-18T04:57:54.702 INFO:tasks.workunit.client.0.smithi096.stdout:4/111: dread d4/f5 [0,4194304] 0 2024-04-18T04:57:54.703 INFO:tasks.workunit.client.0.smithi096.stdout:5/71: write d7/dd/f19 [1803101,10692] 0 2024-04-18T04:57:54.704 INFO:tasks.workunit.client.0.smithi096.stdout:2/130: rmdir df/d18 39 2024-04-18T04:57:54.705 INFO:tasks.workunit.client.0.smithi096.stdout:6/184: dread - d0/d6/f2c zero size 2024-04-18T04:57:54.705 INFO:tasks.workunit.client.0.smithi096.stdout:8/90: unlink d0/d3/dc/d18/f19 0 2024-04-18T04:57:54.709 INFO:tasks.workunit.client.0.smithi096.stdout:4/112: creat d4/d14/d1d/f27 x:0 0 0 2024-04-18T04:57:54.710 INFO:tasks.workunit.client.0.smithi096.stdout:1/185: rename fb to de/f35 0 2024-04-18T04:57:54.711 INFO:tasks.workunit.client.0.smithi096.stdout:8/91: mknod d0/c20 0 2024-04-18T04:57:54.715 INFO:tasks.workunit.client.0.smithi096.stdout:6/185: creat d0/d6/d2e/f35 x:0 0 0 2024-04-18T04:57:54.715 INFO:tasks.workunit.client.0.smithi096.stdout:5/72: dwrite d7/f17 [0,4194304] 0 2024-04-18T04:57:54.716 INFO:tasks.workunit.client.0.smithi096.stdout:8/92: write d0/f1e [67189,115159] 0 2024-04-18T04:57:54.716 INFO:tasks.workunit.client.0.smithi096.stdout:2/131: dwrite f2 [4194304,4194304] 0 2024-04-18T04:57:54.717 INFO:tasks.workunit.client.0.smithi096.stdout:8/93: chown d0/d7 19 1 2024-04-18T04:57:54.717 INFO:tasks.workunit.client.0.smithi096.stdout:1/186: link de/l15 de/l36 0 2024-04-18T04:57:54.718 INFO:tasks.workunit.client.0.smithi096.stdout:6/186: creat d0/d6/d29/f36 x:0 0 0 2024-04-18T04:57:54.719 INFO:tasks.workunit.client.0.smithi096.stdout:6/187: chown d0/d6/d2e 149409 1 2024-04-18T04:57:54.720 INFO:tasks.workunit.client.0.smithi096.stdout:6/188: fsync d0/d6/d2e/f31 0 2024-04-18T04:57:54.721 INFO:tasks.workunit.client.0.smithi096.stdout:2/132: unlink f0 0 2024-04-18T04:57:54.722 INFO:tasks.workunit.client.0.smithi096.stdout:5/73: link d7/f18 d7/f22 0 2024-04-18T04:57:54.723 INFO:tasks.workunit.client.0.smithi096.stdout:1/187: mknod de/d1d/c37 0 2024-04-18T04:57:54.725 INFO:tasks.workunit.client.0.smithi096.stdout:1/188: read de/d1d/f25 [1437954,41540] 0 2024-04-18T04:57:54.726 INFO:tasks.workunit.client.0.smithi096.stdout:6/189: readlink d0/d6/d2e/d1a/l23 0 2024-04-18T04:57:54.729 INFO:tasks.workunit.client.0.smithi096.stdout:1/189: unlink de/d1d/f30 0 2024-04-18T04:57:54.730 INFO:tasks.workunit.client.0.smithi096.stdout:2/133: dread f4 [4194304,4194304] 0 2024-04-18T04:57:54.730 INFO:tasks.workunit.client.0.smithi096.stdout:8/94: dwrite d0/d3/dc/f1f [0,4194304] 0 2024-04-18T04:57:54.730 INFO:tasks.workunit.client.0.smithi096.stdout:6/190: write d0/d6/f15 [8731784,57170] 0 2024-04-18T04:57:54.732 INFO:tasks.workunit.client.0.smithi096.stdout:6/191: fdatasync d0/d6/f20 0 2024-04-18T04:57:54.732 INFO:tasks.workunit.client.0.smithi096.stdout:2/134: write f9 [4582598,37501] 0 2024-04-18T04:57:54.734 INFO:tasks.workunit.client.0.smithi096.stdout:6/192: read - d0/d6/d2e/f31 zero size 2024-04-18T04:57:54.735 INFO:tasks.workunit.client.0.smithi096.stdout:8/95: mkdir d0/d3/dc/d18/d21 0 2024-04-18T04:57:54.735 INFO:tasks.workunit.client.0.smithi096.stdout:5/74: fdatasync d7/f17 0 2024-04-18T04:57:54.736 INFO:tasks.workunit.client.0.smithi096.stdout:8/96: fdatasync d0/f1e 0 2024-04-18T04:57:54.737 INFO:tasks.workunit.client.0.smithi096.stdout:6/193: truncate d0/d6/d29/f30 938943 0 2024-04-18T04:57:54.737 INFO:tasks.workunit.client.0.smithi096.stdout:1/190: symlink de/l38 0 2024-04-18T04:57:54.738 INFO:tasks.workunit.client.0.smithi096.stdout:2/135: truncate df/d18/f23 882003 0 2024-04-18T04:57:54.738 INFO:tasks.workunit.client.0.smithi096.stdout:1/191: read - de/f2f zero size 2024-04-18T04:57:54.742 INFO:tasks.workunit.client.0.smithi096.stdout:5/75: rmdir d7 39 2024-04-18T04:57:54.743 INFO:tasks.workunit.client.0.smithi096.stdout:2/136: mkdir df/d18/d26 0 2024-04-18T04:57:54.745 INFO:tasks.workunit.client.0.smithi096.stdout:1/192: symlink de/d1d/d32/l39 0 2024-04-18T04:57:54.746 INFO:tasks.workunit.client.0.smithi096.stdout:5/76: symlink d7/dd/l23 0 2024-04-18T04:57:54.747 INFO:tasks.workunit.client.0.smithi096.stdout:5/77: chown d7/fc 331941 1 2024-04-18T04:57:54.748 INFO:tasks.workunit.client.0.smithi096.stdout:8/97: dwrite d0/d7/fa [0,4194304] 0 2024-04-18T04:57:54.748 INFO:tasks.workunit.client.0.smithi096.stdout:8/98: chown d0/d3/dc 32 1 2024-04-18T04:57:54.749 INFO:tasks.workunit.client.0.smithi096.stdout:1/193: mknod de/c3a 0 2024-04-18T04:57:54.750 INFO:tasks.workunit.client.0.smithi096.stdout:5/78: mknod d7/c24 0 2024-04-18T04:57:54.750 INFO:tasks.workunit.client.0.smithi096.stdout:6/194: getdents d0/d6/d29 0 2024-04-18T04:57:54.750 INFO:tasks.workunit.client.0.smithi096.stdout:8/99: creat d0/d3/dc/f22 x:0 0 0 2024-04-18T04:57:54.751 INFO:tasks.workunit.client.0.smithi096.stdout:6/195: dread - d0/d6/f24 zero size 2024-04-18T04:57:54.752 INFO:tasks.workunit.client.0.smithi096.stdout:8/100: write d0/d7/fa [2283079,64268] 0 2024-04-18T04:57:54.756 INFO:tasks.workunit.client.0.smithi096.stdout:1/194: creat de/f3b x:0 0 0 2024-04-18T04:57:54.756 INFO:tasks.workunit.client.0.smithi096.stdout:8/101: rmdir d0/d3 39 2024-04-18T04:57:54.757 INFO:tasks.workunit.client.0.smithi096.stdout:1/195: chown de/c13 37452 1 2024-04-18T04:57:54.761 INFO:tasks.workunit.client.0.smithi096.stdout:1/196: fsync fa 0 2024-04-18T04:57:54.763 INFO:tasks.workunit.client.0.smithi096.stdout:2/137: dread f2 [0,4194304] 0 2024-04-18T04:57:54.763 INFO:tasks.workunit.client.0.smithi096.stdout:6/196: dwrite d0/d6/d2e/f22 [0,4194304] 0 2024-04-18T04:57:54.766 INFO:tasks.workunit.client.0.smithi096.stdout:6/197: read - d0/d6/d2e/f31 zero size 2024-04-18T04:57:54.767 INFO:tasks.workunit.client.0.smithi096.stdout:8/102: dwrite d0/f2 [0,4194304] 0 2024-04-18T04:57:54.769 INFO:tasks.workunit.client.0.smithi096.stdout:6/198: creat d0/d6/f37 x:0 0 0 2024-04-18T04:57:54.769 INFO:tasks.workunit.client.0.smithi096.stdout:2/138: creat df/d18/d26/f27 x:0 0 0 2024-04-18T04:57:54.772 INFO:tasks.workunit.client.0.smithi096.stdout:1/197: dwrite de/d1d/f25 [0,4194304] 0 2024-04-18T04:57:54.774 INFO:tasks.workunit.client.0.smithi096.stdout:1/198: write de/d1d/f25 [930345,61831] 0 2024-04-18T04:57:54.775 INFO:tasks.workunit.client.0.smithi096.stdout:1/199: chown de/c13 5 1 2024-04-18T04:57:54.777 INFO:tasks.workunit.client.0.smithi096.stdout:2/139: dread df/f14 [0,4194304] 0 2024-04-18T04:57:54.783 INFO:tasks.workunit.client.0.smithi096.stdout:1/200: dwrite de/d1d/f25 [0,4194304] 0 2024-04-18T04:57:54.785 INFO:tasks.workunit.client.0.smithi096.stdout:2/140: write df/d18/f25 [4648926,10616] 0 2024-04-18T04:57:54.785 INFO:tasks.workunit.client.0.smithi096.stdout:1/201: read de/d1d/f25 [2770198,13170] 0 2024-04-18T04:57:54.785 INFO:tasks.workunit.client.0.smithi096.stdout:8/103: truncate d0/f2 1841967 0 2024-04-18T04:57:54.786 INFO:tasks.workunit.client.0.smithi096.stdout:8/104: chown d0/d15/c1b 31093164 1 2024-04-18T04:57:54.786 INFO:tasks.workunit.client.0.smithi096.stdout:6/199: truncate d0/d6/d2e/f22 1516698 0 2024-04-18T04:57:54.787 INFO:tasks.workunit.client.0.smithi096.stdout:8/105: read - d0/f13 zero size 2024-04-18T04:57:54.789 INFO:tasks.workunit.client.0.smithi096.stdout:1/202: creat de/d1d/d32/f3c x:0 0 0 2024-04-18T04:57:54.790 INFO:tasks.workunit.client.0.smithi096.stdout:1/203: symlink de/d1d/d32/l3d 0 2024-04-18T04:57:54.791 INFO:tasks.workunit.client.0.smithi096.stdout:2/141: link df/f10 df/d18/d26/f28 0 2024-04-18T04:57:54.792 INFO:tasks.workunit.client.0.smithi096.stdout:1/204: dread - de/f20 zero size 2024-04-18T04:57:54.793 INFO:tasks.workunit.client.0.smithi096.stdout:2/142: creat df/d18/d26/f29 x:0 0 0 2024-04-18T04:57:54.793 INFO:tasks.workunit.client.0.smithi096.stdout:1/205: truncate fa 998523 0 2024-04-18T04:57:54.794 INFO:tasks.workunit.client.0.smithi096.stdout:1/206: write de/f12 [1672366,39762] 0 2024-04-18T04:57:54.795 INFO:tasks.workunit.client.0.smithi096.stdout:2/143: mknod df/d18/d26/c2a 0 2024-04-18T04:57:54.796 INFO:tasks.workunit.client.0.smithi096.stdout:2/144: write df/d18/f22 [159203,29557] 0 2024-04-18T04:57:54.796 INFO:tasks.workunit.client.0.smithi096.stdout:1/207: fdatasync f6 0 2024-04-18T04:57:54.797 INFO:tasks.workunit.client.0.smithi096.stdout:1/208: write de/d1d/f25 [1779284,89632] 0 2024-04-18T04:57:54.798 INFO:tasks.workunit.client.0.smithi096.stdout:2/145: rename df/f12 to df/d18/f2b 0 2024-04-18T04:57:54.799 INFO:tasks.workunit.client.0.smithi096.stdout:2/146: read df/f14 [3987171,16000] 0 2024-04-18T04:57:54.800 INFO:tasks.workunit.client.0.smithi096.stdout:1/209: creat de/d1d/f3e x:0 0 0 2024-04-18T04:57:54.802 INFO:tasks.workunit.client.0.smithi096.stdout:1/210: mkdir de/d1d/d3f 0 2024-04-18T04:57:54.803 INFO:tasks.workunit.client.0.smithi096.stdout:1/211: mknod de/d1d/c40 0 2024-04-18T04:57:54.804 INFO:tasks.workunit.client.0.smithi096.stdout:1/212: dread - de/f2e zero size 2024-04-18T04:57:54.806 INFO:tasks.workunit.client.0.smithi096.stdout:1/213: readlink de/d1d/l2d 0 2024-04-18T04:57:54.807 INFO:tasks.workunit.client.0.smithi096.stdout:1/214: symlink de/d1d/d32/l41 0 2024-04-18T04:57:54.809 INFO:tasks.workunit.client.0.smithi096.stdout:2/147: fsync df/d18/f2b 0 2024-04-18T04:57:54.812 INFO:tasks.workunit.client.0.smithi096.stdout:2/148: creat df/d1c/f2c x:0 0 0 2024-04-18T04:57:54.813 INFO:tasks.workunit.client.0.smithi096.stdout:1/215: rmdir de/d1d 39 2024-04-18T04:57:54.814 INFO:tasks.workunit.client.0.smithi096.stdout:2/149: fdatasync df/f17 0 2024-04-18T04:57:54.815 INFO:tasks.workunit.client.0.smithi096.stdout:2/150: mkdir df/d18/d2d 0 2024-04-18T04:57:54.817 INFO:tasks.workunit.client.0.smithi096.stdout:2/151: truncate fe 977977 0 2024-04-18T04:57:54.818 INFO:tasks.workunit.client.0.smithi096.stdout:2/152: stat df/d18/f23 0 2024-04-18T04:57:54.819 INFO:tasks.workunit.client.0.smithi096.stdout:1/216: dread de/d1d/f25 [0,4194304] 0 2024-04-18T04:57:54.819 INFO:tasks.workunit.client.0.smithi096.stdout:1/217: read - de/f2f zero size 2024-04-18T04:57:54.820 INFO:tasks.workunit.client.0.smithi096.stdout:2/153: creat df/d18/d24/f2e x:0 0 0 2024-04-18T04:57:54.820 INFO:tasks.workunit.client.0.smithi096.stdout:2/154: chown fc 374 1 2024-04-18T04:57:54.822 INFO:tasks.workunit.client.0.smithi096.stdout:2/155: mknod df/d18/d2d/c2f 0 2024-04-18T04:57:54.824 INFO:tasks.workunit.client.0.smithi096.stdout:2/156: creat df/d18/d24/f30 x:0 0 0 2024-04-18T04:57:54.825 INFO:tasks.workunit.client.0.smithi096.stdout:1/218: dread de/ff [0,4194304] 0 2024-04-18T04:57:54.831 INFO:tasks.workunit.client.0.smithi096.stdout:2/157: dwrite df/f1b [0,4194304] 0 2024-04-18T04:57:54.833 INFO:tasks.workunit.client.0.smithi096.stdout:2/158: read df/d1c/f21 [2352017,122264] 0 2024-04-18T04:57:54.833 INFO:tasks.workunit.client.0.smithi096.stdout:1/219: dwrite de/f20 [0,4194304] 0 2024-04-18T04:57:54.836 INFO:tasks.workunit.client.0.smithi096.stdout:1/220: chown de/f17 175333 1 2024-04-18T04:57:54.838 INFO:tasks.workunit.client.0.smithi096.stdout:2/159: symlink df/d18/d24/l31 0 2024-04-18T04:57:54.841 INFO:tasks.workunit.client.0.smithi096.stdout:1/221: creat de/d1d/f42 x:0 0 0 2024-04-18T04:57:54.842 INFO:tasks.workunit.client.0.smithi096.stdout:2/160: write df/d1c/f2c [489609,16758] 0 2024-04-18T04:57:54.843 INFO:tasks.workunit.client.0.smithi096.stdout:1/222: mknod de/d1d/d32/c43 0 2024-04-18T04:57:54.844 INFO:tasks.workunit.client.0.smithi096.stdout:2/161: creat df/d1c/f32 x:0 0 0 2024-04-18T04:57:54.846 INFO:tasks.workunit.client.0.smithi096.stdout:1/223: truncate de/f17 3594989 0 2024-04-18T04:57:54.846 INFO:tasks.workunit.client.0.smithi096.stdout:1/224: stat de/d1d/l1f 0 2024-04-18T04:57:54.847 INFO:tasks.workunit.client.0.smithi096.stdout:2/162: creat df/f33 x:0 0 0 2024-04-18T04:57:54.848 INFO:tasks.workunit.client.0.smithi096.stdout:1/225: creat de/d1d/d32/f44 x:0 0 0 2024-04-18T04:57:54.849 INFO:tasks.workunit.client.0.smithi096.stdout:2/163: dread df/d18/f22 [0,4194304] 0 2024-04-18T04:57:54.849 INFO:tasks.workunit.client.0.smithi096.stdout:1/226: creat de/d1d/d3f/f45 x:0 0 0 2024-04-18T04:57:54.850 INFO:tasks.workunit.client.0.smithi096.stdout:2/164: mknod df/d18/d24/c34 0 2024-04-18T04:57:54.850 INFO:tasks.workunit.client.0.smithi096.stdout:2/165: fsync f4 0 2024-04-18T04:57:54.851 INFO:tasks.workunit.client.0.smithi096.stdout:1/227: creat de/d1d/d32/f46 x:0 0 0 2024-04-18T04:57:54.851 INFO:tasks.workunit.client.0.smithi096.stdout:1/228: dread - de/d1d/f42 zero size 2024-04-18T04:57:54.856 INFO:tasks.workunit.client.0.smithi096.stdout:2/166: rmdir df/d1c 39 2024-04-18T04:57:54.857 INFO:tasks.workunit.client.0.smithi096.stdout:2/167: chown df/d18/c1a 16216 1 2024-04-18T04:57:54.857 INFO:tasks.workunit.client.0.smithi096.stdout:2/168: fsync df/d18/d26/f27 0 2024-04-18T04:57:54.858 INFO:tasks.workunit.client.0.smithi096.stdout:1/229: truncate de/f17 2405730 0 2024-04-18T04:57:54.858 INFO:tasks.workunit.client.0.smithi096.stdout:1/230: rename de to de/d1d/d47 22 2024-04-18T04:57:54.860 INFO:tasks.workunit.client.0.smithi096.stdout:2/169: write f2 [2455095,77313] 0 2024-04-18T04:57:54.861 INFO:tasks.workunit.client.0.smithi096.stdout:1/231: mknod de/d1d/d3f/c48 0 2024-04-18T04:57:54.863 INFO:tasks.workunit.client.0.smithi096.stdout:1/232: dread de/ff [0,4194304] 0 2024-04-18T04:57:54.866 INFO:tasks.workunit.client.0.smithi096.stdout:2/170: dwrite fc [0,4194304] 0 2024-04-18T04:57:54.867 INFO:tasks.workunit.client.0.smithi096.stdout:2/171: write df/d18/f2b [864761,54079] 0 2024-04-18T04:57:54.870 INFO:tasks.workunit.client.0.smithi096.stdout:2/172: symlink df/d18/d26/l35 0 2024-04-18T04:57:54.871 INFO:tasks.workunit.client.0.smithi096.stdout:2/173: chown df/d1c 124559 1 2024-04-18T04:57:54.873 INFO:tasks.workunit.client.0.smithi096.stdout:2/174: rename fb to df/d18/d26/f36 0 2024-04-18T04:57:54.874 INFO:tasks.workunit.client.0.smithi096.stdout:2/175: fsync df/d18/f22 0 2024-04-18T04:57:54.877 INFO:tasks.workunit.client.0.smithi096.stdout:2/176: truncate f4 7585866 0 2024-04-18T04:57:54.881 INFO:tasks.workunit.client.0.smithi096.stdout:2/177: dread df/f16 [0,4194304] 0 2024-04-18T04:57:54.883 INFO:tasks.workunit.client.0.smithi096.stdout:2/178: creat df/d18/d2d/f37 x:0 0 0 2024-04-18T04:57:54.885 INFO:tasks.workunit.client.0.smithi096.stdout:2/179: creat df/d18/f38 x:0 0 0 2024-04-18T04:57:54.888 INFO:tasks.workunit.client.0.smithi096.stdout:2/180: rename df/d18/d2d/f37 to df/d18/f39 0 2024-04-18T04:57:54.889 INFO:tasks.workunit.client.0.smithi096.stdout:2/181: mknod df/d18/d26/c3a 0 2024-04-18T04:57:54.890 INFO:tasks.workunit.client.0.smithi096.stdout:2/182: dread - df/d18/d24/f2e zero size 2024-04-18T04:57:54.892 INFO:tasks.workunit.client.0.smithi096.stdout:2/183: truncate fd 123852 0 2024-04-18T04:57:54.892 INFO:tasks.workunit.client.0.smithi096.stdout:2/184: chown df/d18/f39 252459279 1 2024-04-18T04:57:54.898 INFO:tasks.workunit.client.0.smithi096.stdout:2/185: dwrite df/d18/d26/f29 [0,4194304] 0 2024-04-18T04:57:54.899 INFO:tasks.workunit.client.0.smithi096.stdout:2/186: write df/d18/f1d [697670,39586] 0 2024-04-18T04:57:54.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.902+0000 7f6501c04640 1 -- 172.21.15.96:0/1165974789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f64fc0c96d0 con 0x7f64e4003fe0 2024-04-18T04:57:54.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.902+0000 7f64e3fff640 1 -- 172.21.15.96:0/1165974789 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f64ec0563d0 con 0x7f64e4003fe0 2024-04-18T04:57:54.903 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":34,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:57:54.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.906+0000 7f6501c04640 1 -- 172.21.15.96:0/1165974789 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f64e8066f50 msgr2=0x7f64e8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:54.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.906+0000 7f6501c04640 1 --2- 172.21.15.96:0/1165974789 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f64e8066f50 0x7f64e8069410 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f64f0001060 tx=0x7f64f0001bc0 comp rx=0 tx=0).stop 2024-04-18T04:57:54.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.906+0000 7f6501c04640 1 -- 172.21.15.96:0/1165974789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64e4003fe0 msgr2=0x7f64fc0cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:54.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.906+0000 7f6501c04640 1 --2- 172.21.15.96:0/1165974789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64e4003fe0 0x7f64fc0cd060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0169c0 tx=0x7f64ec016e80 comp rx=0 tx=0).stop 2024-04-18T04:57:54.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.906+0000 7f6501c04640 1 -- 172.21.15.96:0/1165974789 shutdown_connections 2024-04-18T04:57:54.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.906+0000 7f6501c04640 1 --2- 172.21.15.96:0/1165974789 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f64e8066f50 0x7f64e8069410 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:54.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.906+0000 7f6501c04640 1 --2- 172.21.15.96:0/1165974789 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc152fe0 0x7f64fc148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:54.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.906+0000 7f6501c04640 1 --2- 172.21.15.96:0/1165974789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64e4004d60 0x7f64fc0cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:54.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.906+0000 7f6501c04640 1 --2- 172.21.15.96:0/1165974789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64e4003fe0 0x7f64fc0cd060 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:54.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.906+0000 7f6501c04640 1 -- 172.21.15.96:0/1165974789 >> 172.21.15.96:0/1165974789 conn(0x7f64fc071760 msgr2=0x7f64fc1494e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:54.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.906+0000 7f6501c04640 1 -- 172.21.15.96:0/1165974789 shutdown_connections 2024-04-18T04:57:54.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:54.906+0000 7f6501c04640 1 -- 172.21.15.96:0/1165974789 wait complete. 2024-04-18T04:57:54.985 INFO:tasks.workunit.client.0.smithi096.stdout:3/46: sync 2024-04-18T04:57:54.992 INFO:tasks.workunit.client.0.smithi096.stdout:3/47: dread f6 [4194304,4194304] 0 2024-04-18T04:57:54.993 INFO:tasks.workunit.client.0.smithi096.stdout:3/48: read f3 [1797310,43290] 0 2024-04-18T04:57:54.996 INFO:tasks.workunit.client.0.smithi096.stdout:3/49: mkdir dc 0 2024-04-18T04:57:55.001 INFO:tasks.workunit.client.0.smithi096.stdout:3/50: dread fa [4194304,4194304] 0 2024-04-18T04:57:55.006 INFO:tasks.workunit.client.0.smithi096.stdout:3/51: link l4 dc/ld 0 2024-04-18T04:57:55.009 INFO:tasks.workunit.client.0.smithi096.stdout:3/52: write f3 [1370636,90778] 0 2024-04-18T04:57:55.010 INFO:tasks.workunit.client.0.smithi096.stdout:3/53: chown f3 934 1 2024-04-18T04:57:55.012 INFO:tasks.workunit.client.0.smithi096.stdout:3/54: fsync f6 0 2024-04-18T04:57:55.020 INFO:tasks.workunit.client.0.smithi096.stdout:3/55: dwrite f6 [4194304,4194304] 0 2024-04-18T04:57:55.039 INFO:tasks.workunit.client.0.smithi096.stdout:3/56: truncate f2 2894342 0 2024-04-18T04:57:55.039 INFO:tasks.workunit.client.0.smithi096.stdout:3/57: chown l5 119965971 1 2024-04-18T04:57:55.039 INFO:tasks.workunit.client.0.smithi096.stdout:3/58: chown l5 25 1 2024-04-18T04:57:55.050 INFO:tasks.workunit.client.0.smithi096.stdout:3/59: dwrite f6 [0,4194304] 0 2024-04-18T04:57:55.051 INFO:tasks.workunit.client.0.smithi096.stdout:3/60: stat cb 0 2024-04-18T04:57:55.056 INFO:tasks.workunit.client.0.smithi096.stdout:3/61: dread f6 [0,4194304] 0 2024-04-18T04:57:55.062 INFO:tasks.workunit.client.0.smithi096.stdout:3/62: truncate f2 335863 0 2024-04-18T04:57:55.066 INFO:tasks.workunit.client.0.smithi096.stdout:3/63: write f8 [874867,104505] 0 2024-04-18T04:57:55.071 INFO:tasks.workunit.client.0.smithi096.stdout:3/64: creat dc/fe x:0 0 0 2024-04-18T04:57:55.079 INFO:tasks.workunit.client.0.smithi096.stdout:3/65: truncate f2 29790 0 2024-04-18T04:57:55.085 INFO:tasks.workunit.client.0.smithi096.stdout:3/66: link dc/ld dc/lf 0 2024-04-18T04:57:55.087 INFO:tasks.workunit.client.0.smithi096.stdout:3/67: readlink dc/ld 0 2024-04-18T04:57:55.104 INFO:tasks.workunit.client.0.smithi096.stdout:3/68: dwrite f6 [0,4194304] 0 2024-04-18T04:57:55.107 INFO:tasks.workunit.client.0.smithi096.stdout:7/77: sync 2024-04-18T04:57:55.116 INFO:tasks.workunit.client.0.smithi096.stdout:3/69: dwrite f8 [4194304,4194304] 0 2024-04-18T04:57:55.116 INFO:tasks.workunit.client.0.smithi096.stdout:3/70: readlink l5 0 2024-04-18T04:57:55.117 INFO:tasks.workunit.client.0.smithi096.stdout:3/71: chown f8 4 1 2024-04-18T04:57:55.118 INFO:tasks.workunit.client.0.smithi096.stdout:7/78: truncate f9 3415332 0 2024-04-18T04:57:55.119 INFO:tasks.workunit.client.0.smithi096.stdout:7/79: dread - db/f15 zero size 2024-04-18T04:57:55.122 INFO:tasks.workunit.client.0.smithi096.stdout:3/72: creat dc/f10 x:0 0 0 2024-04-18T04:57:55.122 INFO:tasks.workunit.client.0.smithi096.stdout:7/80: dread db/ff [0,4194304] 0 2024-04-18T04:57:55.128 INFO:tasks.workunit.client.0.smithi096.stdout:3/73: mknod dc/c11 0 2024-04-18T04:57:55.131 INFO:tasks.workunit.client.0.smithi096.stdout:3/74: readlink l4 0 2024-04-18T04:57:55.131 INFO:tasks.workunit.client.0.smithi096.stdout:7/81: dread db/fe [0,4194304] 0 2024-04-18T04:57:55.133 INFO:tasks.workunit.client.0.smithi096.stdout:7/82: truncate db/f12 60134 0 2024-04-18T04:57:55.135 INFO:tasks.workunit.client.0.smithi096.stdout:3/75: creat dc/f12 x:0 0 0 2024-04-18T04:57:55.137 INFO:tasks.workunit.client.0.smithi096.stdout:3/76: mknod dc/c13 0 2024-04-18T04:57:55.147 INFO:tasks.workunit.client.0.smithi096.stdout:7/83: write f9 [893013,100322] 0 2024-04-18T04:57:55.148 INFO:tasks.workunit.client.0.smithi096.stdout:7/84: fsync f5 0 2024-04-18T04:57:55.152 INFO:tasks.workunit.client.0.smithi096.stdout:3/77: dwrite f3 [8388608,4194304] 0 2024-04-18T04:57:55.152 INFO:tasks.workunit.client.0.smithi096.stdout:7/85: unlink db/c19 0 2024-04-18T04:57:55.153 INFO:tasks.workunit.client.0.smithi096.stdout:3/78: dread - dc/f10 zero size 2024-04-18T04:57:55.154 INFO:tasks.workunit.client.0.smithi096.stdout:3/79: write dc/f12 [728089,47030] 0 2024-04-18T04:57:55.156 INFO:tasks.workunit.client.0.smithi096.stdout:7/86: symlink db/l1a 0 2024-04-18T04:57:55.159 INFO:tasks.workunit.client.0.smithi096.stdout:7/87: truncate db/ff 28564 0 2024-04-18T04:57:55.160 INFO:tasks.workunit.client.0.smithi096.stdout:7/88: chown db/c14 74584 1 2024-04-18T04:57:55.162 INFO:tasks.workunit.client.0.smithi096.stdout:7/89: write f9 [3851537,14983] 0 2024-04-18T04:57:55.165 INFO:tasks.workunit.client.0.smithi096.stdout:0/110: sync 2024-04-18T04:57:55.165 INFO:tasks.workunit.client.0.smithi096.stdout:5/79: sync 2024-04-18T04:57:55.165 INFO:tasks.workunit.client.0.smithi096.stdout:2/187: sync 2024-04-18T04:57:55.166 INFO:tasks.workunit.client.0.smithi096.stdout:9/66: sync 2024-04-18T04:57:55.166 INFO:tasks.workunit.client.0.smithi096.stdout:4/113: sync 2024-04-18T04:57:55.166 INFO:tasks.workunit.client.0.smithi096.stdout:8/106: sync 2024-04-18T04:57:55.166 INFO:tasks.workunit.client.0.smithi096.stdout:6/200: sync 2024-04-18T04:57:55.166 INFO:tasks.workunit.client.0.smithi096.stdout:7/90: creat db/f1b x:0 0 0 2024-04-18T04:57:55.167 INFO:tasks.workunit.client.0.smithi096.stdout:1/233: sync 2024-04-18T04:57:55.168 INFO:tasks.workunit.client.0.smithi096.stdout:6/201: chown d0/d6 2 1 2024-04-18T04:57:55.168 INFO:tasks.workunit.client.0.smithi096.stdout:2/188: dread - df/f33 zero size 2024-04-18T04:57:55.169 INFO:tasks.workunit.client.0.smithi096.stdout:0/111: write d16/f21 [539458,102666] 0 2024-04-18T04:57:55.169 INFO:tasks.workunit.client.0.smithi096.stdout:3/80: dwrite f2 [4194304,4194304] 0 2024-04-18T04:57:55.170 INFO:tasks.workunit.client.0.smithi096.stdout:1/234: dread - de/f2f zero size 2024-04-18T04:57:55.170 INFO:tasks.workunit.client.0.smithi096.stdout:5/80: unlink d7/fb 0 2024-04-18T04:57:55.171 INFO:tasks.workunit.client.0.smithi096.stdout:6/202: fsync d0/d6/f37 0 2024-04-18T04:57:55.171 INFO:tasks.workunit.client.0.smithi096.stdout:2/189: read - df/f33 zero size 2024-04-18T04:57:55.171 INFO:tasks.workunit.client.0.smithi096.stdout:9/67: unlink d0/f6 0 2024-04-18T04:57:55.172 INFO:tasks.workunit.client.0.smithi096.stdout:4/114: mkdir d4/d14/d28 0 2024-04-18T04:57:55.174 INFO:tasks.workunit.client.0.smithi096.stdout:9/68: readlink d0/de/l12 0 2024-04-18T04:57:55.174 INFO:tasks.workunit.client.0.smithi096.stdout:6/203: dread - d0/d6/d29/f36 zero size 2024-04-18T04:57:55.175 INFO:tasks.workunit.client.0.smithi096.stdout:0/112: unlink l10 0 2024-04-18T04:57:55.178 INFO:tasks.workunit.client.0.smithi096.stdout:0/113: write d16/f1b [648348,16027] 0 2024-04-18T04:57:55.179 INFO:tasks.workunit.client.0.smithi096.stdout:8/107: dread d0/d3/dc/f1f [0,4194304] 0 2024-04-18T04:57:55.179 INFO:tasks.workunit.client.0.smithi096.stdout:0/114: write fd [3613801,19997] 0 2024-04-18T04:57:55.182 INFO:tasks.workunit.client.0.smithi096.stdout:2/190: dwrite fc [4194304,4194304] 0 2024-04-18T04:57:55.185 INFO:tasks.workunit.client.0.smithi096.stdout:1/235: mknod de/d1d/d32/c49 0 2024-04-18T04:57:55.186 INFO:tasks.workunit.client.0.smithi096.stdout:1/236: dread - de/d1d/f3e zero size 2024-04-18T04:57:55.187 INFO:tasks.workunit.client.0.smithi096.stdout:9/69: creat d0/de/f16 x:0 0 0 2024-04-18T04:57:55.189 INFO:tasks.workunit.client.0.smithi096.stdout:4/115: rename d4/d14/d28 to d4/d14/d1d/d29 0 2024-04-18T04:57:55.192 INFO:tasks.workunit.client.0.smithi096.stdout:0/115: symlink d16/d1c/l24 0 2024-04-18T04:57:55.194 INFO:tasks.workunit.client.0.smithi096.stdout:2/191: rmdir df/d18/d2d 39 2024-04-18T04:57:55.194 INFO:tasks.workunit.client.0.smithi096.stdout:8/108: creat d0/d3/dc/d18/f23 x:0 0 0 2024-04-18T04:57:55.196 INFO:tasks.workunit.client.0.smithi096.stdout:8/109: chown d0 6293614 1 2024-04-18T04:57:55.196 INFO:tasks.workunit.client.0.smithi096.stdout:0/116: write fe [2000667,65539] 0 2024-04-18T04:57:55.198 INFO:tasks.workunit.client.0.smithi096.stdout:1/237: creat de/d1d/f4a x:0 0 0 2024-04-18T04:57:55.202 INFO:tasks.workunit.client.0.smithi096.stdout:9/70: dwrite d0/de/f15 [0,4194304] 0 2024-04-18T04:57:55.202 INFO:tasks.workunit.client.0.smithi096.stdout:1/238: dread - de/f34 zero size 2024-04-18T04:57:55.203 INFO:tasks.workunit.client.0.smithi096.stdout:4/116: write d4/f18 [644531,47531] 0 2024-04-18T04:57:55.205 INFO:tasks.workunit.client.0.smithi096.stdout:7/91: dwrite db/ff [0,4194304] 0 2024-04-18T04:57:55.206 INFO:tasks.workunit.client.0.smithi096.stdout:6/204: creat d0/d6/d2e/f38 x:0 0 0 2024-04-18T04:57:55.206 INFO:tasks.workunit.client.0.smithi096.stdout:2/192: creat df/d18/d24/f3b x:0 0 0 2024-04-18T04:57:55.207 INFO:tasks.workunit.client.0.smithi096.stdout:1/239: write de/d1d/f42 [609514,42704] 0 2024-04-18T04:57:55.208 INFO:tasks.workunit.client.0.smithi096.stdout:8/110: truncate d0/d3/dc/d18/f23 32112 0 2024-04-18T04:57:55.208 INFO:tasks.workunit.client.0.smithi096.stdout:3/81: getdents dc 0 2024-04-18T04:57:55.209 INFO:tasks.workunit.client.0.smithi096.stdout:5/81: dwrite d7/f22 [0,4194304] 0 2024-04-18T04:57:55.209 INFO:tasks.workunit.client.0.smithi096.stdout:9/71: write d0/f3 [1546177,110132] 0 2024-04-18T04:57:55.212 INFO:tasks.workunit.client.0.smithi096.stdout:1/240: chown de/l1b 54 1 2024-04-18T04:57:55.213 INFO:tasks.workunit.client.0.smithi096.stdout:8/111: dread - d0/d3/dc/f22 zero size 2024-04-18T04:57:55.219 INFO:tasks.workunit.client.0.smithi096.stdout:4/117: creat d4/d14/d1d/f2a x:0 0 0 2024-04-18T04:57:55.219 INFO:tasks.workunit.client.0.smithi096.stdout:6/205: dread d0/d6/d29/f30 [0,4194304] 0 2024-04-18T04:57:55.221 INFO:tasks.workunit.client.0.smithi096.stdout:4/118: write d4/d14/d1d/f25 [555639,106226] 0 2024-04-18T04:57:55.223 INFO:tasks.workunit.client.0.smithi096.stdout:1/241: rename de/c23 to de/d1d/d3f/c4b 0 2024-04-18T04:57:55.225 INFO:tasks.workunit.client.0.smithi096.stdout:4/119: chown d4/fb 3193 1 2024-04-18T04:57:55.227 INFO:tasks.workunit.client.0.smithi096.stdout:7/92: dwrite db/f18 [0,4194304] 0 2024-04-18T04:57:55.227 INFO:tasks.workunit.client.0.smithi096.stdout:0/117: dwrite d16/f1a [0,4194304] 0 2024-04-18T04:57:55.227 INFO:tasks.workunit.client.0.smithi096.stdout:4/120: readlink d4/l10 0 2024-04-18T04:57:55.228 INFO:tasks.workunit.client.0.smithi096.stdout:8/112: rename d0/d3/dc to d0/d7/d24 0 2024-04-18T04:57:55.229 INFO:tasks.workunit.client.0.smithi096.stdout:1/242: write de/d1d/d32/f3c [1014604,120598] 0 2024-04-18T04:57:55.231 INFO:tasks.workunit.client.0.smithi096.stdout:2/193: write df/f10 [694367,93224] 0 2024-04-18T04:57:55.231 INFO:tasks.workunit.client.0.smithi096.stdout:7/93: unlink f9 0 2024-04-18T04:57:55.233 INFO:tasks.workunit.client.0.smithi096.stdout:4/121: creat d4/d14/f2b x:0 0 0 2024-04-18T04:57:55.234 INFO:tasks.workunit.client.0.smithi096.stdout:3/82: truncate f3 1554484 0 2024-04-18T04:57:55.236 INFO:tasks.workunit.client.0.smithi096.stdout:0/118: creat d16/d1d/f25 x:0 0 0 2024-04-18T04:57:55.239 INFO:tasks.workunit.client.0.smithi096.stdout:6/206: dwrite d0/d6/d2e/f38 [0,4194304] 0 2024-04-18T04:57:55.239 INFO:tasks.workunit.client.0.smithi096.stdout:1/243: stat f9 0 2024-04-18T04:57:55.239 INFO:tasks.workunit.client.0.smithi096.stdout:5/82: truncate d7/d12/f15 814664 0 2024-04-18T04:57:55.240 INFO:tasks.workunit.client.0.smithi096.stdout:9/72: dwrite d0/f11 [0,4194304] 0 2024-04-18T04:57:55.241 INFO:tasks.workunit.client.0.smithi096.stdout:2/194: rmdir df 39 2024-04-18T04:57:55.241 INFO:tasks.workunit.client.0.smithi096.stdout:1/244: chown de/l1b 717648028 1 2024-04-18T04:57:55.243 INFO:tasks.workunit.client.0.smithi096.stdout:1/245: truncate de/f2f 766334 0 2024-04-18T04:57:55.244 INFO:tasks.workunit.client.0.smithi096.stdout:7/94: rename db/c13 to db/c1c 0 2024-04-18T04:57:55.244 INFO:tasks.workunit.client.0.smithi096.stdout:1/246: write de/f3b [907982,30517] 0 2024-04-18T04:57:55.245 INFO:tasks.workunit.client.0.smithi096.stdout:3/83: rmdir dc 39 2024-04-18T04:57:55.245 INFO:tasks.workunit.client.0.smithi096.stdout:3/84: stat f2 0 2024-04-18T04:57:55.246 INFO:tasks.workunit.client.0.smithi096.stdout:4/122: mkdir d4/d14/d2c 0 2024-04-18T04:57:55.247 INFO:tasks.workunit.client.0.smithi096.stdout:4/123: dread - d4/f19 zero size 2024-04-18T04:57:55.248 INFO:tasks.workunit.client.0.smithi096.stdout:4/124: write d4/f24 [216580,121351] 0 2024-04-18T04:57:55.250 INFO:tasks.workunit.client.0.smithi096.stdout:6/207: mknod d0/d6/c39 0 2024-04-18T04:57:55.251 INFO:tasks.workunit.client.0.smithi096.stdout:7/95: dread f5 [0,4194304] 0 2024-04-18T04:57:55.252 INFO:tasks.workunit.client.0.smithi096.stdout:7/96: chown db/f18 61289 1 2024-04-18T04:57:55.252 INFO:tasks.workunit.client.0.smithi096.stdout:5/83: mkdir d7/d25 0 2024-04-18T04:57:55.253 INFO:tasks.workunit.client.0.smithi096.stdout:7/97: write db/f18 [3492019,74923] 0 2024-04-18T04:57:55.256 INFO:tasks.workunit.client.0.smithi096.stdout:5/84: write d7/dd/f21 [343854,78643] 0 2024-04-18T04:57:55.258 INFO:tasks.workunit.client.0.smithi096.stdout:9/73: rename d0/de/d13 to d0/de/d17 0 2024-04-18T04:57:55.258 INFO:tasks.workunit.client.0.smithi096.stdout:4/125: dwrite d4/f5 [0,4194304] 0 2024-04-18T04:57:55.261 INFO:tasks.workunit.client.0.smithi096.stdout:9/74: truncate d0/de/f10 4260778 0 2024-04-18T04:57:55.262 INFO:tasks.workunit.client.0.smithi096.stdout:3/85: readlink dc/lf 0 2024-04-18T04:57:55.263 INFO:tasks.workunit.client.0.smithi096.stdout:9/75: fsync d0/de/f10 0 2024-04-18T04:57:55.264 INFO:tasks.workunit.client.0.smithi096.stdout:0/119: rename f11 to d16/f26 0 2024-04-18T04:57:55.265 INFO:tasks.workunit.client.0.smithi096.stdout:6/208: creat d0/d6/f3a x:0 0 0 2024-04-18T04:57:55.265 INFO:tasks.workunit.client.0.smithi096.stdout:0/120: chown d16/d1c 393584 1 2024-04-18T04:57:55.265 INFO:tasks.workunit.client.0.smithi096.stdout:7/98: dwrite db/f18 [4194304,4194304] 0 2024-04-18T04:57:55.266 INFO:tasks.workunit.client.0.smithi096.stdout:6/209: chown d0/d6/d29/f36 28512825 1 2024-04-18T04:57:55.270 INFO:tasks.workunit.client.0.smithi096.stdout:4/126: mkdir d4/d14/d2d 0 2024-04-18T04:57:55.271 INFO:tasks.workunit.client.0.smithi096.stdout:1/247: mknod de/c4c 0 2024-04-18T04:57:55.273 INFO:tasks.workunit.client.0.smithi096.stdout:2/195: dread df/d18/d26/f36 [0,4194304] 0 2024-04-18T04:57:55.275 INFO:tasks.workunit.client.0.smithi096.stdout:9/76: mknod d0/de/d17/c18 0 2024-04-18T04:57:55.277 INFO:tasks.workunit.client.0.smithi096.stdout:0/121: rmdir d16 39 2024-04-18T04:57:55.280 INFO:tasks.workunit.client.0.smithi096.stdout:5/85: link d7/f13 d7/d12/d16/f26 0 2024-04-18T04:57:55.282 INFO:tasks.workunit.client.0.smithi096.stdout:8/113: link d0/d7/d24/d18/c1c d0/d7/c25 0 2024-04-18T04:57:55.284 INFO:tasks.workunit.client.0.smithi096.stdout:1/248: creat de/d1d/d3f/f4d x:0 0 0 2024-04-18T04:57:55.285 INFO:tasks.workunit.client.0.smithi096.stdout:6/210: write d0/d6/d29/f30 [1016737,51199] 0 2024-04-18T04:57:55.286 INFO:tasks.workunit.client.0.smithi096.stdout:3/86: fsync f3 0 2024-04-18T04:57:55.286 INFO:tasks.workunit.client.0.smithi096.stdout:1/249: write de/d1d/f3e [116054,119490] 0 2024-04-18T04:57:55.287 INFO:tasks.workunit.client.0.smithi096.stdout:8/114: dread d0/d7/fa [0,4194304] 0 2024-04-18T04:57:55.289 INFO:tasks.workunit.client.0.smithi096.stdout:6/211: write d0/d6/f37 [65970,72947] 0 2024-04-18T04:57:55.291 INFO:tasks.workunit.client.0.smithi096.stdout:0/122: creat d16/d1d/f27 x:0 0 0 2024-04-18T04:57:55.293 INFO:tasks.workunit.client.0.smithi096.stdout:1/250: creat de/d1d/d32/f4e x:0 0 0 2024-04-18T04:57:55.294 INFO:tasks.workunit.client.0.smithi096.stdout:4/127: getdents d4/d14/d1d 0 2024-04-18T04:57:55.295 INFO:tasks.workunit.client.0.smithi096.stdout:6/212: rename d0/d6/d2e/d1a to d0/d6/d2b/d3b 0 2024-04-18T04:57:55.295 INFO:tasks.workunit.client.0.smithi096.stdout:5/86: write d7/fa [209649,58167] 0 2024-04-18T04:57:55.298 INFO:tasks.workunit.client.0.smithi096.stdout:9/77: truncate d0/f11 3447271 0 2024-04-18T04:57:55.298 INFO:tasks.workunit.client.0.smithi096.stdout:0/123: creat d16/d1c/d22/f28 x:0 0 0 2024-04-18T04:57:55.299 INFO:tasks.workunit.client.0.smithi096.stdout:8/115: creat d0/f26 x:0 0 0 2024-04-18T04:57:55.299 INFO:tasks.workunit.client.0.smithi096.stdout:4/128: mkdir d4/d14/d2d/d2e 0 2024-04-18T04:57:55.300 INFO:tasks.workunit.client.0.smithi096.stdout:8/116: chown d0/d15 384 1 2024-04-18T04:57:55.300 INFO:tasks.workunit.client.0.smithi096.stdout:6/213: rename d0/d6/d29/f36 to d0/d2f/f3c 0 2024-04-18T04:57:55.301 INFO:tasks.workunit.client.0.smithi096.stdout:9/78: creat d0/de/f19 x:0 0 0 2024-04-18T04:57:55.302 INFO:tasks.workunit.client.0.smithi096.stdout:5/87: creat d7/d25/f27 x:0 0 0 2024-04-18T04:57:55.303 INFO:tasks.workunit.client.0.smithi096.stdout:0/124: creat d16/d1c/f29 x:0 0 0 2024-04-18T04:57:55.307 INFO:tasks.workunit.client.0.smithi096.stdout:8/117: mkdir d0/d7/d24/d18/d27 0 2024-04-18T04:57:55.308 INFO:tasks.workunit.client.0.smithi096.stdout:1/251: getdents de/d1d/d32 0 2024-04-18T04:57:55.309 INFO:tasks.workunit.client.0.smithi096.stdout:4/129: dwrite d4/d14/f1a [0,4194304] 0 2024-04-18T04:57:55.310 INFO:tasks.workunit.client.0.smithi096.stdout:6/214: chown d0/d6/d2b/d3b/c27 3662 1 2024-04-18T04:57:55.310 INFO:tasks.workunit.client.0.smithi096.stdout:4/130: read - d4/f19 zero size 2024-04-18T04:57:55.313 INFO:tasks.workunit.client.0.smithi096.stdout:0/125: link f7 d16/d1d/f2a 0 2024-04-18T04:57:55.314 INFO:tasks.workunit.client.0.smithi096.stdout:0/126: fdatasync d16/f1f 0 2024-04-18T04:57:55.315 INFO:tasks.workunit.client.0.smithi096.stdout:1/252: mkdir de/d1d/d3f/d4f 0 2024-04-18T04:57:55.315 INFO:tasks.workunit.client.0.smithi096.stdout:5/88: dwrite d7/ff [0,4194304] 0 2024-04-18T04:57:55.319 INFO:tasks.workunit.client.0.smithi096.stdout:8/118: mknod d0/c28 0 2024-04-18T04:57:55.319 INFO:tasks.workunit.client.0.smithi096.stdout:4/131: symlink d4/l2f 0 2024-04-18T04:57:55.320 INFO:tasks.workunit.client.0.smithi096.stdout:9/79: link d0/ld d0/de/l1a 0 2024-04-18T04:57:55.322 INFO:tasks.workunit.client.0.smithi096.stdout:5/89: unlink d7/d12/d16/l1b 0 2024-04-18T04:57:55.323 INFO:tasks.workunit.client.0.smithi096.stdout:1/253: mknod de/c50 0 2024-04-18T04:57:55.324 INFO:tasks.workunit.client.0.smithi096.stdout:4/132: write d4/d14/d1d/f27 [675639,88982] 0 2024-04-18T04:57:55.324 INFO:tasks.workunit.client.0.smithi096.stdout:0/127: dread d16/d1d/f2a [0,4194304] 0 2024-04-18T04:57:55.325 INFO:tasks.workunit.client.0.smithi096.stdout:9/80: write d0/f3 [4085897,39514] 0 2024-04-18T04:57:55.325 INFO:tasks.workunit.client.0.smithi096.stdout:8/119: fdatasync d0/d7/d24/f1f 0 2024-04-18T04:57:55.325 INFO:tasks.workunit.client.0.smithi096.stdout:6/215: dwrite d0/d6/f24 [0,4194304] 0 2024-04-18T04:57:55.326 INFO:tasks.workunit.client.0.smithi096.stdout:5/90: chown d7/dd/f21 5 1 2024-04-18T04:57:55.329 INFO:tasks.workunit.client.0.smithi096.stdout:4/133: chown d4/f19 128 1 2024-04-18T04:57:55.329 INFO:tasks.workunit.client.0.smithi096.stdout:1/254: mknod de/d1d/d32/c51 0 2024-04-18T04:57:55.330 INFO:tasks.workunit.client.0.smithi096.stdout:8/120: read - d0/d7/d24/d18/f11 zero size 2024-04-18T04:57:55.331 INFO:tasks.workunit.client.0.smithi096.stdout:5/91: write d7/d12/f1f [329909,57384] 0 2024-04-18T04:57:55.332 INFO:tasks.workunit.client.0.smithi096.stdout:8/121: readlink d0/l1 0 2024-04-18T04:57:55.333 INFO:tasks.workunit.client.0.smithi096.stdout:4/134: symlink d4/d14/d1d/l30 0 2024-04-18T04:57:55.334 INFO:tasks.workunit.client.0.smithi096.stdout:5/92: read f4 [2168677,31575] 0 2024-04-18T04:57:55.334 INFO:tasks.workunit.client.0.smithi096.stdout:1/255: dread de/f2f [0,4194304] 0 2024-04-18T04:57:55.345 INFO:tasks.workunit.client.0.smithi096.stdout:0/128: dread d16/d1d/f2a [0,4194304] 0 2024-04-18T04:57:55.347 INFO:tasks.workunit.client.0.smithi096.stdout:1/256: write de/d1d/d3f/f4d [683424,81582] 0 2024-04-18T04:57:55.348 INFO:tasks.workunit.client.0.smithi096.stdout:9/81: dread d0/de/f10 [0,4194304] 0 2024-04-18T04:57:55.351 INFO:tasks.workunit.client.0.smithi096.stdout:6/216: dwrite d0/d6/d2e/f35 [0,4194304] 0 2024-04-18T04:57:55.352 INFO:tasks.workunit.client.0.smithi096.stdout:9/82: write d0/de/f19 [443191,41968] 0 2024-04-18T04:57:55.353 INFO:tasks.workunit.client.0.smithi096.stdout:8/122: dread d0/d3/fb [0,4194304] 0 2024-04-18T04:57:55.354 INFO:tasks.workunit.client.0.smithi096.stdout:8/123: stat d0/c20 0 2024-04-18T04:57:55.356 INFO:tasks.workunit.client.0.smithi096.stdout:8/124: chown d0/f2 138693909 1 2024-04-18T04:57:55.356 INFO:tasks.workunit.client.0.smithi096.stdout:4/135: dwrite d4/f24 [4194304,4194304] 0 2024-04-18T04:57:55.357 INFO:tasks.workunit.client.0.smithi096.stdout:8/125: readlink d0/d7/l1d 0 2024-04-18T04:57:55.358 INFO:tasks.workunit.client.0.smithi096.stdout:5/93: dwrite d7/f17 [4194304,4194304] 0 2024-04-18T04:57:55.358 INFO:tasks.workunit.client.0.smithi096.stdout:4/136: dread - d4/d14/f2b zero size 2024-04-18T04:57:55.359 INFO:tasks.workunit.client.0.smithi096.stdout:4/137: chown d4/l10 183 1 2024-04-18T04:57:55.360 INFO:tasks.workunit.client.0.smithi096.stdout:5/94: write d7/dd/f19 [1960151,73249] 0 2024-04-18T04:57:55.362 INFO:tasks.workunit.client.0.smithi096.stdout:4/138: write d4/f18 [1670854,120027] 0 2024-04-18T04:57:55.363 INFO:tasks.workunit.client.0.smithi096.stdout:8/126: dread d0/d7/d24/d18/f23 [0,4194304] 0 2024-04-18T04:57:55.366 INFO:tasks.workunit.client.0.smithi096.stdout:8/127: write d0/d7/d24/f22 [702727,37738] 0 2024-04-18T04:57:55.366 INFO:tasks.workunit.client.0.smithi096.stdout:6/217: dwrite d0/d6/d2e/f38 [4194304,4194304] 0 2024-04-18T04:57:55.367 INFO:tasks.workunit.client.0.smithi096.stdout:6/218: fsync d0/d6/f34 0 2024-04-18T04:57:55.369 INFO:tasks.workunit.client.0.smithi096.stdout:6/219: write d0/d6/d2e/f31 [497016,52225] 0 2024-04-18T04:57:55.369 INFO:tasks.workunit.client.0.smithi096.stdout:6/220: stat d0/l32 0 2024-04-18T04:57:55.433 INFO:tasks.workunit.client.0.smithi096.stdout:1/257: creat de/d1d/f52 x:0 0 0 2024-04-18T04:57:55.439 INFO:tasks.workunit.client.0.smithi096.stdout:6/221: symlink d0/d6/d2b/l3d 0 2024-04-18T04:57:55.440 INFO:tasks.workunit.client.0.smithi096.stdout:9/83: dwrite d0/fc [0,4194304] 0 2024-04-18T04:57:55.445 INFO:tasks.workunit.client.0.smithi096.stdout:4/139: link d4/d14/d1d/f25 d4/d14/f31 0 2024-04-18T04:57:55.448 INFO:tasks.workunit.client.0.smithi096.stdout:9/84: symlink d0/de/l1b 0 2024-04-18T04:57:55.448 INFO:tasks.workunit.client.0.smithi096.stdout:0/129: getdents d16/d1c/d22 0 2024-04-18T04:57:55.449 INFO:tasks.workunit.client.0.smithi096.stdout:4/140: creat d4/d14/d16/f32 x:0 0 0 2024-04-18T04:57:55.450 INFO:tasks.workunit.client.0.smithi096.stdout:9/85: readlink d0/ld 0 2024-04-18T04:57:55.451 INFO:tasks.workunit.client.0.smithi096.stdout:1/258: dwrite de/f2f [0,4194304] 0 2024-04-18T04:57:55.452 INFO:tasks.workunit.client.0.smithi096.stdout:0/130: creat d16/f2b x:0 0 0 2024-04-18T04:57:55.452 INFO:tasks.workunit.client.0.smithi096.stdout:0/131: readlink l12 0 2024-04-18T04:57:55.457 INFO:tasks.workunit.client.0.smithi096.stdout:0/132: mkdir d16/d1c/d22/d2c 0 2024-04-18T04:57:55.458 INFO:tasks.workunit.client.0.smithi096.stdout:4/141: link d4/d14/d1d/l30 d4/d14/d2d/d2e/l33 0 2024-04-18T04:57:55.459 INFO:tasks.workunit.client.0.smithi096.stdout:4/142: dread - d4/d14/d16/f32 zero size 2024-04-18T04:57:55.460 INFO:tasks.workunit.client.0.smithi096.stdout:4/143: readlink d4/l1e 0 2024-04-18T04:57:55.461 INFO:tasks.workunit.client.0.smithi096.stdout:1/259: dwrite de/f3b [0,4194304] 0 2024-04-18T04:57:55.463 INFO:tasks.workunit.client.0.smithi096.stdout:4/144: write d4/d14/f31 [337716,94669] 0 2024-04-18T04:57:55.465 INFO:tasks.workunit.client.0.smithi096.stdout:4/145: fsync d4/d14/d1d/f2a 0 2024-04-18T04:57:55.468 INFO:tasks.workunit.client.0.smithi096.stdout:4/146: write d4/d14/d1d/f25 [1185919,77334] 0 2024-04-18T04:57:55.471 INFO:tasks.workunit.client.0.smithi096.stdout:0/133: dwrite ff [0,4194304] 0 2024-04-18T04:57:55.481 INFO:tasks.workunit.client.0.smithi096.stdout:4/147: dwrite d4/d14/f2b [0,4194304] 0 2024-04-18T04:57:55.482 INFO:tasks.workunit.client.0.smithi096.stdout:4/148: write d4/f5 [2251713,50675] 0 2024-04-18T04:57:55.489 INFO:tasks.workunit.client.0.smithi096.stdout:4/149: dread d4/f18 [0,4194304] 0 2024-04-18T04:57:55.490 INFO:tasks.workunit.client.0.smithi096.stdout:4/150: read - d4/d14/d1d/f2a zero size 2024-04-18T04:57:55.508 INFO:tasks.workunit.client.0.smithi096.stdout:5/95: truncate d7/dd/f19 3730788 0 2024-04-18T04:57:55.509 INFO:tasks.workunit.client.0.smithi096.stdout:5/96: fdatasync d7/fc 0 2024-04-18T04:57:55.514 INFO:tasks.workunit.client.0.smithi096.stdout:8/128: dwrite d0/d7/d24/d18/f1a [0,4194304] 0 2024-04-18T04:57:55.515 INFO:tasks.workunit.client.0.smithi096.stdout:0/134: truncate d16/f1a 2325124 0 2024-04-18T04:57:55.516 INFO:tasks.workunit.client.0.smithi096.stdout:4/151: truncate d4/d14/d1d/f25 1060666 0 2024-04-18T04:57:55.518 INFO:tasks.workunit.client.0.smithi096.stdout:5/97: write f6 [4161202,74660] 0 2024-04-18T04:57:55.521 INFO:tasks.workunit.client.0.smithi096.stdout:4/152: fdatasync d4/d14/f1a 0 2024-04-18T04:57:55.522 INFO:tasks.workunit.client.0.smithi096.stdout:9/86: dwrite d0/f11 [0,4194304] 0 2024-04-18T04:57:55.524 INFO:tasks.workunit.client.0.smithi096.stdout:1/260: dwrite f9 [0,4194304] 0 2024-04-18T04:57:55.526 INFO:tasks.workunit.client.0.smithi096.stdout:0/135: mkdir d16/d1c/d22/d2c/d2d 0 2024-04-18T04:57:55.527 INFO:tasks.workunit.client.0.smithi096.stdout:0/136: stat d16/f21 0 2024-04-18T04:57:55.528 INFO:tasks.workunit.client.0.smithi096.stdout:4/153: mknod d4/d14/d16/c34 0 2024-04-18T04:57:55.529 INFO:tasks.workunit.client.0.smithi096.stdout:9/87: creat d0/de/f1c x:0 0 0 2024-04-18T04:57:55.532 INFO:tasks.workunit.client.0.smithi096.stdout:0/137: creat d16/d1c/d22/f2e x:0 0 0 2024-04-18T04:57:55.533 INFO:tasks.workunit.client.0.smithi096.stdout:8/129: write d0/d7/d24/d18/f23 [374694,12853] 0 2024-04-18T04:57:55.533 INFO:tasks.workunit.client.0.smithi096.stdout:4/154: rename d4/f5 to d4/d14/f35 0 2024-04-18T04:57:55.535 INFO:tasks.workunit.client.0.smithi096.stdout:0/138: read d16/d1d/f1e [592325,100004] 0 2024-04-18T04:57:55.535 INFO:tasks.workunit.client.0.smithi096.stdout:4/155: write d4/d14/d1d/f27 [821945,35825] 0 2024-04-18T04:57:55.536 INFO:tasks.workunit.client.0.smithi096.stdout:0/139: write fe [2688512,81312] 0 2024-04-18T04:57:55.538 INFO:tasks.workunit.client.0.smithi096.stdout:8/130: write d0/f2 [868683,77990] 0 2024-04-18T04:57:55.539 INFO:tasks.workunit.client.0.smithi096.stdout:5/98: getdents d7/d12/d16 0 2024-04-18T04:57:55.539 INFO:tasks.workunit.client.0.smithi096.stdout:8/131: dread d0/f1e [0,4194304] 0 2024-04-18T04:57:55.543 INFO:tasks.workunit.client.0.smithi096.stdout:0/140: creat d16/d1c/d22/d2c/f2f x:0 0 0 2024-04-18T04:57:55.544 INFO:tasks.workunit.client.0.smithi096.stdout:0/141: write d16/d1c/d22/f2e [815111,98629] 0 2024-04-18T04:57:55.545 INFO:tasks.workunit.client.0.smithi096.stdout:1/261: getdents de 0 2024-04-18T04:57:55.545 INFO:tasks.workunit.client.0.smithi096.stdout:5/99: creat d7/d25/f28 x:0 0 0 2024-04-18T04:57:55.546 INFO:tasks.workunit.client.0.smithi096.stdout:5/100: stat d7/dd 0 2024-04-18T04:57:55.547 INFO:tasks.workunit.client.0.smithi096.stdout:5/101: readlink l5 0 2024-04-18T04:57:55.547 INFO:tasks.workunit.client.0.smithi096.stdout:1/262: truncate de/d1d/d32/f4e 252115 0 2024-04-18T04:57:55.548 INFO:tasks.workunit.client.0.smithi096.stdout:8/132: link d0/c12 d0/d7/d24/c29 0 2024-04-18T04:57:55.549 INFO:tasks.workunit.client.0.smithi096.stdout:4/156: getdents d4 0 2024-04-18T04:57:55.549 INFO:tasks.workunit.client.0.smithi096.stdout:9/88: truncate d0/f3 3962797 0 2024-04-18T04:57:55.550 INFO:tasks.workunit.client.0.smithi096.stdout:4/157: chown d4/d14/d1d/d29 6154978 1 2024-04-18T04:57:55.551 INFO:tasks.workunit.client.0.smithi096.stdout:0/142: link d16/f1f d16/d1c/d22/d2c/f30 0 2024-04-18T04:57:55.551 INFO:tasks.workunit.client.0.smithi096.stdout:1/263: rename lc to de/d1d/l53 0 2024-04-18T04:57:55.552 INFO:tasks.workunit.client.0.smithi096.stdout:8/133: fdatasync d0/d7/fa 0 2024-04-18T04:57:55.553 INFO:tasks.workunit.client.0.smithi096.stdout:9/89: symlink d0/de/d17/l1d 0 2024-04-18T04:57:55.553 INFO:tasks.workunit.client.0.smithi096.stdout:8/134: read d0/d7/d24/f1f [57586,45341] 0 2024-04-18T04:57:55.554 INFO:tasks.workunit.client.0.smithi096.stdout:4/158: creat d4/d14/d1d/d29/f36 x:0 0 0 2024-04-18T04:57:55.554 INFO:tasks.workunit.client.0.smithi096.stdout:0/143: symlink d16/d1d/l31 0 2024-04-18T04:57:55.554 INFO:tasks.workunit.client.0.smithi096.stdout:9/90: chown d0/de/f15 29891 1 2024-04-18T04:57:55.556 INFO:tasks.workunit.client.0.smithi096.stdout:1/264: rename de/d1d/d32/l39 to de/d1d/d32/l54 0 2024-04-18T04:57:55.557 INFO:tasks.workunit.client.0.smithi096.stdout:8/135: dread d0/f2 [0,4194304] 0 2024-04-18T04:57:55.560 INFO:tasks.workunit.client.0.smithi096.stdout:5/102: getdents d7 0 2024-04-18T04:57:55.562 INFO:tasks.workunit.client.0.smithi096.stdout:8/136: creat d0/d7/f2a x:0 0 0 2024-04-18T04:57:55.565 INFO:tasks.workunit.client.0.smithi096.stdout:8/137: creat d0/d7/f2b x:0 0 0 2024-04-18T04:57:55.567 INFO:tasks.workunit.client.0.smithi096.stdout:7/99: sync 2024-04-18T04:57:55.568 INFO:tasks.workunit.client.0.smithi096.stdout:5/103: rename d7/f18 to d7/d12/d16/f29 0 2024-04-18T04:57:55.568 INFO:tasks.workunit.client.0.smithi096.stdout:9/91: dwrite d0/fc [0,4194304] 0 2024-04-18T04:57:55.568 INFO:tasks.workunit.client.0.smithi096.stdout:4/159: dwrite d4/d14/d1d/f2a [0,4194304] 0 2024-04-18T04:57:55.569 INFO:tasks.workunit.client.0.smithi096.stdout:1/265: truncate de/f3b 917996 0 2024-04-18T04:57:55.570 INFO:tasks.workunit.client.0.smithi096.stdout:7/100: mkdir db/d1d 0 2024-04-18T04:57:55.571 INFO:tasks.workunit.client.0.smithi096.stdout:4/160: chown d4/d14/d16 8 1 2024-04-18T04:57:55.571 INFO:tasks.workunit.client.0.smithi096.stdout:8/138: symlink d0/d7/d24/l2c 0 2024-04-18T04:57:55.572 INFO:tasks.workunit.client.0.smithi096.stdout:5/104: symlink d7/d25/l2a 0 2024-04-18T04:57:55.576 INFO:tasks.workunit.client.0.smithi096.stdout:9/92: mknod d0/de/c1e 0 2024-04-18T04:57:55.576 INFO:tasks.workunit.client.0.smithi096.stdout:1/266: read f6 [4315093,107568] 0 2024-04-18T04:57:55.577 INFO:tasks.workunit.client.0.smithi096.stdout:5/105: mkdir d7/d25/d2b 0 2024-04-18T04:57:55.578 INFO:tasks.workunit.client.0.smithi096.stdout:7/101: symlink db/d1d/l1e 0 2024-04-18T04:57:55.578 INFO:tasks.workunit.client.0.smithi096.stdout:4/161: read d4/d14/f31 [509018,67278] 0 2024-04-18T04:57:55.579 INFO:tasks.workunit.client.0.smithi096.stdout:8/139: creat d0/d7/d24/d18/f2d x:0 0 0 2024-04-18T04:57:55.581 INFO:tasks.workunit.client.0.smithi096.stdout:7/102: readlink l4 0 2024-04-18T04:57:55.581 INFO:tasks.workunit.client.0.smithi096.stdout:9/93: unlink d0/de/c1e 0 2024-04-18T04:57:55.582 INFO:tasks.workunit.client.0.smithi096.stdout:0/144: dwrite d16/f26 [0,4194304] 0 2024-04-18T04:57:55.583 INFO:tasks.workunit.client.0.smithi096.stdout:4/162: symlink d4/d14/d16/l37 0 2024-04-18T04:57:55.583 INFO:tasks.workunit.client.0.smithi096.stdout:7/103: truncate db/f1b 986421 0 2024-04-18T04:57:55.584 INFO:tasks.workunit.client.0.smithi096.stdout:4/163: readlink d4/l6 0 2024-04-18T04:57:55.586 INFO:tasks.workunit.client.0.smithi096.stdout:1/267: dread de/ff [0,4194304] 0 2024-04-18T04:57:55.587 INFO:tasks.workunit.client.0.smithi096.stdout:4/164: read - d4/f19 zero size 2024-04-18T04:57:55.588 INFO:tasks.workunit.client.0.smithi096.stdout:7/104: read db/fe [471725,96451] 0 2024-04-18T04:57:55.588 INFO:tasks.workunit.client.0.smithi096.stdout:0/145: mkdir d16/d1c/d32 0 2024-04-18T04:57:55.588 INFO:tasks.workunit.client.0.smithi096.stdout:7/105: readlink l4 0 2024-04-18T04:57:55.588 INFO:tasks.workunit.client.0.smithi096.stdout:5/106: dread d7/f1a [0,4194304] 0 2024-04-18T04:57:55.588 INFO:tasks.workunit.client.0.smithi096.stdout:4/165: readlink d4/l1e 0 2024-04-18T04:57:55.589 INFO:tasks.workunit.client.0.smithi096.stdout:7/106: fdatasync fa 0 2024-04-18T04:57:55.590 INFO:tasks.workunit.client.0.smithi096.stdout:9/94: link d0/lf d0/de/d17/l1f 0 2024-04-18T04:57:55.590 INFO:tasks.workunit.client.0.smithi096.stdout:7/107: fsync db/f18 0 2024-04-18T04:57:55.590 INFO:tasks.workunit.client.0.smithi096.stdout:4/166: read - d4/d14/d16/f32 zero size 2024-04-18T04:57:55.591 INFO:tasks.workunit.client.0.smithi096.stdout:9/95: dread - d0/de/f16 zero size 2024-04-18T04:57:55.591 INFO:tasks.workunit.client.0.smithi096.stdout:8/140: dread d0/d7/fa [0,4194304] 0 2024-04-18T04:57:55.593 INFO:tasks.workunit.client.0.smithi096.stdout:5/107: creat d7/dd/f2c x:0 0 0 2024-04-18T04:57:55.595 INFO:tasks.workunit.client.0.smithi096.stdout:9/96: rename d0/de/f15 to d0/de/d17/f20 0 2024-04-18T04:57:55.596 INFO:tasks.workunit.client.0.smithi096.stdout:0/146: getdents d16/d1c/d22/d2c/d2d 0 2024-04-18T04:57:55.597 INFO:tasks.workunit.client.0.smithi096.stdout:0/147: readlink l9 0 2024-04-18T04:57:55.597 INFO:tasks.workunit.client.0.smithi096.stdout:9/97: fdatasync d0/de/f16 0 2024-04-18T04:57:55.598 INFO:tasks.workunit.client.0.smithi096.stdout:5/108: rename d7/dd/f21 to d7/d12/f2d 0 2024-04-18T04:57:55.599 INFO:tasks.workunit.client.0.smithi096.stdout:0/148: rename d16 to d16/d1c/d33 22 2024-04-18T04:57:55.601 INFO:tasks.workunit.client.0.smithi096.stdout:9/98: chown d0/de/d17/c18 1029 1 2024-04-18T04:57:55.601 INFO:tasks.workunit.client.0.smithi096.stdout:8/141: dwrite d0/d7/f2a [0,4194304] 0 2024-04-18T04:57:55.604 INFO:tasks.workunit.client.0.smithi096.stdout:1/268: write de/f3b [998964,62832] 0 2024-04-18T04:57:55.604 INFO:tasks.workunit.client.0.smithi096.stdout:8/142: dread d0/f2 [0,4194304] 0 2024-04-18T04:57:55.605 INFO:tasks.workunit.client.0.smithi096.stdout:9/99: readlink d0/de/l12 0 2024-04-18T04:57:55.606 INFO:tasks.workunit.client.0.smithi096.stdout:8/143: dread - d0/d7/d24/d18/f2d zero size 2024-04-18T04:57:55.607 INFO:tasks.workunit.client.0.smithi096.stdout:5/109: getdents d7/d12 0 2024-04-18T04:57:55.609 INFO:tasks.workunit.client.0.smithi096.stdout:0/149: getdents d16 0 2024-04-18T04:57:55.610 INFO:tasks.workunit.client.0.smithi096.stdout:0/150: stat d16/d1c/d22/f2e 0 2024-04-18T04:57:55.610 INFO:tasks.workunit.client.0.smithi096.stdout:5/110: readlink d7/l10 0 2024-04-18T04:57:55.612 INFO:tasks.workunit.client.0.smithi096.stdout:1/269: getdents de/d1d/d3f/d4f 0 2024-04-18T04:57:55.614 INFO:tasks.workunit.client.0.smithi096.stdout:5/111: rename d7/f13 to d7/dd/f2e 0 2024-04-18T04:57:55.615 INFO:tasks.workunit.client.0.smithi096.stdout:1/270: write de/d1d/d32/f4e [796734,83092] 0 2024-04-18T04:57:55.615 INFO:tasks.workunit.client.0.smithi096.stdout:8/144: write d0/d3/fb [4710655,57436] 0 2024-04-18T04:57:55.618 INFO:tasks.workunit.client.0.smithi096.stdout:5/112: creat d7/d25/f2f x:0 0 0 2024-04-18T04:57:55.619 INFO:tasks.workunit.client.0.smithi096.stdout:8/145: symlink d0/d3/l2e 0 2024-04-18T04:57:55.619 INFO:tasks.workunit.client.0.smithi096.stdout:1/271: symlink de/d1d/l55 0 2024-04-18T04:57:55.622 INFO:tasks.workunit.client.0.smithi096.stdout:5/113: mkdir d7/d25/d30 0 2024-04-18T04:57:55.622 INFO:tasks.workunit.client.0.smithi096.stdout:0/151: dwrite d16/d1d/f25 [0,4194304] 0 2024-04-18T04:57:55.623 INFO:tasks.workunit.client.0.smithi096.stdout:8/146: write d0/d7/d24/f1f [3870465,24192] 0 2024-04-18T04:57:55.623 INFO:tasks.workunit.client.0.smithi096.stdout:5/114: chown d7/dd 4637197 1 2024-04-18T04:57:55.623 INFO:tasks.workunit.client.0.smithi096.stdout:9/100: dwrite d0/f3 [0,4194304] 0 2024-04-18T04:57:55.624 INFO:tasks.workunit.client.0.smithi096.stdout:1/272: write de/d1d/d32/f46 [387932,5739] 0 2024-04-18T04:57:55.628 INFO:tasks.workunit.client.0.smithi096.stdout:9/101: mknod d0/de/c21 0 2024-04-18T04:57:55.631 INFO:tasks.workunit.client.0.smithi096.stdout:0/152: unlink d16/d1d/f2a 0 2024-04-18T04:57:55.631 INFO:tasks.workunit.client.0.smithi096.stdout:9/102: mknod d0/de/c22 0 2024-04-18T04:57:55.634 INFO:tasks.workunit.client.0.smithi096.stdout:9/103: fsync d0/de/f19 0 2024-04-18T04:57:55.634 INFO:tasks.workunit.client.0.smithi096.stdout:8/147: rename d0/c6 to d0/d7/c2f 0 2024-04-18T04:57:55.637 INFO:tasks.workunit.client.0.smithi096.stdout:0/153: creat d16/d1d/f34 x:0 0 0 2024-04-18T04:57:55.638 INFO:tasks.workunit.client.0.smithi096.stdout:9/104: fsync d0/de/d17/f20 0 2024-04-18T04:57:55.638 INFO:tasks.workunit.client.0.smithi096.stdout:1/273: dwrite de/f29 [0,4194304] 0 2024-04-18T04:57:55.639 INFO:tasks.workunit.client.0.smithi096.stdout:1/274: fdatasync de/d1d/d32/f46 0 2024-04-18T04:57:55.640 INFO:tasks.workunit.client.0.smithi096.stdout:1/275: readlink de/l24 0 2024-04-18T04:57:55.640 INFO:tasks.workunit.client.0.smithi096.stdout:8/148: unlink d0/d7/l1d 0 2024-04-18T04:57:55.641 INFO:tasks.workunit.client.0.smithi096.stdout:8/149: write d0/d7/d24/d18/f1a [1033888,113774] 0 2024-04-18T04:57:55.642 INFO:tasks.workunit.client.0.smithi096.stdout:0/154: creat d16/d1c/d22/d2c/f35 x:0 0 0 2024-04-18T04:57:55.643 INFO:tasks.workunit.client.0.smithi096.stdout:9/105: dread d0/f3 [0,4194304] 0 2024-04-18T04:57:55.644 INFO:tasks.workunit.client.0.smithi096.stdout:1/276: mknod de/d1d/d32/c56 0 2024-04-18T04:57:55.646 INFO:tasks.workunit.client.0.smithi096.stdout:1/277: read de/d1d/d32/f4e [779299,91228] 0 2024-04-18T04:57:55.647 INFO:tasks.workunit.client.0.smithi096.stdout:8/150: mknod d0/d7/d24/d18/c30 0 2024-04-18T04:57:55.649 INFO:tasks.workunit.client.0.smithi096.stdout:0/155: mkdir d16/d1c/d32/d36 0 2024-04-18T04:57:55.650 INFO:tasks.workunit.client.0.smithi096.stdout:1/278: read de/f12 [3069122,43853] 0 2024-04-18T04:57:55.651 INFO:tasks.workunit.client.0.smithi096.stdout:0/156: write d16/f1b [277950,89750] 0 2024-04-18T04:57:55.652 INFO:tasks.workunit.client.0.smithi096.stdout:9/106: dwrite d0/f11 [0,4194304] 0 2024-04-18T04:57:55.656 INFO:tasks.workunit.client.0.smithi096.stdout:9/107: creat d0/de/d17/f23 x:0 0 0 2024-04-18T04:57:55.657 INFO:tasks.workunit.client.0.smithi096.stdout:9/108: chown d0/de/l1b 8339325 1 2024-04-18T04:57:55.657 INFO:tasks.workunit.client.0.smithi096.stdout:0/157: dread d16/f1b [0,4194304] 0 2024-04-18T04:57:55.660 INFO:tasks.workunit.client.0.smithi096.stdout:0/158: creat d16/d1c/f37 x:0 0 0 2024-04-18T04:57:55.661 INFO:tasks.workunit.client.0.smithi096.stdout:1/279: dwrite de/d1d/d32/f4e [0,4194304] 0 2024-04-18T04:57:55.661 INFO:tasks.workunit.client.0.smithi096.stdout:0/159: dread - d16/d1c/d22/d2c/f30 zero size 2024-04-18T04:57:55.662 INFO:tasks.workunit.client.0.smithi096.stdout:1/280: readlink de/d1d/l2d 0 2024-04-18T04:57:55.662 INFO:tasks.workunit.client.0.smithi096.stdout:1/281: chown de/d1d/c2c 323467 1 2024-04-18T04:57:55.664 INFO:tasks.workunit.client.0.smithi096.stdout:9/109: fdatasync d0/f11 0 2024-04-18T04:57:55.665 INFO:tasks.workunit.client.0.smithi096.stdout:0/160: unlink d16/f1f 0 2024-04-18T04:57:55.668 INFO:tasks.workunit.client.0.smithi096.stdout:9/110: rename d0/lf to d0/l24 0 2024-04-18T04:57:55.671 INFO:tasks.workunit.client.0.smithi096.stdout:9/111: dread d0/de/f10 [0,4194304] 0 2024-04-18T04:57:55.672 INFO:tasks.workunit.client.0.smithi096.stdout:9/112: chown d0/de/d17/c18 45 1 2024-04-18T04:57:55.674 INFO:tasks.workunit.client.0.smithi096.stdout:0/161: write d16/d1c/d22/d2c/f30 [15784,109763] 0 2024-04-18T04:57:55.675 INFO:tasks.workunit.client.0.smithi096.stdout:0/162: dread - d16/d1d/f34 zero size 2024-04-18T04:57:55.677 INFO:tasks.workunit.client.0.smithi096.stdout:0/163: dread - d16/d1d/f27 zero size 2024-04-18T04:57:55.678 INFO:tasks.workunit.client.0.smithi096.stdout:0/164: write fe [2972495,45611] 0 2024-04-18T04:57:55.679 INFO:tasks.workunit.client.0.smithi096.stdout:0/165: readlink l12 0 2024-04-18T04:57:55.680 INFO:tasks.workunit.client.0.smithi096.stdout:9/113: dwrite d0/de/f16 [0,4194304] 0 2024-04-18T04:57:55.680 INFO:tasks.workunit.client.0.smithi096.stdout:0/166: chown d16/d1c/d22/f28 35090739 1 2024-04-18T04:57:55.681 INFO:tasks.workunit.client.0.smithi096.stdout:9/114: readlink d0/de/l1a 0 2024-04-18T04:57:55.681 INFO:tasks.workunit.client.0.smithi096.stdout:0/167: fdatasync d16/d1c/f37 0 2024-04-18T04:57:55.681 INFO:tasks.workunit.client.0.smithi096.stdout:9/115: fsync d0/de/f1c 0 2024-04-18T04:57:55.684 INFO:tasks.workunit.client.0.smithi096.stdout:0/168: mknod d16/d1c/d32/c38 0 2024-04-18T04:57:55.684 INFO:tasks.workunit.client.0.smithi096.stdout:9/116: mkdir d0/d25 0 2024-04-18T04:57:55.688 INFO:tasks.workunit.client.0.smithi096.stdout:0/169: rename f7 to d16/d1c/d32/d36/f39 0 2024-04-18T04:57:55.689 INFO:tasks.workunit.client.0.smithi096.stdout:0/170: readlink d16/d1d/l31 0 2024-04-18T04:57:55.690 INFO:tasks.workunit.client.0.smithi096.stdout:0/171: mkdir d16/d1c/d22/d3a 0 2024-04-18T04:57:55.690 INFO:tasks.workunit.client.0.smithi096.stdout:9/117: link d0/l24 d0/d25/l26 0 2024-04-18T04:57:55.692 INFO:tasks.workunit.client.0.smithi096.stdout:0/172: mkdir d16/d1d/d3b 0 2024-04-18T04:57:55.692 INFO:tasks.workunit.client.0.smithi096.stdout:0/173: dread - d16/f2b zero size 2024-04-18T04:57:55.693 INFO:tasks.workunit.client.0.smithi096.stdout:0/174: dread - d16/d1d/f34 zero size 2024-04-18T04:57:55.693 INFO:tasks.workunit.client.0.smithi096.stdout:9/118: dread d0/de/f19 [0,4194304] 0 2024-04-18T04:57:55.695 INFO:tasks.workunit.client.0.smithi096.stdout:9/119: write d0/de/f10 [3112767,35319] 0 2024-04-18T04:57:55.695 INFO:tasks.workunit.client.0.smithi096.stdout:0/175: creat d16/d1c/f3c x:0 0 0 2024-04-18T04:57:55.695 INFO:tasks.workunit.client.0.smithi096.stdout:9/120: write d0/de/d17/f20 [124609,43487] 0 2024-04-18T04:57:55.696 INFO:tasks.workunit.client.0.smithi096.stdout:0/176: mknod d16/d1c/c3d 0 2024-04-18T04:57:55.697 INFO:tasks.workunit.client.0.smithi096.stdout:9/121: symlink d0/l27 0 2024-04-18T04:57:55.697 INFO:tasks.workunit.client.0.smithi096.stdout:0/177: symlink d16/l3e 0 2024-04-18T04:57:55.698 INFO:tasks.workunit.client.0.smithi096.stdout:9/122: creat d0/f28 x:0 0 0 2024-04-18T04:57:55.699 INFO:tasks.workunit.client.0.smithi096.stdout:0/178: unlink d16/d1c/d32/c38 0 2024-04-18T04:57:55.700 INFO:tasks.workunit.client.0.smithi096.stdout:0/179: write d16/d1c/d22/f2e [1015650,50495] 0 2024-04-18T04:57:55.700 INFO:tasks.workunit.client.0.smithi096.stdout:0/180: stat d16/f1a 0 2024-04-18T04:57:55.703 INFO:tasks.workunit.client.0.smithi096.stdout:0/181: rename cb to d16/d1d/c3f 0 2024-04-18T04:57:55.703 INFO:tasks.workunit.client.0.smithi096.stdout:0/182: chown d16/d1c/d22/f2e 292927616 1 2024-04-18T04:57:55.712 INFO:tasks.workunit.client.0.smithi096.stdout:9/123: truncate d0/f3 1807428 0 2024-04-18T04:57:55.717 INFO:tasks.workunit.client.0.smithi096.stdout:0/183: dwrite d16/d1c/d32/d36/f39 [0,4194304] 0 2024-04-18T04:57:55.718 INFO:tasks.workunit.client.0.smithi096.stdout:0/184: dread - d16/d1c/f37 zero size 2024-04-18T04:57:55.719 INFO:tasks.workunit.client.0.smithi096.stdout:0/185: write d16/f26 [2299330,64601] 0 2024-04-18T04:57:55.722 INFO:tasks.workunit.client.0.smithi096.stdout:0/186: creat d16/f40 x:0 0 0 2024-04-18T04:57:55.722 INFO:tasks.workunit.client.0.smithi096.stdout:0/187: chown fd 324292397 1 2024-04-18T04:57:55.723 INFO:tasks.workunit.client.0.smithi096.stdout:0/188: chown d16/f26 14075 1 2024-04-18T04:57:55.723 INFO:tasks.workunit.client.0.smithi096.stdout:2/196: sync 2024-04-18T04:57:55.723 INFO:tasks.workunit.client.0.smithi096.stdout:0/189: write fe [1975351,69954] 0 2024-04-18T04:57:55.726 INFO:tasks.workunit.client.0.smithi096.stdout:2/197: mknod df/d18/d26/c3c 0 2024-04-18T04:57:55.730 INFO:tasks.workunit.client.0.smithi096.stdout:0/190: dread d16/d1d/f1e [0,4194304] 0 2024-04-18T04:57:55.731 INFO:tasks.workunit.client.0.smithi096.stdout:0/191: write d16/d1d/f25 [3913427,90249] 0 2024-04-18T04:57:55.737 INFO:tasks.workunit.client.0.smithi096.stdout:2/198: dwrite df/d18/f25 [4194304,4194304] 0 2024-04-18T04:57:55.740 INFO:tasks.workunit.client.0.smithi096.stdout:0/192: dwrite ff [0,4194304] 0 2024-04-18T04:57:55.741 INFO:tasks.workunit.client.0.smithi096.stdout:2/199: symlink df/d18/d2d/l3d 0 2024-04-18T04:57:55.749 INFO:tasks.workunit.client.0.smithi096.stdout:2/200: dread df/d1c/f2c [0,4194304] 0 2024-04-18T04:57:55.757 INFO:tasks.workunit.client.0.smithi096.stdout:2/201: dwrite df/d18/d24/f30 [0,4194304] 0 2024-04-18T04:57:55.769 INFO:tasks.workunit.client.0.smithi096.stdout:2/202: fsync df/d18/d24/f30 0 2024-04-18T04:57:55.770 INFO:tasks.workunit.client.0.smithi096.stdout:2/203: write fc [2339816,22229] 0 2024-04-18T04:57:55.770 INFO:tasks.workunit.client.0.smithi096.stdout:2/204: stat df/d18/d2d/l3d 0 2024-04-18T04:57:55.773 INFO:tasks.workunit.client.0.smithi096.stdout:2/205: rename f4 to df/d18/d24/f3e 0 2024-04-18T04:57:55.774 INFO:tasks.workunit.client.0.smithi096.stdout:2/206: chown df/d18/f39 12067 1 2024-04-18T04:57:55.780 INFO:tasks.workunit.client.0.smithi096.stdout:2/207: dwrite fd [0,4194304] 0 2024-04-18T04:57:55.787 INFO:tasks.workunit.client.0.smithi096.stdout:2/208: dwrite df/d18/f23 [0,4194304] 0 2024-04-18T04:57:55.796 INFO:tasks.workunit.client.0.smithi096.stdout:2/209: dwrite df/d18/d24/f3e [0,4194304] 0 2024-04-18T04:57:55.801 INFO:tasks.workunit.client.0.smithi096.stdout:2/210: getdents df/d18/d2d 0 2024-04-18T04:57:55.801 INFO:tasks.workunit.client.0.smithi096.stdout:2/211: fdatasync f2 0 2024-04-18T04:57:55.804 INFO:tasks.workunit.client.0.smithi096.stdout:2/212: mkdir df/d1c/d3f 0 2024-04-18T04:57:55.805 INFO:tasks.workunit.client.0.smithi096.stdout:2/213: write df/d18/d24/f30 [3202314,70921] 0 2024-04-18T04:57:55.813 INFO:tasks.workunit.client.0.smithi096.stdout:2/214: dwrite df/d1c/f2c [0,4194304] 0 2024-04-18T04:57:55.814 INFO:tasks.workunit.client.0.smithi096.stdout:2/215: write df/d18/f23 [3463250,58699] 0 2024-04-18T04:57:55.818 INFO:tasks.workunit.client.0.smithi096.stdout:2/216: creat df/d18/d2d/f40 x:0 0 0 2024-04-18T04:57:55.821 INFO:tasks.workunit.client.0.smithi096.stdout:2/217: dread df/d18/f23 [0,4194304] 0 2024-04-18T04:57:55.828 INFO:tasks.workunit.client.0.smithi096.stdout:2/218: dwrite df/d18/f1d [0,4194304] 0 2024-04-18T04:57:55.829 INFO:tasks.workunit.client.0.smithi096.stdout:2/219: rmdir df/d1c 39 2024-04-18T04:57:55.831 INFO:tasks.workunit.client.0.smithi096.stdout:2/220: mknod df/d18/d2d/c41 0 2024-04-18T04:57:55.832 INFO:tasks.workunit.client.0.smithi096.stdout:2/221: dread - df/d1c/f32 zero size 2024-04-18T04:57:55.836 INFO:tasks.workunit.client.0.smithi096.stdout:2/222: getdents df/d18 0 2024-04-18T04:57:55.836 INFO:tasks.workunit.client.0.smithi096.stdout:2/223: fsync df/f33 0 2024-04-18T04:57:55.839 INFO:tasks.workunit.client.0.smithi096.stdout:2/224: rename df/d1c to df/d18/d24/d42 0 2024-04-18T04:57:55.846 INFO:tasks.workunit.client.0.smithi096.stdout:2/225: dwrite df/d18/f38 [0,4194304] 0 2024-04-18T04:57:55.853 INFO:tasks.workunit.client.0.smithi096.stdout:2/226: rename df/d18/d24/d42/f32 to df/d18/d24/d42/d3f/f43 0 2024-04-18T04:57:55.860 INFO:tasks.workunit.client.0.smithi096.stdout:2/227: unlink fc 0 2024-04-18T04:57:55.865 INFO:tasks.workunit.client.0.smithi096.stdout:2/228: getdents df/d18 0 2024-04-18T04:57:55.867 INFO:tasks.workunit.client.0.smithi096.stdout:2/229: symlink df/d18/d24/d42/d3f/l44 0 2024-04-18T04:57:55.870 INFO:tasks.workunit.client.0.smithi096.stdout:2/230: creat df/d18/d24/f45 x:0 0 0 2024-04-18T04:57:55.872 INFO:tasks.workunit.client.0.smithi096.stdout:2/231: mknod df/d18/d26/c46 0 2024-04-18T04:57:55.875 INFO:tasks.workunit.client.0.smithi096.stdout:2/232: creat df/d18/d26/f47 x:0 0 0 2024-04-18T04:57:55.875 INFO:tasks.workunit.client.0.smithi096.stdout:2/233: dread - df/d18/d26/f47 zero size 2024-04-18T04:57:55.876 INFO:tasks.workunit.client.0.smithi096.stdout:2/234: chown f9 2290 1 2024-04-18T04:57:55.877 INFO:tasks.workunit.client.0.smithi096.stdout:2/235: read df/d18/d24/d42/f2c [1869320,119646] 0 2024-04-18T04:57:55.880 INFO:tasks.workunit.client.0.smithi096.stdout:2/236: mkdir df/d18/d26/d48 0 2024-04-18T04:57:55.881 INFO:tasks.workunit.client.0.smithi096.stdout:6/222: sync 2024-04-18T04:57:55.881 INFO:tasks.workunit.client.0.smithi096.stdout:3/87: sync 2024-04-18T04:57:55.886 INFO:tasks.workunit.client.0.smithi096.stdout:3/88: creat dc/f14 x:0 0 0 2024-04-18T04:57:55.887 INFO:tasks.workunit.client.0.smithi096.stdout:6/223: dwrite d0/d6/f7 [0,4194304] 0 2024-04-18T04:57:55.891 INFO:tasks.workunit.client.0.smithi096.stdout:2/237: creat df/d18/d26/d48/f49 x:0 0 0 2024-04-18T04:57:55.894 INFO:tasks.workunit.client.0.smithi096.stdout:3/89: dwrite dc/fe [0,4194304] 0 2024-04-18T04:57:55.896 INFO:tasks.workunit.client.0.smithi096.stdout:3/90: dread f3 [0,4194304] 0 2024-04-18T04:57:55.900 INFO:tasks.workunit.client.0.smithi096.stdout:2/238: dread fe [0,4194304] 0 2024-04-18T04:57:55.903 INFO:tasks.workunit.client.0.smithi096.stdout:3/91: getdents dc 0 2024-04-18T04:57:55.906 INFO:tasks.workunit.client.0.smithi096.stdout:2/239: unlink df/c15 0 2024-04-18T04:57:55.907 INFO:tasks.workunit.client.0.smithi096.stdout:2/240: fdatasync df/d18/d24/f30 0 2024-04-18T04:57:56.005 INFO:tasks.workunit.client.0.smithi096.stdout:7/108: sync 2024-04-18T04:57:56.005 INFO:tasks.workunit.client.0.smithi096.stdout:4/167: sync 2024-04-18T04:57:56.007 INFO:tasks.workunit.client.0.smithi096.stdout:7/109: write f1 [1473323,96414] 0 2024-04-18T04:57:56.008 INFO:tasks.workunit.client.0.smithi096.stdout:4/168: read d4/d14/f31 [483569,7871] 0 2024-04-18T04:57:56.013 INFO:tasks.workunit.client.0.smithi096.stdout:7/110: dread db/f1b [0,4194304] 0 2024-04-18T04:57:56.016 INFO:tasks.workunit.client.0.smithi096.stdout:4/169: rmdir d4/d14/d2c 0 2024-04-18T04:57:56.018 INFO:tasks.workunit.client.0.smithi096.stdout:7/111: rmdir db 39 2024-04-18T04:57:56.029 INFO:tasks.workunit.client.0.smithi096.stdout:7/112: write f7 [1748767,33398] 0 2024-04-18T04:57:56.036 INFO:tasks.workunit.client.0.smithi096.stdout:4/170: dwrite d4/f19 [0,4194304] 0 2024-04-18T04:57:56.037 INFO:tasks.workunit.client.0.smithi096.stdout:4/171: chown d4/f18 23 1 2024-04-18T04:57:56.040 INFO:tasks.workunit.client.0.smithi096.stdout:7/113: mkdir db/d1f 0 2024-04-18T04:57:56.041 INFO:tasks.workunit.client.0.smithi096.stdout:7/114: dread - db/f15 zero size 2024-04-18T04:57:56.051 INFO:tasks.workunit.client.0.smithi096.stdout:7/115: dread db/ff [0,4194304] 0 2024-04-18T04:57:56.052 INFO:tasks.workunit.client.0.smithi096.stdout:4/172: write d4/d14/d1d/f25 [1832574,15569] 0 2024-04-18T04:57:56.056 INFO:tasks.workunit.client.0.smithi096.stdout:7/116: mkdir db/d20 0 2024-04-18T04:57:56.059 INFO:tasks.workunit.client.0.smithi096.stdout:4/173: creat d4/d14/d16/f38 x:0 0 0 2024-04-18T04:57:56.059 INFO:tasks.workunit.client.0.smithi096.stdout:5/115: sync 2024-04-18T04:57:56.059 INFO:tasks.workunit.client.0.smithi096.stdout:8/151: sync 2024-04-18T04:57:56.061 INFO:tasks.workunit.client.0.smithi096.stdout:7/117: write db/ff [2740437,123918] 0 2024-04-18T04:57:56.061 INFO:tasks.workunit.client.0.smithi096.stdout:5/116: fdatasync d7/fa 0 2024-04-18T04:57:56.071 INFO:tasks.workunit.client.0.smithi096.stdout:7/118: creat db/d1d/f21 x:0 0 0 2024-04-18T04:57:56.073 INFO:tasks.workunit.client.0.smithi096.stdout:4/174: mkdir d4/d14/d2d/d2e/d39 0 2024-04-18T04:57:56.087 INFO:tasks.workunit.client.0.smithi096.stdout:4/175: dwrite d4/f24 [0,4194304] 0 2024-04-18T04:57:56.088 INFO:tasks.workunit.client.0.smithi096.stdout:7/119: unlink db/c17 0 2024-04-18T04:57:56.090 INFO:tasks.workunit.client.0.smithi096.stdout:4/176: write d4/d14/f1a [4778865,73392] 0 2024-04-18T04:57:56.091 INFO:tasks.workunit.client.0.smithi096.stdout:7/120: dread - db/d1d/f21 zero size 2024-04-18T04:57:56.091 INFO:tasks.workunit.client.0.smithi096.stdout:8/152: getdents d0/d7 0 2024-04-18T04:57:56.099 INFO:tasks.workunit.client.0.smithi096.stdout:4/177: write d4/d14/d16/f38 [404617,1449] 0 2024-04-18T04:57:56.102 INFO:tasks.workunit.client.0.smithi096.stdout:8/153: rename d0/f13 to d0/d3/f31 0 2024-04-18T04:57:56.103 INFO:tasks.workunit.client.0.smithi096.stdout:4/178: fdatasync d4/d14/d16/f32 0 2024-04-18T04:57:56.106 INFO:tasks.workunit.client.0.smithi096.stdout:7/121: creat db/f22 x:0 0 0 2024-04-18T04:57:56.107 INFO:tasks.workunit.client.0.smithi096.stdout:4/179: chown d4/l2f 39431 1 2024-04-18T04:57:56.108 INFO:tasks.workunit.client.0.smithi096.stdout:5/117: dwrite d7/d12/d16/f29 [0,4194304] 0 2024-04-18T04:57:56.110 INFO:tasks.workunit.client.0.smithi096.stdout:4/180: write d4/f24 [503753,30062] 0 2024-04-18T04:57:56.114 INFO:tasks.workunit.client.0.smithi096.stdout:4/181: fsync d4/d14/d1d/f2a 0 2024-04-18T04:57:56.117 INFO:tasks.workunit.client.0.smithi096.stdout:7/122: symlink db/d20/l23 0 2024-04-18T04:57:56.119 INFO:tasks.workunit.client.0.smithi096.stdout:7/123: fsync f7 0 2024-04-18T04:57:56.121 INFO:tasks.workunit.client.0.smithi096.stdout:5/118: mknod d7/d25/d2b/c31 0 2024-04-18T04:57:56.124 INFO:tasks.workunit.client.0.smithi096.stdout:0/193: sync 2024-04-18T04:57:56.124 INFO:tasks.workunit.client.0.smithi096.stdout:2/241: sync 2024-04-18T04:57:56.124 INFO:tasks.workunit.client.0.smithi096.stdout:1/282: sync 2024-04-18T04:57:56.124 INFO:tasks.workunit.client.0.smithi096.stdout:9/124: sync 2024-04-18T04:57:56.124 INFO:tasks.workunit.client.0.smithi096.stdout:3/92: sync 2024-04-18T04:57:56.124 INFO:tasks.workunit.client.0.smithi096.stdout:6/224: sync 2024-04-18T04:57:56.125 INFO:tasks.workunit.client.0.smithi096.stdout:4/182: rename d4/d14/d2d/d2e to d4/d14/d1d/d29/d3a 0 2024-04-18T04:57:56.127 INFO:tasks.workunit.client.0.smithi096.stdout:8/154: dwrite d0/d7/f2a [4194304,4194304] 0 2024-04-18T04:57:56.127 INFO:tasks.workunit.client.0.smithi096.stdout:1/283: readlink de/d1d/l55 0 2024-04-18T04:57:56.128 INFO:tasks.workunit.client.0.smithi096.stdout:0/194: rename d16/d1c to d16/d1c/d32/d36/d41 22 2024-04-18T04:57:56.130 INFO:tasks.workunit.client.0.smithi096.stdout:5/119: rename d7/c24 to d7/c32 0 2024-04-18T04:57:56.132 INFO:tasks.workunit.client.0.smithi096.stdout:2/242: dread df/d18/d26/f36 [0,4194304] 0 2024-04-18T04:57:56.134 INFO:tasks.workunit.client.0.smithi096.stdout:9/125: rmdir d0/de/d17 39 2024-04-18T04:57:56.136 INFO:tasks.workunit.client.0.smithi096.stdout:0/195: creat d16/f42 x:0 0 0 2024-04-18T04:57:56.138 INFO:tasks.workunit.client.0.smithi096.stdout:9/126: write d0/de/f10 [3854399,107425] 0 2024-04-18T04:57:56.139 INFO:tasks.workunit.client.0.smithi096.stdout:6/225: rename d0/cb to d0/c3e 0 2024-04-18T04:57:56.141 INFO:tasks.workunit.client.0.smithi096.stdout:0/196: write d16/d1d/f25 [5028293,77036] 0 2024-04-18T04:57:56.142 INFO:tasks.workunit.client.0.smithi096.stdout:6/226: fdatasync d0/d6/d2e/f35 0 2024-04-18T04:57:56.142 INFO:tasks.workunit.client.0.smithi096.stdout:7/124: dread f1 [0,4194304] 0 2024-04-18T04:57:56.144 INFO:tasks.workunit.client.0.smithi096.stdout:0/197: read - d16/d1d/f34 zero size 2024-04-18T04:57:56.144 INFO:tasks.workunit.client.0.smithi096.stdout:6/227: chown d0/d6/d2b/l3d 11 1 2024-04-18T04:57:56.144 INFO:tasks.workunit.client.0.smithi096.stdout:8/155: dwrite d0/d7/d24/d18/f2d [0,4194304] 0 2024-04-18T04:57:56.148 INFO:tasks.workunit.client.0.smithi096.stdout:4/183: rename d4/d14/f1a to d4/d14/d1d/d29/f3b 0 2024-04-18T04:57:56.149 INFO:tasks.workunit.client.0.smithi096.stdout:0/198: dread d16/f26 [0,4194304] 0 2024-04-18T04:57:56.164 INFO:tasks.workunit.client.0.smithi096.stdout:8/156: mkdir d0/d3/d32 0 2024-04-18T04:57:56.165 INFO:tasks.workunit.client.0.smithi096.stdout:8/157: write d0/d7/d24/f1f [1041408,31987] 0 2024-04-18T04:57:56.168 INFO:tasks.workunit.client.0.smithi096.stdout:2/243: rename df/d18/d2d to df/d18/d24/d42/d3f/d4a 0 2024-04-18T04:57:56.172 INFO:tasks.workunit.client.0.smithi096.stdout:5/120: link d7/f17 d7/d25/d30/f33 0 2024-04-18T04:57:56.174 INFO:tasks.workunit.client.0.smithi096.stdout:9/127: mknod d0/de/c29 0 2024-04-18T04:57:56.174 INFO:tasks.workunit.client.0.smithi096.stdout:3/93: link c1 dc/c15 0 2024-04-18T04:57:56.176 INFO:tasks.workunit.client.0.smithi096.stdout:7/125: mkdir db/d1f/d24 0 2024-04-18T04:57:56.180 INFO:tasks.workunit.client.0.smithi096.stdout:4/184: rename d4/d14/d16/l37 to d4/d14/d1d/d29/l3c 0 2024-04-18T04:57:56.181 INFO:tasks.workunit.client.0.smithi096.stdout:4/185: write d4/d14/d16/f38 [1374188,40118] 0 2024-04-18T04:57:56.181 INFO:tasks.workunit.client.0.smithi096.stdout:2/244: creat df/d18/d24/d42/d3f/f4b x:0 0 0 2024-04-18T04:57:56.183 INFO:tasks.workunit.client.0.smithi096.stdout:5/121: mknod d7/d12/d16/c34 0 2024-04-18T04:57:56.186 INFO:tasks.workunit.client.0.smithi096.stdout:4/186: dread d4/f19 [0,4194304] 0 2024-04-18T04:57:56.189 INFO:tasks.workunit.client.0.smithi096.stdout:2/245: creat df/d18/d26/f4c x:0 0 0 2024-04-18T04:57:56.194 INFO:tasks.workunit.client.0.smithi096.stdout:9/128: creat d0/de/d17/f2a x:0 0 0 2024-04-18T04:57:56.195 INFO:tasks.workunit.client.0.smithi096.stdout:6/228: getdents d0/d6/d2b/d3b 0 2024-04-18T04:57:56.199 INFO:tasks.workunit.client.0.smithi096.stdout:2/246: creat df/d18/d26/f4d x:0 0 0 2024-04-18T04:57:56.201 INFO:tasks.workunit.client.0.smithi096.stdout:7/126: link c0 db/d1f/c25 0 2024-04-18T04:57:56.202 INFO:tasks.workunit.client.0.smithi096.stdout:2/247: read df/d18/f2b [449129,103941] 0 2024-04-18T04:57:56.203 INFO:tasks.workunit.client.0.smithi096.stdout:4/187: mkdir d4/d14/d1d/d29/d3a/d39/d3d 0 2024-04-18T04:57:56.203 INFO:tasks.workunit.client.0.smithi096.stdout:2/248: stat df/d18/d24/d42/f21 0 2024-04-18T04:57:56.203 INFO:tasks.workunit.client.0.smithi096.stdout:4/188: fsync d4/d14/d16/f38 0 2024-04-18T04:57:56.203 INFO:tasks.workunit.client.0.smithi096.stdout:2/249: stat df/f10 0 2024-04-18T04:57:56.203 INFO:tasks.workunit.client.0.smithi096.stdout:0/199: rmdir d16/d1c/d22/d2c/d2d 0 2024-04-18T04:57:56.204 INFO:tasks.workunit.client.0.smithi096.stdout:2/250: dread - df/d18/d24/f3b zero size 2024-04-18T04:57:56.206 INFO:tasks.workunit.client.0.smithi096.stdout:9/129: symlink d0/d25/l2b 0 2024-04-18T04:57:56.206 INFO:tasks.workunit.client.0.smithi096.stdout:9/130: fsync d0/de/f1c 0 2024-04-18T04:57:56.207 INFO:tasks.workunit.client.0.smithi096.stdout:3/94: getdents dc 0 2024-04-18T04:57:56.207 INFO:tasks.workunit.client.0.smithi096.stdout:9/131: fsync d0/de/d17/f23 0 2024-04-18T04:57:56.208 INFO:tasks.workunit.client.0.smithi096.stdout:9/132: write d0/de/f16 [3240406,16760] 0 2024-04-18T04:57:56.208 INFO:tasks.workunit.client.0.smithi096.stdout:7/127: symlink db/l26 0 2024-04-18T04:57:56.210 INFO:tasks.workunit.client.0.smithi096.stdout:6/229: mkdir d0/d6/d2e/d3f 0 2024-04-18T04:57:56.212 INFO:tasks.workunit.client.0.smithi096.stdout:3/95: dread dc/f12 [0,4194304] 0 2024-04-18T04:57:56.213 INFO:tasks.workunit.client.0.smithi096.stdout:5/122: getdents d7/dd 0 2024-04-18T04:57:56.218 INFO:tasks.workunit.client.0.smithi096.stdout:4/189: rename d4/d14/d1d/c22 to d4/d14/d16/c3e 0 2024-04-18T04:57:56.218 INFO:tasks.workunit.client.0.smithi096.stdout:2/251: symlink df/d18/d24/d42/d3f/l4e 0 2024-04-18T04:57:56.219 INFO:tasks.workunit.client.0.smithi096.stdout:4/190: write d4/d14/f31 [601001,97843] 0 2024-04-18T04:57:56.222 INFO:tasks.workunit.client.0.smithi096.stdout:9/133: mknod d0/de/d17/c2c 0 2024-04-18T04:57:56.224 INFO:tasks.workunit.client.0.smithi096.stdout:6/230: unlink d0/d6/f2c 0 2024-04-18T04:57:56.224 INFO:tasks.workunit.client.0.smithi096.stdout:6/231: chown d0/d6/f20 1066120365 1 2024-04-18T04:57:56.225 INFO:tasks.workunit.client.0.smithi096.stdout:3/96: rmdir dc 39 2024-04-18T04:57:56.226 INFO:tasks.workunit.client.0.smithi096.stdout:5/123: write d7/d12/f2d [85056,63290] 0 2024-04-18T04:57:56.229 INFO:tasks.workunit.client.0.smithi096.stdout:2/252: creat df/d18/d26/d48/f4f x:0 0 0 2024-04-18T04:57:56.230 INFO:tasks.workunit.client.0.smithi096.stdout:2/253: write df/d18/d24/f2e [552582,42510] 0 2024-04-18T04:57:56.230 INFO:tasks.workunit.client.0.smithi096.stdout:4/191: creat d4/d14/d16/f3f x:0 0 0 2024-04-18T04:57:56.236 INFO:tasks.workunit.client.0.smithi096.stdout:6/232: creat d0/d6/d2b/d3b/f40 x:0 0 0 2024-04-18T04:57:56.237 INFO:tasks.workunit.client.0.smithi096.stdout:6/233: fdatasync d0/d6/f7 0 2024-04-18T04:57:56.237 INFO:tasks.workunit.client.0.smithi096.stdout:5/124: mkdir d7/dd/d35 0 2024-04-18T04:57:56.237 INFO:tasks.workunit.client.0.smithi096.stdout:6/234: chown d0/d6 6365230 1 2024-04-18T04:57:56.238 INFO:tasks.workunit.client.0.smithi096.stdout:6/235: dread - d0/d6/f34 zero size 2024-04-18T04:57:56.238 INFO:tasks.workunit.client.0.smithi096.stdout:2/254: symlink df/d18/d24/d42/l50 0 2024-04-18T04:57:56.239 INFO:tasks.workunit.client.0.smithi096.stdout:2/255: stat df/d18/d26/f27 0 2024-04-18T04:57:56.239 INFO:tasks.workunit.client.0.smithi096.stdout:4/192: creat d4/d14/d16/f40 x:0 0 0 2024-04-18T04:57:56.240 INFO:tasks.workunit.client.0.smithi096.stdout:2/256: fsync df/d18/d24/f30 0 2024-04-18T04:57:56.241 INFO:tasks.workunit.client.0.smithi096.stdout:4/193: read d4/fb [4178824,44047] 0 2024-04-18T04:57:56.242 INFO:tasks.workunit.client.0.smithi096.stdout:0/200: getdents d16 0 2024-04-18T04:57:56.242 INFO:tasks.workunit.client.0.smithi096.stdout:4/194: fsync d4/d14/d1d/f25 0 2024-04-18T04:57:56.242 INFO:tasks.workunit.client.0.smithi096.stdout:0/201: dread - d16/f40 zero size 2024-04-18T04:57:56.243 INFO:tasks.workunit.client.0.smithi096.stdout:5/125: mkdir d7/d12/d16/d36 0 2024-04-18T04:57:56.243 INFO:tasks.workunit.client.0.smithi096.stdout:0/202: write fd [2931408,91120] 0 2024-04-18T04:57:56.245 INFO:tasks.workunit.client.0.smithi096.stdout:7/128: getdents db 0 2024-04-18T04:57:56.251 INFO:tasks.workunit.client.0.smithi096.stdout:4/195: dwrite d4/d14/d16/f32 [0,4194304] 0 2024-04-18T04:57:56.252 INFO:tasks.workunit.client.0.smithi096.stdout:5/126: rmdir d7/dd 39 2024-04-18T04:57:56.254 INFO:tasks.workunit.client.0.smithi096.stdout:0/203: write d16/f1b [326656,56737] 0 2024-04-18T04:57:56.255 INFO:tasks.workunit.client.0.smithi096.stdout:7/129: dwrite f5 [4194304,4194304] 0 2024-04-18T04:57:56.255 INFO:tasks.workunit.client.0.smithi096.stdout:6/236: link d0/d6/f37 d0/d6/d2b/d3b/f41 0 2024-04-18T04:57:56.257 INFO:tasks.workunit.client.0.smithi096.stdout:7/130: dread db/f12 [0,4194304] 0 2024-04-18T04:57:56.257 INFO:tasks.workunit.client.0.smithi096.stdout:9/134: getdents d0 0 2024-04-18T04:57:56.257 INFO:tasks.workunit.client.0.smithi096.stdout:3/97: truncate dc/fe 3857211 0 2024-04-18T04:57:56.266 INFO:tasks.workunit.client.0.smithi096.stdout:9/135: dwrite d0/de/f1c [0,4194304] 0 2024-04-18T04:57:56.267 INFO:tasks.workunit.client.0.smithi096.stdout:3/98: rename dc/f14 to dc/f16 0 2024-04-18T04:57:56.271 INFO:tasks.workunit.client.0.smithi096.stdout:2/257: link df/d18/d24/d42/d3f/d4a/c41 df/d18/d24/d42/d3f/d4a/c51 0 2024-04-18T04:57:56.271 INFO:tasks.workunit.client.0.smithi096.stdout:4/196: truncate d4/d14/d1d/f2a 3429169 0 2024-04-18T04:57:56.272 INFO:tasks.workunit.client.0.smithi096.stdout:0/204: mknod d16/d1c/d22/d2c/c43 0 2024-04-18T04:57:56.274 INFO:tasks.workunit.client.0.smithi096.stdout:4/197: dread - d4/d14/d16/f40 zero size 2024-04-18T04:57:56.275 INFO:tasks.workunit.client.0.smithi096.stdout:0/205: dread - d16/d1c/f37 zero size 2024-04-18T04:57:56.275 INFO:tasks.workunit.client.0.smithi096.stdout:1/284: sync 2024-04-18T04:57:56.276 INFO:tasks.workunit.client.0.smithi096.stdout:9/136: dread d0/de/f1c [0,4194304] 0 2024-04-18T04:57:56.276 INFO:tasks.workunit.client.0.smithi096.stdout:7/131: dwrite f1 [0,4194304] 0 2024-04-18T04:57:56.277 INFO:tasks.workunit.client.0.smithi096.stdout:3/99: mknod dc/c17 0 2024-04-18T04:57:56.279 INFO:tasks.workunit.client.0.smithi096.stdout:5/127: link d7/d12/f2d d7/dd/f37 0 2024-04-18T04:57:56.280 INFO:tasks.workunit.client.0.smithi096.stdout:0/206: dread d16/d1d/f1e [0,4194304] 0 2024-04-18T04:57:56.280 INFO:tasks.workunit.client.0.smithi096.stdout:9/137: write d0/de/d17/f20 [5019173,71787] 0 2024-04-18T04:57:56.280 INFO:tasks.workunit.client.0.smithi096.stdout:4/198: symlink d4/d14/l41 0 2024-04-18T04:57:56.282 INFO:tasks.workunit.client.0.smithi096.stdout:3/100: unlink dc/f16 0 2024-04-18T04:57:56.284 INFO:tasks.workunit.client.0.smithi096.stdout:0/207: symlink d16/d1c/l44 0 2024-04-18T04:57:56.284 INFO:tasks.workunit.client.0.smithi096.stdout:6/237: dwrite d0/d6/d2b/d3b/f41 [0,4194304] 0 2024-04-18T04:57:56.286 INFO:tasks.workunit.client.0.smithi096.stdout:6/238: fdatasync d0/d6/f34 0 2024-04-18T04:57:56.286 INFO:tasks.workunit.client.0.smithi096.stdout:0/208: dread - d16/d1c/d22/f28 zero size 2024-04-18T04:57:56.286 INFO:tasks.workunit.client.0.smithi096.stdout:7/132: creat db/d1f/d24/f27 x:0 0 0 2024-04-18T04:57:56.287 INFO:tasks.workunit.client.0.smithi096.stdout:6/239: dread - d0/d6/f3a zero size 2024-04-18T04:57:56.290 INFO:tasks.workunit.client.0.smithi096.stdout:1/285: getdents de/d1d 0 2024-04-18T04:57:56.291 INFO:tasks.workunit.client.0.smithi096.stdout:1/286: read de/f20 [3542539,27485] 0 2024-04-18T04:57:56.291 INFO:tasks.workunit.client.0.smithi096.stdout:4/199: truncate d4/d14/d1d/f2a 3860274 0 2024-04-18T04:57:56.292 INFO:tasks.workunit.client.0.smithi096.stdout:1/287: fdatasync de/f28 0 2024-04-18T04:57:56.293 INFO:tasks.workunit.client.0.smithi096.stdout:9/138: creat d0/de/f2d x:0 0 0 2024-04-18T04:57:56.294 INFO:tasks.workunit.client.0.smithi096.stdout:9/139: chown d0/de/f19 294737 1 2024-04-18T04:57:56.294 INFO:tasks.workunit.client.0.smithi096.stdout:9/140: write d0/de/d17/f20 [2806390,13590] 0 2024-04-18T04:57:56.296 INFO:tasks.workunit.client.0.smithi096.stdout:6/240: rename d0/f26 to d0/d6/d29/f42 0 2024-04-18T04:57:56.298 INFO:tasks.workunit.client.0.smithi096.stdout:4/200: mknod d4/d14/c42 0 2024-04-18T04:57:56.303 INFO:tasks.workunit.client.0.smithi096.stdout:3/101: dread f2 [0,4194304] 0 2024-04-18T04:57:56.304 INFO:tasks.workunit.client.0.smithi096.stdout:9/141: rename d0/de/f10 to d0/d25/f2e 0 2024-04-18T04:57:56.304 INFO:tasks.workunit.client.0.smithi096.stdout:9/142: truncate d0/de/f2d 569076 0 2024-04-18T04:57:56.305 INFO:tasks.workunit.client.0.smithi096.stdout:6/241: mknod d0/d6/c43 0 2024-04-18T04:57:56.305 INFO:tasks.workunit.client.0.smithi096.stdout:0/209: link d16/d1d/l31 d16/l45 0 2024-04-18T04:57:56.305 INFO:tasks.workunit.client.0.smithi096.stdout:0/210: readlink l12 0 2024-04-18T04:57:56.306 INFO:tasks.workunit.client.0.smithi096.stdout:1/288: write de/d1d/d32/f4e [4929742,71954] 0 2024-04-18T04:57:56.307 INFO:tasks.workunit.client.0.smithi096.stdout:3/102: fsync f8 0 2024-04-18T04:57:56.308 INFO:tasks.workunit.client.0.smithi096.stdout:9/143: mkdir d0/de/d17/d2f 0 2024-04-18T04:57:56.308 INFO:tasks.workunit.client.0.smithi096.stdout:1/289: write de/d1d/f3e [117993,89989] 0 2024-04-18T04:57:56.309 INFO:tasks.workunit.client.0.smithi096.stdout:3/103: rmdir dc 39 2024-04-18T04:57:56.310 INFO:tasks.workunit.client.0.smithi096.stdout:1/290: truncate de/d1d/f4a 759660 0 2024-04-18T04:57:56.311 INFO:tasks.workunit.client.0.smithi096.stdout:6/242: rmdir d0/d6/d2e/d3f 0 2024-04-18T04:57:56.311 INFO:tasks.workunit.client.0.smithi096.stdout:9/144: chown d0/l24 67770 1 2024-04-18T04:57:56.312 INFO:tasks.workunit.client.0.smithi096.stdout:3/104: write f6 [6841849,67217] 0 2024-04-18T04:57:56.314 INFO:tasks.workunit.client.0.smithi096.stdout:6/243: write d0/d6/d2b/d3b/f41 [3766477,58618] 0 2024-04-18T04:57:56.315 INFO:tasks.workunit.client.0.smithi096.stdout:3/105: stat dc 0 2024-04-18T04:57:56.315 INFO:tasks.workunit.client.0.smithi096.stdout:0/211: dwrite d16/d1d/f34 [0,4194304] 0 2024-04-18T04:57:56.316 INFO:tasks.workunit.client.0.smithi096.stdout:9/145: mkdir d0/d30 0 2024-04-18T04:57:56.317 INFO:tasks.workunit.client.0.smithi096.stdout:6/244: write d0/d6/d29/f30 [800854,117408] 0 2024-04-18T04:57:56.317 INFO:tasks.workunit.client.0.smithi096.stdout:0/212: write fd [2411042,93925] 0 2024-04-18T04:57:56.320 INFO:tasks.workunit.client.0.smithi096.stdout:3/106: creat dc/f18 x:0 0 0 2024-04-18T04:57:56.320 INFO:tasks.workunit.client.0.smithi096.stdout:6/245: mknod d0/c44 0 2024-04-18T04:57:56.321 INFO:tasks.workunit.client.0.smithi096.stdout:3/107: write dc/f18 [998690,40779] 0 2024-04-18T04:57:56.322 INFO:tasks.workunit.client.0.smithi096.stdout:0/213: fdatasync fd 0 2024-04-18T04:57:56.323 INFO:tasks.workunit.client.0.smithi096.stdout:0/214: stat d16/d1c/d22/d2c/c43 0 2024-04-18T04:57:56.325 INFO:tasks.workunit.client.0.smithi096.stdout:9/146: link d0/d25/l2b d0/de/d17/l31 0 2024-04-18T04:57:56.326 INFO:tasks.workunit.client.0.smithi096.stdout:0/215: creat d16/d1d/d3b/f46 x:0 0 0 2024-04-18T04:57:56.328 INFO:tasks.workunit.client.0.smithi096.stdout:9/147: mknod d0/de/d17/d2f/c32 0 2024-04-18T04:57:56.329 INFO:tasks.workunit.client.0.smithi096.stdout:1/291: truncate de/ff 669478 0 2024-04-18T04:57:56.329 INFO:tasks.workunit.client.0.smithi096.stdout:0/216: truncate d16/d1d/f25 5186453 0 2024-04-18T04:57:56.330 INFO:tasks.workunit.client.0.smithi096.stdout:6/246: dwrite d0/d6/f7 [4194304,4194304] 0 2024-04-18T04:57:56.331 INFO:tasks.workunit.client.0.smithi096.stdout:9/148: mkdir d0/d25/d33 0 2024-04-18T04:57:56.332 INFO:tasks.workunit.client.0.smithi096.stdout:1/292: creat de/d1d/d32/f57 x:0 0 0 2024-04-18T04:57:56.333 INFO:tasks.workunit.client.0.smithi096.stdout:3/108: dwrite f2 [0,4194304] 0 2024-04-18T04:57:56.333 INFO:tasks.workunit.client.0.smithi096.stdout:0/217: dread d16/d1d/f1e [0,4194304] 0 2024-04-18T04:57:56.334 INFO:tasks.workunit.client.0.smithi096.stdout:1/293: chown de/f3b 158809182 1 2024-04-18T04:57:56.335 INFO:tasks.workunit.client.0.smithi096.stdout:6/247: write d0/d6/d2e/f22 [2356587,56932] 0 2024-04-18T04:57:56.335 INFO:tasks.workunit.client.0.smithi096.stdout:6/248: stat d0/d2f/f3c 0 2024-04-18T04:57:56.338 INFO:tasks.workunit.client.0.smithi096.stdout:1/294: symlink de/d1d/d3f/l58 0 2024-04-18T04:57:56.339 INFO:tasks.workunit.client.0.smithi096.stdout:1/295: stat de/l24 0 2024-04-18T04:57:56.340 INFO:tasks.workunit.client.0.smithi096.stdout:3/109: rename dc/ld to dc/l19 0 2024-04-18T04:57:56.340 INFO:tasks.workunit.client.0.smithi096.stdout:1/296: stat de/d1d/f42 0 2024-04-18T04:57:56.342 INFO:tasks.workunit.client.0.smithi096.stdout:1/297: chown de/f34 2559 1 2024-04-18T04:57:56.342 INFO:tasks.workunit.client.0.smithi096.stdout:3/110: truncate f3 2305820 0 2024-04-18T04:57:56.343 INFO:tasks.workunit.client.0.smithi096.stdout:0/218: dwrite d16/f1b [0,4194304] 0 2024-04-18T04:57:56.350 INFO:tasks.workunit.client.0.smithi096.stdout:9/149: truncate d0/de/f2d 492393 0 2024-04-18T04:57:56.353 INFO:tasks.workunit.client.0.smithi096.stdout:6/249: dwrite d0/d6/f24 [0,4194304] 0 2024-04-18T04:57:56.353 INFO:tasks.workunit.client.0.smithi096.stdout:6/250: stat d0/d6 0 2024-04-18T04:57:56.357 INFO:tasks.workunit.client.0.smithi096.stdout:1/298: dwrite de/f29 [0,4194304] 0 2024-04-18T04:57:56.362 INFO:tasks.workunit.client.0.smithi096.stdout:6/251: dwrite d0/d6/f3a [0,4194304] 0 2024-04-18T04:57:56.369 INFO:tasks.workunit.client.0.smithi096.stdout:9/150: fsync d0/f11 0 2024-04-18T04:57:56.371 INFO:tasks.workunit.client.0.smithi096.stdout:1/299: rename de/f28 to de/f59 0 2024-04-18T04:57:56.372 INFO:tasks.workunit.client.0.smithi096.stdout:1/300: stat de/d1d/d32/c49 0 2024-04-18T04:57:56.373 INFO:tasks.workunit.client.0.smithi096.stdout:1/301: write de/d1d/f52 [314254,112504] 0 2024-04-18T04:57:56.374 INFO:tasks.workunit.client.0.smithi096.stdout:0/219: mknod d16/d1c/d22/d2c/c47 0 2024-04-18T04:57:56.375 INFO:tasks.workunit.client.0.smithi096.stdout:0/220: stat d16/d1c/f37 0 2024-04-18T04:57:56.376 INFO:tasks.workunit.client.0.smithi096.stdout:1/302: symlink de/d1d/l5a 0 2024-04-18T04:57:56.376 INFO:tasks.workunit.client.0.smithi096.stdout:9/151: creat d0/d30/f34 x:0 0 0 2024-04-18T04:57:56.380 INFO:tasks.workunit.client.0.smithi096.stdout:0/221: rename d16/d1d/c3f to d16/c48 0 2024-04-18T04:57:56.380 INFO:tasks.workunit.client.0.smithi096.stdout:6/252: dread d0/d6/d2e/f35 [0,4194304] 0 2024-04-18T04:57:56.382 INFO:tasks.workunit.client.0.smithi096.stdout:0/222: creat d16/d1c/d32/f49 x:0 0 0 2024-04-18T04:57:56.383 INFO:tasks.workunit.client.0.smithi096.stdout:6/253: dread d0/d6/d2e/f31 [0,4194304] 0 2024-04-18T04:57:56.385 INFO:tasks.workunit.client.0.smithi096.stdout:6/254: write d0/d2f/f3c [709054,109907] 0 2024-04-18T04:57:56.385 INFO:tasks.workunit.client.0.smithi096.stdout:3/111: truncate f2 3908799 0 2024-04-18T04:57:56.386 INFO:tasks.workunit.client.0.smithi096.stdout:9/152: rmdir d0/d30 39 2024-04-18T04:57:56.387 INFO:tasks.workunit.client.0.smithi096.stdout:6/255: rmdir d0/d2f 39 2024-04-18T04:57:56.387 INFO:tasks.workunit.client.0.smithi096.stdout:1/303: write de/f18 [2199867,53221] 0 2024-04-18T04:57:56.390 INFO:tasks.workunit.client.0.smithi096.stdout:9/153: creat d0/d25/f35 x:0 0 0 2024-04-18T04:57:56.391 INFO:tasks.workunit.client.0.smithi096.stdout:1/304: chown de/ff 84 1 2024-04-18T04:57:56.392 INFO:tasks.workunit.client.0.smithi096.stdout:0/223: dwrite d16/d1c/f37 [0,4194304] 0 2024-04-18T04:57:56.392 INFO:tasks.workunit.client.0.smithi096.stdout:0/224: stat d16/f1b 0 2024-04-18T04:57:56.392 INFO:tasks.workunit.client.0.smithi096.stdout:0/225: write d16/f40 [259969,53223] 0 2024-04-18T04:57:56.395 INFO:tasks.workunit.client.0.smithi096.stdout:6/256: creat d0/d6/d2e/f45 x:0 0 0 2024-04-18T04:57:56.395 INFO:tasks.workunit.client.0.smithi096.stdout:1/305: creat de/f5b x:0 0 0 2024-04-18T04:57:56.396 INFO:tasks.workunit.client.0.smithi096.stdout:3/112: write dc/f12 [477902,16534] 0 2024-04-18T04:57:56.398 INFO:tasks.workunit.client.0.smithi096.stdout:3/113: mknod dc/c1a 0 2024-04-18T04:57:56.399 INFO:tasks.workunit.client.0.smithi096.stdout:1/306: write de/d1d/d32/f3c [753781,12661] 0 2024-04-18T04:57:56.402 INFO:tasks.workunit.client.0.smithi096.stdout:9/154: dwrite d0/de/f19 [0,4194304] 0 2024-04-18T04:57:56.403 INFO:tasks.workunit.client.0.smithi096.stdout:3/114: creat dc/f1b x:0 0 0 2024-04-18T04:57:56.405 INFO:tasks.workunit.client.0.smithi096.stdout:6/257: link d0/d6/d2e/f45 d0/d6/d29/f46 0 2024-04-18T04:57:56.406 INFO:tasks.workunit.client.0.smithi096.stdout:9/155: symlink d0/d25/l36 0 2024-04-18T04:57:56.406 INFO:tasks.workunit.client.0.smithi096.stdout:0/226: dwrite d16/d1c/d22/f28 [0,4194304] 0 2024-04-18T04:57:56.406 INFO:tasks.workunit.client.0.smithi096.stdout:6/258: chown d0/d6/d2e/f38 10618 1 2024-04-18T04:57:56.406 INFO:tasks.workunit.client.0.smithi096.stdout:9/156: readlink d0/d25/l36 0 2024-04-18T04:57:56.407 INFO:tasks.workunit.client.0.smithi096.stdout:1/307: link de/d1d/d32/c43 de/d1d/d3f/d4f/c5c 0 2024-04-18T04:57:56.409 INFO:tasks.workunit.client.0.smithi096.stdout:1/308: dread de/ff [0,4194304] 0 2024-04-18T04:57:56.409 INFO:tasks.workunit.client.0.smithi096.stdout:0/227: creat d16/d1c/d32/f4a x:0 0 0 2024-04-18T04:57:56.410 INFO:tasks.workunit.client.0.smithi096.stdout:6/259: rmdir d0/d6/d29 39 2024-04-18T04:57:56.411 INFO:tasks.workunit.client.0.smithi096.stdout:0/228: write d16/d1d/f27 [377002,70762] 0 2024-04-18T04:57:56.412 INFO:tasks.workunit.client.0.smithi096.stdout:0/229: write d16/d1d/f25 [367787,44632] 0 2024-04-18T04:57:56.414 INFO:tasks.workunit.client.0.smithi096.stdout:1/309: unlink de/f20 0 2024-04-18T04:57:56.415 INFO:tasks.workunit.client.0.smithi096.stdout:3/115: link c7 dc/c1c 0 2024-04-18T04:57:56.417 INFO:tasks.workunit.client.0.smithi096.stdout:8/158: sync 2024-04-18T04:57:56.418 INFO:tasks.workunit.client.0.smithi096.stdout:0/230: fsync d16/f1a 0 2024-04-18T04:57:56.419 INFO:tasks.workunit.client.0.smithi096.stdout:3/116: creat dc/f1d x:0 0 0 2024-04-18T04:57:56.420 INFO:tasks.workunit.client.0.smithi096.stdout:8/159: write d0/d7/d24/d18/f11 [298464,88568] 0 2024-04-18T04:57:56.420 INFO:tasks.workunit.client.0.smithi096.stdout:9/157: rename d0/de/c29 to d0/c37 0 2024-04-18T04:57:56.421 INFO:tasks.workunit.client.0.smithi096.stdout:3/117: rename dc to dc/d1e 22 2024-04-18T04:57:56.421 INFO:tasks.workunit.client.0.smithi096.stdout:0/231: write d16/d1c/f3c [161133,27737] 0 2024-04-18T04:57:56.423 INFO:tasks.workunit.client.0.smithi096.stdout:0/232: stat fd 0 2024-04-18T04:57:56.423 INFO:tasks.workunit.client.0.smithi096.stdout:9/158: mknod d0/c38 0 2024-04-18T04:57:56.425 INFO:tasks.workunit.client.0.smithi096.stdout:3/118: mknod dc/c1f 0 2024-04-18T04:57:56.425 INFO:tasks.workunit.client.0.smithi096.stdout:6/260: dwrite d0/d6/f3a [0,4194304] 0 2024-04-18T04:57:56.427 INFO:tasks.workunit.client.0.smithi096.stdout:6/261: dread - d0/d6/f34 zero size 2024-04-18T04:57:56.431 INFO:tasks.workunit.client.0.smithi096.stdout:8/160: link d0/l1 d0/d7/d24/d18/l33 0 2024-04-18T04:57:56.431 INFO:tasks.workunit.client.0.smithi096.stdout:1/310: dwrite de/f59 [0,4194304] 0 2024-04-18T04:57:56.432 INFO:tasks.workunit.client.0.smithi096.stdout:1/311: read f9 [3020647,75748] 0 2024-04-18T04:57:56.433 INFO:tasks.workunit.client.0.smithi096.stdout:9/159: mknod d0/d25/d33/c39 0 2024-04-18T04:57:56.436 INFO:tasks.workunit.client.0.smithi096.stdout:9/160: write d0/de/d17/f23 [571795,104376] 0 2024-04-18T04:57:56.437 INFO:tasks.workunit.client.0.smithi096.stdout:8/161: write d0/f2 [1770705,116052] 0 2024-04-18T04:57:56.438 INFO:tasks.workunit.client.0.smithi096.stdout:1/312: creat de/d1d/f5d x:0 0 0 2024-04-18T04:57:56.441 INFO:tasks.workunit.client.0.smithi096.stdout:9/161: write d0/de/f19 [2656611,55256] 0 2024-04-18T04:57:56.441 INFO:tasks.workunit.client.0.smithi096.stdout:1/313: dread - de/d1d/f5d zero size 2024-04-18T04:57:56.442 INFO:tasks.workunit.client.0.smithi096.stdout:6/262: dwrite d0/d6/f24 [4194304,4194304] 0 2024-04-18T04:57:56.442 INFO:tasks.workunit.client.0.smithi096.stdout:0/233: dwrite d16/f42 [0,4194304] 0 2024-04-18T04:57:56.445 INFO:tasks.workunit.client.0.smithi096.stdout:8/162: creat d0/d7/d24/f34 x:0 0 0 2024-04-18T04:57:56.445 INFO:tasks.workunit.client.0.smithi096.stdout:0/234: chown l3 150 1 2024-04-18T04:57:56.446 INFO:tasks.workunit.client.0.smithi096.stdout:1/314: truncate de/d1d/d3f/f4d 1148309 0 2024-04-18T04:57:56.448 INFO:tasks.workunit.client.0.smithi096.stdout:8/163: mkdir d0/d7/d24/d35 0 2024-04-18T04:57:56.450 INFO:tasks.workunit.client.0.smithi096.stdout:6/263: symlink d0/d2f/l47 0 2024-04-18T04:57:56.450 INFO:tasks.workunit.client.0.smithi096.stdout:8/164: fsync d0/d7/d24/d18/f1a 0 2024-04-18T04:57:56.453 INFO:tasks.workunit.client.0.smithi096.stdout:9/162: getdents d0/de 0 2024-04-18T04:57:56.453 INFO:tasks.workunit.client.0.smithi096.stdout:6/264: fsync d0/d6/d2e/f45 0 2024-04-18T04:57:56.455 INFO:tasks.workunit.client.0.smithi096.stdout:8/165: creat d0/d7/f36 x:0 0 0 2024-04-18T04:57:56.456 INFO:tasks.workunit.client.0.smithi096.stdout:9/163: mkdir d0/d25/d3a 0 2024-04-18T04:57:56.456 INFO:tasks.workunit.client.0.smithi096.stdout:3/119: dwrite dc/fe [0,4194304] 0 2024-04-18T04:57:56.457 INFO:tasks.workunit.client.0.smithi096.stdout:6/265: truncate d0/f33 497548 0 2024-04-18T04:57:56.458 INFO:tasks.workunit.client.0.smithi096.stdout:0/235: rename d16/d1c/d32/f4a to d16/d1c/d22/d2c/f4b 0 2024-04-18T04:57:56.459 INFO:tasks.workunit.client.0.smithi096.stdout:6/266: truncate d0/d6/d2e/f31 648714 0 2024-04-18T04:57:56.459 INFO:tasks.workunit.client.0.smithi096.stdout:5/128: sync 2024-04-18T04:57:56.459 INFO:tasks.workunit.client.0.smithi096.stdout:7/133: sync 2024-04-18T04:57:56.459 INFO:tasks.workunit.client.0.smithi096.stdout:4/201: sync 2024-04-18T04:57:56.459 INFO:tasks.workunit.client.0.smithi096.stdout:2/258: sync 2024-04-18T04:57:56.461 INFO:tasks.workunit.client.0.smithi096.stdout:5/129: dread - d7/fe zero size 2024-04-18T04:57:56.461 INFO:tasks.workunit.client.0.smithi096.stdout:3/120: creat dc/f20 x:0 0 0 2024-04-18T04:57:56.461 INFO:tasks.workunit.client.0.smithi096.stdout:8/166: unlink d0/d7/d24/d18/f1a 0 2024-04-18T04:57:56.462 INFO:tasks.workunit.client.0.smithi096.stdout:1/315: getdents de/d1d/d3f 0 2024-04-18T04:57:56.463 INFO:tasks.workunit.client.0.smithi096.stdout:9/164: chown d0/de/d17/l31 823919841 1 2024-04-18T04:57:56.463 INFO:tasks.workunit.client.0.smithi096.stdout:0/236: readlink d16/l45 0 2024-04-18T04:57:56.465 INFO:tasks.workunit.client.0.smithi096.stdout:9/165: fsync d0/de/f16 0 2024-04-18T04:57:56.465 INFO:tasks.workunit.client.0.smithi096.stdout:5/130: write d7/dd/f2c [253664,7713] 0 2024-04-18T04:57:56.465 INFO:tasks.workunit.client.0.smithi096.stdout:4/202: creat d4/f43 x:0 0 0 2024-04-18T04:57:56.466 INFO:tasks.workunit.client.0.smithi096.stdout:3/121: symlink dc/l21 0 2024-04-18T04:57:56.467 INFO:tasks.workunit.client.0.smithi096.stdout:1/316: creat de/f5e x:0 0 0 2024-04-18T04:57:56.468 INFO:tasks.workunit.client.0.smithi096.stdout:2/259: creat df/d18/d26/d48/f52 x:0 0 0 2024-04-18T04:57:56.469 INFO:tasks.workunit.client.0.smithi096.stdout:8/167: creat d0/d3/d32/f37 x:0 0 0 2024-04-18T04:57:56.469 INFO:tasks.workunit.client.0.smithi096.stdout:6/267: creat d0/d6/d2e/f48 x:0 0 0 2024-04-18T04:57:56.470 INFO:tasks.workunit.client.0.smithi096.stdout:4/203: unlink d4/l1e 0 2024-04-18T04:57:56.470 INFO:tasks.workunit.client.0.smithi096.stdout:8/168: write d0/d7/d24/f34 [1033661,24698] 0 2024-04-18T04:57:56.470 INFO:tasks.workunit.client.0.smithi096.stdout:2/260: write df/d18/d24/d42/d3f/d4a/f40 [495371,11160] 0 2024-04-18T04:57:56.471 INFO:tasks.workunit.client.0.smithi096.stdout:0/237: unlink d16/d1c/d22/d2c/c43 0 2024-04-18T04:57:56.472 INFO:tasks.workunit.client.0.smithi096.stdout:5/131: symlink d7/d25/d2b/l38 0 2024-04-18T04:57:56.473 INFO:tasks.workunit.client.0.smithi096.stdout:9/166: rename d0/d25/l2b to d0/d25/l3b 0 2024-04-18T04:57:56.476 INFO:tasks.workunit.client.0.smithi096.stdout:6/268: mknod d0/d2f/c49 0 2024-04-18T04:57:56.477 INFO:tasks.workunit.client.0.smithi096.stdout:8/169: rmdir d0/d15 39 2024-04-18T04:57:56.479 INFO:tasks.workunit.client.0.smithi096.stdout:0/238: mkdir d16/d1c/d4c 0 2024-04-18T04:57:56.481 INFO:tasks.workunit.client.0.smithi096.stdout:7/134: truncate f5 1807736 0 2024-04-18T04:57:56.483 INFO:tasks.workunit.client.0.smithi096.stdout:6/269: rmdir d0/d6/d2b/d3b 39 2024-04-18T04:57:56.485 INFO:tasks.workunit.client.0.smithi096.stdout:8/170: dwrite d0/d3/fb [0,4194304] 0 2024-04-18T04:57:56.488 INFO:tasks.workunit.client.0.smithi096.stdout:0/239: truncate d16/d1d/f1e 289370 0 2024-04-18T04:57:56.489 INFO:tasks.workunit.client.0.smithi096.stdout:5/132: dwrite f4 [4194304,4194304] 0 2024-04-18T04:57:56.490 INFO:tasks.workunit.client.0.smithi096.stdout:7/135: mkdir db/d1d/d28 0 2024-04-18T04:57:56.490 INFO:tasks.workunit.client.0.smithi096.stdout:5/133: readlink l5 0 2024-04-18T04:57:56.491 INFO:tasks.workunit.client.0.smithi096.stdout:9/167: link d0/d25/f2e d0/d25/f3c 0 2024-04-18T04:57:56.493 INFO:tasks.workunit.client.0.smithi096.stdout:6/270: chown d0/d6/d2b/d3b/c28 1924 1 2024-04-18T04:57:56.495 INFO:tasks.workunit.client.0.smithi096.stdout:3/122: dwrite f2 [0,4194304] 0 2024-04-18T04:57:56.497 INFO:tasks.workunit.client.0.smithi096.stdout:2/261: truncate df/d18/d26/f29 693885 0 2024-04-18T04:57:56.501 INFO:tasks.workunit.client.0.smithi096.stdout:0/240: rename d16/d1c/d32 to d16/d1c/d4c/d4d 0 2024-04-18T04:57:56.507 INFO:tasks.workunit.client.0.smithi096.stdout:8/171: mknod d0/d15/c38 0 2024-04-18T04:57:56.508 INFO:tasks.workunit.client.0.smithi096.stdout:0/241: dwrite d16/d1d/f25 [0,4194304] 0 2024-04-18T04:57:56.508 INFO:tasks.workunit.client.0.smithi096.stdout:0/242: write fe [785158,11682] 0 2024-04-18T04:57:56.511 INFO:tasks.workunit.client.0.smithi096.stdout:2/262: mknod df/d18/d24/d42/d3f/c53 0 2024-04-18T04:57:56.513 INFO:tasks.workunit.client.0.smithi096.stdout:2/263: truncate df/f33 51704 0 2024-04-18T04:57:56.517 INFO:tasks.workunit.client.0.smithi096.stdout:0/243: chown c15 23 1 2024-04-18T04:57:56.517 INFO:tasks.workunit.client.0.smithi096.stdout:6/271: write d0/d6/d2e/f45 [43289,88210] 0 2024-04-18T04:57:56.518 INFO:tasks.workunit.client.0.smithi096.stdout:6/272: read - d0/d6/f34 zero size 2024-04-18T04:57:56.519 INFO:tasks.workunit.client.0.smithi096.stdout:6/273: write d0/d6/d2e/f22 [2377373,77558] 0 2024-04-18T04:57:56.519 INFO:tasks.workunit.client.0.smithi096.stdout:3/123: link dc/fe dc/f22 0 2024-04-18T04:57:56.519 INFO:tasks.workunit.client.0.smithi096.stdout:3/124: read - dc/f1b zero size 2024-04-18T04:57:56.522 INFO:tasks.workunit.client.0.smithi096.stdout:2/264: creat df/d18/d26/f54 x:0 0 0 2024-04-18T04:57:56.525 INFO:tasks.workunit.client.0.smithi096.stdout:7/136: link c2 db/d1f/c29 0 2024-04-18T04:57:56.525 INFO:tasks.workunit.client.0.smithi096.stdout:0/244: dwrite d16/d1d/f27 [0,4194304] 0 2024-04-18T04:57:56.527 INFO:tasks.workunit.client.0.smithi096.stdout:5/134: getdents d7/dd 0 2024-04-18T04:57:56.528 INFO:tasks.workunit.client.0.smithi096.stdout:9/168: link d0/de/d17/c18 d0/d30/c3d 0 2024-04-18T04:57:56.529 INFO:tasks.workunit.client.0.smithi096.stdout:3/125: rename c7 to dc/c23 0 2024-04-18T04:57:56.529 INFO:tasks.workunit.client.0.smithi096.stdout:6/274: dwrite d0/d6/d2b/d3b/f41 [0,4194304] 0 2024-04-18T04:57:56.530 INFO:tasks.workunit.client.0.smithi096.stdout:7/137: creat db/f2a x:0 0 0 2024-04-18T04:57:56.533 INFO:tasks.workunit.client.0.smithi096.stdout:9/169: symlink d0/de/d17/d2f/l3e 0 2024-04-18T04:57:56.535 INFO:tasks.workunit.client.0.smithi096.stdout:3/126: dread dc/f12 [0,4194304] 0 2024-04-18T04:57:56.537 INFO:tasks.workunit.client.0.smithi096.stdout:3/127: truncate dc/fe 4524553 0 2024-04-18T04:57:56.538 INFO:tasks.workunit.client.0.smithi096.stdout:0/245: dwrite d16/d1d/d3b/f46 [0,4194304] 0 2024-04-18T04:57:56.539 INFO:tasks.workunit.client.0.smithi096.stdout:9/170: creat d0/de/d17/f3f x:0 0 0 2024-04-18T04:57:56.540 INFO:tasks.workunit.client.0.smithi096.stdout:2/265: getdents df/d18/d24/d42/d3f 0 2024-04-18T04:57:56.540 INFO:tasks.workunit.client.0.smithi096.stdout:8/172: truncate d0/d7/d24/d18/f2d 4049381 0 2024-04-18T04:57:56.541 INFO:tasks.workunit.client.0.smithi096.stdout:2/266: write fd [1538816,30690] 0 2024-04-18T04:57:56.543 INFO:tasks.workunit.client.0.smithi096.stdout:7/138: truncate db/f18 8146240 0 2024-04-18T04:57:56.545 INFO:tasks.workunit.client.0.smithi096.stdout:5/135: rename d7/d12/d16 to d7/d39 0 2024-04-18T04:57:56.546 INFO:tasks.workunit.client.0.smithi096.stdout:7/139: dread db/fe [0,4194304] 0 2024-04-18T04:57:56.547 INFO:tasks.workunit.client.0.smithi096.stdout:3/128: creat dc/f24 x:0 0 0 2024-04-18T04:57:56.550 INFO:tasks.workunit.client.0.smithi096.stdout:7/140: write db/f2a [149757,99669] 0 2024-04-18T04:57:56.551 INFO:tasks.workunit.client.0.smithi096.stdout:2/267: fdatasync df/f20 0 2024-04-18T04:57:56.553 INFO:tasks.workunit.client.0.smithi096.stdout:9/171: dwrite d0/fc [0,4194304] 0 2024-04-18T04:57:56.553 INFO:tasks.workunit.client.0.smithi096.stdout:0/246: dwrite d16/d1c/d4c/d4d/d36/f39 [0,4194304] 0 2024-04-18T04:57:56.554 INFO:tasks.workunit.client.0.smithi096.stdout:7/141: write db/f22 [54874,43141] 0 2024-04-18T04:57:56.554 INFO:tasks.workunit.client.0.smithi096.stdout:6/275: truncate d0/d6/f37 1041808 0 2024-04-18T04:57:56.554 INFO:tasks.workunit.client.0.smithi096.stdout:8/173: unlink d0/l1 0 2024-04-18T04:57:56.555 INFO:tasks.workunit.client.0.smithi096.stdout:9/172: dread - d0/de/d17/f3f zero size 2024-04-18T04:57:56.555 INFO:tasks.workunit.client.0.smithi096.stdout:7/142: fsync db/f2a 0 2024-04-18T04:57:56.559 INFO:tasks.workunit.client.0.smithi096.stdout:0/247: truncate d16/d1c/f3c 310584 0 2024-04-18T04:57:56.564 INFO:tasks.workunit.client.0.smithi096.stdout:7/143: rename db/l1a to db/d1f/l2b 0 2024-04-18T04:57:56.565 INFO:tasks.workunit.client.0.smithi096.stdout:3/129: dread dc/f18 [0,4194304] 0 2024-04-18T04:57:56.565 INFO:tasks.workunit.client.0.smithi096.stdout:5/136: write d7/d39/f26 [308909,98839] 0 2024-04-18T04:57:56.565 INFO:tasks.workunit.client.0.smithi096.stdout:0/248: mkdir d16/d1c/d4c/d4e 0 2024-04-18T04:57:56.566 INFO:tasks.workunit.client.0.smithi096.stdout:7/144: write db/f22 [182973,112230] 0 2024-04-18T04:57:56.567 INFO:tasks.workunit.client.0.smithi096.stdout:6/276: mkdir d0/d4a 0 2024-04-18T04:57:56.567 INFO:tasks.workunit.client.0.smithi096.stdout:8/174: mknod d0/d7/d24/d18/d27/c39 0 2024-04-18T04:57:56.568 INFO:tasks.workunit.client.0.smithi096.stdout:7/145: chown db/d1d 143587 1 2024-04-18T04:57:56.569 INFO:tasks.workunit.client.0.smithi096.stdout:0/249: chown d16/d1c/d22 1690 1 2024-04-18T04:57:56.571 INFO:tasks.workunit.client.0.smithi096.stdout:8/175: creat d0/d3/f3a x:0 0 0 2024-04-18T04:57:56.571 INFO:tasks.workunit.client.0.smithi096.stdout:9/173: write d0/d25/f3c [1794402,73203] 0 2024-04-18T04:57:56.572 INFO:tasks.workunit.client.0.smithi096.stdout:5/137: creat d7/d25/d30/f3a x:0 0 0 2024-04-18T04:57:56.575 INFO:tasks.workunit.client.0.smithi096.stdout:0/250: mknod d16/d1d/c4f 0 2024-04-18T04:57:56.576 INFO:tasks.workunit.client.0.smithi096.stdout:6/277: write d0/d6/d2e/f31 [1253618,46424] 0 2024-04-18T04:57:56.576 INFO:tasks.workunit.client.0.smithi096.stdout:2/268: dwrite fe [0,4194304] 0 2024-04-18T04:57:56.577 INFO:tasks.workunit.client.0.smithi096.stdout:5/138: write d7/fe [369099,16242] 0 2024-04-18T04:57:56.580 INFO:tasks.workunit.client.0.smithi096.stdout:9/174: truncate d0/de/f2d 1044212 0 2024-04-18T04:57:56.584 INFO:tasks.workunit.client.0.smithi096.stdout:3/130: dwrite dc/f10 [0,4194304] 0 2024-04-18T04:57:56.585 INFO:tasks.workunit.client.0.smithi096.stdout:0/251: creat d16/d1c/d4c/f50 x:0 0 0 2024-04-18T04:57:56.585 INFO:tasks.workunit.client.0.smithi096.stdout:6/278: write d0/d6/d2e/f38 [7128827,45712] 0 2024-04-18T04:57:56.586 INFO:tasks.workunit.client.0.smithi096.stdout:8/176: rename d0/d3/fb to d0/d7/d24/d18/d21/f3b 0 2024-04-18T04:57:56.587 INFO:tasks.workunit.client.0.smithi096.stdout:3/131: dread - dc/f1b zero size 2024-04-18T04:57:56.590 INFO:tasks.workunit.client.0.smithi096.stdout:7/146: dwrite db/fe [0,4194304] 0 2024-04-18T04:57:56.590 INFO:tasks.workunit.client.0.smithi096.stdout:5/139: mkdir d7/d3b 0 2024-04-18T04:57:56.592 INFO:tasks.workunit.client.0.smithi096.stdout:5/140: readlink d7/l10 0 2024-04-18T04:57:56.596 INFO:tasks.workunit.client.0.smithi096.stdout:3/132: mknod dc/c25 0 2024-04-18T04:57:56.596 INFO:tasks.workunit.client.0.smithi096.stdout:7/147: write db/d1f/d24/f27 [28315,48930] 0 2024-04-18T04:57:56.597 INFO:tasks.workunit.client.0.smithi096.stdout:2/269: dwrite df/d18/d24/f3b [0,4194304] 0 2024-04-18T04:57:56.598 INFO:tasks.workunit.client.0.smithi096.stdout:7/148: readlink l4 0 2024-04-18T04:57:56.599 INFO:tasks.workunit.client.0.smithi096.stdout:5/141: unlink d7/d25/d2b/c31 0 2024-04-18T04:57:56.599 INFO:tasks.workunit.client.0.smithi096.stdout:3/133: write dc/f1d [687106,21875] 0 2024-04-18T04:57:56.602 INFO:tasks.workunit.client.0.smithi096.stdout:9/175: getdents d0/de/d17/d2f 0 2024-04-18T04:57:56.604 INFO:tasks.workunit.client.0.smithi096.stdout:8/177: mkdir d0/d7/d24/d18/d27/d3c 0 2024-04-18T04:57:56.607 INFO:tasks.workunit.client.0.smithi096.stdout:6/279: dwrite d0/d6/d2b/d3b/f40 [0,4194304] 0 2024-04-18T04:57:56.607 INFO:tasks.workunit.client.0.smithi096.stdout:7/149: dread f7 [0,4194304] 0 2024-04-18T04:57:56.607 INFO:tasks.workunit.client.0.smithi096.stdout:2/270: mknod df/d18/d24/d42/d3f/d4a/c55 0 2024-04-18T04:57:56.610 INFO:tasks.workunit.client.0.smithi096.stdout:7/150: unlink l4 0 2024-04-18T04:57:56.610 INFO:tasks.workunit.client.0.smithi096.stdout:9/176: dread d0/de/f2d [0,4194304] 0 2024-04-18T04:57:56.611 INFO:tasks.workunit.client.0.smithi096.stdout:5/142: creat d7/f3c x:0 0 0 2024-04-18T04:57:56.612 INFO:tasks.workunit.client.0.smithi096.stdout:2/271: chown df/d18/d26/d48/f49 159 1 2024-04-18T04:57:56.614 INFO:tasks.workunit.client.0.smithi096.stdout:8/178: dread d0/d7/d24/d18/f23 [0,4194304] 0 2024-04-18T04:57:56.614 INFO:tasks.workunit.client.0.smithi096.stdout:6/280: rename d0 to d0/d6/d29/d4b 22 2024-04-18T04:57:56.614 INFO:tasks.workunit.client.0.smithi096.stdout:7/151: creat db/d1f/f2c x:0 0 0 2024-04-18T04:57:56.616 INFO:tasks.workunit.client.0.smithi096.stdout:5/143: creat d7/d25/d2b/f3d x:0 0 0 2024-04-18T04:57:56.616 INFO:tasks.workunit.client.0.smithi096.stdout:8/179: readlink d0/d3/l2e 0 2024-04-18T04:57:56.618 INFO:tasks.workunit.client.0.smithi096.stdout:5/144: stat d7/fa 0 2024-04-18T04:57:56.618 INFO:tasks.workunit.client.0.smithi096.stdout:6/281: chown d0/ca 4692860 1 2024-04-18T04:57:56.619 INFO:tasks.workunit.client.0.smithi096.stdout:2/272: creat df/d18/d26/d48/f56 x:0 0 0 2024-04-18T04:57:56.619 INFO:tasks.workunit.client.0.smithi096.stdout:7/152: mknod db/d20/c2d 0 2024-04-18T04:57:56.619 INFO:tasks.workunit.client.0.smithi096.stdout:9/177: rename d0/d30 to d0/de/d17/d2f/d40 0 2024-04-18T04:57:56.620 INFO:tasks.workunit.client.0.smithi096.stdout:0/252: dwrite d16/d1d/f1e [0,4194304] 0 2024-04-18T04:57:56.620 INFO:tasks.workunit.client.0.smithi096.stdout:5/145: chown d7/dd 18 1 2024-04-18T04:57:56.622 INFO:tasks.workunit.client.0.smithi096.stdout:7/153: chown db/f2a 0 1 2024-04-18T04:57:56.624 INFO:tasks.workunit.client.0.smithi096.stdout:5/146: write d7/d25/f2f [294106,100279] 0 2024-04-18T04:57:56.625 INFO:tasks.workunit.client.0.smithi096.stdout:2/273: mkdir df/d18/d26/d48/d57 0 2024-04-18T04:57:56.626 INFO:tasks.workunit.client.0.smithi096.stdout:3/134: dwrite dc/f22 [0,4194304] 0 2024-04-18T04:57:56.629 INFO:tasks.workunit.client.0.smithi096.stdout:9/178: getdents d0/de 0 2024-04-18T04:57:56.632 INFO:tasks.workunit.client.0.smithi096.stdout:3/135: mkdir dc/d26 0 2024-04-18T04:57:56.632 INFO:tasks.workunit.client.0.smithi096.stdout:9/179: chown d0/d25/l26 548 1 2024-04-18T04:57:56.632 INFO:tasks.workunit.client.0.smithi096.stdout:6/282: dread d0/d6/f15 [4194304,4194304] 0 2024-04-18T04:57:56.635 INFO:tasks.workunit.client.0.smithi096.stdout:3/136: dread - dc/f24 zero size 2024-04-18T04:57:56.635 INFO:tasks.workunit.client.0.smithi096.stdout:9/180: chown d0/de/d17/f2a 23779 1 2024-04-18T04:57:56.638 INFO:tasks.workunit.client.0.smithi096.stdout:7/154: dread db/fe [0,4194304] 0 2024-04-18T04:57:56.639 INFO:tasks.workunit.client.0.smithi096.stdout:8/180: dwrite d0/d3/d32/f37 [0,4194304] 0 2024-04-18T04:57:56.640 INFO:tasks.workunit.client.0.smithi096.stdout:6/283: mkdir d0/d6/d2b/d4c 0 2024-04-18T04:57:56.641 INFO:tasks.workunit.client.0.smithi096.stdout:3/137: symlink dc/d26/l27 0 2024-04-18T04:57:56.642 INFO:tasks.workunit.client.0.smithi096.stdout:9/181: dread d0/de/f2d [0,4194304] 0 2024-04-18T04:57:56.642 INFO:tasks.workunit.client.0.smithi096.stdout:2/274: dwrite df/d18/f39 [0,4194304] 0 2024-04-18T04:57:56.643 INFO:tasks.workunit.client.0.smithi096.stdout:3/138: write dc/f24 [467880,99293] 0 2024-04-18T04:57:56.648 INFO:tasks.workunit.client.0.smithi096.stdout:7/155: dread db/d1f/d24/f27 [0,4194304] 0 2024-04-18T04:57:56.650 INFO:tasks.workunit.client.0.smithi096.stdout:3/139: mkdir dc/d28 0 2024-04-18T04:57:56.651 INFO:tasks.workunit.client.0.smithi096.stdout:7/156: creat db/d1f/d24/f2e x:0 0 0 2024-04-18T04:57:56.652 INFO:tasks.workunit.client.0.smithi096.stdout:6/284: symlink d0/d6/d2b/l4d 0 2024-04-18T04:57:56.652 INFO:tasks.workunit.client.0.smithi096.stdout:3/140: chown dc/c11 221 1 2024-04-18T04:57:56.653 INFO:tasks.workunit.client.0.smithi096.stdout:2/275: truncate df/d18/d26/f29 1313085 0 2024-04-18T04:57:56.655 INFO:tasks.workunit.client.0.smithi096.stdout:8/181: dwrite d0/d7/d24/d18/f23 [0,4194304] 0 2024-04-18T04:57:56.655 INFO:tasks.workunit.client.0.smithi096.stdout:7/157: rename db/d1d/d28 to db/d20/d2f 0 2024-04-18T04:57:56.657 INFO:tasks.workunit.client.0.smithi096.stdout:6/285: write d0/d6/d29/f42 [443770,131057] 0 2024-04-18T04:57:56.658 INFO:tasks.workunit.client.0.smithi096.stdout:6/286: fsync d0/d2f/f3c 0 2024-04-18T04:57:56.658 INFO:tasks.workunit.client.0.smithi096.stdout:9/182: truncate d0/f11 3882262 0 2024-04-18T04:57:56.659 INFO:tasks.workunit.client.0.smithi096.stdout:6/287: chown d0/f33 1 1 2024-04-18T04:57:56.659 INFO:tasks.workunit.client.0.smithi096.stdout:3/141: mkdir dc/d28/d29 0 2024-04-18T04:57:56.660 INFO:tasks.workunit.client.0.smithi096.stdout:6/288: write d0/d6/d29/f30 [1894347,57962] 0 2024-04-18T04:57:56.661 INFO:tasks.workunit.client.0.smithi096.stdout:7/158: fsync db/f12 0 2024-04-18T04:57:56.662 INFO:tasks.workunit.client.0.smithi096.stdout:8/182: creat d0/d7/d24/f3d x:0 0 0 2024-04-18T04:57:56.668 INFO:tasks.workunit.client.0.smithi096.stdout:3/142: rename dc/c1f to dc/c2a 0 2024-04-18T04:57:56.669 INFO:tasks.workunit.client.0.smithi096.stdout:7/159: dwrite db/d1f/d24/f2e [0,4194304] 0 2024-04-18T04:57:56.670 INFO:tasks.workunit.client.0.smithi096.stdout:7/160: fsync fa 0 2024-04-18T04:57:56.671 INFO:tasks.workunit.client.0.smithi096.stdout:8/183: dwrite d0/d7/d24/d18/f23 [0,4194304] 0 2024-04-18T04:57:56.671 INFO:tasks.workunit.client.0.smithi096.stdout:7/161: fdatasync db/f2a 0 2024-04-18T04:57:56.672 INFO:tasks.workunit.client.0.smithi096.stdout:2/276: link df/d18/d24/d42/d3f/d4a/c2f df/d18/d24/d42/d3f/c58 0 2024-04-18T04:57:56.675 INFO:tasks.workunit.client.0.smithi096.stdout:2/277: rename df/d18/d24 to df/d18/d24/d42/d3f/d4a/d59 22 2024-04-18T04:57:56.676 INFO:tasks.workunit.client.0.smithi096.stdout:2/278: dread - df/d18/d24/d42/d3f/f4b zero size 2024-04-18T04:57:56.679 INFO:tasks.workunit.client.0.smithi096.stdout:3/143: dwrite dc/f1d [0,4194304] 0 2024-04-18T04:57:56.679 INFO:tasks.workunit.client.0.smithi096.stdout:3/144: truncate dc/f20 522046 0 2024-04-18T04:57:56.681 INFO:tasks.workunit.client.0.smithi096.stdout:8/184: creat d0/d3/f3e x:0 0 0 2024-04-18T04:57:56.686 INFO:tasks.workunit.client.0.smithi096.stdout:7/162: dwrite db/f22 [0,4194304] 0 2024-04-18T04:57:56.687 INFO:tasks.workunit.client.0.smithi096.stdout:6/289: creat d0/d6/d2b/f4e x:0 0 0 2024-04-18T04:57:56.687 INFO:tasks.workunit.client.0.smithi096.stdout:3/145: mknod dc/d26/c2b 0 2024-04-18T04:57:56.687 INFO:tasks.workunit.client.0.smithi096.stdout:8/185: symlink d0/d3/l3f 0 2024-04-18T04:57:56.687 INFO:tasks.workunit.client.0.smithi096.stdout:2/279: mknod df/c5a 0 2024-04-18T04:57:56.688 INFO:tasks.workunit.client.0.smithi096.stdout:8/186: chown d0 241563 1 2024-04-18T04:57:56.689 INFO:tasks.workunit.client.0.smithi096.stdout:8/187: dread - d0/d3/f3e zero size 2024-04-18T04:57:56.689 INFO:tasks.workunit.client.0.smithi096.stdout:7/163: creat db/d20/d2f/f30 x:0 0 0 2024-04-18T04:57:56.690 INFO:tasks.workunit.client.0.smithi096.stdout:3/146: rename c1 to dc/d28/c2c 0 2024-04-18T04:57:56.692 INFO:tasks.workunit.client.0.smithi096.stdout:6/290: mknod d0/d6/d2b/d4c/c4f 0 2024-04-18T04:57:56.694 INFO:tasks.workunit.client.0.smithi096.stdout:2/280: creat df/f5b x:0 0 0 2024-04-18T04:57:56.696 INFO:tasks.workunit.client.0.smithi096.stdout:8/188: dread d0/d7/d24/d18/f11 [0,4194304] 0 2024-04-18T04:57:56.697 INFO:tasks.workunit.client.0.smithi096.stdout:3/147: getdents dc/d28/d29 0 2024-04-18T04:57:56.699 INFO:tasks.workunit.client.0.smithi096.stdout:7/164: dwrite f1 [0,4194304] 0 2024-04-18T04:57:56.699 INFO:tasks.workunit.client.0.smithi096.stdout:3/148: mknod dc/c2d 0 2024-04-18T04:57:56.699 INFO:tasks.workunit.client.0.smithi096.stdout:2/281: dread df/d18/d26/f36 [0,4194304] 0 2024-04-18T04:57:56.701 INFO:tasks.workunit.client.0.smithi096.stdout:8/189: unlink d0/d7/d24/d18/c30 0 2024-04-18T04:57:56.705 INFO:tasks.workunit.client.0.smithi096.stdout:3/149: symlink dc/d28/d29/l2e 0 2024-04-18T04:57:56.707 INFO:tasks.workunit.client.0.smithi096.stdout:8/190: rename d0/d15/c38 to d0/d7/d24/d35/c40 0 2024-04-18T04:57:56.708 INFO:tasks.workunit.client.0.smithi096.stdout:6/291: dwrite d0/d6/d29/f30 [0,4194304] 0 2024-04-18T04:57:56.710 INFO:tasks.workunit.client.0.smithi096.stdout:9/183: dread d0/d25/f3c [0,4194304] 0 2024-04-18T04:57:56.714 INFO:tasks.workunit.client.0.smithi096.stdout:2/282: dwrite df/d18/d26/f4d [0,4194304] 0 2024-04-18T04:57:56.716 INFO:tasks.workunit.client.0.smithi096.stdout:9/184: mkdir d0/d41 0 2024-04-18T04:57:56.718 INFO:tasks.workunit.client.0.smithi096.stdout:8/191: dread d0/d7/d24/d18/f2d [0,4194304] 0 2024-04-18T04:57:56.718 INFO:tasks.workunit.client.0.smithi096.stdout:9/185: creat d0/de/d17/d2f/f42 x:0 0 0 2024-04-18T04:57:56.719 INFO:tasks.workunit.client.0.smithi096.stdout:8/192: write d0/f26 [75625,64071] 0 2024-04-18T04:57:56.720 INFO:tasks.workunit.client.0.smithi096.stdout:2/283: rename df/d18/d24/d42/d3f/d4a/c2f to df/d18/d26/d48/c5c 0 2024-04-18T04:57:56.721 INFO:tasks.workunit.client.0.smithi096.stdout:8/193: write d0/d7/d24/d18/f23 [676482,54890] 0 2024-04-18T04:57:56.721 INFO:tasks.workunit.client.0.smithi096.stdout:2/284: truncate df/f33 847748 0 2024-04-18T04:57:56.722 INFO:tasks.workunit.client.0.smithi096.stdout:8/194: chown d0/d7/d24/d18/d21 1213956 1 2024-04-18T04:57:56.723 INFO:tasks.workunit.client.0.smithi096.stdout:9/186: getdents d0/d25/d33 0 2024-04-18T04:57:56.724 INFO:tasks.workunit.client.0.smithi096.stdout:2/285: read df/d18/f22 [110805,50433] 0 2024-04-18T04:57:56.724 INFO:tasks.workunit.client.0.smithi096.stdout:7/165: truncate db/fe 2436621 0 2024-04-18T04:57:56.725 INFO:tasks.workunit.client.0.smithi096.stdout:3/150: truncate f8 105308 0 2024-04-18T04:57:56.726 INFO:tasks.workunit.client.0.smithi096.stdout:3/151: write dc/f22 [3512742,479] 0 2024-04-18T04:57:56.727 INFO:tasks.workunit.client.0.smithi096.stdout:8/195: creat d0/d7/d24/d18/d21/f41 x:0 0 0 2024-04-18T04:57:56.727 INFO:tasks.workunit.client.0.smithi096.stdout:7/166: stat db/d1f/c29 0 2024-04-18T04:57:56.727 INFO:tasks.workunit.client.0.smithi096.stdout:6/292: write d0/d6/d29/f30 [4446891,85158] 0 2024-04-18T04:57:56.728 INFO:tasks.workunit.client.0.smithi096.stdout:2/286: symlink df/d18/d24/d42/l5d 0 2024-04-18T04:57:56.728 INFO:tasks.workunit.client.0.smithi096.stdout:7/167: readlink db/d20/l23 0 2024-04-18T04:57:56.730 INFO:tasks.workunit.client.0.smithi096.stdout:8/196: truncate d0/d3/f31 680840 0 2024-04-18T04:57:56.731 INFO:tasks.workunit.client.0.smithi096.stdout:2/287: chown df/d18/d26/l35 0 1 2024-04-18T04:57:56.731 INFO:tasks.workunit.client.0.smithi096.stdout:6/293: unlink d0/d6/f3a 0 2024-04-18T04:57:56.731 INFO:tasks.workunit.client.0.smithi096.stdout:9/187: dread d0/fc [0,4194304] 0 2024-04-18T04:57:56.732 INFO:tasks.workunit.client.0.smithi096.stdout:7/168: creat db/f31 x:0 0 0 2024-04-18T04:57:56.732 INFO:tasks.workunit.client.0.smithi096.stdout:7/169: chown c6 832 1 2024-04-18T04:57:56.736 INFO:tasks.workunit.client.0.smithi096.stdout:6/294: symlink d0/d6/d2b/d4c/l50 0 2024-04-18T04:57:56.736 INFO:tasks.workunit.client.0.smithi096.stdout:6/295: fsync d0/d6/d2e/f45 0 2024-04-18T04:57:56.739 INFO:tasks.workunit.client.0.smithi096.stdout:9/188: symlink d0/d41/l43 0 2024-04-18T04:57:56.740 INFO:tasks.workunit.client.0.smithi096.stdout:8/197: rmdir d0 39 2024-04-18T04:57:56.741 INFO:tasks.workunit.client.0.smithi096.stdout:1/317: sync 2024-04-18T04:57:56.744 INFO:tasks.workunit.client.0.smithi096.stdout:9/189: symlink d0/d25/l44 0 2024-04-18T04:57:56.745 INFO:tasks.workunit.client.0.smithi096.stdout:2/288: write df/d18/d26/f36 [1213251,94346] 0 2024-04-18T04:57:56.746 INFO:tasks.workunit.client.0.smithi096.stdout:8/198: truncate d0/d7/d24/d18/d21/f41 408141 0 2024-04-18T04:57:56.746 INFO:tasks.workunit.client.0.smithi096.stdout:1/318: unlink de/d1d/d32/f3c 0 2024-04-18T04:57:56.746 INFO:tasks.workunit.client.0.smithi096.stdout:2/289: chown df/d18/d24/d42/d3f/d4a/l3d 25 1 2024-04-18T04:57:56.747 INFO:tasks.workunit.client.0.smithi096.stdout:1/319: chown de/d1d/l27 12668689 1 2024-04-18T04:57:56.765 INFO:tasks.workunit.client.0.smithi096.stdout:7/170: link db/d1d/l1e db/d1d/l32 0 2024-04-18T04:57:56.768 INFO:tasks.workunit.client.0.smithi096.stdout:2/290: creat df/d18/d24/d42/d3f/f5e x:0 0 0 2024-04-18T04:57:56.768 INFO:tasks.workunit.client.0.smithi096.stdout:9/190: symlink d0/d25/d3a/l45 0 2024-04-18T04:57:56.768 INFO:tasks.workunit.client.0.smithi096.stdout:7/171: truncate db/f2a 1150890 0 2024-04-18T04:57:56.768 INFO:tasks.workunit.client.0.smithi096.stdout:1/320: mkdir de/d1d/d3f/d5f 0 2024-04-18T04:57:56.771 INFO:tasks.workunit.client.0.smithi096.stdout:2/291: write df/d18/f1d [1348524,79862] 0 2024-04-18T04:57:56.772 INFO:tasks.workunit.client.0.smithi096.stdout:7/172: creat db/d1f/d24/f33 x:0 0 0 2024-04-18T04:57:56.869 INFO:tasks.workunit.client.0.smithi096.stdout:1/321: write de/d1d/d3f/f45 [718862,92604] 0 2024-04-18T04:57:56.870 INFO:tasks.workunit.client.0.smithi096.stdout:9/191: rename d0/de/c21 to d0/d41/c46 0 2024-04-18T04:57:56.873 INFO:tasks.workunit.client.0.smithi096.stdout:2/292: chown df/d18/d26 3525706 1 2024-04-18T04:57:56.875 INFO:tasks.workunit.client.0.smithi096.stdout:3/152: dwrite fa [0,4194304] 0 2024-04-18T04:57:56.879 INFO:tasks.workunit.client.0.smithi096.stdout:6/296: dread d0/d6/f20 [0,4194304] 0 2024-04-18T04:57:56.880 INFO:tasks.workunit.client.0.smithi096.stdout:7/173: creat db/d20/d2f/f34 x:0 0 0 2024-04-18T04:57:56.883 INFO:tasks.workunit.client.0.smithi096.stdout:3/153: symlink dc/d26/l2f 0 2024-04-18T04:57:56.884 INFO:tasks.workunit.client.0.smithi096.stdout:8/199: dwrite d0/d7/d24/d18/d21/f3b [0,4194304] 0 2024-04-18T04:57:56.884 INFO:tasks.workunit.client.0.smithi096.stdout:9/192: write d0/d25/f2e [3788941,16105] 0 2024-04-18T04:57:56.887 INFO:tasks.workunit.client.0.smithi096.stdout:2/293: rename df/d18/f39 to df/d18/f5f 0 2024-04-18T04:57:56.891 INFO:tasks.workunit.client.0.smithi096.stdout:3/154: rmdir dc/d28/d29 39 2024-04-18T04:57:56.899 INFO:tasks.workunit.client.0.smithi096.stdout:7/174: rename db/d1f/d24/f27 to db/d20/f35 0 2024-04-18T04:57:56.899 INFO:tasks.workunit.client.0.smithi096.stdout:9/193: mknod d0/de/d17/d2f/c47 0 2024-04-18T04:57:56.901 INFO:tasks.workunit.client.0.smithi096.stdout:9/194: chown d0/d25/d33 1 1 2024-04-18T04:57:56.903 INFO:tasks.workunit.client.0.smithi096.stdout:2/294: symlink df/d18/d24/d42/d3f/d4a/l60 0 2024-04-18T04:57:56.906 INFO:tasks.workunit.client.0.smithi096.stdout:7/175: rename c8 to db/d1f/c36 0 2024-04-18T04:57:56.908 INFO:tasks.workunit.client.0.smithi096.stdout:1/322: dwrite de/f5e [0,4194304] 0 2024-04-18T04:57:56.909 INFO:tasks.workunit.client.0.smithi096.stdout:6/297: dread d0/d6/f20 [0,4194304] 0 2024-04-18T04:57:56.911 INFO:tasks.workunit.client.0.smithi096.stdout:2/295: fdatasync df/d18/d26/f54 0 2024-04-18T04:57:56.917 INFO:tasks.workunit.client.0.smithi096.stdout:8/200: truncate d0/d7/d24/f22 766 0 2024-04-18T04:57:56.918 INFO:tasks.workunit.client.0.smithi096.stdout:1/323: mknod de/d1d/d32/c60 0 2024-04-18T04:57:56.923 INFO:tasks.workunit.client.0.smithi096.stdout:1/324: chown de/f5e 57887522 1 2024-04-18T04:57:56.923 INFO:tasks.workunit.client.0.smithi096.stdout:6/298: creat d0/d4a/f51 x:0 0 0 2024-04-18T04:57:56.923 INFO:tasks.workunit.client.0.smithi096.stdout:3/155: dwrite dc/f22 [4194304,4194304] 0 2024-04-18T04:57:56.924 INFO:tasks.workunit.client.0.smithi096.stdout:8/201: chown d0/d3/f31 115843 1 2024-04-18T04:57:56.927 INFO:tasks.workunit.client.0.smithi096.stdout:6/299: readlink d0/d6/d2b/d3b/l23 0 2024-04-18T04:57:56.928 INFO:tasks.workunit.client.0.smithi096.stdout:7/176: dread db/f22 [0,4194304] 0 2024-04-18T04:57:56.931 INFO:tasks.workunit.client.0.smithi096.stdout:8/202: mknod d0/d7/d24/d35/c42 0 2024-04-18T04:57:56.937 INFO:tasks.workunit.client.0.smithi096.stdout:8/203: truncate d0/d3/f3e 326383 0 2024-04-18T04:57:56.940 INFO:tasks.workunit.client.0.smithi096.stdout:6/300: creat d0/d6/d2b/f52 x:0 0 0 2024-04-18T04:57:56.941 INFO:tasks.workunit.client.0.smithi096.stdout:9/195: dread d0/de/d17/f20 [0,4194304] 0 2024-04-18T04:57:56.942 INFO:tasks.workunit.client.0.smithi096.stdout:6/301: readlink d0/l32 0 2024-04-18T04:57:56.942 INFO:tasks.workunit.client.0.smithi096.stdout:8/204: symlink d0/d7/l43 0 2024-04-18T04:57:56.942 INFO:tasks.workunit.client.0.smithi096.stdout:4/204: sync 2024-04-18T04:57:56.943 INFO:tasks.workunit.client.0.smithi096.stdout:1/325: dwrite de/f18 [0,4194304] 0 2024-04-18T04:57:56.943 INFO:tasks.workunit.client.0.smithi096.stdout:3/156: dwrite f8 [0,4194304] 0 2024-04-18T04:57:56.944 INFO:tasks.workunit.client.0.smithi096.stdout:7/177: dread db/d1f/d24/f2e [0,4194304] 0 2024-04-18T04:57:56.945 INFO:tasks.workunit.client.0.smithi096.stdout:6/302: mknod d0/d6/d29/c53 0 2024-04-18T04:57:56.946 INFO:tasks.workunit.client.0.smithi096.stdout:8/205: creat d0/d15/f44 x:0 0 0 2024-04-18T04:57:56.947 INFO:tasks.workunit.client.0.smithi096.stdout:6/303: dread d0/d6/d2e/f45 [0,4194304] 0 2024-04-18T04:57:56.948 INFO:tasks.workunit.client.0.smithi096.stdout:4/205: mkdir d4/d14/d2d/d44 0 2024-04-18T04:57:56.948 INFO:tasks.workunit.client.0.smithi096.stdout:9/196: stat d0/de/d17/d2f/d40/c3d 0 2024-04-18T04:57:56.952 INFO:tasks.workunit.client.0.smithi096.stdout:7/178: rename db/d1f/f2c to db/d20/d2f/f37 0 2024-04-18T04:57:56.952 INFO:tasks.workunit.client.0.smithi096.stdout:8/206: creat d0/d7/d24/f45 x:0 0 0 2024-04-18T04:57:56.954 INFO:tasks.workunit.client.0.smithi096.stdout:3/157: mknod dc/d28/d29/c30 0 2024-04-18T04:57:56.955 INFO:tasks.workunit.client.0.smithi096.stdout:2/296: dread df/f10 [0,4194304] 0 2024-04-18T04:57:56.955 INFO:tasks.workunit.client.0.smithi096.stdout:9/197: mkdir d0/de/d17/d48 0 2024-04-18T04:57:56.957 INFO:tasks.workunit.client.0.smithi096.stdout:9/198: readlink d0/de/l12 0 2024-04-18T04:57:56.958 INFO:tasks.workunit.client.0.smithi096.stdout:7/179: dread db/f2a [0,4194304] 0 2024-04-18T04:57:56.959 INFO:tasks.workunit.client.0.smithi096.stdout:9/199: chown d0/d25/f35 12234 1 2024-04-18T04:57:56.960 INFO:tasks.workunit.client.0.smithi096.stdout:9/200: readlink d0/de/l1a 0 2024-04-18T04:57:56.961 INFO:tasks.workunit.client.0.smithi096.stdout:6/304: creat d0/d6/d2b/f54 x:0 0 0 2024-04-18T04:57:56.963 INFO:tasks.workunit.client.0.smithi096.stdout:8/207: dread d0/d7/d24/f34 [0,4194304] 0 2024-04-18T04:57:56.965 INFO:tasks.workunit.client.0.smithi096.stdout:9/201: getdents d0/d25/d33 0 2024-04-18T04:57:56.967 INFO:tasks.workunit.client.0.smithi096.stdout:6/305: symlink d0/d6/d2b/d3b/l55 0 2024-04-18T04:57:56.970 INFO:tasks.workunit.client.0.smithi096.stdout:6/306: write d0/d6/d2e/f45 [716196,59568] 0 2024-04-18T04:57:56.970 INFO:tasks.workunit.client.0.smithi096.stdout:4/206: dread d4/d14/d1d/d29/f3b [0,4194304] 0 2024-04-18T04:57:56.971 INFO:tasks.workunit.client.0.smithi096.stdout:2/297: dread df/f16 [0,4194304] 0 2024-04-18T04:57:56.972 INFO:tasks.workunit.client.0.smithi096.stdout:8/208: rename d0/f1e to d0/d7/d24/d18/d27/d3c/f46 0 2024-04-18T04:57:56.972 INFO:tasks.workunit.client.0.smithi096.stdout:2/298: dread - df/d18/d26/d48/f56 zero size 2024-04-18T04:57:56.973 INFO:tasks.workunit.client.0.smithi096.stdout:2/299: readlink df/d18/d24/d42/d3f/l44 0 2024-04-18T04:57:56.977 INFO:tasks.workunit.client.0.smithi096.stdout:4/207: dread d4/d14/d16/f38 [0,4194304] 0 2024-04-18T04:57:56.978 INFO:tasks.workunit.client.0.smithi096.stdout:9/202: getdents d0/d25/d33 0 2024-04-18T04:57:56.979 INFO:tasks.workunit.client.0.smithi096.stdout:2/300: symlink df/d18/d26/d48/l61 0 2024-04-18T04:57:56.979 INFO:tasks.workunit.client.0.smithi096.stdout:3/158: write dc/f12 [1279561,104164] 0 2024-04-18T04:57:56.981 INFO:tasks.workunit.client.0.smithi096.stdout:8/209: dwrite d0/d3/f3e [0,4194304] 0 2024-04-18T04:57:56.981 INFO:tasks.workunit.client.0.smithi096.stdout:8/210: fsync d0/f2 0 2024-04-18T04:57:56.983 INFO:tasks.workunit.client.0.smithi096.stdout:7/180: truncate db/d1f/d24/f2e 3206592 0 2024-04-18T04:57:56.984 INFO:tasks.workunit.client.0.smithi096.stdout:7/181: readlink db/l26 0 2024-04-18T04:57:56.984 INFO:tasks.workunit.client.0.smithi096.stdout:4/208: mknod d4/d14/d1d/d29/c45 0 2024-04-18T04:57:56.985 INFO:tasks.workunit.client.0.smithi096.stdout:3/159: rmdir dc/d28/d29 39 2024-04-18T04:57:56.986 INFO:tasks.workunit.client.0.smithi096.stdout:7/182: truncate db/d20/d2f/f34 123338 0 2024-04-18T04:57:56.989 INFO:tasks.workunit.client.0.smithi096.stdout:2/301: dwrite df/d18/d24/f2e [0,4194304] 0 2024-04-18T04:57:56.989 INFO:tasks.workunit.client.0.smithi096.stdout:6/307: getdents d0/d6/d29 0 2024-04-18T04:57:56.994 INFO:tasks.workunit.client.0.smithi096.stdout:8/211: dwrite d0/d7/d24/d18/d27/d3c/f46 [0,4194304] 0 2024-04-18T04:57:56.995 INFO:tasks.workunit.client.0.smithi096.stdout:8/212: readlink d0/l14 0 2024-04-18T04:57:56.995 INFO:tasks.workunit.client.0.smithi096.stdout:6/308: dread d0/d6/f24 [4194304,4194304] 0 2024-04-18T04:57:56.996 INFO:tasks.workunit.client.0.smithi096.stdout:8/213: chown d0/d7/d24/d18 3161963 1 2024-04-18T04:57:57.000 INFO:tasks.workunit.client.0.smithi096.stdout:9/203: link d0/de/d17/l1d d0/de/d17/d2f/l49 0 2024-04-18T04:57:57.001 INFO:tasks.workunit.client.0.smithi096.stdout:7/183: rename db/d1f/c25 to db/d1f/c38 0 2024-04-18T04:57:57.007 INFO:tasks.workunit.client.0.smithi096.stdout:9/204: dwrite d0/de/d17/d2f/d40/f34 [0,4194304] 0 2024-04-18T04:57:57.012 INFO:tasks.workunit.client.0.smithi096.stdout:4/209: link d4/d14/d1d/d29/l3c d4/d14/d16/l46 0 2024-04-18T04:57:57.012 INFO:tasks.workunit.client.0.smithi096.stdout:3/160: link dc/d26/l27 dc/d28/d29/l31 0 2024-04-18T04:57:57.013 INFO:tasks.workunit.client.0.smithi096.stdout:6/309: creat d0/d6/d2e/f56 x:0 0 0 2024-04-18T04:57:57.013 INFO:tasks.workunit.client.0.smithi096.stdout:7/184: truncate db/fe 3301401 0 2024-04-18T04:57:57.015 INFO:tasks.workunit.client.0.smithi096.stdout:2/302: rename df/d18/d24/d42/d3f/d4a/c41 to df/c62 0 2024-04-18T04:57:57.016 INFO:tasks.workunit.client.0.smithi096.stdout:2/303: chown df/c11 1983 1 2024-04-18T04:57:57.017 INFO:tasks.workunit.client.0.smithi096.stdout:3/161: symlink dc/d28/d29/l32 0 2024-04-18T04:57:57.017 INFO:tasks.workunit.client.0.smithi096.stdout:9/205: dwrite d0/f28 [0,4194304] 0 2024-04-18T04:57:57.019 INFO:tasks.workunit.client.0.smithi096.stdout:7/185: unlink f1 0 2024-04-18T04:57:57.019 INFO:tasks.workunit.client.0.smithi096.stdout:9/206: fdatasync d0/d25/f35 0 2024-04-18T04:57:57.022 INFO:tasks.workunit.client.0.smithi096.stdout:2/304: rmdir df/d18/d24/d42/d3f/d4a 39 2024-04-18T04:57:57.023 INFO:tasks.workunit.client.0.smithi096.stdout:4/210: dwrite d4/d14/d16/f32 [0,4194304] 0 2024-04-18T04:57:57.026 INFO:tasks.workunit.client.0.smithi096.stdout:9/207: creat d0/d25/d3a/f4a x:0 0 0 2024-04-18T04:57:57.030 INFO:tasks.workunit.client.0.smithi096.stdout:6/310: dread d0/d6/d2e/f22 [0,4194304] 0 2024-04-18T04:57:57.031 INFO:tasks.workunit.client.0.smithi096.stdout:4/211: unlink d4/fb 0 2024-04-18T04:57:57.034 INFO:tasks.workunit.client.0.smithi096.stdout:3/162: creat dc/d28/f33 x:0 0 0 2024-04-18T04:57:57.034 INFO:tasks.workunit.client.0.smithi096.stdout:6/311: mknod d0/d6/d2b/d3b/c57 0 2024-04-18T04:57:57.035 INFO:tasks.workunit.client.0.smithi096.stdout:3/163: write dc/fe [4077327,33008] 0 2024-04-18T04:57:57.035 INFO:tasks.workunit.client.0.smithi096.stdout:4/212: mkdir d4/d14/d1d/d29/d3a/d47 0 2024-04-18T04:57:57.037 INFO:tasks.workunit.client.0.smithi096.stdout:2/305: creat df/f63 x:0 0 0 2024-04-18T04:57:57.038 INFO:tasks.workunit.client.0.smithi096.stdout:7/186: getdents db 0 2024-04-18T04:57:57.039 INFO:tasks.workunit.client.0.smithi096.stdout:9/208: rename d0/fc to d0/f4b 0 2024-04-18T04:57:57.040 INFO:tasks.workunit.client.0.smithi096.stdout:4/213: symlink d4/d14/d1d/d29/l48 0 2024-04-18T04:57:57.042 INFO:tasks.workunit.client.0.smithi096.stdout:2/306: chown df/d18/d24/d42/d3f/d4a/c55 484837 1 2024-04-18T04:57:57.043 INFO:tasks.workunit.client.0.smithi096.stdout:7/187: mkdir db/d1f/d39 0 2024-04-18T04:57:57.043 INFO:tasks.workunit.client.0.smithi096.stdout:2/307: write f9 [764086,19729] 0 2024-04-18T04:57:57.046 INFO:tasks.workunit.client.0.smithi096.stdout:6/312: dwrite d0/d6/f1d [0,4194304] 0 2024-04-18T04:57:57.046 INFO:tasks.workunit.client.0.smithi096.stdout:0/253: sync 2024-04-18T04:57:57.049 INFO:tasks.workunit.client.0.smithi096.stdout:2/308: creat df/f64 x:0 0 0 2024-04-18T04:57:57.052 INFO:tasks.workunit.client.0.smithi096.stdout:7/188: dread db/f12 [0,4194304] 0 2024-04-18T04:57:57.053 INFO:tasks.workunit.client.0.smithi096.stdout:4/214: dwrite d4/d14/f31 [0,4194304] 0 2024-04-18T04:57:57.053 INFO:tasks.workunit.client.0.smithi096.stdout:6/313: write d0/d6/d2e/f35 [4285268,115628] 0 2024-04-18T04:57:57.053 INFO:tasks.workunit.client.0.smithi096.stdout:7/189: stat db/f12 0 2024-04-18T04:57:57.053 INFO:tasks.workunit.client.0.smithi096.stdout:0/254: creat d16/d1c/f51 x:0 0 0 2024-04-18T04:57:57.054 INFO:tasks.workunit.client.0.smithi096.stdout:6/314: truncate d0/d6/f37 1387580 0 2024-04-18T04:57:57.057 INFO:tasks.workunit.client.0.smithi096.stdout:6/315: write d0/d6/f37 [595436,127] 0 2024-04-18T04:57:57.057 INFO:tasks.workunit.client.0.smithi096.stdout:4/215: dread d4/d14/d1d/f27 [0,4194304] 0 2024-04-18T04:57:57.059 INFO:tasks.workunit.client.0.smithi096.stdout:2/309: creat df/f65 x:0 0 0 2024-04-18T04:57:57.061 INFO:tasks.workunit.client.0.smithi096.stdout:2/310: mknod df/d18/d26/c66 0 2024-04-18T04:57:57.062 INFO:tasks.workunit.client.0.smithi096.stdout:2/311: chown df/d18/d24/f3b 211127988 1 2024-04-18T04:57:57.065 INFO:tasks.workunit.client.0.smithi096.stdout:2/312: write df/d18/d26/d48/f4f [843900,62454] 0 2024-04-18T04:57:57.067 INFO:tasks.workunit.client.0.smithi096.stdout:6/316: dwrite d0/d2f/f3c [0,4194304] 0 2024-04-18T04:57:57.069 INFO:tasks.workunit.client.0.smithi096.stdout:7/190: write db/f12 [775953,102709] 0 2024-04-18T04:57:57.069 INFO:tasks.workunit.client.0.smithi096.stdout:6/317: read d0/d6/f1d [1942421,52807] 0 2024-04-18T04:57:57.071 INFO:tasks.workunit.client.0.smithi096.stdout:6/318: chown d0/d6/f34 28 1 2024-04-18T04:57:57.073 INFO:tasks.workunit.client.0.smithi096.stdout:0/255: truncate d16/f21 351611 0 2024-04-18T04:57:57.074 INFO:tasks.workunit.client.0.smithi096.stdout:2/313: fdatasync df/d18/d26/f29 0 2024-04-18T04:57:57.074 INFO:tasks.workunit.client.0.smithi096.stdout:0/256: chown d16/d1d 11657 1 2024-04-18T04:57:57.075 INFO:tasks.workunit.client.0.smithi096.stdout:7/191: dread db/f22 [0,4194304] 0 2024-04-18T04:57:57.076 INFO:tasks.workunit.client.0.smithi096.stdout:6/319: rename d0/c44 to d0/d6/d2b/d4c/c58 0 2024-04-18T04:57:57.076 INFO:tasks.workunit.client.0.smithi096.stdout:4/216: dread d4/d14/f2b [0,4194304] 0 2024-04-18T04:57:57.077 INFO:tasks.workunit.client.0.smithi096.stdout:4/217: write d4/d14/d16/f3f [194974,39536] 0 2024-04-18T04:57:57.079 INFO:tasks.workunit.client.0.smithi096.stdout:2/314: symlink df/d18/d24/d42/d3f/d4a/l67 0 2024-04-18T04:57:57.079 INFO:tasks.workunit.client.0.smithi096.stdout:2/315: readlink df/d18/d24/d42/l5d 0 2024-04-18T04:57:57.081 INFO:tasks.workunit.client.0.smithi096.stdout:4/218: fdatasync d4/f18 0 2024-04-18T04:57:57.083 INFO:tasks.workunit.client.0.smithi096.stdout:4/219: symlink d4/l49 0 2024-04-18T04:57:57.084 INFO:tasks.workunit.client.0.smithi096.stdout:4/220: dread - d4/d14/d16/f40 zero size 2024-04-18T04:57:57.084 INFO:tasks.workunit.client.0.smithi096.stdout:6/320: rename d0/d6/d2e/f22 to d0/f59 0 2024-04-18T04:57:57.085 INFO:tasks.workunit.client.0.smithi096.stdout:0/257: dread d16/f1a [0,4194304] 0 2024-04-18T04:57:57.085 INFO:tasks.workunit.client.0.smithi096.stdout:6/321: chown d0/d6/d2e/f35 372 1 2024-04-18T04:57:57.086 INFO:tasks.workunit.client.0.smithi096.stdout:6/322: chown d0/f33 37930496 1 2024-04-18T04:57:57.087 INFO:tasks.workunit.client.0.smithi096.stdout:6/323: write d0/d6/d2b/f4e [817731,46273] 0 2024-04-18T04:57:57.087 INFO:tasks.workunit.client.0.smithi096.stdout:4/221: link d4/d14/d1d/d29/f3b d4/d14/d1d/d29/d3a/d47/f4a 0 2024-04-18T04:57:57.091 INFO:tasks.workunit.client.0.smithi096.stdout:2/316: truncate df/d18/d26/d48/f4f 88368 0 2024-04-18T04:57:57.092 INFO:tasks.workunit.client.0.smithi096.stdout:0/258: truncate d16/d1d/f1e 2087438 0 2024-04-18T04:57:57.094 INFO:tasks.workunit.client.0.smithi096.stdout:0/259: unlink fe 0 2024-04-18T04:57:57.098 INFO:tasks.workunit.client.0.smithi096.stdout:0/260: mknod d16/d1c/d4c/d4e/c52 0 2024-04-18T04:57:57.098 INFO:tasks.workunit.client.0.smithi096.stdout:4/222: dwrite d4/d14/f2b [0,4194304] 0 2024-04-18T04:57:57.099 INFO:tasks.workunit.client.0.smithi096.stdout:4/223: dread - d4/f43 zero size 2024-04-18T04:57:57.100 INFO:tasks.workunit.client.0.smithi096.stdout:2/317: dwrite df/d18/f25 [0,4194304] 0 2024-04-18T04:57:57.102 INFO:tasks.workunit.client.0.smithi096.stdout:0/261: mknod d16/d1d/c53 0 2024-04-18T04:57:57.102 INFO:tasks.workunit.client.0.smithi096.stdout:6/324: dread d0/d6/f7 [0,4194304] 0 2024-04-18T04:57:57.103 INFO:tasks.workunit.client.0.smithi096.stdout:2/318: symlink df/d18/d24/d42/l68 0 2024-04-18T04:57:57.103 INFO:tasks.workunit.client.0.smithi096.stdout:4/224: mkdir d4/d14/d1d/d29/d3a/d47/d4b 0 2024-04-18T04:57:57.104 INFO:tasks.workunit.client.0.smithi096.stdout:6/325: read d0/d6/d29/f30 [1251306,28666] 0 2024-04-18T04:57:57.110 INFO:tasks.workunit.client.0.smithi096.stdout:2/319: getdents df/d18/d24/d42/d3f/d4a 0 2024-04-18T04:57:57.111 INFO:tasks.workunit.client.0.smithi096.stdout:0/262: dwrite d16/d1c/d4c/d4d/f49 [0,4194304] 0 2024-04-18T04:57:57.113 INFO:tasks.workunit.client.0.smithi096.stdout:6/326: getdents d0 0 2024-04-18T04:57:57.116 INFO:tasks.workunit.client.0.smithi096.stdout:0/263: dread d16/d1c/d22/f2e [0,4194304] 0 2024-04-18T04:57:57.119 INFO:tasks.workunit.client.0.smithi096.stdout:6/327: dread d0/d6/f20 [0,4194304] 0 2024-04-18T04:57:57.119 INFO:tasks.workunit.client.0.smithi096.stdout:6/328: readlink d0/l32 0 2024-04-18T04:57:57.120 INFO:tasks.workunit.client.0.smithi096.stdout:2/320: rmdir df/d18/d26/d48/d57 0 2024-04-18T04:57:57.123 INFO:tasks.workunit.client.0.smithi096.stdout:6/329: dread d0/d6/f15 [0,4194304] 0 2024-04-18T04:57:57.124 INFO:tasks.workunit.client.0.smithi096.stdout:2/321: creat df/f69 x:0 0 0 2024-04-18T04:57:57.125 INFO:tasks.workunit.client.0.smithi096.stdout:0/264: getdents d16/d1c/d22/d2c 0 2024-04-18T04:57:57.126 INFO:tasks.workunit.client.0.smithi096.stdout:6/330: truncate d0/d6/f1d 19896 0 2024-04-18T04:57:57.127 INFO:tasks.workunit.client.0.smithi096.stdout:0/265: symlink d16/d1c/d22/l54 0 2024-04-18T04:57:57.128 INFO:tasks.workunit.client.0.smithi096.stdout:2/322: rename df/d18/d24/c34 to df/d18/d24/c6a 0 2024-04-18T04:57:57.129 INFO:tasks.workunit.client.0.smithi096.stdout:0/266: mkdir d16/d55 0 2024-04-18T04:57:57.130 INFO:tasks.workunit.client.0.smithi096.stdout:4/225: dwrite d4/d14/d1d/d29/f3b [0,4194304] 0 2024-04-18T04:57:57.133 INFO:tasks.workunit.client.0.smithi096.stdout:0/267: unlink d16/d1d/f27 0 2024-04-18T04:57:57.134 INFO:tasks.workunit.client.0.smithi096.stdout:4/226: readlink d4/d14/d1d/d29/l3c 0 2024-04-18T04:57:57.135 INFO:tasks.workunit.client.0.smithi096.stdout:6/331: getdents d0/d6/d2e 0 2024-04-18T04:57:57.136 INFO:tasks.workunit.client.0.smithi096.stdout:0/268: truncate d16/d1c/f51 461002 0 2024-04-18T04:57:57.137 INFO:tasks.workunit.client.0.smithi096.stdout:4/227: creat d4/d14/d1d/d29/f4c x:0 0 0 2024-04-18T04:57:57.139 INFO:tasks.workunit.client.0.smithi096.stdout:2/323: getdents df/d18/d24 0 2024-04-18T04:57:57.140 INFO:tasks.workunit.client.0.smithi096.stdout:2/324: chown fe 1446263 1 2024-04-18T04:57:57.143 INFO:tasks.workunit.client.0.smithi096.stdout:0/269: link d16/f42 d16/d1c/f56 0 2024-04-18T04:57:57.144 INFO:tasks.workunit.client.0.smithi096.stdout:6/332: link d0/c3e d0/d6/d29/c5a 0 2024-04-18T04:57:57.146 INFO:tasks.workunit.client.0.smithi096.stdout:0/270: creat d16/d1c/d22/f57 x:0 0 0 2024-04-18T04:57:57.147 INFO:tasks.workunit.client.0.smithi096.stdout:2/325: dwrite df/d18/d24/d42/d3f/f5e [0,4194304] 0 2024-04-18T04:57:57.151 INFO:tasks.workunit.client.0.smithi096.stdout:2/326: mkdir df/d18/d26/d6b 0 2024-04-18T04:57:57.153 INFO:tasks.workunit.client.0.smithi096.stdout:6/333: dwrite d0/f33 [0,4194304] 0 2024-04-18T04:57:57.156 INFO:tasks.workunit.client.0.smithi096.stdout:0/271: dread d16/d1c/d4c/d4d/f49 [0,4194304] 0 2024-04-18T04:57:57.156 INFO:tasks.workunit.client.0.smithi096.stdout:2/327: chown df/d18/d24/d42/d3f/d4a/l67 8 1 2024-04-18T04:57:57.156 INFO:tasks.workunit.client.0.smithi096.stdout:2/328: write df/d18/f25 [5946009,107869] 0 2024-04-18T04:57:57.157 INFO:tasks.workunit.client.0.smithi096.stdout:0/272: chown d16/d1d/f1e 128501 1 2024-04-18T04:57:57.160 INFO:tasks.workunit.client.0.smithi096.stdout:2/329: truncate df/d18/d26/d48/f4f 847051 0 2024-04-18T04:57:57.162 INFO:tasks.workunit.client.0.smithi096.stdout:2/330: unlink df/d18/d24/f30 0 2024-04-18T04:57:57.163 INFO:tasks.workunit.client.0.smithi096.stdout:6/334: dread d0/d6/f24 [4194304,4194304] 0 2024-04-18T04:57:57.165 INFO:tasks.workunit.client.0.smithi096.stdout:6/335: write d0/d6/d2e/f35 [5359209,3061] 0 2024-04-18T04:57:57.166 INFO:tasks.workunit.client.0.smithi096.stdout:6/336: read d0/f33 [3375078,14424] 0 2024-04-18T04:57:57.167 INFO:tasks.workunit.client.0.smithi096.stdout:6/337: readlink d0/d6/d2b/l4d 0 2024-04-18T04:57:57.168 INFO:tasks.workunit.client.0.smithi096.stdout:0/273: dwrite d16/f40 [0,4194304] 0 2024-04-18T04:57:57.168 INFO:tasks.workunit.client.0.smithi096.stdout:0/274: chown d16/l45 2 1 2024-04-18T04:57:57.169 INFO:tasks.workunit.client.0.smithi096.stdout:0/275: chown d16/d1d/f34 15 1 2024-04-18T04:57:57.169 INFO:tasks.workunit.client.0.smithi096.stdout:2/331: rmdir df 39 2024-04-18T04:57:57.170 INFO:tasks.workunit.client.0.smithi096.stdout:6/338: creat d0/d6/d2b/d4c/f5b x:0 0 0 2024-04-18T04:57:57.171 INFO:tasks.workunit.client.0.smithi096.stdout:0/276: fsync d16/d1c/d4c/d4d/f49 0 2024-04-18T04:57:57.173 INFO:tasks.workunit.client.0.smithi096.stdout:2/332: symlink df/d18/d24/d42/l6c 0 2024-04-18T04:57:57.175 INFO:tasks.workunit.client.0.smithi096.stdout:2/333: symlink df/d18/l6d 0 2024-04-18T04:57:57.176 INFO:tasks.workunit.client.0.smithi096.stdout:0/277: dread d16/f40 [0,4194304] 0 2024-04-18T04:57:57.176 INFO:tasks.workunit.client.0.smithi096.stdout:6/339: creat d0/d6/d2b/f5c x:0 0 0 2024-04-18T04:57:57.176 INFO:tasks.workunit.client.0.smithi096.stdout:2/334: write df/f14 [463729,115898] 0 2024-04-18T04:57:57.177 INFO:tasks.workunit.client.0.smithi096.stdout:0/278: readlink l12 0 2024-04-18T04:57:57.177 INFO:tasks.workunit.client.0.smithi096.stdout:6/340: readlink d0/d6/d2e/l2a 0 2024-04-18T04:57:57.178 INFO:tasks.workunit.client.0.smithi096.stdout:6/341: chown d0/d6/d2b/d3b/c27 3313973 1 2024-04-18T04:57:57.178 INFO:tasks.workunit.client.0.smithi096.stdout:2/335: mkdir df/d18/d24/d42/d6e 0 2024-04-18T04:57:57.181 INFO:tasks.workunit.client.0.smithi096.stdout:0/279: getdents d16/d1c/d4c/d4d/d36 0 2024-04-18T04:57:57.181 INFO:tasks.workunit.client.0.smithi096.stdout:0/280: readlink d16/d1c/d22/l54 0 2024-04-18T04:57:57.182 INFO:tasks.workunit.client.0.smithi096.stdout:0/281: fsync ff 0 2024-04-18T04:57:57.182 INFO:tasks.workunit.client.0.smithi096.stdout:0/282: stat d16/f40 0 2024-04-18T04:57:57.186 INFO:tasks.workunit.client.0.smithi096.stdout:0/283: write d16/f1a [1238880,99181] 0 2024-04-18T04:57:57.188 INFO:tasks.workunit.client.0.smithi096.stdout:6/342: dwrite d0/d6/d29/f30 [0,4194304] 0 2024-04-18T04:57:57.192 INFO:tasks.workunit.client.0.smithi096.stdout:1/326: sync 2024-04-18T04:57:57.192 INFO:tasks.workunit.client.0.smithi096.stdout:5/147: sync 2024-04-18T04:57:57.193 INFO:tasks.workunit.client.0.smithi096.stdout:6/343: dread d0/d6/d29/f42 [0,4194304] 0 2024-04-18T04:57:57.194 INFO:tasks.workunit.client.0.smithi096.stdout:2/336: dread df/f20 [0,4194304] 0 2024-04-18T04:57:57.196 INFO:tasks.workunit.client.0.smithi096.stdout:2/337: rmdir df/d18/d26/d48 39 2024-04-18T04:57:57.197 INFO:tasks.workunit.client.0.smithi096.stdout:2/338: readlink df/d18/d24/d42/d3f/d4a/l60 0 2024-04-18T04:57:57.200 INFO:tasks.workunit.client.0.smithi096.stdout:1/327: truncate de/d1d/f25 3390976 0 2024-04-18T04:57:57.202 INFO:tasks.workunit.client.0.smithi096.stdout:1/328: fdatasync de/d1d/d3f/f45 0 2024-04-18T04:57:57.202 INFO:tasks.workunit.client.0.smithi096.stdout:6/344: dwrite d0/d6/d2b/f4e [0,4194304] 0 2024-04-18T04:57:57.203 INFO:tasks.workunit.client.0.smithi096.stdout:1/329: fdatasync de/d1d/d32/f44 0 2024-04-18T04:57:57.204 INFO:tasks.workunit.client.0.smithi096.stdout:1/330: fsync de/f29 0 2024-04-18T04:57:57.205 INFO:tasks.workunit.client.0.smithi096.stdout:2/339: dread df/d18/f25 [0,4194304] 0 2024-04-18T04:57:57.206 INFO:tasks.workunit.client.0.smithi096.stdout:1/331: chown de/d1d/d32/c51 0 1 2024-04-18T04:57:57.212 INFO:tasks.workunit.client.0.smithi096.stdout:0/284: dread fd [0,4194304] 0 2024-04-18T04:57:57.214 INFO:tasks.workunit.client.0.smithi096.stdout:1/332: dwrite de/f5e [0,4194304] 0 2024-04-18T04:57:57.225 INFO:tasks.workunit.client.0.smithi096.stdout:2/340: symlink df/d18/d24/l6f 0 2024-04-18T04:57:57.226 INFO:tasks.workunit.client.0.smithi096.stdout:5/148: dread d7/f17 [4194304,4194304] 0 2024-04-18T04:57:57.227 INFO:tasks.workunit.client.0.smithi096.stdout:1/333: dwrite de/d1d/f5d [0,4194304] 0 2024-04-18T04:57:57.227 INFO:tasks.workunit.client.0.smithi096.stdout:1/334: readlink de/d1d/l1f 0 2024-04-18T04:57:57.228 INFO:tasks.workunit.client.0.smithi096.stdout:1/335: truncate de/f59 4676787 0 2024-04-18T04:57:57.229 INFO:tasks.workunit.client.0.smithi096.stdout:0/285: creat d16/d1d/d3b/f58 x:0 0 0 2024-04-18T04:57:57.231 INFO:tasks.workunit.client.0.smithi096.stdout:5/149: mknod d7/d12/c3e 0 2024-04-18T04:57:57.232 INFO:tasks.workunit.client.0.smithi096.stdout:1/336: unlink de/d1d/d32/l41 0 2024-04-18T04:57:57.233 INFO:tasks.workunit.client.0.smithi096.stdout:2/341: creat df/d18/d26/d48/f70 x:0 0 0 2024-04-18T04:57:57.234 INFO:tasks.workunit.client.0.smithi096.stdout:0/286: dread d16/d1c/f3c [0,4194304] 0 2024-04-18T04:57:57.234 INFO:tasks.workunit.client.0.smithi096.stdout:2/342: chown df/f63 136 1 2024-04-18T04:57:57.235 INFO:tasks.workunit.client.0.smithi096.stdout:0/287: chown d16/d1d/c23 408218 1 2024-04-18T04:57:57.235 INFO:tasks.workunit.client.0.smithi096.stdout:0/288: chown l9 3483 1 2024-04-18T04:57:57.235 INFO:tasks.workunit.client.0.smithi096.stdout:5/150: creat d7/d39/f3f x:0 0 0 2024-04-18T04:57:57.236 INFO:tasks.workunit.client.0.smithi096.stdout:6/345: rmdir d0/d6 39 2024-04-18T04:57:57.237 INFO:tasks.workunit.client.0.smithi096.stdout:1/337: creat de/d1d/d3f/f61 x:0 0 0 2024-04-18T04:57:57.238 INFO:tasks.workunit.client.0.smithi096.stdout:1/338: fsync de/f5b 0 2024-04-18T04:57:57.239 INFO:tasks.workunit.client.0.smithi096.stdout:2/343: mkdir df/d18/d71 0 2024-04-18T04:57:57.240 INFO:tasks.workunit.client.0.smithi096.stdout:0/289: symlink d16/l59 0 2024-04-18T04:57:57.241 INFO:tasks.workunit.client.0.smithi096.stdout:0/290: fsync d16/d1c/f29 0 2024-04-18T04:57:57.243 INFO:tasks.workunit.client.0.smithi096.stdout:5/151: dwrite d7/d39/f3f [0,4194304] 0 2024-04-18T04:57:57.245 INFO:tasks.workunit.client.0.smithi096.stdout:2/344: rename df/d18/d26/c46 to df/d18/d24/d42/d3f/d4a/c72 0 2024-04-18T04:57:57.251 INFO:tasks.workunit.client.0.smithi096.stdout:5/152: mknod d7/dd/d35/c40 0 2024-04-18T04:57:57.252 INFO:tasks.workunit.client.0.smithi096.stdout:0/291: dwrite d16/d1c/d22/d2c/f30 [0,4194304] 0 2024-04-18T04:57:57.260 INFO:tasks.workunit.client.0.smithi096.stdout:0/292: mkdir d16/d1c/d4c/d4d/d5a 0 2024-04-18T04:57:57.261 INFO:tasks.workunit.client.0.smithi096.stdout:2/345: link df/d18/d24/d42/d3f/f4b df/f73 0 2024-04-18T04:57:57.262 INFO:tasks.workunit.client.0.smithi096.stdout:2/346: fsync f9 0 2024-04-18T04:57:57.263 INFO:tasks.workunit.client.0.smithi096.stdout:6/346: rename d0/d2f to d0/d6/d5d 0 2024-04-18T04:57:57.263 INFO:tasks.workunit.client.0.smithi096.stdout:0/293: mknod d16/d1c/d4c/d4e/c5b 0 2024-04-18T04:57:57.264 INFO:tasks.workunit.client.0.smithi096.stdout:0/294: chown d16/d1d/l31 20285046 1 2024-04-18T04:57:57.265 INFO:tasks.workunit.client.0.smithi096.stdout:2/347: write df/d18/f5f [572646,55846] 0 2024-04-18T04:57:57.266 INFO:tasks.workunit.client.0.smithi096.stdout:5/153: rename d7/d39/f3f to d7/d25/f41 0 2024-04-18T04:57:57.267 INFO:tasks.workunit.client.0.smithi096.stdout:6/347: write d0/d6/d29/f42 [2880422,63022] 0 2024-04-18T04:57:57.268 INFO:tasks.workunit.client.0.smithi096.stdout:6/348: chown d0/d6/d2b/d3b/c28 593 1 2024-04-18T04:57:57.269 INFO:tasks.workunit.client.0.smithi096.stdout:6/349: chown d0 66 1 2024-04-18T04:57:57.270 INFO:tasks.workunit.client.0.smithi096.stdout:2/348: write df/f14 [3248921,19902] 0 2024-04-18T04:57:57.273 INFO:tasks.workunit.client.0.smithi096.stdout:5/154: creat d7/f42 x:0 0 0 2024-04-18T04:57:57.275 INFO:tasks.workunit.client.0.smithi096.stdout:5/155: unlink d7/dd/d35/c40 0 2024-04-18T04:57:57.277 INFO:tasks.workunit.client.0.smithi096.stdout:6/350: rename d0/d4a/f51 to d0/d6/d2b/f5e 0 2024-04-18T04:57:57.277 INFO:tasks.workunit.client.0.smithi096.stdout:0/295: dread d16/d1d/f25 [0,4194304] 0 2024-04-18T04:57:57.277 INFO:tasks.workunit.client.0.smithi096.stdout:5/156: symlink d7/dd/d35/l43 0 2024-04-18T04:57:57.279 INFO:tasks.workunit.client.0.smithi096.stdout:5/157: write f4 [5760165,44729] 0 2024-04-18T04:57:57.279 INFO:tasks.workunit.client.0.smithi096.stdout:6/351: mknod d0/d6/d29/c5f 0 2024-04-18T04:57:57.280 INFO:tasks.workunit.client.0.smithi096.stdout:0/296: fdatasync d16/d1c/d4c/d4d/f49 0 2024-04-18T04:57:57.280 INFO:tasks.workunit.client.0.smithi096.stdout:2/349: dwrite df/d18/d26/f28 [0,4194304] 0 2024-04-18T04:57:57.282 INFO:tasks.workunit.client.0.smithi096.stdout:0/297: stat d16/d1c/d4c/f50 0 2024-04-18T04:57:57.282 INFO:tasks.workunit.client.0.smithi096.stdout:5/158: chown d7/d25/f27 1347107 1 2024-04-18T04:57:57.284 INFO:tasks.workunit.client.0.smithi096.stdout:2/350: unlink df/d18/f1d 0 2024-04-18T04:57:57.285 INFO:tasks.workunit.client.0.smithi096.stdout:1/339: dwrite de/f17 [0,4194304] 0 2024-04-18T04:57:57.286 INFO:tasks.workunit.client.0.smithi096.stdout:5/159: creat d7/d12/f44 x:0 0 0 2024-04-18T04:57:57.289 INFO:tasks.workunit.client.0.smithi096.stdout:0/298: dread d16/d1d/f25 [0,4194304] 0 2024-04-18T04:57:57.289 INFO:tasks.workunit.client.0.smithi096.stdout:6/352: read d0/d6/d2b/d3b/f41 [744306,53969] 0 2024-04-18T04:57:57.289 INFO:tasks.workunit.client.0.smithi096.stdout:1/340: creat de/d1d/d3f/f62 x:0 0 0 2024-04-18T04:57:57.290 INFO:tasks.workunit.client.0.smithi096.stdout:5/160: creat d7/d25/d2b/f45 x:0 0 0 2024-04-18T04:57:57.291 INFO:tasks.workunit.client.0.smithi096.stdout:5/161: readlink d7/dd/l1c 0 2024-04-18T04:57:57.292 INFO:tasks.workunit.client.0.smithi096.stdout:6/353: dread - d0/d6/f34 zero size 2024-04-18T04:57:57.293 INFO:tasks.workunit.client.0.smithi096.stdout:6/354: write d0/d6/f20 [1659592,35650] 0 2024-04-18T04:57:57.295 INFO:tasks.workunit.client.0.smithi096.stdout:0/299: mknod d16/d1c/d22/d2c/c5c 0 2024-04-18T04:57:57.295 INFO:tasks.workunit.client.0.smithi096.stdout:2/351: dwrite df/d18/d24/d42/d3f/d4a/f40 [0,4194304] 0 2024-04-18T04:57:57.297 INFO:tasks.workunit.client.0.smithi096.stdout:0/300: stat d16/d1c/d22/d2c 0 2024-04-18T04:57:57.298 INFO:tasks.workunit.client.0.smithi096.stdout:2/352: fdatasync df/d18/d26/f28 0 2024-04-18T04:57:57.302 INFO:tasks.workunit.client.0.smithi096.stdout:5/162: dwrite d7/d25/f28 [0,4194304] 0 2024-04-18T04:57:57.304 INFO:tasks.workunit.client.0.smithi096.stdout:2/353: creat df/d18/d24/f74 x:0 0 0 2024-04-18T04:57:57.307 INFO:tasks.workunit.client.0.smithi096.stdout:1/341: rmdir de 39 2024-04-18T04:57:57.310 INFO:tasks.workunit.client.0.smithi096.stdout:2/354: chown df/d18/d24/l31 43 1 2024-04-18T04:57:57.310 INFO:tasks.workunit.client.0.smithi096.stdout:6/355: dread d0/d6/d2b/d3b/f41 [0,4194304] 0 2024-04-18T04:57:57.312 INFO:tasks.workunit.client.0.smithi096.stdout:6/356: dread - d0/d6/d2e/f56 zero size 2024-04-18T04:57:57.312 INFO:tasks.workunit.client.0.smithi096.stdout:1/342: creat de/d1d/d3f/f63 x:0 0 0 2024-04-18T04:57:57.313 INFO:tasks.workunit.client.0.smithi096.stdout:1/343: chown de/d1d/d32/l3d 10984 1 2024-04-18T04:57:57.317 INFO:tasks.workunit.client.0.smithi096.stdout:0/301: dread d16/d1d/f34 [0,4194304] 0 2024-04-18T04:57:57.317 INFO:tasks.workunit.client.0.smithi096.stdout:1/344: link de/f5b de/d1d/d3f/d4f/f64 0 2024-04-18T04:57:57.318 INFO:tasks.workunit.client.0.smithi096.stdout:6/357: truncate d0/d6/d2e/f35 3948018 0 2024-04-18T04:57:57.320 INFO:tasks.workunit.client.0.smithi096.stdout:2/355: dwrite df/d18/d24/f2e [0,4194304] 0 2024-04-18T04:57:57.324 INFO:tasks.workunit.client.0.smithi096.stdout:2/356: chown c8 174711 1 2024-04-18T04:57:57.324 INFO:tasks.workunit.client.0.smithi096.stdout:5/163: dread d7/d39/f29 [0,4194304] 0 2024-04-18T04:57:57.325 INFO:tasks.workunit.client.0.smithi096.stdout:2/357: chown df/d18/d26/c2a 4853949 1 2024-04-18T04:57:57.327 INFO:tasks.workunit.client.0.smithi096.stdout:1/345: dwrite de/d1d/d3f/f45 [0,4194304] 0 2024-04-18T04:57:57.328 INFO:tasks.workunit.client.0.smithi096.stdout:1/346: dread - de/d1d/d3f/f63 zero size 2024-04-18T04:57:57.332 INFO:tasks.workunit.client.0.smithi096.stdout:2/358: mkdir df/d18/d71/d75 0 2024-04-18T04:57:57.335 INFO:tasks.workunit.client.0.smithi096.stdout:0/302: dwrite d16/d1c/f56 [4194304,4194304] 0 2024-04-18T04:57:57.336 INFO:tasks.workunit.client.0.smithi096.stdout:2/359: unlink df/d18/d24/f3b 0 2024-04-18T04:57:57.336 INFO:tasks.workunit.client.0.smithi096.stdout:6/358: dwrite d0/d6/f24 [0,4194304] 0 2024-04-18T04:57:57.340 INFO:tasks.workunit.client.0.smithi096.stdout:2/360: mknod df/d18/d24/d42/d6e/c76 0 2024-04-18T04:57:57.342 INFO:tasks.workunit.client.0.smithi096.stdout:6/359: dread d0/d6/d2b/f4e [0,4194304] 0 2024-04-18T04:57:57.342 INFO:tasks.workunit.client.0.smithi096.stdout:2/361: rmdir df 39 2024-04-18T04:57:57.347 INFO:tasks.workunit.client.0.smithi096.stdout:6/360: dread d0/f59 [0,4194304] 0 2024-04-18T04:57:57.355 INFO:tasks.workunit.client.0.smithi096.stdout:2/362: dwrite df/d18/f38 [0,4194304] 0 2024-04-18T04:57:57.357 INFO:tasks.workunit.client.0.smithi096.stdout:2/363: dread - df/d18/d26/d48/f49 zero size 2024-04-18T04:57:57.359 INFO:tasks.workunit.client.0.smithi096.stdout:2/364: creat df/d18/d24/f77 x:0 0 0 2024-04-18T04:57:57.359 INFO:tasks.workunit.client.0.smithi096.stdout:2/365: fdatasync f9 0 2024-04-18T04:57:57.360 INFO:tasks.workunit.client.0.smithi096.stdout:6/361: dwrite d0/d6/d2b/f5c [0,4194304] 0 2024-04-18T04:57:57.361 INFO:tasks.workunit.client.0.smithi096.stdout:0/303: dread d16/d1c/d22/f28 [0,4194304] 0 2024-04-18T04:57:57.367 INFO:tasks.workunit.client.0.smithi096.stdout:8/214: sync 2024-04-18T04:57:57.372 INFO:tasks.workunit.client.0.smithi096.stdout:6/362: dwrite d0/d6/d2e/f38 [0,4194304] 0 2024-04-18T04:57:57.373 INFO:tasks.workunit.client.0.smithi096.stdout:2/366: dwrite df/d18/d24/f74 [0,4194304] 0 2024-04-18T04:57:57.373 INFO:tasks.workunit.client.0.smithi096.stdout:0/304: dwrite d16/f19 [4194304,4194304] 0 2024-04-18T04:57:57.375 INFO:tasks.workunit.client.0.smithi096.stdout:2/367: rmdir df/d18/d24/d42/d6e 39 2024-04-18T04:57:57.377 INFO:tasks.workunit.client.0.smithi096.stdout:0/305: mkdir d16/d1c/d4c/d4d/d5d 0 2024-04-18T04:57:57.380 INFO:tasks.workunit.client.0.smithi096.stdout:8/215: dwrite d0/d7/f2a [4194304,4194304] 0 2024-04-18T04:57:57.384 INFO:tasks.workunit.client.0.smithi096.stdout:6/363: dwrite d0/d6/f37 [0,4194304] 0 2024-04-18T04:57:57.385 INFO:tasks.workunit.client.0.smithi096.stdout:8/216: getdents d0/d7/d24/d18/d27 0 2024-04-18T04:57:57.386 INFO:tasks.workunit.client.0.smithi096.stdout:6/364: write d0/f59 [2214865,36704] 0 2024-04-18T04:57:57.387 INFO:tasks.workunit.client.0.smithi096.stdout:6/365: dread - d0/d6/f34 zero size 2024-04-18T04:57:57.388 INFO:tasks.workunit.client.0.smithi096.stdout:6/366: chown d0/d6/d2b/d3b/l23 109482 1 2024-04-18T04:57:57.390 INFO:tasks.workunit.client.0.smithi096.stdout:6/367: symlink d0/d4a/l60 0 2024-04-18T04:57:57.392 INFO:tasks.workunit.client.0.smithi096.stdout:6/368: write d0/d6/f20 [3184977,11001] 0 2024-04-18T04:57:57.394 INFO:tasks.workunit.client.0.smithi096.stdout:6/369: write d0/f59 [2806651,126779] 0 2024-04-18T04:57:57.395 INFO:tasks.workunit.client.0.smithi096.stdout:8/217: dwrite d0/d3/f3e [0,4194304] 0 2024-04-18T04:57:57.397 INFO:tasks.workunit.client.0.smithi096.stdout:8/218: rmdir d0/d7/d24/d35 39 2024-04-18T04:57:57.397 INFO:tasks.workunit.client.0.smithi096.stdout:8/219: chown d0/d7/c2f 5599468 1 2024-04-18T04:57:57.399 INFO:tasks.workunit.client.0.smithi096.stdout:6/370: symlink d0/d6/d2b/d4c/l61 0 2024-04-18T04:57:57.400 INFO:tasks.workunit.client.0.smithi096.stdout:6/371: fdatasync d0/d6/d5d/f3c 0 2024-04-18T04:57:57.400 INFO:tasks.workunit.client.0.smithi096.stdout:8/220: mknod d0/d7/c47 0 2024-04-18T04:57:57.401 INFO:tasks.workunit.client.0.smithi096.stdout:6/372: chown d0/d6/d2b/d3b/c1b 422331 1 2024-04-18T04:57:57.404 INFO:tasks.workunit.client.0.smithi096.stdout:8/221: link d0/d3/f31 d0/d3/d32/f48 0 2024-04-18T04:57:57.407 INFO:tasks.workunit.client.0.smithi096.stdout:6/373: rename d0/d6/d29/c53 to d0/c62 0 2024-04-18T04:57:57.410 INFO:tasks.workunit.client.0.smithi096.stdout:6/374: unlink d0/c21 0 2024-04-18T04:57:57.548 INFO:tasks.workunit.client.0.smithi096.stdout:9/209: sync 2024-04-18T04:57:57.548 INFO:tasks.workunit.client.0.smithi096.stdout:3/164: sync 2024-04-18T04:57:57.549 INFO:tasks.workunit.client.0.smithi096.stdout:3/165: readlink dc/d28/d29/l2e 0 2024-04-18T04:57:57.550 INFO:tasks.workunit.client.0.smithi096.stdout:9/210: rmdir d0/d25/d33 39 2024-04-18T04:57:57.552 INFO:tasks.workunit.client.0.smithi096.stdout:9/211: write d0/f11 [4167109,37949] 0 2024-04-18T04:57:57.573 INFO:tasks.workunit.client.0.smithi096.stdout:9/212: truncate d0/de/d17/d2f/d40/f34 1190777 0 2024-04-18T04:57:57.575 INFO:tasks.workunit.client.0.smithi096.stdout:3/166: dread dc/fe [4194304,4194304] 0 2024-04-18T04:57:57.585 INFO:tasks.workunit.client.0.smithi096.stdout:3/167: dwrite fa [0,4194304] 0 2024-04-18T04:57:57.588 INFO:tasks.workunit.client.0.smithi096.stdout:9/213: truncate d0/d25/f2e 1077054 0 2024-04-18T04:57:57.589 INFO:tasks.workunit.client.0.smithi096.stdout:9/214: write d0/de/d17/f3f [730577,11160] 0 2024-04-18T04:57:57.592 INFO:tasks.workunit.client.0.smithi096.stdout:3/168: rename dc/l21 to dc/d26/l34 0 2024-04-18T04:57:57.593 INFO:tasks.workunit.client.0.smithi096.stdout:3/169: chown dc/d28/d29/l2e 33 1 2024-04-18T04:57:57.594 INFO:tasks.workunit.client.0.smithi096.stdout:3/170: write f2 [24866,115743] 0 2024-04-18T04:57:57.595 INFO:tasks.workunit.client.0.smithi096.stdout:3/171: fdatasync dc/f1b 0 2024-04-18T04:57:57.596 INFO:tasks.workunit.client.0.smithi096.stdout:3/172: write dc/f12 [1262954,48664] 0 2024-04-18T04:57:57.598 INFO:tasks.workunit.client.0.smithi096.stdout:3/173: read dc/f20 [195239,126446] 0 2024-04-18T04:57:57.604 INFO:tasks.workunit.client.0.smithi096.stdout:3/174: dread f2 [0,4194304] 0 2024-04-18T04:57:57.605 INFO:tasks.workunit.client.0.smithi096.stdout:3/175: chown dc/f1d 0 1 2024-04-18T04:57:57.609 INFO:tasks.workunit.client.0.smithi096.stdout:3/176: dread dc/f20 [0,4194304] 0 2024-04-18T04:57:57.611 INFO:tasks.workunit.client.0.smithi096.stdout:3/177: mkdir dc/d26/d35 0 2024-04-18T04:57:57.614 INFO:tasks.workunit.client.0.smithi096.stdout:3/178: getdents dc/d26/d35 0 2024-04-18T04:57:57.617 INFO:tasks.workunit.client.0.smithi096.stdout:3/179: mkdir dc/d26/d35/d36 0 2024-04-18T04:57:57.631 INFO:tasks.workunit.client.0.smithi096.stdout:3/180: dwrite dc/f22 [8388608,4194304] 0 2024-04-18T04:57:57.635 INFO:tasks.workunit.client.0.smithi096.stdout:3/181: mknod dc/d28/c37 0 2024-04-18T04:57:57.636 INFO:tasks.workunit.client.0.smithi096.stdout:3/182: chown dc/c11 327 1 2024-04-18T04:57:57.640 INFO:tasks.workunit.client.0.smithi096.stdout:3/183: symlink dc/d28/l38 0 2024-04-18T04:57:57.641 INFO:tasks.workunit.client.0.smithi096.stdout:3/184: readlink dc/d28/d29/l2e 0 2024-04-18T04:57:57.644 INFO:tasks.workunit.client.0.smithi096.stdout:3/185: chown l4 14 1 2024-04-18T04:57:57.656 INFO:tasks.workunit.client.0.smithi096.stdout:3/186: dwrite dc/d28/f33 [0,4194304] 0 2024-04-18T04:57:57.658 INFO:tasks.workunit.client.0.smithi096.stdout:3/187: read fa [2763923,94377] 0 2024-04-18T04:57:57.666 INFO:tasks.workunit.client.0.smithi096.stdout:7/192: sync 2024-04-18T04:57:57.669 INFO:tasks.workunit.client.0.smithi096.stdout:7/193: creat db/f3a x:0 0 0 2024-04-18T04:57:57.673 INFO:tasks.workunit.client.0.smithi096.stdout:7/194: rmdir db/d20/d2f 39 2024-04-18T04:57:57.673 INFO:tasks.workunit.client.0.smithi096.stdout:7/195: chown db/f15 20014 1 2024-04-18T04:57:57.675 INFO:tasks.workunit.client.0.smithi096.stdout:7/196: chown db/f1b 820227 1 2024-04-18T04:57:57.675 INFO:tasks.workunit.client.0.smithi096.stdout:3/188: dwrite f2 [4194304,4194304] 0 2024-04-18T04:57:57.677 INFO:tasks.workunit.client.0.smithi096.stdout:3/189: dread dc/f20 [0,4194304] 0 2024-04-18T04:57:57.678 INFO:tasks.workunit.client.0.smithi096.stdout:7/197: fdatasync db/f22 0 2024-04-18T04:57:57.682 INFO:tasks.workunit.client.0.smithi096.stdout:3/190: creat dc/f39 x:0 0 0 2024-04-18T04:57:57.698 INFO:tasks.workunit.client.0.smithi096.stdout:7/198: dwrite db/d20/d2f/f37 [0,4194304] 0 2024-04-18T04:57:57.701 INFO:tasks.workunit.client.0.smithi096.stdout:7/199: creat db/d1f/d24/f3b x:0 0 0 2024-04-18T04:57:57.710 INFO:tasks.workunit.client.0.smithi096.stdout:7/200: rename db/d1f/c29 to db/d20/c3c 0 2024-04-18T04:57:57.710 INFO:tasks.workunit.client.0.smithi096.stdout:7/201: read - db/d1d/f21 zero size 2024-04-18T04:57:57.713 INFO:tasks.workunit.client.0.smithi096.stdout:7/202: symlink db/l3d 0 2024-04-18T04:57:57.715 INFO:tasks.workunit.client.0.smithi096.stdout:7/203: mknod db/d1d/c3e 0 2024-04-18T04:57:57.717 INFO:tasks.workunit.client.0.smithi096.stdout:7/204: creat db/f3f x:0 0 0 2024-04-18T04:57:57.721 INFO:tasks.workunit.client.0.smithi096.stdout:7/205: creat db/d1f/f40 x:0 0 0 2024-04-18T04:57:57.726 INFO:tasks.workunit.client.0.smithi096.stdout:7/206: rename db/f1b to db/d1f/f41 0 2024-04-18T04:57:57.730 INFO:tasks.workunit.client.0.smithi096.stdout:7/207: mkdir db/d1f/d42 0 2024-04-18T04:57:57.730 INFO:tasks.workunit.client.0.smithi096.stdout:7/208: fsync fa 0 2024-04-18T04:57:57.731 INFO:tasks.workunit.client.0.smithi096.stdout:7/209: chown db/c1c 3916144 1 2024-04-18T04:57:57.734 INFO:tasks.workunit.client.0.smithi096.stdout:7/210: symlink db/d1f/d42/l43 0 2024-04-18T04:57:57.738 INFO:tasks.workunit.client.0.smithi096.stdout:7/211: creat db/d1d/f44 x:0 0 0 2024-04-18T04:57:57.739 INFO:tasks.workunit.client.0.smithi096.stdout:7/212: write db/f12 [999658,275] 0 2024-04-18T04:57:57.743 INFO:tasks.workunit.client.0.smithi096.stdout:7/213: mkdir db/d20/d45 0 2024-04-18T04:57:57.744 INFO:tasks.workunit.client.0.smithi096.stdout:7/214: write db/f31 [709882,55422] 0 2024-04-18T04:57:57.748 INFO:tasks.workunit.client.0.smithi096.stdout:7/215: mknod db/d20/d2f/c46 0 2024-04-18T04:57:57.755 INFO:tasks.workunit.client.0.smithi096.stdout:7/216: chown db/d1f/f41 4584 1 2024-04-18T04:57:57.759 INFO:tasks.workunit.client.0.smithi096.stdout:7/217: creat db/d1d/f47 x:0 0 0 2024-04-18T04:57:57.766 INFO:tasks.workunit.client.0.smithi096.stdout:7/218: link f7 db/f48 0 2024-04-18T04:57:57.771 INFO:tasks.workunit.client.0.smithi096.stdout:7/219: rmdir db/d1f/d24 39 2024-04-18T04:57:57.775 INFO:tasks.workunit.client.0.smithi096.stdout:7/220: mkdir db/d1f/d24/d49 0 2024-04-18T04:57:57.775 INFO:tasks.workunit.client.0.smithi096.stdout:4/228: sync 2024-04-18T04:57:57.775 INFO:tasks.workunit.client.0.smithi096.stdout:5/164: sync 2024-04-18T04:57:57.775 INFO:tasks.workunit.client.0.smithi096.stdout:7/221: dread - db/f3a zero size 2024-04-18T04:57:57.777 INFO:tasks.workunit.client.0.smithi096.stdout:4/229: truncate d4/f43 821508 0 2024-04-18T04:57:57.778 INFO:tasks.workunit.client.0.smithi096.stdout:4/230: dread - d4/d14/d16/f40 zero size 2024-04-18T04:57:57.782 INFO:tasks.workunit.client.0.smithi096.stdout:4/231: mkdir d4/d14/d1d/d29/d3a/d4d 0 2024-04-18T04:57:57.783 INFO:tasks.workunit.client.0.smithi096.stdout:5/165: dread d7/d39/f29 [0,4194304] 0 2024-04-18T04:57:57.789 INFO:tasks.workunit.client.0.smithi096.stdout:7/222: dwrite db/f11 [4194304,4194304] 0 2024-04-18T04:57:57.795 INFO:tasks.workunit.client.0.smithi096.stdout:4/232: dwrite d4/d14/d16/f32 [0,4194304] 0 2024-04-18T04:57:57.801 INFO:tasks.workunit.client.0.smithi096.stdout:4/233: symlink d4/d14/d1d/d29/d3a/d47/d4b/l4e 0 2024-04-18T04:57:57.801 INFO:tasks.workunit.client.0.smithi096.stdout:7/223: write db/fe [3268483,42347] 0 2024-04-18T04:57:57.802 INFO:tasks.workunit.client.0.smithi096.stdout:4/234: chown d4/d14/c42 3164 1 2024-04-18T04:57:57.803 INFO:tasks.workunit.client.0.smithi096.stdout:4/235: chown d4/c8 2055 1 2024-04-18T04:57:57.804 INFO:tasks.workunit.client.0.smithi096.stdout:7/224: creat db/d1d/f4a x:0 0 0 2024-04-18T04:57:57.806 INFO:tasks.workunit.client.0.smithi096.stdout:4/236: chown d4/d14/d1d/c1f 135650781 1 2024-04-18T04:57:57.808 INFO:tasks.workunit.client.0.smithi096.stdout:5/166: dwrite d7/d12/f2d [0,4194304] 0 2024-04-18T04:57:57.812 INFO:tasks.workunit.client.0.smithi096.stdout:7/225: mknod db/c4b 0 2024-04-18T04:57:57.812 INFO:tasks.workunit.client.0.smithi096.stdout:4/237: mknod d4/d14/d16/c4f 0 2024-04-18T04:57:57.813 INFO:tasks.workunit.client.0.smithi096.stdout:2/368: sync 2024-04-18T04:57:57.813 INFO:tasks.workunit.client.0.smithi096.stdout:8/222: sync 2024-04-18T04:57:57.813 INFO:tasks.workunit.client.0.smithi096.stdout:9/215: sync 2024-04-18T04:57:57.813 INFO:tasks.workunit.client.0.smithi096.stdout:1/347: sync 2024-04-18T04:57:57.813 INFO:tasks.workunit.client.0.smithi096.stdout:0/306: sync 2024-04-18T04:57:57.813 INFO:tasks.workunit.client.0.smithi096.stdout:6/375: sync 2024-04-18T04:57:57.814 INFO:tasks.workunit.client.0.smithi096.stdout:7/226: fsync db/d1d/f21 0 2024-04-18T04:57:57.816 INFO:tasks.workunit.client.0.smithi096.stdout:4/238: write d4/d14/d16/f3f [703355,117504] 0 2024-04-18T04:57:57.817 INFO:tasks.workunit.client.0.smithi096.stdout:2/369: chown df/d18/d26/f4c 3150177 1 2024-04-18T04:57:57.820 INFO:tasks.workunit.client.0.smithi096.stdout:5/167: creat d7/f46 x:0 0 0 2024-04-18T04:57:57.820 INFO:tasks.workunit.client.0.smithi096.stdout:6/376: mknod d0/d6/d2b/d4c/c63 0 2024-04-18T04:57:57.822 INFO:tasks.workunit.client.0.smithi096.stdout:2/370: creat df/d18/d26/d48/f78 x:0 0 0 2024-04-18T04:57:57.822 INFO:tasks.workunit.client.0.smithi096.stdout:4/239: truncate d4/f19 392803 0 2024-04-18T04:57:57.826 INFO:tasks.workunit.client.0.smithi096.stdout:2/371: write df/f14 [3432047,48071] 0 2024-04-18T04:57:57.829 INFO:tasks.workunit.client.0.smithi096.stdout:0/307: creat d16/d1c/d22/d3a/f5e x:0 0 0 2024-04-18T04:57:57.830 INFO:tasks.workunit.client.0.smithi096.stdout:8/223: rename d0/d3/l3f to d0/l49 0 2024-04-18T04:57:57.832 INFO:tasks.workunit.client.0.smithi096.stdout:7/227: dwrite db/f11 [4194304,4194304] 0 2024-04-18T04:57:57.834 INFO:tasks.workunit.client.0.smithi096.stdout:9/216: dwrite d0/d25/d3a/f4a [0,4194304] 0 2024-04-18T04:57:57.835 INFO:tasks.workunit.client.0.smithi096.stdout:1/348: dwrite de/d1d/f52 [0,4194304] 0 2024-04-18T04:57:57.839 INFO:tasks.workunit.client.0.smithi096.stdout:5/168: dwrite d7/d39/f20 [0,4194304] 0 2024-04-18T04:57:57.839 INFO:tasks.workunit.client.0.smithi096.stdout:7/228: read db/d1f/d24/f2e [3109628,20313] 0 2024-04-18T04:57:57.840 INFO:tasks.workunit.client.0.smithi096.stdout:9/217: truncate d0/d25/f35 542746 0 2024-04-18T04:57:57.847 INFO:tasks.workunit.client.0.smithi096.stdout:0/308: rename d16/d1c/d4c/d4d/f49 to d16/d55/f5f 0 2024-04-18T04:57:57.848 INFO:tasks.workunit.client.0.smithi096.stdout:6/377: truncate d0/d6/d2b/f4e 501086 0 2024-04-18T04:57:57.851 INFO:tasks.workunit.client.0.smithi096.stdout:1/349: creat de/d1d/f65 x:0 0 0 2024-04-18T04:57:57.852 INFO:tasks.workunit.client.0.smithi096.stdout:9/218: dwrite d0/de/d17/f2a [0,4194304] 0 2024-04-18T04:57:57.852 INFO:tasks.workunit.client.0.smithi096.stdout:8/224: dwrite d0/d7/d24/f1f [0,4194304] 0 2024-04-18T04:57:57.853 INFO:tasks.workunit.client.0.smithi096.stdout:9/219: write d0/de/f19 [1706512,98651] 0 2024-04-18T04:57:57.856 INFO:tasks.workunit.client.0.smithi096.stdout:5/169: mknod d7/dd/c47 0 2024-04-18T04:57:57.856 INFO:tasks.workunit.client.0.smithi096.stdout:4/240: rmdir d4/d14/d1d/d29/d3a/d39/d3d 0 2024-04-18T04:57:57.856 INFO:tasks.workunit.client.0.smithi096.stdout:2/372: link df/c1e df/c79 0 2024-04-18T04:57:57.857 INFO:tasks.workunit.client.0.smithi096.stdout:0/309: fdatasync d16/d1c/d22/d2c/f4b 0 2024-04-18T04:57:57.858 INFO:tasks.workunit.client.0.smithi096.stdout:0/310: stat d16/c20 0 2024-04-18T04:57:57.860 INFO:tasks.workunit.client.0.smithi096.stdout:0/311: truncate d16/d1d/d3b/f46 4513513 0 2024-04-18T04:57:57.862 INFO:tasks.workunit.client.0.smithi096.stdout:7/229: mknod db/d1f/c4c 0 2024-04-18T04:57:57.864 INFO:tasks.workunit.client.0.smithi096.stdout:6/378: symlink d0/d6/d2b/l64 0 2024-04-18T04:57:57.864 INFO:tasks.workunit.client.0.smithi096.stdout:4/241: dread d4/d14/d1d/f27 [0,4194304] 0 2024-04-18T04:57:57.865 INFO:tasks.workunit.client.0.smithi096.stdout:7/230: stat db/d1f/d24/f2e 0 2024-04-18T04:57:57.866 INFO:tasks.workunit.client.0.smithi096.stdout:0/312: write d16/d1d/d3b/f46 [2101720,74380] 0 2024-04-18T04:57:57.866 INFO:tasks.workunit.client.0.smithi096.stdout:4/242: write d4/f24 [6135851,85084] 0 2024-04-18T04:57:57.869 INFO:tasks.workunit.client.0.smithi096.stdout:3/191: sync 2024-04-18T04:57:57.870 INFO:tasks.workunit.client.0.smithi096.stdout:7/231: chown db/d20/d2f/f37 490440 1 2024-04-18T04:57:57.870 INFO:tasks.workunit.client.0.smithi096.stdout:2/373: dwrite df/d18/d26/f4d [0,4194304] 0 2024-04-18T04:57:57.871 INFO:tasks.workunit.client.0.smithi096.stdout:9/220: link d0/d25/l3b d0/de/l4c 0 2024-04-18T04:57:57.872 INFO:tasks.workunit.client.0.smithi096.stdout:2/374: fsync df/d18/d24/f45 0 2024-04-18T04:57:57.872 INFO:tasks.workunit.client.0.smithi096.stdout:5/170: rename d7/c32 to d7/c48 0 2024-04-18T04:57:57.872 INFO:tasks.workunit.client.0.smithi096.stdout:2/375: dread - df/f73 zero size 2024-04-18T04:57:57.877 INFO:tasks.workunit.client.0.smithi096.stdout:4/243: rename d4/l2f to d4/d14/d1d/d29/d3a/d47/d4b/l50 0 2024-04-18T04:57:57.878 INFO:tasks.workunit.client.0.smithi096.stdout:7/232: mknod db/c4d 0 2024-04-18T04:57:57.879 INFO:tasks.workunit.client.0.smithi096.stdout:8/225: write d0/d7/d24/f22 [386440,93776] 0 2024-04-18T04:57:57.882 INFO:tasks.workunit.client.0.smithi096.stdout:7/233: write db/ff [4582011,58061] 0 2024-04-18T04:57:57.886 INFO:tasks.workunit.client.0.smithi096.stdout:3/192: rmdir dc/d26/d35/d36 0 2024-04-18T04:57:57.886 INFO:tasks.workunit.client.0.smithi096.stdout:7/234: chown db/f12 417073 1 2024-04-18T04:57:57.887 INFO:tasks.workunit.client.0.smithi096.stdout:5/171: dwrite d7/d12/f44 [0,4194304] 0 2024-04-18T04:57:57.889 INFO:tasks.workunit.client.0.smithi096.stdout:6/379: link d0/d6/d2b/d3b/c28 d0/d6/d2b/c65 0 2024-04-18T04:57:57.890 INFO:tasks.workunit.client.0.smithi096.stdout:1/350: dwrite fa [0,4194304] 0 2024-04-18T04:57:57.890 INFO:tasks.workunit.client.0.smithi096.stdout:4/244: truncate d4/f18 1169012 0 2024-04-18T04:57:57.892 INFO:tasks.workunit.client.0.smithi096.stdout:2/376: dwrite df/d18/d26/f28 [0,4194304] 0 2024-04-18T04:57:57.894 INFO:tasks.workunit.client.0.smithi096.stdout:1/351: dread - de/d1d/d3f/f62 zero size 2024-04-18T04:57:57.897 INFO:tasks.workunit.client.0.smithi096.stdout:8/226: creat d0/d7/d24/d35/f4a x:0 0 0 2024-04-18T04:57:57.897 INFO:tasks.workunit.client.0.smithi096.stdout:3/193: rename l4 to dc/d28/d29/l3a 0 2024-04-18T04:57:57.898 INFO:tasks.workunit.client.0.smithi096.stdout:5/172: creat d7/d25/d2b/f49 x:0 0 0 2024-04-18T04:57:57.899 INFO:tasks.workunit.client.0.smithi096.stdout:7/235: mkdir db/d1f/d4e 0 2024-04-18T04:57:57.899 INFO:tasks.workunit.client.0.smithi096.stdout:4/245: truncate d4/d14/d1d/f27 1880190 0 2024-04-18T04:57:57.900 INFO:tasks.workunit.client.0.smithi096.stdout:6/380: mkdir d0/d6/d2b/d4c/d66 0 2024-04-18T04:57:57.900 INFO:tasks.workunit.client.0.smithi096.stdout:3/194: stat dc/f1d 0 2024-04-18T04:57:57.901 INFO:tasks.workunit.client.0.smithi096.stdout:1/352: rename de/f17 to de/d1d/f66 0 2024-04-18T04:57:57.902 INFO:tasks.workunit.client.0.smithi096.stdout:8/227: rmdir d0/d7/d24/d18 39 2024-04-18T04:57:57.903 INFO:tasks.workunit.client.0.smithi096.stdout:5/173: mknod d7/d12/c4a 0 2024-04-18T04:57:57.906 INFO:tasks.workunit.client.0.smithi096.stdout:8/228: readlink d0/d7/d24/l2c 0 2024-04-18T04:57:57.908 INFO:tasks.workunit.client.0.smithi096.stdout:5/174: fsync d7/f46 0 2024-04-18T04:57:57.908 INFO:tasks.workunit.client.0.smithi096.stdout:3/195: rename dc/d28/d29/l2e to dc/l3b 0 2024-04-18T04:57:57.910 INFO:tasks.workunit.client.0.smithi096.stdout:9/221: dwrite d0/d25/f3c [0,4194304] 0 2024-04-18T04:57:57.910 INFO:tasks.workunit.client.0.smithi096.stdout:7/236: mknod db/d1f/d4e/c4f 0 2024-04-18T04:57:57.911 INFO:tasks.workunit.client.0.smithi096.stdout:2/377: dwrite df/d18/d26/d48/f70 [0,4194304] 0 2024-04-18T04:57:57.913 INFO:tasks.workunit.client.0.smithi096.stdout:6/381: creat d0/f67 x:0 0 0 2024-04-18T04:57:57.915 INFO:tasks.workunit.client.0.smithi096.stdout:7/237: readlink db/d1f/l2b 0 2024-04-18T04:57:57.916 INFO:tasks.workunit.client.0.smithi096.stdout:5/175: creat d7/d25/d30/f4b x:0 0 0 2024-04-18T04:57:57.918 INFO:tasks.workunit.client.0.smithi096.stdout:6/382: write d0/d6/d2b/f5c [2968167,45907] 0 2024-04-18T04:57:57.919 INFO:tasks.workunit.client.0.smithi096.stdout:1/353: dread de/d1d/f52 [0,4194304] 0 2024-04-18T04:57:57.920 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:57:57.921 INFO:tasks.workunit.client.0.smithi096.stdout:5/176: chown d7/d39/c34 30 1 2024-04-18T04:57:57.921 INFO:tasks.workunit.client.0.smithi096.stdout:6/383: chown d0/f67 419750 1 2024-04-18T04:57:57.922 INFO:tasks.workunit.client.0.smithi096.stdout:5/177: chown d7/d39 6873 1 2024-04-18T04:57:57.923 INFO:tasks.workunit.client.0.smithi096.stdout:9/222: rename d0/l27 to d0/l4d 0 2024-04-18T04:57:57.923 INFO:tasks.workunit.client.0.smithi096.stdout:3/196: dwrite dc/f10 [0,4194304] 0 2024-04-18T04:57:57.924 INFO:tasks.workunit.client.0.smithi096.stdout:5/178: dread - d7/d25/d2b/f49 zero size 2024-04-18T04:57:57.924 INFO:tasks.workunit.client.0.smithi096.stdout:3/197: stat f3 0 2024-04-18T04:57:57.925 INFO:tasks.workunit.client.0.smithi096.stdout:3/198: readlink l5 0 2024-04-18T04:57:57.925 INFO:tasks.workunit.client.0.smithi096.stdout:2/378: rename df/d18/d26/d6b to df/d7a 0 2024-04-18T04:57:57.926 INFO:tasks.workunit.client.0.smithi096.stdout:5/179: chown d7/l14 40352 1 2024-04-18T04:57:57.927 INFO:tasks.workunit.client.0.smithi096.stdout:1/354: dread de/d1d/d32/f46 [0,4194304] 0 2024-04-18T04:57:57.929 INFO:tasks.workunit.client.0.smithi096.stdout:7/238: getdents db/d20 0 2024-04-18T04:57:57.931 INFO:tasks.workunit.client.0.smithi096.stdout:4/246: dread d4/d14/d1d/d29/d3a/d47/f4a [0,4194304] 0 2024-04-18T04:57:57.931 INFO:tasks.workunit.client.0.smithi096.stdout:1/355: fsync de/d1d/d3f/f62 0 2024-04-18T04:57:57.931 INFO:tasks.workunit.client.0.smithi096.stdout:2/379: readlink df/d18/d24/d42/l68 0 2024-04-18T04:57:57.931 INFO:tasks.workunit.client.0.smithi096.stdout:8/229: dread d0/d7/d24/f34 [0,4194304] 0 2024-04-18T04:57:57.933 INFO:tasks.workunit.client.0.smithi096.stdout:2/380: write f9 [3818057,12349] 0 2024-04-18T04:57:57.933 INFO:tasks.workunit.client.0.smithi096.stdout:7/239: stat db/cd 0 2024-04-18T04:57:57.934 INFO:tasks.workunit.client.0.smithi096.stdout:6/384: dread d0/d6/d2b/f5c [0,4194304] 0 2024-04-18T04:57:57.934 INFO:tasks.workunit.client.0.smithi096.stdout:5/180: creat d7/f4c x:0 0 0 2024-04-18T04:57:57.937 INFO:tasks.workunit.client.0.smithi096.stdout:7/240: readlink db/d20/l23 0 2024-04-18T04:57:57.940 INFO:tasks.workunit.client.0.smithi096.stdout:1/356: mkdir de/d1d/d3f/d4f/d67 0 2024-04-18T04:57:57.940 INFO:tasks.workunit.client.0.smithi096.stdout:5/181: write d7/d39/f29 [3160850,57502] 0 2024-04-18T04:57:57.942 INFO:tasks.workunit.client.0.smithi096.stdout:7/241: rmdir db/d1f 39 2024-04-18T04:57:57.943 INFO:tasks.workunit.client.0.smithi096.stdout:8/230: write d0/d3/d32/f48 [1199210,87970] 0 2024-04-18T04:57:57.944 INFO:tasks.workunit.client.0.smithi096.stdout:3/199: dwrite dc/f24 [0,4194304] 0 2024-04-18T04:57:57.944 INFO:tasks.workunit.client.0.smithi096.stdout:9/223: dread d0/d25/f2e [0,4194304] 0 2024-04-18T04:57:57.948 INFO:tasks.workunit.client.0.smithi096.stdout:1/357: mknod de/c68 0 2024-04-18T04:57:57.950 INFO:tasks.workunit.client.0.smithi096.stdout:5/182: creat d7/d25/f4d x:0 0 0 2024-04-18T04:57:57.951 INFO:tasks.workunit.client.0.smithi096.stdout:3/200: mknod dc/d28/d29/c3c 0 2024-04-18T04:57:57.953 INFO:tasks.workunit.client.0.smithi096.stdout:3/201: readlink l5 0 2024-04-18T04:57:57.954 INFO:tasks.workunit.client.0.smithi096.stdout:9/224: dread d0/d25/f35 [0,4194304] 0 2024-04-18T04:57:57.954 INFO:tasks.workunit.client.0.smithi096.stdout:5/183: write d7/f4c [571636,9898] 0 2024-04-18T04:57:57.957 INFO:tasks.workunit.client.0.smithi096.stdout:4/247: dwrite d4/d14/d1d/d29/f3b [0,4194304] 0 2024-04-18T04:57:57.957 INFO:tasks.workunit.client.0.smithi096.stdout:1/358: creat de/d1d/d32/f69 x:0 0 0 2024-04-18T04:57:57.960 INFO:tasks.workunit.client.0.smithi096.stdout:7/242: rename db/d1f/c36 to db/d20/d45/c50 0 2024-04-18T04:57:57.961 INFO:tasks.workunit.client.0.smithi096.stdout:2/381: dwrite df/d18/d24/f3e [0,4194304] 0 2024-04-18T04:57:57.965 INFO:tasks.workunit.client.0.smithi096.stdout:6/385: dwrite d0/d6/d2b/d3b/f41 [0,4194304] 0 2024-04-18T04:57:57.965 INFO:tasks.workunit.client.0.smithi096.stdout:7/243: rmdir db/d1f 39 2024-04-18T04:57:57.966 INFO:tasks.workunit.client.0.smithi096.stdout:9/225: write d0/de/d17/d2f/f42 [548395,59128] 0 2024-04-18T04:57:57.968 INFO:tasks.workunit.client.0.smithi096.stdout:8/231: dwrite d0/d7/f2b [0,4194304] 0 2024-04-18T04:57:57.972 INFO:tasks.workunit.client.0.smithi096.stdout:2/382: chown df/d18/d24/d42/d3f/l44 11 1 2024-04-18T04:57:57.973 INFO:tasks.workunit.client.0.smithi096.stdout:3/202: truncate dc/d28/f33 3816493 0 2024-04-18T04:57:57.975 INFO:tasks.workunit.client.0.smithi096.stdout:1/359: getdents de/d1d/d3f/d5f 0 2024-04-18T04:57:57.978 INFO:tasks.workunit.client.0.smithi096.stdout:2/383: mkdir df/d18/d26/d48/d7b 0 2024-04-18T04:57:57.978 INFO:tasks.workunit.client.0.smithi096.stdout:4/248: dread d4/d14/d1d/d29/f3b [0,4194304] 0 2024-04-18T04:57:57.978 INFO:tasks.workunit.client.0.smithi096.stdout:3/203: mknod dc/d26/c3d 0 2024-04-18T04:57:57.982 INFO:tasks.workunit.client.0.smithi096.stdout:9/226: getdents d0/de 0 2024-04-18T04:57:57.983 INFO:tasks.workunit.client.0.smithi096.stdout:3/204: stat dc/c23 0 2024-04-18T04:57:57.983 INFO:tasks.workunit.client.0.smithi096.stdout:7/244: dwrite db/f22 [0,4194304] 0 2024-04-18T04:57:57.984 INFO:tasks.workunit.client.0.smithi096.stdout:6/386: getdents d0/d4a 0 2024-04-18T04:57:57.985 INFO:tasks.workunit.client.0.smithi096.stdout:2/384: symlink df/d18/d24/d42/d3f/d4a/l7c 0 2024-04-18T04:57:57.986 INFO:tasks.workunit.client.0.smithi096.stdout:4/249: write d4/d14/d1d/d29/f3b [2450573,80012] 0 2024-04-18T04:57:57.990 INFO:tasks.workunit.client.0.smithi096.stdout:7/245: write db/fe [882226,52663] 0 2024-04-18T04:57:57.990 INFO:tasks.workunit.client.0.smithi096.stdout:1/360: dwrite de/d1d/d32/f4e [0,4194304] 0 2024-04-18T04:57:57.991 INFO:tasks.workunit.client.0.smithi096.stdout:3/205: chown dc/d26/c3d 3 1 2024-04-18T04:57:57.991 INFO:tasks.workunit.client.0.smithi096.stdout:9/227: write d0/f3 [844922,41363] 0 2024-04-18T04:57:57.994 INFO:tasks.workunit.client.0.smithi096.stdout:2/385: mkdir df/d7d 0 2024-04-18T04:57:57.994 INFO:tasks.workunit.client.0.smithi096.stdout:6/387: mknod d0/d6/d2b/d4c/d66/c68 0 2024-04-18T04:57:57.996 INFO:tasks.workunit.client.0.smithi096.stdout:8/232: dread d0/d3/d32/f37 [0,4194304] 0 2024-04-18T04:57:57.996 INFO:tasks.workunit.client.0.smithi096.stdout:4/250: truncate d4/f19 427286 0 2024-04-18T04:57:57.998 INFO:tasks.workunit.client.0.smithi096.stdout:7/246: truncate db/d1f/f40 856084 0 2024-04-18T04:57:57.999 INFO:tasks.workunit.client.0.smithi096.stdout:4/251: read - d4/d14/d16/f40 zero size 2024-04-18T04:57:57.999 INFO:tasks.workunit.client.0.smithi096.stdout:3/206: dread dc/f18 [0,4194304] 0 2024-04-18T04:57:58.000 INFO:tasks.workunit.client.0.smithi096.stdout:1/361: unlink de/d1d/d32/l54 0 2024-04-18T04:57:58.001 INFO:tasks.workunit.client.0.smithi096.stdout:1/362: readlink de/d1d/l2b 0 2024-04-18T04:57:58.002 INFO:tasks.workunit.client.0.smithi096.stdout:8/233: mknod d0/d3/d32/c4b 0 2024-04-18T04:57:58.002 INFO:tasks.workunit.client.0.smithi096.stdout:7/247: write db/d20/d2f/f34 [389698,27347] 0 2024-04-18T04:57:58.002 INFO:tasks.workunit.client.0.smithi096.stdout:2/386: getdents df/d18/d71/d75 0 2024-04-18T04:57:58.004 INFO:tasks.workunit.client.0.smithi096.stdout:1/363: chown de/d1d/d32/f46 1347 1 2024-04-18T04:57:58.004 INFO:tasks.workunit.client.0.smithi096.stdout:9/228: rename d0/de/d17/d2f/d40/c3d to d0/c4e 0 2024-04-18T04:57:58.004 INFO:tasks.workunit.client.0.smithi096.stdout:2/387: truncate df/d18/d26/d48/f49 272357 0 2024-04-18T04:57:58.005 INFO:tasks.workunit.client.0.smithi096.stdout:1/364: readlink de/d1d/l2b 0 2024-04-18T04:57:58.005 INFO:tasks.workunit.client.0.smithi096.stdout:4/252: creat d4/d14/d1d/d29/d3a/d39/f51 x:0 0 0 2024-04-18T04:57:58.007 INFO:tasks.workunit.client.0.smithi096.stdout:8/234: write d0/d7/d24/f34 [403074,61759] 0 2024-04-18T04:57:58.007 INFO:tasks.workunit.client.0.smithi096.stdout:1/365: fdatasync de/d1d/d32/f44 0 2024-04-18T04:57:58.009 INFO:tasks.workunit.client.0.smithi096.stdout:9/229: creat d0/de/d17/d2f/f4f x:0 0 0 2024-04-18T04:57:58.012 INFO:tasks.workunit.client.0.smithi096.stdout:2/388: dread df/d18/f38 [0,4194304] 0 2024-04-18T04:57:58.012 INFO:tasks.workunit.client.0.smithi096.stdout:8/235: symlink d0/d7/d24/d35/l4c 0 2024-04-18T04:57:58.013 INFO:tasks.workunit.client.0.smithi096.stdout:2/389: chown df/d18/d26/f54 22 1 2024-04-18T04:57:58.014 INFO:tasks.workunit.client.0.smithi096.stdout:7/248: link c6 db/d1d/c51 0 2024-04-18T04:57:58.019 INFO:tasks.workunit.client.0.smithi096.stdout:1/366: dwrite de/d1d/d3f/f4d [0,4194304] 0 2024-04-18T04:57:58.019 INFO:tasks.workunit.client.0.smithi096.stdout:2/390: symlink df/d18/d24/l7e 0 2024-04-18T04:57:58.020 INFO:tasks.workunit.client.0.smithi096.stdout:2/391: rename df to df/d18/d26/d48/d7b/d7f 22 2024-04-18T04:57:58.020 INFO:tasks.workunit.client.0.smithi096.stdout:3/207: truncate f6 1897434 0 2024-04-18T04:57:58.020 INFO:tasks.workunit.client.0.smithi096.stdout:9/230: creat d0/de/d17/d48/f50 x:0 0 0 2024-04-18T04:57:58.022 INFO:tasks.workunit.client.0.smithi096.stdout:8/236: unlink d0/c12 0 2024-04-18T04:57:58.025 INFO:tasks.workunit.client.0.smithi096.stdout:2/392: chown df/d18/d24/d42/d6e 137 1 2024-04-18T04:57:58.025 INFO:tasks.workunit.client.0.smithi096.stdout:4/253: getdents d4/d14/d1d/d29/d3a/d47 0 2024-04-18T04:57:58.030 INFO:tasks.workunit.client.0.smithi096.stdout:3/208: creat dc/d28/f3e x:0 0 0 2024-04-18T04:57:58.031 INFO:tasks.workunit.client.0.smithi096.stdout:3/209: stat dc/d28/d29 0 2024-04-18T04:57:58.031 INFO:tasks.workunit.client.0.smithi096.stdout:8/237: creat d0/f4d x:0 0 0 2024-04-18T04:57:58.032 INFO:tasks.workunit.client.0.smithi096.stdout:8/238: chown d0/f2 244144 1 2024-04-18T04:57:58.033 INFO:tasks.workunit.client.0.smithi096.stdout:2/393: dwrite df/d18/d24/f77 [0,4194304] 0 2024-04-18T04:57:58.033 INFO:tasks.workunit.client.0.smithi096.stdout:4/254: rename d4/d14/d1d/f2a to d4/d14/d1d/f52 0 2024-04-18T04:57:58.036 INFO:tasks.workunit.client.0.smithi096.stdout:4/255: mknod d4/d14/c53 0 2024-04-18T04:57:58.040 INFO:tasks.workunit.client.0.smithi096.stdout:7/249: truncate db/ff 4090362 0 2024-04-18T04:57:58.041 INFO:tasks.workunit.client.0.smithi096.stdout:4/256: mkdir d4/d14/d1d/d29/d3a/d39/d54 0 2024-04-18T04:57:58.042 INFO:tasks.workunit.client.0.smithi096.stdout:7/250: write db/f22 [2006303,36372] 0 2024-04-18T04:57:58.044 INFO:tasks.workunit.client.0.smithi096.stdout:3/210: rename fa to dc/d26/f3f 0 2024-04-18T04:57:58.045 INFO:tasks.workunit.client.0.smithi096.stdout:0/313: sync 2024-04-18T04:57:58.047 INFO:tasks.workunit.client.0.smithi096.stdout:2/394: getdents df/d18/d24/d42/d3f/d4a 0 2024-04-18T04:57:58.048 INFO:tasks.workunit.client.0.smithi096.stdout:3/211: mknod dc/d26/d35/c40 0 2024-04-18T04:57:58.050 INFO:tasks.workunit.client.0.smithi096.stdout:7/251: rename db/c4b to db/d1f/c52 0 2024-04-18T04:57:58.051 INFO:tasks.workunit.client.0.smithi096.stdout:3/212: symlink dc/d28/d29/l41 0 2024-04-18T04:57:58.052 INFO:tasks.workunit.client.0.smithi096.stdout:4/257: rename d4/d14/d1d/d29/d3a/d4d to d4/d14/d2d/d44/d55 0 2024-04-18T04:57:58.055 INFO:tasks.workunit.client.0.smithi096.stdout:7/252: rename db/d20/d2f/c46 to db/d1f/d24/c53 0 2024-04-18T04:57:58.058 INFO:tasks.workunit.client.0.smithi096.stdout:7/253: mkdir db/d1f/d24/d49/d54 0 2024-04-18T04:57:58.059 INFO:tasks.workunit.client.0.smithi096.stdout:3/213: dwrite dc/f12 [0,4194304] 0 2024-04-18T04:57:58.059 INFO:tasks.workunit.client.0.smithi096.stdout:4/258: dread d4/d14/d16/f38 [0,4194304] 0 2024-04-18T04:57:58.061 INFO:tasks.workunit.client.0.smithi096.stdout:7/254: truncate db/d1d/f4a 949274 0 2024-04-18T04:57:58.061 INFO:tasks.workunit.client.0.smithi096.stdout:2/395: dread df/d18/f5f [0,4194304] 0 2024-04-18T04:57:58.063 INFO:tasks.workunit.client.0.smithi096.stdout:7/255: rmdir db/d1d 39 2024-04-18T04:57:58.065 INFO:tasks.workunit.client.0.smithi096.stdout:2/396: mknod df/d18/d24/d42/d6e/c80 0 2024-04-18T04:57:58.066 INFO:tasks.workunit.client.0.smithi096.stdout:7/256: dread db/d1f/f40 [0,4194304] 0 2024-04-18T04:57:58.066 INFO:tasks.workunit.client.0.smithi096.stdout:7/257: readlink db/d20/l23 0 2024-04-18T04:57:58.069 INFO:tasks.workunit.client.0.smithi096.stdout:4/259: link d4/f18 d4/d14/d1d/d29/d3a/d39/f56 0 2024-04-18T04:57:58.071 INFO:tasks.workunit.client.0.smithi096.stdout:4/260: write d4/d14/d1d/d29/d3a/d39/f51 [816932,627] 0 2024-04-18T04:57:58.071 INFO:tasks.workunit.client.0.smithi096.stdout:2/397: symlink df/d7d/l81 0 2024-04-18T04:57:58.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8ecedd8640 1 Processor -- start 2024-04-18T04:57:58.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8ecedd8640 1 -- start start 2024-04-18T04:57:58.072 INFO:tasks.workunit.client.0.smithi096.stdout:4/261: write d4/f24 [4527317,29299] 0 2024-04-18T04:57:58.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8ecedd8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8ec81530f0 0x7f8ec8070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8ecedd8640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec8071cd0 0x7f8ec806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8ecedd8640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8ec806f5f0 0x7f8ec81590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8ecedd8640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec80c9e50 con 0x7f8ec806f5f0 2024-04-18T04:57:58.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8ecedd8640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec80ca130 con 0x7f8ec81530f0 2024-04-18T04:57:58.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8ecedd8640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec80ca410 con 0x7f8ec8071cd0 2024-04-18T04:57:58.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8eccb74640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8ec81530f0 0x7f8ec8070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8eccb74640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8ec81530f0 0x7f8ec8070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:46962/0 (socket says 172.21.15.96:46962) 2024-04-18T04:57:58.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8eccb74640 1 -- 172.21.15.96:0/653187001 learned_addr learned my addr 172.21.15.96:0/653187001 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:58.075 INFO:tasks.workunit.client.0.smithi096.stdout:4/262: readlink d4/d14/d1d/d29/d3a/d47/d4b/l4e 0 2024-04-18T04:57:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8eccb74640 1 -- 172.21.15.96:0/653187001 >> v2:172.21.15.139:3300/0 conn(0x7f8ec81530f0 msgr2=0x7f8ec8070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:57:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8eccb74640 1 -- 172.21.15.96:0/653187001 >> v2:172.21.15.139:3300/0 conn(0x7f8ec81530f0 msgr2=0x7f8ec8070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:57:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8eccb74640 1 --2- 172.21.15.96:0/653187001 >> v2:172.21.15.139:3300/0 conn(0x7f8ec81530f0 0x7f8ec8070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8ec7fff640 1 --2- 172.21.15.96:0/653187001 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec8071cd0 0x7f8ec806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8eccb74640 1 --2- 172.21.15.96:0/653187001 >> v2:172.21.15.139:3300/0 conn(0x7f8ec81530f0 0x7f8ec8070f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8ecd375640 1 --2- 172.21.15.96:0/653187001 >> v2:172.21.15.96:3300/0 conn(0x7f8ec806f5f0 0x7f8ec81590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8ecd375640 1 -- 172.21.15.96:0/653187001 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec8071cd0 msgr2=0x7f8ec806f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8ecd375640 1 --2- 172.21.15.96:0/653187001 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec8071cd0 0x7f8ec806f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8ecd375640 1 -- 172.21.15.96:0/653187001 >> v2:172.21.15.139:3300/0 conn(0x7f8ec81530f0 msgr2=0x7f8ec8070f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:57:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8ecd375640 1 --2- 172.21.15.96:0/653187001 >> v2:172.21.15.139:3300/0 conn(0x7f8ec81530f0 0x7f8ec8070f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.074+0000 7f8ecd375640 1 -- 172.21.15.96:0/653187001 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec80ca6f0 con 0x7f8ec806f5f0 2024-04-18T04:57:58.077 INFO:tasks.workunit.client.0.smithi096.stdout:2/398: mkdir df/d18/d24/d42/d3f/d4a/d82 0 2024-04-18T04:57:58.077 INFO:tasks.workunit.client.0.smithi096.stdout:7/258: getdents db/d20/d45 0 2024-04-18T04:57:58.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.078+0000 7f8ecd375640 1 --2- 172.21.15.96:0/653187001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ec806f5f0 0x7f8ec81590f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80c9040 tx=0x7f8ec001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b404124a9e8c2ee0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:58.078 INFO:tasks.workunit.client.0.smithi096.stdout:7/259: fdatasync db/d1f/d24/f2e 0 2024-04-18T04:57:58.078 INFO:tasks.workunit.client.0.smithi096.stdout:3/214: write dc/d28/f33 [2657968,2315] 0 2024-04-18T04:57:58.080 INFO:tasks.workunit.client.0.smithi096.stdout:7/260: mknod db/d1f/c55 0 2024-04-18T04:57:58.080 INFO:tasks.workunit.client.0.smithi096.stdout:2/399: dread df/d18/f2b [0,4194304] 0 2024-04-18T04:57:58.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.078+0000 7f8ec77fe640 1 -- 172.21.15.96:0/653187001 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec00ab600 con 0x7f8ec806f5f0 2024-04-18T04:57:58.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.078+0000 7f8ec77fe640 1 -- 172.21.15.96:0/653187001 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec00a7050 con 0x7f8ec806f5f0 2024-04-18T04:57:58.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.078+0000 7f8ec77fe640 1 -- 172.21.15.96:0/653187001 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec00ab980 con 0x7f8ec806f5f0 2024-04-18T04:57:58.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.078+0000 7f8ecedd8640 1 -- 172.21.15.96:0/653187001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ec806f5f0 msgr2=0x7f8ec81590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:58.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.078+0000 7f8ecedd8640 1 --2- 172.21.15.96:0/653187001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ec806f5f0 0x7f8ec81590f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80c9040 tx=0x7f8ec001c3f0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.078+0000 7f8ecedd8640 1 -- 172.21.15.96:0/653187001 shutdown_connections 2024-04-18T04:57:58.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.078+0000 7f8ecedd8640 1 --2- 172.21.15.96:0/653187001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ec806f5f0 0x7f8ec81590f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.078+0000 7f8ecedd8640 1 --2- 172.21.15.96:0/653187001 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec8071cd0 0x7f8ec806f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.078+0000 7f8ecedd8640 1 --2- 172.21.15.96:0/653187001 >> v2:172.21.15.139:3300/0 conn(0x7f8ec81530f0 0x7f8ec8070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.078+0000 7f8ecedd8640 1 -- 172.21.15.96:0/653187001 >> 172.21.15.96:0/653187001 conn(0x7f8ec806af70 msgr2=0x7f8ec806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:58.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.078+0000 7f8ecedd8640 1 -- 172.21.15.96:0/653187001 shutdown_connections 2024-04-18T04:57:58.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.078+0000 7f8ecedd8640 1 -- 172.21.15.96:0/653187001 wait complete. 2024-04-18T04:57:58.108 INFO:tasks.workunit.client.0.smithi096.stdout:2/400: fdatasync df/d18/d26/f54 0 2024-04-18T04:57:58.108 INFO:tasks.workunit.client.0.smithi096.stdout:4/263: dwrite d4/d14/d16/f3f [0,4194304] 0 2024-04-18T04:57:58.108 INFO:tasks.workunit.client.0.smithi096.stdout:2/401: stat df/d18/f2b 0 2024-04-18T04:57:58.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.106+0000 7f8ecedd8640 1 Processor -- start 2024-04-18T04:57:58.108 INFO:tasks.workunit.client.0.smithi096.stdout:4/264: readlink d4/l49 0 2024-04-18T04:57:58.109 INFO:tasks.workunit.client.0.smithi096.stdout:3/215: getdents dc/d28/d29 0 2024-04-18T04:57:58.109 INFO:tasks.workunit.client.0.smithi096.stdout:7/261: unlink db/d1f/c38 0 2024-04-18T04:57:58.112 INFO:tasks.workunit.client.0.smithi096.stdout:4/265: creat d4/d14/d1d/d29/d3a/d47/d4b/f57 x:0 0 0 2024-04-18T04:57:58.113 INFO:tasks.workunit.client.0.smithi096.stdout:3/216: creat dc/f42 x:0 0 0 2024-04-18T04:57:58.114 INFO:tasks.workunit.client.0.smithi096.stdout:7/262: creat db/d1f/d24/f56 x:0 0 0 2024-04-18T04:57:58.117 INFO:tasks.workunit.client.0.smithi096.stdout:3/217: symlink dc/d28/d29/l43 0 2024-04-18T04:57:58.118 INFO:tasks.workunit.client.0.smithi096.stdout:3/218: write dc/f1b [280378,37332] 0 2024-04-18T04:57:58.119 INFO:tasks.workunit.client.0.smithi096.stdout:3/219: chown dc/d26/l2f 981248 1 2024-04-18T04:57:58.120 INFO:tasks.workunit.client.0.smithi096.stdout:3/220: chown dc/d26/c3d 3 1 2024-04-18T04:57:58.120 INFO:tasks.workunit.client.0.smithi096.stdout:3/221: dread - dc/f39 zero size 2024-04-18T04:57:58.121 INFO:tasks.workunit.client.0.smithi096.stdout:7/263: dwrite db/f11 [4194304,4194304] 0 2024-04-18T04:57:58.126 INFO:tasks.workunit.client.0.smithi096.stdout:2/402: dwrite df/d18/d26/f29 [0,4194304] 0 2024-04-18T04:57:58.128 INFO:tasks.workunit.client.0.smithi096.stdout:7/264: mknod db/d1f/d24/d49/d54/c57 0 2024-04-18T04:57:58.129 INFO:tasks.workunit.client.0.smithi096.stdout:4/266: write d4/d14/d1d/d29/d3a/d39/f56 [1828558,84129] 0 2024-04-18T04:57:58.132 INFO:tasks.workunit.client.0.smithi096.stdout:4/267: rmdir d4/d14/d1d 39 2024-04-18T04:57:58.137 INFO:tasks.workunit.client.0.smithi096.stdout:2/403: dwrite fd [0,4194304] 0 2024-04-18T04:57:58.137 INFO:tasks.workunit.client.0.smithi096.stdout:3/222: dwrite f8 [0,4194304] 0 2024-04-18T04:57:58.138 INFO:tasks.workunit.client.0.smithi096.stdout:4/268: mkdir d4/d14/d2d/d44/d58 0 2024-04-18T04:57:58.141 INFO:tasks.workunit.client.0.smithi096.stdout:3/223: mknod dc/d28/d29/c44 0 2024-04-18T04:57:58.143 INFO:tasks.workunit.client.0.smithi096.stdout:2/404: creat df/d18/d26/f83 x:0 0 0 2024-04-18T04:57:58.144 INFO:tasks.workunit.client.0.smithi096.stdout:7/265: dwrite db/f18 [4194304,4194304] 0 2024-04-18T04:57:58.146 INFO:tasks.workunit.client.0.smithi096.stdout:3/224: rename f6 to dc/f45 0 2024-04-18T04:57:58.147 INFO:tasks.workunit.client.0.smithi096.stdout:7/266: truncate db/d1f/d24/f56 302135 0 2024-04-18T04:57:58.148 INFO:tasks.workunit.client.0.smithi096.stdout:4/269: dwrite d4/d14/f31 [0,4194304] 0 2024-04-18T04:57:58.152 INFO:tasks.workunit.client.0.smithi096.stdout:2/405: creat df/d18/d26/f84 x:0 0 0 2024-04-18T04:57:58.155 INFO:tasks.workunit.client.0.smithi096.stdout:3/225: rename dc/d26/f3f to dc/d28/f46 0 2024-04-18T04:57:58.155 INFO:tasks.workunit.client.0.smithi096.stdout:2/406: rmdir df/d18/d24/d42 39 2024-04-18T04:57:58.156 INFO:tasks.workunit.client.0.smithi096.stdout:7/267: dwrite db/d20/d2f/f37 [4194304,4194304] 0 2024-04-18T04:57:58.156 INFO:tasks.workunit.client.0.smithi096.stdout:3/226: fsync dc/f22 0 2024-04-18T04:57:58.158 INFO:tasks.workunit.client.0.smithi096.stdout:7/268: truncate fa 504695 0 2024-04-18T04:57:58.158 INFO:tasks.workunit.client.0.smithi096.stdout:3/227: write dc/d28/f3e [474163,3765] 0 2024-04-18T04:57:58.165 INFO:tasks.workunit.client.0.smithi096.stdout:4/270: creat d4/d14/d1d/d29/d3a/d39/f59 x:0 0 0 2024-04-18T04:57:58.167 INFO:tasks.workunit.client.0.smithi096.stdout:2/407: readlink df/d18/d24/d42/d3f/d4a/l7c 0 2024-04-18T04:57:58.168 INFO:tasks.workunit.client.0.smithi096.stdout:4/271: symlink d4/d14/d2d/l5a 0 2024-04-18T04:57:58.172 INFO:tasks.workunit.client.0.smithi096.stdout:7/269: fsync db/ff 0 2024-04-18T04:57:58.172 INFO:tasks.workunit.client.0.smithi096.stdout:4/272: symlink d4/d14/d1d/d29/d3a/d47/l5b 0 2024-04-18T04:57:58.173 INFO:tasks.workunit.client.0.smithi096.stdout:2/408: mknod df/d7d/c85 0 2024-04-18T04:57:58.175 INFO:tasks.workunit.client.0.smithi096.stdout:7/270: rename db/f3a to db/d20/d2f/f58 0 2024-04-18T04:57:58.177 INFO:tasks.workunit.client.0.smithi096.stdout:4/273: creat d4/d14/d1d/d29/d3a/d39/d54/f5c x:0 0 0 2024-04-18T04:57:58.177 INFO:tasks.workunit.client.0.smithi096.stdout:3/228: dwrite dc/f20 [0,4194304] 0 2024-04-18T04:57:58.178 INFO:tasks.workunit.client.0.smithi096.stdout:2/409: rename df/d18/d24/f45 to df/d7a/f86 0 2024-04-18T04:57:58.178 INFO:tasks.workunit.client.0.smithi096.stdout:3/229: chown f3 7110015 1 2024-04-18T04:57:58.179 INFO:tasks.workunit.client.0.smithi096.stdout:7/271: creat db/d1f/d42/f59 x:0 0 0 2024-04-18T04:57:58.180 INFO:tasks.workunit.client.0.smithi096.stdout:4/274: creat d4/d14/d2d/d44/f5d x:0 0 0 2024-04-18T04:57:58.181 INFO:tasks.workunit.client.0.smithi096.stdout:2/410: mkdir df/d18/d87 0 2024-04-18T04:57:58.181 INFO:tasks.workunit.client.0.smithi096.stdout:4/275: write d4/d14/d16/f32 [2303751,47614] 0 2024-04-18T04:57:58.185 INFO:tasks.workunit.client.0.smithi096.stdout:4/276: creat d4/d14/d2d/d44/f5e x:0 0 0 2024-04-18T04:57:58.186 INFO:tasks.workunit.client.0.smithi096.stdout:2/411: creat df/d18/d71/d75/f88 x:0 0 0 2024-04-18T04:57:58.187 INFO:tasks.workunit.client.0.smithi096.stdout:4/277: write d4/d14/d16/f3f [3323047,91684] 0 2024-04-18T04:57:58.187 INFO:tasks.workunit.client.0.smithi096.stdout:3/230: link dc/d26/c3d dc/d28/d29/c47 0 2024-04-18T04:57:58.188 INFO:tasks.workunit.client.0.smithi096.stdout:2/412: write df/d18/d24/f77 [4454762,124636] 0 2024-04-18T04:57:58.188 INFO:tasks.workunit.client.0.smithi096.stdout:7/272: write db/d1f/d24/f2e [2843672,117507] 0 2024-04-18T04:57:58.190 INFO:tasks.workunit.client.0.smithi096.stdout:3/231: mkdir dc/d26/d48 0 2024-04-18T04:57:58.191 INFO:tasks.workunit.client.0.smithi096.stdout:3/232: fsync dc/fe 0 2024-04-18T04:57:58.192 INFO:tasks.workunit.client.0.smithi096.stdout:4/278: rename d4/d14/f35 to d4/d14/d2d/d44/f5f 0 2024-04-18T04:57:58.194 INFO:tasks.workunit.client.0.smithi096.stdout:3/233: mknod dc/d26/c49 0 2024-04-18T04:57:58.196 INFO:tasks.workunit.client.0.smithi096.stdout:4/279: symlink d4/d14/d1d/d29/d3a/d39/d54/l60 0 2024-04-18T04:57:58.199 INFO:tasks.workunit.client.0.smithi096.stdout:3/234: unlink dc/d26/l27 0 2024-04-18T04:57:58.199 INFO:tasks.workunit.client.0.smithi096.stdout:2/413: dwrite df/f33 [0,4194304] 0 2024-04-18T04:57:58.201 INFO:tasks.workunit.client.0.smithi096.stdout:7/273: dwrite db/d1f/d24/f2e [0,4194304] 0 2024-04-18T04:57:58.203 INFO:tasks.workunit.client.0.smithi096.stdout:7/274: write db/d1f/d24/f2e [46424,11097] 0 2024-04-18T04:57:58.204 INFO:tasks.workunit.client.0.smithi096.stdout:3/235: write dc/d28/f46 [2570472,33656] 0 2024-04-18T04:57:58.205 INFO:tasks.workunit.client.0.smithi096.stdout:7/275: chown db/d1f/d24/f2e 52068 1 2024-04-18T04:57:58.206 INFO:tasks.workunit.client.0.smithi096.stdout:3/236: write f3 [1864156,108030] 0 2024-04-18T04:57:58.214 INFO:tasks.workunit.client.0.smithi096.stdout:3/237: mkdir dc/d26/d4a 0 2024-04-18T04:57:58.214 INFO:tasks.workunit.client.0.smithi096.stdout:4/280: dwrite d4/f19 [0,4194304] 0 2024-04-18T04:57:58.218 INFO:tasks.workunit.client.0.smithi096.stdout:3/238: fsync dc/f18 0 2024-04-18T04:57:58.219 INFO:tasks.workunit.client.0.smithi096.stdout:4/281: write d4/d14/d1d/d29/f4c [382390,64370] 0 2024-04-18T04:57:58.221 INFO:tasks.workunit.client.0.smithi096.stdout:4/282: fdatasync d4/d14/d1d/d29/f3b 0 2024-04-18T04:57:58.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.106+0000 7f8ecedd8640 1 -- start start 2024-04-18T04:57:58.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ecedd8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ec806f5f0 0x7f8ec8153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ecedd8640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec8071cd0 0x7f8ec813e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ecedd8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ec81530f0 0x7f8ec813ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ecedd8640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec8140c00 con 0x7f8ec806f5f0 2024-04-18T04:57:58.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ecedd8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec81528c0 con 0x7f8ec81530f0 2024-04-18T04:57:58.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ecedd8640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec8140920 con 0x7f8ec8071cd0 2024-04-18T04:57:58.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8eccb74640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ec806f5f0 0x7f8ec8153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8eccb74640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ec806f5f0 0x7f8ec8153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41986/0 (socket says 172.21.15.96:41986) 2024-04-18T04:57:58.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8eccb74640 1 -- 172.21.15.96:0/1692559152 learned_addr learned my addr 172.21.15.96:0/1692559152 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:58.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ecd375640 1 --2- 172.21.15.96:0/1692559152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ec81530f0 0x7f8ec813ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ec7fff640 1 --2- 172.21.15.96:0/1692559152 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec8071cd0 0x7f8ec813e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ecd375640 1 -- 172.21.15.96:0/1692559152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ec81530f0 msgr2=0x7f8ec813ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-18T04:57:58.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ecd375640 1 -- 172.21.15.96:0/1692559152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ec81530f0 msgr2=0x7f8ec813ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T04:57:58.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ecd375640 1 --2- 172.21.15.96:0/1692559152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ec81530f0 0x7f8ec813ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:58.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ecd375640 1 --2- 172.21.15.96:0/1692559152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ec81530f0 0x7f8ec813ee00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:58.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8eccb74640 1 -- 172.21.15.96:0/1692559152 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec8071cd0 msgr2=0x7f8ec813e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:58.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8eccb74640 1 --2- 172.21.15.96:0/1692559152 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec8071cd0 0x7f8ec813e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8eccb74640 1 -- 172.21.15.96:0/1692559152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ec81530f0 msgr2=0x7f8ec813ee00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:57:58.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8eccb74640 1 --2- 172.21.15.96:0/1692559152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ec81530f0 0x7f8ec813ee00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8eccb74640 1 -- 172.21.15.96:0/1692559152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec0009420 con 0x7f8ec806f5f0 2024-04-18T04:57:58.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8eccb74640 1 --2- 172.21.15.96:0/1692559152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ec806f5f0 0x7f8ec8153ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8007bd0 tx=0x7f8eb800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:58.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ec57fa640 1 -- 172.21.15.96:0/1692559152 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb800ddb0 con 0x7f8ec806f5f0 2024-04-18T04:57:58.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ec57fa640 1 -- 172.21.15.96:0/1692559152 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb8035400 con 0x7f8ec806f5f0 2024-04-18T04:57:58.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ecedd8640 1 -- 172.21.15.96:0/1692559152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec8152300 con 0x7f8ec806f5f0 2024-04-18T04:57:58.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ec57fa640 1 -- 172.21.15.96:0/1692559152 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80357b0 con 0x7f8ec806f5f0 2024-04-18T04:57:58.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ecedd8640 1 -- 172.21.15.96:0/1692559152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec8073080 con 0x7f8ec806f5f0 2024-04-18T04:57:58.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.110+0000 7f8ec57fa640 1 -- 172.21.15.96:0/1692559152 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8eb8035910 con 0x7f8ec806f5f0 2024-04-18T04:57:58.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.114+0000 7f8ecedd8640 1 -- 172.21.15.96:0/1692559152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec8152160 con 0x7f8ec806f5f0 2024-04-18T04:57:58.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.114+0000 7f8ec57fa640 1 --2- 172.21.15.96:0/1692559152 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8eb4066690 0x7f8eb4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.114+0000 7f8ec57fa640 1 -- 172.21.15.96:0/1692559152 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8eb80a6790 con 0x7f8ec806f5f0 2024-04-18T04:57:58.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.114+0000 7f8ec7fff640 1 --2- 172.21.15.96:0/1692559152 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8eb4066690 0x7f8eb4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.114+0000 7f8ec7fff640 1 --2- 172.21.15.96:0/1692559152 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8eb4066690 0x7f8eb4068b50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8159f10 tx=0x7f8ebc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:58.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.118+0000 7f8ec57fa640 1 -- 172.21.15.96:0/1692559152 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8ec8152160 con 0x7f8ec806f5f0 2024-04-18T04:57:58.224 INFO:tasks.workunit.client.0.smithi096.stdout:7/276: dwrite db/d1d/f21 [0,4194304] 0 2024-04-18T04:57:58.225 INFO:tasks.workunit.client.0.smithi096.stdout:7/277: chown db/d20/l23 59073707 1 2024-04-18T04:57:58.225 INFO:tasks.workunit.client.0.smithi096.stdout:2/414: dread df/d18/f23 [0,4194304] 0 2024-04-18T04:57:58.226 INFO:tasks.workunit.client.0.smithi096.stdout:3/239: creat dc/d26/d4a/f4b x:0 0 0 2024-04-18T04:57:58.228 INFO:tasks.workunit.client.0.smithi096.stdout:4/283: dread d4/d14/d1d/f25 [0,4194304] 0 2024-04-18T04:57:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:2/415: creat df/d18/f89 x:0 0 0 2024-04-18T04:57:58.229 INFO:tasks.workunit.client.0.smithi096.stdout:4/284: chown d4/d14/c53 55006556 1 2024-04-18T04:57:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:3/240: mknod dc/d26/d48/c4c 0 2024-04-18T04:57:58.230 INFO:tasks.workunit.client.0.smithi096.stdout:4/285: dread - d4/d14/d1d/d29/f36 zero size 2024-04-18T04:57:58.231 INFO:tasks.workunit.client.0.smithi096.stdout:4/286: chown d4/d14/d1d/d29/l3c 35161 1 2024-04-18T04:57:58.232 INFO:tasks.workunit.client.0.smithi096.stdout:2/416: rmdir df/d18/d26/d48 39 2024-04-18T04:57:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:4/287: fsync d4/d14/d1d/d29/d3a/d39/f56 0 2024-04-18T04:57:58.233 INFO:tasks.workunit.client.0.smithi096.stdout:7/278: write db/f48 [2293006,81713] 0 2024-04-18T04:57:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:4/288: dread - d4/d14/d16/f40 zero size 2024-04-18T04:57:58.235 INFO:tasks.workunit.client.0.smithi096.stdout:7/279: read db/d1f/f41 [390826,23266] 0 2024-04-18T04:57:58.238 INFO:tasks.workunit.client.0.smithi096.stdout:2/417: getdents df 0 2024-04-18T04:57:58.238 INFO:tasks.workunit.client.0.smithi096.stdout:4/289: mknod d4/d14/d2d/d44/c61 0 2024-04-18T04:57:58.238 INFO:tasks.workunit.client.0.smithi096.stdout:7/280: chown db/f48 37401201 1 2024-04-18T04:57:58.240 INFO:tasks.workunit.client.0.smithi096.stdout:7/281: dread fa [0,4194304] 0 2024-04-18T04:57:58.240 INFO:tasks.workunit.client.0.smithi096.stdout:4/290: read - d4/d14/d16/f40 zero size 2024-04-18T04:57:58.240 INFO:tasks.workunit.client.0.smithi096.stdout:3/241: dwrite dc/f45 [0,4194304] 0 2024-04-18T04:57:58.242 INFO:tasks.workunit.client.0.smithi096.stdout:4/291: read d4/d14/d16/f3f [3340898,99371] 0 2024-04-18T04:57:58.243 INFO:tasks.workunit.client.0.smithi096.stdout:2/418: rename df/d18/d26/l35 to df/d18/d24/d42/d6e/l8a 0 2024-04-18T04:57:58.244 INFO:tasks.workunit.client.0.smithi096.stdout:2/419: chown df/d18/d26/f84 2902278 1 2024-04-18T04:57:58.245 INFO:tasks.workunit.client.0.smithi096.stdout:4/292: creat d4/f62 x:0 0 0 2024-04-18T04:57:58.248 INFO:tasks.workunit.client.0.smithi096.stdout:2/420: creat df/d18/d24/d42/d6e/f8b x:0 0 0 2024-04-18T04:57:58.248 INFO:tasks.workunit.client.0.smithi096.stdout:3/242: dwrite dc/d26/d4a/f4b [0,4194304] 0 2024-04-18T04:57:58.250 INFO:tasks.workunit.client.0.smithi096.stdout:3/243: dread - dc/f39 zero size 2024-04-18T04:57:58.251 INFO:tasks.workunit.client.0.smithi096.stdout:3/244: chown dc/d26/d4a/f4b 1104 1 2024-04-18T04:57:58.253 INFO:tasks.workunit.client.0.smithi096.stdout:2/421: truncate df/d18/d26/d48/f70 4701624 0 2024-04-18T04:57:58.254 INFO:tasks.workunit.client.0.smithi096.stdout:3/245: symlink dc/d26/l4d 0 2024-04-18T04:57:58.257 INFO:tasks.workunit.client.0.smithi096.stdout:3/246: chown dc/c23 65271 1 2024-04-18T04:57:58.257 INFO:tasks.workunit.client.0.smithi096.stdout:4/293: dwrite d4/d14/d1d/d29/f36 [0,4194304] 0 2024-04-18T04:57:58.258 INFO:tasks.workunit.client.0.smithi096.stdout:3/247: write f2 [775969,7509] 0 2024-04-18T04:57:58.258 INFO:tasks.workunit.client.0.smithi096.stdout:3/248: fdatasync dc/f10 0 2024-04-18T04:57:58.262 INFO:tasks.workunit.client.0.smithi096.stdout:3/249: readlink dc/lf 0 2024-04-18T04:57:58.267 INFO:tasks.workunit.client.0.smithi096.stdout:3/250: dread dc/f24 [0,4194304] 0 2024-04-18T04:57:58.268 INFO:tasks.workunit.client.0.smithi096.stdout:4/294: truncate d4/f19 1959172 0 2024-04-18T04:57:58.270 INFO:tasks.workunit.client.0.smithi096.stdout:3/251: rmdir dc/d26 39 2024-04-18T04:57:58.271 INFO:tasks.workunit.client.0.smithi096.stdout:4/295: mkdir d4/d14/d2d/d44/d63 0 2024-04-18T04:57:58.271 INFO:tasks.workunit.client.0.smithi096.stdout:3/252: stat dc/d26/d35 0 2024-04-18T04:57:58.274 INFO:tasks.workunit.client.0.smithi096.stdout:3/253: mknod dc/d26/c4e 0 2024-04-18T04:57:58.274 INFO:tasks.workunit.client.0.smithi096.stdout:4/296: symlink d4/d14/d2d/d44/d58/l64 0 2024-04-18T04:57:58.275 INFO:tasks.workunit.client.0.smithi096.stdout:5/184: sync 2024-04-18T04:57:58.276 INFO:tasks.workunit.client.0.smithi096.stdout:3/254: creat dc/d26/d48/f4f x:0 0 0 2024-04-18T04:57:58.277 INFO:tasks.workunit.client.0.smithi096.stdout:2/422: dread df/d18/d24/d42/d3f/d4a/f40 [0,4194304] 0 2024-04-18T04:57:58.277 INFO:tasks.workunit.client.0.smithi096.stdout:4/297: creat d4/d14/d2d/d44/d58/f65 x:0 0 0 2024-04-18T04:57:58.278 INFO:tasks.workunit.client.0.smithi096.stdout:3/255: write dc/f12 [3779825,120959] 0 2024-04-18T04:57:58.281 INFO:tasks.workunit.client.0.smithi096.stdout:2/423: fdatasync df/d18/d24/d42/f2c 0 2024-04-18T04:57:58.282 INFO:tasks.workunit.client.0.smithi096.stdout:2/424: fdatasync df/f14 0 2024-04-18T04:57:58.282 INFO:tasks.workunit.client.0.smithi096.stdout:3/256: creat dc/d26/d4a/f50 x:0 0 0 2024-04-18T04:57:58.283 INFO:tasks.workunit.client.0.smithi096.stdout:5/185: link d7/dd/l23 d7/d25/l4e 0 2024-04-18T04:57:58.283 INFO:tasks.workunit.client.0.smithi096.stdout:2/425: write df/d18/d26/d48/f49 [832513,105907] 0 2024-04-18T04:57:58.284 INFO:tasks.workunit.client.0.smithi096.stdout:4/298: symlink d4/d14/l66 0 2024-04-18T04:57:58.284 INFO:tasks.workunit.client.0.smithi096.stdout:5/186: dread - d7/d25/d2b/f3d zero size 2024-04-18T04:57:58.285 INFO:tasks.workunit.client.0.smithi096.stdout:2/426: write df/d18/f22 [492319,71885] 0 2024-04-18T04:57:58.285 INFO:tasks.workunit.client.0.smithi096.stdout:4/299: chown d4/d14/c42 924983 1 2024-04-18T04:57:58.288 INFO:tasks.workunit.client.0.smithi096.stdout:3/257: symlink dc/d26/d35/l51 0 2024-04-18T04:57:58.290 INFO:tasks.workunit.client.0.smithi096.stdout:5/187: creat d7/d39/d36/f4f x:0 0 0 2024-04-18T04:57:58.291 INFO:tasks.workunit.client.0.smithi096.stdout:4/300: dread d4/f19 [0,4194304] 0 2024-04-18T04:57:58.292 INFO:tasks.workunit.client.0.smithi096.stdout:3/258: readlink dc/d28/d29/l3a 0 2024-04-18T04:57:58.292 INFO:tasks.workunit.client.0.smithi096.stdout:4/301: stat d4/d14/d2d/d44/d58 0 2024-04-18T04:57:58.293 INFO:tasks.workunit.client.0.smithi096.stdout:5/188: creat d7/d39/f50 x:0 0 0 2024-04-18T04:57:58.295 INFO:tasks.workunit.client.0.smithi096.stdout:5/189: write d7/d12/f1f [244184,56504] 0 2024-04-18T04:57:58.295 INFO:tasks.workunit.client.0.smithi096.stdout:4/302: mkdir d4/d14/d2d/d44/d55/d67 0 2024-04-18T04:57:58.296 INFO:tasks.workunit.client.0.smithi096.stdout:5/190: read - d7/f46 zero size 2024-04-18T04:57:58.296 INFO:tasks.workunit.client.0.smithi096.stdout:4/303: chown d4/d14/d1d/d29/c45 70 1 2024-04-18T04:57:58.299 INFO:tasks.workunit.client.0.smithi096.stdout:5/191: unlink d7/d39/c34 0 2024-04-18T04:57:58.300 INFO:tasks.workunit.client.0.smithi096.stdout:3/259: dread f3 [0,4194304] 0 2024-04-18T04:57:58.300 INFO:tasks.workunit.client.0.smithi096.stdout:3/260: dread - dc/f39 zero size 2024-04-18T04:57:58.305 INFO:tasks.workunit.client.0.smithi096.stdout:5/192: getdents d7/d12 0 2024-04-18T04:57:58.306 INFO:tasks.workunit.client.0.smithi096.stdout:4/304: truncate d4/d14/d1d/d29/f36 1734142 0 2024-04-18T04:57:58.307 INFO:tasks.workunit.client.0.smithi096.stdout:2/427: dread df/d18/d24/d42/d3f/f5e [0,4194304] 0 2024-04-18T04:57:58.308 INFO:tasks.workunit.client.0.smithi096.stdout:2/428: chown df/d18/d24/d42/d3f/d4a/d82 0 1 2024-04-18T04:57:58.309 INFO:tasks.workunit.client.0.smithi096.stdout:3/261: dwrite dc/d28/f3e [0,4194304] 0 2024-04-18T04:57:58.316 INFO:tasks.workunit.client.0.smithi096.stdout:5/193: dwrite d7/d39/f29 [0,4194304] 0 2024-04-18T04:57:58.317 INFO:tasks.workunit.client.0.smithi096.stdout:5/194: stat d7/d25/f2f 0 2024-04-18T04:57:58.318 INFO:tasks.workunit.client.0.smithi096.stdout:3/262: dwrite f8 [0,4194304] 0 2024-04-18T04:57:58.319 INFO:tasks.workunit.client.0.smithi096.stdout:2/429: mknod df/d18/d24/d42/d3f/c8c 0 2024-04-18T04:57:58.320 INFO:tasks.workunit.client.0.smithi096.stdout:2/430: rmdir df 39 2024-04-18T04:57:58.327 INFO:tasks.workunit.client.0.smithi096.stdout:3/263: rename dc/d26/l34 to dc/d28/l52 0 2024-04-18T04:57:58.329 INFO:tasks.workunit.client.0.smithi096.stdout:3/264: write dc/f20 [2947706,62992] 0 2024-04-18T04:57:58.333 INFO:tasks.workunit.client.0.smithi096.stdout:2/431: dwrite df/d18/d26/d48/f78 [0,4194304] 0 2024-04-18T04:57:58.336 INFO:tasks.workunit.client.0.smithi096.stdout:5/195: dread d7/ff [0,4194304] 0 2024-04-18T04:57:58.337 INFO:tasks.workunit.client.0.smithi096.stdout:2/432: creat df/d18/d24/f8d x:0 0 0 2024-04-18T04:57:58.339 INFO:tasks.workunit.client.0.smithi096.stdout:3/265: dwrite dc/f1b [0,4194304] 0 2024-04-18T04:57:58.339 INFO:tasks.workunit.client.0.smithi096.stdout:2/433: symlink df/l8e 0 2024-04-18T04:57:58.344 INFO:tasks.workunit.client.0.smithi096.stdout:3/266: creat dc/f53 x:0 0 0 2024-04-18T04:57:58.344 INFO:tasks.workunit.client.0.smithi096.stdout:3/267: chown dc/d28/d29 13 1 2024-04-18T04:57:58.346 INFO:tasks.workunit.client.0.smithi096.stdout:3/268: creat dc/d26/d4a/f54 x:0 0 0 2024-04-18T04:57:58.346 INFO:tasks.workunit.client.0.smithi096.stdout:3/269: readlink dc/d28/l38 0 2024-04-18T04:57:58.348 INFO:tasks.workunit.client.0.smithi096.stdout:2/434: chown df/d18/d26/d48/d7b 1223 1 2024-04-18T04:57:58.349 INFO:tasks.workunit.client.0.smithi096.stdout:3/270: symlink dc/l55 0 2024-04-18T04:57:58.350 INFO:tasks.workunit.client.0.smithi096.stdout:2/435: chown df/f63 12838837 1 2024-04-18T04:57:58.350 INFO:tasks.workunit.client.0.smithi096.stdout:2/436: fsync df/d18/d26/f54 0 2024-04-18T04:57:58.351 INFO:tasks.workunit.client.0.smithi096.stdout:3/271: truncate dc/d26/d4a/f4b 4577279 0 2024-04-18T04:57:58.356 INFO:tasks.workunit.client.0.smithi096.stdout:2/437: mknod df/d18/d24/d42/d3f/d4a/c8f 0 2024-04-18T04:57:58.358 INFO:tasks.workunit.client.0.smithi096.stdout:3/272: link dc/d26/d4a/f50 dc/f56 0 2024-04-18T04:57:58.358 INFO:tasks.workunit.client.0.smithi096.stdout:2/438: symlink df/d18/d24/d42/l90 0 2024-04-18T04:57:58.359 INFO:tasks.workunit.client.0.smithi096.stdout:3/273: rmdir dc/d26 39 2024-04-18T04:57:58.359 INFO:tasks.workunit.client.0.smithi096.stdout:2/439: fdatasync df/d18/d26/f4d 0 2024-04-18T04:57:58.361 INFO:tasks.workunit.client.0.smithi096.stdout:3/274: write dc/d26/d4a/f54 [331161,50046] 0 2024-04-18T04:57:58.363 INFO:tasks.workunit.client.0.smithi096.stdout:2/440: rename df/d18/d26/d48/f70 to df/d18/d26/f91 0 2024-04-18T04:57:58.364 INFO:tasks.workunit.client.0.smithi096.stdout:3/275: mkdir dc/d26/d57 0 2024-04-18T04:57:58.364 INFO:tasks.workunit.client.0.smithi096.stdout:2/441: write df/d18/d26/f27 [267677,75758] 0 2024-04-18T04:57:58.365 INFO:tasks.workunit.client.0.smithi096.stdout:2/442: write df/d18/d26/f4d [3170613,92664] 0 2024-04-18T04:57:58.371 INFO:tasks.workunit.client.0.smithi096.stdout:3/276: dwrite dc/f22 [0,4194304] 0 2024-04-18T04:57:58.373 INFO:tasks.workunit.client.0.smithi096.stdout:2/443: truncate df/d18/f5f 2522140 0 2024-04-18T04:57:58.373 INFO:tasks.workunit.client.0.smithi096.stdout:3/277: creat dc/d26/d4a/f58 x:0 0 0 2024-04-18T04:57:58.373 INFO:tasks.workunit.client.0.smithi096.stdout:3/278: stat dc/lf 0 2024-04-18T04:57:58.374 INFO:tasks.workunit.client.0.smithi096.stdout:3/279: chown dc/d26/c2b 428810752 1 2024-04-18T04:57:58.375 INFO:tasks.workunit.client.0.smithi096.stdout:3/280: write dc/f10 [2334594,104815] 0 2024-04-18T04:57:58.376 INFO:tasks.workunit.client.0.smithi096.stdout:2/444: fsync df/f14 0 2024-04-18T04:57:58.377 INFO:tasks.workunit.client.0.smithi096.stdout:2/445: dread - df/d7a/f86 zero size 2024-04-18T04:57:58.378 INFO:tasks.workunit.client.0.smithi096.stdout:3/281: unlink dc/d28/d29/l31 0 2024-04-18T04:57:58.379 INFO:tasks.workunit.client.0.smithi096.stdout:2/446: write df/d18/f25 [4530286,71967] 0 2024-04-18T04:57:58.381 INFO:tasks.workunit.client.0.smithi096.stdout:3/282: rename dc/d28/d29/l3a to dc/d26/l59 0 2024-04-18T04:57:58.386 INFO:tasks.workunit.client.0.smithi096.stdout:3/283: dread dc/d28/f46 [0,4194304] 0 2024-04-18T04:57:58.387 INFO:tasks.workunit.client.0.smithi096.stdout:3/284: chown dc/f56 318 1 2024-04-18T04:57:58.390 INFO:tasks.workunit.client.0.smithi096.stdout:3/285: mknod dc/d26/d57/c5a 0 2024-04-18T04:57:58.390 INFO:tasks.workunit.client.0.smithi096.stdout:2/447: dwrite df/d18/d24/d42/f2c [0,4194304] 0 2024-04-18T04:57:58.393 INFO:tasks.workunit.client.0.smithi096.stdout:2/448: mknod df/d7d/c92 0 2024-04-18T04:57:58.393 INFO:tasks.workunit.client.0.smithi096.stdout:2/449: chown df/d18 19761436 1 2024-04-18T04:57:58.394 INFO:tasks.workunit.client.0.smithi096.stdout:2/450: write df/d18/d26/f83 [226814,98635] 0 2024-04-18T04:57:58.394 INFO:tasks.workunit.client.0.smithi096.stdout:3/286: getdents dc/d26/d48 0 2024-04-18T04:57:58.395 INFO:tasks.workunit.client.0.smithi096.stdout:3/287: write dc/fe [9279329,62981] 0 2024-04-18T04:57:58.397 INFO:tasks.workunit.client.0.smithi096.stdout:2/451: mknod df/d18/d26/d48/c93 0 2024-04-18T04:57:58.399 INFO:tasks.workunit.client.0.smithi096.stdout:2/452: truncate df/f69 775355 0 2024-04-18T04:57:58.400 INFO:tasks.workunit.client.0.smithi096.stdout:3/288: symlink dc/d28/l5b 0 2024-04-18T04:57:58.400 INFO:tasks.workunit.client.0.smithi096.stdout:2/453: truncate df/d18/d71/d75/f88 833652 0 2024-04-18T04:57:58.401 INFO:tasks.workunit.client.0.smithi096.stdout:3/289: rmdir dc/d26/d48 39 2024-04-18T04:57:58.404 INFO:tasks.workunit.client.0.smithi096.stdout:2/454: fsync df/f17 0 2024-04-18T04:57:58.405 INFO:tasks.workunit.client.0.smithi096.stdout:3/290: creat dc/d26/d35/f5c x:0 0 0 2024-04-18T04:57:58.405 INFO:tasks.workunit.client.0.smithi096.stdout:2/455: dread - df/f65 zero size 2024-04-18T04:57:58.407 INFO:tasks.workunit.client.0.smithi096.stdout:2/456: unlink df/d18/f25 0 2024-04-18T04:57:58.416 INFO:tasks.workunit.client.0.smithi096.stdout:3/291: dwrite f2 [0,4194304] 0 2024-04-18T04:57:58.420 INFO:tasks.workunit.client.0.smithi096.stdout:2/457: dwrite df/f63 [0,4194304] 0 2024-04-18T04:57:58.425 INFO:tasks.workunit.client.0.smithi096.stdout:2/458: mknod df/d18/d26/c94 0 2024-04-18T04:57:58.427 INFO:tasks.workunit.client.0.smithi096.stdout:3/292: rename dc/d26/d35 to dc/d5d 0 2024-04-18T04:57:58.427 INFO:tasks.workunit.client.0.smithi096.stdout:3/293: stat dc/l55 0 2024-04-18T04:57:58.428 INFO:tasks.workunit.client.0.smithi096.stdout:3/294: read dc/d28/f3e [1683290,3205] 0 2024-04-18T04:57:58.428 INFO:tasks.workunit.client.0.smithi096.stdout:2/459: mknod df/d18/d87/c95 0 2024-04-18T04:57:58.431 INFO:tasks.workunit.client.0.smithi096.stdout:3/295: unlink f2 0 2024-04-18T04:57:58.432 INFO:tasks.workunit.client.0.smithi096.stdout:2/460: rename df/d18/d26/c2a to df/d18/d24/d42/d6e/c96 0 2024-04-18T04:57:58.433 INFO:tasks.workunit.client.0.smithi096.stdout:2/461: chown df/d18/d24/d42/l50 13172 1 2024-04-18T04:57:58.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.438+0000 7f8ecedd8640 1 -- 172.21.15.96:0/1692559152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8ec8152160 con 0x7f8ec806f5f0 2024-04-18T04:57:58.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.438+0000 7f8ec57fa640 1 -- 172.21.15.96:0/1692559152 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f8ec8152160 con 0x7f8ec806f5f0 2024-04-18T04:57:58.438 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:57:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.438+0000 7f8ecedd8640 1 -- 172.21.15.96:0/1692559152 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8eb4066690 msgr2=0x7f8eb4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.438+0000 7f8ecedd8640 1 --2- 172.21.15.96:0/1692559152 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8eb4066690 0x7f8eb4068b50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8159f10 tx=0x7f8ebc008040 comp rx=0 tx=0).stop 2024-04-18T04:57:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.438+0000 7f8ecedd8640 1 -- 172.21.15.96:0/1692559152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ec806f5f0 msgr2=0x7f8ec8153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.438+0000 7f8ecedd8640 1 --2- 172.21.15.96:0/1692559152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ec806f5f0 0x7f8ec8153ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8007bd0 tx=0x7f8eb800d4a0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.438+0000 7f8ecedd8640 1 -- 172.21.15.96:0/1692559152 shutdown_connections 2024-04-18T04:57:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.438+0000 7f8ecedd8640 1 --2- 172.21.15.96:0/1692559152 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8eb4066690 0x7f8eb4068b50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.438+0000 7f8ecedd8640 1 --2- 172.21.15.96:0/1692559152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ec81530f0 0x7f8ec813ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.438+0000 7f8ecedd8640 1 --2- 172.21.15.96:0/1692559152 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8ec8071cd0 0x7f8ec813e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.438+0000 7f8ecedd8640 1 --2- 172.21.15.96:0/1692559152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ec806f5f0 0x7f8ec8153ad0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.438+0000 7f8ecedd8640 1 -- 172.21.15.96:0/1692559152 >> 172.21.15.96:0/1692559152 conn(0x7f8ec806af70 msgr2=0x7f8ec8069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:58.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.438+0000 7f8ecedd8640 1 -- 172.21.15.96:0/1692559152 shutdown_connections 2024-04-18T04:57:58.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.442+0000 7f8ecedd8640 1 -- 172.21.15.96:0/1692559152 wait complete. 2024-04-18T04:57:58.441 INFO:tasks.workunit.client.0.smithi096.stdout:2/462: dwrite df/d18/d26/f4d [0,4194304] 0 2024-04-18T04:57:58.446 INFO:tasks.workunit.client.0.smithi096.stdout:2/463: unlink df/d18/d26/c66 0 2024-04-18T04:57:58.446 INFO:tasks.workunit.client.0.smithi096.stdout:3/296: dwrite dc/d26/d4a/f50 [0,4194304] 0 2024-04-18T04:57:58.448 INFO:tasks.workunit.client.0.smithi096.stdout:2/464: write df/d18/d24/d42/f2c [741577,121508] 0 2024-04-18T04:57:58.450 INFO:tasks.workunit.client.0.smithi096.stdout:3/297: mknod dc/d28/d29/c5e 0 2024-04-18T04:57:58.454 INFO:tasks.workunit.client.0.smithi096.stdout:2/465: truncate df/d18/d24/f74 3379714 0 2024-04-18T04:57:58.459 INFO:tasks.workunit.client.0.smithi096.stdout:3/298: dwrite dc/d26/d4a/f58 [0,4194304] 0 2024-04-18T04:57:58.464 INFO:tasks.workunit.client.0.smithi096.stdout:2/466: dwrite df/f14 [0,4194304] 0 2024-04-18T04:57:58.467 INFO:tasks.workunit.client.0.smithi096.stdout:3/299: dread dc/f45 [0,4194304] 0 2024-04-18T04:57:58.467 INFO:tasks.workunit.client.0.smithi096.stdout:2/467: creat df/d18/d71/f97 x:0 0 0 2024-04-18T04:57:58.469 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-18T04:57:58.470 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-18T04:57:58.470 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T04:57:58.471 INFO:tasks.workunit.client.0.smithi096.stdout:2/468: mkdir df/d18/d71/d75/d98 0 2024-04-18T04:57:58.471 INFO:tasks.workunit.client.0.smithi096.stdout:2/469: fsync df/d18/d26/f47 0 2024-04-18T04:57:58.472 INFO:tasks.workunit.client.0.smithi096.stdout:2/470: mkdir df/d18/d99 0 2024-04-18T04:57:58.475 INFO:tasks.workunit.client.0.smithi096.stdout:2/471: symlink df/l9a 0 2024-04-18T04:57:58.475 INFO:tasks.workunit.client.0.smithi096.stdout:3/300: truncate dc/fe 4255810 0 2024-04-18T04:57:58.477 INFO:tasks.workunit.client.0.smithi096.stdout:2/472: write df/d18/d26/f83 [628988,11213] 0 2024-04-18T04:57:58.479 INFO:tasks.workunit.client.0.smithi096.stdout:2/473: write df/f64 [638073,98223] 0 2024-04-18T04:57:58.481 INFO:tasks.workunit.client.0.smithi096.stdout:3/301: rename dc/c15 to dc/d28/c5f 0 2024-04-18T04:57:58.481 INFO:tasks.workunit.client.0.smithi096.stdout:2/474: mknod df/d18/d26/d48/c9b 0 2024-04-18T04:57:58.483 INFO:tasks.workunit.client.0.smithi096.stdout:3/302: write f3 [193893,86560] 0 2024-04-18T04:57:58.483 INFO:tasks.workunit.client.0.smithi096.stdout:2/475: mkdir df/d18/d71/d9c 0 2024-04-18T04:57:58.484 INFO:tasks.workunit.client.0.smithi096.stdout:3/303: readlink dc/d28/l38 0 2024-04-18T04:57:58.484 INFO:tasks.workunit.client.0.smithi096.stdout:2/476: chown df/d18/d24/d42/d3f 588658647 1 2024-04-18T04:57:58.485 INFO:tasks.workunit.client.0.smithi096.stdout:2/477: chown df/f16 582503 1 2024-04-18T04:57:58.486 INFO:tasks.workunit.client.0.smithi096.stdout:3/304: creat dc/f60 x:0 0 0 2024-04-18T04:57:58.488 INFO:tasks.workunit.client.0.smithi096.stdout:2/478: creat df/d7a/f9d x:0 0 0 2024-04-18T04:57:58.490 INFO:tasks.workunit.client.0.smithi096.stdout:3/305: dread dc/d28/f46 [0,4194304] 0 2024-04-18T04:57:58.491 INFO:tasks.workunit.client.0.smithi096.stdout:2/479: unlink df/d18/f2b 0 2024-04-18T04:57:58.491 INFO:tasks.workunit.client.0.smithi096.stdout:6/388: sync 2024-04-18T04:57:58.492 INFO:tasks.workunit.client.0.smithi096.stdout:2/480: creat df/d18/d87/f9e x:0 0 0 2024-04-18T04:57:58.493 INFO:tasks.workunit.client.0.smithi096.stdout:6/389: rename d0/d6/d2b/d4c to d0/d6/d2b/d3b/d69 0 2024-04-18T04:57:58.494 INFO:tasks.workunit.client.0.smithi096.stdout:2/481: write df/d18/d24/d42/f2c [957828,128674] 0 2024-04-18T04:57:58.496 INFO:tasks.workunit.client.0.smithi096.stdout:3/306: dread dc/d28/f46 [0,4194304] 0 2024-04-18T04:57:58.496 INFO:tasks.workunit.client.0.smithi096.stdout:3/307: fsync f3 0 2024-04-18T04:57:58.497 INFO:tasks.workunit.client.0.smithi096.stdout:6/390: rename d0/d6/d2b/d3b/d69/l61 to d0/d6/d5d/l6a 0 2024-04-18T04:57:58.497 INFO:tasks.workunit.client.0.smithi096.stdout:3/308: write dc/f42 [110201,240] 0 2024-04-18T04:57:58.498 INFO:tasks.workunit.client.0.smithi096.stdout:6/391: readlink d0/d4a/l60 0 2024-04-18T04:57:58.498 INFO:tasks.workunit.client.0.smithi096.stdout:3/309: write dc/f60 [1022603,63455] 0 2024-04-18T04:57:58.499 INFO:tasks.workunit.client.0.smithi096.stdout:2/482: rename df/d18/d71/d75/d98 to df/d7d/d9f 0 2024-04-18T04:57:58.500 INFO:tasks.workunit.client.0.smithi096.stdout:6/392: rmdir d0/d6/d29 39 2024-04-18T04:57:58.500 INFO:tasks.workunit.client.0.smithi096.stdout:3/310: symlink dc/d26/d4a/l61 0 2024-04-18T04:57:58.501 INFO:tasks.workunit.client.0.smithi096.stdout:2/483: mknod df/d18/d71/d9c/ca0 0 2024-04-18T04:57:58.503 INFO:tasks.workunit.client.0.smithi096.stdout:2/484: write df/f33 [2311232,47645] 0 2024-04-18T04:57:58.512 INFO:tasks.workunit.client.0.smithi096.stdout:3/311: write dc/f1d [4177406,107709] 0 2024-04-18T04:57:58.514 INFO:tasks.workunit.client.0.smithi096.stdout:2/485: truncate df/d18/d24/f2e 3664988 0 2024-04-18T04:57:58.514 INFO:tasks.workunit.client.0.smithi096.stdout:3/312: rmdir dc/d5d 39 2024-04-18T04:57:58.515 INFO:tasks.workunit.client.0.smithi096.stdout:2/486: symlink df/d7d/d9f/la1 0 2024-04-18T04:57:58.516 INFO:tasks.workunit.client.0.smithi096.stdout:3/313: mkdir dc/d28/d29/d62 0 2024-04-18T04:57:58.517 INFO:tasks.workunit.client.0.smithi096.stdout:2/487: readlink df/d18/d24/d42/d6e/l8a 0 2024-04-18T04:57:58.517 INFO:tasks.workunit.client.0.smithi096.stdout:2/488: write f2 [6094437,123064] 0 2024-04-18T04:57:58.520 INFO:tasks.workunit.client.0.smithi096.stdout:2/489: symlink df/la2 0 2024-04-18T04:57:58.523 INFO:tasks.workunit.client.0.smithi096.stdout:2/490: creat df/d18/d24/d42/d3f/fa3 x:0 0 0 2024-04-18T04:57:58.524 INFO:tasks.workunit.client.0.smithi096.stdout:2/491: chown df/d18/d26/c94 228478 1 2024-04-18T04:57:58.524 INFO:tasks.workunit.client.0.smithi096.stdout:3/314: dwrite dc/d28/f46 [0,4194304] 0 2024-04-18T04:57:58.525 INFO:tasks.workunit.client.0.smithi096.stdout:2/492: readlink df/d18/d24/l31 0 2024-04-18T04:57:58.529 INFO:tasks.workunit.client.0.smithi096.stdout:3/315: dread dc/d26/d4a/f50 [0,4194304] 0 2024-04-18T04:57:58.531 INFO:tasks.workunit.client.0.smithi096.stdout:2/493: rename df/d18/d24/f2e to df/d7d/d9f/fa4 0 2024-04-18T04:57:58.534 INFO:tasks.workunit.client.0.smithi096.stdout:2/494: write df/f69 [639497,41847] 0 2024-04-18T04:57:58.536 INFO:tasks.workunit.client.0.smithi096.stdout:3/316: creat dc/d28/f63 x:0 0 0 2024-04-18T04:57:58.537 INFO:tasks.workunit.client.0.smithi096.stdout:3/317: fdatasync dc/d26/d4a/f58 0 2024-04-18T04:57:58.538 INFO:tasks.workunit.client.0.smithi096.stdout:2/495: unlink df/d18/d26/c3a 0 2024-04-18T04:57:58.541 INFO:tasks.workunit.client.0.smithi096.stdout:3/318: rename dc/d28/l5b to dc/d5d/l64 0 2024-04-18T04:57:58.541 INFO:tasks.workunit.client.0.smithi096.stdout:3/319: chown f3 148423 1 2024-04-18T04:57:58.542 INFO:tasks.workunit.client.0.smithi096.stdout:3/320: read dc/d26/d4a/f50 [4008918,21686] 0 2024-04-18T04:57:58.545 INFO:tasks.workunit.client.0.smithi096.stdout:3/321: unlink dc/f1d 0 2024-04-18T04:57:58.548 INFO:tasks.workunit.client.0.smithi096.stdout:3/322: truncate f8 5048487 0 2024-04-18T04:57:58.548 INFO:tasks.workunit.client.0.smithi096.stdout:3/323: truncate dc/f53 181399 0 2024-04-18T04:57:58.549 INFO:tasks.workunit.client.0.smithi096.stdout:2/496: chown df/d7d/d9f/fa4 4104 1 2024-04-18T04:57:58.551 INFO:tasks.workunit.client.0.smithi096.stdout:3/324: creat dc/d26/d4a/f65 x:0 0 0 2024-04-18T04:57:58.552 INFO:tasks.workunit.client.0.smithi096.stdout:3/325: write dc/d5d/f5c [684123,72357] 0 2024-04-18T04:57:58.554 INFO:tasks.workunit.client.0.smithi096.stdout:3/326: mkdir dc/d26/d66 0 2024-04-18T04:57:58.556 INFO:tasks.workunit.client.0.smithi096.stdout:3/327: fsync dc/d28/f3e 0 2024-04-18T04:57:58.560 INFO:tasks.workunit.client.0.smithi096.stdout:2/497: dwrite df/f73 [0,4194304] 0 2024-04-18T04:57:58.563 INFO:tasks.workunit.client.0.smithi096.stdout:2/498: symlink df/d18/d26/la5 0 2024-04-18T04:57:58.566 INFO:tasks.workunit.client.0.smithi096.stdout:3/328: dwrite dc/f24 [0,4194304] 0 2024-04-18T04:57:58.567 INFO:tasks.workunit.client.0.smithi096.stdout:2/499: creat df/d18/d26/d48/fa6 x:0 0 0 2024-04-18T04:57:58.568 INFO:tasks.workunit.client.0.smithi096.stdout:2/500: truncate df/d18/d71/f97 415962 0 2024-04-18T04:57:58.571 INFO:tasks.workunit.client.0.smithi096.stdout:3/329: rename dc/f53 to dc/d28/f67 0 2024-04-18T04:57:58.575 INFO:tasks.workunit.client.0.smithi096.stdout:2/501: getdents df/d18 0 2024-04-18T04:57:58.579 INFO:tasks.workunit.client.0.smithi096.stdout:3/330: getdents dc 0 2024-04-18T04:57:58.580 INFO:tasks.workunit.client.0.smithi096.stdout:2/502: rename df/d18/d24/d42/d3f/f5e to df/d18/d71/d9c/fa7 0 2024-04-18T04:57:58.581 INFO:tasks.workunit.client.0.smithi096.stdout:3/331: readlink dc/lf 0 2024-04-18T04:57:58.581 INFO:tasks.workunit.client.0.smithi096.stdout:2/503: read df/d18/f38 [2541277,126591] 0 2024-04-18T04:57:58.589 INFO:tasks.workunit.client.0.smithi096.stdout:3/332: dwrite dc/f39 [0,4194304] 0 2024-04-18T04:57:58.589 INFO:tasks.workunit.client.0.smithi096.stdout:2/504: dwrite df/d7a/f9d [0,4194304] 0 2024-04-18T04:57:58.592 INFO:tasks.workunit.client.0.smithi096.stdout:3/333: rename dc/c1a to dc/d26/d57/c68 0 2024-04-18T04:57:58.592 INFO:tasks.workunit.client.0.smithi096.stdout:2/505: write df/d7a/f86 [573293,8367] 0 2024-04-18T04:57:58.594 INFO:tasks.workunit.client.0.smithi096.stdout:2/506: chown df/d18/d24/d42/f2c 2063484 1 2024-04-18T04:57:58.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.598+0000 7fc78635d640 1 Processor -- start 2024-04-18T04:57:58.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.598+0000 7fc78635d640 1 -- start start 2024-04-18T04:57:58.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc78635d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc780153060 0x7fc7800c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc78635d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc7801590f0 0x7fc7800c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc78635d640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7800c9610 con 0x7fc780158cd0 2024-04-18T04:57:58.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc78635d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc780153440 con 0x7fc7801590f0 2024-04-18T04:57:58.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc78635d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7801595f0 con 0x7fc780153060 2024-04-18T04:57:58.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc7848fa640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc7801590f0 0x7fc7800c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc7848fa640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc7801590f0 0x7fc7800c4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41992/0 (socket says 172.21.15.96:41992) 2024-04-18T04:57:58.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc7848fa640 1 -- 172.21.15.96:0/3707190671 learned_addr learned my addr 172.21.15.96:0/3707190671 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:58.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc77ffff640 1 --2- 172.21.15.96:0/3707190671 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc780153060 0x7fc7800c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc7848fa640 1 -- 172.21.15.96:0/3707190671 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc780153060 msgr2=0x7fc7800c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:58.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc7848fa640 1 --2- 172.21.15.96:0/3707190671 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc780153060 0x7fc7800c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc7848fa640 1 -- 172.21.15.96:0/3707190671 >> v1:172.21.15.139:6789/0 conn(0x7fc780158cd0 legacy=0x7fc7800c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:58.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc7848fa640 1 -- 172.21.15.96:0/3707190671 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7801598d0 con 0x7fc7801590f0 2024-04-18T04:57:58.603 INFO:tasks.workunit.client.0.smithi096.stdout:2/507: dwrite df/d18/d26/d48/f56 [0,4194304] 0 2024-04-18T04:57:58.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc7848fa640 1 --2- 172.21.15.96:0/3707190671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7801590f0 0x7fc7800c4480 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc778009e50 tx=0x7fc77801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ecd79326c788d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:58.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc77effd640 1 -- 172.21.15.96:0/3707190671 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7780af400 con 0x7fc7801590f0 2024-04-18T04:57:58.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc77effd640 1 -- 172.21.15.96:0/3707190671 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7780ab050 con 0x7fc7801590f0 2024-04-18T04:57:58.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.602+0000 7fc77effd640 1 -- 172.21.15.96:0/3707190671 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7780af780 con 0x7fc7801590f0 2024-04-18T04:57:58.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.606+0000 7fc78635d640 1 -- 172.21.15.96:0/3707190671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7801590f0 msgr2=0x7fc7800c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:58.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.606+0000 7fc78635d640 1 --2- 172.21.15.96:0/3707190671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7801590f0 0x7fc7800c4480 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc778009e50 tx=0x7fc77801f1e0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.605 INFO:tasks.workunit.client.0.smithi096.stdout:3/334: link dc/f60 dc/d26/d66/f69 0 2024-04-18T04:57:58.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.606+0000 7fc78635d640 1 -- 172.21.15.96:0/3707190671 shutdown_connections 2024-04-18T04:57:58.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.606+0000 7fc78635d640 1 --2- 172.21.15.96:0/3707190671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7801590f0 0x7fc7800c4480 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.606+0000 7fc78635d640 1 --2- 172.21.15.96:0/3707190671 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc780153060 0x7fc7800c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.606+0000 7fc78635d640 1 -- 172.21.15.96:0/3707190671 >> 172.21.15.96:0/3707190671 conn(0x7fc78006b470 msgr2=0x7fc78006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:58.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.606+0000 7fc78635d640 1 -- 172.21.15.96:0/3707190671 shutdown_connections 2024-04-18T04:57:58.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.606+0000 7fc78635d640 1 -- 172.21.15.96:0/3707190671 wait complete. 2024-04-18T04:57:58.607 INFO:tasks.workunit.client.0.smithi096.stdout:2/508: creat df/d18/d24/d42/d3f/d4a/fa8 x:0 0 0 2024-04-18T04:57:58.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.606+0000 7fc78635d640 1 Processor -- start 2024-04-18T04:57:58.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.606+0000 7fc78635d640 1 -- start start 2024-04-18T04:57:58.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.606+0000 7fc78635d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc780153060 0x7fc7800cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.606+0000 7fc78635d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc780158cd0 0x7fc7800cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.606+0000 7fc78635d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc7801590f0 0x7fc780150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc78635d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800cd1f0 con 0x7fc780158cd0 2024-04-18T04:57:58.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc78635d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7801519d0 con 0x7fc780153060 2024-04-18T04:57:58.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc78635d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800cc570 con 0x7fc7801590f0 2024-04-18T04:57:58.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc77f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc780158cd0 0x7fc7800cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc77f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc780158cd0 0x7fc7800cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42002/0 (socket says 172.21.15.96:42002) 2024-04-18T04:57:58.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc77f7fe640 1 -- 172.21.15.96:0/186182579 learned_addr learned my addr 172.21.15.96:0/186182579 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:58.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc77ffff640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc780153060 0x7fc7800cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc7848fa640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc7801590f0 0x7fc780150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc77f7fe640 1 -- 172.21.15.96:0/186182579 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc7801590f0 msgr2=0x7fc780150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:58.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc77f7fe640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc7801590f0 0x7fc780150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc77f7fe640 1 -- 172.21.15.96:0/186182579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc780153060 msgr2=0x7fc7800cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:58.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc77f7fe640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc780153060 0x7fc7800cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc77f7fe640 1 -- 172.21.15.96:0/186182579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc778009b30 con 0x7fc780158cd0 2024-04-18T04:57:58.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc7848fa640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc7801590f0 0x7fc780150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:57:58.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc77f7fe640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc780158cd0 0x7fc7800cdb50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc77400c490 tx=0x7fc774001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:58.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc77cff9640 1 -- 172.21.15.96:0/186182579 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774003600 con 0x7fc780158cd0 2024-04-18T04:57:58.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc77cff9640 1 -- 172.21.15.96:0/186182579 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc774003780 con 0x7fc780158cd0 2024-04-18T04:57:58.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc77cff9640 1 -- 172.21.15.96:0/186182579 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774003b70 con 0x7fc780158cd0 2024-04-18T04:57:58.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc78635d640 1 -- 172.21.15.96:0/186182579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7800cc850 con 0x7fc780158cd0 2024-04-18T04:57:58.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc78635d640 1 -- 172.21.15.96:0/186182579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7800cce10 con 0x7fc780158cd0 2024-04-18T04:57:58.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc78635d640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7800c9870 0x7fc7801511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc78635d640 1 -- 172.21.15.96:0/186182579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc780072290 con 0x7fc7800c9870 2024-04-18T04:57:58.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc77ffff640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7800c9870 0x7fc7801511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc77ffff640 1 -- 172.21.15.96:0/186182579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc7800c39a0 con 0x7fc7800c9870 2024-04-18T04:57:58.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.610+0000 7fc77cff9640 1 -- 172.21.15.96:0/186182579 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc774003cd0 con 0x7fc780158cd0 2024-04-18T04:57:58.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.614+0000 7fc77ffff640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7800c9870 0x7fc7801511a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc77000f4b0 tx=0x7fc77000f970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:58.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.614+0000 7fc77cff9640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc76c066690 0x7fc76c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.614+0000 7fc77cff9640 1 -- 172.21.15.96:0/186182579 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc774083420 con 0x7fc780158cd0 2024-04-18T04:57:58.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.614+0000 7fc77cff9640 1 -- 172.21.15.96:0/186182579 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770014870 con 0x7fc7800c9870 2024-04-18T04:57:58.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.614+0000 7fc77cff9640 1 -- 172.21.15.96:0/186182579 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fc7700149d0 con 0x7fc7800c9870 2024-04-18T04:57:58.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.614+0000 7fc77cff9640 1 -- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7800c9870 msgr2=0x7fc7801511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:58.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.614+0000 7fc77cff9640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7800c9870 0x7fc7801511a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc77000f4b0 tx=0x7fc77000f970 comp rx=0 tx=0).stop 2024-04-18T04:57:58.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.614+0000 7fc7848fa640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc76c066690 0x7fc76c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.614+0000 7fc77cff9640 1 -- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7800c9870 msgr2=0x7fc7801511a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:58.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.614+0000 7fc77cff9640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7800c9870 0x7fc7801511a0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc77000f4b0 tx=0x7fc77000f970 comp rx=0 tx=0).stop 2024-04-18T04:57:58.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.614+0000 7fc7848fa640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc76c066690 0x7fc76c068b50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc7780b1000 tx=0x7fc7780aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:58.614 INFO:tasks.workunit.client.0.smithi096.stdout:3/335: dread dc/f22 [0,4194304] 0 2024-04-18T04:57:58.616 INFO:tasks.workunit.client.0.smithi096.stdout:3/336: dread dc/d28/f67 [0,4194304] 0 2024-04-18T04:57:58.617 INFO:tasks.workunit.client.0.smithi096.stdout:2/509: dwrite df/d18/d24/f74 [0,4194304] 0 2024-04-18T04:57:58.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.618+0000 7fc78635d640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc780147fe0 0x7fc7801f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.618+0000 7fc78635d640 1 -- 172.21.15.96:0/186182579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800c3f60 con 0x7fc780147fe0 2024-04-18T04:57:58.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.618+0000 7fc77ffff640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc780147fe0 0x7fc7801f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.618+0000 7fc77ffff640 1 -- 172.21.15.96:0/186182579 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc7800c3c40 con 0x7fc780147fe0 2024-04-18T04:57:58.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc77ffff640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc780147fe0 0x7fc7801f67d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc77001a000 tx=0x7fc7700046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:58.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc77cff9640 1 -- 172.21.15.96:0/186182579 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770004520 con 0x7fc780147fe0 2024-04-18T04:57:58.621 INFO:tasks.workunit.client.0.smithi096.stdout:3/337: unlink dc/f12 0 2024-04-18T04:57:58.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc77cff9640 1 -- 172.21.15.96:0/186182579 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7fc770003620 con 0x7fc780147fe0 2024-04-18T04:57:58.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc77cff9640 1 -- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc780147fe0 msgr2=0x7fc7801f67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:58.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc77cff9640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc780147fe0 0x7fc7801f67d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc77001a000 tx=0x7fc7700046d0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc77cff9640 1 -- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc780147fe0 msgr2=0x7fc7801f67d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:57:58.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc77cff9640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc780147fe0 0x7fc7801f67d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.622 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:57:58.622 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:57:58.622 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:57:58.622 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T04:57:58.623 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 36, 2024-04-18T04:57:58.623 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:57:58.623 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:57:58.623 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:57:58.623 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:57:58.623 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:58.623 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 3, 2024-04-18T04:57:58.623 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:58.623 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:57:58.623 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:57:58.623 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:58.623 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:58.623 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:58.624 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:58.624 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:58.624 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:58.624 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:58.624 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:58.624 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:58.624 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:58.624 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:58.624 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:57:58.624 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:57:58.624 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:58.624 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:58.624 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:58.624 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:58.625 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:58.625 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:58.625 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:58.625 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:58.625 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:58.625 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:58.625 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:58.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:58.625 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:57:58.625 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:57:58.625 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:57:58.626 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:57:58.626 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:57:58.626 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:57:58.626 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:58.626 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:57:58.627 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:57:58.627 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:57:58.627 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:57:58.627 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:57:58.627 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:57:58.627 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:57:58.627 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:57:58.627 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:57:58.627 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:57:58.627 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:57:58.627 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:57:58.627 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:57:58.627 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:57:58.627 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:57:58.627 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:57:58.628 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:57:58.628 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:57:58.628 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:57:58.628 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:57:58.628 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:58.628 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:57:58.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:58.628 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:57:58.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:58.628 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:57:58.628 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:57:58.628 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:58.628 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:58.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:58.628 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:58.628 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:57:58.629 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:58.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:58.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:58.629 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:58.629 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:57:58.629 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:58.629 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:58.629 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:58.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:58.629 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:57:58.629 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:57:58.629 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:58.629 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:58.629 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:58.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:58.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:58.630 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:57:58.630 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:57:58.630 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:58.630 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:58.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:58.630 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:58.630 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:57:58.630 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:58.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:58.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:58.630 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:58.630 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:57:58.630 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:58.630 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:58.631 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:58.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:58.631 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:57:58.631 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:57:58.631 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:58.631 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:58.631 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:58.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:58.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:58.631 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:57:58.631 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:57:58.631 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:57:58.631 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:57:58.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:58.631 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:57:58.631 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:57:58.632 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:58.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:58.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:58.632 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:57:58.632 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:57:58.632 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:57:58.632 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:58.632 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:58.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:58.632 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:57:58.632 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:57:58.632 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:57:58.632 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:57:58.632 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:57:58.632 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:58.632 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:58.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:58.633 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:57:58.633 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:57:58.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:58.633 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:58.633 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:58.633 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:57:58.633 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:58.633 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:58.633 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:57:58.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:58.633 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:58.633 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:58.633 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:57:58.633 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:58.633 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:58.634 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:57:58.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:58.634 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:58.634 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:58.634 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:57:58.634 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:58.634 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:58.634 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:57:58.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:58.634 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:58.634 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:58.634 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5 2024-04-18T04:57:58.634 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:58.634 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:57:58.635 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:57:58.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:57:58.635 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:57:58.635 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:57:58.635 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:57:58.635 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:57:58.635 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:57:58.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:57:58.635 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:57:58.635 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:57:58.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc78635d640 1 -- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc76c066690 msgr2=0x7fc76c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:58.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc78635d640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc76c066690 0x7fc76c068b50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc7780b1000 tx=0x7fc7780aa000 comp rx=0 tx=0).stop 2024-04-18T04:57:58.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc78635d640 1 -- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc780158cd0 msgr2=0x7fc7800cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:58.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc78635d640 1 --2- 172.21.15.96:0/186182579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc780158cd0 0x7fc7800cdb50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc77400c490 tx=0x7fc774001e80 comp rx=0 tx=0).stop 2024-04-18T04:57:58.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc7848fa640 1 -- 172.21.15.96:0/186182579 reap_dead start 2024-04-18T04:57:58.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc7848fa640 1 -- 172.21.15.96:0/186182579 reap_dead start 2024-04-18T04:57:58.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc78635d640 1 -- 172.21.15.96:0/186182579 shutdown_connections 2024-04-18T04:57:58.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc78635d640 1 -- 172.21.15.96:0/186182579 >> 172.21.15.96:0/186182579 conn(0x7fc78006b470 msgr2=0x7fc780156820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:58.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc78635d640 1 -- 172.21.15.96:0/186182579 shutdown_connections 2024-04-18T04:57:58.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.622+0000 7fc78635d640 1 -- 172.21.15.96:0/186182579 wait complete. 2024-04-18T04:57:58.638 INFO:tasks.workunit.client.0.smithi096.stdout:2/510: symlink df/d18/d24/d42/d6e/la9 0 2024-04-18T04:57:58.638 INFO:tasks.workunit.client.0.smithi096.stdout:2/511: readlink df/d18/d24/d42/d3f/l4e 0 2024-04-18T04:57:58.638 INFO:tasks.workunit.client.0.smithi096.stdout:3/338: unlink dc/f20 0 2024-04-18T04:57:58.638 INFO:tasks.workunit.client.0.smithi096.stdout:3/339: creat dc/d28/d29/d62/f6a x:0 0 0 2024-04-18T04:57:58.638 INFO:tasks.workunit.client.0.smithi096.stdout:3/340: rmdir dc/d26/d48 39 2024-04-18T04:57:58.638 INFO:tasks.workunit.client.0.smithi096.stdout:3/341: mkdir dc/d26/d4a/d6b 0 2024-04-18T04:57:58.638 INFO:tasks.workunit.client.0.smithi096.stdout:3/342: write dc/d26/d4a/f50 [2636519,17921] 0 2024-04-18T04:57:58.638 INFO:tasks.workunit.client.0.smithi096.stdout:3/343: creat dc/d26/d4a/f6c x:0 0 0 2024-04-18T04:57:58.639 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:57:58.639 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-18T04:57:58.639 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-18T04:57:58.640 INFO:tasks.workunit.client.0.smithi096.stdout:3/344: dwrite dc/d28/f46 [0,4194304] 0 2024-04-18T04:57:58.641 INFO:tasks.workunit.client.0.smithi096.stdout:3/345: chown dc/d26/d57/c68 6901944 1 2024-04-18T04:57:58.644 INFO:tasks.workunit.client.0.smithi096.stdout:3/346: creat dc/d5d/f6d x:0 0 0 2024-04-18T04:57:58.645 INFO:tasks.workunit.client.0.smithi096.stdout:3/347: fsync dc/d26/d48/f4f 0 2024-04-18T04:57:58.646 INFO:tasks.workunit.client.0.smithi096.stdout:3/348: readlink dc/lf 0 2024-04-18T04:57:58.646 INFO:tasks.workunit.client.0.smithi096.stdout:3/349: stat dc/d28/d29/d62 0 2024-04-18T04:57:58.648 INFO:tasks.workunit.client.0.smithi096.stdout:1/367: sync 2024-04-18T04:57:58.648 INFO:tasks.workunit.client.0.smithi096.stdout:3/350: mknod dc/c6e 0 2024-04-18T04:57:58.653 INFO:tasks.workunit.client.0.smithi096.stdout:3/351: creat dc/d28/d29/f6f x:0 0 0 2024-04-18T04:57:58.654 INFO:tasks.workunit.client.0.smithi096.stdout:3/352: mkdir dc/d70 0 2024-04-18T04:57:58.655 INFO:tasks.workunit.client.0.smithi096.stdout:1/368: dwrite de/d1d/d3f/f45 [4194304,4194304] 0 2024-04-18T04:57:58.656 INFO:tasks.workunit.client.0.smithi096.stdout:3/353: chown dc/d26/d4a/f65 5317225 1 2024-04-18T04:57:58.661 INFO:tasks.workunit.client.0.smithi096.stdout:3/354: getdents dc/d26/d4a 0 2024-04-18T04:57:58.661 INFO:tasks.workunit.client.0.smithi096.stdout:3/355: stat f8 0 2024-04-18T04:57:58.661 INFO:tasks.workunit.client.0.smithi096.stdout:1/369: write de/d1d/f25 [222198,78449] 0 2024-04-18T04:57:58.663 INFO:tasks.workunit.client.0.smithi096.stdout:1/370: creat de/f6a x:0 0 0 2024-04-18T04:57:58.664 INFO:tasks.workunit.client.0.smithi096.stdout:3/356: link dc/d5d/c40 dc/d26/d57/c71 0 2024-04-18T04:57:58.665 INFO:tasks.workunit.client.0.smithi096.stdout:1/371: mkdir de/d1d/d32/d6b 0 2024-04-18T04:57:58.668 INFO:tasks.workunit.client.0.smithi096.stdout:3/357: dread dc/d5d/f5c [0,4194304] 0 2024-04-18T04:57:58.669 INFO:tasks.workunit.client.0.smithi096.stdout:3/358: write dc/d5d/f6d [814865,48175] 0 2024-04-18T04:57:58.672 INFO:tasks.workunit.client.0.smithi096.stdout:1/372: dwrite de/f29 [0,4194304] 0 2024-04-18T04:57:58.678 INFO:tasks.workunit.client.0.smithi096.stdout:3/359: dwrite dc/d28/f46 [0,4194304] 0 2024-04-18T04:57:58.683 INFO:tasks.workunit.client.0.smithi096.stdout:1/373: dwrite de/f12 [0,4194304] 0 2024-04-18T04:57:58.684 INFO:tasks.workunit.client.0.smithi096.stdout:3/360: rmdir dc 39 2024-04-18T04:57:58.684 INFO:tasks.workunit.client.0.smithi096.stdout:1/374: chown de/d1d/d3f/c48 27 1 2024-04-18T04:57:58.686 INFO:tasks.workunit.client.0.smithi096.stdout:3/361: readlink dc/d26/d4a/l61 0 2024-04-18T04:57:58.687 INFO:tasks.workunit.client.0.smithi096.stdout:1/375: creat de/d1d/d3f/f6c x:0 0 0 2024-04-18T04:57:58.688 INFO:tasks.workunit.client.0.smithi096.stdout:3/362: getdents dc/d26/d48 0 2024-04-18T04:57:58.689 INFO:tasks.workunit.client.0.smithi096.stdout:1/376: symlink de/d1d/d3f/d5f/l6d 0 2024-04-18T04:57:58.690 INFO:tasks.workunit.client.0.smithi096.stdout:1/377: dread - de/f34 zero size 2024-04-18T04:57:58.691 INFO:tasks.workunit.client.0.smithi096.stdout:1/378: dread - de/f5b zero size 2024-04-18T04:57:58.691 INFO:tasks.workunit.client.0.smithi096.stdout:3/363: dread dc/d5d/f6d [0,4194304] 0 2024-04-18T04:57:58.692 INFO:tasks.workunit.client.0.smithi096.stdout:1/379: write de/f16 [273870,80224] 0 2024-04-18T04:57:58.695 INFO:tasks.workunit.client.0.smithi096.stdout:1/380: creat de/d1d/d3f/f6e x:0 0 0 2024-04-18T04:57:58.695 INFO:tasks.workunit.client.0.smithi096.stdout:1/381: fsync de/d1d/d3f/f63 0 2024-04-18T04:57:58.697 INFO:tasks.workunit.client.0.smithi096.stdout:1/382: unlink de/f5b 0 2024-04-18T04:57:58.697 INFO:tasks.workunit.client.0.smithi096.stdout:1/383: readlink de/d1d/l53 0 2024-04-18T04:57:58.698 INFO:tasks.workunit.client.0.smithi096.stdout:1/384: write de/d1d/d32/f57 [1043651,56322] 0 2024-04-18T04:57:58.699 INFO:tasks.workunit.client.0.smithi096.stdout:1/385: write de/d1d/d3f/f6c [743090,31549] 0 2024-04-18T04:57:58.701 INFO:tasks.workunit.client.0.smithi096.stdout:3/364: write dc/d28/f3e [3588850,77627] 0 2024-04-18T04:57:58.701 INFO:tasks.workunit.client.0.smithi096.stdout:1/386: write de/d1d/f5d [4037866,87749] 0 2024-04-18T04:57:58.703 INFO:tasks.workunit.client.0.smithi096.stdout:3/365: write dc/f18 [1865414,116864] 0 2024-04-18T04:57:58.703 INFO:tasks.workunit.client.0.smithi096.stdout:1/387: mkdir de/d1d/d32/d6f 0 2024-04-18T04:57:58.704 INFO:tasks.workunit.client.0.smithi096.stdout:1/388: chown de/f5e 76236 1 2024-04-18T04:57:58.705 INFO:tasks.workunit.client.0.smithi096.stdout:1/389: chown de/c50 10882 1 2024-04-18T04:57:58.707 INFO:tasks.workunit.client.0.smithi096.stdout:1/390: creat de/d1d/f70 x:0 0 0 2024-04-18T04:57:58.710 INFO:tasks.workunit.client.0.smithi096.stdout:3/366: dwrite dc/f18 [0,4194304] 0 2024-04-18T04:57:58.715 INFO:tasks.workunit.client.0.smithi096.stdout:1/391: rmdir de/d1d/d3f/d4f/d67 0 2024-04-18T04:57:58.717 INFO:tasks.workunit.client.0.smithi096.stdout:1/392: truncate de/f16 1057490 0 2024-04-18T04:57:58.717 INFO:tasks.workunit.client.0.smithi096.stdout:1/393: fdatasync de/f12 0 2024-04-18T04:57:58.721 INFO:tasks.workunit.client.0.smithi096.stdout:1/394: symlink de/d1d/d32/d6f/l71 0 2024-04-18T04:57:58.721 INFO:tasks.workunit.client.0.smithi096.stdout:3/367: dwrite dc/f60 [0,4194304] 0 2024-04-18T04:57:58.724 INFO:tasks.workunit.client.0.smithi096.stdout:1/395: creat de/f72 x:0 0 0 2024-04-18T04:57:58.726 INFO:tasks.workunit.client.0.smithi096.stdout:1/396: write de/d1d/f66 [2731758,37309] 0 2024-04-18T04:57:58.727 INFO:tasks.workunit.client.0.smithi096.stdout:3/368: dread dc/d28/f3e [0,4194304] 0 2024-04-18T04:57:58.731 INFO:tasks.workunit.client.0.smithi096.stdout:3/369: creat dc/d26/f72 x:0 0 0 2024-04-18T04:57:58.732 INFO:tasks.workunit.client.0.smithi096.stdout:3/370: write dc/d28/f33 [3604976,116665] 0 2024-04-18T04:57:58.735 INFO:tasks.workunit.client.0.smithi096.stdout:1/397: dwrite de/f34 [0,4194304] 0 2024-04-18T04:57:58.735 INFO:tasks.workunit.client.0.smithi096.stdout:3/371: creat dc/d70/f73 x:0 0 0 2024-04-18T04:57:58.737 INFO:tasks.workunit.client.0.smithi096.stdout:1/398: mkdir de/d1d/d32/d73 0 2024-04-18T04:57:58.742 INFO:tasks.workunit.client.0.smithi096.stdout:3/372: dread dc/f1b [0,4194304] 0 2024-04-18T04:57:58.745 INFO:tasks.workunit.client.0.smithi096.stdout:1/399: dwrite de/f18 [0,4194304] 0 2024-04-18T04:57:58.745 INFO:tasks.workunit.client.0.smithi096.stdout:3/373: creat dc/d28/f74 x:0 0 0 2024-04-18T04:57:58.748 INFO:tasks.workunit.client.0.smithi096.stdout:3/374: mknod dc/d28/c75 0 2024-04-18T04:57:58.752 INFO:tasks.workunit.client.0.smithi096.stdout:1/400: mkdir de/d1d/d3f/d74 0 2024-04-18T04:57:58.754 INFO:tasks.workunit.client.0.smithi096.stdout:1/401: unlink de/f3b 0 2024-04-18T04:57:58.756 INFO:tasks.workunit.client.0.smithi096.stdout:3/375: unlink cb 0 2024-04-18T04:57:58.757 INFO:tasks.workunit.client.0.smithi096.stdout:3/376: chown dc/d26/d4a/f50 245451 1 2024-04-18T04:57:58.761 INFO:tasks.workunit.client.0.smithi096.stdout:3/377: getdents dc/d5d 0 2024-04-18T04:57:58.761 INFO:tasks.workunit.client.0.smithi096.stdout:3/378: readlink dc/d5d/l64 0 2024-04-18T04:57:58.763 INFO:tasks.workunit.client.0.smithi096.stdout:3/379: truncate dc/f10 4219572 0 2024-04-18T04:57:58.767 INFO:tasks.workunit.client.0.smithi096.stdout:3/380: rename dc/d28 to dc/d26/d76 0 2024-04-18T04:57:58.768 INFO:tasks.workunit.client.0.smithi096.stdout:3/381: truncate dc/d26/d76/f67 303727 0 2024-04-18T04:57:58.776 INFO:tasks.workunit.client.0.smithi096.stdout:3/382: truncate dc/f1b 1465178 0 2024-04-18T04:57:58.777 INFO:tasks.workunit.client.0.smithi096.stdout:3/383: symlink dc/d5d/l77 0 2024-04-18T04:57:58.784 INFO:tasks.workunit.client.0.smithi096.stdout:3/384: dwrite dc/d26/d4a/f65 [0,4194304] 0 2024-04-18T04:57:58.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.774+0000 7f14ddeb7640 1 Processor -- start 2024-04-18T04:57:58.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.774+0000 7f14ddeb7640 1 -- start start 2024-04-18T04:57:58.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.774+0000 7f14ddeb7640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f14d815fee0 0x7f14d808a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.774+0000 7f14ddeb7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f14d808a820 0x7f14d806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.774+0000 7f14ddeb7640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d808ad00 con 0x7f14d806bf20 2024-04-18T04:57:58.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.774+0000 7f14ddeb7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d8169560 con 0x7f14d808a820 2024-04-18T04:57:58.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.774+0000 7f14ddeb7640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d8169840 con 0x7f14d815fee0 2024-04-18T04:57:58.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.774+0000 7f14d7fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f14d806bf20 0x7f14d8166060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:41484/0 (socket says 172.21.15.96:41484) 2024-04-18T04:57:58.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.774+0000 7f14cffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f14d808a820 0x7f14d806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.774+0000 7f14d7fff640 1 -- 172.21.15.96:0/1022257145 learned_addr learned my addr 172.21.15.96:0/1022257145 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:57:58.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.774+0000 7f14d77fe640 1 --2- 172.21.15.96:0/1022257145 >> v2:172.21.15.139:3300/0 conn(0x7f14d815fee0 0x7f14d808a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.774+0000 7f14d6ffd640 1 -- 172.21.15.96:0/1022257145 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263027067 0 0) 0x7f14d808ad00 con 0x7f14d806bf20 2024-04-18T04:57:58.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.786+0000 7f14d6ffd640 1 -- 172.21.15.96:0/1022257145 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14c4003510 con 0x7f14d806bf20 2024-04-18T04:57:58.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.786+0000 7f14d6ffd640 1 -- 172.21.15.96:0/1022257145 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2731878931 0 0) 0x7f14c4003510 con 0x7f14d806bf20 2024-04-18T04:57:58.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.786+0000 7f14cffff640 1 -- 172.21.15.96:0/1022257145 >> v2:172.21.15.139:3300/0 conn(0x7f14d815fee0 msgr2=0x7f14d808a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:57:58.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.786+0000 7f14cffff640 1 --2- 172.21.15.96:0/1022257145 >> v2:172.21.15.139:3300/0 conn(0x7f14d815fee0 0x7f14d808a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.786+0000 7f14cffff640 1 -- 172.21.15.96:0/1022257145 >> v1:172.21.15.96:6789/0 conn(0x7f14d806bf20 legacy=0x7f14d8166060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:58.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.786+0000 7f14cffff640 1 -- 172.21.15.96:0/1022257145 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d8169b20 con 0x7f14d808a820 2024-04-18T04:57:58.790 INFO:tasks.workunit.client.0.smithi096.stdout:3/385: creat dc/d26/f78 x:0 0 0 2024-04-18T04:57:58.790 INFO:tasks.workunit.client.0.smithi096.stdout:9/231: sync 2024-04-18T04:57:58.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.790+0000 7f14cffff640 1 --2- 172.21.15.96:0/1022257145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14d808a820 0x7f14d806b9e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14d80c79d0 tx=0x7f14c001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b140a1314f2dafd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:58.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.790+0000 7f14d6ffd640 1 -- 172.21.15.96:0/1022257145 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0001a00 con 0x7f14d808a820 2024-04-18T04:57:58.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.790+0000 7f14d6ffd640 1 -- 172.21.15.96:0/1022257145 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c00a9070 con 0x7f14d808a820 2024-04-18T04:57:58.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.790+0000 7f14d6ffd640 1 -- 172.21.15.96:0/1022257145 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c00a5ab0 con 0x7f14d808a820 2024-04-18T04:57:58.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.790+0000 7f14ddeb7640 1 -- 172.21.15.96:0/1022257145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14d808a820 msgr2=0x7f14d806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:58.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.790+0000 7f14ddeb7640 1 --2- 172.21.15.96:0/1022257145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14d808a820 0x7f14d806b9e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14d80c79d0 tx=0x7f14c001ca40 comp rx=0 tx=0).stop 2024-04-18T04:57:58.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.790+0000 7f14ddeb7640 1 -- 172.21.15.96:0/1022257145 shutdown_connections 2024-04-18T04:57:58.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.790+0000 7f14ddeb7640 1 --2- 172.21.15.96:0/1022257145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14d808a820 0x7f14d806b9e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.790+0000 7f14ddeb7640 1 --2- 172.21.15.96:0/1022257145 >> v2:172.21.15.139:3300/0 conn(0x7f14d815fee0 0x7f14d808a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.790+0000 7f14ddeb7640 1 -- 172.21.15.96:0/1022257145 >> 172.21.15.96:0/1022257145 conn(0x7f14d806a8e0 msgr2=0x7f14d80c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:57:58.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.790+0000 7f14ddeb7640 1 -- 172.21.15.96:0/1022257145 shutdown_connections 2024-04-18T04:57:58.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.790+0000 7f14ddeb7640 1 -- 172.21.15.96:0/1022257145 wait complete. 2024-04-18T04:57:58.792 INFO:tasks.workunit.client.0.smithi096.stdout:3/386: mknod dc/c79 0 2024-04-18T04:57:58.792 INFO:tasks.workunit.client.0.smithi096.stdout:3/387: chown dc/d26/c2b 1238 1 2024-04-18T04:57:58.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14ddeb7640 1 Processor -- start 2024-04-18T04:57:58.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14ddeb7640 1 -- start start 2024-04-18T04:57:58.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14ddeb7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14d806bf20 0x7f14d8162bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14ddeb7640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f14d808a820 0x7f14d8160680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14ddeb7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d815fee0 0x7f14d80c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.793 INFO:tasks.workunit.client.0.smithi096.stdout:9/232: write d0/d25/f35 [11394,47766] 0 2024-04-18T04:57:58.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14ddeb7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d8163100 con 0x7f14d806bf20 2024-04-18T04:57:58.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14ddeb7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d81634c0 con 0x7f14d815fee0 2024-04-18T04:57:58.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14ddeb7640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d8201f20 con 0x7f14d808a820 2024-04-18T04:57:58.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14d77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14d806bf20 0x7f14d8162bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14d77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14d806bf20 0x7f14d8162bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42026/0 (socket says 172.21.15.96:42026) 2024-04-18T04:57:58.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14d77fe640 1 -- 172.21.15.96:0/267710781 learned_addr learned my addr 172.21.15.96:0/267710781 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:57:58.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14cffff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f14d808a820 0x7f14d8160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14d7fff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d815fee0 0x7f14d80c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14d77fe640 1 -- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f14d808a820 msgr2=0x7f14d8160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:58.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14d77fe640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f14d808a820 0x7f14d8160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14d77fe640 1 -- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d815fee0 msgr2=0x7f14d80c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:57:58.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14d77fe640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d815fee0 0x7f14d80c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:57:58.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14d77fe640 1 -- 172.21.15.96:0/267710781 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c000b520 con 0x7f14d806bf20 2024-04-18T04:57:58.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14d77fe640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14d806bf20 0x7f14d8162bc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14c800e950 tx=0x7f14c800ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:58.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14d4ff9640 1 -- 172.21.15.96:0/267710781 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c800c6d0 con 0x7f14d806bf20 2024-04-18T04:57:58.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14d4ff9640 1 -- 172.21.15.96:0/267710781 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c800c850 con 0x7f14d806bf20 2024-04-18T04:57:58.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14ddeb7640 1 -- 172.21.15.96:0/267710781 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d8202450 con 0x7f14d806bf20 2024-04-18T04:57:58.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14d4ff9640 1 -- 172.21.15.96:0/267710781 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c800cc00 con 0x7f14d806bf20 2024-04-18T04:57:58.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14ddeb7640 1 -- 172.21.15.96:0/267710781 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d8202170 con 0x7f14d806bf20 2024-04-18T04:57:58.796 INFO:tasks.workunit.client.0.smithi096.stdout:9/233: write d0/de/f16 [307883,85556] 0 2024-04-18T04:57:58.797 INFO:tasks.workunit.client.0.smithi096.stdout:3/388: getdents dc/d26/d4a 0 2024-04-18T04:57:58.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14ddeb7640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 0x7f14d80c2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14ddeb7640 1 -- 172.21.15.96:0/267710781 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d8066b90 con 0x7f14d80c4260 2024-04-18T04:57:58.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.794+0000 7f14cffff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 0x7f14d80c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.798+0000 7f14cffff640 1 -- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 msgr2=0x7f14d80c2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-04-18T04:57:58.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.798+0000 7f14cffff640 1 -- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 msgr2=0x7f14d80c2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T04:57:58.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.798+0000 7f14cffff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 0x7f14d80c2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:58.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.798+0000 7f14cffff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 0x7f14d80c2f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:57:58.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.798+0000 7f14d4ff9640 1 -- 172.21.15.96:0/267710781 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f14c8013410 con 0x7f14d806bf20 2024-04-18T04:57:58.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.798+0000 7f14d4ff9640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f14b80666c0 0x7f14b8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:57:58.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.798+0000 7f14d4ff9640 1 -- 172.21.15.96:0/267710781 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f14c8083ec0 con 0x7f14d806bf20 2024-04-18T04:57:58.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.798+0000 7f14d7fff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f14b80666c0 0x7f14b8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:58.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:58.798+0000 7f14d7fff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f14b80666c0 0x7f14b8068b80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f14d80c14d0 tx=0x7f14d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:57:58.799 INFO:tasks.workunit.client.0.smithi096.stdout:9/234: symlink d0/de/d17/d48/l51 0 2024-04-18T04:57:58.799 INFO:tasks.workunit.client.0.smithi096.stdout:3/389: unlink dc/d26/d76/f67 0 2024-04-18T04:57:58.800 INFO:tasks.workunit.client.0.smithi096.stdout:9/235: mkdir d0/d52 0 2024-04-18T04:57:58.803 INFO:tasks.workunit.client.0.smithi096.stdout:9/236: mknod d0/c53 0 2024-04-18T04:57:58.808 INFO:tasks.workunit.client.0.smithi096.stdout:9/237: rename d0/de/l4c to d0/d25/l54 0 2024-04-18T04:57:58.809 INFO:tasks.workunit.client.0.smithi096.stdout:3/390: dwrite dc/f1b [0,4194304] 0 2024-04-18T04:57:58.810 INFO:tasks.workunit.client.0.smithi096.stdout:9/238: symlink d0/d25/d3a/l55 0 2024-04-18T04:57:58.811 INFO:tasks.workunit.client.0.smithi096.stdout:9/239: write d0/d25/f35 [892024,123471] 0 2024-04-18T04:57:58.813 INFO:tasks.workunit.client.0.smithi096.stdout:3/391: creat dc/d26/d57/f7a x:0 0 0 2024-04-18T04:57:58.816 INFO:tasks.workunit.client.0.smithi096.stdout:9/240: unlink d0/c38 0 2024-04-18T04:57:58.817 INFO:tasks.workunit.client.0.smithi096.stdout:3/392: write dc/f24 [3137002,32978] 0 2024-04-18T04:57:58.817 INFO:tasks.workunit.client.0.smithi096.stdout:9/241: write d0/f4b [2085162,88073] 0 2024-04-18T04:57:58.820 INFO:tasks.workunit.client.0.smithi096.stdout:3/393: rmdir dc/d70 39 2024-04-18T04:57:58.823 INFO:tasks.workunit.client.0.smithi096.stdout:3/394: creat dc/d26/d4a/d6b/f7b x:0 0 0 2024-04-18T04:57:58.826 INFO:tasks.workunit.client.0.smithi096.stdout:3/395: creat dc/f7c x:0 0 0 2024-04-18T04:57:58.828 INFO:tasks.workunit.client.0.smithi096.stdout:9/242: dread d0/de/d17/f20 [0,4194304] 0 2024-04-18T04:57:58.830 INFO:tasks.workunit.client.0.smithi096.stdout:3/396: rename dc/d26/c4e to dc/d26/c7d 0 2024-04-18T04:57:58.831 INFO:tasks.workunit.client.0.smithi096.stdout:9/243: dread d0/de/d17/f23 [0,4194304] 0 2024-04-18T04:57:58.835 INFO:tasks.workunit.client.0.smithi096.stdout:9/244: rename d0/de/d17/d48 to d0/de/d17/d56 0 2024-04-18T04:57:58.836 INFO:tasks.workunit.client.0.smithi096.stdout:9/245: chown d0/d25/d3a/l45 9576 1 2024-04-18T04:57:58.837 INFO:tasks.workunit.client.0.smithi096.stdout:9/246: fdatasync d0/de/d17/f23 0 2024-04-18T04:57:58.840 INFO:tasks.workunit.client.0.smithi096.stdout:9/247: creat d0/de/d17/f57 x:0 0 0 2024-04-18T04:57:58.845 INFO:tasks.workunit.client.0.smithi096.stdout:9/248: rename d0/de/d17/l31 to d0/d25/l58 0 2024-04-18T04:57:58.846 INFO:tasks.workunit.client.0.smithi096.stdout:3/397: dread dc/f10 [0,4194304] 0 2024-04-18T04:57:58.847 INFO:tasks.workunit.client.0.smithi096.stdout:9/249: mkdir d0/de/d17/d56/d59 0 2024-04-18T04:57:58.853 INFO:tasks.workunit.client.0.smithi096.stdout:3/398: dwrite dc/f24 [0,4194304] 0 2024-04-18T04:57:58.854 INFO:tasks.workunit.client.0.smithi096.stdout:3/399: truncate dc/d26/d76/d29/f6f 442118 0 2024-04-18T04:57:58.858 INFO:tasks.workunit.client.0.smithi096.stdout:9/250: dwrite d0/de/d17/d2f/d40/f34 [0,4194304] 0 2024-04-18T04:57:58.862 INFO:tasks.workunit.client.0.smithi096.stdout:3/400: truncate dc/d26/d76/f33 147784 0 2024-04-18T04:57:58.867 INFO:tasks.workunit.client.0.smithi096.stdout:3/401: dread dc/d26/d4a/f4b [0,4194304] 0 2024-04-18T04:57:58.869 INFO:tasks.workunit.client.0.smithi096.stdout:3/402: chown dc/c1c 721911 1 2024-04-18T04:57:58.870 INFO:tasks.workunit.client.0.smithi096.stdout:3/403: write dc/f18 [3954194,125627] 0 2024-04-18T04:57:58.872 INFO:tasks.workunit.client.0.smithi096.stdout:9/251: dread d0/f4b [0,4194304] 0 2024-04-18T04:57:58.872 INFO:tasks.workunit.client.0.smithi096.stdout:9/252: readlink d0/d25/l44 0 2024-04-18T04:57:58.873 INFO:tasks.workunit.client.0.smithi096.stdout:3/404: unlink dc/c13 0 2024-04-18T04:57:58.875 INFO:tasks.workunit.client.0.smithi096.stdout:3/405: mkdir dc/d26/d76/d29/d7e 0 2024-04-18T04:57:58.877 INFO:tasks.workunit.client.0.smithi096.stdout:3/406: read dc/d26/d4a/f4b [1764828,72006] 0 2024-04-18T04:57:58.880 INFO:tasks.workunit.client.0.smithi096.stdout:9/253: dwrite d0/de/d17/f57 [0,4194304] 0 2024-04-18T04:57:58.881 INFO:tasks.workunit.client.0.smithi096.stdout:9/254: chown d0/de/d17/d56/d59 38 1 2024-04-18T04:57:58.882 INFO:tasks.workunit.client.0.smithi096.stdout:3/407: getdents dc/d26/d76/d29/d62 0 2024-04-18T04:57:58.886 INFO:tasks.workunit.client.0.smithi096.stdout:9/255: getdents d0/de/d17 0 2024-04-18T04:57:58.889 INFO:tasks.workunit.client.0.smithi096.stdout:9/256: mkdir d0/d52/d5a 0 2024-04-18T04:57:58.891 INFO:tasks.workunit.client.0.smithi096.stdout:3/408: dwrite dc/d5d/f5c [0,4194304] 0 2024-04-18T04:57:58.893 INFO:tasks.workunit.client.0.smithi096.stdout:3/409: write dc/d26/d4a/f65 [556678,69290] 0 2024-04-18T04:57:58.894 INFO:tasks.workunit.client.0.smithi096.stdout:3/410: chown dc/d26/d4a/d6b/f7b 1 1 2024-04-18T04:57:58.896 INFO:tasks.workunit.client.0.smithi096.stdout:3/411: chown dc/f45 30 1 2024-04-18T04:57:58.897 INFO:tasks.workunit.client.0.smithi096.stdout:3/412: write dc/d5d/f5c [2559816,124990] 0 2024-04-18T04:57:58.900 INFO:tasks.workunit.client.0.smithi096.stdout:9/257: dwrite d0/d25/f35 [0,4194304] 0 2024-04-18T04:57:58.902 INFO:tasks.workunit.client.0.smithi096.stdout:3/413: mkdir dc/d26/d66/d7f 0 2024-04-18T04:57:58.905 INFO:tasks.workunit.client.0.smithi096.stdout:9/258: mkdir d0/d25/d5b 0 2024-04-18T04:57:58.905 INFO:tasks.workunit.client.0.smithi096.stdout:3/414: symlink dc/d26/d57/l80 0 2024-04-18T04:57:58.908 INFO:tasks.workunit.client.0.smithi096.stdout:3/415: dread dc/f42 [0,4194304] 0 2024-04-18T04:57:58.911 INFO:tasks.workunit.client.0.smithi096.stdout:3/416: symlink dc/d26/d76/l81 0 2024-04-18T04:57:58.912 INFO:tasks.workunit.client.0.smithi096.stdout:3/417: rmdir dc/d26/d76/d29/d62 39 2024-04-18T04:57:58.916 INFO:tasks.workunit.client.0.smithi096.stdout:9/259: dread d0/de/d17/f2a [0,4194304] 0 2024-04-18T04:57:58.917 INFO:tasks.workunit.client.0.smithi096.stdout:3/418: rename dc/c2d to dc/d5d/c82 0 2024-04-18T04:57:58.918 INFO:tasks.workunit.client.0.smithi096.stdout:9/260: mkdir d0/de/d17/d5c 0 2024-04-18T04:57:58.918 INFO:tasks.workunit.client.0.smithi096.stdout:3/419: rename dc/d26 to dc/d26/d76/d83 22 2024-04-18T04:57:58.921 INFO:tasks.workunit.client.0.smithi096.stdout:9/261: symlink d0/de/d17/d56/d59/l5d 0 2024-04-18T04:57:58.923 INFO:tasks.workunit.client.0.smithi096.stdout:3/420: rename dc/c25 to dc/d26/d76/d29/c84 0 2024-04-18T04:57:58.924 INFO:tasks.workunit.client.0.smithi096.stdout:9/262: creat d0/d25/d5b/f5e x:0 0 0 2024-04-18T04:57:58.925 INFO:tasks.workunit.client.0.smithi096.stdout:9/263: fsync d0/f4b 0 2024-04-18T04:57:58.930 INFO:tasks.workunit.client.0.smithi096.stdout:3/421: dwrite dc/d26/d48/f4f [0,4194304] 0 2024-04-18T04:57:58.933 INFO:tasks.workunit.client.0.smithi096.stdout:3/422: rename dc/d26/d4a/f4b to dc/d26/d66/d7f/f85 0 2024-04-18T04:57:58.937 INFO:tasks.workunit.client.0.smithi096.stdout:3/423: dread dc/f18 [0,4194304] 0 2024-04-18T04:57:58.938 INFO:tasks.workunit.client.0.smithi096.stdout:3/424: readlink dc/l19 0 2024-04-18T04:57:58.940 INFO:tasks.workunit.client.0.smithi096.stdout:3/425: creat dc/d5d/f86 x:0 0 0 2024-04-18T04:57:58.945 INFO:tasks.workunit.client.0.smithi096.stdout:3/426: rename dc/d26/d76/d29/l43 to dc/d26/d76/d29/d62/l87 0 2024-04-18T04:57:58.946 INFO:tasks.workunit.client.0.smithi096.stdout:3/427: fdatasync dc/f22 0 2024-04-18T04:57:58.951 INFO:tasks.workunit.client.0.smithi096.stdout:3/428: link dc/d26/d76/c5f dc/d26/d76/d29/d7e/c88 0 2024-04-18T04:57:58.957 INFO:tasks.workunit.client.0.smithi096.stdout:3/429: truncate dc/d26/d48/f4f 3944534 0 2024-04-18T04:57:58.957 INFO:tasks.workunit.client.0.smithi096.stdout:3/430: readlink dc/d26/d76/l38 0 2024-04-18T04:57:58.957 INFO:tasks.workunit.client.0.smithi096.stdout:3/431: read dc/d26/d4a/f58 [1015812,36373] 0 2024-04-18T04:57:58.962 INFO:tasks.workunit.client.0.smithi096.stdout:3/432: fsync dc/d26/d48/f4f 0 2024-04-18T04:57:58.964 INFO:tasks.workunit.client.0.smithi096.stdout:3/433: symlink dc/d26/d76/d29/l89 0 2024-04-18T04:57:58.965 INFO:tasks.workunit.client.0.smithi096.stdout:3/434: creat dc/d5d/f8a x:0 0 0 2024-04-18T04:57:58.972 INFO:tasks.workunit.client.0.smithi096.stdout:3/435: dwrite dc/d26/d76/f74 [0,4194304] 0 2024-04-18T04:57:58.975 INFO:tasks.workunit.client.0.smithi096.stdout:3/436: mkdir dc/d26/d4a/d8b 0 2024-04-18T04:57:58.978 INFO:tasks.workunit.client.0.smithi096.stdout:3/437: getdents dc/d70 0 2024-04-18T04:57:58.985 INFO:tasks.workunit.client.0.smithi096.stdout:3/438: dwrite dc/d26/f78 [0,4194304] 0 2024-04-18T04:57:58.985 INFO:tasks.workunit.client.0.smithi096.stdout:3/439: readlink dc/l19 0 2024-04-18T04:57:58.988 INFO:tasks.workunit.client.0.smithi096.stdout:3/440: rename dc/d26/d76/c75 to dc/d26/d4a/d6b/c8c 0 2024-04-18T04:57:58.989 INFO:tasks.workunit.client.0.smithi096.stdout:3/441: write dc/d26/d66/f69 [3242929,43086] 0 2024-04-18T04:57:58.994 INFO:tasks.workunit.client.0.smithi096.stdout:3/442: dread dc/d26/f78 [0,4194304] 0 2024-04-18T04:57:58.996 INFO:tasks.workunit.client.0.smithi096.stdout:3/443: mkdir dc/d26/d76/d8d 0 2024-04-18T04:57:58.997 INFO:tasks.workunit.client.0.smithi096.stdout:3/444: read - dc/d26/d76/d29/d62/f6a zero size 2024-04-18T04:57:58.998 INFO:tasks.workunit.client.0.smithi096.stdout:3/445: chown dc/d26/d76/d29/d62/f6a 1053270 1 2024-04-18T04:57:59.000 INFO:tasks.workunit.client.0.smithi096.stdout:3/446: dread dc/d26/d4a/f54 [0,4194304] 0 2024-04-18T04:57:59.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:59.002+0000 7f14cffff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 0x7f14d80c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:59.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:59.002+0000 7f14cffff640 1 -- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 msgr2=0x7f14d80c2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-04-18T04:57:59.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:59.002+0000 7f14cffff640 1 -- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 msgr2=0x7f14d80c2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T04:57:59.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:59.002+0000 7f14cffff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 0x7f14d80c2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:59.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:59.002+0000 7f14cffff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 0x7f14d80c2f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:57:59.001 INFO:tasks.workunit.client.0.smithi096.stdout:3/447: mknod dc/d26/d4a/c8e 0 2024-04-18T04:57:59.052 INFO:tasks.workunit.client.0.smithi096.stdout:8/239: sync 2024-04-18T04:57:59.053 INFO:tasks.workunit.client.0.smithi096.stdout:8/240: dread - d0/d15/f44 zero size 2024-04-18T04:57:59.055 INFO:tasks.workunit.client.0.smithi096.stdout:8/241: chown d0/d3/d32/c4b 290770 1 2024-04-18T04:57:59.056 INFO:tasks.workunit.client.0.smithi096.stdout:8/242: write d0/d7/d24/f3d [800095,49855] 0 2024-04-18T04:57:59.082 INFO:tasks.workunit.client.0.smithi096.stdout:8/243: dread d0/d7/f2b [0,4194304] 0 2024-04-18T04:57:59.085 INFO:tasks.workunit.client.0.smithi096.stdout:8/244: rmdir d0/d15 39 2024-04-18T04:57:59.098 INFO:tasks.workunit.client.0.smithi096.stdout:8/245: creat d0/d7/d24/d18/d21/f4e x:0 0 0 2024-04-18T04:57:59.103 INFO:tasks.workunit.client.0.smithi096.stdout:8/246: mkdir d0/d4f 0 2024-04-18T04:57:59.107 INFO:tasks.workunit.client.0.smithi096.stdout:8/247: creat d0/d7/f50 x:0 0 0 2024-04-18T04:57:59.112 INFO:tasks.workunit.client.0.smithi096.stdout:8/248: write d0/d3/d32/f37 [3068724,121270] 0 2024-04-18T04:57:59.117 INFO:tasks.workunit.client.0.smithi096.stdout:8/249: stat d0/d7/d24/d18/d27/d3c 0 2024-04-18T04:57:59.118 INFO:tasks.workunit.client.0.smithi096.stdout:8/250: chown d0/d7/f50 0 1 2024-04-18T04:57:59.123 INFO:tasks.workunit.client.0.smithi096.stdout:8/251: mkdir d0/d7/d24/d35/d51 0 2024-04-18T04:57:59.132 INFO:tasks.workunit.client.0.smithi096.stdout:8/252: rename d0/d7/d24/d18/d21/f41 to d0/d7/d24/d35/f52 0 2024-04-18T04:57:59.133 INFO:tasks.workunit.client.0.smithi096.stdout:8/253: read d0/d7/f2b [3317414,109728] 0 2024-04-18T04:57:59.135 INFO:tasks.workunit.client.0.smithi096.stdout:8/254: chown d0/d7/d24/d18 6433 1 2024-04-18T04:57:59.250 INFO:tasks.workunit.client.0.smithi096.stdout:0/314: sync 2024-04-18T04:57:59.266 INFO:tasks.workunit.client.0.smithi096.stdout:0/315: dwrite d16/d1c/d4c/f50 [0,4194304] 0 2024-04-18T04:57:59.268 INFO:tasks.workunit.client.0.smithi096.stdout:0/316: write d16/d1c/f56 [7092503,105131] 0 2024-04-18T04:57:59.271 INFO:tasks.workunit.client.0.smithi096.stdout:0/317: write d16/d1c/d4c/f50 [2131952,12834] 0 2024-04-18T04:57:59.277 INFO:tasks.workunit.client.0.smithi096.stdout:0/318: write d16/d1c/d22/f2e [1072813,112795] 0 2024-04-18T04:57:59.295 INFO:tasks.workunit.client.0.smithi096.stdout:0/319: dwrite d16/d1c/d22/f57 [0,4194304] 0 2024-04-18T04:57:59.299 INFO:tasks.workunit.client.0.smithi096.stdout:0/320: creat d16/f60 x:0 0 0 2024-04-18T04:57:59.303 INFO:tasks.workunit.client.0.smithi096.stdout:0/321: mknod d16/d1c/d4c/d4d/d5a/c61 0 2024-04-18T04:57:59.304 INFO:tasks.workunit.client.0.smithi096.stdout:0/322: readlink d16/l3e 0 2024-04-18T04:57:59.308 INFO:tasks.workunit.client.0.smithi096.stdout:0/323: creat d16/d1c/f62 x:0 0 0 2024-04-18T04:57:59.310 INFO:tasks.workunit.client.0.smithi096.stdout:0/324: truncate d16/d1c/f29 847756 0 2024-04-18T04:57:59.324 INFO:tasks.workunit.client.0.smithi096.stdout:0/325: dwrite d16/f2b [0,4194304] 0 2024-04-18T04:57:59.331 INFO:tasks.workunit.client.0.smithi096.stdout:7/282: sync 2024-04-18T04:57:59.343 INFO:tasks.workunit.client.0.smithi096.stdout:0/326: dwrite d16/d1c/d22/f2e [0,4194304] 0 2024-04-18T04:57:59.346 INFO:tasks.workunit.client.0.smithi096.stdout:7/283: dwrite db/f3f [0,4194304] 0 2024-04-18T04:57:59.346 INFO:tasks.workunit.client.0.smithi096.stdout:0/327: chown d16/d1d/d3b/f46 201109 1 2024-04-18T04:57:59.349 INFO:tasks.workunit.client.0.smithi096.stdout:0/328: write d16/f2b [5088867,4110] 0 2024-04-18T04:57:59.350 INFO:tasks.workunit.client.0.smithi096.stdout:0/329: chown d16/d1c/d22/d2c 23882 1 2024-04-18T04:57:59.360 INFO:tasks.workunit.client.0.smithi096.stdout:0/330: creat d16/d1c/d4c/d4d/d5d/f63 x:0 0 0 2024-04-18T04:57:59.361 INFO:tasks.workunit.client.0.smithi096.stdout:0/331: write d16/d1c/d4c/d4d/d5d/f63 [80272,110167] 0 2024-04-18T04:57:59.370 INFO:tasks.workunit.client.0.smithi096.stdout:0/332: rename d16/d1c/f51 to d16/d1c/d4c/d4e/f64 0 2024-04-18T04:57:59.377 INFO:tasks.workunit.client.0.smithi096.stdout:0/333: dread d16/d1d/f34 [0,4194304] 0 2024-04-18T04:57:59.379 INFO:tasks.workunit.client.0.smithi096.stdout:0/334: truncate d16/d1d/d3b/f46 5478472 0 2024-04-18T04:57:59.380 INFO:tasks.workunit.client.0.smithi096.stdout:0/335: dread - d16/d1c/d22/d3a/f5e zero size 2024-04-18T04:57:59.385 INFO:tasks.workunit.client.0.smithi096.stdout:0/336: dread d16/d1c/f3c [0,4194304] 0 2024-04-18T04:57:59.390 INFO:tasks.workunit.client.0.smithi096.stdout:0/337: link d16/d55/f5f d16/d1c/f65 0 2024-04-18T04:57:59.396 INFO:tasks.workunit.client.0.smithi096.stdout:0/338: link l12 d16/d1c/d4c/d4d/l66 0 2024-04-18T04:57:59.399 INFO:tasks.workunit.client.0.smithi096.stdout:0/339: mkdir d16/d1c/d4c/d4e/d67 0 2024-04-18T04:57:59.404 INFO:tasks.workunit.client.0.smithi096.stdout:0/340: rename d16/d1c/d22/f57 to d16/d1c/d22/d2c/f68 0 2024-04-18T04:57:59.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:59.406+0000 7f14cffff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 0x7f14d80c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:57:59.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:59.406+0000 7f14cffff640 1 -- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 msgr2=0x7f14d80c2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-04-18T04:57:59.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:59.406+0000 7f14cffff640 1 -- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 msgr2=0x7f14d80c2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T04:57:59.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:59.406+0000 7f14cffff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 0x7f14d80c2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:57:59.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:57:59.406+0000 7f14cffff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 0x7f14d80c2f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:57:59.409 INFO:tasks.workunit.client.0.smithi096.stdout:0/341: symlink d16/d1c/d4c/l69 0 2024-04-18T04:57:59.412 INFO:tasks.workunit.client.0.smithi096.stdout:0/342: mkdir d16/d1c/d4c/d6a 0 2024-04-18T04:57:59.413 INFO:tasks.workunit.client.0.smithi096.stdout:0/343: chown d16/d1c/d22/d2c/f2f 6433134 1 2024-04-18T04:57:59.418 INFO:tasks.workunit.client.0.smithi096.stdout:0/344: symlink d16/d1c/d4c/d4e/d67/l6b 0 2024-04-18T04:57:59.423 INFO:tasks.workunit.client.0.smithi096.stdout:1/402: sync 2024-04-18T04:57:59.423 INFO:tasks.workunit.client.0.smithi096.stdout:5/196: sync 2024-04-18T04:57:59.423 INFO:tasks.workunit.client.0.smithi096.stdout:8/255: sync 2024-04-18T04:57:59.423 INFO:tasks.workunit.client.0.smithi096.stdout:3/448: sync 2024-04-18T04:57:59.423 INFO:tasks.workunit.client.0.smithi096.stdout:2/512: sync 2024-04-18T04:57:59.423 INFO:tasks.workunit.client.0.smithi096.stdout:4/305: sync 2024-04-18T04:57:59.423 INFO:tasks.workunit.client.0.smithi096.stdout:9/264: sync 2024-04-18T04:57:59.423 INFO:tasks.workunit.client.0.smithi096.stdout:6/393: sync 2024-04-18T04:57:59.425 INFO:tasks.workunit.client.0.smithi096.stdout:5/197: write d7/fc [655713,63095] 0 2024-04-18T04:57:59.426 INFO:tasks.workunit.client.0.smithi096.stdout:0/345: rename d16/d1c/d22/d2c/f2f to d16/d1c/d4c/d4d/d5a/f6c 0 2024-04-18T04:57:59.427 INFO:tasks.workunit.client.0.smithi096.stdout:3/449: read dc/d26/d76/f3e [115003,104154] 0 2024-04-18T04:57:59.428 INFO:tasks.workunit.client.0.smithi096.stdout:2/513: write df/d18/d26/f27 [948396,100673] 0 2024-04-18T04:57:59.428 INFO:tasks.workunit.client.0.smithi096.stdout:6/394: write d0/d6/d2b/f52 [566344,129753] 0 2024-04-18T04:57:59.429 INFO:tasks.workunit.client.0.smithi096.stdout:3/450: chown dc/d26/d57 1265570442 1 2024-04-18T04:57:59.429 INFO:tasks.workunit.client.0.smithi096.stdout:5/198: chown l5 6 1 2024-04-18T04:57:59.430 INFO:tasks.workunit.client.0.smithi096.stdout:0/346: read d16/d1c/d4c/d4e/f64 [16861,108073] 0 2024-04-18T04:57:59.438 INFO:tasks.workunit.client.0.smithi096.stdout:4/306: dwrite d4/d14/d2d/d44/f5e [0,4194304] 0 2024-04-18T04:57:59.439 INFO:tasks.workunit.client.0.smithi096.stdout:2/514: mkdir df/d18/d71/d9c/daa 0 2024-04-18T04:57:59.439 INFO:tasks.workunit.client.0.smithi096.stdout:8/256: dwrite d0/d7/d24/d18/d27/d3c/f46 [0,4194304] 0 2024-04-18T04:57:59.444 INFO:tasks.workunit.client.0.smithi096.stdout:3/451: dwrite dc/d26/d4a/f58 [0,4194304] 0 2024-04-18T04:57:59.445 INFO:tasks.workunit.client.0.smithi096.stdout:5/199: creat d7/dd/d35/f51 x:0 0 0 2024-04-18T04:57:59.446 INFO:tasks.workunit.client.0.smithi096.stdout:5/200: readlink d7/dd/d35/l43 0 2024-04-18T04:57:59.457 INFO:tasks.workunit.client.0.smithi096.stdout:1/403: dread de/f35 [0,4194304] 0 2024-04-18T04:57:59.457 INFO:tasks.workunit.client.0.smithi096.stdout:8/257: write d0/d7/d24/d18/f23 [4361392,37685] 0 2024-04-18T04:57:59.457 INFO:tasks.workunit.client.0.smithi096.stdout:9/265: dread d0/de/f19 [0,4194304] 0 2024-04-18T04:57:59.457 INFO:tasks.workunit.client.0.smithi096.stdout:3/452: fsync dc/f42 0 2024-04-18T04:57:59.460 INFO:tasks.workunit.client.0.smithi096.stdout:5/201: mkdir d7/d39/d52 0 2024-04-18T04:57:59.461 INFO:tasks.workunit.client.0.smithi096.stdout:2/515: dread df/f17 [0,4194304] 0 2024-04-18T04:57:59.461 INFO:tasks.workunit.client.0.smithi096.stdout:5/202: dread - d7/d25/d30/f4b zero size 2024-04-18T04:57:59.467 INFO:tasks.workunit.client.0.smithi096.stdout:1/404: readlink de/l36 0 2024-04-18T04:57:59.468 INFO:tasks.workunit.client.0.smithi096.stdout:1/405: readlink de/l1b 0 2024-04-18T04:57:59.469 INFO:tasks.workunit.client.0.smithi096.stdout:2/516: dwrite df/d18/d24/d42/f2c [0,4194304] 0 2024-04-18T04:57:59.477 INFO:tasks.workunit.client.0.smithi096.stdout:4/307: dread d4/d14/d1d/f52 [0,4194304] 0 2024-04-18T04:57:59.478 INFO:tasks.workunit.client.0.smithi096.stdout:3/453: write dc/f10 [2828293,91999] 0 2024-04-18T04:57:59.478 INFO:tasks.workunit.client.0.smithi096.stdout:3/454: truncate dc/d26/d76/d29/f6f 1061595 0 2024-04-18T04:57:59.480 INFO:tasks.workunit.client.0.smithi096.stdout:6/395: getdents d0 0 2024-04-18T04:57:59.480 INFO:tasks.workunit.client.0.smithi096.stdout:4/308: dread d4/d14/d1d/d29/d3a/d39/f56 [0,4194304] 0 2024-04-18T04:57:59.481 INFO:tasks.workunit.client.0.smithi096.stdout:6/396: stat d0/d6/d5d/f3c 0 2024-04-18T04:57:59.481 INFO:tasks.workunit.client.0.smithi096.stdout:6/397: chown d0/f67 1729 1 2024-04-18T04:57:59.482 INFO:tasks.workunit.client.0.smithi096.stdout:8/258: symlink d0/d7/d24/d18/l53 0 2024-04-18T04:57:59.483 INFO:tasks.workunit.client.0.smithi096.stdout:3/455: symlink dc/d26/d66/l8f 0 2024-04-18T04:57:59.483 INFO:tasks.workunit.client.0.smithi096.stdout:1/406: getdents de/d1d/d32/d73 0 2024-04-18T04:57:59.485 INFO:tasks.workunit.client.0.smithi096.stdout:6/398: rmdir d0/d6/d2b 39 2024-04-18T04:57:59.486 INFO:tasks.workunit.client.0.smithi096.stdout:5/203: dread d7/d25/d30/f33 [4194304,4194304] 0 2024-04-18T04:57:59.487 INFO:tasks.workunit.client.0.smithi096.stdout:5/204: chown d7/d25/d30/f33 2030 1 2024-04-18T04:57:59.487 INFO:tasks.workunit.client.0.smithi096.stdout:8/259: creat d0/d3/d32/f54 x:0 0 0 2024-04-18T04:57:59.488 INFO:tasks.workunit.client.0.smithi096.stdout:3/456: creat dc/d26/d4a/d6b/f90 x:0 0 0 2024-04-18T04:57:59.490 INFO:tasks.workunit.client.0.smithi096.stdout:6/399: creat d0/f6b x:0 0 0 2024-04-18T04:57:59.491 INFO:tasks.workunit.client.0.smithi096.stdout:8/260: unlink d0/d7/d24/d35/f52 0 2024-04-18T04:57:59.493 INFO:tasks.workunit.client.0.smithi096.stdout:4/309: rename d4/d14/d1d/c1f to d4/d14/c68 0 2024-04-18T04:57:59.493 INFO:tasks.workunit.client.0.smithi096.stdout:4/310: stat d4/d14/d1d/d29/f4c 0 2024-04-18T04:57:59.494 INFO:tasks.workunit.client.0.smithi096.stdout:4/311: write d4/d14/d1d/d29/d3a/d39/f56 [2574581,13947] 0 2024-04-18T04:57:59.495 INFO:tasks.workunit.client.0.smithi096.stdout:1/407: link de/d1d/f66 de/d1d/d3f/f75 0 2024-04-18T04:57:59.496 INFO:tasks.workunit.client.0.smithi096.stdout:4/312: chown d4/d14/d16/c4f 8292411 1 2024-04-18T04:57:59.498 INFO:tasks.workunit.client.0.smithi096.stdout:8/261: write d0/d15/f44 [1030876,122167] 0 2024-04-18T04:57:59.501 INFO:tasks.workunit.client.0.smithi096.stdout:4/313: mknod d4/d14/d1d/d29/d3a/d47/d4b/c69 0 2024-04-18T04:57:59.503 INFO:tasks.workunit.client.0.smithi096.stdout:9/266: dread d0/de/f16 [0,4194304] 0 2024-04-18T04:57:59.504 INFO:tasks.workunit.client.0.smithi096.stdout:1/408: dwrite de/f72 [0,4194304] 0 2024-04-18T04:57:59.508 INFO:tasks.workunit.client.0.smithi096.stdout:9/267: fsync d0/de/f16 0 2024-04-18T04:57:59.510 INFO:tasks.workunit.client.0.smithi096.stdout:1/409: creat de/d1d/d3f/f76 x:0 0 0 2024-04-18T04:57:59.511 INFO:tasks.workunit.client.0.smithi096.stdout:8/262: creat d0/f55 x:0 0 0 2024-04-18T04:57:59.516 INFO:tasks.workunit.client.0.smithi096.stdout:7/284: sync 2024-04-18T04:57:59.518 INFO:tasks.workunit.client.0.smithi096.stdout:1/410: unlink de/d1d/d32/c56 0 2024-04-18T04:57:59.521 INFO:tasks.workunit.client.0.smithi096.stdout:8/263: unlink d0/d7/fa 0 2024-04-18T04:57:59.522 INFO:tasks.workunit.client.0.smithi096.stdout:3/457: truncate dc/d5d/f6d 125619 0 2024-04-18T04:57:59.526 INFO:tasks.workunit.client.0.smithi096.stdout:9/268: mkdir d0/d5f 0 2024-04-18T04:57:59.528 INFO:tasks.workunit.client.0.smithi096.stdout:4/314: write d4/d14/d1d/f52 [327097,91208] 0 2024-04-18T04:57:59.529 INFO:tasks.workunit.client.0.smithi096.stdout:7/285: dread db/d1f/f40 [0,4194304] 0 2024-04-18T04:57:59.529 INFO:tasks.workunit.client.0.smithi096.stdout:4/315: read d4/d14/d1d/f27 [275723,80140] 0 2024-04-18T04:57:59.530 INFO:tasks.workunit.client.0.smithi096.stdout:8/264: creat d0/d7/d24/d18/d21/f56 x:0 0 0 2024-04-18T04:57:59.532 INFO:tasks.workunit.client.0.smithi096.stdout:3/458: rename dc/f7c to dc/d26/d4a/f91 0 2024-04-18T04:57:59.533 INFO:tasks.workunit.client.0.smithi096.stdout:9/269: mkdir d0/de/d17/d56/d59/d60 0 2024-04-18T04:57:59.536 INFO:tasks.workunit.client.0.smithi096.stdout:8/265: readlink d0/l49 0 2024-04-18T04:57:59.537 INFO:tasks.workunit.client.0.smithi096.stdout:8/266: write d0/d3/f31 [1431527,13778] 0 2024-04-18T04:57:59.538 INFO:tasks.workunit.client.0.smithi096.stdout:9/270: creat d0/de/d17/d2f/d40/f61 x:0 0 0 2024-04-18T04:57:59.540 INFO:tasks.workunit.client.0.smithi096.stdout:1/411: rmdir de/d1d/d3f/d74 0 2024-04-18T04:57:59.540 INFO:tasks.workunit.client.0.smithi096.stdout:1/412: readlink de/l38 0 2024-04-18T04:57:59.541 INFO:tasks.workunit.client.0.smithi096.stdout:7/286: link db/d1d/f44 db/d1d/f5a 0 2024-04-18T04:57:59.541 INFO:tasks.workunit.client.0.smithi096.stdout:7/287: chown db/d20/f35 0 1 2024-04-18T04:57:59.543 INFO:tasks.workunit.client.0.smithi096.stdout:9/271: creat d0/de/f62 x:0 0 0 2024-04-18T04:57:59.544 INFO:tasks.workunit.client.0.smithi096.stdout:6/400: dread d0/d6/d29/f30 [0,4194304] 0 2024-04-18T04:57:59.544 INFO:tasks.workunit.client.0.smithi096.stdout:4/316: creat d4/d14/f6a x:0 0 0 2024-04-18T04:57:59.544 INFO:tasks.workunit.client.0.smithi096.stdout:9/272: read d0/de/f19 [3180069,124886] 0 2024-04-18T04:57:59.546 INFO:tasks.workunit.client.0.smithi096.stdout:8/267: symlink d0/d7/d24/d35/d51/l57 0 2024-04-18T04:57:59.546 INFO:tasks.workunit.client.0.smithi096.stdout:4/317: write d4/f24 [1648690,49737] 0 2024-04-18T04:57:59.547 INFO:tasks.workunit.client.0.smithi096.stdout:1/413: truncate de/f12 1025059 0 2024-04-18T04:57:59.547 INFO:tasks.workunit.client.0.smithi096.stdout:8/268: write d0/d3/d32/f54 [373449,155] 0 2024-04-18T04:57:59.547 INFO:tasks.workunit.client.0.smithi096.stdout:7/288: mkdir db/d1f/d5b 0 2024-04-18T04:57:59.549 INFO:tasks.workunit.client.0.smithi096.stdout:1/414: write de/d1d/d32/f57 [620913,64970] 0 2024-04-18T04:57:59.549 INFO:tasks.workunit.client.0.smithi096.stdout:3/459: link dc/d26/d76/d29/c44 dc/d26/d48/c92 0 2024-04-18T04:57:59.549 INFO:tasks.workunit.client.0.smithi096.stdout:7/289: write db/d20/d2f/f37 [7421909,31685] 0 2024-04-18T04:57:59.550 INFO:tasks.workunit.client.0.smithi096.stdout:9/273: creat d0/d41/f63 x:0 0 0 2024-04-18T04:57:59.551 INFO:tasks.workunit.client.0.smithi096.stdout:4/318: creat d4/d14/d2d/d44/d58/f6b x:0 0 0 2024-04-18T04:57:59.552 INFO:tasks.workunit.client.0.smithi096.stdout:1/415: write de/d1d/f42 [675096,6272] 0 2024-04-18T04:57:59.556 INFO:tasks.workunit.client.0.smithi096.stdout:6/401: mkdir d0/d6/d2b/d3b/d69/d6c 0 2024-04-18T04:57:59.559 INFO:tasks.workunit.client.0.smithi096.stdout:3/460: mkdir dc/d26/d4a/d6b/d93 0 2024-04-18T04:57:59.559 INFO:tasks.workunit.client.0.smithi096.stdout:3/461: chown dc/d26/d76/d29 20 1 2024-04-18T04:57:59.561 INFO:tasks.workunit.client.0.smithi096.stdout:8/269: creat d0/d4f/f58 x:0 0 0 2024-04-18T04:57:59.563 INFO:tasks.workunit.client.0.smithi096.stdout:4/319: fdatasync d4/d14/f31 0 2024-04-18T04:57:59.565 INFO:tasks.workunit.client.0.smithi096.stdout:1/416: mknod de/d1d/d32/c77 0 2024-04-18T04:57:59.565 INFO:tasks.workunit.client.0.smithi096.stdout:1/417: chown de/d1d/c26 19077 1 2024-04-18T04:57:59.565 INFO:tasks.workunit.client.0.smithi096.stdout:1/418: stat de/d1d/d32/c51 0 2024-04-18T04:57:59.566 INFO:tasks.workunit.client.0.smithi096.stdout:9/274: rmdir d0/de/d17/d2f/d40 39 2024-04-18T04:57:59.567 INFO:tasks.workunit.client.0.smithi096.stdout:9/275: read - d0/de/f62 zero size 2024-04-18T04:57:59.568 INFO:tasks.workunit.client.0.smithi096.stdout:3/462: creat dc/d70/f94 x:0 0 0 2024-04-18T04:57:59.568 INFO:tasks.workunit.client.0.smithi096.stdout:9/276: read - d0/de/d17/d2f/f4f zero size 2024-04-18T04:57:59.570 INFO:tasks.workunit.client.0.smithi096.stdout:6/402: dread d0/d6/d2b/f4e [0,4194304] 0 2024-04-18T04:57:59.571 INFO:tasks.workunit.client.0.smithi096.stdout:9/277: read d0/de/d17/f23 [497353,76590] 0 2024-04-18T04:57:59.571 INFO:tasks.workunit.client.0.smithi096.stdout:4/320: dwrite d4/f18 [0,4194304] 0 2024-04-18T04:57:59.572 INFO:tasks.workunit.client.0.smithi096.stdout:1/419: creat de/d1d/f78 x:0 0 0 2024-04-18T04:57:59.573 INFO:tasks.workunit.client.0.smithi096.stdout:6/403: read - d0/d6/d2b/f5e zero size 2024-04-18T04:57:59.574 INFO:tasks.workunit.client.0.smithi096.stdout:1/420: fdatasync de/d1d/d32/f69 0 2024-04-18T04:57:59.575 INFO:tasks.workunit.client.0.smithi096.stdout:8/270: creat d0/f59 x:0 0 0 2024-04-18T04:57:59.577 INFO:tasks.workunit.client.0.smithi096.stdout:1/421: readlink de/l15 0 2024-04-18T04:57:59.578 INFO:tasks.workunit.client.0.smithi096.stdout:8/271: fsync d0/d3/d32/f54 0 2024-04-18T04:57:59.579 INFO:tasks.workunit.client.0.smithi096.stdout:3/463: dread dc/d26/d76/f74 [0,4194304] 0 2024-04-18T04:57:59.580 INFO:tasks.workunit.client.0.smithi096.stdout:1/422: write de/d1d/f42 [613245,112365] 0 2024-04-18T04:57:59.582 INFO:tasks.workunit.client.0.smithi096.stdout:1/423: chown de/d1d/d3f/d4f 25165 1 2024-04-18T04:57:59.583 INFO:tasks.workunit.client.0.smithi096.stdout:8/272: mknod d0/d7/c5a 0 2024-04-18T04:57:59.583 INFO:tasks.workunit.client.0.smithi096.stdout:3/464: dread - dc/d26/d76/d29/d62/f6a zero size 2024-04-18T04:57:59.584 INFO:tasks.workunit.client.0.smithi096.stdout:1/424: write de/f18 [3851639,41889] 0 2024-04-18T04:57:59.585 INFO:tasks.workunit.client.0.smithi096.stdout:6/404: link d0/d6/d2e/f45 d0/d6/d5d/f6d 0 2024-04-18T04:57:59.586 INFO:tasks.workunit.client.0.smithi096.stdout:9/278: dwrite d0/f11 [0,4194304] 0 2024-04-18T04:57:59.587 INFO:tasks.workunit.client.0.smithi096.stdout:7/290: write db/d1f/f40 [303208,115361] 0 2024-04-18T04:57:59.587 INFO:tasks.workunit.client.0.smithi096.stdout:3/465: write dc/d26/d4a/f6c [760098,73105] 0 2024-04-18T04:57:59.588 INFO:tasks.workunit.client.0.smithi096.stdout:9/279: chown d0/d25 11 1 2024-04-18T04:57:59.589 INFO:tasks.workunit.client.0.smithi096.stdout:6/405: fsync d0/d6/d5d/f3c 0 2024-04-18T04:57:59.590 INFO:tasks.workunit.client.0.smithi096.stdout:7/291: write db/f22 [2011193,94938] 0 2024-04-18T04:57:59.590 INFO:tasks.workunit.client.0.smithi096.stdout:1/425: symlink de/d1d/d3f/l79 0 2024-04-18T04:57:59.597 INFO:tasks.workunit.client.0.smithi096.stdout:4/321: dread d4/d14/d16/f32 [0,4194304] 0 2024-04-18T04:57:59.598 INFO:tasks.workunit.client.0.smithi096.stdout:8/273: dwrite d0/d7/d24/f22 [0,4194304] 0 2024-04-18T04:57:59.603 INFO:tasks.workunit.client.0.smithi096.stdout:4/322: readlink d4/d14/d1d/d29/d3a/d39/d54/l60 0 2024-04-18T04:57:59.605 INFO:tasks.workunit.client.0.smithi096.stdout:6/406: dwrite d0/d6/d2b/d3b/f41 [0,4194304] 0 2024-04-18T04:57:59.605 INFO:tasks.workunit.client.0.smithi096.stdout:4/323: chown d4/d14 1838783630 1 2024-04-18T04:57:59.605 INFO:tasks.workunit.client.0.smithi096.stdout:1/426: dwrite f9 [0,4194304] 0 2024-04-18T04:57:59.605 INFO:tasks.workunit.client.0.smithi096.stdout:9/280: dread d0/de/d17/d2f/d40/f34 [0,4194304] 0 2024-04-18T04:57:59.609 INFO:tasks.workunit.client.0.smithi096.stdout:1/427: unlink de/f72 0 2024-04-18T04:57:59.610 INFO:tasks.workunit.client.0.smithi096.stdout:6/407: write d0/d6/f34 [222920,44972] 0 2024-04-18T04:57:59.611 INFO:tasks.workunit.client.0.smithi096.stdout:9/281: mknod d0/de/d17/d56/d59/c64 0 2024-04-18T04:57:59.611 INFO:tasks.workunit.client.0.smithi096.stdout:4/324: write d4/f62 [995411,69927] 0 2024-04-18T04:57:59.615 INFO:tasks.workunit.client.0.smithi096.stdout:6/408: read d0/d6/d29/f30 [1966071,50657] 0 2024-04-18T04:57:59.616 INFO:tasks.workunit.client.0.smithi096.stdout:7/292: dwrite db/f2a [0,4194304] 0 2024-04-18T04:57:59.619 INFO:tasks.workunit.client.0.smithi096.stdout:1/428: mkdir de/d1d/d3f/d7a 0 2024-04-18T04:57:59.619 INFO:tasks.workunit.client.0.smithi096.stdout:9/282: fsync d0/de/f1c 0 2024-04-18T04:57:59.619 INFO:tasks.workunit.client.0.smithi096.stdout:1/429: mkdir de/d7b 0 2024-04-18T04:57:59.620 INFO:tasks.workunit.client.0.smithi096.stdout:6/409: dread d0/d6/d2b/f4e [0,4194304] 0 2024-04-18T04:57:59.621 INFO:tasks.workunit.client.0.smithi096.stdout:9/283: write d0/f3 [1070026,23470] 0 2024-04-18T04:57:59.623 INFO:tasks.workunit.client.0.smithi096.stdout:8/274: dwrite d0/d7/d24/d18/d27/d3c/f46 [0,4194304] 0 2024-04-18T04:57:59.623 INFO:tasks.workunit.client.0.smithi096.stdout:1/430: fsync de/d1d/d32/f4e 0 2024-04-18T04:57:59.626 INFO:tasks.workunit.client.0.smithi096.stdout:7/293: creat db/d1f/d39/f5c x:0 0 0 2024-04-18T04:57:59.633 INFO:tasks.workunit.client.0.smithi096.stdout:1/431: creat de/d1d/d32/d6f/f7c x:0 0 0 2024-04-18T04:57:59.634 INFO:tasks.workunit.client.0.smithi096.stdout:7/294: write db/d20/f35 [148569,88205] 0 2024-04-18T04:57:59.640 INFO:tasks.workunit.client.0.smithi096.stdout:9/284: dwrite d0/de/d17/f3f [0,4194304] 0 2024-04-18T04:57:59.641 INFO:tasks.workunit.client.0.smithi096.stdout:7/295: write db/f3f [4312440,55058] 0 2024-04-18T04:57:59.642 INFO:tasks.workunit.client.0.smithi096.stdout:6/410: dwrite d0/d6/d2b/d3b/d69/f5b [0,4194304] 0 2024-04-18T04:57:59.642 INFO:tasks.workunit.client.0.smithi096.stdout:8/275: dwrite d0/d3/f3e [0,4194304] 0 2024-04-18T04:57:59.642 INFO:tasks.workunit.client.0.smithi096.stdout:9/285: dread - d0/de/f62 zero size 2024-04-18T04:57:59.645 INFO:tasks.workunit.client.0.smithi096.stdout:4/325: dread d4/d14/d1d/d29/f3b [0,4194304] 0 2024-04-18T04:57:59.646 INFO:tasks.workunit.client.0.smithi096.stdout:7/296: write db/d20/d2f/f37 [1846399,85340] 0 2024-04-18T04:57:59.648 INFO:tasks.workunit.client.0.smithi096.stdout:7/297: readlink db/d1f/l2b 0 2024-04-18T04:57:59.649 INFO:tasks.workunit.client.0.smithi096.stdout:1/432: creat de/d1d/d3f/d4f/f7d x:0 0 0 2024-04-18T04:57:59.651 INFO:tasks.workunit.client.0.smithi096.stdout:6/411: symlink d0/d4a/l6e 0 2024-04-18T04:57:59.653 INFO:tasks.workunit.client.0.smithi096.stdout:8/276: mkdir d0/d7/d24/d35/d51/d5b 0 2024-04-18T04:57:59.653 INFO:tasks.workunit.client.0.smithi096.stdout:9/286: dwrite d0/f4b [0,4194304] 0 2024-04-18T04:57:59.653 INFO:tasks.workunit.client.0.smithi096.stdout:4/326: dread d4/f18 [0,4194304] 0 2024-04-18T04:57:59.654 INFO:tasks.workunit.client.0.smithi096.stdout:8/277: write d0/d3/f3e [757194,24562] 0 2024-04-18T04:57:59.655 INFO:tasks.workunit.client.0.smithi096.stdout:0/347: sync 2024-04-18T04:57:59.656 INFO:tasks.workunit.client.0.smithi096.stdout:6/412: stat d0/d6/c4 0 2024-04-18T04:57:59.665 INFO:tasks.workunit.client.0.smithi096.stdout:7/298: link db/d1f/d24/f33 db/d1f/d24/d49/d54/f5d 0 2024-04-18T04:57:59.665 INFO:tasks.workunit.client.0.smithi096.stdout:1/433: mknod de/d1d/d32/d73/c7e 0 2024-04-18T04:57:59.669 INFO:tasks.workunit.client.0.smithi096.stdout:1/434: fsync de/f59 0 2024-04-18T04:57:59.670 INFO:tasks.workunit.client.0.smithi096.stdout:9/287: dwrite d0/f28 [4194304,4194304] 0 2024-04-18T04:57:59.674 INFO:tasks.workunit.client.0.smithi096.stdout:0/348: dwrite fd [0,4194304] 0 2024-04-18T04:57:59.674 INFO:tasks.workunit.client.0.smithi096.stdout:4/327: dwrite d4/d14/d2d/d44/f5e [0,4194304] 0 2024-04-18T04:57:59.679 INFO:tasks.workunit.client.0.smithi096.stdout:7/299: chown db/d1d/c51 32329376 1 2024-04-18T04:57:59.680 INFO:tasks.workunit.client.0.smithi096.stdout:6/413: dwrite d0/d6/d2e/f56 [0,4194304] 0 2024-04-18T04:57:59.682 INFO:tasks.workunit.client.0.smithi096.stdout:1/435: chown de/d1d/d3f/f45 192498 1 2024-04-18T04:57:59.686 INFO:tasks.workunit.client.0.smithi096.stdout:4/328: rmdir d4/d14/d1d/d29/d3a/d47 39 2024-04-18T04:57:59.686 INFO:tasks.workunit.client.0.smithi096.stdout:8/278: dwrite d0/d7/d24/d18/d27/d3c/f46 [0,4194304] 0 2024-04-18T04:57:59.687 INFO:tasks.workunit.client.0.smithi096.stdout:7/300: dread db/f31 [0,4194304] 0 2024-04-18T04:57:59.688 INFO:tasks.workunit.client.0.smithi096.stdout:6/414: symlink d0/d6/d2e/l6f 0 2024-04-18T04:57:59.695 INFO:tasks.workunit.client.0.smithi096.stdout:9/288: link d0/de/d17/f20 d0/de/d17/d56/d59/f65 0 2024-04-18T04:57:59.695 INFO:tasks.workunit.client.0.smithi096.stdout:1/436: rename de/d1d/d3f/f75 to de/d1d/d32/d73/f7f 0 2024-04-18T04:57:59.695 INFO:tasks.workunit.client.0.smithi096.stdout:4/329: symlink d4/d14/d1d/d29/d3a/d39/d54/l6c 0 2024-04-18T04:57:59.695 INFO:tasks.workunit.client.0.smithi096.stdout:1/437: fsync de/d1d/d3f/f61 0 2024-04-18T04:57:59.695 INFO:tasks.workunit.client.0.smithi096.stdout:0/349: dwrite d16/f40 [4194304,4194304] 0 2024-04-18T04:57:59.696 INFO:tasks.workunit.client.0.smithi096.stdout:1/438: write de/d1d/d3f/d4f/f7d [40356,37370] 0 2024-04-18T04:57:59.698 INFO:tasks.workunit.client.0.smithi096.stdout:7/301: dread - db/d1f/d39/f5c zero size 2024-04-18T04:57:59.700 INFO:tasks.workunit.client.0.smithi096.stdout:0/350: creat d16/d1c/f6d x:0 0 0 2024-04-18T04:57:59.701 INFO:tasks.workunit.client.0.smithi096.stdout:4/330: creat d4/d14/d2d/d44/d55/d67/f6d x:0 0 0 2024-04-18T04:57:59.702 INFO:tasks.workunit.client.0.smithi096.stdout:1/439: getdents de/d7b 0 2024-04-18T04:57:59.702 INFO:tasks.workunit.client.0.smithi096.stdout:9/289: dread d0/de/d17/f3f [0,4194304] 0 2024-04-18T04:57:59.702 INFO:tasks.workunit.client.0.smithi096.stdout:7/302: mkdir db/d20/d45/d5e 0 2024-04-18T04:57:59.706 INFO:tasks.workunit.client.0.smithi096.stdout:0/351: dread d16/d1d/f34 [0,4194304] 0 2024-04-18T04:57:59.707 INFO:tasks.workunit.client.0.smithi096.stdout:6/415: write d0/d6/d5d/f6d [952971,90264] 0 2024-04-18T04:57:59.709 INFO:tasks.workunit.client.0.smithi096.stdout:4/331: mknod d4/d14/d1d/d29/d3a/c6e 0 2024-04-18T04:57:59.709 INFO:tasks.workunit.client.0.smithi096.stdout:0/352: fdatasync d16/d1c/d22/d3a/f5e 0 2024-04-18T04:57:59.710 INFO:tasks.workunit.client.0.smithi096.stdout:9/290: truncate d0/de/f16 432251 0 2024-04-18T04:57:59.711 INFO:tasks.workunit.client.0.smithi096.stdout:7/303: link db/d20/d2f/f30 db/d1f/d42/f5f 0 2024-04-18T04:57:59.713 INFO:tasks.workunit.client.0.smithi096.stdout:6/416: rename d0/f6b to d0/d6/d5d/f70 0 2024-04-18T04:57:59.714 INFO:tasks.workunit.client.0.smithi096.stdout:0/353: fsync d16/f19 0 2024-04-18T04:57:59.715 INFO:tasks.workunit.client.0.smithi096.stdout:1/440: dwrite de/d1d/f65 [0,4194304] 0 2024-04-18T04:57:59.716 INFO:tasks.workunit.client.0.smithi096.stdout:7/304: fdatasync db/d1d/f44 0 2024-04-18T04:57:59.716 INFO:tasks.workunit.client.0.smithi096.stdout:8/279: dread d0/d7/d24/d18/f23 [0,4194304] 0 2024-04-18T04:57:59.716 INFO:tasks.workunit.client.0.smithi096.stdout:1/441: stat de/f35 0 2024-04-18T04:57:59.719 INFO:tasks.workunit.client.0.smithi096.stdout:0/354: dread d16/d1c/f29 [0,4194304] 0 2024-04-18T04:57:59.720 INFO:tasks.workunit.client.0.smithi096.stdout:7/305: symlink db/d20/d45/l60 0 2024-04-18T04:57:59.721 INFO:tasks.workunit.client.0.smithi096.stdout:8/280: creat d0/d3/f5c x:0 0 0 2024-04-18T04:57:59.723 INFO:tasks.workunit.client.0.smithi096.stdout:9/291: link d0/de/d17/c14 d0/de/d17/d56/c66 0 2024-04-18T04:57:59.723 INFO:tasks.workunit.client.0.smithi096.stdout:4/332: dwrite d4/d14/d1d/f52 [0,4194304] 0 2024-04-18T04:57:59.724 INFO:tasks.workunit.client.0.smithi096.stdout:7/306: rmdir db/d1d 39 2024-04-18T04:57:59.725 INFO:tasks.workunit.client.0.smithi096.stdout:7/307: fsync db/f2a 0 2024-04-18T04:57:59.726 INFO:tasks.workunit.client.0.smithi096.stdout:0/355: creat d16/d1d/d3b/f6e x:0 0 0 2024-04-18T04:57:59.727 INFO:tasks.workunit.client.0.smithi096.stdout:0/356: dread - d16/d1c/f62 zero size 2024-04-18T04:57:59.728 INFO:tasks.workunit.client.0.smithi096.stdout:1/442: dread de/d1d/f65 [0,4194304] 0 2024-04-18T04:57:59.729 INFO:tasks.workunit.client.0.smithi096.stdout:4/333: fdatasync d4/d14/d1d/f27 0 2024-04-18T04:57:59.730 INFO:tasks.workunit.client.0.smithi096.stdout:1/443: write de/d1d/d3f/f62 [6031,76013] 0 2024-04-18T04:57:59.731 INFO:tasks.workunit.client.0.smithi096.stdout:7/308: mkdir db/d1f/d24/d61 0 2024-04-18T04:57:59.732 INFO:tasks.workunit.client.0.smithi096.stdout:9/292: symlink d0/l67 0 2024-04-18T04:57:59.733 INFO:tasks.workunit.client.0.smithi096.stdout:0/357: mknod d16/d1c/d4c/d4d/c6f 0 2024-04-18T04:57:59.735 INFO:tasks.workunit.client.0.smithi096.stdout:4/334: rmdir d4 39 2024-04-18T04:57:59.736 INFO:tasks.workunit.client.0.smithi096.stdout:6/417: readlink d0/d6/d2e/l2a 0 2024-04-18T04:57:59.737 INFO:tasks.workunit.client.0.smithi096.stdout:1/444: write de/d1d/f52 [1200822,31895] 0 2024-04-18T04:57:59.738 INFO:tasks.workunit.client.0.smithi096.stdout:1/445: readlink de/d1d/l55 0 2024-04-18T04:57:59.740 INFO:tasks.workunit.client.0.smithi096.stdout:9/293: rename d0/d25/d5b to d0/de/d17/d56/d59/d68 0 2024-04-18T04:57:59.740 INFO:tasks.workunit.client.0.smithi096.stdout:0/358: unlink d16/d1c/d4c/d4e/d67/l6b 0 2024-04-18T04:57:59.742 INFO:tasks.workunit.client.0.smithi096.stdout:6/418: creat d0/d6/d2b/d3b/d69/f71 x:0 0 0 2024-04-18T04:57:59.743 INFO:tasks.workunit.client.0.smithi096.stdout:9/294: rename d0/de/f19 to d0/d52/d5a/f69 0 2024-04-18T04:57:59.743 INFO:tasks.workunit.client.0.smithi096.stdout:0/359: chown d16/d1c/d22/d2c/f68 0 1 2024-04-18T04:57:59.744 INFO:tasks.workunit.client.0.smithi096.stdout:1/446: link de/d1d/f65 de/d7b/f80 0 2024-04-18T04:57:59.746 INFO:tasks.workunit.client.0.smithi096.stdout:6/419: symlink d0/d6/l72 0 2024-04-18T04:57:59.747 INFO:tasks.workunit.client.0.smithi096.stdout:7/309: dwrite db/d1d/f47 [0,4194304] 0 2024-04-18T04:57:59.749 INFO:tasks.workunit.client.0.smithi096.stdout:1/447: mkdir de/d1d/d81 0 2024-04-18T04:57:59.749 INFO:tasks.workunit.client.0.smithi096.stdout:4/335: dread d4/d14/d16/f32 [0,4194304] 0 2024-04-18T04:57:59.749 INFO:tasks.workunit.client.0.smithi096.stdout:9/295: unlink d0/de/d17/d56/d59/d68/f5e 0 2024-04-18T04:57:59.751 INFO:tasks.workunit.client.0.smithi096.stdout:9/296: write d0/d25/f3c [2978265,54202] 0 2024-04-18T04:57:59.754 INFO:tasks.workunit.client.0.smithi096.stdout:1/448: symlink de/l82 0 2024-04-18T04:57:59.755 INFO:tasks.workunit.client.0.smithi096.stdout:4/336: mkdir d4/d14/d1d/d29/d6f 0 2024-04-18T04:57:59.755 INFO:tasks.workunit.client.0.smithi096.stdout:9/297: unlink d0/de/d17/d2f/f4f 0 2024-04-18T04:57:59.756 INFO:tasks.workunit.client.0.smithi096.stdout:6/420: mkdir d0/d73 0 2024-04-18T04:57:59.756 INFO:tasks.workunit.client.0.smithi096.stdout:1/449: creat de/d1d/d32/d6f/f83 x:0 0 0 2024-04-18T04:57:59.757 INFO:tasks.workunit.client.0.smithi096.stdout:1/450: fsync de/f6a 0 2024-04-18T04:57:59.759 INFO:tasks.workunit.client.0.smithi096.stdout:7/310: creat db/f62 x:0 0 0 2024-04-18T04:57:59.759 INFO:tasks.workunit.client.0.smithi096.stdout:4/337: symlink d4/d14/d1d/d29/d6f/l70 0 2024-04-18T04:57:59.760 INFO:tasks.workunit.client.0.smithi096.stdout:7/311: readlink db/d1f/d42/l43 0 2024-04-18T04:57:59.761 INFO:tasks.workunit.client.0.smithi096.stdout:7/312: chown db/d20/d2f 4372 1 2024-04-18T04:57:59.762 INFO:tasks.workunit.client.0.smithi096.stdout:4/338: dread - d4/d14/d1d/d29/d3a/d47/d4b/f57 zero size 2024-04-18T04:57:59.763 INFO:tasks.workunit.client.0.smithi096.stdout:0/360: dread d16/f19 [4194304,4194304] 0 2024-04-18T04:57:59.763 INFO:tasks.workunit.client.0.smithi096.stdout:4/339: fdatasync d4/d14/f6a 0 2024-04-18T04:57:59.764 INFO:tasks.workunit.client.0.smithi096.stdout:6/421: rename d0/d6/d2b/d3b/d69/d66/c68 to d0/d6/c74 0 2024-04-18T04:57:59.765 INFO:tasks.workunit.client.0.smithi096.stdout:0/361: creat d16/d1c/d4c/d4d/d5a/f70 x:0 0 0 2024-04-18T04:57:59.765 INFO:tasks.workunit.client.0.smithi096.stdout:0/362: chown d16/d1d/l31 338 1 2024-04-18T04:57:59.766 INFO:tasks.workunit.client.0.smithi096.stdout:7/313: rename db/d20/d2f/f58 to db/d20/d45/f63 0 2024-04-18T04:57:59.767 INFO:tasks.workunit.client.0.smithi096.stdout:9/298: write d0/de/f2d [928848,7084] 0 2024-04-18T04:57:59.770 INFO:tasks.workunit.client.0.smithi096.stdout:4/340: rename d4/d14/d1d/d29/d3a/d47/d4b/l50 to d4/d14/d1d/l71 0 2024-04-18T04:57:59.770 INFO:tasks.workunit.client.0.smithi096.stdout:1/451: truncate de/f16 253957 0 2024-04-18T04:57:59.771 INFO:tasks.workunit.client.0.smithi096.stdout:7/314: mknod db/c64 0 2024-04-18T04:57:59.772 INFO:tasks.workunit.client.0.smithi096.stdout:9/299: unlink d0/de/c22 0 2024-04-18T04:57:59.773 INFO:tasks.workunit.client.0.smithi096.stdout:6/422: getdents d0 0 2024-04-18T04:57:59.774 INFO:tasks.workunit.client.0.smithi096.stdout:9/300: creat d0/de/d17/d56/f6a x:0 0 0 2024-04-18T04:57:59.781 INFO:tasks.workunit.client.0.smithi096.stdout:6/423: link d0/d6/f7 d0/d6/d5d/f75 0 2024-04-18T04:57:59.782 INFO:tasks.workunit.client.0.smithi096.stdout:7/315: dwrite db/d1d/f21 [0,4194304] 0 2024-04-18T04:57:59.782 INFO:tasks.workunit.client.0.smithi096.stdout:1/452: dwrite de/d1d/d3f/f6e [0,4194304] 0 2024-04-18T04:57:59.784 INFO:tasks.workunit.client.0.smithi096.stdout:4/341: dread d4/d14/d1d/d29/f36 [0,4194304] 0 2024-04-18T04:57:59.784 INFO:tasks.workunit.client.0.smithi096.stdout:6/424: fdatasync d0/d6/f7 0 2024-04-18T04:57:59.784 INFO:tasks.workunit.client.0.smithi096.stdout:1/453: write de/f6a [717481,12611] 0 2024-04-18T04:57:59.787 INFO:tasks.workunit.client.0.smithi096.stdout:4/342: write d4/d14/d2d/d44/d55/d67/f6d [239481,40873] 0 2024-04-18T04:57:59.789 INFO:tasks.workunit.client.0.smithi096.stdout:6/425: write d0/d6/d29/f30 [3147329,33627] 0 2024-04-18T04:57:59.792 INFO:tasks.workunit.client.0.smithi096.stdout:7/316: getdents db 0 2024-04-18T04:57:59.793 INFO:tasks.workunit.client.0.smithi096.stdout:6/426: write d0/d6/f15 [5474353,101246] 0 2024-04-18T04:57:59.794 INFO:tasks.workunit.client.0.smithi096.stdout:9/301: dwrite d0/de/d17/d2f/d40/f34 [4194304,4194304] 0 2024-04-18T04:57:59.796 INFO:tasks.workunit.client.0.smithi096.stdout:1/454: getdents de/d1d/d3f 0 2024-04-18T04:57:59.797 INFO:tasks.workunit.client.0.smithi096.stdout:7/317: creat db/d1f/d42/f65 x:0 0 0 2024-04-18T04:57:59.798 INFO:tasks.workunit.client.0.smithi096.stdout:6/427: write d0/d6/d2e/f56 [3842186,79985] 0 2024-04-18T04:57:59.799 INFO:tasks.workunit.client.0.smithi096.stdout:7/318: fsync db/d1d/f4a 0 2024-04-18T04:57:59.800 INFO:tasks.workunit.client.0.smithi096.stdout:6/428: stat d0/d6/d5d/l47 0 2024-04-18T04:57:59.800 INFO:tasks.workunit.client.0.smithi096.stdout:1/455: link de/d1d/c2c de/d1d/d3f/d7a/c84 0 2024-04-18T04:57:59.801 INFO:tasks.workunit.client.0.smithi096.stdout:1/456: write de/f2e [181650,42275] 0 2024-04-18T04:57:59.802 INFO:tasks.workunit.client.0.smithi096.stdout:6/429: creat d0/d6/d2b/d3b/d69/d6c/f76 x:0 0 0 2024-04-18T04:57:59.804 INFO:tasks.workunit.client.0.smithi096.stdout:1/457: mkdir de/d1d/d32/d6f/d85 0 2024-04-18T04:57:59.805 INFO:tasks.workunit.client.0.smithi096.stdout:1/458: creat de/f86 x:0 0 0 2024-04-18T04:57:59.811 INFO:tasks.workunit.client.0.smithi096.stdout:7/319: dwrite db/d1f/d42/f5f [0,4194304] 0 2024-04-18T04:57:59.813 INFO:tasks.workunit.client.0.smithi096.stdout:7/320: readlink db/l26 0 2024-04-18T04:57:59.814 INFO:tasks.workunit.client.0.smithi096.stdout:2/517: sync 2024-04-18T04:57:59.815 INFO:tasks.workunit.client.0.smithi096.stdout:6/430: dwrite d0/d6/d2e/f48 [0,4194304] 0 2024-04-18T04:57:59.816 INFO:tasks.workunit.client.0.smithi096.stdout:6/431: chown d0/d6 306571970 1 2024-04-18T04:57:59.816 INFO:tasks.workunit.client.0.smithi096.stdout:2/518: write df/d18/d26/f4c [464723,73794] 0 2024-04-18T04:57:59.819 INFO:tasks.workunit.client.0.smithi096.stdout:6/432: dread - d0/d6/d5d/f70 zero size 2024-04-18T04:57:59.819 INFO:tasks.workunit.client.0.smithi096.stdout:1/459: dwrite de/d1d/d3f/f6e [4194304,4194304] 0 2024-04-18T04:57:59.821 INFO:tasks.workunit.client.0.smithi096.stdout:1/460: write de/f2f [2209735,57621] 0 2024-04-18T04:57:59.822 INFO:tasks.workunit.client.0.smithi096.stdout:2/519: stat df/d7a/f9d 0 2024-04-18T04:57:59.822 INFO:tasks.workunit.client.0.smithi096.stdout:7/321: getdents db/d20/d45 0 2024-04-18T04:57:59.824 INFO:tasks.workunit.client.0.smithi096.stdout:6/433: symlink d0/l77 0 2024-04-18T04:57:59.826 INFO:tasks.workunit.client.0.smithi096.stdout:1/461: creat de/d1d/f87 x:0 0 0 2024-04-18T04:57:59.828 INFO:tasks.workunit.client.0.smithi096.stdout:2/520: symlink df/d18/d71/lab 0 2024-04-18T04:57:59.829 INFO:tasks.workunit.client.0.smithi096.stdout:7/322: creat db/d20/f66 x:0 0 0 2024-04-18T04:57:59.829 INFO:tasks.workunit.client.0.smithi096.stdout:2/521: read df/d18/d71/d9c/fa7 [890596,13420] 0 2024-04-18T04:57:59.832 INFO:tasks.workunit.client.0.smithi096.stdout:7/323: symlink db/d1f/d39/l67 0 2024-04-18T04:57:59.834 INFO:tasks.workunit.client.0.smithi096.stdout:2/522: mknod df/d18/d71/d9c/cac 0 2024-04-18T04:57:59.835 INFO:tasks.workunit.client.0.smithi096.stdout:6/434: rmdir d0/d4a 39 2024-04-18T04:57:59.836 INFO:tasks.workunit.client.0.smithi096.stdout:1/462: link de/d1d/f66 de/d7b/f88 0 2024-04-18T04:57:59.838 INFO:tasks.workunit.client.0.smithi096.stdout:6/435: read - d0/d6/d5d/f70 zero size 2024-04-18T04:57:59.838 INFO:tasks.workunit.client.0.smithi096.stdout:2/523: getdents df/d7d/d9f 0 2024-04-18T04:57:59.839 INFO:tasks.workunit.client.0.smithi096.stdout:2/524: chown df/f73 107598163 1 2024-04-18T04:57:59.840 INFO:tasks.workunit.client.0.smithi096.stdout:7/324: dwrite db/f48 [0,4194304] 0 2024-04-18T04:57:59.840 INFO:tasks.workunit.client.0.smithi096.stdout:1/463: symlink de/d1d/l89 0 2024-04-18T04:57:59.841 INFO:tasks.workunit.client.0.smithi096.stdout:2/525: fsync df/d18/d24/f77 0 2024-04-18T04:57:59.841 INFO:tasks.workunit.client.0.smithi096.stdout:7/325: write db/d1f/f40 [287479,106310] 0 2024-04-18T04:57:59.842 INFO:tasks.workunit.client.0.smithi096.stdout:2/526: write df/d18/d24/d42/d6e/f8b [696542,71387] 0 2024-04-18T04:57:59.844 INFO:tasks.workunit.client.0.smithi096.stdout:1/464: creat de/d1d/d32/d6f/f8a x:0 0 0 2024-04-18T04:57:59.846 INFO:tasks.workunit.client.0.smithi096.stdout:6/436: getdents d0/d6/d2b/d3b 0 2024-04-18T04:57:59.846 INFO:tasks.workunit.client.0.smithi096.stdout:7/326: mknod db/d1f/d24/d61/c68 0 2024-04-18T04:57:59.847 INFO:tasks.workunit.client.0.smithi096.stdout:1/465: mkdir de/d1d/d32/d73/d8b 0 2024-04-18T04:57:59.848 INFO:tasks.workunit.client.0.smithi096.stdout:7/327: write db/d20/d2f/f34 [457934,50065] 0 2024-04-18T04:57:59.848 INFO:tasks.workunit.client.0.smithi096.stdout:6/437: dread d0/d6/f34 [0,4194304] 0 2024-04-18T04:57:59.849 INFO:tasks.workunit.client.0.smithi096.stdout:7/328: write db/f3f [5177994,5475] 0 2024-04-18T04:57:59.849 INFO:tasks.workunit.client.0.smithi096.stdout:2/527: link df/d18/d24/d42/d3f/d4a/c55 df/d18/d24/d42/d6e/cad 0 2024-04-18T04:57:59.850 INFO:tasks.workunit.client.0.smithi096.stdout:6/438: fdatasync d0/d6/d5d/f75 0 2024-04-18T04:57:59.851 INFO:tasks.workunit.client.0.smithi096.stdout:1/466: mkdir de/d1d/d32/d8c 0 2024-04-18T04:57:59.851 INFO:tasks.workunit.client.0.smithi096.stdout:2/528: fsync df/d18/f22 0 2024-04-18T04:57:59.851 INFO:tasks.workunit.client.0.smithi096.stdout:7/329: read db/d1d/f47 [1049604,33516] 0 2024-04-18T04:57:59.855 INFO:tasks.workunit.client.0.smithi096.stdout:7/330: mknod db/d20/d2f/c69 0 2024-04-18T04:57:59.861 INFO:tasks.workunit.client.0.smithi096.stdout:7/331: mkdir db/d1f/d5b/d6a 0 2024-04-18T04:57:59.862 INFO:tasks.workunit.client.0.smithi096.stdout:1/467: dwrite de/d1d/f78 [0,4194304] 0 2024-04-18T04:57:59.862 INFO:tasks.workunit.client.0.smithi096.stdout:6/439: dwrite d0/d6/f20 [0,4194304] 0 2024-04-18T04:57:59.863 INFO:tasks.workunit.client.0.smithi096.stdout:6/440: write d0/d6/d5d/f3c [82518,83934] 0 2024-04-18T04:57:59.868 INFO:tasks.workunit.client.0.smithi096.stdout:7/332: mkdir db/d20/d45/d5e/d6b 0 2024-04-18T04:57:59.868 INFO:tasks.workunit.client.0.smithi096.stdout:1/468: truncate de/d7b/f88 5006880 0 2024-04-18T04:57:59.868 INFO:tasks.workunit.client.0.smithi096.stdout:6/441: mknod d0/c78 0 2024-04-18T04:57:59.870 INFO:tasks.workunit.client.0.smithi096.stdout:6/442: write d0/d6/d2b/d3b/d69/f5b [5208379,83047] 0 2024-04-18T04:57:59.872 INFO:tasks.workunit.client.0.smithi096.stdout:7/333: dread f7 [0,4194304] 0 2024-04-18T04:57:59.872 INFO:tasks.workunit.client.0.smithi096.stdout:1/469: mknod de/d1d/d32/d73/d8b/c8d 0 2024-04-18T04:57:59.873 INFO:tasks.workunit.client.0.smithi096.stdout:7/334: chown db/c64 1547 1 2024-04-18T04:57:59.874 INFO:tasks.workunit.client.0.smithi096.stdout:7/335: readlink db/l3d 0 2024-04-18T04:57:59.875 INFO:tasks.workunit.client.0.smithi096.stdout:7/336: chown db/f18 9027 1 2024-04-18T04:57:59.875 INFO:tasks.workunit.client.0.smithi096.stdout:2/529: dread df/d18/d26/f29 [0,4194304] 0 2024-04-18T04:57:59.880 INFO:tasks.workunit.client.0.smithi096.stdout:1/470: dwrite de/f5e [0,4194304] 0 2024-04-18T04:57:59.880 INFO:tasks.workunit.client.0.smithi096.stdout:7/337: unlink db/c10 0 2024-04-18T04:57:59.881 INFO:tasks.workunit.client.0.smithi096.stdout:6/443: write d0/f33 [3472547,58742] 0 2024-04-18T04:57:59.886 INFO:tasks.workunit.client.0.smithi096.stdout:1/471: creat de/d1d/d32/f8e x:0 0 0 2024-04-18T04:57:59.886 INFO:tasks.workunit.client.0.smithi096.stdout:1/472: mknod de/d1d/c8f 0 2024-04-18T04:57:59.890 INFO:tasks.workunit.client.0.smithi096.stdout:7/338: rename db/d20/d2f/c69 to db/d20/d2f/c6c 0 2024-04-18T04:57:59.891 INFO:tasks.workunit.client.0.smithi096.stdout:7/339: chown db/d20/c2d 4718 1 2024-04-18T04:57:59.892 INFO:tasks.workunit.client.0.smithi096.stdout:6/444: dwrite d0/d6/d2e/f45 [0,4194304] 0 2024-04-18T04:57:59.892 INFO:tasks.workunit.client.0.smithi096.stdout:7/340: stat f7 0 2024-04-18T04:57:59.894 INFO:tasks.workunit.client.0.smithi096.stdout:1/473: dwrite de/d1d/f42 [0,4194304] 0 2024-04-18T04:57:59.896 INFO:tasks.workunit.client.0.smithi096.stdout:6/445: creat d0/d6/d2b/d3b/d69/d66/f79 x:0 0 0 2024-04-18T04:57:59.897 INFO:tasks.workunit.client.0.smithi096.stdout:1/474: unlink de/f86 0 2024-04-18T04:57:59.898 INFO:tasks.workunit.client.0.smithi096.stdout:1/475: dread - de/d1d/f87 zero size 2024-04-18T04:57:59.900 INFO:tasks.workunit.client.0.smithi096.stdout:6/446: mkdir d0/d6/d2e/d7a 0 2024-04-18T04:57:59.903 INFO:tasks.workunit.client.0.smithi096.stdout:1/476: link de/l1c de/d1d/d32/d73/d8b/l90 0 2024-04-18T04:57:59.904 INFO:tasks.workunit.client.0.smithi096.stdout:6/447: dread d0/d6/d2e/f56 [0,4194304] 0 2024-04-18T04:57:59.905 INFO:tasks.workunit.client.0.smithi096.stdout:1/477: truncate de/f12 591554 0 2024-04-18T04:57:59.906 INFO:tasks.workunit.client.0.smithi096.stdout:1/478: chown de/d1d/d3f/l79 31886 1 2024-04-18T04:57:59.907 INFO:tasks.workunit.client.0.smithi096.stdout:1/479: write de/d1d/f78 [3828758,8268] 0 2024-04-18T04:57:59.908 INFO:tasks.workunit.client.0.smithi096.stdout:1/480: write de/f2f [596648,62563] 0 2024-04-18T04:57:59.912 INFO:tasks.workunit.client.0.smithi096.stdout:6/448: dwrite d0/d6/d5d/f75 [8388608,4194304] 0 2024-04-18T04:57:59.921 INFO:tasks.workunit.client.0.smithi096.stdout:6/449: dwrite d0/d6/d2b/f5e [0,4194304] 0 2024-04-18T04:57:59.925 INFO:tasks.workunit.client.0.smithi096.stdout:6/450: dread d0/d6/f1d [0,4194304] 0 2024-04-18T04:57:59.927 INFO:tasks.workunit.client.0.smithi096.stdout:6/451: creat d0/d6/d5d/f7b x:0 0 0 2024-04-18T04:57:59.929 INFO:tasks.workunit.client.0.smithi096.stdout:6/452: creat d0/d6/d2e/f7c x:0 0 0 2024-04-18T04:57:59.930 INFO:tasks.workunit.client.0.smithi096.stdout:6/453: readlink d0/d6/d2b/d3b/l55 0 2024-04-18T04:57:59.931 INFO:tasks.workunit.client.0.smithi096.stdout:6/454: mkdir d0/d6/d2b/d3b/d7d 0 2024-04-18T04:57:59.933 INFO:tasks.workunit.client.0.smithi096.stdout:6/455: mkdir d0/d6/d2b/d7e 0 2024-04-18T04:57:59.935 INFO:tasks.workunit.client.0.smithi096.stdout:6/456: getdents d0/d6/d2b/d3b/d69 0 2024-04-18T04:57:59.936 INFO:tasks.workunit.client.0.smithi096.stdout:6/457: stat d0/ca 0 2024-04-18T04:57:59.937 INFO:tasks.workunit.client.0.smithi096.stdout:6/458: write d0/d6/f15 [2728851,100561] 0 2024-04-18T04:57:59.938 INFO:tasks.workunit.client.0.smithi096.stdout:6/459: dread - d0/d6/d5d/f70 zero size 2024-04-18T04:57:59.940 INFO:tasks.workunit.client.0.smithi096.stdout:6/460: creat d0/d6/d29/f7f x:0 0 0 2024-04-18T04:57:59.941 INFO:tasks.workunit.client.0.smithi096.stdout:6/461: unlink d0/d6/d2b/l64 0 2024-04-18T04:57:59.943 INFO:tasks.workunit.client.0.smithi096.stdout:6/462: creat d0/d73/f80 x:0 0 0 2024-04-18T04:57:59.947 INFO:tasks.workunit.client.0.smithi096.stdout:6/463: dread d0/d6/d2e/f56 [0,4194304] 0 2024-04-18T04:57:59.948 INFO:tasks.workunit.client.0.smithi096.stdout:6/464: symlink d0/d6/d5d/l81 0 2024-04-18T04:57:59.950 INFO:tasks.workunit.client.0.smithi096.stdout:6/465: creat d0/f82 x:0 0 0 2024-04-18T04:57:59.951 INFO:tasks.workunit.client.0.smithi096.stdout:6/466: mkdir d0/d6/d29/d83 0 2024-04-18T04:57:59.958 INFO:tasks.workunit.client.0.smithi096.stdout:6/467: dwrite d0/d6/d29/f30 [0,4194304] 0 2024-04-18T04:57:59.966 INFO:tasks.workunit.client.0.smithi096.stdout:6/468: dwrite d0/f59 [0,4194304] 0 2024-04-18T04:57:59.970 INFO:tasks.workunit.client.0.smithi096.stdout:6/469: creat d0/d6/d2b/d3b/d69/f84 x:0 0 0 2024-04-18T04:57:59.971 INFO:tasks.workunit.client.0.smithi096.stdout:6/470: mkdir d0/d6/d2b/d3b/d69/d6c/d85 0 2024-04-18T04:57:59.972 INFO:tasks.workunit.client.0.smithi096.stdout:6/471: truncate d0/d6/d5d/f3c 4590319 0 2024-04-18T04:57:59.974 INFO:tasks.workunit.client.0.smithi096.stdout:6/472: write d0/d6/d2b/f5c [1061775,38551] 0 2024-04-18T04:57:59.975 INFO:tasks.workunit.client.0.smithi096.stdout:6/473: write d0/d6/d2b/d3b/d69/d6c/f76 [8632,5124] 0 2024-04-18T04:57:59.976 INFO:tasks.workunit.client.0.smithi096.stdout:6/474: write d0/d6/d2e/f48 [794223,50449] 0 2024-04-18T04:57:59.977 INFO:tasks.workunit.client.0.smithi096.stdout:6/475: write d0/d6/d2b/f5c [299123,104827] 0 2024-04-18T04:57:59.980 INFO:tasks.workunit.client.0.smithi096.stdout:6/476: read d0/d6/d2e/f31 [993129,123475] 0 2024-04-18T04:57:59.984 INFO:tasks.workunit.client.0.smithi096.stdout:6/477: rename d0/d6/d2e/l2a to d0/d4a/l86 0 2024-04-18T04:57:59.987 INFO:tasks.workunit.client.0.smithi096.stdout:6/478: symlink d0/d6/d2b/d3b/d7d/l87 0 2024-04-18T04:57:59.989 INFO:tasks.workunit.client.0.smithi096.stdout:6/479: rename d0/d4a/l60 to d0/d6/d2b/d3b/d69/d66/l88 0 2024-04-18T04:57:59.989 INFO:tasks.workunit.client.0.smithi096.stdout:5/205: sync 2024-04-18T04:57:59.989 INFO:tasks.workunit.client.0.smithi096.stdout:3/466: sync 2024-04-18T04:57:59.990 INFO:tasks.workunit.client.0.smithi096.stdout:6/480: dread - d0/f67 zero size 2024-04-18T04:57:59.991 INFO:tasks.workunit.client.0.smithi096.stdout:5/206: write d7/dd/f2e [69821,33152] 0 2024-04-18T04:57:59.992 INFO:tasks.workunit.client.0.smithi096.stdout:3/467: mkdir dc/d26/d76/d95 0 2024-04-18T04:57:59.992 INFO:tasks.workunit.client.0.smithi096.stdout:5/207: fdatasync d7/f17 0 2024-04-18T04:57:59.994 INFO:tasks.workunit.client.0.smithi096.stdout:5/208: mknod d7/dd/c53 0 2024-04-18T04:57:59.995 INFO:tasks.workunit.client.0.smithi096.stdout:3/468: symlink dc/d26/d76/l96 0 2024-04-18T04:57:59.995 INFO:tasks.workunit.client.0.smithi096.stdout:5/209: chown d7/d39/f20 0 1 2024-04-18T04:57:59.996 INFO:tasks.workunit.client.0.smithi096.stdout:3/469: dread - dc/d26/d4a/f91 zero size 2024-04-18T04:57:59.997 INFO:tasks.workunit.client.0.smithi096.stdout:5/210: creat d7/d39/d36/f54 x:0 0 0 2024-04-18T04:57:59.997 INFO:tasks.workunit.client.0.smithi096.stdout:6/481: dwrite d0/d6/d2b/d3b/d69/f5b [0,4194304] 0 2024-04-18T04:57:59.998 INFO:tasks.workunit.client.0.smithi096.stdout:3/470: mknod dc/d26/d76/c97 0 2024-04-18T04:58:00.000 INFO:tasks.workunit.client.0.smithi096.stdout:5/211: rmdir d7/d25/d30 39 2024-04-18T04:58:00.003 INFO:tasks.workunit.client.0.smithi096.stdout:5/212: write d7/d25/f41 [1883382,56753] 0 2024-04-18T04:58:00.003 INFO:tasks.workunit.client.0.smithi096.stdout:3/471: read f3 [152497,61039] 0 2024-04-18T04:58:00.003 INFO:tasks.workunit.client.0.smithi096.stdout:6/482: dread d0/d6/d29/f46 [0,4194304] 0 2024-04-18T04:58:00.004 INFO:tasks.workunit.client.0.smithi096.stdout:3/472: read - dc/d70/f73 zero size 2024-04-18T04:58:00.007 INFO:tasks.workunit.client.0.smithi096.stdout:5/213: creat d7/d25/d30/f55 x:0 0 0 2024-04-18T04:58:00.007 INFO:tasks.workunit.client.0.smithi096.stdout:5/214: write d7/d12/f1f [401702,5569] 0 2024-04-18T04:58:00.011 INFO:tasks.workunit.client.0.smithi096.stdout:5/215: mkdir d7/d39/d56 0 2024-04-18T04:58:00.011 INFO:tasks.workunit.client.0.smithi096.stdout:6/483: link d0/d6/d2b/d3b/d69/c63 d0/d73/c89 0 2024-04-18T04:58:00.011 INFO:tasks.workunit.client.0.smithi096.stdout:5/216: dread - d7/f3c zero size 2024-04-18T04:58:00.104 INFO:tasks.workunit.client.0.smithi096.stdout:5/217: mknod d7/d3b/c57 0 2024-04-18T04:58:00.106 INFO:tasks.workunit.client.0.smithi096.stdout:5/218: dread - d7/d25/d30/f55 zero size 2024-04-18T04:58:00.107 INFO:tasks.workunit.client.0.smithi096.stdout:3/473: dread dc/f18 [0,4194304] 0 2024-04-18T04:58:00.108 INFO:tasks.workunit.client.0.smithi096.stdout:6/484: getdents d0/d6/d2b/d3b 0 2024-04-18T04:58:00.110 INFO:tasks.workunit.client.0.smithi096.stdout:5/219: mkdir d7/d25/d58 0 2024-04-18T04:58:00.111 INFO:tasks.workunit.client.0.smithi096.stdout:5/220: chown d7/d25/d30/f3a 0 1 2024-04-18T04:58:00.112 INFO:tasks.workunit.client.0.smithi096.stdout:3/474: creat dc/d26/d76/d95/f98 x:0 0 0 2024-04-18T04:58:00.113 INFO:tasks.workunit.client.0.smithi096.stdout:6/485: getdents d0/d4a 0 2024-04-18T04:58:00.114 INFO:tasks.workunit.client.0.smithi096.stdout:5/221: creat d7/dd/d35/f59 x:0 0 0 2024-04-18T04:58:00.116 INFO:tasks.workunit.client.0.smithi096.stdout:3/475: creat dc/d26/d4a/d8b/f99 x:0 0 0 2024-04-18T04:58:00.117 INFO:tasks.workunit.client.0.smithi096.stdout:5/222: write d7/d25/d30/f55 [743201,128995] 0 2024-04-18T04:58:00.118 INFO:tasks.workunit.client.0.smithi096.stdout:6/486: creat d0/f8a x:0 0 0 2024-04-18T04:58:00.120 INFO:tasks.workunit.client.0.smithi096.stdout:3/476: creat dc/d26/d48/f9a x:0 0 0 2024-04-18T04:58:00.121 INFO:tasks.workunit.client.0.smithi096.stdout:5/223: creat d7/d12/f5a x:0 0 0 2024-04-18T04:58:00.122 INFO:tasks.workunit.client.0.smithi096.stdout:5/224: write d7/fe [300939,107553] 0 2024-04-18T04:58:00.123 INFO:tasks.workunit.client.0.smithi096.stdout:6/487: link d0/d6/d2b/f54 d0/d6/d29/f8b 0 2024-04-18T04:58:00.124 INFO:tasks.workunit.client.0.smithi096.stdout:5/225: stat d7/d39/f50 0 2024-04-18T04:58:00.125 INFO:tasks.workunit.client.0.smithi096.stdout:5/226: fsync d7/f4c 0 2024-04-18T04:58:00.129 INFO:tasks.workunit.client.0.smithi096.stdout:6/488: creat d0/d6/d2b/d3b/d7d/f8c x:0 0 0 2024-04-18T04:58:00.131 INFO:tasks.workunit.client.0.smithi096.stdout:3/477: dwrite dc/d5d/f86 [0,4194304] 0 2024-04-18T04:58:00.145 INFO:tasks.workunit.client.0.smithi096.stdout:5/227: dwrite d7/d12/f2d [4194304,4194304] 0 2024-04-18T04:58:00.147 INFO:tasks.workunit.client.0.smithi096.stdout:6/489: dwrite d0/d6/d2b/d3b/d69/f71 [0,4194304] 0 2024-04-18T04:58:00.149 INFO:tasks.workunit.client.0.smithi096.stdout:5/228: rmdir d7/d3b 39 2024-04-18T04:58:00.152 INFO:tasks.workunit.client.0.smithi096.stdout:5/229: symlink d7/d39/l5b 0 2024-04-18T04:58:00.153 INFO:tasks.workunit.client.0.smithi096.stdout:5/230: chown d7/f1a 304652577 1 2024-04-18T04:58:00.156 INFO:tasks.workunit.client.0.smithi096.stdout:8/281: sync 2024-04-18T04:58:00.157 INFO:tasks.workunit.client.0.smithi096.stdout:5/231: fsync d7/d12/f15 0 2024-04-18T04:58:00.159 INFO:tasks.workunit.client.0.smithi096.stdout:8/282: truncate d0/d7/d24/d18/d21/f56 265271 0 2024-04-18T04:58:00.160 INFO:tasks.workunit.client.0.smithi096.stdout:8/283: write d0/d3/f31 [993386,82998] 0 2024-04-18T04:58:00.167 INFO:tasks.workunit.client.0.smithi096.stdout:5/232: getdents d7/d39/d56 0 2024-04-18T04:58:00.167 INFO:tasks.workunit.client.0.smithi096.stdout:5/233: chown d7/d12/f1f 0 1 2024-04-18T04:58:00.170 INFO:tasks.workunit.client.0.smithi096.stdout:8/284: mkdir d0/d7/d24/d18/d5d 0 2024-04-18T04:58:00.176 INFO:tasks.workunit.client.0.smithi096.stdout:5/234: dwrite d7/d25/d30/f3a [0,4194304] 0 2024-04-18T04:58:00.177 INFO:tasks.workunit.client.0.smithi096.stdout:5/235: write d7/d12/f5a [575266,97262] 0 2024-04-18T04:58:00.179 INFO:tasks.workunit.client.0.smithi096.stdout:8/285: dwrite d0/d3/f3a [0,4194304] 0 2024-04-18T04:58:00.184 INFO:tasks.workunit.client.0.smithi096.stdout:5/236: rename d7/fc to d7/d25/d30/f5c 0 2024-04-18T04:58:00.185 INFO:tasks.workunit.client.0.smithi096.stdout:5/237: write d7/fa [683041,65722] 0 2024-04-18T04:58:00.187 INFO:tasks.workunit.client.0.smithi096.stdout:5/238: chown d7/d25/d2b 230 1 2024-04-18T04:58:00.191 INFO:tasks.workunit.client.0.smithi096.stdout:8/286: dwrite d0/d7/d24/d18/d21/f4e [0,4194304] 0 2024-04-18T04:58:00.196 INFO:tasks.workunit.client.0.smithi096.stdout:8/287: creat d0/d7/d24/d35/f5e x:0 0 0 2024-04-18T04:58:00.198 INFO:tasks.workunit.client.0.smithi096.stdout:8/288: truncate d0/d7/f50 656726 0 2024-04-18T04:58:00.203 INFO:tasks.workunit.client.0.smithi096.stdout:8/289: creat d0/d7/d24/d18/d5d/f5f x:0 0 0 2024-04-18T04:58:00.204 INFO:tasks.workunit.client.0.smithi096.stdout:8/290: dread - d0/d4f/f58 zero size 2024-04-18T04:58:00.205 INFO:tasks.workunit.client.0.smithi096.stdout:5/239: dread d7/d12/f44 [0,4194304] 0 2024-04-18T04:58:00.205 INFO:tasks.workunit.client.0.smithi096.stdout:8/291: read - d0/f59 zero size 2024-04-18T04:58:00.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.210+0000 7f14cffff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 0x7f14d80c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.210+0000 7f14cffff640 1 -- 172.21.15.96:0/267710781 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14d80c6940 con 0x7f14d80c4260 2024-04-18T04:58:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.210+0000 7f14cffff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 0x7f14d80c2f30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f14d80c47c0 tx=0x7f14c001b2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:00.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.210+0000 7f14d4ff9640 1 -- 172.21.15.96:0/267710781 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c00c2400 con 0x7f14d80c4260 2024-04-18T04:58:00.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.210+0000 7f14d4ff9640 1 -- 172.21.15.96:0/267710781 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f14c00c2560 con 0x7f14d80c4260 2024-04-18T04:58:00.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.210+0000 7f14d4ff9640 1 -- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 msgr2=0x7f14d80c2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.210+0000 7f14d4ff9640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 0x7f14d80c2f30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f14d80c47c0 tx=0x7f14c001b2e0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.210+0000 7f14d4ff9640 1 -- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 msgr2=0x7f14d80c2f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:00.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.210+0000 7f14d4ff9640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c4260 0x7f14d80c2f30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.212 INFO:tasks.workunit.client.0.smithi096.stdout:5/240: truncate d7/d25/f28 579961 0 2024-04-18T04:58:00.212 INFO:tasks.workunit.client.0.smithi096.stdout:5/241: fsync d7/d25/d30/f4b 0 2024-04-18T04:58:00.213 INFO:tasks.workunit.client.0.smithi096.stdout:5/242: write d7/d25/f2f [1093474,40254] 0 2024-04-18T04:58:00.216 INFO:tasks.workunit.client.0.smithi096.stdout:5/243: mknod d7/d39/d36/c5d 0 2024-04-18T04:58:00.216 INFO:tasks.workunit.client.0.smithi096.stdout:5/244: stat d7/c1d 0 2024-04-18T04:58:00.217 INFO:tasks.workunit.client.0.smithi096.stdout:5/245: chown d7/f1a 14014 1 2024-04-18T04:58:00.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14ddeb7640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c3ad0 0x7f14d81680d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:00.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14ddeb7640 1 -- 172.21.15.96:0/267710781 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80c37a0 con 0x7f14d80c3ad0 2024-04-18T04:58:00.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14cffff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c3ad0 0x7f14d81680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:00.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14cffff640 1 -- 172.21.15.96:0/267710781 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f14d80670f0 con 0x7f14d80c3ad0 2024-04-18T04:58:00.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14cffff640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c3ad0 0x7f14d81680d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f14c0000c10 tx=0x7f14c0019840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:00.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14d4ff9640 1 -- 172.21.15.96:0/267710781 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0003a30 con 0x7f14d80c3ad0 2024-04-18T04:58:00.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14d4ff9640 1 -- 172.21.15.96:0/267710781 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7f14c0003b90 con 0x7f14d80c3ad0 2024-04-18T04:58:00.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14d4ff9640 1 -- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c3ad0 msgr2=0x7f14d81680d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14d4ff9640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c3ad0 0x7f14d81680d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f14c0000c10 tx=0x7f14c0019840 comp rx=0 tx=0).stop 2024-04-18T04:58:00.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14d4ff9640 1 -- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c3ad0 msgr2=0x7f14d81680d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:00.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14d4ff9640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d80c3ad0 0x7f14d81680d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.220 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:58:00.220 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:58:00.220 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:58:00.220 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:58:00.220 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 36, 2024-04-18T04:58:00.220 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:58:00.221 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:58:00.221 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:58:00.221 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:58:00.221 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:00.221 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 5, 2024-04-18T04:58:00.221 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:00.221 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:58:00.221 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:58:00.221 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:00.221 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:00.221 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:00.221 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:00.221 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:00.221 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:00.221 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:00.222 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:00.222 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:00.222 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:00.222 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:00.222 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:58:00.222 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:58:00.222 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:00.222 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:00.222 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:00.222 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:00.222 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:00.222 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:00.222 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:00.222 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:00.223 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:00.223 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:00.223 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:00.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.223 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:58:00.223 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:58:00.223 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:58:00.223 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:58:00.223 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:58:00.223 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:58:00.223 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:00.223 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:00.223 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:58:00.223 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:58:00.224 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:58:00.224 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:58:00.224 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:58:00.224 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:58:00.224 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:58:00.224 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:00.224 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:58:00.224 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:00.224 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:00.224 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:00.224 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:00.224 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:00.224 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:00.224 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:00.225 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:00.225 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:00.225 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:00.225 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:00.225 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:58:00.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.225 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:58:00.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.225 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:58:00.225 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:58:00.225 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:00.225 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:00.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.225 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:00.225 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:58:00.226 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:00.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.226 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:00.226 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:58:00.226 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:00.226 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:00.226 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:00.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.226 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:58:00.226 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:58:00.226 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:00.226 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:00.227 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:00.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.227 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.227 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:58:00.227 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:58:00.227 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:00.227 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:00.227 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.227 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:00.227 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:58:00.227 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:00.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.227 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.227 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:00.228 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:58:00.228 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:00.228 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:00.228 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:00.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.228 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:58:00.228 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:58:00.228 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:00.228 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:00.228 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:00.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.228 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:58:00.228 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:58:00.228 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:00.228 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:00.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.229 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:00.229 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:58:00.229 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:00.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.229 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:00.229 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:58:00.229 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:00.229 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:00.230 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:00.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.230 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:58:00.230 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:58:00.230 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:00.230 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:00.230 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:00.230 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:00.230 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:00.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.231 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:58:00.231 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:58:00.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.231 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:00.231 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:00.231 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:00.231 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:00.231 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:00.231 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:58:00.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.231 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:00.231 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:00.231 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:00.231 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:00.232 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:00.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.232 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:58:00.232 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:58:00.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14ddeb7640 1 -- 172.21.15.96:0/267710781 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f14b80666c0 msgr2=0x7f14b8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14ddeb7640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f14b80666c0 0x7f14b8068b80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f14d80c14d0 tx=0x7f14d0009040 comp rx=0 tx=0).stop 2024-04-18T04:58:00.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14ddeb7640 1 -- 172.21.15.96:0/267710781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14d806bf20 msgr2=0x7f14d8162bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14ddeb7640 1 --2- 172.21.15.96:0/267710781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14d806bf20 0x7f14d8162bc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14c800e950 tx=0x7f14c800ee10 comp rx=0 tx=0).stop 2024-04-18T04:58:00.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14d7fff640 1 -- 172.21.15.96:0/267710781 reap_dead start 2024-04-18T04:58:00.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14d7fff640 1 -- 172.21.15.96:0/267710781 reap_dead start 2024-04-18T04:58:00.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14ddeb7640 1 -- 172.21.15.96:0/267710781 shutdown_connections 2024-04-18T04:58:00.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14ddeb7640 1 -- 172.21.15.96:0/267710781 >> 172.21.15.96:0/267710781 conn(0x7f14d806a8e0 msgr2=0x7f14d80c50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:00.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14ddeb7640 1 -- 172.21.15.96:0/267710781 shutdown_connections 2024-04-18T04:58:00.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.218+0000 7f14ddeb7640 1 -- 172.21.15.96:0/267710781 wait complete. 2024-04-18T04:58:00.234 INFO:tasks.workunit.client.0.smithi096.stdout:5/246: dwrite d7/d25/f4d [0,4194304] 0 2024-04-18T04:58:00.234 INFO:tasks.workunit.client.0.smithi096.stdout:5/247: dwrite d7/dd/f37 [0,4194304] 0 2024-04-18T04:58:00.236 INFO:tasks.workunit.client.0.smithi096.stdout:5/248: mkdir d7/d12/d5e 0 2024-04-18T04:58:00.239 INFO:tasks.workunit.client.0.smithi096.stdout:5/249: symlink d7/dd/d35/l5f 0 2024-04-18T04:58:00.240 INFO:tasks.workunit.client.0.smithi096.stdout:5/250: symlink d7/dd/l60 0 2024-04-18T04:58:00.243 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:58:00.243 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-18T04:58:00.243 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-18T04:58:00.248 INFO:tasks.workunit.client.0.smithi096.stdout:5/251: fsync d7/d25/f28 0 2024-04-18T04:58:00.251 INFO:tasks.workunit.client.0.smithi096.stdout:5/252: mkdir d7/d39/d52/d61 0 2024-04-18T04:58:00.252 INFO:tasks.workunit.client.0.smithi096.stdout:5/253: write d7/dd/d35/f59 [712414,98442] 0 2024-04-18T04:58:00.253 INFO:tasks.workunit.client.0.smithi096.stdout:5/254: fsync d7/d39/f29 0 2024-04-18T04:58:00.259 INFO:tasks.workunit.client.0.smithi096.stdout:5/255: dwrite d7/dd/f19 [0,4194304] 0 2024-04-18T04:58:00.260 INFO:tasks.workunit.client.0.smithi096.stdout:5/256: chown d7/d25/d2b/f3d 1786 1 2024-04-18T04:58:00.264 INFO:tasks.workunit.client.0.smithi096.stdout:5/257: creat d7/d25/d58/f62 x:0 0 0 2024-04-18T04:58:00.272 INFO:tasks.workunit.client.0.smithi096.stdout:5/258: dwrite d7/d25/f41 [4194304,4194304] 0 2024-04-18T04:58:00.276 INFO:tasks.workunit.client.0.smithi096.stdout:5/259: creat d7/d12/d5e/f63 x:0 0 0 2024-04-18T04:58:00.282 INFO:tasks.workunit.client.0.smithi096.stdout:0/363: sync 2024-04-18T04:58:00.282 INFO:tasks.workunit.client.0.smithi096.stdout:4/343: sync 2024-04-18T04:58:00.283 INFO:tasks.workunit.client.0.smithi096.stdout:5/260: link d7/d3b/c57 d7/d39/d56/c64 0 2024-04-18T04:58:00.284 INFO:tasks.workunit.client.0.smithi096.stdout:5/261: write d7/f4c [1381783,100922] 0 2024-04-18T04:58:00.285 INFO:tasks.workunit.client.0.smithi096.stdout:0/364: rmdir d16/d1c/d22/d3a 39 2024-04-18T04:58:00.293 INFO:tasks.workunit.client.0.smithi096.stdout:0/365: dread d16/d1c/d22/f28 [0,4194304] 0 2024-04-18T04:58:00.294 INFO:tasks.workunit.client.0.smithi096.stdout:5/262: rename d7/dd/f37 to d7/d39/d52/f65 0 2024-04-18T04:58:00.294 INFO:tasks.workunit.client.0.smithi096.stdout:0/366: read d16/d1d/f34 [2086530,86979] 0 2024-04-18T04:58:00.298 INFO:tasks.workunit.client.0.smithi096.stdout:5/263: symlink d7/d39/l66 0 2024-04-18T04:58:00.301 INFO:tasks.workunit.client.0.smithi096.stdout:0/367: dread d16/f21 [0,4194304] 0 2024-04-18T04:58:00.302 INFO:tasks.workunit.client.0.smithi096.stdout:5/264: symlink d7/d39/d36/l67 0 2024-04-18T04:58:00.303 INFO:tasks.workunit.client.0.smithi096.stdout:4/344: write d4/d14/d16/f3f [1335022,45770] 0 2024-04-18T04:58:00.304 INFO:tasks.workunit.client.0.smithi096.stdout:4/345: write d4/d14/d1d/f52 [828458,13939] 0 2024-04-18T04:58:00.305 INFO:tasks.workunit.client.0.smithi096.stdout:4/346: write d4/d14/f2b [3798889,96377] 0 2024-04-18T04:58:00.305 INFO:tasks.workunit.client.0.smithi096.stdout:5/265: write d7/d39/d52/f65 [6343647,129515] 0 2024-04-18T04:58:00.306 INFO:tasks.workunit.client.0.smithi096.stdout:5/266: dread - d7/d25/d2b/f45 zero size 2024-04-18T04:58:00.307 INFO:tasks.workunit.client.0.smithi096.stdout:5/267: read d7/dd/f19 [1693650,36919] 0 2024-04-18T04:58:00.316 INFO:tasks.workunit.client.0.smithi096.stdout:5/268: mknod d7/d39/d36/c68 0 2024-04-18T04:58:00.320 INFO:tasks.workunit.client.0.smithi096.stdout:0/368: getdents d16/d1d 0 2024-04-18T04:58:00.321 INFO:tasks.workunit.client.0.smithi096.stdout:0/369: chown d16/d1d/c53 3639 1 2024-04-18T04:58:00.323 INFO:tasks.workunit.client.0.smithi096.stdout:4/347: creat d4/d14/f72 x:0 0 0 2024-04-18T04:58:00.323 INFO:tasks.workunit.client.0.smithi096.stdout:4/348: fsync d4/d14/d1d/f25 0 2024-04-18T04:58:00.324 INFO:tasks.workunit.client.0.smithi096.stdout:5/269: mknod d7/c69 0 2024-04-18T04:58:00.328 INFO:tasks.workunit.client.0.smithi096.stdout:4/349: rename d4/l6 to d4/d14/d2d/l73 0 2024-04-18T04:58:00.329 INFO:tasks.workunit.client.0.smithi096.stdout:0/370: mkdir d16/d1c/d22/d71 0 2024-04-18T04:58:00.332 INFO:tasks.workunit.client.0.smithi096.stdout:4/350: creat d4/d14/d1d/d29/d3a/d47/d4b/f74 x:0 0 0 2024-04-18T04:58:00.333 INFO:tasks.workunit.client.0.smithi096.stdout:4/351: write d4/d14/d1d/d29/d3a/d47/f4a [4218105,110745] 0 2024-04-18T04:58:00.333 INFO:tasks.workunit.client.0.smithi096.stdout:5/270: creat d7/d39/d56/f6a x:0 0 0 2024-04-18T04:58:00.336 INFO:tasks.workunit.client.0.smithi096.stdout:4/352: dread - d4/d14/d1d/d29/d3a/d47/d4b/f74 zero size 2024-04-18T04:58:00.338 INFO:tasks.workunit.client.0.smithi096.stdout:4/353: fsync d4/d14/d2d/d44/f5e 0 2024-04-18T04:58:00.341 INFO:tasks.workunit.client.0.smithi096.stdout:5/271: dwrite d7/d25/d2b/f45 [0,4194304] 0 2024-04-18T04:58:00.343 INFO:tasks.workunit.client.0.smithi096.stdout:5/272: truncate d7/d39/d56/f6a 882483 0 2024-04-18T04:58:00.344 INFO:tasks.workunit.client.0.smithi096.stdout:4/354: link d4/d14/d1d/d29/d3a/d39/f56 d4/d14/d1d/d29/d3a/d39/f75 0 2024-04-18T04:58:00.345 INFO:tasks.workunit.client.0.smithi096.stdout:4/355: fdatasync d4/f62 0 2024-04-18T04:58:00.347 INFO:tasks.workunit.client.0.smithi096.stdout:4/356: write d4/d14/d1d/d29/d3a/d39/d54/f5c [284375,51054] 0 2024-04-18T04:58:00.352 INFO:tasks.workunit.client.0.smithi096.stdout:5/273: dwrite d7/f42 [0,4194304] 0 2024-04-18T04:58:00.354 INFO:tasks.workunit.client.0.smithi096.stdout:5/274: fdatasync d7/d25/f2f 0 2024-04-18T04:58:00.357 INFO:tasks.workunit.client.0.smithi096.stdout:4/357: rename d4/d14/d1d/d29/d3a/d47/f4a to d4/d14/d1d/d29/f76 0 2024-04-18T04:58:00.364 INFO:tasks.workunit.client.0.smithi096.stdout:5/275: creat d7/dd/f6b x:0 0 0 2024-04-18T04:58:00.371 INFO:tasks.workunit.client.0.smithi096.stdout:5/276: dwrite d7/d39/f20 [0,4194304] 0 2024-04-18T04:58:00.375 INFO:tasks.workunit.client.0.smithi096.stdout:5/277: creat d7/d25/d30/f6c x:0 0 0 2024-04-18T04:58:00.376 INFO:tasks.workunit.client.0.smithi096.stdout:5/278: dread - d7/f3c zero size 2024-04-18T04:58:00.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.378+0000 7f35b3ab6640 1 Processor -- start 2024-04-18T04:58:00.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.378+0000 7f35b3ab6640 1 -- start start 2024-04-18T04:58:00.377 INFO:tasks.workunit.client.0.smithi096.stdout:4/358: truncate d4/d14/d1d/d29/d3a/d39/f75 3538819 0 2024-04-18T04:58:00.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.378+0000 7f35b3ab6640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f35ac14fec0 0x7f35ac0cab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:00.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.378+0000 7f35b3ab6640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ac0ca970 con 0x7f35ac0cb450 2024-04-18T04:58:00.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.378+0000 7f35b3ab6640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ac0c9c40 con 0x7f35ac0714e0 2024-04-18T04:58:00.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.378+0000 7f35b3ab6640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ac0ca4e0 con 0x7f35ac14fec0 2024-04-18T04:58:00.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.378+0000 7f35b1852640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f35ac14fec0 0x7f35ac0cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:00.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.378+0000 7f35b1852640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f35ac14fec0 0x7f35ac0cab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:54444/0 (socket says 172.21.15.96:54444) 2024-04-18T04:58:00.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.378+0000 7f35b2053640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f35ac0cb450 0x7f35ac1604e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45770/0 (socket says 172.21.15.96:45770) 2024-04-18T04:58:00.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.378+0000 7f35b1852640 1 -- 172.21.15.96:0/4043975924 learned_addr learned my addr 172.21.15.96:0/4043975924 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:00.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.378+0000 7f35b0850640 1 -- 172.21.15.96:0/4043975924 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277647592 0 0) 0x7f35ac0ca970 con 0x7f35ac0cb450 2024-04-18T04:58:00.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.378+0000 7f35b0850640 1 -- 172.21.15.96:0/4043975924 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3598003530 con 0x7f35ac0cb450 2024-04-18T04:58:00.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.378+0000 7f35b1852640 1 -- 172.21.15.96:0/4043975924 >> v1:172.21.15.139:6789/0 conn(0x7f35ac0714e0 legacy=0x7f35ac155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.378+0000 7f35b1852640 1 -- 172.21.15.96:0/4043975924 >> v1:172.21.15.96:6789/0 conn(0x7f35ac0cb450 legacy=0x7f35ac1604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.378+0000 7f35b1852640 1 -- 172.21.15.96:0/4043975924 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac1502a0 con 0x7f35ac14fec0 2024-04-18T04:58:00.379 INFO:tasks.workunit.client.0.smithi096.stdout:4/359: rmdir d4/d14/d2d/d44/d55/d67 39 2024-04-18T04:58:00.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.382+0000 7f35b1852640 1 --2- 172.21.15.96:0/4043975924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35ac14fec0 0x7f35ac0cab80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f35a800bb10 tx=0x7f35a801ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b45c7c80f674c67c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:00.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.382+0000 7f35b0850640 1 -- 172.21.15.96:0/4043975924 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a80a7bd0 con 0x7f35ac14fec0 2024-04-18T04:58:00.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.382+0000 7f35b0850640 1 -- 172.21.15.96:0/4043975924 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a80a7d30 con 0x7f35ac14fec0 2024-04-18T04:58:00.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.382+0000 7f35b0850640 1 -- 172.21.15.96:0/4043975924 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a80a7ea0 con 0x7f35ac14fec0 2024-04-18T04:58:00.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.382+0000 7f35b3ab6640 1 -- 172.21.15.96:0/4043975924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35ac14fec0 msgr2=0x7f35ac0cab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.382+0000 7f35b3ab6640 1 --2- 172.21.15.96:0/4043975924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35ac14fec0 0x7f35ac0cab80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f35a800bb10 tx=0x7f35a801ec00 comp rx=0 tx=0).stop 2024-04-18T04:58:00.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.382+0000 7f35b3ab6640 1 -- 172.21.15.96:0/4043975924 shutdown_connections 2024-04-18T04:58:00.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.382+0000 7f35b3ab6640 1 --2- 172.21.15.96:0/4043975924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35ac14fec0 0x7f35ac0cab80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.382+0000 7f35b3ab6640 1 -- 172.21.15.96:0/4043975924 >> 172.21.15.96:0/4043975924 conn(0x7f35ac06d2a0 msgr2=0x7f35ac06afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:00.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.382+0000 7f35b3ab6640 1 -- 172.21.15.96:0/4043975924 shutdown_connections 2024-04-18T04:58:00.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.382+0000 7f35b3ab6640 1 -- 172.21.15.96:0/4043975924 wait complete. 2024-04-18T04:58:00.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.382+0000 7f35b3ab6640 1 Processor -- start 2024-04-18T04:58:00.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.382+0000 7f35b3ab6640 1 -- start start 2024-04-18T04:58:00.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b3ab6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35ac0714e0 0x7f35ac158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:00.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b3ab6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35ac0cb450 0x7f35ac1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:00.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b3ab6640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac14fec0 0x7f35ac1ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:00.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b3ab6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac159cd0 con 0x7f35ac0cb450 2024-04-18T04:58:00.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b3ab6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac157ee0 con 0x7f35ac0714e0 2024-04-18T04:58:00.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b3ab6640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac1edd80 con 0x7f35ac14fec0 2024-04-18T04:58:00.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b1051640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35ac0cb450 0x7f35ac1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:00.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b1051640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35ac0cb450 0x7f35ac1579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47288/0 (socket says 172.21.15.96:47288) 2024-04-18T04:58:00.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b1852640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35ac0714e0 0x7f35ac158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:00.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b1051640 1 -- 172.21.15.96:0/3155394955 learned_addr learned my addr 172.21.15.96:0/3155394955 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:00.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b2053640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac14fec0 0x7f35ac1ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:00.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b1051640 1 -- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac14fec0 msgr2=0x7f35ac1ed840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b1051640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac14fec0 0x7f35ac1ed840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b1051640 1 -- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35ac0714e0 msgr2=0x7f35ac158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b1051640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35ac0714e0 0x7f35ac158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b1051640 1 -- 172.21.15.96:0/3155394955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a800b770 con 0x7f35ac0cb450 2024-04-18T04:58:00.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b2053640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac14fec0 0x7f35ac1ed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:58:00.386 INFO:tasks.workunit.client.0.smithi096.stdout:5/279: dread d7/d25/f2f [0,4194304] 0 2024-04-18T04:58:00.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b1051640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35ac0cb450 0x7f35ac1579a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f359c00c430 tx=0x7f359c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:00.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35a27fc640 1 -- 172.21.15.96:0/3155394955 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c0052d0 con 0x7f35ac0cb450 2024-04-18T04:58:00.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35a27fc640 1 -- 172.21.15.96:0/3155394955 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c005430 con 0x7f35ac0cb450 2024-04-18T04:58:00.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35a27fc640 1 -- 172.21.15.96:0/3155394955 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c003840 con 0x7f35ac0cb450 2024-04-18T04:58:00.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b3ab6640 1 -- 172.21.15.96:0/3155394955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ac157510 con 0x7f35ac0cb450 2024-04-18T04:58:00.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b3ab6640 1 -- 172.21.15.96:0/3155394955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ac1599f0 con 0x7f35ac0cb450 2024-04-18T04:58:00.388 INFO:tasks.workunit.client.0.smithi096.stdout:5/280: write d7/d12/f5a [811074,117289] 0 2024-04-18T04:58:00.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b3ab6640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac156710 0x7f35ac156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:00.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b3ab6640 1 -- 172.21.15.96:0/3155394955 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac066b20 con 0x7f35ac156710 2024-04-18T04:58:00.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.386+0000 7f35b1852640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac156710 0x7f35ac156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:00.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.390+0000 7f35b1852640 1 -- 172.21.15.96:0/3155394955 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35ac0ca170 con 0x7f35ac156710 2024-04-18T04:58:00.389 INFO:tasks.workunit.client.0.smithi096.stdout:4/360: dwrite d4/d14/d16/f40 [0,4194304] 0 2024-04-18T04:58:00.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.390+0000 7f35a27fc640 1 -- 172.21.15.96:0/3155394955 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f359c0039a0 con 0x7f35ac0cb450 2024-04-18T04:58:00.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.390+0000 7f35b1852640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac156710 0x7f35ac156d20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f35ac070ee0 tx=0x7f35a801b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:00.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.390+0000 7f35a27fc640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3590066690 0x7f3590068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:00.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.390+0000 7f35a27fc640 1 -- 172.21.15.96:0/3155394955 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f359c0836f0 con 0x7f35ac0cb450 2024-04-18T04:58:00.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.390+0000 7f35b2053640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3590066690 0x7f3590068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:00.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.390+0000 7f35a27fc640 1 -- 172.21.15.96:0/3155394955 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a80a7ea0 con 0x7f35ac156710 2024-04-18T04:58:00.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.390+0000 7f35b2053640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3590066690 0x7f3590068b50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f35a4007fd0 tx=0x7f35a4007ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:00.391 INFO:tasks.workunit.client.0.smithi096.stdout:5/281: creat d7/d39/d52/f6d x:0 0 0 2024-04-18T04:58:00.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.390+0000 7f35a27fc640 1 -- 172.21.15.96:0/3155394955 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f35a80be070 con 0x7f35ac156710 2024-04-18T04:58:00.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.390+0000 7f35a27fc640 1 -- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac156710 msgr2=0x7f35ac156d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.390+0000 7f35a27fc640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac156710 0x7f35ac156d20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f35ac070ee0 tx=0x7f35a801b9a0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.390+0000 7f35a27fc640 1 -- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac156710 msgr2=0x7f35ac156d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:00.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.390+0000 7f35a27fc640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac156710 0x7f35ac156d20 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f35ac070ee0 tx=0x7f35a801b9a0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.396 INFO:tasks.workunit.client.0.smithi096.stdout:5/282: mknod d7/d25/c6e 0 2024-04-18T04:58:00.397 INFO:tasks.workunit.client.0.smithi096.stdout:5/283: write d7/f17 [6987741,74200] 0 2024-04-18T04:58:00.397 INFO:tasks.workunit.client.0.smithi096.stdout:4/361: dwrite d4/d14/d16/f40 [4194304,4194304] 0 2024-04-18T04:58:00.398 INFO:tasks.workunit.client.0.smithi096.stdout:5/284: read - d7/f46 zero size 2024-04-18T04:58:00.399 INFO:tasks.workunit.client.0.smithi096.stdout:5/285: readlink d7/dd/l60 0 2024-04-18T04:58:00.399 INFO:tasks.workunit.client.0.smithi096.stdout:5/286: stat d7/l10 0 2024-04-18T04:58:00.402 INFO:tasks.workunit.client.0.smithi096.stdout:4/362: creat d4/d14/d1d/d29/d6f/f77 x:0 0 0 2024-04-18T04:58:00.404 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:58:00.404 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:58:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:58:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:58:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 36, 2024-04-18T04:58:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:58:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:58:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:58:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:58:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:00.405 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 5, 2024-04-18T04:58:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:58:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:58:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:00.406 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:58:00.407 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:58:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:00.408 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:58:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:58:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:58:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:58:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:58:00.409 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:58:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:58:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:58:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:58:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:58:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:58:00.410 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:58:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:58:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:58:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:00.411 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:58:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:58:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:58:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:58:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.412 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:58:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:58:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:58:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:58:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:00.413 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:58:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:58:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:58:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.414 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:58:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:58:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:58:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:58:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:58:00.415 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:58:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:58:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:58:00.416 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:58:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:58:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:58:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:00.417 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:58:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:58:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:58:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:58:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:00.418 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:58:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:58:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:58:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:00.419 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:00.420 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:58:00.420 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:58:00.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.402+0000 7f35b3ab6640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac152860 0x7f35ac1589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:00.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.402+0000 7f35b3ab6640 1 -- 172.21.15.96:0/3155394955 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0c9e90 con 0x7f35ac152860 2024-04-18T04:58:00.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.402+0000 7f35b1852640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac152860 0x7f35ac1589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:00.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.402+0000 7f35b1852640 1 -- 172.21.15.96:0/3155394955 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f35ac0cb0c0 con 0x7f35ac152860 2024-04-18T04:58:00.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.402+0000 7f35b1852640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac152860 0x7f35ac1589a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35a801b810 tx=0x7f35a80a9000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:00.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.402+0000 7f35a27fc640 1 -- 172.21.15.96:0/3155394955 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a8003e00 con 0x7f35ac152860 2024-04-18T04:58:00.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.402+0000 7f35a27fc640 1 -- 172.21.15.96:0/3155394955 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4975 (secure 0 0 0) 0x7f35a80cc440 con 0x7f35ac152860 2024-04-18T04:58:00.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.402+0000 7f35a27fc640 1 -- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac152860 msgr2=0x7f35ac1589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.402+0000 7f35a27fc640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac152860 0x7f35ac1589a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35a801b810 tx=0x7f35a80a9000 comp rx=0 tx=0).stop 2024-04-18T04:58:00.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.402+0000 7f35a27fc640 1 -- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac152860 msgr2=0x7f35ac1589a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:00.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.402+0000 7f35a27fc640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35ac152860 0x7f35ac1589a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.406+0000 7f35b3ab6640 1 -- 172.21.15.96:0/3155394955 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3590066690 msgr2=0x7f3590068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.406+0000 7f35b3ab6640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3590066690 0x7f3590068b50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f35a4007fd0 tx=0x7f35a4007ea0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.406+0000 7f35b2053640 1 -- 172.21.15.96:0/3155394955 reap_dead start 2024-04-18T04:58:00.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.406+0000 7f35b3ab6640 1 -- 172.21.15.96:0/3155394955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35ac0cb450 msgr2=0x7f35ac1579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.406+0000 7f35b3ab6640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35ac0cb450 0x7f35ac1579a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f359c00c430 tx=0x7f359c00c8f0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.406+0000 7f35b3ab6640 1 -- 172.21.15.96:0/3155394955 shutdown_connections 2024-04-18T04:58:00.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.406+0000 7f35b3ab6640 1 --2- 172.21.15.96:0/3155394955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35ac0cb450 0x7f35ac1579a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.406+0000 7f35b3ab6640 1 -- 172.21.15.96:0/3155394955 >> 172.21.15.96:0/3155394955 conn(0x7f35ac06d2a0 msgr2=0x7f35ac14c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:00.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.406+0000 7f35b3ab6640 1 -- 172.21.15.96:0/3155394955 shutdown_connections 2024-04-18T04:58:00.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.406+0000 7f35b3ab6640 1 -- 172.21.15.96:0/3155394955 wait complete. 2024-04-18T04:58:00.423 INFO:tasks.workunit.client.0.smithi096.stdout:4/363: mkdir d4/d14/d1d/d29/d78 0 2024-04-18T04:58:00.423 INFO:tasks.workunit.client.0.smithi096.stdout:4/364: symlink d4/d14/d1d/l79 0 2024-04-18T04:58:00.423 INFO:tasks.workunit.client.0.smithi096.stdout:4/365: stat d4/d14/d16/c3e 0 2024-04-18T04:58:00.424 INFO:tasks.workunit.client.0.smithi096.stdout:5/287: dread d7/ff [0,4194304] 0 2024-04-18T04:58:00.424 INFO:tasks.workunit.client.0.smithi096.stdout:5/288: write d7/f1a [2004134,8042] 0 2024-04-18T04:58:00.424 INFO:tasks.workunit.client.0.smithi096.stdout:4/366: dread d4/f62 [0,4194304] 0 2024-04-18T04:58:00.424 INFO:tasks.workunit.client.0.smithi096.stdout:4/367: mkdir d4/d7a 0 2024-04-18T04:58:00.424 INFO:tasks.workunit.client.0.smithi096.stdout:5/289: mkdir d7/d39/d36/d6f 0 2024-04-18T04:58:00.424 INFO:tasks.workunit.client.0.smithi096.stdout:5/290: creat d7/d39/f70 x:0 0 0 2024-04-18T04:58:00.425 INFO:tasks.workunit.client.0.smithi096.stdout:5/291: symlink d7/d39/d52/d61/l71 0 2024-04-18T04:58:00.427 INFO:tasks.workunit.client.0.smithi096.stdout:5/292: truncate d7/d12/f44 4873364 0 2024-04-18T04:58:00.428 INFO:tasks.workunit.client.0.smithi096.stdout:4/368: dwrite d4/d14/d2d/d44/f5f [0,4194304] 0 2024-04-18T04:58:00.429 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:58:00.429 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-18T04:58:00.429 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-18T04:58:00.430 INFO:tasks.workunit.client.0.smithi096.stdout:5/293: mknod d7/c72 0 2024-04-18T04:58:00.432 INFO:tasks.workunit.client.0.smithi096.stdout:4/369: rmdir d4/d14/d1d/d29/d3a/d39/d54 39 2024-04-18T04:58:00.433 INFO:tasks.workunit.client.0.smithi096.stdout:5/294: creat d7/d39/d56/f73 x:0 0 0 2024-04-18T04:58:00.436 INFO:tasks.workunit.client.0.smithi096.stdout:5/295: dread d7/d12/f5a [0,4194304] 0 2024-04-18T04:58:00.440 INFO:tasks.workunit.client.0.smithi096.stdout:5/296: unlink d7/f17 0 2024-04-18T04:58:00.440 INFO:tasks.workunit.client.0.smithi096.stdout:4/370: dwrite d4/d14/d2d/d44/f5d [0,4194304] 0 2024-04-18T04:58:00.443 INFO:tasks.workunit.client.0.smithi096.stdout:4/371: symlink d4/d14/d16/l7b 0 2024-04-18T04:58:00.455 INFO:tasks.workunit.client.0.smithi096.stdout:4/372: truncate d4/d14/d1d/f52 2694738 0 2024-04-18T04:58:00.460 INFO:tasks.workunit.client.0.smithi096.stdout:4/373: write d4/d14/d1d/d29/f36 [661206,42888] 0 2024-04-18T04:58:00.461 INFO:tasks.workunit.client.0.smithi096.stdout:4/374: read - d4/d14/f6a zero size 2024-04-18T04:58:00.463 INFO:tasks.workunit.client.0.smithi096.stdout:4/375: symlink d4/l7c 0 2024-04-18T04:58:00.464 INFO:tasks.workunit.client.0.smithi096.stdout:4/376: chown d4/d14/d1d/d29/f36 12 1 2024-04-18T04:58:00.466 INFO:tasks.workunit.client.0.smithi096.stdout:4/377: dread d4/f62 [0,4194304] 0 2024-04-18T04:58:00.467 INFO:tasks.workunit.client.0.smithi096.stdout:4/378: creat d4/d14/d16/f7d x:0 0 0 2024-04-18T04:58:00.473 INFO:tasks.workunit.client.0.smithi096.stdout:9/302: sync 2024-04-18T04:58:00.473 INFO:tasks.workunit.client.0.smithi096.stdout:2/530: sync 2024-04-18T04:58:00.478 INFO:tasks.workunit.client.0.smithi096.stdout:9/303: mkdir d0/d6b 0 2024-04-18T04:58:00.478 INFO:tasks.workunit.client.0.smithi096.stdout:9/304: fdatasync d0/f3 0 2024-04-18T04:58:00.479 INFO:tasks.workunit.client.0.smithi096.stdout:9/305: dread - d0/de/d17/d56/f6a zero size 2024-04-18T04:58:00.480 INFO:tasks.workunit.client.0.smithi096.stdout:4/379: dwrite d4/d14/d1d/f52 [0,4194304] 0 2024-04-18T04:58:00.481 INFO:tasks.workunit.client.0.smithi096.stdout:4/380: readlink d4/d14/d16/l7b 0 2024-04-18T04:58:00.484 INFO:tasks.workunit.client.0.smithi096.stdout:9/306: symlink d0/de/d17/d5c/l6c 0 2024-04-18T04:58:00.486 INFO:tasks.workunit.client.0.smithi096.stdout:2/531: truncate fe 3653366 0 2024-04-18T04:58:00.488 INFO:tasks.workunit.client.0.smithi096.stdout:9/307: unlink d0/de/d17/d2f/c32 0 2024-04-18T04:58:00.489 INFO:tasks.workunit.client.0.smithi096.stdout:4/381: dwrite d4/d14/d1d/d29/d6f/f77 [0,4194304] 0 2024-04-18T04:58:00.494 INFO:tasks.workunit.client.0.smithi096.stdout:9/308: rename d0/d5f to d0/de/d17/d56/d6d 0 2024-04-18T04:58:00.494 INFO:tasks.workunit.client.0.smithi096.stdout:4/382: fsync d4/d14/d16/f32 0 2024-04-18T04:58:00.495 INFO:tasks.workunit.client.0.smithi096.stdout:2/532: dwrite df/d18/d26/f27 [0,4194304] 0 2024-04-18T04:58:00.496 INFO:tasks.workunit.client.0.smithi096.stdout:2/533: fdatasync df/d18/d87/f9e 0 2024-04-18T04:58:00.498 INFO:tasks.workunit.client.0.smithi096.stdout:9/309: write d0/de/d17/f3f [1810684,60698] 0 2024-04-18T04:58:00.521 INFO:tasks.workunit.client.0.smithi096.stdout:4/383: dread d4/d14/f31 [0,4194304] 0 2024-04-18T04:58:00.521 INFO:tasks.workunit.client.0.smithi096.stdout:4/384: dread - d4/d14/d16/f7d zero size 2024-04-18T04:58:00.521 INFO:tasks.workunit.client.0.smithi096.stdout:2/534: dread df/d18/f38 [0,4194304] 0 2024-04-18T04:58:00.523 INFO:tasks.workunit.client.0.smithi096.stdout:2/535: chown df/d18/d26/d48/f56 32477942 1 2024-04-18T04:58:00.524 INFO:tasks.workunit.client.0.smithi096.stdout:9/310: dread d0/d25/f2e [0,4194304] 0 2024-04-18T04:58:00.525 INFO:tasks.workunit.client.0.smithi096.stdout:2/536: read df/f64 [196534,13146] 0 2024-04-18T04:58:00.525 INFO:tasks.workunit.client.0.smithi096.stdout:9/311: stat d0/f28 0 2024-04-18T04:58:00.526 INFO:tasks.workunit.client.0.smithi096.stdout:9/312: write d0/d25/f35 [2857122,123552] 0 2024-04-18T04:58:00.528 INFO:tasks.workunit.client.0.smithi096.stdout:9/313: stat d0/d25/l36 0 2024-04-18T04:58:00.528 INFO:tasks.workunit.client.0.smithi096.stdout:4/385: truncate d4/d14/d2d/d44/f5d 1616574 0 2024-04-18T04:58:00.528 INFO:tasks.workunit.client.0.smithi096.stdout:9/314: stat d0/de/d17/d56/l51 0 2024-04-18T04:58:00.529 INFO:tasks.workunit.client.0.smithi096.stdout:2/537: mkdir df/d18/d24/d42/d3f/dae 0 2024-04-18T04:58:00.531 INFO:tasks.workunit.client.0.smithi096.stdout:9/315: mknod d0/de/d17/d56/c6e 0 2024-04-18T04:58:00.532 INFO:tasks.workunit.client.0.smithi096.stdout:2/538: write df/d18/d24/d42/d3f/f43 [950640,82299] 0 2024-04-18T04:58:00.538 INFO:tasks.workunit.client.0.smithi096.stdout:4/386: write d4/d14/d2d/d44/f5d [2579459,26571] 0 2024-04-18T04:58:00.541 INFO:tasks.workunit.client.0.smithi096.stdout:4/387: symlink d4/d14/d1d/d29/l7e 0 2024-04-18T04:58:00.542 INFO:tasks.workunit.client.0.smithi096.stdout:2/539: dwrite df/d18/d24/d42/d3f/f43 [0,4194304] 0 2024-04-18T04:58:00.543 INFO:tasks.workunit.client.0.smithi096.stdout:2/540: chown df/d18/d24/d42/d3f/d4a/c8f 1954417 1 2024-04-18T04:58:00.543 INFO:tasks.workunit.client.0.smithi096.stdout:2/541: stat df/d18/d24/d42/d6e/la9 0 2024-04-18T04:58:00.544 INFO:tasks.workunit.client.0.smithi096.stdout:2/542: write df/d18/d71/d75/f88 [375442,28685] 0 2024-04-18T04:58:00.546 INFO:tasks.workunit.client.0.smithi096.stdout:4/388: creat d4/d14/d2d/d44/d63/f7f x:0 0 0 2024-04-18T04:58:00.554 INFO:tasks.workunit.client.0.smithi096.stdout:2/543: dwrite df/f10 [0,4194304] 0 2024-04-18T04:58:00.554 INFO:tasks.workunit.client.0.smithi096.stdout:4/389: dwrite d4/d14/d2d/d44/f5d [0,4194304] 0 2024-04-18T04:58:00.557 INFO:tasks.workunit.client.0.smithi096.stdout:4/390: write d4/d14/d2d/d44/d63/f7f [140941,121354] 0 2024-04-18T04:58:00.561 INFO:tasks.workunit.client.0.smithi096.stdout:2/544: rename df/d18/d24/d42/d3f/d4a/fa8 to df/d18/d24/faf 0 2024-04-18T04:58:00.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.566+0000 7fcc8ce09640 1 Processor -- start 2024-04-18T04:58:00.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.566+0000 7fcc8ce09640 1 -- start start 2024-04-18T04:58:00.565 INFO:tasks.workunit.client.0.smithi096.stdout:4/391: truncate d4/d14/f31 1564142 0 2024-04-18T04:58:00.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.566+0000 7fcc8ce09640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fcc88152fe0 0x7fcc880c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:00.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.566+0000 7fcc8ce09640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcc880c4510 0x7fcc880c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:00.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.566+0000 7fcc8ce09640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcc8815c480 0x7fcc8815c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:00.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.566+0000 7fcc8ce09640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc880c4950 con 0x7fcc880c4510 2024-04-18T04:58:00.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.566+0000 7fcc8ce09640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc881533c0 con 0x7fcc88152fe0 2024-04-18T04:58:00.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.566+0000 7fcc8ce09640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc88066940 con 0x7fcc8815c480 2024-04-18T04:58:00.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.566+0000 7fcc85d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcc880c4510 0x7fcc880c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:00.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.566+0000 7fcc85d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcc880c4510 0x7fcc880c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47298/0 (socket says 172.21.15.96:47298) 2024-04-18T04:58:00.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.566+0000 7fcc85d9b640 1 -- 172.21.15.96:0/125655515 learned_addr learned my addr 172.21.15.96:0/125655515 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:00.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.566+0000 7fcc85d9b640 1 -- 172.21.15.96:0/125655515 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcc8815c480 msgr2=0x7fcc8815c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:00.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.566+0000 7fcc85d9b640 1 --2- 172.21.15.96:0/125655515 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcc8815c480 0x7fcc8815c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.566+0000 7fcc85d9b640 1 -- 172.21.15.96:0/125655515 >> v2:172.21.15.139:3300/0 conn(0x7fcc88152fe0 msgr2=0x7fcc880c9160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:58:00.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.566+0000 7fcc85d9b640 1 --2- 172.21.15.96:0/125655515 >> v2:172.21.15.139:3300/0 conn(0x7fcc88152fe0 0x7fcc880c9160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.566+0000 7fcc85d9b640 1 -- 172.21.15.96:0/125655515 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc88159c50 con 0x7fcc880c4510 2024-04-18T04:58:00.568 INFO:tasks.workunit.client.0.smithi096.stdout:2/545: creat df/d18/d24/d42/fb0 x:0 0 0 2024-04-18T04:58:00.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.570+0000 7fcc85d9b640 1 --2- 172.21.15.96:0/125655515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc880c4510 0x7fcc880c9f00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcc880cc2f0 tx=0x7fcc7c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599c3054d3e2da16 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:00.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.570+0000 7fcc8559a640 1 -- 172.21.15.96:0/125655515 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0a89f0 con 0x7fcc880c4510 2024-04-18T04:58:00.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.570+0000 7fcc8559a640 1 -- 172.21.15.96:0/125655515 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c0a8b50 con 0x7fcc880c4510 2024-04-18T04:58:00.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.570+0000 7fcc8559a640 1 -- 172.21.15.96:0/125655515 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0b0440 con 0x7fcc880c4510 2024-04-18T04:58:00.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.570+0000 7fcc8ce09640 1 -- 172.21.15.96:0/125655515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc880c4510 msgr2=0x7fcc880c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.570+0000 7fcc8ce09640 1 --2- 172.21.15.96:0/125655515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc880c4510 0x7fcc880c9f00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcc880cc2f0 tx=0x7fcc7c01ed30 comp rx=0 tx=0).stop 2024-04-18T04:58:00.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.570+0000 7fcc8ce09640 1 -- 172.21.15.96:0/125655515 shutdown_connections 2024-04-18T04:58:00.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.570+0000 7fcc8ce09640 1 --2- 172.21.15.96:0/125655515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc880c4510 0x7fcc880c9f00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.570+0000 7fcc8ce09640 1 --2- 172.21.15.96:0/125655515 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcc8815c480 0x7fcc8815c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.570+0000 7fcc8ce09640 1 --2- 172.21.15.96:0/125655515 >> v2:172.21.15.139:3300/0 conn(0x7fcc88152fe0 0x7fcc880c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.570+0000 7fcc8ce09640 1 -- 172.21.15.96:0/125655515 >> 172.21.15.96:0/125655515 conn(0x7fcc88071760 msgr2=0x7fcc88065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:00.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.570+0000 7fcc8ce09640 1 -- 172.21.15.96:0/125655515 shutdown_connections 2024-04-18T04:58:00.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.570+0000 7fcc8ce09640 1 -- 172.21.15.96:0/125655515 wait complete. 2024-04-18T04:58:00.572 INFO:tasks.workunit.client.0.smithi096.stdout:2/546: write df/d18/d26/f91 [3066357,94957] 0 2024-04-18T04:58:00.573 INFO:tasks.workunit.client.0.smithi096.stdout:2/547: chown df/d7d/d9f 861 1 2024-04-18T04:58:00.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc8ce09640 1 Processor -- start 2024-04-18T04:58:00.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc8ce09640 1 -- start start 2024-04-18T04:58:00.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc8ce09640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc880c4510 0x7fcc88141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:00.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc8ce09640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc88152fe0 0x7fcc881f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:00.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc8ce09640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcc8815c480 0x7fcc880cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:00.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc8ce09640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc881f1920 con 0x7fcc88152fe0 2024-04-18T04:58:00.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc8ce09640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc880cb3d0 con 0x7fcc880c4510 2024-04-18T04:58:00.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc8ce09640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc881ef820 con 0x7fcc8815c480 2024-04-18T04:58:00.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc85d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc88152fe0 0x7fcc881f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:00.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc85d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc88152fe0 0x7fcc881f2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47312/0 (socket says 172.21.15.96:47312) 2024-04-18T04:58:00.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc85d9b640 1 -- 172.21.15.96:0/2928149581 learned_addr learned my addr 172.21.15.96:0/2928149581 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:00.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc8659c640 1 --2- 172.21.15.96:0/2928149581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc880c4510 0x7fcc88141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:00.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc86d9d640 1 --2- 172.21.15.96:0/2928149581 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcc8815c480 0x7fcc880cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:00.576 INFO:tasks.workunit.client.0.smithi096.stdout:2/548: fdatasync df/f16 0 2024-04-18T04:58:00.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc85d9b640 1 -- 172.21.15.96:0/2928149581 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcc8815c480 msgr2=0x7fcc880cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc85d9b640 1 --2- 172.21.15.96:0/2928149581 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcc8815c480 0x7fcc880cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc85d9b640 1 -- 172.21.15.96:0/2928149581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc880c4510 msgr2=0x7fcc88141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc85d9b640 1 --2- 172.21.15.96:0/2928149581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc880c4510 0x7fcc88141690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc85d9b640 1 -- 172.21.15.96:0/2928149581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c0094d0 con 0x7fcc88152fe0 2024-04-18T04:58:00.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc85d9b640 1 --2- 172.21.15.96:0/2928149581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc88152fe0 0x7fcc881f2090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c01c960 tx=0x7fcc7c01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:00.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc76ffd640 1 -- 172.21.15.96:0/2928149581 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0b0e20 con 0x7fcc88152fe0 2024-04-18T04:58:00.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc76ffd640 1 -- 172.21.15.96:0/2928149581 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c0ba440 con 0x7fcc88152fe0 2024-04-18T04:58:00.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc8ce09640 1 -- 172.21.15.96:0/2928149581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8815a470 con 0x7fcc88152fe0 2024-04-18T04:58:00.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc76ffd640 1 -- 172.21.15.96:0/2928149581 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0ba7f0 con 0x7fcc88152fe0 2024-04-18T04:58:00.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.574+0000 7fcc8ce09640 1 -- 172.21.15.96:0/2928149581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8815aa10 con 0x7fcc88152fe0 2024-04-18T04:58:00.578 INFO:tasks.workunit.client.0.smithi096.stdout:4/392: dwrite d4/d14/d1d/d29/d6f/f77 [0,4194304] 0 2024-04-18T04:58:00.578 INFO:tasks.workunit.client.0.smithi096.stdout:2/549: readlink df/d18/d24/d42/l6c 0 2024-04-18T04:58:00.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.578+0000 7fcc8ce09640 1 -- 172.21.15.96:0/2928149581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc880721f0 con 0x7fcc88152fe0 2024-04-18T04:58:00.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.578+0000 7fcc76ffd640 1 -- 172.21.15.96:0/2928149581 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcc7c0ba950 con 0x7fcc88152fe0 2024-04-18T04:58:00.579 INFO:tasks.workunit.client.0.smithi096.stdout:2/550: rmdir df/d18/d26 39 2024-04-18T04:58:00.579 INFO:tasks.workunit.client.0.smithi096.stdout:4/393: symlink d4/d14/d2d/d44/l80 0 2024-04-18T04:58:00.579 INFO:tasks.workunit.client.0.smithi096.stdout:4/394: read d4/f62 [769785,109097] 0 2024-04-18T04:58:00.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.578+0000 7fcc76ffd640 1 --2- 172.21.15.96:0/2928149581 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcc68066690 0x7fcc68068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:00.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.578+0000 7fcc76ffd640 1 -- 172.21.15.96:0/2928149581 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fcc7c122070 con 0x7fcc88152fe0 2024-04-18T04:58:00.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.582+0000 7fcc8659c640 1 --2- 172.21.15.96:0/2928149581 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcc68066690 0x7fcc68068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:00.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.582+0000 7fcc8659c640 1 --2- 172.21.15.96:0/2928149581 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcc68066690 0x7fcc68068b50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009980 tx=0x7fcc780090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:00.584 INFO:tasks.workunit.client.0.smithi096.stdout:4/395: getdents d4/d14/d2d/d44/d55 0 2024-04-18T04:58:00.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.586+0000 7fcc76ffd640 1 -- 172.21.15.96:0/2928149581 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fcc7c0ef530 con 0x7fcc88152fe0 2024-04-18T04:58:00.585 INFO:tasks.workunit.client.0.smithi096.stdout:4/396: readlink d4/d14/d1d/d29/l3c 0 2024-04-18T04:58:00.585 INFO:tasks.workunit.client.0.smithi096.stdout:2/551: getdents df/d18/d24/d42 0 2024-04-18T04:58:00.586 INFO:tasks.workunit.client.0.smithi096.stdout:4/397: write d4/d14/f2b [3194471,127207] 0 2024-04-18T04:58:00.587 INFO:tasks.workunit.client.0.smithi096.stdout:2/552: fdatasync df/f20 0 2024-04-18T04:58:00.589 INFO:tasks.workunit.client.0.smithi096.stdout:2/553: symlink df/d18/d87/lb1 0 2024-04-18T04:58:00.598 INFO:tasks.workunit.client.0.smithi096.stdout:4/398: dwrite d4/d14/f31 [0,4194304] 0 2024-04-18T04:58:00.599 INFO:tasks.workunit.client.0.smithi096.stdout:2/554: dwrite df/d18/f89 [0,4194304] 0 2024-04-18T04:58:00.601 INFO:tasks.workunit.client.0.smithi096.stdout:4/399: mkdir d4/d14/d1d/d29/d3a/d47/d4b/d81 0 2024-04-18T04:58:00.605 INFO:tasks.workunit.client.0.smithi096.stdout:4/400: link d4/d14/d1d/d29/f36 d4/d14/d1d/d29/d3a/d47/d4b/d81/f82 0 2024-04-18T04:58:00.606 INFO:tasks.workunit.client.0.smithi096.stdout:2/555: write fe [1098970,54603] 0 2024-04-18T04:58:00.608 INFO:tasks.workunit.client.0.smithi096.stdout:4/401: truncate d4/d14/d1d/d29/d3a/d39/f75 3371180 0 2024-04-18T04:58:00.609 INFO:tasks.workunit.client.0.smithi096.stdout:4/402: truncate d4/d14/d16/f7d 1011554 0 2024-04-18T04:58:00.616 INFO:tasks.workunit.client.0.smithi096.stdout:4/403: getdents d4/d14/d1d/d29/d6f 0 2024-04-18T04:58:00.616 INFO:tasks.workunit.client.0.smithi096.stdout:2/556: dwrite df/d18/d26/f47 [0,4194304] 0 2024-04-18T04:58:00.622 INFO:tasks.workunit.client.0.smithi096.stdout:4/404: link d4/d14/d1d/d29/l7e d4/d14/d2d/d44/d55/l83 0 2024-04-18T04:58:00.626 INFO:tasks.workunit.client.0.smithi096.stdout:4/405: chown d4/d14/d1d/d29/l7e 16271627 1 2024-04-18T04:58:00.630 INFO:tasks.workunit.client.0.smithi096.stdout:4/406: chown d4/d14/d2d/d44/d55 294242 1 2024-04-18T04:58:00.630 INFO:tasks.workunit.client.0.smithi096.stdout:4/407: chown d4/d14/d2d/d44 467 1 2024-04-18T04:58:00.633 INFO:tasks.workunit.client.0.smithi096.stdout:4/408: link d4/d14/d1d/d29/d3a/d47/d4b/c69 d4/c84 0 2024-04-18T04:58:00.634 INFO:tasks.workunit.client.0.smithi096.stdout:4/409: write d4/d14/d2d/d44/f5d [4802452,83757] 0 2024-04-18T04:58:00.636 INFO:tasks.workunit.client.0.smithi096.stdout:4/410: stat d4/d14/c68 0 2024-04-18T04:58:00.749 INFO:tasks.workunit.client.0.smithi096.stdout:3/478: sync 2024-04-18T04:58:00.750 INFO:tasks.workunit.client.0.smithi096.stdout:1/481: sync 2024-04-18T04:58:00.750 INFO:tasks.workunit.client.0.smithi096.stdout:7/341: sync 2024-04-18T04:58:00.751 INFO:tasks.workunit.client.0.smithi096.stdout:7/342: dread - db/d1f/d39/f5c zero size 2024-04-18T04:58:00.752 INFO:tasks.workunit.client.0.smithi096.stdout:3/479: chown dc/d26/d76/c2c 55 1 2024-04-18T04:58:00.755 INFO:tasks.workunit.client.0.smithi096.stdout:3/480: dread - dc/d26/d4a/d6b/f7b zero size 2024-04-18T04:58:00.755 INFO:tasks.workunit.client.0.smithi096.stdout:3/481: stat dc/l19 0 2024-04-18T04:58:00.756 INFO:tasks.workunit.client.0.smithi096.stdout:3/482: dread - dc/d70/f94 zero size 2024-04-18T04:58:00.758 INFO:tasks.workunit.client.0.smithi096.stdout:7/343: rename db/d20/d45/d5e/d6b to db/d1f/d39/d6d 0 2024-04-18T04:58:00.765 INFO:tasks.workunit.client.0.smithi096.stdout:1/482: dwrite de/d1d/f65 [0,4194304] 0 2024-04-18T04:58:00.766 INFO:tasks.workunit.client.0.smithi096.stdout:1/483: stat de/d1d/l2b 0 2024-04-18T04:58:00.769 INFO:tasks.workunit.client.0.smithi096.stdout:3/483: link f8 dc/d5d/f9b 0 2024-04-18T04:58:00.771 INFO:tasks.workunit.client.0.smithi096.stdout:1/484: rename de/d1d/d32/c77 to de/d7b/c91 0 2024-04-18T04:58:00.773 INFO:tasks.workunit.client.0.smithi096.stdout:3/484: rmdir dc/d26/d76/d29/d7e 39 2024-04-18T04:58:00.776 INFO:tasks.workunit.client.0.smithi096.stdout:1/485: mknod de/d1d/d3f/c92 0 2024-04-18T04:58:00.777 INFO:tasks.workunit.client.0.smithi096.stdout:1/486: chown de/c68 131626 1 2024-04-18T04:58:00.780 INFO:tasks.workunit.client.0.smithi096.stdout:3/485: link dc/d26/d48/f9a dc/d26/d4a/f9c 0 2024-04-18T04:58:00.785 INFO:tasks.workunit.client.0.smithi096.stdout:1/487: link de/l38 de/d1d/d32/d73/l93 0 2024-04-18T04:58:00.791 INFO:tasks.workunit.client.0.smithi096.stdout:3/486: dwrite dc/f60 [0,4194304] 0 2024-04-18T04:58:00.793 INFO:tasks.workunit.client.0.smithi096.stdout:1/488: getdents de/d1d/d3f/d4f 0 2024-04-18T04:58:00.795 INFO:tasks.workunit.client.0.smithi096.stdout:1/489: dread - de/d1d/d32/f69 zero size 2024-04-18T04:58:00.797 INFO:tasks.workunit.client.0.smithi096.stdout:3/487: creat dc/f9d x:0 0 0 2024-04-18T04:58:00.798 INFO:tasks.workunit.client.0.smithi096.stdout:7/344: dread db/f11 [4194304,4194304] 0 2024-04-18T04:58:00.804 INFO:tasks.workunit.client.0.smithi096.stdout:3/488: mknod dc/d26/c9e 0 2024-04-18T04:58:00.807 INFO:tasks.workunit.client.0.smithi096.stdout:1/490: symlink de/d1d/d32/l94 0 2024-04-18T04:58:00.812 INFO:tasks.workunit.client.0.smithi096.stdout:7/345: creat db/d1f/d5b/d6a/f6e x:0 0 0 2024-04-18T04:58:00.819 INFO:tasks.workunit.client.0.smithi096.stdout:7/346: mknod db/d1f/d24/d61/c6f 0 2024-04-18T04:58:00.821 INFO:tasks.workunit.client.0.smithi096.stdout:3/489: link dc/d26/d4a/f9c dc/d5d/f9f 0 2024-04-18T04:58:00.825 INFO:tasks.workunit.client.0.smithi096.stdout:7/347: readlink db/l3d 0 2024-04-18T04:58:00.829 INFO:tasks.workunit.client.0.smithi096.stdout:7/348: dread - db/d1d/f44 zero size 2024-04-18T04:58:00.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.830+0000 7fcc8ce09640 1 -- 172.21.15.96:0/2928149581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fcc88067050 con 0x7fcc88152fe0 2024-04-18T04:58:00.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.830+0000 7fcc76ffd640 1 -- 172.21.15.96:0/2928149581 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fcc7c0b5080 con 0x7fcc88152fe0 2024-04-18T04:58:00.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.834+0000 7fcc8ce09640 1 -- 172.21.15.96:0/2928149581 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcc68066690 msgr2=0x7fcc68068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.834+0000 7fcc8ce09640 1 --2- 172.21.15.96:0/2928149581 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcc68066690 0x7fcc68068b50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009980 tx=0x7fcc780090e0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.834+0000 7fcc8ce09640 1 -- 172.21.15.96:0/2928149581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc88152fe0 msgr2=0x7fcc881f2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:00.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.834+0000 7fcc8ce09640 1 --2- 172.21.15.96:0/2928149581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc88152fe0 0x7fcc881f2090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c01c960 tx=0x7fcc7c01bad0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.834+0000 7fcc8ce09640 1 -- 172.21.15.96:0/2928149581 shutdown_connections 2024-04-18T04:58:00.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.834+0000 7fcc8ce09640 1 --2- 172.21.15.96:0/2928149581 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcc68066690 0x7fcc68068b50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.834+0000 7fcc8ce09640 1 --2- 172.21.15.96:0/2928149581 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcc8815c480 0x7fcc880cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.834+0000 7fcc8ce09640 1 --2- 172.21.15.96:0/2928149581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc88152fe0 0x7fcc881f2090 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.834+0000 7fcc8ce09640 1 --2- 172.21.15.96:0/2928149581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc880c4510 0x7fcc88141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:00.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.834+0000 7fcc8ce09640 1 -- 172.21.15.96:0/2928149581 >> 172.21.15.96:0/2928149581 conn(0x7fcc88071760 msgr2=0x7fcc88065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:00.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.834+0000 7fcc8ce09640 1 -- 172.21.15.96:0/2928149581 shutdown_connections 2024-04-18T04:58:00.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:00.834+0000 7fcc8ce09640 1 -- 172.21.15.96:0/2928149581 wait complete. 2024-04-18T04:58:00.835 INFO:tasks.workunit.client.0.smithi096.stdout:3/490: dwrite dc/f39 [0,4194304] 0 2024-04-18T04:58:00.836 INFO:tasks.workunit.client.0.smithi096.stdout:3/491: dread - dc/d26/f72 zero size 2024-04-18T04:58:00.842 INFO:tasks.workunit.client.0.smithi096.stdout:1/491: dread de/d1d/f66 [0,4194304] 0 2024-04-18T04:58:00.845 INFO:tasks.workunit.client.0.smithi096.stdout:7/349: dwrite db/ff [0,4194304] 0 2024-04-18T04:58:00.845 INFO:tasks.workunit.client.0.smithi096.stdout:1/492: mknod de/d1d/c95 0 2024-04-18T04:58:00.851 INFO:tasks.workunit.client.0.smithi096.stdout:7/350: getdents db/d20/d45/d5e 0 2024-04-18T04:58:00.855 INFO:tasks.workunit.client.0.smithi096.stdout:3/492: dwrite f8 [4194304,4194304] 0 2024-04-18T04:58:00.855 INFO:tasks.workunit.client.0.smithi096.stdout:7/351: creat db/d1f/d24/f70 x:0 0 0 2024-04-18T04:58:00.856 INFO:tasks.workunit.client.0.smithi096.stdout:3/493: fsync dc/d5d/f8a 0 2024-04-18T04:58:00.860 INFO:tasks.workunit.client.0.smithi096.stdout:7/352: creat db/d1f/d24/d49/f71 x:0 0 0 2024-04-18T04:58:00.860 INFO:tasks.workunit.client.0.smithi096.stdout:3/494: creat dc/d26/d57/fa0 x:0 0 0 2024-04-18T04:58:00.861 INFO:tasks.workunit.client.0.smithi096.stdout:7/353: readlink db/d1d/l32 0 2024-04-18T04:58:00.863 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-18T04:58:00.864 INFO:tasks.workunit.client.0.smithi096.stdout:7/354: mknod db/d1f/d24/d61/c72 0 2024-04-18T04:58:00.865 INFO:tasks.workunit.client.0.smithi096.stdout:1/493: dread de/d1d/d32/f4e [0,4194304] 0 2024-04-18T04:58:00.866 INFO:tasks.workunit.client.0.smithi096.stdout:3/495: rename dc/d5d/c82 to dc/d26/d66/ca1 0 2024-04-18T04:58:00.869 INFO:tasks.workunit.client.0.smithi096.stdout:3/496: stat dc/d26/d76/d29/c84 0 2024-04-18T04:58:00.870 INFO:tasks.workunit.client.0.smithi096.stdout:3/497: write dc/d26/d76/f46 [471279,119480] 0 2024-04-18T04:58:00.871 INFO:tasks.workunit.client.0.smithi096.stdout:1/494: mkdir de/d1d/d3f/d7a/d96 0 2024-04-18T04:58:00.871 INFO:tasks.workunit.client.0.smithi096.stdout:1/495: readlink de/d1d/d32/d6f/l71 0 2024-04-18T04:58:00.871 INFO:tasks.workunit.client.0.smithi096.stdout:1/496: fdatasync de/f2f 0 2024-04-18T04:58:00.872 INFO:tasks.workunit.client.0.smithi096.stdout:3/498: dread dc/f42 [0,4194304] 0 2024-04-18T04:58:00.872 INFO:tasks.workunit.client.0.smithi096.stdout:1/497: chown de/d1d/d3f/d7a/d96 29939 1 2024-04-18T04:58:00.874 INFO:tasks.workunit.client.0.smithi096.stdout:3/499: getdents dc/d26/d76/d8d 0 2024-04-18T04:58:00.875 INFO:tasks.workunit.client.0.smithi096.stdout:1/498: getdents de/d1d/d32/d6b 0 2024-04-18T04:58:00.875 INFO:tasks.workunit.client.0.smithi096.stdout:3/500: stat dc/d26/d4a/d6b/f90 0 2024-04-18T04:58:00.875 INFO:tasks.workunit.client.0.smithi096.stdout:3/501: readlink dc/d5d/l77 0 2024-04-18T04:58:00.878 INFO:tasks.workunit.client.0.smithi096.stdout:1/499: rename de/d1d/l89 to de/d1d/d32/d6f/d85/l97 0 2024-04-18T04:58:00.879 INFO:tasks.workunit.client.0.smithi096.stdout:1/500: chown de/d1d/d32/d73/d8b 0 1 2024-04-18T04:58:00.879 INFO:tasks.workunit.client.0.smithi096.stdout:3/502: creat dc/d26/d76/d95/fa2 x:0 0 0 2024-04-18T04:58:00.882 INFO:tasks.workunit.client.0.smithi096.stdout:3/503: unlink dc/d26/d76/l38 0 2024-04-18T04:58:00.886 INFO:tasks.workunit.client.0.smithi096.stdout:1/501: dwrite de/d1d/d3f/d4f/f7d [0,4194304] 0 2024-04-18T04:58:00.891 INFO:tasks.workunit.client.0.smithi096.stdout:3/504: dwrite dc/f60 [0,4194304] 0 2024-04-18T04:58:00.891 INFO:tasks.workunit.client.0.smithi096.stdout:3/505: fsync dc/f39 0 2024-04-18T04:58:00.894 INFO:tasks.workunit.client.0.smithi096.stdout:3/506: mkdir dc/d26/d76/d95/da3 0 2024-04-18T04:58:00.897 INFO:tasks.workunit.client.0.smithi096.stdout:3/507: rename dc/d26/d4a/f50 to dc/d5d/fa4 0 2024-04-18T04:58:00.900 INFO:tasks.workunit.client.0.smithi096.stdout:3/508: dread dc/d26/d76/d29/f6f [0,4194304] 0 2024-04-18T04:58:00.900 INFO:tasks.workunit.client.0.smithi096.stdout:3/509: readlink dc/lf 0 2024-04-18T04:58:00.900 INFO:tasks.workunit.client.0.smithi096.stdout:3/510: dread - dc/d26/d57/f7a zero size 2024-04-18T04:58:00.906 INFO:tasks.workunit.client.0.smithi096.stdout:3/511: dwrite dc/d70/f73 [0,4194304] 0 2024-04-18T04:58:00.909 INFO:tasks.workunit.client.0.smithi096.stdout:3/512: symlink dc/d26/d66/la5 0 2024-04-18T04:58:00.914 INFO:tasks.workunit.client.0.smithi096.stdout:3/513: rename l5 to dc/d26/d48/la6 0 2024-04-18T04:58:00.992 INFO:tasks.workunit.client.0.smithi096.stdout:7/355: rmdir db/d1f/d24 39 2024-04-18T04:58:00.998 INFO:tasks.workunit.client.0.smithi096.stdout:7/356: mknod db/d1f/d24/d49/c73 0 2024-04-18T04:58:01.001 INFO:tasks.workunit.client.0.smithi096.stdout:7/357: write db/d1f/d24/d49/f71 [97669,85998] 0 2024-04-18T04:58:01.007 INFO:tasks.workunit.client.0.smithi096.stdout:7/358: dread db/d1f/f41 [0,4194304] 0 2024-04-18T04:58:01.009 INFO:tasks.workunit.client.0.smithi096.stdout:3/514: write dc/d5d/f6d [228558,81441] 0 2024-04-18T04:58:01.015 INFO:tasks.workunit.client.0.smithi096.stdout:1/502: dwrite de/d1d/d3f/d4f/f7d [4194304,4194304] 0 2024-04-18T04:58:01.025 INFO:tasks.workunit.client.0.smithi096.stdout:6/490: sync 2024-04-18T04:58:01.028 INFO:tasks.workunit.client.0.smithi096.stdout:1/503: creat de/d1d/d3f/d7a/d96/f98 x:0 0 0 2024-04-18T04:58:01.029 INFO:tasks.workunit.client.0.smithi096.stdout:7/359: dwrite db/d1f/d42/f59 [0,4194304] 0 2024-04-18T04:58:01.031 INFO:tasks.workunit.client.0.smithi096.stdout:1/504: chown de/d1d/d32/d6f/f7c 83744087 1 2024-04-18T04:58:01.034 INFO:tasks.workunit.client.0.smithi096.stdout:3/515: dwrite dc/d5d/f86 [0,4194304] 0 2024-04-18T04:58:01.035 INFO:tasks.workunit.client.0.smithi096.stdout:7/360: truncate db/d1f/d24/f56 646942 0 2024-04-18T04:58:01.037 INFO:tasks.workunit.client.0.smithi096.stdout:1/505: unlink de/d1d/d3f/f6c 0 2024-04-18T04:58:01.042 INFO:tasks.workunit.client.0.smithi096.stdout:7/361: chown db/d20/c3c 3505271 1 2024-04-18T04:58:01.043 INFO:tasks.workunit.client.0.smithi096.stdout:3/516: symlink dc/d5d/la7 0 2024-04-18T04:58:01.044 INFO:tasks.workunit.client.0.smithi096.stdout:6/491: dwrite d0/d6/f24 [0,4194304] 0 2024-04-18T04:58:01.044 INFO:tasks.workunit.client.0.smithi096.stdout:1/506: truncate de/d1d/d3f/f63 647144 0 2024-04-18T04:58:01.045 INFO:tasks.workunit.client.0.smithi096.stdout:7/362: rmdir db/d1f/d24/d49 39 2024-04-18T04:58:01.045 INFO:tasks.workunit.client.0.smithi096.stdout:1/507: fdatasync de/d1d/d32/d6f/f8a 0 2024-04-18T04:58:01.046 INFO:tasks.workunit.client.0.smithi096.stdout:6/492: read - d0/f67 zero size 2024-04-18T04:58:01.047 INFO:tasks.workunit.client.0.smithi096.stdout:3/517: stat dc/d26/d48 0 2024-04-18T04:58:01.050 INFO:tasks.workunit.client.0.smithi096.stdout:3/518: write dc/f39 [2808757,56838] 0 2024-04-18T04:58:01.050 INFO:tasks.workunit.client.0.smithi096.stdout:1/508: symlink de/d1d/d32/d6f/l99 0 2024-04-18T04:58:01.053 INFO:tasks.workunit.client.0.smithi096.stdout:7/363: read db/f48 [2027402,38351] 0 2024-04-18T04:58:01.056 INFO:tasks.workunit.client.0.smithi096.stdout:1/509: mkdir de/d1d/d32/d9a 0 2024-04-18T04:58:01.057 INFO:tasks.workunit.client.0.smithi096.stdout:1/510: chown de/d1d/f5d 10 1 2024-04-18T04:58:01.059 INFO:tasks.workunit.client.0.smithi096.stdout:3/519: symlink dc/d70/la8 0 2024-04-18T04:58:01.060 INFO:tasks.workunit.client.0.smithi096.stdout:3/520: chown dc/d26/c2b 1966 1 2024-04-18T04:58:01.066 INFO:tasks.workunit.client.0.smithi096.stdout:1/511: mkdir de/d1d/d3f/d9b 0 2024-04-18T04:58:01.067 INFO:tasks.workunit.client.0.smithi096.stdout:1/512: truncate de/f2e 346491 0 2024-04-18T04:58:01.077 INFO:tasks.workunit.client.0.smithi096.stdout:1/513: rename de/l21 to de/d1d/d3f/d7a/l9c 0 2024-04-18T04:58:01.085 INFO:tasks.workunit.client.0.smithi096.stdout:3/521: creat dc/fa9 x:0 0 0 2024-04-18T04:58:01.089 INFO:tasks.workunit.client.0.smithi096.stdout:1/514: creat de/d1d/d32/d6b/f9d x:0 0 0 2024-04-18T04:58:01.094 INFO:tasks.workunit.client.0.smithi096.stdout:7/364: getdents db/d1f/d24/d49/d54 0 2024-04-18T04:58:01.094 INFO:tasks.workunit.client.0.smithi096.stdout:3/522: dwrite dc/d5d/f9b [8388608,4194304] 0 2024-04-18T04:58:01.096 INFO:tasks.workunit.client.0.smithi096.stdout:6/493: truncate d0/d6/d2e/f38 6892236 0 2024-04-18T04:58:01.096 INFO:tasks.workunit.client.0.smithi096.stdout:6/494: stat d0/d6/d2e 0 2024-04-18T04:58:01.108 INFO:tasks.workunit.client.0.smithi096.stdout:1/515: rename de/l38 to de/d1d/d32/l9e 0 2024-04-18T04:58:01.119 INFO:tasks.workunit.client.0.smithi096.stdout:6/495: link d0/d6/d2b/d3b/d69/l50 d0/d6/d2e/d7a/l8d 0 2024-04-18T04:58:01.124 INFO:tasks.workunit.client.0.smithi096.stdout:1/516: dread de/d1d/f25 [0,4194304] 0 2024-04-18T04:58:01.127 INFO:tasks.workunit.client.0.smithi096.stdout:6/496: mknod d0/d6/d2e/c8e 0 2024-04-18T04:58:01.127 INFO:tasks.workunit.client.0.smithi096.stdout:3/523: write dc/d26/d4a/f9c [128336,118193] 0 2024-04-18T04:58:01.129 INFO:tasks.workunit.client.0.smithi096.stdout:6/497: write d0/d6/d2b/d3b/d69/f84 [670127,41187] 0 2024-04-18T04:58:01.132 INFO:tasks.workunit.client.0.smithi096.stdout:3/524: chown dc/d26/d76/d29/c47 773148475 1 2024-04-18T04:58:01.132 INFO:tasks.workunit.client.0.smithi096.stdout:6/498: read d0/f59 [271536,36985] 0 2024-04-18T04:58:01.135 INFO:tasks.workunit.client.0.smithi096.stdout:1/517: dwrite de/d1d/f5d [0,4194304] 0 2024-04-18T04:58:01.137 INFO:tasks.workunit.client.0.smithi096.stdout:1/518: read de/f35 [83977,74619] 0 2024-04-18T04:58:01.140 INFO:tasks.workunit.client.0.smithi096.stdout:6/499: rmdir d0/d6/d2b 39 2024-04-18T04:58:01.144 INFO:tasks.workunit.client.0.smithi096.stdout:6/500: chown d0/d6/d5d/l6a 2628198 1 2024-04-18T04:58:01.144 INFO:tasks.workunit.client.0.smithi096.stdout:3/525: dwrite dc/d5d/f5c [0,4194304] 0 2024-04-18T04:58:01.145 INFO:tasks.workunit.client.0.smithi096.stdout:6/501: fdatasync d0/f8a 0 2024-04-18T04:58:01.146 INFO:tasks.workunit.client.0.smithi096.stdout:6/502: stat d0/d6/d2e/f45 0 2024-04-18T04:58:01.149 INFO:tasks.workunit.client.0.smithi096.stdout:3/526: creat dc/d26/d4a/faa x:0 0 0 2024-04-18T04:58:01.150 INFO:tasks.workunit.client.0.smithi096.stdout:3/527: fsync dc/d26/d4a/f58 0 2024-04-18T04:58:01.155 INFO:tasks.workunit.client.0.smithi096.stdout:1/519: truncate de/d1d/f5d 230316 0 2024-04-18T04:58:01.157 INFO:tasks.workunit.client.0.smithi096.stdout:1/520: truncate de/d1d/d3f/f63 841580 0 2024-04-18T04:58:01.158 INFO:tasks.workunit.client.0.smithi096.stdout:6/503: rename d0/d6/d2b/d3b/d69/c58 to d0/d6/d5d/c8f 0 2024-04-18T04:58:01.161 INFO:tasks.workunit.client.0.smithi096.stdout:3/528: creat dc/d26/d76/fab x:0 0 0 2024-04-18T04:58:01.161 INFO:tasks.workunit.client.0.smithi096.stdout:3/529: fdatasync dc/f24 0 2024-04-18T04:58:01.162 INFO:tasks.workunit.client.0.smithi096.stdout:1/521: symlink de/d1d/d32/d8c/l9f 0 2024-04-18T04:58:01.162 INFO:tasks.workunit.client.0.smithi096.stdout:6/504: rmdir d0/d6/d2b/d3b/d7d 39 2024-04-18T04:58:01.163 INFO:tasks.workunit.client.0.smithi096.stdout:6/505: readlink d0/d6/d5d/l81 0 2024-04-18T04:58:01.167 INFO:tasks.workunit.client.0.smithi096.stdout:3/530: rename dc/d26/d76/d29/c5e to dc/d26/d76/d8d/cac 0 2024-04-18T04:58:01.169 INFO:tasks.workunit.client.0.smithi096.stdout:1/522: unlink de/d1d/c33 0 2024-04-18T04:58:01.173 INFO:tasks.workunit.client.0.smithi096.stdout:1/523: creat de/d1d/d3f/d4f/fa0 x:0 0 0 2024-04-18T04:58:01.173 INFO:tasks.workunit.client.0.smithi096.stdout:6/506: dwrite d0/d6/d2e/f7c [0,4194304] 0 2024-04-18T04:58:01.177 INFO:tasks.workunit.client.0.smithi096.stdout:3/531: dwrite dc/d26/d4a/f65 [0,4194304] 0 2024-04-18T04:58:01.181 INFO:tasks.workunit.client.0.smithi096.stdout:1/524: symlink de/d1d/d32/d73/d8b/la1 0 2024-04-18T04:58:01.181 INFO:tasks.workunit.client.0.smithi096.stdout:1/525: chown de/c4c 7614430 1 2024-04-18T04:58:01.189 INFO:tasks.workunit.client.0.smithi096.stdout:6/507: creat d0/d6/d2b/f90 x:0 0 0 2024-04-18T04:58:01.192 INFO:tasks.workunit.client.0.smithi096.stdout:3/532: creat dc/d26/d76/fad x:0 0 0 2024-04-18T04:58:01.199 INFO:tasks.workunit.client.0.smithi096.stdout:1/526: dread de/f2f [0,4194304] 0 2024-04-18T04:58:01.199 INFO:tasks.workunit.client.0.smithi096.stdout:6/508: dwrite d0/d6/d29/f30 [0,4194304] 0 2024-04-18T04:58:01.201 INFO:tasks.workunit.client.0.smithi096.stdout:6/509: creat d0/d6/d5d/f91 x:0 0 0 2024-04-18T04:58:01.203 INFO:tasks.workunit.client.0.smithi096.stdout:1/527: rename de/l19 to de/d1d/d32/d73/la2 0 2024-04-18T04:58:01.203 INFO:tasks.workunit.client.0.smithi096.stdout:1/528: stat de/d1d/c37 0 2024-04-18T04:58:01.205 INFO:tasks.workunit.client.0.smithi096.stdout:6/510: creat d0/d6/d29/d83/f92 x:0 0 0 2024-04-18T04:58:01.206 INFO:tasks.workunit.client.0.smithi096.stdout:1/529: creat de/d1d/d32/d6f/d85/fa3 x:0 0 0 2024-04-18T04:58:01.213 INFO:tasks.workunit.client.0.smithi096.stdout:6/511: dwrite d0/d6/d2e/f56 [0,4194304] 0 2024-04-18T04:58:01.214 INFO:tasks.workunit.client.0.smithi096.stdout:1/530: dwrite de/f2f [0,4194304] 0 2024-04-18T04:58:01.217 INFO:tasks.workunit.client.0.smithi096.stdout:1/531: unlink de/d1d/d32/d6f/f7c 0 2024-04-18T04:58:01.220 INFO:tasks.workunit.client.0.smithi096.stdout:1/532: rmdir de/d1d/d32/d73 39 2024-04-18T04:58:01.224 INFO:tasks.workunit.client.0.smithi096.stdout:6/512: dwrite d0/d6/d29/f46 [0,4194304] 0 2024-04-18T04:58:01.225 INFO:tasks.workunit.client.0.smithi096.stdout:6/513: chown d0/ca 65289 1 2024-04-18T04:58:01.230 INFO:tasks.workunit.client.0.smithi096.stdout:1/533: creat de/d1d/d3f/d4f/fa4 x:0 0 0 2024-04-18T04:58:01.233 INFO:tasks.workunit.client.0.smithi096.stdout:6/514: dwrite d0/d6/d2e/f7c [0,4194304] 0 2024-04-18T04:58:01.233 INFO:tasks.workunit.client.0.smithi096.stdout:6/515: readlink d0/d6/d5d/l47 0 2024-04-18T04:58:01.234 INFO:tasks.workunit.client.0.smithi096.stdout:6/516: write d0/f33 [2849454,16875] 0 2024-04-18T04:58:01.235 INFO:tasks.workunit.client.0.smithi096.stdout:6/517: truncate d0/f8a 1029375 0 2024-04-18T04:58:01.236 INFO:tasks.workunit.client.0.smithi096.stdout:1/534: mkdir de/d1d/d3f/d7a/d96/da5 0 2024-04-18T04:58:01.237 INFO:tasks.workunit.client.0.smithi096.stdout:1/535: truncate de/d1d/d32/f69 1006547 0 2024-04-18T04:58:01.240 INFO:tasks.workunit.client.0.smithi096.stdout:6/518: symlink d0/d6/d2b/d3b/d69/d6c/l93 0 2024-04-18T04:58:01.242 INFO:tasks.workunit.client.0.smithi096.stdout:6/519: chown d0/d6/d2b/d3b/f40 7103285 1 2024-04-18T04:58:01.243 INFO:tasks.workunit.client.0.smithi096.stdout:6/520: dread - d0/f82 zero size 2024-04-18T04:58:01.245 INFO:tasks.workunit.client.0.smithi096.stdout:6/521: unlink d0/f8a 0 2024-04-18T04:58:01.249 INFO:tasks.workunit.client.0.smithi096.stdout:6/522: creat d0/d6/d2b/d7e/f94 x:0 0 0 2024-04-18T04:58:01.249 INFO:tasks.workunit.client.0.smithi096.stdout:6/523: chown d0/d6/d29 318293946 1 2024-04-18T04:58:01.250 INFO:tasks.workunit.client.0.smithi096.stdout:1/536: dread de/d1d/d3f/f45 [0,4194304] 0 2024-04-18T04:58:01.252 INFO:tasks.workunit.client.0.smithi096.stdout:8/292: sync 2024-04-18T04:58:01.253 INFO:tasks.workunit.client.0.smithi096.stdout:6/524: symlink d0/d6/d2e/d7a/l95 0 2024-04-18T04:58:01.256 INFO:tasks.workunit.client.0.smithi096.stdout:8/293: mkdir d0/d7/d24/d18/d27/d60 0 2024-04-18T04:58:01.258 INFO:tasks.workunit.client.0.smithi096.stdout:6/525: creat d0/d73/f96 x:0 0 0 2024-04-18T04:58:01.259 INFO:tasks.workunit.client.0.smithi096.stdout:6/526: truncate d0/d6/f34 536753 0 2024-04-18T04:58:01.260 INFO:tasks.workunit.client.0.smithi096.stdout:8/294: rename d0/d7/d24/f22 to d0/d7/d24/d18/d21/f61 0 2024-04-18T04:58:01.261 INFO:tasks.workunit.client.0.smithi096.stdout:6/527: symlink d0/d4a/l97 0 2024-04-18T04:58:01.266 INFO:tasks.workunit.client.0.smithi096.stdout:6/528: creat d0/d6/f98 x:0 0 0 2024-04-18T04:58:01.266 INFO:tasks.workunit.client.0.smithi096.stdout:6/529: truncate d0/f67 540264 0 2024-04-18T04:58:01.269 INFO:tasks.workunit.client.0.smithi096.stdout:6/530: symlink d0/d6/d29/d83/l99 0 2024-04-18T04:58:01.269 INFO:tasks.workunit.client.0.smithi096.stdout:6/531: chown d0/d6/d2e 3 1 2024-04-18T04:58:01.269 INFO:tasks.workunit.client.0.smithi096.stdout:6/532: stat d0/d6/d2e 0 2024-04-18T04:58:01.272 INFO:tasks.workunit.client.0.smithi096.stdout:8/295: dread d0/d7/d24/d18/d21/f61 [0,4194304] 0 2024-04-18T04:58:01.273 INFO:tasks.workunit.client.0.smithi096.stdout:6/533: dread d0/d6/f34 [0,4194304] 0 2024-04-18T04:58:01.280 INFO:tasks.workunit.client.0.smithi096.stdout:8/296: dwrite d0/d3/f5c [0,4194304] 0 2024-04-18T04:58:01.282 INFO:tasks.workunit.client.0.smithi096.stdout:8/297: fsync d0/d7/f50 0 2024-04-18T04:58:01.283 INFO:tasks.workunit.client.0.smithi096.stdout:8/298: write d0/d7/f2a [8206161,26828] 0 2024-04-18T04:58:01.288 INFO:tasks.workunit.client.0.smithi096.stdout:6/534: dwrite d0/d6/d2e/f31 [0,4194304] 0 2024-04-18T04:58:01.288 INFO:tasks.workunit.client.0.smithi096.stdout:8/299: symlink d0/d7/d24/l62 0 2024-04-18T04:58:01.296 INFO:tasks.workunit.client.0.smithi096.stdout:8/300: rmdir d0 39 2024-04-18T04:58:01.298 INFO:tasks.workunit.client.0.smithi096.stdout:6/535: creat d0/d6/d5d/f9a x:0 0 0 2024-04-18T04:58:01.299 INFO:tasks.workunit.client.0.smithi096.stdout:8/301: truncate d0/d3/d32/f54 739215 0 2024-04-18T04:58:01.300 INFO:tasks.workunit.client.0.smithi096.stdout:8/302: fsync d0/d3/f31 0 2024-04-18T04:58:01.305 INFO:tasks.workunit.client.0.smithi096.stdout:6/536: dwrite d0/d6/d5d/f75 [0,4194304] 0 2024-04-18T04:58:01.309 INFO:tasks.workunit.client.0.smithi096.stdout:6/537: symlink d0/d6/d2b/d3b/d69/d6c/d85/l9b 0 2024-04-18T04:58:01.309 INFO:tasks.workunit.client.0.smithi096.stdout:8/303: dwrite d0/d7/d24/d18/d21/f61 [0,4194304] 0 2024-04-18T04:58:01.316 INFO:tasks.workunit.client.0.smithi096.stdout:8/304: creat d0/d7/d24/d35/d51/d5b/f63 x:0 0 0 2024-04-18T04:58:01.317 INFO:tasks.workunit.client.0.smithi096.stdout:8/305: write d0/d3/f5c [150458,25213] 0 2024-04-18T04:58:01.322 INFO:tasks.workunit.client.0.smithi096.stdout:6/538: truncate d0/d6/d2b/f5e 2925834 0 2024-04-18T04:58:01.324 INFO:tasks.workunit.client.0.smithi096.stdout:8/306: getdents d0/d7/d24/d18/d5d 0 2024-04-18T04:58:01.330 INFO:tasks.workunit.client.0.smithi096.stdout:6/539: truncate d0/d6/d5d/f6d 3275728 0 2024-04-18T04:58:01.332 INFO:tasks.workunit.client.0.smithi096.stdout:8/307: dwrite d0/d3/d32/f48 [0,4194304] 0 2024-04-18T04:58:01.335 INFO:tasks.workunit.client.0.smithi096.stdout:8/308: dread d0/d7/f50 [0,4194304] 0 2024-04-18T04:58:01.339 INFO:tasks.workunit.client.0.smithi096.stdout:6/540: dwrite d0/d6/d2b/d3b/f40 [0,4194304] 0 2024-04-18T04:58:01.343 INFO:tasks.workunit.client.0.smithi096.stdout:8/309: truncate d0/d7/f50 335979 0 2024-04-18T04:58:01.344 INFO:tasks.workunit.client.0.smithi096.stdout:8/310: mknod d0/d15/c64 0 2024-04-18T04:58:01.346 INFO:tasks.workunit.client.0.smithi096.stdout:6/541: link d0/d6/d5d/f3c d0/d6/d29/f9c 0 2024-04-18T04:58:01.348 INFO:tasks.workunit.client.0.smithi096.stdout:6/542: symlink d0/d6/d2b/d3b/d69/d66/l9d 0 2024-04-18T04:58:01.351 INFO:tasks.workunit.client.0.smithi096.stdout:6/543: rename d0/c3e to d0/d73/c9e 0 2024-04-18T04:58:01.353 INFO:tasks.workunit.client.0.smithi096.stdout:6/544: read d0/d6/d2b/d3b/d69/d6c/f76 [249,77594] 0 2024-04-18T04:58:01.354 INFO:tasks.workunit.client.0.smithi096.stdout:6/545: read - d0/d6/d29/d83/f92 zero size 2024-04-18T04:58:01.355 INFO:tasks.workunit.client.0.smithi096.stdout:6/546: dread - d0/d6/d2b/d7e/f94 zero size 2024-04-18T04:58:01.357 INFO:tasks.workunit.client.0.smithi096.stdout:6/547: write d0/d6/d5d/f3c [2333562,9775] 0 2024-04-18T04:58:01.358 INFO:tasks.workunit.client.0.smithi096.stdout:6/548: fsync d0/d6/f7 0 2024-04-18T04:58:01.359 INFO:tasks.workunit.client.0.smithi096.stdout:8/311: dread d0/d7/d24/d18/d27/d3c/f46 [0,4194304] 0 2024-04-18T04:58:01.359 INFO:tasks.workunit.client.0.smithi096.stdout:6/549: chown d0/d6/c39 10145214 1 2024-04-18T04:58:01.360 INFO:tasks.workunit.client.0.smithi096.stdout:8/312: chown d0/d4f 57 1 2024-04-18T04:58:01.360 INFO:tasks.workunit.client.0.smithi096.stdout:6/550: readlink d0/d6/l72 0 2024-04-18T04:58:01.361 INFO:tasks.workunit.client.0.smithi096.stdout:8/313: chown d0/d7/d24/d18/d27/d60 1056 1 2024-04-18T04:58:01.363 INFO:tasks.workunit.client.0.smithi096.stdout:8/314: fsync d0/d7/d24/d18/f23 0 2024-04-18T04:58:01.369 INFO:tasks.workunit.client.0.smithi096.stdout:6/551: dwrite d0/d6/f20 [0,4194304] 0 2024-04-18T04:58:01.371 INFO:tasks.workunit.client.0.smithi096.stdout:8/315: mkdir d0/d15/d65 0 2024-04-18T04:58:01.371 INFO:tasks.workunit.client.0.smithi096.stdout:6/552: rmdir d0/d4a 39 2024-04-18T04:58:01.374 INFO:tasks.workunit.client.0.smithi096.stdout:8/316: symlink d0/d7/d24/d18/d21/l66 0 2024-04-18T04:58:01.375 INFO:tasks.workunit.client.0.smithi096.stdout:8/317: write d0/d3/f5c [291506,50966] 0 2024-04-18T04:58:01.377 INFO:tasks.workunit.client.0.smithi096.stdout:6/553: dread d0/d6/f20 [0,4194304] 0 2024-04-18T04:58:01.377 INFO:tasks.workunit.client.0.smithi096.stdout:8/318: rename d0 to d0/d7/d24/d18/d27/d67 22 2024-04-18T04:58:01.379 INFO:tasks.workunit.client.0.smithi096.stdout:8/319: truncate d0/d7/d24/d18/d5d/f5f 531911 0 2024-04-18T04:58:01.380 INFO:tasks.workunit.client.0.smithi096.stdout:6/554: creat d0/d6/d2b/d3b/d69/d6c/d85/f9f x:0 0 0 2024-04-18T04:58:01.382 INFO:tasks.workunit.client.0.smithi096.stdout:8/320: unlink d0/d7/d24/d18/d21/f3b 0 2024-04-18T04:58:01.385 INFO:tasks.workunit.client.0.smithi096.stdout:8/321: symlink d0/l68 0 2024-04-18T04:58:01.386 INFO:tasks.workunit.client.0.smithi096.stdout:8/322: read d0/d7/f2b [452027,58370] 0 2024-04-18T04:58:01.395 INFO:tasks.workunit.client.0.smithi096.stdout:8/323: dwrite d0/f55 [0,4194304] 0 2024-04-18T04:58:01.395 INFO:tasks.workunit.client.0.smithi096.stdout:6/555: dwrite d0/d6/d2b/f4e [0,4194304] 0 2024-04-18T04:58:01.398 INFO:tasks.workunit.client.0.smithi096.stdout:8/324: creat d0/d7/d24/d18/d27/f69 x:0 0 0 2024-04-18T04:58:01.401 INFO:tasks.workunit.client.0.smithi096.stdout:6/556: mkdir d0/da0 0 2024-04-18T04:58:01.401 INFO:tasks.workunit.client.0.smithi096.stdout:8/325: fsync d0/d7/d24/d18/d5d/f5f 0 2024-04-18T04:58:01.404 INFO:tasks.workunit.client.0.smithi096.stdout:6/557: creat d0/d6/d2b/d3b/d69/d6c/d85/fa1 x:0 0 0 2024-04-18T04:58:01.405 INFO:tasks.workunit.client.0.smithi096.stdout:6/558: write d0/d6/d2e/f48 [859778,101347] 0 2024-04-18T04:58:01.405 INFO:tasks.workunit.client.0.smithi096.stdout:8/326: link d0/d7/d24/d18/d5d/f5f d0/d15/d65/f6a 0 2024-04-18T04:58:01.407 INFO:tasks.workunit.client.0.smithi096.stdout:6/559: write d0/d6/d2b/d3b/d69/d6c/d85/f9f [331472,54555] 0 2024-04-18T04:58:01.408 INFO:tasks.workunit.client.0.smithi096.stdout:8/327: mkdir d0/d3/d32/d6b 0 2024-04-18T04:58:01.410 INFO:tasks.workunit.client.0.smithi096.stdout:8/328: unlink d0/d3/f3e 0 2024-04-18T04:58:01.411 INFO:tasks.workunit.client.0.smithi096.stdout:6/560: fdatasync d0/d6/d29/f42 0 2024-04-18T04:58:01.412 INFO:tasks.workunit.client.0.smithi096.stdout:8/329: read d0/d7/f2b [1964969,92300] 0 2024-04-18T04:58:01.413 INFO:tasks.workunit.client.0.smithi096.stdout:8/330: creat d0/d3/f6c x:0 0 0 2024-04-18T04:58:01.414 INFO:tasks.workunit.client.0.smithi096.stdout:6/561: truncate d0/d6/d2e/f45 3636022 0 2024-04-18T04:58:01.414 INFO:tasks.workunit.client.0.smithi096.stdout:6/562: read d0/f67 [315128,20865] 0 2024-04-18T04:58:01.415 INFO:tasks.workunit.client.0.smithi096.stdout:8/331: symlink d0/d7/l6d 0 2024-04-18T04:58:01.419 INFO:tasks.workunit.client.0.smithi096.stdout:6/563: creat d0/d4a/fa2 x:0 0 0 2024-04-18T04:58:01.429 INFO:tasks.workunit.client.0.smithi096.stdout:8/332: dwrite d0/d7/d24/d18/f11 [0,4194304] 0 2024-04-18T04:58:01.430 INFO:tasks.workunit.client.0.smithi096.stdout:8/333: fsync d0/d4f/f58 0 2024-04-18T04:58:01.435 INFO:tasks.workunit.client.0.smithi096.stdout:8/334: getdents d0/d7/d24/d18 0 2024-04-18T04:58:01.438 INFO:tasks.workunit.client.0.smithi096.stdout:6/564: dwrite d0/d6/f1d [0,4194304] 0 2024-04-18T04:58:01.442 INFO:tasks.workunit.client.0.smithi096.stdout:0/371: sync 2024-04-18T04:58:01.444 INFO:tasks.workunit.client.0.smithi096.stdout:0/372: truncate d16/d1c/d4c/d4d/d5a/f6c 599371 0 2024-04-18T04:58:01.444 INFO:tasks.workunit.client.0.smithi096.stdout:0/373: readlink l3 0 2024-04-18T04:58:01.447 INFO:tasks.workunit.client.0.smithi096.stdout:0/374: rename c2 to d16/d1c/d4c/d6a/c72 0 2024-04-18T04:58:01.460 INFO:tasks.workunit.client.0.smithi096.stdout:0/375: dread d16/d1c/d22/d2c/f68 [0,4194304] 0 2024-04-18T04:58:01.630 INFO:tasks.workunit.client.0.smithi096.stdout:5/297: sync 2024-04-18T04:58:01.634 INFO:tasks.workunit.client.0.smithi096.stdout:5/298: mkdir d7/dd/d35/d74 0 2024-04-18T04:58:01.643 INFO:tasks.workunit.client.0.smithi096.stdout:5/299: rename d7/d25/d30/f55 to d7/d25/d2b/f75 0 2024-04-18T04:58:01.646 INFO:tasks.workunit.client.0.smithi096.stdout:5/300: fdatasync d7/d25/d30/f3a 0 2024-04-18T04:58:01.651 INFO:tasks.workunit.client.0.smithi096.stdout:5/301: rename d7/d12/f5a to d7/dd/f76 0 2024-04-18T04:58:01.656 INFO:tasks.workunit.client.0.smithi096.stdout:5/302: symlink d7/d39/d52/d61/l77 0 2024-04-18T04:58:01.660 INFO:tasks.workunit.client.0.smithi096.stdout:5/303: rmdir d7/d25 39 2024-04-18T04:58:01.665 INFO:tasks.workunit.client.0.smithi096.stdout:5/304: mkdir d7/d39/d78 0 2024-04-18T04:58:01.715 INFO:tasks.workunit.client.0.smithi096.stdout:9/316: sync 2024-04-18T04:58:01.719 INFO:tasks.workunit.client.0.smithi096.stdout:9/317: mkdir d0/d41/d6f 0 2024-04-18T04:58:01.726 INFO:tasks.workunit.client.0.smithi096.stdout:9/318: symlink d0/de/d17/d56/d59/d60/l70 0 2024-04-18T04:58:01.730 INFO:tasks.workunit.client.0.smithi096.stdout:9/319: fsync d0/d25/d3a/f4a 0 2024-04-18T04:58:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:2/557: sync 2024-04-18T04:58:01.807 INFO:tasks.workunit.client.0.smithi096.stdout:4/411: sync 2024-04-18T04:58:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:2/558: fsync df/d18/d24/f77 0 2024-04-18T04:58:01.809 INFO:tasks.workunit.client.0.smithi096.stdout:4/412: stat d4/d14/d1d/d29/d3a/d47/d4b 0 2024-04-18T04:58:01.810 INFO:tasks.workunit.client.0.smithi096.stdout:2/559: chown df/d18/d71 2565 1 2024-04-18T04:58:01.811 INFO:tasks.workunit.client.0.smithi096.stdout:2/560: fdatasync df/d18/d71/f97 0 2024-04-18T04:58:01.813 INFO:tasks.workunit.client.0.smithi096.stdout:4/413: truncate d4/d14/d2d/d44/d58/f65 313872 0 2024-04-18T04:58:01.816 INFO:tasks.workunit.client.0.smithi096.stdout:2/561: creat df/d18/d24/d42/d3f/d4a/fb2 x:0 0 0 2024-04-18T04:58:01.820 INFO:tasks.workunit.client.0.smithi096.stdout:2/562: symlink df/d7d/lb3 0 2024-04-18T04:58:01.826 INFO:tasks.workunit.client.0.smithi096.stdout:2/563: creat df/d18/d26/fb4 x:0 0 0 2024-04-18T04:58:01.839 INFO:tasks.workunit.client.0.smithi096.stdout:2/564: write df/d18/d26/d48/f4f [1797313,48569] 0 2024-04-18T04:58:01.843 INFO:tasks.workunit.client.0.smithi096.stdout:2/565: symlink df/d18/d71/lb5 0 2024-04-18T04:58:01.853 INFO:tasks.workunit.client.0.smithi096.stdout:2/566: getdents df/d18/d71 0 2024-04-18T04:58:01.854 INFO:tasks.workunit.client.0.smithi096.stdout:2/567: chown df/d18/d24/d42/d6e/l8a 1644526 1 2024-04-18T04:58:01.859 INFO:tasks.workunit.client.0.smithi096.stdout:2/568: mkdir df/d18/d71/d9c/db6 0 2024-04-18T04:58:01.862 INFO:tasks.workunit.client.0.smithi096.stdout:2/569: symlink df/d18/d71/d9c/lb7 0 2024-04-18T04:58:01.866 INFO:tasks.workunit.client.0.smithi096.stdout:2/570: mkdir df/d18/d71/db8 0 2024-04-18T04:58:01.868 INFO:tasks.workunit.client.0.smithi096.stdout:2/571: read - df/d18/d87/f9e zero size 2024-04-18T04:58:01.869 INFO:tasks.workunit.client.0.smithi096.stdout:2/572: stat df/d18/d24/d42/l6c 0 2024-04-18T04:58:01.873 INFO:tasks.workunit.client.0.smithi096.stdout:2/573: creat df/d7d/fb9 x:0 0 0 2024-04-18T04:58:01.876 INFO:tasks.workunit.client.0.smithi096.stdout:2/574: write df/f65 [1009904,55970] 0 2024-04-18T04:58:01.881 INFO:tasks.workunit.client.0.smithi096.stdout:2/575: write df/d18/d24/faf [279632,15454] 0 2024-04-18T04:58:01.887 INFO:tasks.workunit.client.0.smithi096.stdout:2/576: rename df/d18/d24/l6f to df/d18/d71/lba 0 2024-04-18T04:58:01.893 INFO:tasks.workunit.client.0.smithi096.stdout:2/577: unlink df/d18/d24/d42/d3f/d4a/l67 0 2024-04-18T04:58:01.897 INFO:tasks.workunit.client.0.smithi096.stdout:7/365: sync 2024-04-18T04:58:01.897 INFO:tasks.workunit.client.0.smithi096.stdout:2/578: mknod df/d18/d87/cbb 0 2024-04-18T04:58:01.902 INFO:tasks.workunit.client.0.smithi096.stdout:7/366: mkdir db/d1f/d5b/d6a/d74 0 2024-04-18T04:58:01.906 INFO:tasks.workunit.client.0.smithi096.stdout:2/579: rename df/d18/d71/d9c/daa to df/d18/d24/d42/d3f/d4a/dbc 0 2024-04-18T04:58:01.911 INFO:tasks.workunit.client.0.smithi096.stdout:2/580: creat df/d18/fbd x:0 0 0 2024-04-18T04:58:01.919 INFO:tasks.workunit.client.0.smithi096.stdout:7/367: dwrite db/d1f/f40 [0,4194304] 0 2024-04-18T04:58:01.922 INFO:tasks.workunit.client.0.smithi096.stdout:7/368: rmdir db/d1f/d24/d61 39 2024-04-18T04:58:01.923 INFO:tasks.workunit.client.0.smithi096.stdout:7/369: chown db/d1d 52136 1 2024-04-18T04:58:01.928 INFO:tasks.workunit.client.0.smithi096.stdout:2/581: dwrite df/d18/d26/f4c [0,4194304] 0 2024-04-18T04:58:01.930 INFO:tasks.workunit.client.0.smithi096.stdout:4/414: sync 2024-04-18T04:58:01.931 INFO:tasks.workunit.client.0.smithi096.stdout:3/533: sync 2024-04-18T04:58:01.931 INFO:tasks.workunit.client.0.smithi096.stdout:6/565: sync 2024-04-18T04:58:01.931 INFO:tasks.workunit.client.0.smithi096.stdout:0/376: sync 2024-04-18T04:58:01.931 INFO:tasks.workunit.client.0.smithi096.stdout:1/537: sync 2024-04-18T04:58:01.931 INFO:tasks.workunit.client.0.smithi096.stdout:8/335: sync 2024-04-18T04:58:01.931 INFO:tasks.workunit.client.0.smithi096.stdout:5/305: sync 2024-04-18T04:58:01.931 INFO:tasks.workunit.client.0.smithi096.stdout:9/320: sync 2024-04-18T04:58:01.938 INFO:tasks.workunit.client.0.smithi096.stdout:3/534: chown dc/lf 0 1 2024-04-18T04:58:01.939 INFO:tasks.workunit.client.0.smithi096.stdout:7/370: dread db/f12 [0,4194304] 0 2024-04-18T04:58:01.939 INFO:tasks.workunit.client.0.smithi096.stdout:2/582: chown df/d18/d87/cbb 11763 1 2024-04-18T04:58:01.942 INFO:tasks.workunit.client.0.smithi096.stdout:0/377: rmdir d16/d1c 39 2024-04-18T04:58:01.942 INFO:tasks.workunit.client.0.smithi096.stdout:8/336: write d0/d7/d24/d18/d21/f61 [2666369,126951] 0 2024-04-18T04:58:01.943 INFO:tasks.workunit.client.0.smithi096.stdout:2/583: write df/d18/d24/f74 [4683879,2943] 0 2024-04-18T04:58:01.944 INFO:tasks.workunit.client.0.smithi096.stdout:1/538: creat de/d1d/d3f/d7a/d96/fa6 x:0 0 0 2024-04-18T04:58:01.947 INFO:tasks.workunit.client.0.smithi096.stdout:3/535: mkdir dc/d26/d48/dae 0 2024-04-18T04:58:01.947 INFO:tasks.workunit.client.0.smithi096.stdout:2/584: write df/d18/d71/f97 [956602,37580] 0 2024-04-18T04:58:01.949 INFO:tasks.workunit.client.0.smithi096.stdout:7/371: read - db/f15 zero size 2024-04-18T04:58:01.949 INFO:tasks.workunit.client.0.smithi096.stdout:3/536: truncate dc/f18 4894940 0 2024-04-18T04:58:01.949 INFO:tasks.workunit.client.0.smithi096.stdout:2/585: chown df/d18/d71/lab 983752 1 2024-04-18T04:58:01.950 INFO:tasks.workunit.client.0.smithi096.stdout:7/372: read - db/d1f/d24/d49/d54/f5d zero size 2024-04-18T04:58:01.953 INFO:tasks.workunit.client.0.smithi096.stdout:2/586: truncate df/d18/d26/d48/f52 490130 0 2024-04-18T04:58:01.953 INFO:tasks.workunit.client.0.smithi096.stdout:2/587: stat df/d18/d26/f47 0 2024-04-18T04:58:01.954 INFO:tasks.workunit.client.0.smithi096.stdout:2/588: chown df/d18/d87 63 1 2024-04-18T04:58:01.955 INFO:tasks.workunit.client.0.smithi096.stdout:6/566: dread d0/d6/d5d/f75 [8388608,4194304] 0 2024-04-18T04:58:01.955 INFO:tasks.workunit.client.0.smithi096.stdout:2/589: dread - df/d18/d26/fb4 zero size 2024-04-18T04:58:01.956 INFO:tasks.workunit.client.0.smithi096.stdout:6/567: chown d0/d4a/l6e 1 1 2024-04-18T04:58:01.957 INFO:tasks.workunit.client.0.smithi096.stdout:4/415: symlink d4/d14/d1d/d29/d3a/d47/d4b/d81/l85 0 2024-04-18T04:58:01.960 INFO:tasks.workunit.client.0.smithi096.stdout:9/321: write d0/de/d17/f20 [3992998,77099] 0 2024-04-18T04:58:01.961 INFO:tasks.workunit.client.0.smithi096.stdout:7/373: dwrite db/d1f/d24/d49/f71 [0,4194304] 0 2024-04-18T04:58:01.962 INFO:tasks.workunit.client.0.smithi096.stdout:0/378: creat d16/d1c/d4c/d4d/f73 x:0 0 0 2024-04-18T04:58:01.964 INFO:tasks.workunit.client.0.smithi096.stdout:8/337: truncate d0/d7/f50 809080 0 2024-04-18T04:58:01.965 INFO:tasks.workunit.client.0.smithi096.stdout:6/568: rmdir d0/d6/d2b/d3b 39 2024-04-18T04:58:01.967 INFO:tasks.workunit.client.0.smithi096.stdout:2/590: dwrite df/d18/d24/f77 [4194304,4194304] 0 2024-04-18T04:58:01.967 INFO:tasks.workunit.client.0.smithi096.stdout:8/338: write d0/d3/d32/f37 [4429096,35039] 0 2024-04-18T04:58:01.972 INFO:tasks.workunit.client.0.smithi096.stdout:5/306: getdents d7/d12/d5e 0 2024-04-18T04:58:01.972 INFO:tasks.workunit.client.0.smithi096.stdout:9/322: mknod d0/d25/d3a/c71 0 2024-04-18T04:58:01.978 INFO:tasks.workunit.client.0.smithi096.stdout:8/339: truncate d0/d7/d24/d35/f5e 965583 0 2024-04-18T04:58:01.978 INFO:tasks.workunit.client.0.smithi096.stdout:1/539: truncate de/f6a 495344 0 2024-04-18T04:58:01.979 INFO:tasks.workunit.client.0.smithi096.stdout:7/374: dwrite db/d20/d2f/f30 [4194304,4194304] 0 2024-04-18T04:58:01.980 INFO:tasks.workunit.client.0.smithi096.stdout:2/591: dread df/f64 [0,4194304] 0 2024-04-18T04:58:01.982 INFO:tasks.workunit.client.0.smithi096.stdout:7/375: readlink db/d1d/l32 0 2024-04-18T04:58:01.984 INFO:tasks.workunit.client.0.smithi096.stdout:0/379: rmdir d16/d1c/d22/d71 0 2024-04-18T04:58:01.986 INFO:tasks.workunit.client.0.smithi096.stdout:6/569: dwrite d0/d6/d5d/f91 [0,4194304] 0 2024-04-18T04:58:01.992 INFO:tasks.workunit.client.0.smithi096.stdout:4/416: truncate d4/d14/f2b 3256044 0 2024-04-18T04:58:01.992 INFO:tasks.workunit.client.0.smithi096.stdout:8/340: truncate d0/d7/f36 247366 0 2024-04-18T04:58:01.995 INFO:tasks.workunit.client.0.smithi096.stdout:4/417: readlink d4/l7c 0 2024-04-18T04:58:01.997 INFO:tasks.workunit.client.0.smithi096.stdout:5/307: dwrite d7/f4c [0,4194304] 0 2024-04-18T04:58:01.997 INFO:tasks.workunit.client.0.smithi096.stdout:1/540: read de/f12 [430615,76436] 0 2024-04-18T04:58:02.000 INFO:tasks.workunit.client.0.smithi096.stdout:1/541: readlink de/l36 0 2024-04-18T04:58:02.000 INFO:tasks.workunit.client.0.smithi096.stdout:9/323: dwrite d0/d25/f3c [0,4194304] 0 2024-04-18T04:58:02.001 INFO:tasks.workunit.client.0.smithi096.stdout:6/570: symlink d0/d6/d2e/d7a/la3 0 2024-04-18T04:58:02.002 INFO:tasks.workunit.client.0.smithi096.stdout:2/592: creat df/d18/d71/d9c/db6/fbe x:0 0 0 2024-04-18T04:58:02.004 INFO:tasks.workunit.client.0.smithi096.stdout:8/341: rename d0/l49 to d0/d7/d24/d35/d51/l6e 0 2024-04-18T04:58:02.005 INFO:tasks.workunit.client.0.smithi096.stdout:0/380: dread d16/f2b [4194304,4194304] 0 2024-04-18T04:58:02.008 INFO:tasks.workunit.client.0.smithi096.stdout:6/571: chown d0/d6/d29/c5a 96752148 1 2024-04-18T04:58:02.010 INFO:tasks.workunit.client.0.smithi096.stdout:1/542: mkdir de/d1d/d81/da7 0 2024-04-18T04:58:02.011 INFO:tasks.workunit.client.0.smithi096.stdout:2/593: mknod df/d18/d26/d48/d7b/cbf 0 2024-04-18T04:58:02.011 INFO:tasks.workunit.client.0.smithi096.stdout:4/418: dwrite d4/d14/d2d/d44/d63/f7f [0,4194304] 0 2024-04-18T04:58:02.012 INFO:tasks.workunit.client.0.smithi096.stdout:0/381: creat d16/d1c/d4c/d4d/d5d/f74 x:0 0 0 2024-04-18T04:58:02.014 INFO:tasks.workunit.client.0.smithi096.stdout:5/308: dread d7/d12/f44 [0,4194304] 0 2024-04-18T04:58:02.014 INFO:tasks.workunit.client.0.smithi096.stdout:6/572: creat d0/d73/fa4 x:0 0 0 2024-04-18T04:58:02.017 INFO:tasks.workunit.client.0.smithi096.stdout:5/309: write d7/d39/f26 [793705,30280] 0 2024-04-18T04:58:02.018 INFO:tasks.workunit.client.0.smithi096.stdout:0/382: symlink d16/d1c/d22/d3a/l75 0 2024-04-18T04:58:02.021 INFO:tasks.workunit.client.0.smithi096.stdout:4/419: rename d4/d14/d1d/d29 to d4/d14/d2d/d44/d58/d86 0 2024-04-18T04:58:02.022 INFO:tasks.workunit.client.0.smithi096.stdout:9/324: dwrite d0/de/d17/d56/d59/f65 [0,4194304] 0 2024-04-18T04:58:02.025 INFO:tasks.workunit.client.0.smithi096.stdout:4/420: creat d4/f87 x:0 0 0 2024-04-18T04:58:02.026 INFO:tasks.workunit.client.0.smithi096.stdout:9/325: write d0/de/d17/f3f [1147160,99739] 0 2024-04-18T04:58:02.028 INFO:tasks.workunit.client.0.smithi096.stdout:0/383: rename d16/f1a to d16/d1c/d4c/d4d/d5d/f76 0 2024-04-18T04:58:02.029 INFO:tasks.workunit.client.0.smithi096.stdout:2/594: link df/d18/d24/d42/d3f/c53 df/d18/d26/d48/cc0 0 2024-04-18T04:58:02.029 INFO:tasks.workunit.client.0.smithi096.stdout:1/543: dwrite de/d1d/f25 [0,4194304] 0 2024-04-18T04:58:02.030 INFO:tasks.workunit.client.0.smithi096.stdout:0/384: chown d16/d1c/l24 9641110 1 2024-04-18T04:58:02.031 INFO:tasks.workunit.client.0.smithi096.stdout:9/326: truncate d0/de/f1c 4345339 0 2024-04-18T04:58:02.032 INFO:tasks.workunit.client.0.smithi096.stdout:6/573: link d0/d6/d2b/d3b/d69/d6c/f76 d0/d6/d2b/d7e/fa5 0 2024-04-18T04:58:02.033 INFO:tasks.workunit.client.0.smithi096.stdout:9/327: write d0/de/d17/d56/f50 [136088,43599] 0 2024-04-18T04:58:02.034 INFO:tasks.workunit.client.0.smithi096.stdout:6/574: read - d0/d6/d2b/f90 zero size 2024-04-18T04:58:02.034 INFO:tasks.workunit.client.0.smithi096.stdout:2/595: mknod df/d7d/d9f/cc1 0 2024-04-18T04:58:02.038 INFO:tasks.workunit.client.0.smithi096.stdout:0/385: mknod d16/d1c/d4c/d4d/d5d/c77 0 2024-04-18T04:58:02.040 INFO:tasks.workunit.client.0.smithi096.stdout:4/421: link d4/d14/d2d/d44/d58/f6b d4/d14/d2d/d44/d58/f88 0 2024-04-18T04:58:02.040 INFO:tasks.workunit.client.0.smithi096.stdout:6/575: dread d0/d6/f24 [0,4194304] 0 2024-04-18T04:58:02.041 INFO:tasks.workunit.client.0.smithi096.stdout:9/328: creat d0/de/d17/d56/d59/d68/f72 x:0 0 0 2024-04-18T04:58:02.041 INFO:tasks.workunit.client.0.smithi096.stdout:9/329: readlink d0/l24 0 2024-04-18T04:58:02.043 INFO:tasks.workunit.client.0.smithi096.stdout:1/544: rmdir de/d1d/d3f/d7a/d96/da5 0 2024-04-18T04:58:02.045 INFO:tasks.workunit.client.0.smithi096.stdout:4/422: read d4/d14/d2d/d44/d58/d86/d3a/d39/f56 [2393812,1231] 0 2024-04-18T04:58:02.046 INFO:tasks.workunit.client.0.smithi096.stdout:9/330: read d0/f28 [403700,20001] 0 2024-04-18T04:58:02.046 INFO:tasks.workunit.client.0.smithi096.stdout:4/423: stat d4/f87 0 2024-04-18T04:58:02.046 INFO:tasks.workunit.client.0.smithi096.stdout:2/596: rmdir df/d18/d24/d42/d3f/dae 0 2024-04-18T04:58:02.048 INFO:tasks.workunit.client.0.smithi096.stdout:9/331: write d0/de/d17/d2f/d40/f34 [74930,34844] 0 2024-04-18T04:58:02.049 INFO:tasks.workunit.client.0.smithi096.stdout:0/386: getdents d16/d55 0 2024-04-18T04:58:02.051 INFO:tasks.workunit.client.0.smithi096.stdout:0/387: chown d16/d1c/d4c/f50 70557 1 2024-04-18T04:58:02.051 INFO:tasks.workunit.client.0.smithi096.stdout:9/332: symlink d0/de/d17/d56/d59/l73 0 2024-04-18T04:58:02.052 INFO:tasks.workunit.client.0.smithi096.stdout:0/388: fdatasync d16/d1c/d4c/f50 0 2024-04-18T04:58:02.053 INFO:tasks.workunit.client.0.smithi096.stdout:4/424: dread d4/d14/d2d/d44/d63/f7f [0,4194304] 0 2024-04-18T04:58:02.053 INFO:tasks.workunit.client.0.smithi096.stdout:2/597: mknod df/d18/d24/d42/d3f/d4a/d82/cc2 0 2024-04-18T04:58:02.058 INFO:tasks.workunit.client.0.smithi096.stdout:4/425: write d4/d14/d2d/d44/d63/f7f [259942,21121] 0 2024-04-18T04:58:02.059 INFO:tasks.workunit.client.0.smithi096.stdout:2/598: rename df/d18/d71/d9c/lb7 to df/d18/d71/d9c/lc3 0 2024-04-18T04:58:02.060 INFO:tasks.workunit.client.0.smithi096.stdout:9/333: symlink d0/d25/d33/l74 0 2024-04-18T04:58:02.061 INFO:tasks.workunit.client.0.smithi096.stdout:9/334: dread - d0/de/d17/d56/d59/d68/f72 zero size 2024-04-18T04:58:02.061 INFO:tasks.workunit.client.0.smithi096.stdout:4/426: mkdir d4/d14/d2d/d44/d89 0 2024-04-18T04:58:02.063 INFO:tasks.workunit.client.0.smithi096.stdout:9/335: truncate d0/de/d17/d2f/f42 1320630 0 2024-04-18T04:58:02.068 INFO:tasks.workunit.client.0.smithi096.stdout:6/576: truncate d0/d6/d29/f9c 4053000 0 2024-04-18T04:58:02.071 INFO:tasks.workunit.client.0.smithi096.stdout:4/427: dwrite d4/d14/d2d/d44/d58/d86/d3a/d39/f51 [0,4194304] 0 2024-04-18T04:58:02.075 INFO:tasks.workunit.client.0.smithi096.stdout:9/336: dwrite d0/de/d17/f23 [0,4194304] 0 2024-04-18T04:58:02.075 INFO:tasks.workunit.client.0.smithi096.stdout:6/577: creat d0/d6/d2b/d3b/d69/d6c/fa6 x:0 0 0 2024-04-18T04:58:02.076 INFO:tasks.workunit.client.0.smithi096.stdout:6/578: fsync d0/f33 0 2024-04-18T04:58:02.083 INFO:tasks.workunit.client.0.smithi096.stdout:9/337: mknod d0/de/d17/d56/d59/d68/c75 0 2024-04-18T04:58:02.084 INFO:tasks.workunit.client.0.smithi096.stdout:4/428: mkdir d4/d14/d2d/d44/d58/d86/d3a/d47/d8a 0 2024-04-18T04:58:02.085 INFO:tasks.workunit.client.0.smithi096.stdout:2/599: dwrite df/d18/d24/f3e [4194304,4194304] 0 2024-04-18T04:58:02.087 INFO:tasks.workunit.client.0.smithi096.stdout:9/338: write d0/de/d17/d2f/f42 [1606565,42739] 0 2024-04-18T04:58:02.088 INFO:tasks.workunit.client.0.smithi096.stdout:2/600: chown df/d18/d87/f9e 0 1 2024-04-18T04:58:02.090 INFO:tasks.workunit.client.0.smithi096.stdout:4/429: symlink d4/d14/l8b 0 2024-04-18T04:58:02.091 INFO:tasks.workunit.client.0.smithi096.stdout:6/579: dwrite d0/f82 [0,4194304] 0 2024-04-18T04:58:02.092 INFO:tasks.workunit.client.0.smithi096.stdout:2/601: rmdir df/d18/d24 39 2024-04-18T04:58:02.096 INFO:tasks.workunit.client.0.smithi096.stdout:6/580: dread d0/d6/d2b/f52 [0,4194304] 0 2024-04-18T04:58:02.100 INFO:tasks.workunit.client.0.smithi096.stdout:4/430: mkdir d4/d14/d2d/d44/d55/d8c 0 2024-04-18T04:58:02.101 INFO:tasks.workunit.client.0.smithi096.stdout:4/431: stat d4/d14/d2d/d44/d58/d86/d3a/d39/f59 0 2024-04-18T04:58:02.101 INFO:tasks.workunit.client.0.smithi096.stdout:6/581: symlink d0/d6/d2b/d7e/la7 0 2024-04-18T04:58:02.102 INFO:tasks.workunit.client.0.smithi096.stdout:3/537: sync 2024-04-18T04:58:02.103 INFO:tasks.workunit.client.0.smithi096.stdout:2/602: write df/d18/d24/d42/d3f/d4a/f40 [807270,46934] 0 2024-04-18T04:58:02.104 INFO:tasks.workunit.client.0.smithi096.stdout:4/432: read d4/d14/d2d/d44/f5d [1419807,126802] 0 2024-04-18T04:58:02.104 INFO:tasks.workunit.client.0.smithi096.stdout:9/339: getdents d0/de/d17/d56/d59/d68 0 2024-04-18T04:58:02.105 INFO:tasks.workunit.client.0.smithi096.stdout:6/582: dread d0/d6/d2b/d7e/fa5 [0,4194304] 0 2024-04-18T04:58:02.105 INFO:tasks.workunit.client.0.smithi096.stdout:2/603: read - df/d18/d26/f54 zero size 2024-04-18T04:58:02.106 INFO:tasks.workunit.client.0.smithi096.stdout:3/538: write dc/d26/d76/f3e [991083,13593] 0 2024-04-18T04:58:02.107 INFO:tasks.workunit.client.0.smithi096.stdout:4/433: chown d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/f82 305 1 2024-04-18T04:58:02.108 INFO:tasks.workunit.client.0.smithi096.stdout:4/434: fdatasync d4/d14/d16/f3f 0 2024-04-18T04:58:02.108 INFO:tasks.workunit.client.0.smithi096.stdout:9/340: creat d0/d52/d5a/f76 x:0 0 0 2024-04-18T04:58:02.110 INFO:tasks.workunit.client.0.smithi096.stdout:4/435: chown d4/d14/d2d/d44/d58/d86/d6f/f77 13585 1 2024-04-18T04:58:02.110 INFO:tasks.workunit.client.0.smithi096.stdout:2/604: creat df/d18/d71/fc4 x:0 0 0 2024-04-18T04:58:02.112 INFO:tasks.workunit.client.0.smithi096.stdout:6/583: rmdir d0/d6/d2b/d3b/d69/d6c/d85 39 2024-04-18T04:58:02.114 INFO:tasks.workunit.client.0.smithi096.stdout:9/341: dread d0/d25/f2e [0,4194304] 0 2024-04-18T04:58:02.115 INFO:tasks.workunit.client.0.smithi096.stdout:3/539: creat dc/d26/d66/faf x:0 0 0 2024-04-18T04:58:02.118 INFO:tasks.workunit.client.0.smithi096.stdout:2/605: dwrite df/f73 [0,4194304] 0 2024-04-18T04:58:02.118 INFO:tasks.workunit.client.0.smithi096.stdout:6/584: creat d0/d73/fa8 x:0 0 0 2024-04-18T04:58:02.120 INFO:tasks.workunit.client.0.smithi096.stdout:9/342: rmdir d0/de/d17/d2f 39 2024-04-18T04:58:02.123 INFO:tasks.workunit.client.0.smithi096.stdout:3/540: mknod dc/d26/d76/d29/d62/cb0 0 2024-04-18T04:58:02.126 INFO:tasks.workunit.client.0.smithi096.stdout:4/436: dwrite d4/d14/d2d/d44/f5d [0,4194304] 0 2024-04-18T04:58:02.127 INFO:tasks.workunit.client.0.smithi096.stdout:4/437: chown d4/d14/d16/c4f 0 1 2024-04-18T04:58:02.127 INFO:tasks.workunit.client.0.smithi096.stdout:9/343: rename d0/de/d17/f20 to d0/de/d17/d56/d59/d60/f77 0 2024-04-18T04:58:02.128 INFO:tasks.workunit.client.0.smithi096.stdout:3/541: chown dc/f56 3722817 1 2024-04-18T04:58:02.129 INFO:tasks.workunit.client.0.smithi096.stdout:2/606: mknod df/d18/d71/db8/cc5 0 2024-04-18T04:58:02.130 INFO:tasks.workunit.client.0.smithi096.stdout:3/542: read dc/d5d/f5c [4185660,108765] 0 2024-04-18T04:58:02.130 INFO:tasks.workunit.client.0.smithi096.stdout:6/585: creat d0/d6/d2e/fa9 x:0 0 0 2024-04-18T04:58:02.132 INFO:tasks.workunit.client.0.smithi096.stdout:4/438: write d4/d14/d2d/d44/d58/d86/d3a/d39/d54/f5c [1342274,7251] 0 2024-04-18T04:58:02.134 INFO:tasks.workunit.client.0.smithi096.stdout:2/607: creat df/d18/d26/d48/fc6 x:0 0 0 2024-04-18T04:58:02.135 INFO:tasks.workunit.client.0.smithi096.stdout:3/543: unlink dc/f10 0 2024-04-18T04:58:02.136 INFO:tasks.workunit.client.0.smithi096.stdout:3/544: write dc/d26/d57/f7a [647852,48775] 0 2024-04-18T04:58:02.137 INFO:tasks.workunit.client.0.smithi096.stdout:9/344: rename d0/d25/l58 to d0/de/d17/d56/d59/d68/l78 0 2024-04-18T04:58:02.139 INFO:tasks.workunit.client.0.smithi096.stdout:4/439: readlink d4/d14/d2d/d44/d55/l83 0 2024-04-18T04:58:02.140 INFO:tasks.workunit.client.0.smithi096.stdout:3/545: readlink dc/d26/d76/d29/l41 0 2024-04-18T04:58:02.141 INFO:tasks.workunit.client.0.smithi096.stdout:4/440: write d4/d14/d2d/d44/d58/d86/d3a/d39/f51 [2429703,10194] 0 2024-04-18T04:58:02.144 INFO:tasks.workunit.client.0.smithi096.stdout:6/586: rename d0/d6/d5d/c49 to d0/d6/d2b/d3b/caa 0 2024-04-18T04:58:02.146 INFO:tasks.workunit.client.0.smithi096.stdout:3/546: symlink dc/d26/d76/d95/da3/lb1 0 2024-04-18T04:58:02.146 INFO:tasks.workunit.client.0.smithi096.stdout:2/608: dread df/d18/d71/d9c/fa7 [0,4194304] 0 2024-04-18T04:58:02.148 INFO:tasks.workunit.client.0.smithi096.stdout:6/587: mkdir d0/d6/d2b/d3b/d69/dab 0 2024-04-18T04:58:02.150 INFO:tasks.workunit.client.0.smithi096.stdout:3/547: write dc/f56 [486873,67716] 0 2024-04-18T04:58:02.151 INFO:tasks.workunit.client.0.smithi096.stdout:3/548: write dc/d5d/f6d [404005,94852] 0 2024-04-18T04:58:02.156 INFO:tasks.workunit.client.0.smithi096.stdout:9/345: getdents d0/de/d17/d2f/d40 0 2024-04-18T04:58:02.157 INFO:tasks.workunit.client.0.smithi096.stdout:3/549: stat dc/d26/d76/f33 0 2024-04-18T04:58:02.157 INFO:tasks.workunit.client.0.smithi096.stdout:3/550: chown dc/d26/d4a/c8e 110 1 2024-04-18T04:58:02.157 INFO:tasks.workunit.client.0.smithi096.stdout:6/588: truncate d0/d6/d29/f46 3261492 0 2024-04-18T04:58:02.159 INFO:tasks.workunit.client.0.smithi096.stdout:2/609: getdents df/d18/d24 0 2024-04-18T04:58:02.160 INFO:tasks.workunit.client.0.smithi096.stdout:3/551: mknod dc/d26/d76/d95/da3/cb2 0 2024-04-18T04:58:02.161 INFO:tasks.workunit.client.0.smithi096.stdout:6/589: fdatasync d0/d6/d2b/f54 0 2024-04-18T04:58:02.163 INFO:tasks.workunit.client.0.smithi096.stdout:3/552: rename dc/d5d/f86 to dc/d26/d66/fb3 0 2024-04-18T04:58:02.167 INFO:tasks.workunit.client.0.smithi096.stdout:6/590: symlink d0/d6/d2e/d7a/lac 0 2024-04-18T04:58:02.171 INFO:tasks.workunit.client.0.smithi096.stdout:2/610: creat df/d18/fc7 x:0 0 0 2024-04-18T04:58:02.171 INFO:tasks.workunit.client.0.smithi096.stdout:9/346: truncate d0/de/d17/f57 540320 0 2024-04-18T04:58:02.173 INFO:tasks.workunit.client.0.smithi096.stdout:9/347: write d0/de/d17/d2f/f42 [2340988,96951] 0 2024-04-18T04:58:02.174 INFO:tasks.workunit.client.0.smithi096.stdout:3/553: rename dc/d26/d76/d29/d62/l87 to dc/d26/d76/d29/d7e/lb4 0 2024-04-18T04:58:02.177 INFO:tasks.workunit.client.0.smithi096.stdout:6/591: dwrite d0/d6/f37 [0,4194304] 0 2024-04-18T04:58:02.179 INFO:tasks.workunit.client.0.smithi096.stdout:9/348: symlink d0/de/d17/d2f/d40/l79 0 2024-04-18T04:58:02.180 INFO:tasks.workunit.client.0.smithi096.stdout:6/592: fdatasync d0/d6/f34 0 2024-04-18T04:58:02.180 INFO:tasks.workunit.client.0.smithi096.stdout:2/611: unlink df/d18/d24/d42/d3f/c58 0 2024-04-18T04:58:02.180 INFO:tasks.workunit.client.0.smithi096.stdout:3/554: truncate dc/fe 2813745 0 2024-04-18T04:58:02.181 INFO:tasks.workunit.client.0.smithi096.stdout:9/349: write d0/de/d17/d56/d59/d68/f72 [285438,87370] 0 2024-04-18T04:58:02.182 INFO:tasks.workunit.client.0.smithi096.stdout:2/612: creat df/d7a/fc8 x:0 0 0 2024-04-18T04:58:02.183 INFO:tasks.workunit.client.0.smithi096.stdout:6/593: unlink d0/d6/d29/d83/l99 0 2024-04-18T04:58:02.185 INFO:tasks.workunit.client.0.smithi096.stdout:2/613: write df/d18/d24/d42/d6e/f8b [1273454,117646] 0 2024-04-18T04:58:02.185 INFO:tasks.workunit.client.0.smithi096.stdout:9/350: rename d0/cb to d0/d52/d5a/c7a 0 2024-04-18T04:58:02.188 INFO:tasks.workunit.client.0.smithi096.stdout:9/351: write d0/de/d17/f23 [232207,67107] 0 2024-04-18T04:58:02.192 INFO:tasks.workunit.client.0.smithi096.stdout:9/352: rmdir d0/de/d17/d56 39 2024-04-18T04:58:02.192 INFO:tasks.workunit.client.0.smithi096.stdout:2/614: link df/d18/d24/d42/l5d df/d18/d71/d75/lc9 0 2024-04-18T04:58:02.194 INFO:tasks.workunit.client.0.smithi096.stdout:2/615: dread - df/d7a/fc8 zero size 2024-04-18T04:58:02.195 INFO:tasks.workunit.client.0.smithi096.stdout:6/594: dwrite d0/d6/d2b/f5c [0,4194304] 0 2024-04-18T04:58:02.205 INFO:tasks.workunit.client.0.smithi096.stdout:3/555: dread dc/f24 [0,4194304] 0 2024-04-18T04:58:02.206 INFO:tasks.workunit.client.0.smithi096.stdout:9/353: dwrite d0/de/f62 [0,4194304] 0 2024-04-18T04:58:02.208 INFO:tasks.workunit.client.0.smithi096.stdout:2/616: dwrite df/d18/d24/d42/f2c [0,4194304] 0 2024-04-18T04:58:02.214 INFO:tasks.workunit.client.0.smithi096.stdout:2/617: write df/d18/d24/f3e [4415568,19114] 0 2024-04-18T04:58:02.216 INFO:tasks.workunit.client.0.smithi096.stdout:2/618: write df/d18/d26/d48/fa6 [235599,127026] 0 2024-04-18T04:58:02.233 INFO:tasks.workunit.client.0.smithi096.stdout:6/595: creat d0/d6/d2b/d3b/d69/d6c/d85/fad x:0 0 0 2024-04-18T04:58:02.236 INFO:tasks.workunit.client.0.smithi096.stdout:9/354: fsync d0/de/f16 0 2024-04-18T04:58:02.240 INFO:tasks.workunit.client.0.smithi096.stdout:6/596: creat d0/da0/fae x:0 0 0 2024-04-18T04:58:02.264 INFO:tasks.workunit.client.0.smithi096.stdout:6/597: dread d0/d6/d5d/f3c [0,4194304] 0 2024-04-18T04:58:02.278 INFO:tasks.workunit.client.0.smithi096.stdout:6/598: rename d0/d6/c2d to d0/d6/d2e/caf 0 2024-04-18T04:58:02.279 INFO:tasks.workunit.client.0.smithi096.stdout:3/556: dread dc/f22 [0,4194304] 0 2024-04-18T04:58:02.280 INFO:tasks.workunit.client.0.smithi096.stdout:3/557: dread - dc/d26/d4a/d6b/f7b zero size 2024-04-18T04:58:02.281 INFO:tasks.workunit.client.0.smithi096.stdout:6/599: symlink d0/d6/d29/d83/lb0 0 2024-04-18T04:58:02.281 INFO:tasks.workunit.client.0.smithi096.stdout:3/558: truncate dc/d26/d76/d29/d62/f6a 557580 0 2024-04-18T04:58:02.282 INFO:tasks.workunit.client.0.smithi096.stdout:9/355: creat d0/de/f7b x:0 0 0 2024-04-18T04:58:02.283 INFO:tasks.workunit.client.0.smithi096.stdout:6/600: creat d0/d4a/fb1 x:0 0 0 2024-04-18T04:58:02.286 INFO:tasks.workunit.client.0.smithi096.stdout:9/356: rename d0/f3 to d0/de/d17/d5c/f7c 0 2024-04-18T04:58:02.289 INFO:tasks.workunit.client.0.smithi096.stdout:9/357: creat d0/d52/d5a/f7d x:0 0 0 2024-04-18T04:58:02.291 INFO:tasks.workunit.client.0.smithi096.stdout:6/601: creat d0/d6/d2b/d3b/d7d/fb2 x:0 0 0 2024-04-18T04:58:02.292 INFO:tasks.workunit.client.0.smithi096.stdout:9/358: symlink d0/l7e 0 2024-04-18T04:58:02.301 INFO:tasks.workunit.client.0.smithi096.stdout:6/602: write d0/d6/d2b/d7e/fa5 [356360,9897] 0 2024-04-18T04:58:02.301 INFO:tasks.workunit.client.0.smithi096.stdout:9/359: write d0/de/f16 [893416,70411] 0 2024-04-18T04:58:02.302 INFO:tasks.workunit.client.0.smithi096.stdout:6/603: readlink d0/d6/d2b/l3d 0 2024-04-18T04:58:02.308 INFO:tasks.workunit.client.0.smithi096.stdout:9/360: link d0/d41/f63 d0/de/d17/d56/d6d/f7f 0 2024-04-18T04:58:02.309 INFO:tasks.workunit.client.0.smithi096.stdout:6/604: creat d0/d6/fb3 x:0 0 0 2024-04-18T04:58:02.312 INFO:tasks.workunit.client.0.smithi096.stdout:6/605: write d0/d6/d5d/f70 [269145,32120] 0 2024-04-18T04:58:02.313 INFO:tasks.workunit.client.0.smithi096.stdout:6/606: chown d0/d6/d2b/d3b/d69/d6c 23220 1 2024-04-18T04:58:02.316 INFO:tasks.workunit.client.0.smithi096.stdout:9/361: dwrite d0/de/d17/d56/f6a [0,4194304] 0 2024-04-18T04:58:02.319 INFO:tasks.workunit.client.0.smithi096.stdout:9/362: symlink d0/d41/l80 0 2024-04-18T04:58:02.329 INFO:tasks.workunit.client.0.smithi096.stdout:6/607: dwrite d0/d6/d2b/f54 [0,4194304] 0 2024-04-18T04:58:02.334 INFO:tasks.workunit.client.0.smithi096.stdout:6/608: dread d0/d6/f37 [0,4194304] 0 2024-04-18T04:58:02.336 INFO:tasks.workunit.client.0.smithi096.stdout:9/363: dread d0/de/d17/d2f/d40/f34 [4194304,4194304] 0 2024-04-18T04:58:02.341 INFO:tasks.workunit.client.0.smithi096.stdout:6/609: rmdir d0/d6/d2b/d3b/d69/dab 0 2024-04-18T04:58:02.343 INFO:tasks.workunit.client.0.smithi096.stdout:9/364: rmdir d0/d41/d6f 0 2024-04-18T04:58:02.345 INFO:tasks.workunit.client.0.smithi096.stdout:6/610: creat d0/d6/d2e/d7a/fb4 x:0 0 0 2024-04-18T04:58:02.346 INFO:tasks.workunit.client.0.smithi096.stdout:9/365: mknod d0/d52/d5a/c81 0 2024-04-18T04:58:02.346 INFO:tasks.workunit.client.0.smithi096.stdout:9/366: truncate d0/de/f16 996642 0 2024-04-18T04:58:02.349 INFO:tasks.workunit.client.0.smithi096.stdout:9/367: rmdir d0/d25 39 2024-04-18T04:58:02.350 INFO:tasks.workunit.client.0.smithi096.stdout:6/611: link d0/d6/d2b/d3b/d69/c4f d0/d73/cb5 0 2024-04-18T04:58:02.354 INFO:tasks.workunit.client.0.smithi096.stdout:9/368: mknod d0/d25/c82 0 2024-04-18T04:58:02.354 INFO:tasks.workunit.client.0.smithi096.stdout:6/612: dread d0/d6/f20 [0,4194304] 0 2024-04-18T04:58:02.355 INFO:tasks.workunit.client.0.smithi096.stdout:6/613: write d0/d6/d2b/d3b/d69/d6c/d85/f9f [117348,59627] 0 2024-04-18T04:58:02.357 INFO:tasks.workunit.client.0.smithi096.stdout:9/369: creat d0/de/d17/d56/d59/d68/f83 x:0 0 0 2024-04-18T04:58:02.364 INFO:tasks.workunit.client.0.smithi096.stdout:6/614: dwrite d0/d6/d2b/d3b/d69/d6c/d85/fa1 [0,4194304] 0 2024-04-18T04:58:02.365 INFO:tasks.workunit.client.0.smithi096.stdout:9/370: dread d0/de/d17/d5c/f7c [0,4194304] 0 2024-04-18T04:58:02.366 INFO:tasks.workunit.client.0.smithi096.stdout:6/615: chown d0/d6/d2b/f4e 1 1 2024-04-18T04:58:02.370 INFO:tasks.workunit.client.0.smithi096.stdout:9/371: chown d0/de/d17/d2f/d40/f34 52982025 1 2024-04-18T04:58:02.371 INFO:tasks.workunit.client.0.smithi096.stdout:9/372: chown d0/d25/l36 3036120 1 2024-04-18T04:58:02.380 INFO:tasks.workunit.client.0.smithi096.stdout:9/373: fdatasync d0/d52/d5a/f69 0 2024-04-18T04:58:02.384 INFO:tasks.workunit.client.0.smithi096.stdout:6/616: getdents d0/da0 0 2024-04-18T04:58:02.389 INFO:tasks.workunit.client.0.smithi096.stdout:6/617: unlink d0/d6/d2b/d3b/d69/d6c/fa6 0 2024-04-18T04:58:02.390 INFO:tasks.workunit.client.0.smithi096.stdout:9/374: dwrite d0/de/d17/f2a [0,4194304] 0 2024-04-18T04:58:02.392 INFO:tasks.workunit.client.0.smithi096.stdout:6/618: mknod d0/da0/cb6 0 2024-04-18T04:58:02.393 INFO:tasks.workunit.client.0.smithi096.stdout:6/619: readlink d0/d6/d2b/d3b/l55 0 2024-04-18T04:58:02.394 INFO:tasks.workunit.client.0.smithi096.stdout:9/375: truncate d0/f11 1817379 0 2024-04-18T04:58:02.394 INFO:tasks.workunit.client.0.smithi096.stdout:9/376: readlink d0/d25/l26 0 2024-04-18T04:58:02.395 INFO:tasks.workunit.client.0.smithi096.stdout:6/620: write d0/d6/d2b/d3b/d69/d66/f79 [996030,49780] 0 2024-04-18T04:58:02.403 INFO:tasks.workunit.client.0.smithi096.stdout:9/377: creat d0/de/d17/d2f/f84 x:0 0 0 2024-04-18T04:58:02.406 INFO:tasks.workunit.client.0.smithi096.stdout:9/378: write d0/de/d17/d56/d59/d60/f77 [5441289,101767] 0 2024-04-18T04:58:02.410 INFO:tasks.workunit.client.0.smithi096.stdout:9/379: creat d0/d52/d5a/f85 x:0 0 0 2024-04-18T04:58:02.410 INFO:tasks.workunit.client.0.smithi096.stdout:6/621: write d0/d6/d2e/f38 [7668043,53773] 0 2024-04-18T04:58:02.411 INFO:tasks.workunit.client.0.smithi096.stdout:6/622: chown d0/d6/fb3 381493 1 2024-04-18T04:58:02.414 INFO:tasks.workunit.client.0.smithi096.stdout:6/623: creat d0/d6/d29/fb7 x:0 0 0 2024-04-18T04:58:02.416 INFO:tasks.workunit.client.0.smithi096.stdout:6/624: mknod d0/d6/d2b/d3b/d69/d6c/d85/cb8 0 2024-04-18T04:58:02.418 INFO:tasks.workunit.client.0.smithi096.stdout:9/380: dwrite d0/f4b [0,4194304] 0 2024-04-18T04:58:02.419 INFO:tasks.workunit.client.0.smithi096.stdout:9/381: truncate d0/d52/d5a/f85 447694 0 2024-04-18T04:58:02.420 INFO:tasks.workunit.client.0.smithi096.stdout:6/625: unlink d0/d6/d2b/f54 0 2024-04-18T04:58:02.420 INFO:tasks.workunit.client.0.smithi096.stdout:6/626: dread - d0/d73/f80 zero size 2024-04-18T04:58:02.432 INFO:tasks.workunit.client.0.smithi096.stdout:6/627: dwrite d0/d6/d2b/f4e [0,4194304] 0 2024-04-18T04:58:02.432 INFO:tasks.workunit.client.0.smithi096.stdout:6/628: chown d0/d6/c4 10 1 2024-04-18T04:58:02.440 INFO:tasks.workunit.client.0.smithi096.stdout:9/382: dwrite d0/d25/f3c [0,4194304] 0 2024-04-18T04:58:02.441 INFO:tasks.workunit.client.0.smithi096.stdout:6/629: getdents d0/d4a 0 2024-04-18T04:58:02.442 INFO:tasks.workunit.client.0.smithi096.stdout:9/383: chown d0/d25/l26 2804 1 2024-04-18T04:58:02.445 INFO:tasks.workunit.client.0.smithi096.stdout:9/384: creat d0/de/f86 x:0 0 0 2024-04-18T04:58:02.447 INFO:tasks.workunit.client.0.smithi096.stdout:6/630: rename d0/d6/d2b/d3b/d69/d6c/d85/l9b to d0/d6/d2b/d7e/lb9 0 2024-04-18T04:58:02.449 INFO:tasks.workunit.client.0.smithi096.stdout:9/385: rename d0/d25/l36 to d0/d52/l87 0 2024-04-18T04:58:02.450 INFO:tasks.workunit.client.0.smithi096.stdout:9/386: mknod d0/de/d17/d56/d59/c88 0 2024-04-18T04:58:02.454 INFO:tasks.workunit.client.0.smithi096.stdout:6/631: dwrite d0/d6/d2b/d3b/d69/d66/f79 [0,4194304] 0 2024-04-18T04:58:02.457 INFO:tasks.workunit.client.0.smithi096.stdout:6/632: creat d0/d6/d2b/d3b/d69/fba x:0 0 0 2024-04-18T04:58:02.460 INFO:tasks.workunit.client.0.smithi096.stdout:6/633: mkdir d0/d6/d2b/d3b/dbb 0 2024-04-18T04:58:02.461 INFO:tasks.workunit.client.0.smithi096.stdout:6/634: truncate d0/d73/f96 558574 0 2024-04-18T04:58:02.464 INFO:tasks.workunit.client.0.smithi096.stdout:6/635: creat d0/d6/d2b/d3b/d69/d66/fbc x:0 0 0 2024-04-18T04:58:02.467 INFO:tasks.workunit.client.0.smithi096.stdout:6/636: mknod d0/d6/cbd 0 2024-04-18T04:58:02.468 INFO:tasks.workunit.client.0.smithi096.stdout:6/637: chown d0/d6/d2b/d3b/d69/d6c/d85/fad 3785386 1 2024-04-18T04:58:02.470 INFO:tasks.workunit.client.0.smithi096.stdout:9/387: truncate d0/de/d17/d56/d59/d60/f77 1996242 0 2024-04-18T04:58:02.471 INFO:tasks.workunit.client.0.smithi096.stdout:9/388: write d0/de/d17/f23 [3261050,97786] 0 2024-04-18T04:58:02.472 INFO:tasks.workunit.client.0.smithi096.stdout:9/389: write d0/de/d17/d2f/f84 [198753,42105] 0 2024-04-18T04:58:02.472 INFO:tasks.workunit.client.0.smithi096.stdout:6/638: dread - d0/d6/d29/fb7 zero size 2024-04-18T04:58:02.473 INFO:tasks.workunit.client.0.smithi096.stdout:7/376: sync 2024-04-18T04:58:02.473 INFO:tasks.workunit.client.0.smithi096.stdout:8/342: sync 2024-04-18T04:58:02.473 INFO:tasks.workunit.client.0.smithi096.stdout:1/545: sync 2024-04-18T04:58:02.473 INFO:tasks.workunit.client.0.smithi096.stdout:0/389: sync 2024-04-18T04:58:02.473 INFO:tasks.workunit.client.0.smithi096.stdout:5/310: sync 2024-04-18T04:58:02.475 INFO:tasks.workunit.client.0.smithi096.stdout:1/546: write de/d1d/d32/f57 [528474,124847] 0 2024-04-18T04:58:02.476 INFO:tasks.workunit.client.0.smithi096.stdout:7/377: creat db/d1d/f75 x:0 0 0 2024-04-18T04:58:02.478 INFO:tasks.workunit.client.0.smithi096.stdout:0/390: write d16/d1c/d22/d2c/f68 [1652625,94885] 0 2024-04-18T04:58:02.481 INFO:tasks.workunit.client.0.smithi096.stdout:1/547: creat de/d1d/d32/d8c/fa8 x:0 0 0 2024-04-18T04:58:02.482 INFO:tasks.workunit.client.0.smithi096.stdout:6/639: getdents d0 0 2024-04-18T04:58:02.482 INFO:tasks.workunit.client.0.smithi096.stdout:1/548: readlink de/d1d/l5a 0 2024-04-18T04:58:02.484 INFO:tasks.workunit.client.0.smithi096.stdout:5/311: dwrite d7/d25/d2b/f45 [0,4194304] 0 2024-04-18T04:58:02.484 INFO:tasks.workunit.client.0.smithi096.stdout:1/549: chown de/d1d/d32/d8c/l9f 634460 1 2024-04-18T04:58:02.484 INFO:tasks.workunit.client.0.smithi096.stdout:7/378: rmdir db/d20/d45/d5e 0 2024-04-18T04:58:02.488 INFO:tasks.workunit.client.0.smithi096.stdout:5/312: unlink d7/dd/l60 0 2024-04-18T04:58:02.490 INFO:tasks.workunit.client.0.smithi096.stdout:7/379: symlink db/d1f/d39/d6d/l76 0 2024-04-18T04:58:02.493 INFO:tasks.workunit.client.0.smithi096.stdout:1/550: mkdir de/d1d/d3f/d4f/da9 0 2024-04-18T04:58:02.495 INFO:tasks.workunit.client.0.smithi096.stdout:6/640: dwrite d0/d6/d29/f7f [0,4194304] 0 2024-04-18T04:58:02.498 INFO:tasks.workunit.client.0.smithi096.stdout:1/551: symlink de/d1d/d32/d6f/laa 0 2024-04-18T04:58:02.501 INFO:tasks.workunit.client.0.smithi096.stdout:5/313: dwrite d7/d39/f70 [0,4194304] 0 2024-04-18T04:58:02.502 INFO:tasks.workunit.client.0.smithi096.stdout:8/343: truncate d0/d3/d32/f48 2650694 0 2024-04-18T04:58:02.508 INFO:tasks.workunit.client.0.smithi096.stdout:1/552: creat de/d1d/fab x:0 0 0 2024-04-18T04:58:02.508 INFO:tasks.workunit.client.0.smithi096.stdout:8/344: write d0/f55 [5160010,2987] 0 2024-04-18T04:58:02.509 INFO:tasks.workunit.client.0.smithi096.stdout:7/380: dwrite db/d20/d2f/f34 [0,4194304] 0 2024-04-18T04:58:02.509 INFO:tasks.workunit.client.0.smithi096.stdout:1/553: creat de/d1d/d32/d6f/d85/fac x:0 0 0 2024-04-18T04:58:02.511 INFO:tasks.workunit.client.0.smithi096.stdout:1/554: write de/d1d/d32/f46 [681047,27188] 0 2024-04-18T04:58:02.518 INFO:tasks.workunit.client.0.smithi096.stdout:6/641: link d0/d6/d2b/d3b/d69/c4f d0/d6/d2b/d3b/cbe 0 2024-04-18T04:58:02.521 INFO:tasks.workunit.client.0.smithi096.stdout:6/642: mknod d0/d6/d2b/d3b/d69/cbf 0 2024-04-18T04:58:02.522 INFO:tasks.workunit.client.0.smithi096.stdout:7/381: getdents db/d1f/d24 0 2024-04-18T04:58:02.522 INFO:tasks.workunit.client.0.smithi096.stdout:8/345: dread d0/d3/f5c [0,4194304] 0 2024-04-18T04:58:02.523 INFO:tasks.workunit.client.0.smithi096.stdout:8/346: chown d0/d7/d24/d35/f4a 92 1 2024-04-18T04:58:02.524 INFO:tasks.workunit.client.0.smithi096.stdout:1/555: getdents de/d7b 0 2024-04-18T04:58:02.524 INFO:tasks.workunit.client.0.smithi096.stdout:8/347: chown d0/d3/f6c 354598112 1 2024-04-18T04:58:02.525 INFO:tasks.workunit.client.0.smithi096.stdout:8/348: chown d0/f26 6099 1 2024-04-18T04:58:02.525 INFO:tasks.workunit.client.0.smithi096.stdout:7/382: fdatasync db/f3f 0 2024-04-18T04:58:02.526 INFO:tasks.workunit.client.0.smithi096.stdout:7/383: read db/d1f/f41 [953776,53380] 0 2024-04-18T04:58:02.529 INFO:tasks.workunit.client.0.smithi096.stdout:8/349: symlink d0/d7/d24/d18/d21/l6f 0 2024-04-18T04:58:02.530 INFO:tasks.workunit.client.0.smithi096.stdout:8/350: dread - d0/d3/f6c zero size 2024-04-18T04:58:02.530 INFO:tasks.workunit.client.0.smithi096.stdout:6/643: creat d0/d6/fc0 x:0 0 0 2024-04-18T04:58:02.531 INFO:tasks.workunit.client.0.smithi096.stdout:7/384: mkdir db/d1f/d24/d61/d77 0 2024-04-18T04:58:02.532 INFO:tasks.workunit.client.0.smithi096.stdout:7/385: chown db/d1f/d24/f56 11071 1 2024-04-18T04:58:02.533 INFO:tasks.workunit.client.0.smithi096.stdout:1/556: dwrite de/d1d/d3f/d4f/f7d [0,4194304] 0 2024-04-18T04:58:02.535 INFO:tasks.workunit.client.0.smithi096.stdout:8/351: unlink d0/d7/d24/d18/d27/d3c/f46 0 2024-04-18T04:58:02.537 INFO:tasks.workunit.client.0.smithi096.stdout:8/352: readlink d0/d7/d24/l62 0 2024-04-18T04:58:02.537 INFO:tasks.workunit.client.0.smithi096.stdout:7/386: creat db/d1f/d4e/f78 x:0 0 0 2024-04-18T04:58:02.539 INFO:tasks.workunit.client.0.smithi096.stdout:7/387: chown db/d1d/f47 31 1 2024-04-18T04:58:02.539 INFO:tasks.workunit.client.0.smithi096.stdout:8/353: truncate d0/f4d 769802 0 2024-04-18T04:58:02.540 INFO:tasks.workunit.client.0.smithi096.stdout:6/644: dwrite d0/d73/fa4 [0,4194304] 0 2024-04-18T04:58:02.541 INFO:tasks.workunit.client.0.smithi096.stdout:1/557: mkdir de/d1d/d32/d9a/dad 0 2024-04-18T04:58:02.542 INFO:tasks.workunit.client.0.smithi096.stdout:8/354: rmdir d0/d15 39 2024-04-18T04:58:02.543 INFO:tasks.workunit.client.0.smithi096.stdout:7/388: read db/d1f/d24/f56 [268728,3806] 0 2024-04-18T04:58:02.543 INFO:tasks.workunit.client.0.smithi096.stdout:8/355: write d0/d3/f3a [1977945,118885] 0 2024-04-18T04:58:02.545 INFO:tasks.workunit.client.0.smithi096.stdout:8/356: write d0/f4d [1468566,31155] 0 2024-04-18T04:58:02.546 INFO:tasks.workunit.client.0.smithi096.stdout:8/357: dread - d0/d7/d24/d35/f4a zero size 2024-04-18T04:58:02.549 INFO:tasks.workunit.client.0.smithi096.stdout:7/389: mkdir db/d1f/d39/d6d/d79 0 2024-04-18T04:58:02.551 INFO:tasks.workunit.client.0.smithi096.stdout:7/390: dread db/d1d/f4a [0,4194304] 0 2024-04-18T04:58:02.552 INFO:tasks.workunit.client.0.smithi096.stdout:1/558: link de/d1d/d32/f46 de/d1d/d81/da7/fae 0 2024-04-18T04:58:02.553 INFO:tasks.workunit.client.0.smithi096.stdout:8/358: chown d0/d15 178 1 2024-04-18T04:58:02.555 INFO:tasks.workunit.client.0.smithi096.stdout:6/645: dwrite d0/d6/d29/d83/f92 [0,4194304] 0 2024-04-18T04:58:02.556 INFO:tasks.workunit.client.0.smithi096.stdout:1/559: mknod de/d1d/d81/da7/caf 0 2024-04-18T04:58:02.557 INFO:tasks.workunit.client.0.smithi096.stdout:8/359: creat d0/d7/d24/d18/d27/d60/f70 x:0 0 0 2024-04-18T04:58:02.558 INFO:tasks.workunit.client.0.smithi096.stdout:6/646: chown d0/d6/d2e/f45 22 1 2024-04-18T04:58:02.563 INFO:tasks.workunit.client.0.smithi096.stdout:7/391: write db/d1d/f5a [17714,14478] 0 2024-04-18T04:58:02.564 INFO:tasks.workunit.client.0.smithi096.stdout:8/360: dwrite d0/d7/f2a [4194304,4194304] 0 2024-04-18T04:58:02.565 INFO:tasks.workunit.client.0.smithi096.stdout:6/647: getdents d0/d6/d2e 0 2024-04-18T04:58:02.566 INFO:tasks.workunit.client.0.smithi096.stdout:7/392: creat db/d1f/d4e/f7a x:0 0 0 2024-04-18T04:58:02.568 INFO:tasks.workunit.client.0.smithi096.stdout:8/361: mknod d0/d15/d65/c71 0 2024-04-18T04:58:02.571 INFO:tasks.workunit.client.0.smithi096.stdout:7/393: creat db/d1f/d24/f7b x:0 0 0 2024-04-18T04:58:02.571 INFO:tasks.workunit.client.0.smithi096.stdout:6/648: truncate d0/d6/d2e/d7a/fb4 625710 0 2024-04-18T04:58:02.572 INFO:tasks.workunit.client.0.smithi096.stdout:8/362: creat d0/d3/d32/f72 x:0 0 0 2024-04-18T04:58:02.574 INFO:tasks.workunit.client.0.smithi096.stdout:8/363: stat d0/d15/d65 0 2024-04-18T04:58:02.574 INFO:tasks.workunit.client.0.smithi096.stdout:1/560: dwrite de/d1d/f4a [0,4194304] 0 2024-04-18T04:58:02.577 INFO:tasks.workunit.client.0.smithi096.stdout:1/561: mknod de/d1d/d3f/d7a/cb0 0 2024-04-18T04:58:02.580 INFO:tasks.workunit.client.0.smithi096.stdout:6/649: link d0/d6/d5d/f70 d0/d6/d2b/d7e/fc1 0 2024-04-18T04:58:02.583 INFO:tasks.workunit.client.0.smithi096.stdout:1/562: symlink de/d1d/d32/d6f/d85/lb1 0 2024-04-18T04:58:02.584 INFO:tasks.workunit.client.0.smithi096.stdout:1/563: truncate de/d1d/d32/d6f/d85/fa3 677451 0 2024-04-18T04:58:02.588 INFO:tasks.workunit.client.0.smithi096.stdout:8/364: truncate d0/d7/d24/d18/f23 1239916 0 2024-04-18T04:58:02.591 INFO:tasks.workunit.client.0.smithi096.stdout:6/650: mknod d0/d6/d2b/cc2 0 2024-04-18T04:58:02.594 INFO:tasks.workunit.client.0.smithi096.stdout:1/564: readlink de/d1d/d32/d73/d8b/l90 0 2024-04-18T04:58:02.594 INFO:tasks.workunit.client.0.smithi096.stdout:8/365: dread d0/d7/f2b [0,4194304] 0 2024-04-18T04:58:02.596 INFO:tasks.workunit.client.0.smithi096.stdout:7/394: creat db/d1f/d24/f7c x:0 0 0 2024-04-18T04:58:02.598 INFO:tasks.workunit.client.0.smithi096.stdout:8/366: creat d0/d7/f73 x:0 0 0 2024-04-18T04:58:02.599 INFO:tasks.workunit.client.0.smithi096.stdout:8/367: chown d0/d7/d24/d18/l53 695192 1 2024-04-18T04:58:02.599 INFO:tasks.workunit.client.0.smithi096.stdout:6/651: link d0/ca d0/d6/d2e/cc3 0 2024-04-18T04:58:02.600 INFO:tasks.workunit.client.0.smithi096.stdout:6/652: chown d0/d6/f20 23 1 2024-04-18T04:58:02.600 INFO:tasks.workunit.client.0.smithi096.stdout:8/368: stat d0/d7/d24/d18/d27/d3c 0 2024-04-18T04:58:02.601 INFO:tasks.workunit.client.0.smithi096.stdout:7/395: creat db/d1f/f7d x:0 0 0 2024-04-18T04:58:02.604 INFO:tasks.workunit.client.0.smithi096.stdout:6/653: mknod d0/d6/d2b/cc4 0 2024-04-18T04:58:02.605 INFO:tasks.workunit.client.0.smithi096.stdout:7/396: symlink db/d1f/d24/l7e 0 2024-04-18T04:58:02.609 INFO:tasks.workunit.client.0.smithi096.stdout:7/397: rename db/f22 to db/f7f 0 2024-04-18T04:58:02.610 INFO:tasks.workunit.client.0.smithi096.stdout:2/619: sync 2024-04-18T04:58:02.610 INFO:tasks.workunit.client.0.smithi096.stdout:4/441: sync 2024-04-18T04:58:02.610 INFO:tasks.workunit.client.0.smithi096.stdout:6/654: dwrite d0/da0/fae [0,4194304] 0 2024-04-18T04:58:02.611 INFO:tasks.workunit.client.0.smithi096.stdout:6/655: fdatasync d0/d73/f80 0 2024-04-18T04:58:02.611 INFO:tasks.workunit.client.0.smithi096.stdout:2/620: fsync df/d18/d26/f84 0 2024-04-18T04:58:02.612 INFO:tasks.workunit.client.0.smithi096.stdout:2/621: write df/f65 [803361,38640] 0 2024-04-18T04:58:02.615 INFO:tasks.workunit.client.0.smithi096.stdout:2/622: chown df/d18/d24/d42/d6e/c80 455794 1 2024-04-18T04:58:02.616 INFO:tasks.workunit.client.0.smithi096.stdout:6/656: mknod d0/d6/d2b/cc5 0 2024-04-18T04:58:02.618 INFO:tasks.workunit.client.0.smithi096.stdout:6/657: fsync d0/d6/d2b/f4e 0 2024-04-18T04:58:02.619 INFO:tasks.workunit.client.0.smithi096.stdout:4/442: dwrite d4/d14/d1d/f27 [0,4194304] 0 2024-04-18T04:58:02.620 INFO:tasks.workunit.client.0.smithi096.stdout:4/443: truncate d4/f43 1003512 0 2024-04-18T04:58:02.628 INFO:tasks.workunit.client.0.smithi096.stdout:2/623: dwrite df/d18/d71/d9c/fa7 [0,4194304] 0 2024-04-18T04:58:02.630 INFO:tasks.workunit.client.0.smithi096.stdout:4/444: rename d4/d14/d2d/d44/d58/d86/c45 to d4/d14/d2d/d44/d55/d67/c8d 0 2024-04-18T04:58:02.632 INFO:tasks.workunit.client.0.smithi096.stdout:2/624: fsync df/d18/d26/f29 0 2024-04-18T04:58:02.632 INFO:tasks.workunit.client.0.smithi096.stdout:7/398: dread - db/d1f/d4e/f78 zero size 2024-04-18T04:58:02.632 INFO:tasks.workunit.client.0.smithi096.stdout:6/658: dwrite d0/d6/f37 [4194304,4194304] 0 2024-04-18T04:58:02.633 INFO:tasks.workunit.client.0.smithi096.stdout:2/625: chown df/d18/d24/l7e 234995330 1 2024-04-18T04:58:02.633 INFO:tasks.workunit.client.0.smithi096.stdout:6/659: write d0/d6/d2b/f5c [1679197,110603] 0 2024-04-18T04:58:02.637 INFO:tasks.workunit.client.0.smithi096.stdout:2/626: mknod df/d7a/cca 0 2024-04-18T04:58:02.642 INFO:tasks.workunit.client.0.smithi096.stdout:2/627: symlink df/d18/d24/lcb 0 2024-04-18T04:58:02.645 INFO:tasks.workunit.client.0.smithi096.stdout:2/628: write df/d18/d26/f83 [1083414,108242] 0 2024-04-18T04:58:02.645 INFO:tasks.workunit.client.0.smithi096.stdout:4/445: dwrite d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/f74 [0,4194304] 0 2024-04-18T04:58:02.648 INFO:tasks.workunit.client.0.smithi096.stdout:7/399: truncate db/f48 2729102 0 2024-04-18T04:58:02.650 INFO:tasks.workunit.client.0.smithi096.stdout:6/660: link d0/d6/d2b/d3b/d69/d66/l88 d0/d6/d2e/d7a/lc6 0 2024-04-18T04:58:02.652 INFO:tasks.workunit.client.0.smithi096.stdout:6/661: getdents d0/d4a 0 2024-04-18T04:58:02.653 INFO:tasks.workunit.client.0.smithi096.stdout:7/400: getdents db/d1f/d24/d61/d77 0 2024-04-18T04:58:02.655 INFO:tasks.workunit.client.0.smithi096.stdout:6/662: mknod d0/d6/d29/cc7 0 2024-04-18T04:58:02.655 INFO:tasks.workunit.client.0.smithi096.stdout:7/401: creat db/d1f/d24/d61/f80 x:0 0 0 2024-04-18T04:58:02.658 INFO:tasks.workunit.client.0.smithi096.stdout:6/663: rmdir d0/d6/d2b 39 2024-04-18T04:58:02.663 INFO:tasks.workunit.client.0.smithi096.stdout:7/402: dread db/d20/f35 [0,4194304] 0 2024-04-18T04:58:02.663 INFO:tasks.workunit.client.0.smithi096.stdout:6/664: truncate d0/d6/d2b/d3b/d69/d6c/d85/f9f 567341 0 2024-04-18T04:58:02.665 INFO:tasks.workunit.client.0.smithi096.stdout:2/629: dread df/d18/d26/d48/f78 [0,4194304] 0 2024-04-18T04:58:02.666 INFO:tasks.workunit.client.0.smithi096.stdout:4/446: dwrite d4/f19 [0,4194304] 0 2024-04-18T04:58:02.667 INFO:tasks.workunit.client.0.smithi096.stdout:6/665: write d0/d6/f1d [4452890,115453] 0 2024-04-18T04:58:02.667 INFO:tasks.workunit.client.0.smithi096.stdout:7/403: unlink db/d1f/d24/f3b 0 2024-04-18T04:58:02.667 INFO:tasks.workunit.client.0.smithi096.stdout:4/447: chown d4/d14/d2d 2583500 1 2024-04-18T04:58:02.670 INFO:tasks.workunit.client.0.smithi096.stdout:7/404: chown db/f31 89 1 2024-04-18T04:58:02.672 INFO:tasks.workunit.client.0.smithi096.stdout:4/448: creat d4/d14/d2d/d44/d89/f8e x:0 0 0 2024-04-18T04:58:02.676 INFO:tasks.workunit.client.0.smithi096.stdout:2/630: dwrite df/d18/fc7 [0,4194304] 0 2024-04-18T04:58:02.677 INFO:tasks.workunit.client.0.smithi096.stdout:7/405: creat db/d1f/d5b/d6a/d74/f81 x:0 0 0 2024-04-18T04:58:02.680 INFO:tasks.workunit.client.0.smithi096.stdout:7/406: unlink c2 0 2024-04-18T04:58:02.682 INFO:tasks.workunit.client.0.smithi096.stdout:7/407: write db/f2a [778147,30498] 0 2024-04-18T04:58:02.683 INFO:tasks.workunit.client.0.smithi096.stdout:7/408: dread - db/d1f/d24/d61/f80 zero size 2024-04-18T04:58:02.684 INFO:tasks.workunit.client.0.smithi096.stdout:2/631: link df/f63 df/d7a/fcc 0 2024-04-18T04:58:02.685 INFO:tasks.workunit.client.0.smithi096.stdout:6/666: dread d0/d6/f15 [4194304,4194304] 0 2024-04-18T04:58:02.688 INFO:tasks.workunit.client.0.smithi096.stdout:6/667: write d0/d6/d29/d83/f92 [1140435,115792] 0 2024-04-18T04:58:02.688 INFO:tasks.workunit.client.0.smithi096.stdout:2/632: unlink df/d18/d26/f36 0 2024-04-18T04:58:02.689 INFO:tasks.workunit.client.0.smithi096.stdout:7/409: mkdir db/d1d/d82 0 2024-04-18T04:58:02.690 INFO:tasks.workunit.client.0.smithi096.stdout:2/633: creat df/d7d/fcd x:0 0 0 2024-04-18T04:58:02.691 INFO:tasks.workunit.client.0.smithi096.stdout:7/410: truncate db/d1f/f41 498357 0 2024-04-18T04:58:02.693 INFO:tasks.workunit.client.0.smithi096.stdout:6/668: mknod d0/d6/d2b/cc8 0 2024-04-18T04:58:02.695 INFO:tasks.workunit.client.0.smithi096.stdout:4/449: dread d4/d14/d16/f3f [0,4194304] 0 2024-04-18T04:58:02.697 INFO:tasks.workunit.client.0.smithi096.stdout:6/669: mkdir d0/d6/d2b/d3b/dc9 0 2024-04-18T04:58:02.705 INFO:tasks.workunit.client.0.smithi096.stdout:6/670: dwrite d0/d6/fc0 [0,4194304] 0 2024-04-18T04:58:02.706 INFO:tasks.workunit.client.0.smithi096.stdout:6/671: fsync d0/d6/d2b/f4e 0 2024-04-18T04:58:02.707 INFO:tasks.workunit.client.0.smithi096.stdout:6/672: write d0/d6/d2b/d3b/d7d/f8c [986740,44193] 0 2024-04-18T04:58:02.711 INFO:tasks.workunit.client.0.smithi096.stdout:7/411: dread db/f7f [0,4194304] 0 2024-04-18T04:58:02.713 INFO:tasks.workunit.client.0.smithi096.stdout:7/412: mkdir db/d1f/d39/d6d/d79/d83 0 2024-04-18T04:58:02.716 INFO:tasks.workunit.client.0.smithi096.stdout:6/673: dwrite d0/d6/d2b/d3b/f41 [4194304,4194304] 0 2024-04-18T04:58:02.719 INFO:tasks.workunit.client.0.smithi096.stdout:6/674: unlink d0/d6/d2b/d3b/d7d/l87 0 2024-04-18T04:58:02.722 INFO:tasks.workunit.client.0.smithi096.stdout:7/413: dwrite db/f48 [0,4194304] 0 2024-04-18T04:58:02.725 INFO:tasks.workunit.client.0.smithi096.stdout:7/414: creat db/d1f/d24/d61/f84 x:0 0 0 2024-04-18T04:58:02.727 INFO:tasks.workunit.client.0.smithi096.stdout:7/415: truncate fa 1427541 0 2024-04-18T04:58:02.730 INFO:tasks.workunit.client.0.smithi096.stdout:7/416: creat db/d1f/d39/d6d/d79/d83/f85 x:0 0 0 2024-04-18T04:58:02.731 INFO:tasks.workunit.client.0.smithi096.stdout:6/675: dwrite d0/d6/d2b/d3b/d69/f71 [0,4194304] 0 2024-04-18T04:58:02.732 INFO:tasks.workunit.client.0.smithi096.stdout:6/676: fdatasync d0/d6/d29/f7f 0 2024-04-18T04:58:02.735 INFO:tasks.workunit.client.0.smithi096.stdout:6/677: write d0/d6/d2b/d3b/d69/d66/fbc [671183,71214] 0 2024-04-18T04:58:02.740 INFO:tasks.workunit.client.0.smithi096.stdout:6/678: getdents d0/d6/d2b/d3b/dbb 0 2024-04-18T04:58:02.741 INFO:tasks.workunit.client.0.smithi096.stdout:6/679: chown d0/d6/d2b/d3b/d69/d66 20052 1 2024-04-18T04:58:02.745 INFO:tasks.workunit.client.0.smithi096.stdout:7/417: dread db/ff [0,4194304] 0 2024-04-18T04:58:02.746 INFO:tasks.workunit.client.0.smithi096.stdout:6/680: truncate d0/d6/d29/f7f 3641299 0 2024-04-18T04:58:02.749 INFO:tasks.workunit.client.0.smithi096.stdout:7/418: creat db/d1f/d24/d49/f86 x:0 0 0 2024-04-18T04:58:02.751 INFO:tasks.workunit.client.0.smithi096.stdout:7/419: symlink db/d20/l87 0 2024-04-18T04:58:02.752 INFO:tasks.workunit.client.0.smithi096.stdout:7/420: chown db/d1f/d24/d49/d54/c57 4701229 1 2024-04-18T04:58:02.756 INFO:tasks.workunit.client.0.smithi096.stdout:7/421: rename db/d1f/d24/d61/c68 to db/d1f/d39/d6d/d79/c88 0 2024-04-18T04:58:02.757 INFO:tasks.workunit.client.0.smithi096.stdout:7/422: write db/f2a [332395,129700] 0 2024-04-18T04:58:02.760 INFO:tasks.workunit.client.0.smithi096.stdout:7/423: creat db/d1f/d5b/f89 x:0 0 0 2024-04-18T04:58:02.762 INFO:tasks.workunit.client.0.smithi096.stdout:7/424: mknod db/d1f/d39/d6d/c8a 0 2024-04-18T04:58:02.764 INFO:tasks.workunit.client.0.smithi096.stdout:7/425: fsync db/d1f/d24/f70 0 2024-04-18T04:58:02.771 INFO:tasks.workunit.client.0.smithi096.stdout:7/426: dwrite db/f11 [4194304,4194304] 0 2024-04-18T04:58:02.776 INFO:tasks.workunit.client.0.smithi096.stdout:7/427: rename db/d1f/d24/f7b to db/d1f/d5b/d6a/f8b 0 2024-04-18T04:58:02.803 INFO:tasks.workunit.client.0.smithi096.stdout:3/559: sync 2024-04-18T04:58:02.807 INFO:tasks.workunit.client.0.smithi096.stdout:3/560: mknod dc/d26/d4a/d6b/cb5 0 2024-04-18T04:58:02.819 INFO:tasks.workunit.client.0.smithi096.stdout:3/561: dread dc/d26/d66/fb3 [0,4194304] 0 2024-04-18T04:58:02.827 INFO:tasks.workunit.client.0.smithi096.stdout:3/562: getdents dc/d26 0 2024-04-18T04:58:02.832 INFO:tasks.workunit.client.0.smithi096.stdout:3/563: creat dc/d26/d76/d29/d7e/fb6 x:0 0 0 2024-04-18T04:58:02.837 INFO:tasks.workunit.client.0.smithi096.stdout:3/564: mknod dc/d26/d76/d29/d7e/cb7 0 2024-04-18T04:58:02.845 INFO:tasks.workunit.client.0.smithi096.stdout:3/565: creat dc/d26/d4a/d6b/d93/fb8 x:0 0 0 2024-04-18T04:58:02.848 INFO:tasks.workunit.client.0.smithi096.stdout:3/566: creat dc/d26/d4a/d6b/d93/fb9 x:0 0 0 2024-04-18T04:58:02.850 INFO:tasks.workunit.client.0.smithi096.stdout:3/567: creat dc/d26/d4a/d6b/fba x:0 0 0 2024-04-18T04:58:02.860 INFO:tasks.workunit.client.0.smithi096.stdout:3/568: getdents dc/d26/d4a/d6b/d93 0 2024-04-18T04:58:02.861 INFO:tasks.workunit.client.0.smithi096.stdout:3/569: chown dc/d26/d76/l81 1 1 2024-04-18T04:58:02.862 INFO:tasks.workunit.client.0.smithi096.stdout:3/570: truncate dc/d26/d76/f63 821888 0 2024-04-18T04:58:02.863 INFO:tasks.workunit.client.0.smithi096.stdout:3/571: write dc/d26/f72 [361718,53015] 0 2024-04-18T04:58:02.864 INFO:tasks.workunit.client.0.smithi096.stdout:3/572: write dc/d26/d76/d29/d7e/fb6 [701834,28408] 0 2024-04-18T04:58:02.869 INFO:tasks.workunit.client.0.smithi096.stdout:3/573: link dc/d26/f72 dc/d5d/fbb 0 2024-04-18T04:58:02.874 INFO:tasks.workunit.client.0.smithi096.stdout:3/574: symlink dc/d26/d4a/d6b/d93/lbc 0 2024-04-18T04:58:02.884 INFO:tasks.workunit.client.0.smithi096.stdout:3/575: truncate dc/d26/d4a/f65 1815320 0 2024-04-18T04:58:02.888 INFO:tasks.workunit.client.0.smithi096.stdout:3/576: unlink dc/fe 0 2024-04-18T04:58:02.889 INFO:tasks.workunit.client.0.smithi096.stdout:3/577: fsync dc/d26/d4a/faa 0 2024-04-18T04:58:02.889 INFO:tasks.workunit.client.0.smithi096.stdout:3/578: chown dc/d26/d76/d29/c47 696702 1 2024-04-18T04:58:02.892 INFO:tasks.workunit.client.0.smithi096.stdout:3/579: mkdir dc/d26/d48/dbd 0 2024-04-18T04:58:02.893 INFO:tasks.workunit.client.0.smithi096.stdout:3/580: chown dc/d26/l59 125 1 2024-04-18T04:58:02.893 INFO:tasks.workunit.client.0.smithi096.stdout:3/581: dread - dc/d26/d76/fad zero size 2024-04-18T04:58:02.895 INFO:tasks.workunit.client.0.smithi096.stdout:3/582: write dc/d26/d76/f3e [4259548,112858] 0 2024-04-18T04:58:02.896 INFO:tasks.workunit.client.0.smithi096.stdout:3/583: write dc/d26/d76/f3e [2151104,70182] 0 2024-04-18T04:58:02.908 INFO:tasks.workunit.client.0.smithi096.stdout:3/584: dread dc/d26/d4a/f58 [0,4194304] 0 2024-04-18T04:58:02.912 INFO:tasks.workunit.client.0.smithi096.stdout:3/585: getdents dc/d26/d76/d95/da3 0 2024-04-18T04:58:02.917 INFO:tasks.workunit.client.0.smithi096.stdout:3/586: link dc/d26/d76/d29/f6f dc/d26/d66/d7f/fbe 0 2024-04-18T04:58:02.923 INFO:tasks.workunit.client.0.smithi096.stdout:3/587: dwrite dc/d26/d57/fa0 [0,4194304] 0 2024-04-18T04:58:02.924 INFO:tasks.workunit.client.0.smithi096.stdout:3/588: read dc/d26/d4a/f58 [3072696,126064] 0 2024-04-18T04:58:02.924 INFO:tasks.workunit.client.0.smithi096.stdout:3/589: dread - dc/d26/d66/faf zero size 2024-04-18T04:58:02.925 INFO:tasks.workunit.client.0.smithi096.stdout:3/590: fsync dc/d5d/f9f 0 2024-04-18T04:58:02.976 INFO:tasks.workunit.client.0.smithi096.stdout:9/390: sync 2024-04-18T04:58:02.996 INFO:tasks.workunit.client.0.smithi096.stdout:3/591: link dc/d26/d76/d29/d7e/lb4 dc/d26/d76/d29/d62/lbf 0 2024-04-18T04:58:03.044 INFO:tasks.workunit.client.0.smithi096.stdout:9/391: dwrite d0/de/d17/d56/d59/d60/f77 [0,4194304] 0 2024-04-18T04:58:03.046 INFO:tasks.workunit.client.0.smithi096.stdout:9/392: chown d0/d25/d33 15 1 2024-04-18T04:58:03.047 INFO:tasks.workunit.client.0.smithi096.stdout:9/393: readlink d0/d41/l80 0 2024-04-18T04:58:03.052 INFO:tasks.workunit.client.0.smithi096.stdout:9/394: mkdir d0/d6b/d89 0 2024-04-18T04:58:03.053 INFO:tasks.workunit.client.0.smithi096.stdout:9/395: chown d0 77 1 2024-04-18T04:58:03.053 INFO:tasks.workunit.client.0.smithi096.stdout:3/592: dread dc/d26/d76/d29/f6f [0,4194304] 0 2024-04-18T04:58:03.056 INFO:tasks.workunit.client.0.smithi096.stdout:9/396: write d0/de/f1c [4079368,113537] 0 2024-04-18T04:58:03.059 INFO:tasks.workunit.client.0.smithi096.stdout:3/593: mknod dc/d26/d48/dae/cc0 0 2024-04-18T04:58:03.063 INFO:tasks.workunit.client.0.smithi096.stdout:9/397: creat d0/de/d17/d56/d59/d60/f8a x:0 0 0 2024-04-18T04:58:03.065 INFO:tasks.workunit.client.0.smithi096.stdout:3/594: creat dc/d26/d76/d29/d62/fc1 x:0 0 0 2024-04-18T04:58:03.069 INFO:tasks.workunit.client.0.smithi096.stdout:3/595: truncate dc/fa9 223320 0 2024-04-18T04:58:03.072 INFO:tasks.workunit.client.0.smithi096.stdout:3/596: fsync dc/d26/d76/f33 0 2024-04-18T04:58:03.073 INFO:tasks.workunit.client.0.smithi096.stdout:0/391: sync 2024-04-18T04:58:03.073 INFO:tasks.workunit.client.0.smithi096.stdout:5/314: sync 2024-04-18T04:58:03.075 INFO:tasks.workunit.client.0.smithi096.stdout:3/597: fdatasync dc/d26/d66/faf 0 2024-04-18T04:58:03.078 INFO:tasks.workunit.client.0.smithi096.stdout:5/315: creat d7/d12/d5e/f79 x:0 0 0 2024-04-18T04:58:03.081 INFO:tasks.workunit.client.0.smithi096.stdout:0/392: mkdir d16/d78 0 2024-04-18T04:58:03.096 INFO:tasks.workunit.client.0.smithi096.stdout:9/398: dread d0/d52/d5a/f69 [0,4194304] 0 2024-04-18T04:58:03.098 INFO:tasks.workunit.client.0.smithi096.stdout:5/316: dwrite d7/f46 [0,4194304] 0 2024-04-18T04:58:03.103 INFO:tasks.workunit.client.0.smithi096.stdout:9/399: mkdir d0/de/d17/d2f/d40/d8b 0 2024-04-18T04:58:03.105 INFO:tasks.workunit.client.0.smithi096.stdout:3/598: dwrite dc/d26/f72 [0,4194304] 0 2024-04-18T04:58:03.105 INFO:tasks.workunit.client.0.smithi096.stdout:5/317: mknod d7/d25/d2b/c7a 0 2024-04-18T04:58:03.116 INFO:tasks.workunit.client.0.smithi096.stdout:3/599: rename dc/d26/d76 to dc/d26/d48/dc2 0 2024-04-18T04:58:03.120 INFO:tasks.workunit.client.0.smithi096.stdout:3/600: write dc/f42 [1030428,79207] 0 2024-04-18T04:58:03.121 INFO:tasks.workunit.client.0.smithi096.stdout:5/318: write d7/d25/f28 [585841,33055] 0 2024-04-18T04:58:03.123 INFO:tasks.workunit.client.0.smithi096.stdout:5/319: chown d7/f46 0 1 2024-04-18T04:58:03.125 INFO:tasks.workunit.client.0.smithi096.stdout:9/400: dwrite d0/de/d17/d2f/f42 [0,4194304] 0 2024-04-18T04:58:03.126 INFO:tasks.workunit.client.0.smithi096.stdout:9/401: chown d0/d25/f3c 106630156 1 2024-04-18T04:58:03.127 INFO:tasks.workunit.client.0.smithi096.stdout:9/402: stat d0/d25/d3a/c71 0 2024-04-18T04:58:03.131 INFO:tasks.workunit.client.0.smithi096.stdout:5/320: creat d7/d12/d5e/f7b x:0 0 0 2024-04-18T04:58:03.137 INFO:tasks.workunit.client.0.smithi096.stdout:5/321: mkdir d7/d25/d7c 0 2024-04-18T04:58:03.144 INFO:tasks.workunit.client.0.smithi096.stdout:3/601: rename dc/d26/d48/dc2/d8d/cac to dc/d26/d48/dc2/d29/d7e/cc3 0 2024-04-18T04:58:03.145 INFO:tasks.workunit.client.0.smithi096.stdout:9/403: dread d0/de/d17/f3f [0,4194304] 0 2024-04-18T04:58:03.149 INFO:tasks.workunit.client.0.smithi096.stdout:5/322: rename d7/d25/d2b/c7a to d7/d25/d58/c7d 0 2024-04-18T04:58:03.154 INFO:tasks.workunit.client.0.smithi096.stdout:1/565: sync 2024-04-18T04:58:03.158 INFO:tasks.workunit.client.0.smithi096.stdout:3/602: unlink dc/d26/c49 0 2024-04-18T04:58:03.162 INFO:tasks.workunit.client.0.smithi096.stdout:9/404: fsync d0/de/d17/f57 0 2024-04-18T04:58:03.163 INFO:tasks.workunit.client.0.smithi096.stdout:5/323: symlink d7/dd/d35/d74/l7e 0 2024-04-18T04:58:03.168 INFO:tasks.workunit.client.0.smithi096.stdout:9/405: dwrite d0/d52/d5a/f69 [0,4194304] 0 2024-04-18T04:58:03.169 INFO:tasks.workunit.client.0.smithi096.stdout:1/566: rename de/d1d/d3f/f4d to de/d1d/d3f/d9b/fb2 0 2024-04-18T04:58:03.172 INFO:tasks.workunit.client.0.smithi096.stdout:3/603: chown dc/d26/d48/dc2/f63 25 1 2024-04-18T04:58:03.178 INFO:tasks.workunit.client.0.smithi096.stdout:5/324: dwrite d7/d12/f1f [0,4194304] 0 2024-04-18T04:58:03.181 INFO:tasks.workunit.client.0.smithi096.stdout:5/325: write d7/d25/d30/f3a [3829045,130776] 0 2024-04-18T04:58:03.183 INFO:tasks.workunit.client.0.smithi096.stdout:9/406: stat d0/de/d17/c14 0 2024-04-18T04:58:03.188 INFO:tasks.workunit.client.0.smithi096.stdout:9/407: rmdir d0/de/d17/d56/d59/d68 39 2024-04-18T04:58:03.189 INFO:tasks.workunit.client.0.smithi096.stdout:9/408: fdatasync d0/de/d17/d2f/d40/f61 0 2024-04-18T04:58:03.191 INFO:tasks.workunit.client.0.smithi096.stdout:3/604: creat dc/d26/fc4 x:0 0 0 2024-04-18T04:58:03.194 INFO:tasks.workunit.client.0.smithi096.stdout:3/605: dread - dc/d26/d66/faf zero size 2024-04-18T04:58:03.197 INFO:tasks.workunit.client.0.smithi096.stdout:9/409: rename d0/d25/d3a/l55 to d0/de/d17/d2f/d40/l8c 0 2024-04-18T04:58:03.198 INFO:tasks.workunit.client.0.smithi096.stdout:5/326: write d7/d39/f29 [3665755,24883] 0 2024-04-18T04:58:03.200 INFO:tasks.workunit.client.0.smithi096.stdout:3/606: mknod dc/cc5 0 2024-04-18T04:58:03.205 INFO:tasks.workunit.client.0.smithi096.stdout:3/607: creat dc/d26/d4a/fc6 x:0 0 0 2024-04-18T04:58:03.205 INFO:tasks.workunit.client.0.smithi096.stdout:9/410: dread d0/f4b [0,4194304] 0 2024-04-18T04:58:03.206 INFO:tasks.workunit.client.0.smithi096.stdout:5/327: dread d7/f1a [0,4194304] 0 2024-04-18T04:58:03.206 INFO:tasks.workunit.client.0.smithi096.stdout:3/608: chown dc/d26/d4a/c8e 606209900 1 2024-04-18T04:58:03.208 INFO:tasks.workunit.client.0.smithi096.stdout:9/411: mknod d0/de/d17/d2f/d40/c8d 0 2024-04-18T04:58:03.212 INFO:tasks.workunit.client.0.smithi096.stdout:3/609: creat dc/d26/d57/fc7 x:0 0 0 2024-04-18T04:58:03.213 INFO:tasks.workunit.client.0.smithi096.stdout:3/610: chown dc/d26/fc4 2230501 1 2024-04-18T04:58:03.214 INFO:tasks.workunit.client.0.smithi096.stdout:9/412: rename d0/de/f16 to d0/de/d17/d56/d59/d68/f8e 0 2024-04-18T04:58:03.215 INFO:tasks.workunit.client.0.smithi096.stdout:5/328: dwrite d7/fe [0,4194304] 0 2024-04-18T04:58:03.216 INFO:tasks.workunit.client.0.smithi096.stdout:3/611: readlink dc/d26/d48/dc2/d29/d7e/lb4 0 2024-04-18T04:58:03.219 INFO:tasks.workunit.client.0.smithi096.stdout:5/329: creat d7/d3b/f7f x:0 0 0 2024-04-18T04:58:03.220 INFO:tasks.workunit.client.0.smithi096.stdout:5/330: dread - d7/dd/d35/f51 zero size 2024-04-18T04:58:03.224 INFO:tasks.workunit.client.0.smithi096.stdout:3/612: creat dc/d26/d48/dc2/d95/da3/fc8 x:0 0 0 2024-04-18T04:58:03.229 INFO:tasks.workunit.client.0.smithi096.stdout:5/331: dwrite d7/d39/f20 [4194304,4194304] 0 2024-04-18T04:58:03.230 INFO:tasks.workunit.client.0.smithi096.stdout:3/613: unlink dc/d26/d48/dc2/l52 0 2024-04-18T04:58:03.232 INFO:tasks.workunit.client.0.smithi096.stdout:3/614: write dc/d26/d57/f7a [1313492,99232] 0 2024-04-18T04:58:03.232 INFO:tasks.workunit.client.0.smithi096.stdout:5/332: unlink d7/d12/c3e 0 2024-04-18T04:58:03.235 INFO:tasks.workunit.client.0.smithi096.stdout:9/413: truncate d0/de/d17/d2f/f42 3974457 0 2024-04-18T04:58:03.236 INFO:tasks.workunit.client.0.smithi096.stdout:5/333: mknod d7/d25/d58/c80 0 2024-04-18T04:58:03.236 INFO:tasks.workunit.client.0.smithi096.stdout:9/414: write d0/de/d17/d56/f6a [3767929,6405] 0 2024-04-18T04:58:03.237 INFO:tasks.workunit.client.0.smithi096.stdout:3/615: creat dc/d70/fc9 x:0 0 0 2024-04-18T04:58:03.238 INFO:tasks.workunit.client.0.smithi096.stdout:5/334: chown d7/d39/d36/l67 3659 1 2024-04-18T04:58:03.240 INFO:tasks.workunit.client.0.smithi096.stdout:9/415: write d0/f4b [5073179,92578] 0 2024-04-18T04:58:03.243 INFO:tasks.workunit.client.0.smithi096.stdout:5/335: creat d7/dd/d35/d74/f81 x:0 0 0 2024-04-18T04:58:03.247 INFO:tasks.workunit.client.0.smithi096.stdout:9/416: dread d0/f4b [4194304,4194304] 0 2024-04-18T04:58:03.247 INFO:tasks.workunit.client.0.smithi096.stdout:5/336: creat d7/d3b/f82 x:0 0 0 2024-04-18T04:58:03.250 INFO:tasks.workunit.client.0.smithi096.stdout:3/616: link dc/d26/d4a/f91 dc/d26/d48/dc2/d29/fca 0 2024-04-18T04:58:03.251 INFO:tasks.workunit.client.0.smithi096.stdout:9/417: creat d0/d25/d3a/f8f x:0 0 0 2024-04-18T04:58:03.251 INFO:tasks.workunit.client.0.smithi096.stdout:9/418: fsync d0/de/f2d 0 2024-04-18T04:58:03.252 INFO:tasks.workunit.client.0.smithi096.stdout:5/337: creat d7/d39/d56/f83 x:0 0 0 2024-04-18T04:58:03.253 INFO:tasks.workunit.client.0.smithi096.stdout:3/617: creat dc/d26/d66/d7f/fcb x:0 0 0 2024-04-18T04:58:03.255 INFO:tasks.workunit.client.0.smithi096.stdout:9/419: mknod d0/d25/d33/c90 0 2024-04-18T04:58:03.256 INFO:tasks.workunit.client.0.smithi096.stdout:5/338: rename d7/f42 to d7/d39/d78/f84 0 2024-04-18T04:58:03.258 INFO:tasks.workunit.client.0.smithi096.stdout:9/420: symlink d0/d25/d3a/l91 0 2024-04-18T04:58:03.260 INFO:tasks.workunit.client.0.smithi096.stdout:5/339: rename d7/d39/d36/c5d to d7/d39/d36/c85 0 2024-04-18T04:58:03.261 INFO:tasks.workunit.client.0.smithi096.stdout:9/421: creat d0/de/f92 x:0 0 0 2024-04-18T04:58:03.262 INFO:tasks.workunit.client.0.smithi096.stdout:9/422: chown d0/de/d17/f2a 3176 1 2024-04-18T04:58:03.263 INFO:tasks.workunit.client.0.smithi096.stdout:3/618: rename dc/f45 to dc/d26/d48/dae/fcc 0 2024-04-18T04:58:03.264 INFO:tasks.workunit.client.0.smithi096.stdout:3/619: stat dc/d26/d48/dc2/fab 0 2024-04-18T04:58:03.265 INFO:tasks.workunit.client.0.smithi096.stdout:8/369: sync 2024-04-18T04:58:03.265 INFO:tasks.workunit.client.0.smithi096.stdout:2/634: sync 2024-04-18T04:58:03.267 INFO:tasks.workunit.client.0.smithi096.stdout:8/370: truncate d0/d3/d32/f72 782226 0 2024-04-18T04:58:03.267 INFO:tasks.workunit.client.0.smithi096.stdout:9/423: dread d0/de/d17/f3f [0,4194304] 0 2024-04-18T04:58:03.267 INFO:tasks.workunit.client.0.smithi096.stdout:3/620: fsync dc/d26/d48/dc2/f33 0 2024-04-18T04:58:03.270 INFO:tasks.workunit.client.0.smithi096.stdout:9/424: dread - d0/de/d17/d2f/d40/f61 zero size 2024-04-18T04:58:03.273 INFO:tasks.workunit.client.0.smithi096.stdout:8/371: creat d0/d7/d24/d18/d5d/f74 x:0 0 0 2024-04-18T04:58:03.279 INFO:tasks.workunit.client.0.smithi096.stdout:5/340: write d7/dd/f2c [973198,33461] 0 2024-04-18T04:58:03.281 INFO:tasks.workunit.client.0.smithi096.stdout:2/635: creat df/d18/d24/d42/d3f/d4a/dbc/fce x:0 0 0 2024-04-18T04:58:03.282 INFO:tasks.workunit.client.0.smithi096.stdout:5/341: creat d7/dd/f86 x:0 0 0 2024-04-18T04:58:03.282 INFO:tasks.workunit.client.0.smithi096.stdout:8/372: dwrite d0/d7/d24/f34 [0,4194304] 0 2024-04-18T04:58:03.285 INFO:tasks.workunit.client.0.smithi096.stdout:5/342: truncate d7/dd/f76 1972246 0 2024-04-18T04:58:03.285 INFO:tasks.workunit.client.0.smithi096.stdout:3/621: dread dc/f56 [0,4194304] 0 2024-04-18T04:58:03.285 INFO:tasks.workunit.client.0.smithi096.stdout:5/343: fdatasync d7/fa 0 2024-04-18T04:58:03.288 INFO:tasks.workunit.client.0.smithi096.stdout:2/636: creat df/d18/d71/d9c/db6/fcf x:0 0 0 2024-04-18T04:58:03.293 INFO:tasks.workunit.client.0.smithi096.stdout:8/373: rename d0/d7/f36 to d0/f75 0 2024-04-18T04:58:03.295 INFO:tasks.workunit.client.0.smithi096.stdout:2/637: creat df/d7d/fd0 x:0 0 0 2024-04-18T04:58:03.296 INFO:tasks.workunit.client.0.smithi096.stdout:2/638: readlink df/d18/d87/lb1 0 2024-04-18T04:58:03.298 INFO:tasks.workunit.client.0.smithi096.stdout:8/374: symlink d0/d7/d24/d18/d21/l76 0 2024-04-18T04:58:03.299 INFO:tasks.workunit.client.0.smithi096.stdout:2/639: chown df/d18/d26/d48/f4f 37 1 2024-04-18T04:58:03.299 INFO:tasks.workunit.client.0.smithi096.stdout:3/622: dwrite dc/d5d/f8a [0,4194304] 0 2024-04-18T04:58:03.300 INFO:tasks.workunit.client.0.smithi096.stdout:2/640: fsync df/d18/d26/f83 0 2024-04-18T04:58:03.302 INFO:tasks.workunit.client.0.smithi096.stdout:8/375: truncate d0/d7/d24/d18/d27/d60/f70 538550 0 2024-04-18T04:58:03.302 INFO:tasks.workunit.client.0.smithi096.stdout:2/641: fsync df/d18/d71/d9c/fa7 0 2024-04-18T04:58:03.304 INFO:tasks.workunit.client.0.smithi096.stdout:3/623: creat dc/d26/d57/fcd x:0 0 0 2024-04-18T04:58:03.307 INFO:tasks.workunit.client.0.smithi096.stdout:8/376: symlink d0/d7/d24/d35/l77 0 2024-04-18T04:58:03.310 INFO:tasks.workunit.client.0.smithi096.stdout:3/624: dread dc/d5d/fa4 [0,4194304] 0 2024-04-18T04:58:03.311 INFO:tasks.workunit.client.0.smithi096.stdout:8/377: truncate d0/d7/f50 650304 0 2024-04-18T04:58:03.313 INFO:tasks.workunit.client.0.smithi096.stdout:3/625: mknod dc/d26/d48/dc2/cce 0 2024-04-18T04:58:03.315 INFO:tasks.workunit.client.0.smithi096.stdout:2/642: dread df/f17 [0,4194304] 0 2024-04-18T04:58:03.315 INFO:tasks.workunit.client.0.smithi096.stdout:3/626: chown dc/d26/d57/c71 1950 1 2024-04-18T04:58:03.318 INFO:tasks.workunit.client.0.smithi096.stdout:2/643: fsync df/d18/d24/f3e 0 2024-04-18T04:58:03.319 INFO:tasks.workunit.client.0.smithi096.stdout:2/644: write f9 [4217632,68513] 0 2024-04-18T04:58:03.321 INFO:tasks.workunit.client.0.smithi096.stdout:8/378: rename d0/d7/d24/d18/d21 to d0/d7/d24/d78 0 2024-04-18T04:58:03.324 INFO:tasks.workunit.client.0.smithi096.stdout:3/627: mkdir dc/dcf 0 2024-04-18T04:58:03.325 INFO:tasks.workunit.client.0.smithi096.stdout:3/628: chown dc/d26/d48/dc2/c37 185 1 2024-04-18T04:58:03.325 INFO:tasks.workunit.client.0.smithi096.stdout:8/379: dread d0/d3/d32/f54 [0,4194304] 0 2024-04-18T04:58:03.327 INFO:tasks.workunit.client.0.smithi096.stdout:2/645: mkdir df/d18/d24/dd1 0 2024-04-18T04:58:03.331 INFO:tasks.workunit.client.0.smithi096.stdout:8/380: creat d0/d4f/f79 x:0 0 0 2024-04-18T04:58:03.332 INFO:tasks.workunit.client.0.smithi096.stdout:8/381: chown d0/d3/d32/f54 59 1 2024-04-18T04:58:03.332 INFO:tasks.workunit.client.0.smithi096.stdout:8/382: stat d0/d4f/f79 0 2024-04-18T04:58:03.336 INFO:tasks.workunit.client.0.smithi096.stdout:3/629: symlink dc/dcf/ld0 0 2024-04-18T04:58:03.339 INFO:tasks.workunit.client.0.smithi096.stdout:8/383: rename d0/d7/d24/d78/l76 to d0/d15/l7a 0 2024-04-18T04:58:03.341 INFO:tasks.workunit.client.0.smithi096.stdout:2/646: mknod df/d18/d24/d42/d3f/cd2 0 2024-04-18T04:58:03.341 INFO:tasks.workunit.client.0.smithi096.stdout:2/647: read - df/d18/d24/d42/fb0 zero size 2024-04-18T04:58:03.344 INFO:tasks.workunit.client.0.smithi096.stdout:3/630: rename dc/d26/d48/dc2/d95/f98 to dc/d26/d48/dc2/d29/d62/fd1 0 2024-04-18T04:58:03.347 INFO:tasks.workunit.client.0.smithi096.stdout:8/384: mkdir d0/d3/d32/d6b/d7b 0 2024-04-18T04:58:03.348 INFO:tasks.workunit.client.0.smithi096.stdout:2/648: dwrite df/d18/d26/f54 [0,4194304] 0 2024-04-18T04:58:03.349 INFO:tasks.workunit.client.0.smithi096.stdout:8/385: truncate d0/d7/f73 353639 0 2024-04-18T04:58:03.349 INFO:tasks.workunit.client.0.smithi096.stdout:2/649: fsync df/d18/f89 0 2024-04-18T04:58:03.354 INFO:tasks.workunit.client.0.smithi096.stdout:2/650: mknod df/d18/d26/d48/d7b/cd3 0 2024-04-18T04:58:03.355 INFO:tasks.workunit.client.0.smithi096.stdout:8/386: truncate d0/d7/d24/d18/d27/d60/f70 913913 0 2024-04-18T04:58:03.356 INFO:tasks.workunit.client.0.smithi096.stdout:8/387: write d0/d7/d24/f3d [639988,15971] 0 2024-04-18T04:58:03.357 INFO:tasks.workunit.client.0.smithi096.stdout:2/651: write df/f65 [1451053,120463] 0 2024-04-18T04:58:03.361 INFO:tasks.workunit.client.0.smithi096.stdout:2/652: creat df/d18/d24/d42/d6e/fd4 x:0 0 0 2024-04-18T04:58:03.366 INFO:tasks.workunit.client.0.smithi096.stdout:4/450: sync 2024-04-18T04:58:03.366 INFO:tasks.workunit.client.0.smithi096.stdout:7/428: sync 2024-04-18T04:58:03.366 INFO:tasks.workunit.client.0.smithi096.stdout:6/681: sync 2024-04-18T04:58:03.366 INFO:tasks.workunit.client.0.smithi096.stdout:6/682: write d0/d73/f96 [676324,69221] 0 2024-04-18T04:58:03.368 INFO:tasks.workunit.client.0.smithi096.stdout:3/631: rename dc/d26/d48/dc2/d29/d62 to dc/dcf/dd2 0 2024-04-18T04:58:03.373 INFO:tasks.workunit.client.0.smithi096.stdout:8/388: fdatasync d0/d7/d24/d18/d5d/f5f 0 2024-04-18T04:58:03.373 INFO:tasks.workunit.client.0.smithi096.stdout:7/429: rmdir db/d1f/d24/d49/d54 39 2024-04-18T04:58:03.374 INFO:tasks.workunit.client.0.smithi096.stdout:4/451: symlink d4/d7a/l8f 0 2024-04-18T04:58:03.374 INFO:tasks.workunit.client.0.smithi096.stdout:6/683: creat d0/d6/d2b/d3b/d69/fca x:0 0 0 2024-04-18T04:58:03.376 INFO:tasks.workunit.client.0.smithi096.stdout:2/653: dwrite df/d18/d24/f8d [0,4194304] 0 2024-04-18T04:58:03.377 INFO:tasks.workunit.client.0.smithi096.stdout:4/452: write d4/d14/d2d/d44/f5d [1006369,129134] 0 2024-04-18T04:58:03.385 INFO:tasks.workunit.client.0.smithi096.stdout:4/453: dwrite d4/d14/d2d/d44/d63/f7f [0,4194304] 0 2024-04-18T04:58:03.385 INFO:tasks.workunit.client.0.smithi096.stdout:4/454: readlink d4/d14/d1d/l79 0 2024-04-18T04:58:03.388 INFO:tasks.workunit.client.0.smithi096.stdout:4/455: dread - d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/f57 zero size 2024-04-18T04:58:03.388 INFO:tasks.workunit.client.0.smithi096.stdout:2/654: creat df/d7d/fd5 x:0 0 0 2024-04-18T04:58:03.393 INFO:tasks.workunit.client.0.smithi096.stdout:3/632: truncate dc/d26/d48/f9a 23886 0 2024-04-18T04:58:03.393 INFO:tasks.workunit.client.0.smithi096.stdout:8/389: mkdir d0/d7/d24/d18/d7c 0 2024-04-18T04:58:03.394 INFO:tasks.workunit.client.0.smithi096.stdout:7/430: rename db/d1f/d24/f33 to db/d1d/d82/f8c 0 2024-04-18T04:58:03.395 INFO:tasks.workunit.client.0.smithi096.stdout:2/655: chown df/d18/d24/d42/l5d 650197 1 2024-04-18T04:58:03.396 INFO:tasks.workunit.client.0.smithi096.stdout:6/684: rename d0/d6/f7 to d0/d6/d2b/d3b/d69/d6c/d85/fcb 0 2024-04-18T04:58:03.398 INFO:tasks.workunit.client.0.smithi096.stdout:8/390: mkdir d0/d7/d24/d35/d51/d7d 0 2024-04-18T04:58:03.398 INFO:tasks.workunit.client.0.smithi096.stdout:8/391: chown d0/d7 25081 1 2024-04-18T04:58:03.399 INFO:tasks.workunit.client.0.smithi096.stdout:7/431: mkdir db/d20/d2f/d8d 0 2024-04-18T04:58:03.401 INFO:tasks.workunit.client.0.smithi096.stdout:2/656: symlink df/d18/d24/d42/d3f/d4a/dbc/ld6 0 2024-04-18T04:58:03.402 INFO:tasks.workunit.client.0.smithi096.stdout:7/432: mknod db/d1f/d5b/d6a/c8e 0 2024-04-18T04:58:03.404 INFO:tasks.workunit.client.0.smithi096.stdout:2/657: creat df/d18/d71/d9c/fd7 x:0 0 0 2024-04-18T04:58:03.405 INFO:tasks.workunit.client.0.smithi096.stdout:2/658: write df/d18/d26/f4c [3640371,111261] 0 2024-04-18T04:58:03.406 INFO:tasks.workunit.client.0.smithi096.stdout:6/685: rename d0/d6/d2b/d3b/caa to d0/d6/d29/d83/ccc 0 2024-04-18T04:58:03.406 INFO:tasks.workunit.client.0.smithi096.stdout:1/567: sync 2024-04-18T04:58:03.406 INFO:tasks.workunit.client.0.smithi096.stdout:0/393: sync 2024-04-18T04:58:03.406 INFO:tasks.workunit.client.0.smithi096.stdout:9/425: sync 2024-04-18T04:58:03.408 INFO:tasks.workunit.client.0.smithi096.stdout:4/456: truncate d4/d14/d2d/d44/d58/d86/d6f/f77 1602784 0 2024-04-18T04:58:03.408 INFO:tasks.workunit.client.0.smithi096.stdout:9/426: write d0/de/f62 [1336988,114667] 0 2024-04-18T04:58:03.409 INFO:tasks.workunit.client.0.smithi096.stdout:8/392: link d0/f55 d0/d7/d24/d18/d7c/f7e 0 2024-04-18T04:58:03.411 INFO:tasks.workunit.client.0.smithi096.stdout:8/393: truncate d0/d7/d24/d18/d27/f69 501063 0 2024-04-18T04:58:03.415 INFO:tasks.workunit.client.0.smithi096.stdout:6/686: creat d0/d6/d2b/d3b/d7d/fcd x:0 0 0 2024-04-18T04:58:03.416 INFO:tasks.workunit.client.0.smithi096.stdout:0/394: unlink d16/d1c/d4c/d4d/f73 0 2024-04-18T04:58:03.418 INFO:tasks.workunit.client.0.smithi096.stdout:0/395: dread - d16/f60 zero size 2024-04-18T04:58:03.418 INFO:tasks.workunit.client.0.smithi096.stdout:1/568: creat de/d1d/d32/d73/d8b/fb3 x:0 0 0 2024-04-18T04:58:03.420 INFO:tasks.workunit.client.0.smithi096.stdout:3/633: dwrite dc/d26/d48/dc2/d29/f6f [0,4194304] 0 2024-04-18T04:58:03.421 INFO:tasks.workunit.client.0.smithi096.stdout:9/427: dwrite d0/de/d17/d56/d59/d68/f72 [0,4194304] 0 2024-04-18T04:58:03.423 INFO:tasks.workunit.client.0.smithi096.stdout:8/394: creat d0/d7/d24/d35/d51/f7f x:0 0 0 2024-04-18T04:58:03.424 INFO:tasks.workunit.client.0.smithi096.stdout:3/634: dread - dc/d26/d4a/d6b/f90 zero size 2024-04-18T04:58:03.424 INFO:tasks.workunit.client.0.smithi096.stdout:2/659: creat df/d18/d99/fd8 x:0 0 0 2024-04-18T04:58:03.426 INFO:tasks.workunit.client.0.smithi096.stdout:9/428: write d0/de/d17/d56/d59/d60/f8a [38017,31129] 0 2024-04-18T04:58:03.429 INFO:tasks.workunit.client.0.smithi096.stdout:8/395: write d0/d7/d24/d18/d27/d60/f70 [846599,110793] 0 2024-04-18T04:58:03.431 INFO:tasks.workunit.client.0.smithi096.stdout:3/635: write dc/d26/d4a/d6b/fba [243429,61733] 0 2024-04-18T04:58:03.431 INFO:tasks.workunit.client.0.smithi096.stdout:7/433: truncate f7 3634333 0 2024-04-18T04:58:03.433 INFO:tasks.workunit.client.0.smithi096.stdout:3/636: dread - dc/d70/f94 zero size 2024-04-18T04:58:03.434 INFO:tasks.workunit.client.0.smithi096.stdout:4/457: write d4/d14/d2d/d44/d58/d86/d3a/d39/f75 [1113112,87487] 0 2024-04-18T04:58:03.435 INFO:tasks.workunit.client.0.smithi096.stdout:0/396: dread d16/d1c/d22/d2c/f68 [0,4194304] 0 2024-04-18T04:58:03.439 INFO:tasks.workunit.client.0.smithi096.stdout:0/397: chown d16/c20 37886 1 2024-04-18T04:58:03.441 INFO:tasks.workunit.client.0.smithi096.stdout:7/434: mknod db/d1f/d24/d49/c8f 0 2024-04-18T04:58:03.447 INFO:tasks.workunit.client.0.smithi096.stdout:2/660: dwrite df/d18/d24/d42/d6e/fd4 [0,4194304] 0 2024-04-18T04:58:03.450 INFO:tasks.workunit.client.0.smithi096.stdout:7/435: rename db/d20 to db/d20/d2f/d8d/d90 22 2024-04-18T04:58:03.451 INFO:tasks.workunit.client.0.smithi096.stdout:6/687: truncate d0/d6/d29/f30 3489766 0 2024-04-18T04:58:03.451 INFO:tasks.workunit.client.0.smithi096.stdout:9/429: dwrite d0/d52/d5a/f7d [0,4194304] 0 2024-04-18T04:58:03.452 INFO:tasks.workunit.client.0.smithi096.stdout:8/396: dwrite d0/d7/d24/f3d [0,4194304] 0 2024-04-18T04:58:03.454 INFO:tasks.workunit.client.0.smithi096.stdout:4/458: dwrite d4/f18 [0,4194304] 0 2024-04-18T04:58:03.455 INFO:tasks.workunit.client.0.smithi096.stdout:2/661: write df/d18/d71/d9c/fa7 [1270546,78577] 0 2024-04-18T04:58:03.456 INFO:tasks.workunit.client.0.smithi096.stdout:3/637: truncate dc/f42 1106349 0 2024-04-18T04:58:03.457 INFO:tasks.workunit.client.0.smithi096.stdout:9/430: read d0/f28 [5443616,77117] 0 2024-04-18T04:58:03.457 INFO:tasks.workunit.client.0.smithi096.stdout:0/398: truncate fd 3894303 0 2024-04-18T04:58:03.464 INFO:tasks.workunit.client.0.smithi096.stdout:6/688: fdatasync d0/f59 0 2024-04-18T04:58:03.470 INFO:tasks.workunit.client.0.smithi096.stdout:6/689: write d0/d6/d2b/d3b/d69/d66/fbc [701427,38991] 0 2024-04-18T04:58:03.470 INFO:tasks.workunit.client.0.smithi096.stdout:2/662: truncate df/d18/d26/f83 1828520 0 2024-04-18T04:58:03.473 INFO:tasks.workunit.client.0.smithi096.stdout:8/397: link d0/c20 d0/d15/d65/c80 0 2024-04-18T04:58:03.476 INFO:tasks.workunit.client.0.smithi096.stdout:2/663: mkdir df/d18/d24/d42/dd9 0 2024-04-18T04:58:03.477 INFO:tasks.workunit.client.0.smithi096.stdout:9/431: link d0/de/d17/d5c/l6c d0/de/d17/d2f/l93 0 2024-04-18T04:58:03.477 INFO:tasks.workunit.client.0.smithi096.stdout:8/398: fsync d0/d3/d32/f72 0 2024-04-18T04:58:03.480 INFO:tasks.workunit.client.0.smithi096.stdout:7/436: dwrite db/d1f/d5b/d6a/f8b [0,4194304] 0 2024-04-18T04:58:03.480 INFO:tasks.workunit.client.0.smithi096.stdout:6/690: creat d0/d6/d2b/d3b/d7d/fce x:0 0 0 2024-04-18T04:58:03.483 INFO:tasks.workunit.client.0.smithi096.stdout:9/432: chown d0/de/d17/c2c 108815792 1 2024-04-18T04:58:03.483 INFO:tasks.workunit.client.0.smithi096.stdout:3/638: dwrite f8 [4194304,4194304] 0 2024-04-18T04:58:03.483 INFO:tasks.workunit.client.0.smithi096.stdout:8/399: stat d0/d15/d65/c80 0 2024-04-18T04:58:03.483 INFO:tasks.workunit.client.0.smithi096.stdout:0/399: dwrite d16/f40 [0,4194304] 0 2024-04-18T04:58:03.484 INFO:tasks.workunit.client.0.smithi096.stdout:2/664: dread df/d18/d26/d48/f52 [0,4194304] 0 2024-04-18T04:58:03.486 INFO:tasks.workunit.client.0.smithi096.stdout:3/639: dread - dc/d26/d57/fcd zero size 2024-04-18T04:58:03.486 INFO:tasks.workunit.client.0.smithi096.stdout:7/437: truncate db/d1f/d5b/f89 700671 0 2024-04-18T04:58:03.487 INFO:tasks.workunit.client.0.smithi096.stdout:4/459: truncate d4/d14/d2d/d44/d58/d86/d3a/d39/f75 1722395 0 2024-04-18T04:58:03.487 INFO:tasks.workunit.client.0.smithi096.stdout:2/665: dread - df/d18/d71/d9c/db6/fcf zero size 2024-04-18T04:58:03.490 INFO:tasks.workunit.client.0.smithi096.stdout:9/433: write d0/de/d17/d56/d59/d68/f8e [323550,49469] 0 2024-04-18T04:58:03.494 INFO:tasks.workunit.client.0.smithi096.stdout:2/666: rmdir df/d18/d26/d48/d7b 39 2024-04-18T04:58:03.495 INFO:tasks.workunit.client.0.smithi096.stdout:8/400: mkdir d0/d7/d24/d35/d51/d7d/d81 0 2024-04-18T04:58:03.496 INFO:tasks.workunit.client.0.smithi096.stdout:6/691: dwrite d0/d6/d5d/f7b [0,4194304] 0 2024-04-18T04:58:03.502 INFO:tasks.workunit.client.0.smithi096.stdout:7/438: link db/d1f/d24/c53 db/d20/d45/c91 0 2024-04-18T04:58:03.503 INFO:tasks.workunit.client.0.smithi096.stdout:0/400: dwrite d16/d1c/d4c/d4d/d5d/f74 [0,4194304] 0 2024-04-18T04:58:03.504 INFO:tasks.workunit.client.0.smithi096.stdout:6/692: mkdir d0/d6/d2b/d3b/d69/d66/dcf 0 2024-04-18T04:58:03.505 INFO:tasks.workunit.client.0.smithi096.stdout:3/640: dwrite dc/f1b [0,4194304] 0 2024-04-18T04:58:03.506 INFO:tasks.workunit.client.0.smithi096.stdout:2/667: rename df/d18/d24/f74 to df/d18/d71/d9c/fda 0 2024-04-18T04:58:03.507 INFO:tasks.workunit.client.0.smithi096.stdout:8/401: creat d0/d7/d24/f82 x:0 0 0 2024-04-18T04:58:03.509 INFO:tasks.workunit.client.0.smithi096.stdout:2/668: readlink df/d18/d24/d42/d6e/l8a 0 2024-04-18T04:58:03.512 INFO:tasks.workunit.client.0.smithi096.stdout:8/402: write d0/d7/d24/d18/d27/f69 [1175305,128278] 0 2024-04-18T04:58:03.512 INFO:tasks.workunit.client.0.smithi096.stdout:3/641: mkdir dc/d26/d48/dbd/dd3 0 2024-04-18T04:58:03.512 INFO:tasks.workunit.client.0.smithi096.stdout:0/401: dread d16/d1c/d4c/d4e/f64 [0,4194304] 0 2024-04-18T04:58:03.514 INFO:tasks.workunit.client.0.smithi096.stdout:2/669: rmdir df/d18/d24/d42/d6e 39 2024-04-18T04:58:03.517 INFO:tasks.workunit.client.0.smithi096.stdout:7/439: dwrite db/d1f/d5b/d6a/f6e [0,4194304] 0 2024-04-18T04:58:03.520 INFO:tasks.workunit.client.0.smithi096.stdout:6/693: getdents d0/d6 0 2024-04-18T04:58:03.526 INFO:tasks.workunit.client.0.smithi096.stdout:2/670: dwrite df/d18/d24/d42/d3f/d4a/fb2 [0,4194304] 0 2024-04-18T04:58:03.527 INFO:tasks.workunit.client.0.smithi096.stdout:7/440: rename db/l3d to db/d1f/d39/d6d/l92 0 2024-04-18T04:58:03.527 INFO:tasks.workunit.client.0.smithi096.stdout:2/671: fsync df/d18/d24/f8d 0 2024-04-18T04:58:03.530 INFO:tasks.workunit.client.0.smithi096.stdout:0/402: write d16/d1c/f65 [4050612,82139] 0 2024-04-18T04:58:03.532 INFO:tasks.workunit.client.0.smithi096.stdout:0/403: chown d16/d1c/d22/d2c/f68 27421 1 2024-04-18T04:58:03.532 INFO:tasks.workunit.client.0.smithi096.stdout:8/403: getdents d0/d7/d24/d35/d51/d7d 0 2024-04-18T04:58:03.533 INFO:tasks.workunit.client.0.smithi096.stdout:6/694: rename d0/d6/f20 to d0/d6/d2b/d3b/dbb/fd0 0 2024-04-18T04:58:03.536 INFO:tasks.workunit.client.0.smithi096.stdout:3/642: dwrite dc/d26/d4a/f91 [0,4194304] 0 2024-04-18T04:58:03.537 INFO:tasks.workunit.client.0.smithi096.stdout:0/404: mkdir d16/d1c/d4c/d4d/d79 0 2024-04-18T04:58:03.538 INFO:tasks.workunit.client.0.smithi096.stdout:7/441: dread - db/d20/d45/f63 zero size 2024-04-18T04:58:03.538 INFO:tasks.workunit.client.0.smithi096.stdout:5/344: sync 2024-04-18T04:58:03.538 INFO:tasks.workunit.client.0.smithi096.stdout:2/672: symlink df/d18/d24/d42/d3f/ldb 0 2024-04-18T04:58:03.539 INFO:tasks.workunit.client.0.smithi096.stdout:6/695: rmdir d0/d4a 39 2024-04-18T04:58:03.544 INFO:tasks.workunit.client.0.smithi096.stdout:5/345: rmdir d7/d39/d52/d61 39 2024-04-18T04:58:03.548 INFO:tasks.workunit.client.0.smithi096.stdout:3/643: dread dc/d26/f72 [0,4194304] 0 2024-04-18T04:58:03.549 INFO:tasks.workunit.client.0.smithi096.stdout:2/673: mknod df/d18/d24/d42/d6e/cdc 0 2024-04-18T04:58:03.549 INFO:tasks.workunit.client.0.smithi096.stdout:0/405: write d16/d1c/f29 [1345747,57767] 0 2024-04-18T04:58:03.551 INFO:tasks.workunit.client.0.smithi096.stdout:2/674: write df/d18/d26/f27 [3808853,129742] 0 2024-04-18T04:58:03.552 INFO:tasks.workunit.client.0.smithi096.stdout:8/404: dread d0/d7/d24/d78/f4e [0,4194304] 0 2024-04-18T04:58:03.552 INFO:tasks.workunit.client.0.smithi096.stdout:3/644: fsync dc/f56 0 2024-04-18T04:58:03.553 INFO:tasks.workunit.client.0.smithi096.stdout:2/675: truncate df/d18/d26/d48/fc6 543215 0 2024-04-18T04:58:03.558 INFO:tasks.workunit.client.0.smithi096.stdout:8/405: rename d0/f59 to d0/d7/d24/d18/d5d/f83 0 2024-04-18T04:58:03.560 INFO:tasks.workunit.client.0.smithi096.stdout:7/442: write db/d1f/d24/d49/d54/f5d [180448,106621] 0 2024-04-18T04:58:03.561 INFO:tasks.workunit.client.0.smithi096.stdout:6/696: truncate d0/d6/d29/f7f 4227974 0 2024-04-18T04:58:03.564 INFO:tasks.workunit.client.0.smithi096.stdout:7/443: stat db/d20/d45/c91 0 2024-04-18T04:58:03.564 INFO:tasks.workunit.client.0.smithi096.stdout:5/346: dwrite d7/d25/d30/f5c [0,4194304] 0 2024-04-18T04:58:03.565 INFO:tasks.workunit.client.0.smithi096.stdout:2/676: getdents df/d18/d26/d48 0 2024-04-18T04:58:03.570 INFO:tasks.workunit.client.0.smithi096.stdout:5/347: write d7/d25/d30/f3a [2672400,118755] 0 2024-04-18T04:58:03.570 INFO:tasks.workunit.client.0.smithi096.stdout:3/645: rename dc/d26/d48/dc2/d29/d7e/cc3 to dc/d26/d48/dc2/d8d/cd4 0 2024-04-18T04:58:03.570 INFO:tasks.workunit.client.0.smithi096.stdout:0/406: dwrite d16/f21 [0,4194304] 0 2024-04-18T04:58:03.570 INFO:tasks.workunit.client.0.smithi096.stdout:0/407: stat d16/d1d/c23 0 2024-04-18T04:58:03.574 INFO:tasks.workunit.client.0.smithi096.stdout:8/406: rename d0/d3/d32/f37 to d0/d7/d24/d18/d7c/f84 0 2024-04-18T04:58:03.575 INFO:tasks.workunit.client.0.smithi096.stdout:7/444: rmdir db/d1d 39 2024-04-18T04:58:03.576 INFO:tasks.workunit.client.0.smithi096.stdout:3/646: stat dc/d26/d66/d7f/f85 0 2024-04-18T04:58:03.584 INFO:tasks.workunit.client.0.smithi096.stdout:8/407: creat d0/d4f/f85 x:0 0 0 2024-04-18T04:58:03.584 INFO:tasks.workunit.client.0.smithi096.stdout:3/647: mknod dc/d26/d48/cd5 0 2024-04-18T04:58:03.586 INFO:tasks.workunit.client.0.smithi096.stdout:2/677: dwrite df/d18/f5f [0,4194304] 0 2024-04-18T04:58:03.587 INFO:tasks.workunit.client.0.smithi096.stdout:6/697: rename d0/d73/c9e to d0/d6/d5d/cd1 0 2024-04-18T04:58:03.588 INFO:tasks.workunit.client.0.smithi096.stdout:0/408: dwrite d16/d1c/d4c/d4d/d5a/f6c [0,4194304] 0 2024-04-18T04:58:03.589 INFO:tasks.workunit.client.0.smithi096.stdout:2/678: fdatasync df/d18/d26/f27 0 2024-04-18T04:58:03.595 INFO:tasks.workunit.client.0.smithi096.stdout:3/648: creat dc/d26/d48/fd6 x:0 0 0 2024-04-18T04:58:03.596 INFO:tasks.workunit.client.0.smithi096.stdout:7/445: mkdir db/d1f/d39/d6d/d93 0 2024-04-18T04:58:03.596 INFO:tasks.workunit.client.0.smithi096.stdout:5/348: dread d7/d25/f41 [4194304,4194304] 0 2024-04-18T04:58:03.596 INFO:tasks.workunit.client.0.smithi096.stdout:3/649: write dc/d26/d66/d7f/fbe [2988535,14232] 0 2024-04-18T04:58:03.599 INFO:tasks.workunit.client.0.smithi096.stdout:2/679: symlink df/d18/ldd 0 2024-04-18T04:58:03.599 INFO:tasks.workunit.client.0.smithi096.stdout:8/408: dwrite d0/d7/d24/d18/d5d/f74 [0,4194304] 0 2024-04-18T04:58:03.601 INFO:tasks.workunit.client.0.smithi096.stdout:0/409: rmdir d16/d1c/d4c/d4d/d79 0 2024-04-18T04:58:03.601 INFO:tasks.workunit.client.0.smithi096.stdout:7/446: symlink db/d1d/l94 0 2024-04-18T04:58:03.603 INFO:tasks.workunit.client.0.smithi096.stdout:8/409: chown d0/d4f/f58 293958 1 2024-04-18T04:58:03.606 INFO:tasks.workunit.client.0.smithi096.stdout:8/410: mkdir d0/d7/d86 0 2024-04-18T04:58:03.607 INFO:tasks.workunit.client.0.smithi096.stdout:5/349: truncate d7/d39/f20 4888111 0 2024-04-18T04:58:03.608 INFO:tasks.workunit.client.0.smithi096.stdout:7/447: mknod db/d1f/d5b/d6a/c95 0 2024-04-18T04:58:03.608 INFO:tasks.workunit.client.0.smithi096.stdout:2/680: truncate df/d18/d26/d48/f52 1440973 0 2024-04-18T04:58:03.609 INFO:tasks.workunit.client.0.smithi096.stdout:6/698: dwrite d0/d6/f24 [8388608,4194304] 0 2024-04-18T04:58:03.609 INFO:tasks.workunit.client.0.smithi096.stdout:0/410: write d16/d1c/d22/d3a/f5e [1046366,2418] 0 2024-04-18T04:58:03.613 INFO:tasks.workunit.client.0.smithi096.stdout:7/448: read db/d20/f35 [20662,4513] 0 2024-04-18T04:58:03.613 INFO:tasks.workunit.client.0.smithi096.stdout:8/411: creat d0/d7/d24/d18/d5d/f87 x:0 0 0 2024-04-18T04:58:03.614 INFO:tasks.workunit.client.0.smithi096.stdout:5/350: creat d7/d25/d7c/f87 x:0 0 0 2024-04-18T04:58:03.616 INFO:tasks.workunit.client.0.smithi096.stdout:6/699: write d0/d6/d2b/d3b/f41 [2429710,31351] 0 2024-04-18T04:58:03.617 INFO:tasks.workunit.client.0.smithi096.stdout:0/411: rename ff to d16/d1d/d3b/f7a 0 2024-04-18T04:58:03.618 INFO:tasks.workunit.client.0.smithi096.stdout:8/412: creat d0/d15/f88 x:0 0 0 2024-04-18T04:58:03.618 INFO:tasks.workunit.client.0.smithi096.stdout:3/650: dread dc/d70/f73 [0,4194304] 0 2024-04-18T04:58:03.618 INFO:tasks.workunit.client.0.smithi096.stdout:5/351: unlink d7/d3b/f82 0 2024-04-18T04:58:03.619 INFO:tasks.workunit.client.0.smithi096.stdout:3/651: chown dc/d5d/f5c 18 1 2024-04-18T04:58:03.619 INFO:tasks.workunit.client.0.smithi096.stdout:8/413: write d0/d7/d24/d78/f56 [705208,90227] 0 2024-04-18T04:58:03.620 INFO:tasks.workunit.client.0.smithi096.stdout:2/681: creat df/d18/d24/d42/d3f/fde x:0 0 0 2024-04-18T04:58:03.621 INFO:tasks.workunit.client.0.smithi096.stdout:5/352: write d7/d39/d52/f6d [17106,124138] 0 2024-04-18T04:58:03.621 INFO:tasks.workunit.client.0.smithi096.stdout:7/449: symlink db/d1f/d39/d6d/d93/l96 0 2024-04-18T04:58:03.623 INFO:tasks.workunit.client.0.smithi096.stdout:3/652: unlink dc/d26/d4a/l61 0 2024-04-18T04:58:03.624 INFO:tasks.workunit.client.0.smithi096.stdout:8/414: write d0/d7/d24/d35/f4a [902961,11288] 0 2024-04-18T04:58:03.624 INFO:tasks.workunit.client.0.smithi096.stdout:7/450: symlink db/d20/d2f/l97 0 2024-04-18T04:58:03.627 INFO:tasks.workunit.client.0.smithi096.stdout:3/653: chown dc/f56 104210 1 2024-04-18T04:58:03.627 INFO:tasks.workunit.client.0.smithi096.stdout:5/353: symlink d7/dd/d35/d74/l88 0 2024-04-18T04:58:03.630 INFO:tasks.workunit.client.0.smithi096.stdout:8/415: creat d0/d7/d24/d35/d51/d5b/f89 x:0 0 0 2024-04-18T04:58:03.630 INFO:tasks.workunit.client.0.smithi096.stdout:7/451: write db/f62 [98248,122421] 0 2024-04-18T04:58:03.631 INFO:tasks.workunit.client.0.smithi096.stdout:6/700: creat d0/d6/d2e/fd2 x:0 0 0 2024-04-18T04:58:03.633 INFO:tasks.workunit.client.0.smithi096.stdout:8/416: chown d0/c20 160420245 1 2024-04-18T04:58:03.635 INFO:tasks.workunit.client.0.smithi096.stdout:2/682: dwrite df/f16 [4194304,4194304] 0 2024-04-18T04:58:03.640 INFO:tasks.workunit.client.0.smithi096.stdout:2/683: write df/d18/d24/f3e [5076934,57614] 0 2024-04-18T04:58:03.644 INFO:tasks.workunit.client.0.smithi096.stdout:3/654: dwrite dc/d26/d48/dc2/d95/da3/fc8 [0,4194304] 0 2024-04-18T04:58:03.645 INFO:tasks.workunit.client.0.smithi096.stdout:5/354: truncate d7/d12/f2d 3677066 0 2024-04-18T04:58:03.647 INFO:tasks.workunit.client.0.smithi096.stdout:7/452: dread db/d1f/d5b/d6a/f8b [0,4194304] 0 2024-04-18T04:58:03.648 INFO:tasks.workunit.client.0.smithi096.stdout:2/684: mknod df/d18/d99/cdf 0 2024-04-18T04:58:03.649 INFO:tasks.workunit.client.0.smithi096.stdout:0/412: dwrite d16/d1d/d3b/f58 [0,4194304] 0 2024-04-18T04:58:03.651 INFO:tasks.workunit.client.0.smithi096.stdout:7/453: readlink db/d1f/d39/l67 0 2024-04-18T04:58:03.652 INFO:tasks.workunit.client.0.smithi096.stdout:5/355: creat d7/d39/d36/d6f/f89 x:0 0 0 2024-04-18T04:58:03.653 INFO:tasks.workunit.client.0.smithi096.stdout:8/417: dwrite d0/d7/d24/d78/f61 [4194304,4194304] 0 2024-04-18T04:58:03.656 INFO:tasks.workunit.client.0.smithi096.stdout:3/655: getdents dc/d26/d48/dae 0 2024-04-18T04:58:03.659 INFO:tasks.workunit.client.0.smithi096.stdout:2/685: symlink df/d18/d24/d42/d3f/d4a/dbc/le0 0 2024-04-18T04:58:03.660 INFO:tasks.workunit.client.0.smithi096.stdout:7/454: creat db/d1f/d24/d49/d54/f98 x:0 0 0 2024-04-18T04:58:03.660 INFO:tasks.workunit.client.0.smithi096.stdout:2/686: truncate df/d7d/fb9 889619 0 2024-04-18T04:58:03.661 INFO:tasks.workunit.client.0.smithi096.stdout:7/455: fdatasync db/d1f/d5b/d6a/d74/f81 0 2024-04-18T04:58:03.662 INFO:tasks.workunit.client.0.smithi096.stdout:8/418: creat d0/d3/f8a x:0 0 0 2024-04-18T04:58:03.662 INFO:tasks.workunit.client.0.smithi096.stdout:8/419: stat d0/d7/d86 0 2024-04-18T04:58:03.663 INFO:tasks.workunit.client.0.smithi096.stdout:5/356: mknod d7/d25/d7c/c8a 0 2024-04-18T04:58:03.663 INFO:tasks.workunit.client.0.smithi096.stdout:0/413: write d16/d1c/f3c [666443,113467] 0 2024-04-18T04:58:03.664 INFO:tasks.workunit.client.0.smithi096.stdout:3/656: fdatasync dc/f9d 0 2024-04-18T04:58:03.664 INFO:tasks.workunit.client.0.smithi096.stdout:8/420: read - d0/d7/d24/f82 zero size 2024-04-18T04:58:03.667 INFO:tasks.workunit.client.0.smithi096.stdout:2/687: rename df/f33 to df/d18/d24/d42/d3f/d4a/d82/fe1 0 2024-04-18T04:58:03.669 INFO:tasks.workunit.client.0.smithi096.stdout:5/357: unlink d7/d39/d52/d61/l77 0 2024-04-18T04:58:03.669 INFO:tasks.workunit.client.0.smithi096.stdout:8/421: rmdir d0/d7/d24/d18/d27 39 2024-04-18T04:58:03.670 INFO:tasks.workunit.client.0.smithi096.stdout:3/657: symlink dc/d26/d48/dc2/d29/d7e/ld7 0 2024-04-18T04:58:03.671 INFO:tasks.workunit.client.0.smithi096.stdout:8/422: dread - d0/d7/d24/d35/d51/f7f zero size 2024-04-18T04:58:03.672 INFO:tasks.workunit.client.0.smithi096.stdout:3/658: truncate dc/d26/f72 4621753 0 2024-04-18T04:58:03.672 INFO:tasks.workunit.client.0.smithi096.stdout:1/569: sync 2024-04-18T04:58:03.674 INFO:tasks.workunit.client.0.smithi096.stdout:7/456: link db/d1f/c4c db/c99 0 2024-04-18T04:58:03.675 INFO:tasks.workunit.client.0.smithi096.stdout:7/457: stat db/d20/d2f/l97 0 2024-04-18T04:58:03.677 INFO:tasks.workunit.client.0.smithi096.stdout:5/358: link d7/dd/d35/d74/f81 d7/d39/d52/d61/f8b 0 2024-04-18T04:58:03.677 INFO:tasks.workunit.client.0.smithi096.stdout:8/423: symlink d0/d7/d24/l8b 0 2024-04-18T04:58:03.678 INFO:tasks.workunit.client.0.smithi096.stdout:1/570: creat de/d1d/d32/d9a/dad/fb4 x:0 0 0 2024-04-18T04:58:03.681 INFO:tasks.workunit.client.0.smithi096.stdout:7/458: write db/d1f/d5b/d6a/f8b [5174715,69066] 0 2024-04-18T04:58:03.681 INFO:tasks.workunit.client.0.smithi096.stdout:2/688: getdents df/d7d 0 2024-04-18T04:58:03.681 INFO:tasks.workunit.client.0.smithi096.stdout:0/414: dwrite d16/d1c/d22/d2c/f4b [0,4194304] 0 2024-04-18T04:58:03.684 INFO:tasks.workunit.client.0.smithi096.stdout:8/424: mknod d0/d3/d32/d6b/d7b/c8c 0 2024-04-18T04:58:03.688 INFO:tasks.workunit.client.0.smithi096.stdout:7/459: unlink db/d1f/d24/d49/d54/f98 0 2024-04-18T04:58:03.690 INFO:tasks.workunit.client.0.smithi096.stdout:3/659: truncate dc/d5d/f8a 369662 0 2024-04-18T04:58:03.691 INFO:tasks.workunit.client.0.smithi096.stdout:3/660: readlink dc/d26/d48/dc2/d29/d7e/lb4 0 2024-04-18T04:58:03.692 INFO:tasks.workunit.client.0.smithi096.stdout:8/425: write d0/d7/f2b [1842202,52354] 0 2024-04-18T04:58:03.693 INFO:tasks.workunit.client.0.smithi096.stdout:1/571: creat de/d1d/d32/fb5 x:0 0 0 2024-04-18T04:58:03.696 INFO:tasks.workunit.client.0.smithi096.stdout:7/460: creat db/d1f/d39/d6d/d79/f9a x:0 0 0 2024-04-18T04:58:03.697 INFO:tasks.workunit.client.0.smithi096.stdout:3/661: creat dc/d26/d48/dae/fd8 x:0 0 0 2024-04-18T04:58:03.698 INFO:tasks.workunit.client.0.smithi096.stdout:8/426: mkdir d0/d7/d24/d8d 0 2024-04-18T04:58:03.699 INFO:tasks.workunit.client.0.smithi096.stdout:7/461: unlink db/d20/d2f/f34 0 2024-04-18T04:58:03.701 INFO:tasks.workunit.client.0.smithi096.stdout:8/427: dread d0/d15/d65/f6a [0,4194304] 0 2024-04-18T04:58:03.702 INFO:tasks.workunit.client.0.smithi096.stdout:5/359: dwrite d7/d12/f2d [0,4194304] 0 2024-04-18T04:58:03.706 INFO:tasks.workunit.client.0.smithi096.stdout:5/360: rename d7/d39/d52/d61/f8b to d7/d39/d52/d61/f8c 0 2024-04-18T04:58:03.707 INFO:tasks.workunit.client.0.smithi096.stdout:9/434: sync 2024-04-18T04:58:03.707 INFO:tasks.workunit.client.0.smithi096.stdout:4/460: sync 2024-04-18T04:58:03.710 INFO:tasks.workunit.client.0.smithi096.stdout:5/361: mknod d7/d12/c8d 0 2024-04-18T04:58:03.710 INFO:tasks.workunit.client.0.smithi096.stdout:8/428: write d0/f2 [1477031,72500] 0 2024-04-18T04:58:03.712 INFO:tasks.workunit.client.0.smithi096.stdout:9/435: chown d0/de/d17/f2a 52 1 2024-04-18T04:58:03.712 INFO:tasks.workunit.client.0.smithi096.stdout:0/415: dread d16/d1c/f37 [0,4194304] 0 2024-04-18T04:58:03.714 INFO:tasks.workunit.client.0.smithi096.stdout:7/462: dwrite db/d1d/f44 [0,4194304] 0 2024-04-18T04:58:03.716 INFO:tasks.workunit.client.0.smithi096.stdout:1/572: dwrite f6 [0,4194304] 0 2024-04-18T04:58:03.716 INFO:tasks.workunit.client.0.smithi096.stdout:0/416: fsync d16/d1c/f6d 0 2024-04-18T04:58:03.716 INFO:tasks.workunit.client.0.smithi096.stdout:4/461: mkdir d4/d14/d2d/d44/d90 0 2024-04-18T04:58:03.719 INFO:tasks.workunit.client.0.smithi096.stdout:7/463: dread - db/d1f/d4e/f78 zero size 2024-04-18T04:58:03.719 INFO:tasks.workunit.client.0.smithi096.stdout:0/417: readlink d16/d1c/d4c/l69 0 2024-04-18T04:58:03.720 INFO:tasks.workunit.client.0.smithi096.stdout:3/662: dwrite dc/d5d/f5c [4194304,4194304] 0 2024-04-18T04:58:03.721 INFO:tasks.workunit.client.0.smithi096.stdout:5/362: symlink d7/d39/d36/d6f/l8e 0 2024-04-18T04:58:03.723 INFO:tasks.workunit.client.0.smithi096.stdout:8/429: write d0/d7/d24/f45 [150294,63672] 0 2024-04-18T04:58:03.723 INFO:tasks.workunit.client.0.smithi096.stdout:5/363: chown d7/d39/d36/d6f 128373555 1 2024-04-18T04:58:03.724 INFO:tasks.workunit.client.0.smithi096.stdout:3/663: chown dc/d5d/l64 31 1 2024-04-18T04:58:03.726 INFO:tasks.workunit.client.0.smithi096.stdout:3/664: write dc/d26/d48/dae/fd8 [921299,117616] 0 2024-04-18T04:58:03.728 INFO:tasks.workunit.client.0.smithi096.stdout:5/364: dread - d7/d39/d36/d6f/f89 zero size 2024-04-18T04:58:03.730 INFO:tasks.workunit.client.0.smithi096.stdout:4/462: truncate d4/d14/d2d/d44/f5e 3907802 0 2024-04-18T04:58:03.735 INFO:tasks.workunit.client.0.smithi096.stdout:9/436: link d0/de/d17/c14 d0/d25/c94 0 2024-04-18T04:58:03.736 INFO:tasks.workunit.client.0.smithi096.stdout:7/464: getdents db/d1f/d24/d49/d54 0 2024-04-18T04:58:03.736 INFO:tasks.workunit.client.0.smithi096.stdout:1/573: dwrite de/f59 [0,4194304] 0 2024-04-18T04:58:03.739 INFO:tasks.workunit.client.0.smithi096.stdout:5/365: rename d7/d12 to d7/dd/d8f 0 2024-04-18T04:58:03.739 INFO:tasks.workunit.client.0.smithi096.stdout:8/430: truncate d0/d7/d24/d18/f23 914674 0 2024-04-18T04:58:03.740 INFO:tasks.workunit.client.0.smithi096.stdout:1/574: creat de/d1d/d81/fb6 x:0 0 0 2024-04-18T04:58:03.742 INFO:tasks.workunit.client.0.smithi096.stdout:9/437: mknod d0/d25/c95 0 2024-04-18T04:58:03.744 INFO:tasks.workunit.client.0.smithi096.stdout:8/431: creat d0/d7/d24/d35/f8e x:0 0 0 2024-04-18T04:58:03.745 INFO:tasks.workunit.client.0.smithi096.stdout:7/465: link db/d1f/d24/d49/c73 db/d1f/d5b/d6a/d74/c9b 0 2024-04-18T04:58:03.747 INFO:tasks.workunit.client.0.smithi096.stdout:9/438: mkdir d0/de/d17/d56/d59/d68/d96 0 2024-04-18T04:58:03.754 INFO:tasks.workunit.client.0.smithi096.stdout:0/418: dread d16/f2b [0,4194304] 0 2024-04-18T04:58:03.754 INFO:tasks.workunit.client.0.smithi096.stdout:8/432: rmdir d0/d7/d24/d35/d51/d7d/d81 0 2024-04-18T04:58:03.756 INFO:tasks.workunit.client.0.smithi096.stdout:9/439: creat d0/de/d17/f97 x:0 0 0 2024-04-18T04:58:03.757 INFO:tasks.workunit.client.0.smithi096.stdout:0/419: unlink c15 0 2024-04-18T04:58:03.760 INFO:tasks.workunit.client.0.smithi096.stdout:4/463: dread d4/d14/d16/f40 [4194304,4194304] 0 2024-04-18T04:58:03.762 INFO:tasks.workunit.client.0.smithi096.stdout:1/575: dwrite de/d1d/f3e [0,4194304] 0 2024-04-18T04:58:03.763 INFO:tasks.workunit.client.0.smithi096.stdout:4/464: stat d4/d14/c53 0 2024-04-18T04:58:03.763 INFO:tasks.workunit.client.0.smithi096.stdout:7/466: dwrite db/d1f/d24/d61/f84 [0,4194304] 0 2024-04-18T04:58:03.763 INFO:tasks.workunit.client.0.smithi096.stdout:8/433: rename d0/d7/d24/d35/d51/d7d to d0/d15/d65/d8f 0 2024-04-18T04:58:03.764 INFO:tasks.workunit.client.0.smithi096.stdout:0/420: creat d16/d1c/d4c/d4d/d5d/f7b x:0 0 0 2024-04-18T04:58:03.764 INFO:tasks.workunit.client.0.smithi096.stdout:0/421: chown c13 820241436 1 2024-04-18T04:58:03.766 INFO:tasks.workunit.client.0.smithi096.stdout:1/576: symlink de/d1d/d32/d6f/lb7 0 2024-04-18T04:58:03.769 INFO:tasks.workunit.client.0.smithi096.stdout:8/434: creat d0/d3/d32/f90 x:0 0 0 2024-04-18T04:58:03.770 INFO:tasks.workunit.client.0.smithi096.stdout:9/440: link d0/de/d17/d56/d59/d68/f83 d0/de/d17/d56/d59/d68/f98 0 2024-04-18T04:58:03.771 INFO:tasks.workunit.client.0.smithi096.stdout:7/467: creat db/f9c x:0 0 0 2024-04-18T04:58:03.771 INFO:tasks.workunit.client.0.smithi096.stdout:9/441: fdatasync d0/de/d17/d56/f6a 0 2024-04-18T04:58:03.776 INFO:tasks.workunit.client.0.smithi096.stdout:9/442: rmdir d0/d41 39 2024-04-18T04:58:03.777 INFO:tasks.workunit.client.0.smithi096.stdout:7/468: creat db/d1f/d39/d6d/f9d x:0 0 0 2024-04-18T04:58:03.778 INFO:tasks.workunit.client.0.smithi096.stdout:8/435: mkdir d0/d7/d86/d91 0 2024-04-18T04:58:03.780 INFO:tasks.workunit.client.0.smithi096.stdout:8/436: truncate d0/d7/f73 628496 0 2024-04-18T04:58:03.781 INFO:tasks.workunit.client.0.smithi096.stdout:7/469: creat db/d1f/d39/d6d/d79/f9e x:0 0 0 2024-04-18T04:58:03.781 INFO:tasks.workunit.client.0.smithi096.stdout:8/437: truncate d0/d3/f3a 4840195 0 2024-04-18T04:58:03.782 INFO:tasks.workunit.client.0.smithi096.stdout:7/470: fsync db/d1d/f21 0 2024-04-18T04:58:03.784 INFO:tasks.workunit.client.0.smithi096.stdout:8/438: fsync d0/d7/d24/d78/f4e 0 2024-04-18T04:58:03.786 INFO:tasks.workunit.client.0.smithi096.stdout:9/443: dwrite d0/de/d17/d56/d59/d68/f8e [0,4194304] 0 2024-04-18T04:58:03.788 INFO:tasks.workunit.client.0.smithi096.stdout:9/444: stat d0/de/d17/d56/l51 0 2024-04-18T04:58:03.789 INFO:tasks.workunit.client.0.smithi096.stdout:0/422: dread fd [0,4194304] 0 2024-04-18T04:58:03.791 INFO:tasks.workunit.client.0.smithi096.stdout:0/423: stat d16/d1c/d22/d3a/l75 0 2024-04-18T04:58:03.791 INFO:tasks.workunit.client.0.smithi096.stdout:1/577: dread de/d1d/f4a [0,4194304] 0 2024-04-18T04:58:03.793 INFO:tasks.workunit.client.0.smithi096.stdout:9/445: getdents d0/d52 0 2024-04-18T04:58:03.794 INFO:tasks.workunit.client.0.smithi096.stdout:0/424: rename d16/d1c/d22/d3a to d16/d1d/d7c 0 2024-04-18T04:58:03.794 INFO:tasks.workunit.client.0.smithi096.stdout:1/578: mknod de/d1d/d3f/d5f/cb8 0 2024-04-18T04:58:03.796 INFO:tasks.workunit.client.0.smithi096.stdout:9/446: rmdir d0/d52/d5a 39 2024-04-18T04:58:03.797 INFO:tasks.workunit.client.0.smithi096.stdout:0/425: unlink d16/d1c/d22/f2e 0 2024-04-18T04:58:03.798 INFO:tasks.workunit.client.0.smithi096.stdout:7/471: dread f7 [0,4194304] 0 2024-04-18T04:58:03.798 INFO:tasks.workunit.client.0.smithi096.stdout:9/447: chown d0/de/d17/d2f/l3e 1 1 2024-04-18T04:58:03.798 INFO:tasks.workunit.client.0.smithi096.stdout:0/426: chown d16/d1c/d22/d2c/f35 203294 1 2024-04-18T04:58:03.799 INFO:tasks.workunit.client.0.smithi096.stdout:1/579: rename de/d1d/d32/f4e to de/d1d/d3f/d7a/d96/fb9 0 2024-04-18T04:58:03.800 INFO:tasks.workunit.client.0.smithi096.stdout:9/448: mkdir d0/de/d99 0 2024-04-18T04:58:03.801 INFO:tasks.workunit.client.0.smithi096.stdout:7/472: symlink db/d1f/d5b/d6a/l9f 0 2024-04-18T04:58:03.803 INFO:tasks.workunit.client.0.smithi096.stdout:9/449: read d0/d25/d3a/f4a [800950,22377] 0 2024-04-18T04:58:03.804 INFO:tasks.workunit.client.0.smithi096.stdout:7/473: mknod db/d1f/d24/d49/ca0 0 2024-04-18T04:58:03.805 INFO:tasks.workunit.client.0.smithi096.stdout:8/439: dread d0/d7/d24/d18/f11 [0,4194304] 0 2024-04-18T04:58:03.805 INFO:tasks.workunit.client.0.smithi096.stdout:9/450: rmdir d0/de/d17/d56/d6d 39 2024-04-18T04:58:03.806 INFO:tasks.workunit.client.0.smithi096.stdout:8/440: stat d0/d3/d32/c4b 0 2024-04-18T04:58:03.807 INFO:tasks.workunit.client.0.smithi096.stdout:9/451: unlink d0/de/d17/f57 0 2024-04-18T04:58:03.808 INFO:tasks.workunit.client.0.smithi096.stdout:8/441: rmdir d0/d7/d24/d18/d7c 39 2024-04-18T04:58:03.809 INFO:tasks.workunit.client.0.smithi096.stdout:1/580: write de/f6a [357801,72912] 0 2024-04-18T04:58:03.810 INFO:tasks.workunit.client.0.smithi096.stdout:8/442: read - d0/d7/d24/d35/d51/d5b/f63 zero size 2024-04-18T04:58:03.811 INFO:tasks.workunit.client.0.smithi096.stdout:8/443: stat d0/d7/f2b 0 2024-04-18T04:58:03.811 INFO:tasks.workunit.client.0.smithi096.stdout:9/452: rename d0/de/f1c to d0/f9a 0 2024-04-18T04:58:03.813 INFO:tasks.workunit.client.0.smithi096.stdout:8/444: mknod d0/d7/d24/d35/d51/d5b/c92 0 2024-04-18T04:58:03.816 INFO:tasks.workunit.client.0.smithi096.stdout:6/701: dread d0/d6/d2e/d7a/fb4 [0,4194304] 0 2024-04-18T04:58:03.816 INFO:tasks.workunit.client.0.smithi096.stdout:9/453: creat d0/de/d17/d56/d59/d68/d96/f9b x:0 0 0 2024-04-18T04:58:03.817 INFO:tasks.workunit.client.0.smithi096.stdout:2/689: read df/d7a/f9d [3300303,91505] 0 2024-04-18T04:58:03.818 INFO:tasks.workunit.client.0.smithi096.stdout:8/445: chown d0/d7/d24/d18/c1c 30 1 2024-04-18T04:58:03.819 INFO:tasks.workunit.client.0.smithi096.stdout:6/702: mkdir d0/d6/d29/d83/dd3 0 2024-04-18T04:58:03.821 INFO:tasks.workunit.client.0.smithi096.stdout:7/474: dread db/d1f/d24/f2e [0,4194304] 0 2024-04-18T04:58:03.822 INFO:tasks.workunit.client.0.smithi096.stdout:8/446: chown d0/d7/d24/d18/f2d 15400642 1 2024-04-18T04:58:03.823 INFO:tasks.workunit.client.0.smithi096.stdout:6/703: creat d0/d6/d2b/d3b/dbb/fd4 x:0 0 0 2024-04-18T04:58:03.827 INFO:tasks.workunit.client.0.smithi096.stdout:2/690: link df/d18/d71/d9c/fd7 df/d18/d24/d42/dd9/fe2 0 2024-04-18T04:58:03.829 INFO:tasks.workunit.client.0.smithi096.stdout:1/581: dread de/f2f [0,4194304] 0 2024-04-18T04:58:03.833 INFO:tasks.workunit.client.0.smithi096.stdout:1/582: mknod de/d1d/d32/cba 0 2024-04-18T04:58:03.835 INFO:tasks.workunit.client.0.smithi096.stdout:2/691: dread df/f69 [0,4194304] 0 2024-04-18T04:58:03.835 INFO:tasks.workunit.client.0.smithi096.stdout:9/454: truncate d0/de/d17/d5c/f7c 1173265 0 2024-04-18T04:58:03.836 INFO:tasks.workunit.client.0.smithi096.stdout:8/447: dwrite d0/d7/d24/d18/f11 [0,4194304] 0 2024-04-18T04:58:03.837 INFO:tasks.workunit.client.0.smithi096.stdout:2/692: dread - df/d18/d71/d9c/fd7 zero size 2024-04-18T04:58:03.838 INFO:tasks.workunit.client.0.smithi096.stdout:1/583: creat de/d1d/d32/fbb x:0 0 0 2024-04-18T04:58:03.839 INFO:tasks.workunit.client.0.smithi096.stdout:2/693: write df/d18/d24/d42/d6e/fd4 [757813,72714] 0 2024-04-18T04:58:03.845 INFO:tasks.workunit.client.0.smithi096.stdout:2/694: creat df/d18/d26/fe3 x:0 0 0 2024-04-18T04:58:03.847 INFO:tasks.workunit.client.0.smithi096.stdout:3/665: dread dc/d26/d48/f4f [0,4194304] 0 2024-04-18T04:58:03.851 INFO:tasks.workunit.client.0.smithi096.stdout:8/448: dwrite d0/d4f/f79 [0,4194304] 0 2024-04-18T04:58:03.854 INFO:tasks.workunit.client.0.smithi096.stdout:2/695: creat df/d18/d24/d42/d3f/d4a/dbc/fe4 x:0 0 0 2024-04-18T04:58:03.854 INFO:tasks.workunit.client.0.smithi096.stdout:8/449: fsync d0/d7/d24/d35/f5e 0 2024-04-18T04:58:03.856 INFO:tasks.workunit.client.0.smithi096.stdout:3/666: link dc/f42 dc/d70/fd9 0 2024-04-18T04:58:03.856 INFO:tasks.workunit.client.0.smithi096.stdout:1/584: dwrite de/d1d/d32/d73/d8b/fb3 [0,4194304] 0 2024-04-18T04:58:03.858 INFO:tasks.workunit.client.0.smithi096.stdout:1/585: stat de/d1d/d81/da7 0 2024-04-18T04:58:03.858 INFO:tasks.workunit.client.0.smithi096.stdout:9/455: dread d0/de/d17/d2f/f42 [0,4194304] 0 2024-04-18T04:58:03.858 INFO:tasks.workunit.client.0.smithi096.stdout:2/696: mknod df/d18/d24/d42/d3f/d4a/dbc/ce5 0 2024-04-18T04:58:03.859 INFO:tasks.workunit.client.0.smithi096.stdout:3/667: creat dc/d5d/fda x:0 0 0 2024-04-18T04:58:03.860 INFO:tasks.workunit.client.0.smithi096.stdout:8/450: mkdir d0/d7/d86/d91/d93 0 2024-04-18T04:58:03.860 INFO:tasks.workunit.client.0.smithi096.stdout:1/586: symlink de/d1d/d32/d6f/lbc 0 2024-04-18T04:58:03.865 INFO:tasks.workunit.client.0.smithi096.stdout:3/668: creat dc/d26/d4a/d6b/fdb x:0 0 0 2024-04-18T04:58:03.866 INFO:tasks.workunit.client.0.smithi096.stdout:2/697: creat df/d18/d24/d42/d3f/fe6 x:0 0 0 2024-04-18T04:58:03.867 INFO:tasks.workunit.client.0.smithi096.stdout:8/451: symlink d0/d7/d24/d8d/l94 0 2024-04-18T04:58:03.868 INFO:tasks.workunit.client.0.smithi096.stdout:9/456: getdents d0/de/d17/d56/d59/d68/d96 0 2024-04-18T04:58:03.868 INFO:tasks.workunit.client.0.smithi096.stdout:2/698: rmdir df/d7d/d9f 39 2024-04-18T04:58:03.869 INFO:tasks.workunit.client.0.smithi096.stdout:8/452: creat d0/d7/d24/d8d/f95 x:0 0 0 2024-04-18T04:58:03.870 INFO:tasks.workunit.client.0.smithi096.stdout:8/453: fdatasync d0/d7/f73 0 2024-04-18T04:58:03.874 INFO:tasks.workunit.client.0.smithi096.stdout:8/454: chown d0/d7/d24/d18/c1c 15930 1 2024-04-18T04:58:03.875 INFO:tasks.workunit.client.0.smithi096.stdout:8/455: fsync d0/f4d 0 2024-04-18T04:58:03.876 INFO:tasks.workunit.client.0.smithi096.stdout:9/457: link d0/de/d17/c18 d0/de/d17/d56/c9c 0 2024-04-18T04:58:03.877 INFO:tasks.workunit.client.0.smithi096.stdout:3/669: dwrite dc/dcf/dd2/fd1 [0,4194304] 0 2024-04-18T04:58:03.878 INFO:tasks.workunit.client.0.smithi096.stdout:2/699: dwrite df/f16 [0,4194304] 0 2024-04-18T04:58:03.878 INFO:tasks.workunit.client.0.smithi096.stdout:8/456: mkdir d0/d3/d32/d6b/d96 0 2024-04-18T04:58:03.880 INFO:tasks.workunit.client.0.smithi096.stdout:9/458: write d0/de/d17/d56/d59/d68/d96/f9b [4820,113353] 0 2024-04-18T04:58:03.882 INFO:tasks.workunit.client.0.smithi096.stdout:2/700: rmdir df/d18/d24/d42/d3f/d4a/dbc 39 2024-04-18T04:58:03.883 INFO:tasks.workunit.client.0.smithi096.stdout:8/457: truncate d0/d7/d24/d18/d7c/f7e 5420446 0 2024-04-18T04:58:03.887 INFO:tasks.workunit.client.0.smithi096.stdout:9/459: truncate d0/d25/f35 486440 0 2024-04-18T04:58:03.889 INFO:tasks.workunit.client.0.smithi096.stdout:8/458: symlink d0/d4f/l97 0 2024-04-18T04:58:03.889 INFO:tasks.workunit.client.0.smithi096.stdout:2/701: dread df/d18/d26/d48/fc6 [0,4194304] 0 2024-04-18T04:58:03.890 INFO:tasks.workunit.client.0.smithi096.stdout:9/460: rmdir d0/de/d17/d56/d6d 39 2024-04-18T04:58:03.890 INFO:tasks.workunit.client.0.smithi096.stdout:2/702: chown df/d18/d26/c94 185340 1 2024-04-18T04:58:03.891 INFO:tasks.workunit.client.0.smithi096.stdout:8/459: creat d0/d7/d24/d18/d5d/f98 x:0 0 0 2024-04-18T04:58:03.894 INFO:tasks.workunit.client.0.smithi096.stdout:9/461: creat d0/d52/f9d x:0 0 0 2024-04-18T04:58:03.895 INFO:tasks.workunit.client.0.smithi096.stdout:2/703: rename df/d18/d24/l31 to df/d18/d99/le7 0 2024-04-18T04:58:03.895 INFO:tasks.workunit.client.0.smithi096.stdout:9/462: stat d0/c37 0 2024-04-18T04:58:03.898 INFO:tasks.workunit.client.0.smithi096.stdout:9/463: write d0/de/d17/d56/d59/d68/f72 [640738,74377] 0 2024-04-18T04:58:03.902 INFO:tasks.workunit.client.0.smithi096.stdout:8/460: dwrite d0/d3/d32/f72 [0,4194304] 0 2024-04-18T04:58:03.903 INFO:tasks.workunit.client.0.smithi096.stdout:8/461: fsync d0/d4f/f58 0 2024-04-18T04:58:03.906 INFO:tasks.workunit.client.0.smithi096.stdout:2/704: dwrite df/f14 [0,4194304] 0 2024-04-18T04:58:03.908 INFO:tasks.workunit.client.0.smithi096.stdout:2/705: write df/d18/d26/fb4 [524340,19729] 0 2024-04-18T04:58:03.908 INFO:tasks.workunit.client.0.smithi096.stdout:8/462: symlink d0/l99 0 2024-04-18T04:58:03.910 INFO:tasks.workunit.client.0.smithi096.stdout:9/464: getdents d0/de/d17/d56/d59 0 2024-04-18T04:58:03.911 INFO:tasks.workunit.client.0.smithi096.stdout:9/465: chown d0/de/d17/d2f/d40/d8b 14103934 1 2024-04-18T04:58:03.911 INFO:tasks.workunit.client.0.smithi096.stdout:2/706: dread df/d18/d26/d48/fa6 [0,4194304] 0 2024-04-18T04:58:03.915 INFO:tasks.workunit.client.0.smithi096.stdout:8/463: truncate d0/d7/d24/d35/f5e 182160 0 2024-04-18T04:58:03.918 INFO:tasks.workunit.client.0.smithi096.stdout:8/464: truncate d0/d7/d24/d35/d51/d5b/f89 268517 0 2024-04-18T04:58:03.919 INFO:tasks.workunit.client.0.smithi096.stdout:2/707: truncate df/d18/d24/d42/d3f/f43 1745274 0 2024-04-18T04:58:03.921 INFO:tasks.workunit.client.0.smithi096.stdout:9/466: dwrite d0/d52/d5a/f69 [0,4194304] 0 2024-04-18T04:58:03.921 INFO:tasks.workunit.client.0.smithi096.stdout:8/465: write d0/d7/d24/d18/d5d/f87 [337107,82626] 0 2024-04-18T04:58:03.925 INFO:tasks.workunit.client.0.smithi096.stdout:9/467: mknod d0/de/d99/c9e 0 2024-04-18T04:58:03.927 INFO:tasks.workunit.client.0.smithi096.stdout:9/468: creat d0/d25/d33/f9f x:0 0 0 2024-04-18T04:58:03.933 INFO:tasks.workunit.client.0.smithi096.stdout:8/466: dwrite d0/d4f/f79 [4194304,4194304] 0 2024-04-18T04:58:03.938 INFO:tasks.workunit.client.0.smithi096.stdout:9/469: dwrite d0/d52/d5a/f7d [0,4194304] 0 2024-04-18T04:58:03.942 INFO:tasks.workunit.client.0.smithi096.stdout:9/470: mknod d0/de/d99/ca0 0 2024-04-18T04:58:03.944 INFO:tasks.workunit.client.0.smithi096.stdout:9/471: rmdir d0/d41 39 2024-04-18T04:58:03.945 INFO:tasks.workunit.client.0.smithi096.stdout:8/467: dwrite d0/d15/f44 [0,4194304] 0 2024-04-18T04:58:03.947 INFO:tasks.workunit.client.0.smithi096.stdout:9/472: read - d0/de/d17/d56/d6d/f7f zero size 2024-04-18T04:58:03.951 INFO:tasks.workunit.client.0.smithi096.stdout:8/468: dread d0/d4f/f79 [4194304,4194304] 0 2024-04-18T04:58:03.953 INFO:tasks.workunit.client.0.smithi096.stdout:2/708: dread df/f10 [0,4194304] 0 2024-04-18T04:58:03.955 INFO:tasks.workunit.client.0.smithi096.stdout:8/469: rmdir d0/d7/d24/d18/d5d 39 2024-04-18T04:58:03.960 INFO:tasks.workunit.client.0.smithi096.stdout:9/473: dwrite d0/de/d17/d56/d59/d68/d96/f9b [0,4194304] 0 2024-04-18T04:58:03.961 INFO:tasks.workunit.client.0.smithi096.stdout:9/474: chown d0/d25/d33 4 1 2024-04-18T04:58:03.965 INFO:tasks.workunit.client.0.smithi096.stdout:8/470: dwrite d0/d3/d32/f90 [0,4194304] 0 2024-04-18T04:58:03.968 INFO:tasks.workunit.client.0.smithi096.stdout:8/471: rmdir d0/d7/d24/d8d 39 2024-04-18T04:58:03.971 INFO:tasks.workunit.client.0.smithi096.stdout:9/475: dwrite d0/de/d17/d2f/f84 [0,4194304] 0 2024-04-18T04:58:03.974 INFO:tasks.workunit.client.0.smithi096.stdout:9/476: creat d0/de/d17/d56/d59/d68/d96/fa1 x:0 0 0 2024-04-18T04:58:03.976 INFO:tasks.workunit.client.0.smithi096.stdout:9/477: chown d0/de/d17/d56/d59/d60/f77 199652 1 2024-04-18T04:58:03.977 INFO:tasks.workunit.client.0.smithi096.stdout:9/478: rmdir d0/d25 39 2024-04-18T04:58:03.983 INFO:tasks.workunit.client.0.smithi096.stdout:9/479: rmdir d0/de/d17 39 2024-04-18T04:58:03.983 INFO:tasks.workunit.client.0.smithi096.stdout:9/480: write d0/d25/d3a/f8f [180583,116516] 0 2024-04-18T04:58:03.983 INFO:tasks.workunit.client.0.smithi096.stdout:9/481: chown d0/de/d17/d56/d59 3295 1 2024-04-18T04:58:03.984 INFO:tasks.workunit.client.0.smithi096.stdout:9/482: write d0/de/d17/d2f/d40/f34 [4126758,52935] 0 2024-04-18T04:58:03.986 INFO:tasks.workunit.client.0.smithi096.stdout:9/483: truncate d0/de/d17/d2f/f84 4635046 0 2024-04-18T04:58:03.986 INFO:tasks.workunit.client.0.smithi096.stdout:9/484: dread - d0/d25/d33/f9f zero size 2024-04-18T04:58:03.988 INFO:tasks.workunit.client.0.smithi096.stdout:9/485: mknod d0/de/d17/d5c/ca2 0 2024-04-18T04:58:03.994 INFO:tasks.workunit.client.0.smithi096.stdout:9/486: dwrite d0/de/d17/f23 [0,4194304] 0 2024-04-18T04:58:03.999 INFO:tasks.workunit.client.0.smithi096.stdout:9/487: getdents d0/de/d17/d5c 0 2024-04-18T04:58:04.003 INFO:tasks.workunit.client.0.smithi096.stdout:9/488: rename d0/de/l12 to d0/d52/la3 0 2024-04-18T04:58:04.011 INFO:tasks.workunit.client.0.smithi096.stdout:9/489: dwrite d0/de/d17/d5c/f7c [0,4194304] 0 2024-04-18T04:58:04.015 INFO:tasks.workunit.client.0.smithi096.stdout:9/490: mknod d0/de/d17/ca4 0 2024-04-18T04:58:04.015 INFO:tasks.workunit.client.0.smithi096.stdout:9/491: fdatasync d0/de/f2d 0 2024-04-18T04:58:04.018 INFO:tasks.workunit.client.0.smithi096.stdout:9/492: mknod d0/de/d17/d2f/d40/d8b/ca5 0 2024-04-18T04:58:04.019 INFO:tasks.workunit.client.0.smithi096.stdout:9/493: write d0/de/d17/d56/d59/d68/d96/f9b [2097646,21471] 0 2024-04-18T04:58:04.022 INFO:tasks.workunit.client.0.smithi096.stdout:9/494: mknod d0/d41/ca6 0 2024-04-18T04:58:04.026 INFO:tasks.workunit.client.0.smithi096.stdout:9/495: dread d0/de/d17/d2f/f84 [0,4194304] 0 2024-04-18T04:58:04.133 INFO:tasks.workunit.client.0.smithi096.stdout:5/366: sync 2024-04-18T04:58:04.138 INFO:tasks.workunit.client.0.smithi096.stdout:5/367: truncate d7/d39/d36/f4f 661606 0 2024-04-18T04:58:04.146 INFO:tasks.workunit.client.0.smithi096.stdout:5/368: dread d7/d25/f2f [0,4194304] 0 2024-04-18T04:58:04.151 INFO:tasks.workunit.client.0.smithi096.stdout:5/369: symlink d7/d39/l90 0 2024-04-18T04:58:04.152 INFO:tasks.workunit.client.0.smithi096.stdout:5/370: fsync d7/dd/d35/f51 0 2024-04-18T04:58:04.156 INFO:tasks.workunit.client.0.smithi096.stdout:5/371: dread - d7/d25/d30/f6c zero size 2024-04-18T04:58:04.165 INFO:tasks.workunit.client.0.smithi096.stdout:5/372: getdents d7/dd/d35 0 2024-04-18T04:58:04.167 INFO:tasks.workunit.client.0.smithi096.stdout:5/373: read - d7/d39/d56/f83 zero size 2024-04-18T04:58:04.174 INFO:tasks.workunit.client.0.smithi096.stdout:5/374: fsync d7/d39/d36/f4f 0 2024-04-18T04:58:04.182 INFO:tasks.workunit.client.0.smithi096.stdout:5/375: getdents d7/d39/d78 0 2024-04-18T04:58:04.190 INFO:tasks.workunit.client.0.smithi096.stdout:5/376: creat d7/d25/f91 x:0 0 0 2024-04-18T04:58:04.192 INFO:tasks.workunit.client.0.smithi096.stdout:5/377: symlink d7/d25/l92 0 2024-04-18T04:58:04.209 INFO:tasks.workunit.client.0.smithi096.stdout:5/378: dwrite d7/d25/d7c/f87 [0,4194304] 0 2024-04-18T04:58:04.211 INFO:tasks.workunit.client.0.smithi096.stdout:5/379: dread - d7/dd/f6b zero size 2024-04-18T04:58:04.216 INFO:tasks.workunit.client.0.smithi096.stdout:5/380: symlink d7/d39/d36/l93 0 2024-04-18T04:58:04.220 INFO:tasks.workunit.client.0.smithi096.stdout:5/381: creat d7/d3b/f94 x:0 0 0 2024-04-18T04:58:04.225 INFO:tasks.workunit.client.0.smithi096.stdout:5/382: dread d7/d39/d56/f6a [0,4194304] 0 2024-04-18T04:58:04.251 INFO:tasks.workunit.client.0.smithi096.stdout:5/383: dread d7/f4c [0,4194304] 0 2024-04-18T04:58:04.252 INFO:tasks.workunit.client.0.smithi096.stdout:4/465: sync 2024-04-18T04:58:04.253 INFO:tasks.workunit.client.0.smithi096.stdout:5/384: write d7/d25/d30/f3a [1453919,109423] 0 2024-04-18T04:58:04.255 INFO:tasks.workunit.client.0.smithi096.stdout:5/385: chown d7/dd/d35 0 1 2024-04-18T04:58:04.256 INFO:tasks.workunit.client.0.smithi096.stdout:4/466: fdatasync d4/d14/d2d/d44/d58/d86/f76 0 2024-04-18T04:58:04.260 INFO:tasks.workunit.client.0.smithi096.stdout:5/386: mkdir d7/d3b/d95 0 2024-04-18T04:58:04.262 INFO:tasks.workunit.client.0.smithi096.stdout:5/387: read - d7/dd/d35/f51 zero size 2024-04-18T04:58:04.267 INFO:tasks.workunit.client.0.smithi096.stdout:4/467: dread d4/d14/d2d/d44/d58/d86/f4c [0,4194304] 0 2024-04-18T04:58:04.270 INFO:tasks.workunit.client.0.smithi096.stdout:4/468: fdatasync d4/d14/d2d/d44/d55/d67/f6d 0 2024-04-18T04:58:04.278 INFO:tasks.workunit.client.0.smithi096.stdout:4/469: creat d4/d14/d2d/d44/d58/d86/d3a/d39/d54/f91 x:0 0 0 2024-04-18T04:58:04.280 INFO:tasks.workunit.client.0.smithi096.stdout:5/388: truncate d7/d25/d2b/f75 744919 0 2024-04-18T04:58:04.281 INFO:tasks.workunit.client.0.smithi096.stdout:4/470: mknod d4/d14/d2d/d44/d89/c92 0 2024-04-18T04:58:04.289 INFO:tasks.workunit.client.0.smithi096.stdout:5/389: rename d7/dd/d8f/d5e/f7b to d7/d39/f96 0 2024-04-18T04:58:04.296 INFO:tasks.workunit.client.0.smithi096.stdout:5/390: mkdir d7/d39/d36/d97 0 2024-04-18T04:58:04.296 INFO:tasks.workunit.client.0.smithi096.stdout:5/391: readlink d7/d25/l2a 0 2024-04-18T04:58:04.301 INFO:tasks.workunit.client.0.smithi096.stdout:4/471: rmdir d4/d14/d2d/d44/d58/d86/d3a/d47/d8a 0 2024-04-18T04:58:04.309 INFO:tasks.workunit.client.0.smithi096.stdout:4/472: rename d4/d14/d2d/d44/d58/d86/d78 to d4/d14/d2d/d44/d58/d86/d6f/d93 0 2024-04-18T04:58:04.313 INFO:tasks.workunit.client.0.smithi096.stdout:5/392: getdents d7/d3b 0 2024-04-18T04:58:04.320 INFO:tasks.workunit.client.0.smithi096.stdout:5/393: rename d7/dd/l1c to d7/dd/d8f/d5e/l98 0 2024-04-18T04:58:04.329 INFO:tasks.workunit.client.0.smithi096.stdout:5/394: creat d7/d25/d30/f99 x:0 0 0 2024-04-18T04:58:04.329 INFO:tasks.workunit.client.0.smithi096.stdout:4/473: dread d4/d14/d2d/d44/d58/d86/d3a/d39/f56 [0,4194304] 0 2024-04-18T04:58:04.330 INFO:tasks.workunit.client.0.smithi096.stdout:0/427: sync 2024-04-18T04:58:04.331 INFO:tasks.workunit.client.0.smithi096.stdout:0/428: read - d16/d1d/d3b/f6e zero size 2024-04-18T04:58:04.338 INFO:tasks.workunit.client.0.smithi096.stdout:0/429: dread d16/d1d/d7c/f5e [0,4194304] 0 2024-04-18T04:58:04.347 INFO:tasks.workunit.client.0.smithi096.stdout:0/430: mknod d16/d1c/d4c/d4d/d5d/c7d 0 2024-04-18T04:58:04.353 INFO:tasks.workunit.client.0.smithi096.stdout:0/431: read d16/f1b [1986251,48186] 0 2024-04-18T04:58:04.353 INFO:tasks.workunit.client.0.smithi096.stdout:4/474: dread d4/d14/d16/f3f [0,4194304] 0 2024-04-18T04:58:04.358 INFO:tasks.workunit.client.0.smithi096.stdout:0/432: mknod d16/d55/c7e 0 2024-04-18T04:58:04.359 INFO:tasks.workunit.client.0.smithi096.stdout:5/395: dwrite d7/d39/f20 [4194304,4194304] 0 2024-04-18T04:58:04.359 INFO:tasks.workunit.client.0.smithi096.stdout:4/475: creat d4/d14/d2d/d44/d58/d86/d3a/d47/f94 x:0 0 0 2024-04-18T04:58:04.366 INFO:tasks.workunit.client.0.smithi096.stdout:5/396: truncate d7/d25/d58/f62 736823 0 2024-04-18T04:58:04.367 INFO:tasks.workunit.client.0.smithi096.stdout:0/433: write d16/f26 [3168772,45766] 0 2024-04-18T04:58:04.368 INFO:tasks.workunit.client.0.smithi096.stdout:4/476: write d4/d14/d2d/d44/d58/d86/d3a/d39/d54/f91 [271584,117040] 0 2024-04-18T04:58:04.371 INFO:tasks.workunit.client.0.smithi096.stdout:5/397: truncate d7/d25/d30/f6c 82632 0 2024-04-18T04:58:04.376 INFO:tasks.workunit.client.0.smithi096.stdout:7/475: sync 2024-04-18T04:58:04.376 INFO:tasks.workunit.client.0.smithi096.stdout:6/704: sync 2024-04-18T04:58:04.384 INFO:tasks.workunit.client.0.smithi096.stdout:0/434: write d16/d1c/d4c/d4d/d36/f39 [1087910,38286] 0 2024-04-18T04:58:04.398 INFO:tasks.workunit.client.0.smithi096.stdout:0/435: fsync d16/d1c/d22/d2c/f30 0 2024-04-18T04:58:04.398 INFO:tasks.workunit.client.0.smithi096.stdout:5/398: dwrite d7/dd/d8f/f15 [0,4194304] 0 2024-04-18T04:58:04.401 INFO:tasks.workunit.client.0.smithi096.stdout:6/705: mkdir d0/d6/d2b/d3b/d69/d66/dcf/dd5 0 2024-04-18T04:58:04.403 INFO:tasks.workunit.client.0.smithi096.stdout:5/399: write d7/dd/f6b [131646,114812] 0 2024-04-18T04:58:04.409 INFO:tasks.workunit.client.0.smithi096.stdout:0/436: mknod d16/d1d/d3b/c7f 0 2024-04-18T04:58:04.409 INFO:tasks.workunit.client.0.smithi096.stdout:5/400: write d7/d39/f26 [1676985,7651] 0 2024-04-18T04:58:04.409 INFO:tasks.workunit.client.0.smithi096.stdout:4/477: dread d4/d14/d2d/d44/f5e [0,4194304] 0 2024-04-18T04:58:04.409 INFO:tasks.workunit.client.0.smithi096.stdout:5/401: write d7/dd/f2c [124093,9781] 0 2024-04-18T04:58:04.411 INFO:tasks.workunit.client.0.smithi096.stdout:6/706: fdatasync d0/d6/d2b/d3b/dbb/fd0 0 2024-04-18T04:58:04.412 INFO:tasks.workunit.client.0.smithi096.stdout:4/478: write d4/d14/d2d/d44/d58/d86/d3a/d39/f51 [876657,18495] 0 2024-04-18T04:58:04.413 INFO:tasks.workunit.client.0.smithi096.stdout:5/402: write d7/d25/d7c/f87 [384233,80211] 0 2024-04-18T04:58:04.414 INFO:tasks.workunit.client.0.smithi096.stdout:0/437: rename d16/d1c/d4c/d4d/c6f to d16/d55/c80 0 2024-04-18T04:58:04.415 INFO:tasks.workunit.client.0.smithi096.stdout:6/707: write d0/d6/d2b/d3b/d69/fba [473091,102] 0 2024-04-18T04:58:04.415 INFO:tasks.workunit.client.0.smithi096.stdout:5/403: chown d7 174298 1 2024-04-18T04:58:04.416 INFO:tasks.workunit.client.0.smithi096.stdout:5/404: chown d7/fe 96394 1 2024-04-18T04:58:04.417 INFO:tasks.workunit.client.0.smithi096.stdout:7/476: dread db/d20/d2f/f37 [4194304,4194304] 0 2024-04-18T04:58:04.418 INFO:tasks.workunit.client.0.smithi096.stdout:7/477: fsync db/d1f/f7d 0 2024-04-18T04:58:04.424 INFO:tasks.workunit.client.0.smithi096.stdout:8/472: sync 2024-04-18T04:58:04.425 INFO:tasks.workunit.client.0.smithi096.stdout:1/587: sync 2024-04-18T04:58:04.425 INFO:tasks.workunit.client.0.smithi096.stdout:9/496: sync 2024-04-18T04:58:04.425 INFO:tasks.workunit.client.0.smithi096.stdout:2/709: sync 2024-04-18T04:58:04.425 INFO:tasks.workunit.client.0.smithi096.stdout:3/670: sync 2024-04-18T04:58:04.426 INFO:tasks.workunit.client.0.smithi096.stdout:6/708: unlink d0/d6/d2b/cc2 0 2024-04-18T04:58:04.427 INFO:tasks.workunit.client.0.smithi096.stdout:5/405: rmdir d7/dd/d35 39 2024-04-18T04:58:04.428 INFO:tasks.workunit.client.0.smithi096.stdout:3/671: dread dc/dcf/dd2/f6a [0,4194304] 0 2024-04-18T04:58:04.435 INFO:tasks.workunit.client.0.smithi096.stdout:4/479: rename d4/le to d4/d7a/l95 0 2024-04-18T04:58:04.440 INFO:tasks.workunit.client.0.smithi096.stdout:1/588: chown de/d1d/c2c 392685 1 2024-04-18T04:58:04.445 INFO:tasks.workunit.client.0.smithi096.stdout:2/710: unlink df/d18/d71/lab 0 2024-04-18T04:58:04.447 INFO:tasks.workunit.client.0.smithi096.stdout:8/473: dread - d0/d7/d24/d18/d5d/f83 zero size 2024-04-18T04:58:04.455 INFO:tasks.workunit.client.0.smithi096.stdout:4/480: creat d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/f96 x:0 0 0 2024-04-18T04:58:04.456 INFO:tasks.workunit.client.0.smithi096.stdout:8/474: dwrite d0/d7/d24/d78/f61 [0,4194304] 0 2024-04-18T04:58:04.456 INFO:tasks.workunit.client.0.smithi096.stdout:9/497: unlink d0/l24 0 2024-04-18T04:58:04.457 INFO:tasks.workunit.client.0.smithi096.stdout:4/481: write d4/d14/f72 [979819,104880] 0 2024-04-18T04:58:04.458 INFO:tasks.workunit.client.0.smithi096.stdout:1/589: unlink de/d1d/l2b 0 2024-04-18T04:58:04.462 INFO:tasks.workunit.client.0.smithi096.stdout:2/711: dread - df/d18/d24/d42/d3f/fa3 zero size 2024-04-18T04:58:04.464 INFO:tasks.workunit.client.0.smithi096.stdout:7/478: dwrite db/f31 [0,4194304] 0 2024-04-18T04:58:04.469 INFO:tasks.workunit.client.0.smithi096.stdout:9/498: dread d0/de/f2d [0,4194304] 0 2024-04-18T04:58:04.478 INFO:tasks.workunit.client.0.smithi096.stdout:3/672: write dc/d26/d48/f4f [3872377,34600] 0 2024-04-18T04:58:04.480 INFO:tasks.workunit.client.0.smithi096.stdout:0/438: truncate d16/d1c/d4c/d4d/d36/f39 2176522 0 2024-04-18T04:58:04.480 INFO:tasks.workunit.client.0.smithi096.stdout:3/673: dread - dc/d26/d48/dc2/fad zero size 2024-04-18T04:58:04.484 INFO:tasks.workunit.client.0.smithi096.stdout:0/439: chown d16/d1c/d22/d2c/f35 27 1 2024-04-18T04:58:04.484 INFO:tasks.workunit.client.0.smithi096.stdout:6/709: dwrite d0/d6/d5d/f70 [0,4194304] 0 2024-04-18T04:58:04.487 INFO:tasks.workunit.client.0.smithi096.stdout:2/712: mkdir df/d18/d24/de8 0 2024-04-18T04:58:04.489 INFO:tasks.workunit.client.0.smithi096.stdout:8/475: write d0/f55 [6455495,66876] 0 2024-04-18T04:58:04.491 INFO:tasks.workunit.client.0.smithi096.stdout:3/674: mknod dc/d26/d48/dc2/d95/cdc 0 2024-04-18T04:58:04.491 INFO:tasks.workunit.client.0.smithi096.stdout:4/482: write d4/d14/d2d/d44/d58/d86/d3a/d39/f59 [372987,106483] 0 2024-04-18T04:58:04.492 INFO:tasks.workunit.client.0.smithi096.stdout:0/440: mkdir d16/d1c/d22/d2c/d81 0 2024-04-18T04:58:04.492 INFO:tasks.workunit.client.0.smithi096.stdout:4/483: chown d4/c12 2249208 1 2024-04-18T04:58:04.495 INFO:tasks.workunit.client.0.smithi096.stdout:6/710: mknod d0/d6/d2b/d3b/d7d/cd6 0 2024-04-18T04:58:04.496 INFO:tasks.workunit.client.0.smithi096.stdout:4/484: truncate d4/d14/d2d/d44/d58/d86/d3a/d39/f51 4341676 0 2024-04-18T04:58:04.496 INFO:tasks.workunit.client.0.smithi096.stdout:7/479: dread db/f18 [0,4194304] 0 2024-04-18T04:58:04.498 INFO:tasks.workunit.client.0.smithi096.stdout:2/713: creat df/d18/d71/d75/fe9 x:0 0 0 2024-04-18T04:58:04.499 INFO:tasks.workunit.client.0.smithi096.stdout:9/499: write d0/de/d17/d56/d59/d68/f98 [1008895,45759] 0 2024-04-18T04:58:04.499 INFO:tasks.workunit.client.0.smithi096.stdout:1/590: truncate de/d1d/d32/f69 719126 0 2024-04-18T04:58:04.499 INFO:tasks.workunit.client.0.smithi096.stdout:8/476: stat d0/d7/d24/d35/d51/l6e 0 2024-04-18T04:58:04.502 INFO:tasks.workunit.client.0.smithi096.stdout:8/477: fdatasync d0/d7/d24/d35/d51/f7f 0 2024-04-18T04:58:04.502 INFO:tasks.workunit.client.0.smithi096.stdout:6/711: mknod d0/d6/d5d/cd7 0 2024-04-18T04:58:04.505 INFO:tasks.workunit.client.0.smithi096.stdout:4/485: mkdir d4/d14/d2d/d44/d58/d86/d97 0 2024-04-18T04:58:04.507 INFO:tasks.workunit.client.0.smithi096.stdout:4/486: fsync d4/d14/d2d/d44/f5f 0 2024-04-18T04:58:04.507 INFO:tasks.workunit.client.0.smithi096.stdout:3/675: creat dc/d26/d48/dbd/dd3/fdd x:0 0 0 2024-04-18T04:58:04.509 INFO:tasks.workunit.client.0.smithi096.stdout:1/591: creat de/d1d/d3f/d9b/fbd x:0 0 0 2024-04-18T04:58:04.509 INFO:tasks.workunit.client.0.smithi096.stdout:9/500: dwrite d0/de/d17/d56/f6a [0,4194304] 0 2024-04-18T04:58:04.511 INFO:tasks.workunit.client.0.smithi096.stdout:0/441: write d16/f42 [8005350,44237] 0 2024-04-18T04:58:04.511 INFO:tasks.workunit.client.0.smithi096.stdout:7/480: truncate db/f48 4627719 0 2024-04-18T04:58:04.512 INFO:tasks.workunit.client.0.smithi096.stdout:8/478: chown d0/d15/l7a 15 1 2024-04-18T04:58:04.517 INFO:tasks.workunit.client.0.smithi096.stdout:2/714: dread df/d18/d24/faf [0,4194304] 0 2024-04-18T04:58:04.517 INFO:tasks.workunit.client.0.smithi096.stdout:1/592: creat de/fbe x:0 0 0 2024-04-18T04:58:04.518 INFO:tasks.workunit.client.0.smithi096.stdout:6/712: mkdir d0/d6/d2b/d3b/d69/d6c/dd8 0 2024-04-18T04:58:04.519 INFO:tasks.workunit.client.0.smithi096.stdout:0/442: unlink d16/d1c/l44 0 2024-04-18T04:58:04.520 INFO:tasks.workunit.client.0.smithi096.stdout:2/715: chown df/d18/ldd 588 1 2024-04-18T04:58:04.522 INFO:tasks.workunit.client.0.smithi096.stdout:8/479: chown d0/d7/d24/d18/l53 29301 1 2024-04-18T04:58:04.523 INFO:tasks.workunit.client.0.smithi096.stdout:3/676: dread dc/dcf/dd2/fd1 [0,4194304] 0 2024-04-18T04:58:04.524 INFO:tasks.workunit.client.0.smithi096.stdout:0/443: write d16/f21 [959079,28506] 0 2024-04-18T04:58:04.524 INFO:tasks.workunit.client.0.smithi096.stdout:4/487: rename d4/d14/d16/c17 to d4/d14/c98 0 2024-04-18T04:58:04.526 INFO:tasks.workunit.client.0.smithi096.stdout:2/716: creat df/d18/d71/db8/fea x:0 0 0 2024-04-18T04:58:04.527 INFO:tasks.workunit.client.0.smithi096.stdout:5/406: sync 2024-04-18T04:58:04.528 INFO:tasks.workunit.client.0.smithi096.stdout:7/481: rename db/d1f/d39/d6d/d93 to db/d20/d2f/d8d/da1 0 2024-04-18T04:58:04.529 INFO:tasks.workunit.client.0.smithi096.stdout:9/501: dwrite d0/d52/f9d [0,4194304] 0 2024-04-18T04:58:04.531 INFO:tasks.workunit.client.0.smithi096.stdout:5/407: readlink d7/d39/d36/l67 0 2024-04-18T04:58:04.531 INFO:tasks.workunit.client.0.smithi096.stdout:6/713: dread d0/d73/f96 [0,4194304] 0 2024-04-18T04:58:04.533 INFO:tasks.workunit.client.0.smithi096.stdout:8/480: symlink d0/d7/d24/d78/l9a 0 2024-04-18T04:58:04.534 INFO:tasks.workunit.client.0.smithi096.stdout:3/677: truncate dc/d26/d48/dc2/fab 965726 0 2024-04-18T04:58:04.534 INFO:tasks.workunit.client.0.smithi096.stdout:2/717: rename df/d18/d26/fe3 to df/d18/d71/feb 0 2024-04-18T04:58:04.537 INFO:tasks.workunit.client.0.smithi096.stdout:5/408: mkdir d7/d39/d36/d6f/d9a 0 2024-04-18T04:58:04.537 INFO:tasks.workunit.client.0.smithi096.stdout:6/714: write d0/d6/d2e/f48 [2335213,129709] 0 2024-04-18T04:58:04.538 INFO:tasks.workunit.client.0.smithi096.stdout:9/502: rename d0/d52/d5a/f85 to d0/d52/d5a/fa7 0 2024-04-18T04:58:04.541 INFO:tasks.workunit.client.0.smithi096.stdout:5/409: stat d7/dd/c47 0 2024-04-18T04:58:04.542 INFO:tasks.workunit.client.0.smithi096.stdout:2/718: write df/d18/d24/d42/d6e/f8b [2145658,35258] 0 2024-04-18T04:58:04.542 INFO:tasks.workunit.client.0.smithi096.stdout:1/593: dwrite de/d1d/d3f/d9b/fb2 [4194304,4194304] 0 2024-04-18T04:58:04.544 INFO:tasks.workunit.client.0.smithi096.stdout:3/678: truncate dc/d26/d48/dc2/fad 674571 0 2024-04-18T04:58:04.548 INFO:tasks.workunit.client.0.smithi096.stdout:5/410: write d7/d25/f4d [2868763,105968] 0 2024-04-18T04:58:04.549 INFO:tasks.workunit.client.0.smithi096.stdout:6/715: chown d0/d6/d2b/d7e/lb9 82 1 2024-04-18T04:58:04.550 INFO:tasks.workunit.client.0.smithi096.stdout:9/503: mkdir d0/de/d17/d2f/d40/da8 0 2024-04-18T04:58:04.552 INFO:tasks.workunit.client.0.smithi096.stdout:7/482: truncate db/d1d/d82/f8c 227033 0 2024-04-18T04:58:04.553 INFO:tasks.workunit.client.0.smithi096.stdout:0/444: dwrite d16/d1c/d4c/d4d/d5d/f76 [0,4194304] 0 2024-04-18T04:58:04.553 INFO:tasks.workunit.client.0.smithi096.stdout:2/719: symlink df/lec 0 2024-04-18T04:58:04.554 INFO:tasks.workunit.client.0.smithi096.stdout:9/504: chown d0/c37 53404 1 2024-04-18T04:58:04.555 INFO:tasks.workunit.client.0.smithi096.stdout:4/488: dwrite d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/f74 [4194304,4194304] 0 2024-04-18T04:58:04.556 INFO:tasks.workunit.client.0.smithi096.stdout:3/679: symlink dc/d26/d4a/d6b/lde 0 2024-04-18T04:58:04.560 INFO:tasks.workunit.client.0.smithi096.stdout:6/716: creat d0/d6/d2e/d7a/fd9 x:0 0 0 2024-04-18T04:58:04.560 INFO:tasks.workunit.client.0.smithi096.stdout:8/481: getdents d0/d7/d24/d35/d51/d5b 0 2024-04-18T04:58:04.560 INFO:tasks.workunit.client.0.smithi096.stdout:1/594: write de/d7b/f88 [864510,9733] 0 2024-04-18T04:58:04.562 INFO:tasks.workunit.client.0.smithi096.stdout:3/680: fdatasync dc/d26/d48/dc2/f63 0 2024-04-18T04:58:04.569 INFO:tasks.workunit.client.0.smithi096.stdout:5/411: creat d7/dd/f9b x:0 0 0 2024-04-18T04:58:04.570 INFO:tasks.workunit.client.0.smithi096.stdout:6/717: rmdir d0/d6/d2e 39 2024-04-18T04:58:04.571 INFO:tasks.workunit.client.0.smithi096.stdout:7/483: write db/d1f/f41 [239713,1181] 0 2024-04-18T04:58:04.573 INFO:tasks.workunit.client.0.smithi096.stdout:8/482: creat d0/d7/d24/d18/d27/d3c/f9b x:0 0 0 2024-04-18T04:58:04.574 INFO:tasks.workunit.client.0.smithi096.stdout:1/595: link de/d1d/d81/fb6 de/d1d/fbf 0 2024-04-18T04:58:04.575 INFO:tasks.workunit.client.0.smithi096.stdout:2/720: dwrite df/d18/f89 [0,4194304] 0 2024-04-18T04:58:04.576 INFO:tasks.workunit.client.0.smithi096.stdout:3/681: write dc/d26/d66/fb3 [3258446,3612] 0 2024-04-18T04:58:04.577 INFO:tasks.workunit.client.0.smithi096.stdout:7/484: chown db/d1f/d4e/c4f 302996 1 2024-04-18T04:58:04.578 INFO:tasks.workunit.client.0.smithi096.stdout:9/505: dwrite d0/d52/d5a/f7d [0,4194304] 0 2024-04-18T04:58:04.580 INFO:tasks.workunit.client.0.smithi096.stdout:6/718: chown d0/d6/cbd 9797687 1 2024-04-18T04:58:04.580 INFO:tasks.workunit.client.0.smithi096.stdout:5/412: mknod d7/d25/c9c 0 2024-04-18T04:58:04.584 INFO:tasks.workunit.client.0.smithi096.stdout:5/413: write d7/dd/f2c [1172870,118412] 0 2024-04-18T04:58:04.586 INFO:tasks.workunit.client.0.smithi096.stdout:1/596: rename de/d1d/d32/fbb to de/d1d/d81/da7/fc0 0 2024-04-18T04:58:04.587 INFO:tasks.workunit.client.0.smithi096.stdout:8/483: read d0/d15/d65/f6a [345739,95225] 0 2024-04-18T04:58:04.588 INFO:tasks.workunit.client.0.smithi096.stdout:0/445: dwrite d16/d1c/d22/f28 [4194304,4194304] 0 2024-04-18T04:58:04.588 INFO:tasks.workunit.client.0.smithi096.stdout:9/506: rmdir d0/de 39 2024-04-18T04:58:04.594 INFO:tasks.workunit.client.0.smithi096.stdout:2/721: creat df/d18/d71/d9c/db6/fed x:0 0 0 2024-04-18T04:58:04.594 INFO:tasks.workunit.client.0.smithi096.stdout:3/682: write dc/f42 [717579,80297] 0 2024-04-18T04:58:04.594 INFO:tasks.workunit.client.0.smithi096.stdout:5/414: creat d7/d3b/f9d x:0 0 0 2024-04-18T04:58:04.595 INFO:tasks.workunit.client.0.smithi096.stdout:4/489: dwrite d4/d14/d2d/d44/d58/f88 [0,4194304] 0 2024-04-18T04:58:04.595 INFO:tasks.workunit.client.0.smithi096.stdout:8/484: rmdir d0/d7/d24/d35 39 2024-04-18T04:58:04.598 INFO:tasks.workunit.client.0.smithi096.stdout:9/507: mknod d0/d52/d5a/ca9 0 2024-04-18T04:58:04.599 INFO:tasks.workunit.client.0.smithi096.stdout:0/446: symlink d16/d1c/d4c/d6a/l82 0 2024-04-18T04:58:04.602 INFO:tasks.workunit.client.0.smithi096.stdout:7/485: creat db/d1f/d24/d49/fa2 x:0 0 0 2024-04-18T04:58:04.603 INFO:tasks.workunit.client.0.smithi096.stdout:3/683: rename dc/d26/d4a/d6b to dc/d26/d4a/ddf 0 2024-04-18T04:58:04.606 INFO:tasks.workunit.client.0.smithi096.stdout:8/485: creat d0/d15/d65/d8f/f9c x:0 0 0 2024-04-18T04:58:04.607 INFO:tasks.workunit.client.0.smithi096.stdout:4/490: symlink d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/l99 0 2024-04-18T04:58:04.607 INFO:tasks.workunit.client.0.smithi096.stdout:1/597: dwrite de/f2f [4194304,4194304] 0 2024-04-18T04:58:04.607 INFO:tasks.workunit.client.0.smithi096.stdout:3/684: write dc/d5d/f9b [1957619,51711] 0 2024-04-18T04:58:04.609 INFO:tasks.workunit.client.0.smithi096.stdout:0/447: truncate d16/d1d/f1e 1397504 0 2024-04-18T04:58:04.610 INFO:tasks.workunit.client.0.smithi096.stdout:5/415: mkdir d7/d25/d30/d9e 0 2024-04-18T04:58:04.612 INFO:tasks.workunit.client.0.smithi096.stdout:2/722: truncate df/d18/d71/d75/f88 832253 0 2024-04-18T04:58:04.613 INFO:tasks.workunit.client.0.smithi096.stdout:5/416: chown d7/dd/f6b 4165 1 2024-04-18T04:58:04.615 INFO:tasks.workunit.client.0.smithi096.stdout:3/685: creat dc/d5d/fe0 x:0 0 0 2024-04-18T04:58:04.617 INFO:tasks.workunit.client.0.smithi096.stdout:8/486: write d0/d7/d24/d18/d5d/f87 [1407652,92491] 0 2024-04-18T04:58:04.618 INFO:tasks.workunit.client.0.smithi096.stdout:0/448: fsync d16/d1c/d22/d2c/f30 0 2024-04-18T04:58:04.623 INFO:tasks.workunit.client.0.smithi096.stdout:8/487: fsync d0/d3/f6c 0 2024-04-18T04:58:04.623 INFO:tasks.workunit.client.0.smithi096.stdout:2/723: read df/d18/d24/d42/d6e/fd4 [2438707,109043] 0 2024-04-18T04:58:04.625 INFO:tasks.workunit.client.0.smithi096.stdout:4/491: dread d4/d14/d16/f3f [0,4194304] 0 2024-04-18T04:58:04.627 INFO:tasks.workunit.client.0.smithi096.stdout:3/686: truncate dc/d26/d4a/d8b/f99 34061 0 2024-04-18T04:58:04.628 INFO:tasks.workunit.client.0.smithi096.stdout:2/724: readlink df/d18/d24/d42/d3f/ldb 0 2024-04-18T04:58:04.628 INFO:tasks.workunit.client.0.smithi096.stdout:0/449: creat d16/d1c/d4c/d4d/d5a/f83 x:0 0 0 2024-04-18T04:58:04.629 INFO:tasks.workunit.client.0.smithi096.stdout:9/508: truncate d0/de/d17/d56/d59/f65 3404499 0 2024-04-18T04:58:04.629 INFO:tasks.workunit.client.0.smithi096.stdout:7/486: dwrite db/d1f/d42/f5f [8388608,4194304] 0 2024-04-18T04:58:04.631 INFO:tasks.workunit.client.0.smithi096.stdout:8/488: dread - d0/d7/d24/d18/d27/d3c/f9b zero size 2024-04-18T04:58:04.634 INFO:tasks.workunit.client.0.smithi096.stdout:1/598: getdents de/d1d/d32/d6f/d85 0 2024-04-18T04:58:04.634 INFO:tasks.workunit.client.0.smithi096.stdout:5/417: dwrite d7/d39/d52/f6d [0,4194304] 0 2024-04-18T04:58:04.636 INFO:tasks.workunit.client.0.smithi096.stdout:8/489: dread - d0/d7/d24/d18/d5d/f83 zero size 2024-04-18T04:58:04.638 INFO:tasks.workunit.client.0.smithi096.stdout:7/487: read db/d1f/f41 [264280,76225] 0 2024-04-18T04:58:04.639 INFO:tasks.workunit.client.0.smithi096.stdout:3/687: rename dc/d26/d48/dc2/c2c to dc/dcf/ce1 0 2024-04-18T04:58:04.642 INFO:tasks.workunit.client.0.smithi096.stdout:4/492: write d4/d14/d2d/d44/d58/d86/f36 [153102,12625] 0 2024-04-18T04:58:04.646 INFO:tasks.workunit.client.0.smithi096.stdout:5/418: dwrite d7/d25/f4d [0,4194304] 0 2024-04-18T04:58:04.647 INFO:tasks.workunit.client.0.smithi096.stdout:5/419: dread - d7/d3b/f94 zero size 2024-04-18T04:58:04.651 INFO:tasks.workunit.client.0.smithi096.stdout:9/509: fsync d0/de/d17/d2f/f42 0 2024-04-18T04:58:04.653 INFO:tasks.workunit.client.0.smithi096.stdout:7/488: chown db/d20/c3c 21097 1 2024-04-18T04:58:04.654 INFO:tasks.workunit.client.0.smithi096.stdout:9/510: fdatasync d0/de/d17/d2f/d40/f61 0 2024-04-18T04:58:04.656 INFO:tasks.workunit.client.0.smithi096.stdout:0/450: write d16/d1c/d4c/d4d/d36/f39 [1719327,22811] 0 2024-04-18T04:58:04.658 INFO:tasks.workunit.client.0.smithi096.stdout:9/511: fsync d0/d52/f9d 0 2024-04-18T04:58:04.658 INFO:tasks.workunit.client.0.smithi096.stdout:7/489: rmdir db/d1f/d5b 39 2024-04-18T04:58:04.659 INFO:tasks.workunit.client.0.smithi096.stdout:5/420: mknod d7/d39/d36/d6f/d9a/c9f 0 2024-04-18T04:58:04.660 INFO:tasks.workunit.client.0.smithi096.stdout:9/512: write d0/de/d17/d56/d59/d68/f98 [1217454,72236] 0 2024-04-18T04:58:04.660 INFO:tasks.workunit.client.0.smithi096.stdout:5/421: truncate d7/f46 4458818 0 2024-04-18T04:58:04.661 INFO:tasks.workunit.client.0.smithi096.stdout:1/599: dread fa [0,4194304] 0 2024-04-18T04:58:04.661 INFO:tasks.workunit.client.0.smithi096.stdout:8/490: truncate d0/d7/f2b 3058803 0 2024-04-18T04:58:04.663 INFO:tasks.workunit.client.0.smithi096.stdout:1/600: write de/d1d/d3f/d9b/fb2 [2236830,119890] 0 2024-04-18T04:58:04.663 INFO:tasks.workunit.client.0.smithi096.stdout:2/725: rename df/d18/d24/d42/d3f/d4a/dbc/fce to df/d7d/fee 0 2024-04-18T04:58:04.664 INFO:tasks.workunit.client.0.smithi096.stdout:1/601: dread - de/d1d/d32/d9a/dad/fb4 zero size 2024-04-18T04:58:04.665 INFO:tasks.workunit.client.0.smithi096.stdout:0/451: unlink d16/d1c/d4c/l69 0 2024-04-18T04:58:04.668 INFO:tasks.workunit.client.0.smithi096.stdout:5/422: rmdir d7/d3b 39 2024-04-18T04:58:04.669 INFO:tasks.workunit.client.0.smithi096.stdout:3/688: dread dc/f1b [0,4194304] 0 2024-04-18T04:58:04.673 INFO:tasks.workunit.client.0.smithi096.stdout:4/493: dwrite d4/d14/d2d/d44/d58/d86/d6f/f77 [0,4194304] 0 2024-04-18T04:58:04.674 INFO:tasks.workunit.client.0.smithi096.stdout:9/513: rename d0/d25/d33/c39 to d0/de/d17/d56/d59/caa 0 2024-04-18T04:58:04.675 INFO:tasks.workunit.client.0.smithi096.stdout:1/602: symlink de/lc1 0 2024-04-18T04:58:04.677 INFO:tasks.workunit.client.0.smithi096.stdout:2/726: creat df/d18/d71/db8/fef x:0 0 0 2024-04-18T04:58:04.679 INFO:tasks.workunit.client.0.smithi096.stdout:8/491: creat d0/d7/d24/d35/f9d x:0 0 0 2024-04-18T04:58:04.684 INFO:tasks.workunit.client.0.smithi096.stdout:1/603: mkdir de/d1d/d32/d73/d8b/dc2 0 2024-04-18T04:58:04.685 INFO:tasks.workunit.client.0.smithi096.stdout:7/490: dread db/f3f [0,4194304] 0 2024-04-18T04:58:04.685 INFO:tasks.workunit.client.0.smithi096.stdout:0/452: truncate d16/d1c/d4c/f50 239383 0 2024-04-18T04:58:04.689 INFO:tasks.workunit.client.0.smithi096.stdout:5/423: mkdir d7/dd/d35/da0 0 2024-04-18T04:58:04.693 INFO:tasks.workunit.client.0.smithi096.stdout:4/494: write d4/d14/d16/f38 [1803187,68261] 0 2024-04-18T04:58:04.694 INFO:tasks.workunit.client.0.smithi096.stdout:5/424: fdatasync d7/dd/d8f/d5e/f79 0 2024-04-18T04:58:04.695 INFO:tasks.workunit.client.0.smithi096.stdout:0/453: unlink l3 0 2024-04-18T04:58:04.696 INFO:tasks.workunit.client.0.smithi096.stdout:1/604: dwrite f6 [0,4194304] 0 2024-04-18T04:58:04.701 INFO:tasks.workunit.client.0.smithi096.stdout:1/605: dread - de/d1d/d3f/f76 zero size 2024-04-18T04:58:04.701 INFO:tasks.workunit.client.0.smithi096.stdout:9/514: rename d0/d25 to d0/de/d17/d56/d59/d68/dab 0 2024-04-18T04:58:04.703 INFO:tasks.workunit.client.0.smithi096.stdout:3/689: dwrite f3 [0,4194304] 0 2024-04-18T04:58:04.703 INFO:tasks.workunit.client.0.smithi096.stdout:5/425: readlink d7/dd/l23 0 2024-04-18T04:58:04.703 INFO:tasks.workunit.client.0.smithi096.stdout:7/491: dwrite db/d1f/d42/f5f [0,4194304] 0 2024-04-18T04:58:04.704 INFO:tasks.workunit.client.0.smithi096.stdout:0/454: mknod d16/d1c/d4c/d4d/d36/c84 0 2024-04-18T04:58:04.705 INFO:tasks.workunit.client.0.smithi096.stdout:4/495: write d4/d14/d2d/d44/d55/d67/f6d [673167,22353] 0 2024-04-18T04:58:04.705 INFO:tasks.workunit.client.0.smithi096.stdout:8/492: link d0/d7/d24/c29 d0/d15/d65/d8f/c9e 0 2024-04-18T04:58:04.709 INFO:tasks.workunit.client.0.smithi096.stdout:0/455: chown d16/d1c/d22/d2c/f35 14743 1 2024-04-18T04:58:04.711 INFO:tasks.workunit.client.0.smithi096.stdout:1/606: fsync de/d1d/d3f/d4f/f64 0 2024-04-18T04:58:04.712 INFO:tasks.workunit.client.0.smithi096.stdout:8/493: mknod d0/d7/d86/c9f 0 2024-04-18T04:58:04.714 INFO:tasks.workunit.client.0.smithi096.stdout:2/727: dread df/f73 [0,4194304] 0 2024-04-18T04:58:04.714 INFO:tasks.workunit.client.0.smithi096.stdout:2/728: chown df/d7a 1893929830 1 2024-04-18T04:58:04.715 INFO:tasks.workunit.client.0.smithi096.stdout:9/515: getdents d0/de/d17/d56/d59 0 2024-04-18T04:58:04.716 INFO:tasks.workunit.client.0.smithi096.stdout:1/607: creat de/d1d/d32/d8c/fc3 x:0 0 0 2024-04-18T04:58:04.717 INFO:tasks.workunit.client.0.smithi096.stdout:8/494: dread - d0/d4f/f85 zero size 2024-04-18T04:58:04.719 INFO:tasks.workunit.client.0.smithi096.stdout:9/516: stat d0/f9a 0 2024-04-18T04:58:04.720 INFO:tasks.workunit.client.0.smithi096.stdout:0/456: mknod d16/d1c/d4c/d4d/c85 0 2024-04-18T04:58:04.721 INFO:tasks.workunit.client.0.smithi096.stdout:2/729: mkdir df/d7d/df0 0 2024-04-18T04:58:04.725 INFO:tasks.workunit.client.0.smithi096.stdout:4/496: chown d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/c69 96134747 1 2024-04-18T04:58:04.727 INFO:tasks.workunit.client.0.smithi096.stdout:6/719: sync 2024-04-18T04:58:04.728 INFO:tasks.workunit.client.0.smithi096.stdout:1/608: link de/c50 de/d1d/d32/d9a/cc4 0 2024-04-18T04:58:04.730 INFO:tasks.workunit.client.0.smithi096.stdout:3/690: dwrite dc/d26/f72 [4194304,4194304] 0 2024-04-18T04:58:04.730 INFO:tasks.workunit.client.0.smithi096.stdout:2/730: creat df/d18/d26/d48/d7b/ff1 x:0 0 0 2024-04-18T04:58:04.732 INFO:tasks.workunit.client.0.smithi096.stdout:1/609: fsync de/d1d/fab 0 2024-04-18T04:58:04.734 INFO:tasks.workunit.client.0.smithi096.stdout:7/492: dwrite db/d1f/d24/d61/f80 [0,4194304] 0 2024-04-18T04:58:04.738 INFO:tasks.workunit.client.0.smithi096.stdout:2/731: stat df/d18/d24/d42/fb0 0 2024-04-18T04:58:04.739 INFO:tasks.workunit.client.0.smithi096.stdout:4/497: symlink d4/d14/d2d/d44/d90/l9a 0 2024-04-18T04:58:04.741 INFO:tasks.workunit.client.0.smithi096.stdout:6/720: write d0/d6/f1d [1950101,8641] 0 2024-04-18T04:58:04.741 INFO:tasks.workunit.client.0.smithi096.stdout:5/426: dwrite d7/dd/d35/d74/f81 [0,4194304] 0 2024-04-18T04:58:04.742 INFO:tasks.workunit.client.0.smithi096.stdout:1/610: read de/f16 [168910,57425] 0 2024-04-18T04:58:04.743 INFO:tasks.workunit.client.0.smithi096.stdout:8/495: dread d0/d3/d32/f90 [0,4194304] 0 2024-04-18T04:58:04.743 INFO:tasks.workunit.client.0.smithi096.stdout:3/691: truncate dc/d5d/f6d 985312 0 2024-04-18T04:58:04.743 INFO:tasks.workunit.client.0.smithi096.stdout:9/517: dwrite d0/d52/f9d [0,4194304] 0 2024-04-18T04:58:04.744 INFO:tasks.workunit.client.0.smithi096.stdout:5/427: chown d7/d25 135107 1 2024-04-18T04:58:04.745 INFO:tasks.workunit.client.0.smithi096.stdout:1/611: fdatasync de/d1d/f65 0 2024-04-18T04:58:04.747 INFO:tasks.workunit.client.0.smithi096.stdout:5/428: dread - d7/d39/f96 zero size 2024-04-18T04:58:04.748 INFO:tasks.workunit.client.0.smithi096.stdout:7/493: symlink db/d1f/d39/d6d/d79/d83/la3 0 2024-04-18T04:58:04.750 INFO:tasks.workunit.client.0.smithi096.stdout:0/457: dread d16/f1b [0,4194304] 0 2024-04-18T04:58:04.752 INFO:tasks.workunit.client.0.smithi096.stdout:4/498: creat d4/d14/f9b x:0 0 0 2024-04-18T04:58:04.753 INFO:tasks.workunit.client.0.smithi096.stdout:8/496: symlink d0/d7/d24/d18/la0 0 2024-04-18T04:58:04.754 INFO:tasks.workunit.client.0.smithi096.stdout:4/499: chown d4/d14/c42 2413 1 2024-04-18T04:58:04.755 INFO:tasks.workunit.client.0.smithi096.stdout:1/612: mknod de/d1d/d3f/d4f/da9/cc5 0 2024-04-18T04:58:04.755 INFO:tasks.workunit.client.0.smithi096.stdout:8/497: readlink d0/l68 0 2024-04-18T04:58:04.756 INFO:tasks.workunit.client.0.smithi096.stdout:6/721: dwrite d0/d6/fc0 [0,4194304] 0 2024-04-18T04:58:04.758 INFO:tasks.workunit.client.0.smithi096.stdout:1/613: chown de/d1d/d32/d6b/f9d 135911 1 2024-04-18T04:58:04.759 INFO:tasks.workunit.client.0.smithi096.stdout:7/494: rename db/d1d/f47 to db/d1f/d5b/d6a/fa4 0 2024-04-18T04:58:04.762 INFO:tasks.workunit.client.0.smithi096.stdout:9/518: write d0/de/d17/d2f/f42 [2774908,1704] 0 2024-04-18T04:58:04.763 INFO:tasks.workunit.client.0.smithi096.stdout:1/614: mknod de/d1d/d32/d73/d8b/cc6 0 2024-04-18T04:58:04.763 INFO:tasks.workunit.client.0.smithi096.stdout:4/500: rename d4/d14/d2d to d4/d14/d2d/d44/d55/d9c 22 2024-04-18T04:58:04.764 INFO:tasks.workunit.client.0.smithi096.stdout:5/429: getdents d7/dd/d8f 0 2024-04-18T04:58:04.764 INFO:tasks.workunit.client.0.smithi096.stdout:6/722: write d0/d6/d29/f42 [4122707,53183] 0 2024-04-18T04:58:04.766 INFO:tasks.workunit.client.0.smithi096.stdout:3/692: truncate dc/d26/d48/dc2/f3e 3477105 0 2024-04-18T04:58:04.767 INFO:tasks.workunit.client.0.smithi096.stdout:0/458: dwrite d16/d1c/f3c [0,4194304] 0 2024-04-18T04:58:04.767 INFO:tasks.workunit.client.0.smithi096.stdout:7/495: creat db/d1d/d82/fa5 x:0 0 0 2024-04-18T04:58:04.769 INFO:tasks.workunit.client.0.smithi096.stdout:9/519: write d0/d52/d5a/f76 [579919,68216] 0 2024-04-18T04:58:04.769 INFO:tasks.workunit.client.0.smithi096.stdout:1/615: mkdir de/d1d/d3f/d5f/dc7 0 2024-04-18T04:58:04.774 INFO:tasks.workunit.client.0.smithi096.stdout:4/501: write d4/d14/d1d/f52 [5041449,99324] 0 2024-04-18T04:58:04.774 INFO:tasks.workunit.client.0.smithi096.stdout:7/496: chown db/f9c 0 1 2024-04-18T04:58:04.774 INFO:tasks.workunit.client.0.smithi096.stdout:5/430: creat d7/dd/d8f/d5e/fa1 x:0 0 0 2024-04-18T04:58:04.776 INFO:tasks.workunit.client.0.smithi096.stdout:6/723: chown d0/d6/d2e/d7a/fd9 25 1 2024-04-18T04:58:04.778 INFO:tasks.workunit.client.0.smithi096.stdout:3/693: truncate dc/d26/d4a/fc6 42679 0 2024-04-18T04:58:04.778 INFO:tasks.workunit.client.0.smithi096.stdout:8/498: dwrite d0/d3/f3a [0,4194304] 0 2024-04-18T04:58:04.782 INFO:tasks.workunit.client.0.smithi096.stdout:4/502: write d4/d14/d16/f40 [5139762,53173] 0 2024-04-18T04:58:04.782 INFO:tasks.workunit.client.0.smithi096.stdout:1/616: write de/d1d/d32/d6f/f8a [522750,21665] 0 2024-04-18T04:58:04.785 INFO:tasks.workunit.client.0.smithi096.stdout:0/459: link d16/d1d/f25 d16/d1d/d7c/f86 0 2024-04-18T04:58:04.786 INFO:tasks.workunit.client.0.smithi096.stdout:5/431: rename d7/d39/d52/d61 to d7/dd/d8f/da2 0 2024-04-18T04:58:04.787 INFO:tasks.workunit.client.0.smithi096.stdout:6/724: truncate d0/d6/d2b/f90 518662 0 2024-04-18T04:58:04.792 INFO:tasks.workunit.client.0.smithi096.stdout:0/460: chown d16/d1d/l31 7071 1 2024-04-18T04:58:04.792 INFO:tasks.workunit.client.0.smithi096.stdout:1/617: getdents de/d7b 0 2024-04-18T04:58:04.794 INFO:tasks.workunit.client.0.smithi096.stdout:9/520: dwrite d0/de/d17/d56/d59/d68/dab/f2e [4194304,4194304] 0 2024-04-18T04:58:04.795 INFO:tasks.workunit.client.0.smithi096.stdout:4/503: truncate d4/d14/d1d/f25 4335896 0 2024-04-18T04:58:04.797 INFO:tasks.workunit.client.0.smithi096.stdout:3/694: link dc/d26/d66/d7f/fcb dc/d26/d48/dae/fe2 0 2024-04-18T04:58:04.798 INFO:tasks.workunit.client.0.smithi096.stdout:0/461: write d16/f40 [6606633,51885] 0 2024-04-18T04:58:04.798 INFO:tasks.workunit.client.0.smithi096.stdout:7/497: dwrite db/d1d/f75 [0,4194304] 0 2024-04-18T04:58:04.799 INFO:tasks.workunit.client.0.smithi096.stdout:8/499: link d0/d7/c25 d0/d4f/ca1 0 2024-04-18T04:58:04.803 INFO:tasks.workunit.client.0.smithi096.stdout:1/618: symlink de/d1d/d32/d6b/lc8 0 2024-04-18T04:58:04.803 INFO:tasks.workunit.client.0.smithi096.stdout:9/521: write d0/de/d17/d56/d59/d60/f8a [351480,78592] 0 2024-04-18T04:58:04.805 INFO:tasks.workunit.client.0.smithi096.stdout:7/498: truncate db/d1f/d24/d49/f86 238030 0 2024-04-18T04:58:04.807 INFO:tasks.workunit.client.0.smithi096.stdout:1/619: chown de/l1c 0 1 2024-04-18T04:58:04.807 INFO:tasks.workunit.client.0.smithi096.stdout:0/462: creat d16/d1c/d4c/d4e/d67/f87 x:0 0 0 2024-04-18T04:58:04.807 INFO:tasks.workunit.client.0.smithi096.stdout:7/499: stat db/d1d/f75 0 2024-04-18T04:58:04.811 INFO:tasks.workunit.client.0.smithi096.stdout:1/620: read de/d1d/d3f/f63 [337665,17027] 0 2024-04-18T04:58:04.812 INFO:tasks.workunit.client.0.smithi096.stdout:6/725: truncate d0/d6/d2b/d3b/d69/f84 443210 0 2024-04-18T04:58:04.817 INFO:tasks.workunit.client.0.smithi096.stdout:4/504: dwrite d4/d14/f72 [0,4194304] 0 2024-04-18T04:58:04.817 INFO:tasks.workunit.client.0.smithi096.stdout:1/621: dread - de/d1d/d32/d6f/f83 zero size 2024-04-18T04:58:04.818 INFO:tasks.workunit.client.0.smithi096.stdout:6/726: chown d0/d6/d2b/d3b/l23 81844 1 2024-04-18T04:58:04.819 INFO:tasks.workunit.client.0.smithi096.stdout:8/500: dwrite d0/d3/f5c [0,4194304] 0 2024-04-18T04:58:04.821 INFO:tasks.workunit.client.0.smithi096.stdout:5/432: dread d7/fe [0,4194304] 0 2024-04-18T04:58:04.821 INFO:tasks.workunit.client.0.smithi096.stdout:1/622: creat de/d7b/fc9 x:0 0 0 2024-04-18T04:58:04.822 INFO:tasks.workunit.client.0.smithi096.stdout:0/463: dread d16/d1d/f1e [0,4194304] 0 2024-04-18T04:58:04.825 INFO:tasks.workunit.client.0.smithi096.stdout:9/522: truncate d0/de/d17/d56/d59/d68/f8e 3484996 0 2024-04-18T04:58:04.825 INFO:tasks.workunit.client.0.smithi096.stdout:5/433: write d7/dd/d35/f59 [636160,84310] 0 2024-04-18T04:58:04.831 INFO:tasks.workunit.client.0.smithi096.stdout:7/500: dwrite db/d1f/d24/d61/f80 [0,4194304] 0 2024-04-18T04:58:04.831 INFO:tasks.workunit.client.0.smithi096.stdout:8/501: fdatasync d0/d7/d24/d78/f61 0 2024-04-18T04:58:04.833 INFO:tasks.workunit.client.0.smithi096.stdout:7/501: truncate db/d1f/d42/f65 567057 0 2024-04-18T04:58:04.836 INFO:tasks.workunit.client.0.smithi096.stdout:7/502: read db/d1f/d42/f65 [332181,30571] 0 2024-04-18T04:58:04.838 INFO:tasks.workunit.client.0.smithi096.stdout:6/727: getdents d0 0 2024-04-18T04:58:04.839 INFO:tasks.workunit.client.0.smithi096.stdout:0/464: dwrite d16/d1c/f62 [0,4194304] 0 2024-04-18T04:58:04.839 INFO:tasks.workunit.client.0.smithi096.stdout:8/502: rmdir d0/d7/d24/d35/d51/d5b 39 2024-04-18T04:58:04.842 INFO:tasks.workunit.client.0.smithi096.stdout:0/465: stat l12 0 2024-04-18T04:58:04.843 INFO:tasks.workunit.client.0.smithi096.stdout:4/505: rename d4/d14/d2d/d44/d58/d86/d3a/d39/f75 to d4/d14/d2d/d44/d55/f9d 0 2024-04-18T04:58:04.843 INFO:tasks.workunit.client.0.smithi096.stdout:9/523: dwrite d0/de/d17/d56/d59/d68/dab/d3a/f4a [4194304,4194304] 0 2024-04-18T04:58:04.844 INFO:tasks.workunit.client.0.smithi096.stdout:8/503: write d0/d7/d24/d18/d5d/f5f [972568,67402] 0 2024-04-18T04:58:04.848 INFO:tasks.workunit.client.0.smithi096.stdout:1/623: truncate de/f35 431271 0 2024-04-18T04:58:04.849 INFO:tasks.workunit.client.0.smithi096.stdout:8/504: chown d0/d3/d32/d6b/d7b/c8c 102 1 2024-04-18T04:58:04.850 INFO:tasks.workunit.client.0.smithi096.stdout:1/624: fsync de/d1d/d3f/d4f/fa4 0 2024-04-18T04:58:04.850 INFO:tasks.workunit.client.0.smithi096.stdout:9/524: creat d0/de/d17/d2f/d40/fac x:0 0 0 2024-04-18T04:58:04.854 INFO:tasks.workunit.client.0.smithi096.stdout:5/434: rename d7/d39/d36/d6f to d7/da3 0 2024-04-18T04:58:04.856 INFO:tasks.workunit.client.0.smithi096.stdout:8/505: symlink d0/d3/d32/la2 0 2024-04-18T04:58:04.857 INFO:tasks.workunit.client.0.smithi096.stdout:1/625: mkdir de/d1d/d32/d73/d8b/dca 0 2024-04-18T04:58:04.859 INFO:tasks.workunit.client.0.smithi096.stdout:9/525: mknod d0/de/d17/d2f/d40/cad 0 2024-04-18T04:58:04.860 INFO:tasks.workunit.client.0.smithi096.stdout:9/526: stat d0/de/d17/f3f 0 2024-04-18T04:58:04.861 INFO:tasks.workunit.client.0.smithi096.stdout:0/466: rename d16/d1c/d4c/d4e/d67/f87 to d16/d1c/f88 0 2024-04-18T04:58:04.861 INFO:tasks.workunit.client.0.smithi096.stdout:7/503: truncate db/f7f 1374414 0 2024-04-18T04:58:04.862 INFO:tasks.workunit.client.0.smithi096.stdout:9/527: read d0/de/d17/d56/d59/d68/dab/f2e [3262177,28278] 0 2024-04-18T04:58:04.864 INFO:tasks.workunit.client.0.smithi096.stdout:8/506: creat d0/d3/d32/d6b/fa3 x:0 0 0 2024-04-18T04:58:04.865 INFO:tasks.workunit.client.0.smithi096.stdout:1/626: rmdir de/d1d/d32/d6f 39 2024-04-18T04:58:04.867 INFO:tasks.workunit.client.0.smithi096.stdout:1/627: fsync de/d1d/f52 0 2024-04-18T04:58:04.868 INFO:tasks.workunit.client.0.smithi096.stdout:4/506: link d4/d14/d2d/l5a d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/l9e 0 2024-04-18T04:58:04.869 INFO:tasks.workunit.client.0.smithi096.stdout:9/528: chown d0/de/d17/d56/d59/d60/f77 253 1 2024-04-18T04:58:04.869 INFO:tasks.workunit.client.0.smithi096.stdout:6/728: dread d0/d6/d2b/d3b/dbb/fd0 [0,4194304] 0 2024-04-18T04:58:04.871 INFO:tasks.workunit.client.0.smithi096.stdout:5/435: write d7/d39/d36/f4f [842604,23750] 0 2024-04-18T04:58:04.872 INFO:tasks.workunit.client.0.smithi096.stdout:7/504: dwrite db/d1f/d4e/f7a [0,4194304] 0 2024-04-18T04:58:04.874 INFO:tasks.workunit.client.0.smithi096.stdout:4/507: write d4/d14/d2d/d44/d58/d86/f3b [5739179,57196] 0 2024-04-18T04:58:04.875 INFO:tasks.workunit.client.0.smithi096.stdout:6/729: symlink d0/d6/d2b/d3b/d69/lda 0 2024-04-18T04:58:04.875 INFO:tasks.workunit.client.0.smithi096.stdout:9/529: fsync d0/de/d17/d56/d59/d68/dab/d33/f9f 0 2024-04-18T04:58:04.877 INFO:tasks.workunit.client.0.smithi096.stdout:7/505: unlink db/d1f/l2b 0 2024-04-18T04:58:04.877 INFO:tasks.workunit.client.0.smithi096.stdout:4/508: fsync d4/f62 0 2024-04-18T04:58:04.879 INFO:tasks.workunit.client.0.smithi096.stdout:8/507: dwrite d0/f4d [0,4194304] 0 2024-04-18T04:58:04.879 INFO:tasks.workunit.client.0.smithi096.stdout:9/530: fdatasync d0/de/d17/d56/f50 0 2024-04-18T04:58:04.883 INFO:tasks.workunit.client.0.smithi096.stdout:8/508: write d0/d7/d24/d78/f61 [5190445,57898] 0 2024-04-18T04:58:04.884 INFO:tasks.workunit.client.0.smithi096.stdout:7/506: rename db/d1f/d5b/f89 to db/d20/d45/fa6 0 2024-04-18T04:58:04.885 INFO:tasks.workunit.client.0.smithi096.stdout:9/531: truncate d0/de/d17/d5c/f7c 4591197 0 2024-04-18T04:58:04.888 INFO:tasks.workunit.client.0.smithi096.stdout:5/436: dwrite d7/d25/f2f [0,4194304] 0 2024-04-18T04:58:04.889 INFO:tasks.workunit.client.0.smithi096.stdout:6/730: link d0/d6/d2b/d3b/d7d/fcd d0/d6/d2b/d3b/d69/d66/dcf/dd5/fdb 0 2024-04-18T04:58:04.890 INFO:tasks.workunit.client.0.smithi096.stdout:5/437: dread - d7/d25/f91 zero size 2024-04-18T04:58:04.892 INFO:tasks.workunit.client.0.smithi096.stdout:7/507: rename db/d1f/d24/d49/fa2 to db/d1f/d5b/d6a/d74/fa7 0 2024-04-18T04:58:04.892 INFO:tasks.workunit.client.0.smithi096.stdout:5/438: write d7/d39/d52/f65 [4070943,108922] 0 2024-04-18T04:58:04.893 INFO:tasks.workunit.client.0.smithi096.stdout:6/731: unlink d0/d6/d2b/d3b/c57 0 2024-04-18T04:58:04.896 INFO:tasks.workunit.client.0.smithi096.stdout:5/439: write d7/d3b/f94 [396965,115640] 0 2024-04-18T04:58:04.897 INFO:tasks.workunit.client.0.smithi096.stdout:7/508: write db/d1f/d5b/d6a/d74/fa7 [735675,117646] 0 2024-04-18T04:58:04.900 INFO:tasks.workunit.client.0.smithi096.stdout:4/509: write d4/d14/d2d/d44/d58/d86/d3a/d39/f56 [2181200,55884] 0 2024-04-18T04:58:04.902 INFO:tasks.workunit.client.0.smithi096.stdout:7/509: write db/d1f/d24/f70 [79487,75773] 0 2024-04-18T04:58:04.902 INFO:tasks.workunit.client.0.smithi096.stdout:9/532: dread d0/de/d17/f3f [0,4194304] 0 2024-04-18T04:58:04.906 INFO:tasks.workunit.client.0.smithi096.stdout:7/510: mknod db/d1f/d39/d6d/d79/d83/ca8 0 2024-04-18T04:58:04.907 INFO:tasks.workunit.client.0.smithi096.stdout:5/440: dread d7/d25/f28 [0,4194304] 0 2024-04-18T04:58:04.907 INFO:tasks.workunit.client.0.smithi096.stdout:8/509: dread d0/d3/d32/f72 [0,4194304] 0 2024-04-18T04:58:04.907 INFO:tasks.workunit.client.0.smithi096.stdout:4/510: link d4/d14/c21 d4/d14/d2d/d44/d58/c9f 0 2024-04-18T04:58:04.908 INFO:tasks.workunit.client.0.smithi096.stdout:7/511: mknod db/d1f/d24/d61/ca9 0 2024-04-18T04:58:04.911 INFO:tasks.workunit.client.0.smithi096.stdout:4/511: write d4/d14/d2d/d44/d58/d86/d3a/d39/d54/f91 [972001,47033] 0 2024-04-18T04:58:04.912 INFO:tasks.workunit.client.0.smithi096.stdout:7/512: mkdir db/d1f/d39/d6d/d79/d83/daa 0 2024-04-18T04:58:04.914 INFO:tasks.workunit.client.0.smithi096.stdout:4/512: write d4/d14/d2d/d44/d63/f7f [1595167,5638] 0 2024-04-18T04:58:04.917 INFO:tasks.workunit.client.0.smithi096.stdout:6/732: dread d0/d6/d2e/f7c [0,4194304] 0 2024-04-18T04:58:04.919 INFO:tasks.workunit.client.0.smithi096.stdout:4/513: fdatasync d4/d14/d2d/d44/d58/d86/f4c 0 2024-04-18T04:58:04.919 INFO:tasks.workunit.client.0.smithi096.stdout:9/533: dread d0/de/d17/d56/d59/f65 [0,4194304] 0 2024-04-18T04:58:04.923 INFO:tasks.workunit.client.0.smithi096.stdout:5/441: dread d7/dd/d8f/f15 [0,4194304] 0 2024-04-18T04:58:04.924 INFO:tasks.workunit.client.0.smithi096.stdout:9/534: write d0/de/d17/d2f/d40/fac [1011140,67952] 0 2024-04-18T04:58:04.925 INFO:tasks.workunit.client.0.smithi096.stdout:7/513: dwrite db/d1f/f7d [0,4194304] 0 2024-04-18T04:58:04.926 INFO:tasks.workunit.client.0.smithi096.stdout:9/535: fsync d0/de/d17/d2f/f42 0 2024-04-18T04:58:04.926 INFO:tasks.workunit.client.0.smithi096.stdout:4/514: symlink d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/la0 0 2024-04-18T04:58:04.928 INFO:tasks.workunit.client.0.smithi096.stdout:5/442: link d7/dd/d8f/f15 d7/d39/d36/d97/fa4 0 2024-04-18T04:58:04.930 INFO:tasks.workunit.client.0.smithi096.stdout:6/733: truncate d0/d6/d2b/d3b/f41 3982435 0 2024-04-18T04:58:04.931 INFO:tasks.workunit.client.0.smithi096.stdout:5/443: creat d7/da3/d9a/fa5 x:0 0 0 2024-04-18T04:58:04.933 INFO:tasks.workunit.client.0.smithi096.stdout:6/734: rmdir d0/d6/d2b/d3b/d69/d66 39 2024-04-18T04:58:04.934 INFO:tasks.workunit.client.0.smithi096.stdout:4/515: getdents d4/d14 0 2024-04-18T04:58:04.939 INFO:tasks.workunit.client.0.smithi096.stdout:5/444: truncate d7/d39/f50 203611 0 2024-04-18T04:58:04.940 INFO:tasks.workunit.client.0.smithi096.stdout:7/514: dwrite db/d1f/d39/d6d/d79/d83/f85 [0,4194304] 0 2024-04-18T04:58:04.944 INFO:tasks.workunit.client.0.smithi096.stdout:9/536: dwrite d0/de/d17/d2f/d40/f61 [0,4194304] 0 2024-04-18T04:58:04.945 INFO:tasks.workunit.client.0.smithi096.stdout:5/445: unlink d7/da3/f89 0 2024-04-18T04:58:04.946 INFO:tasks.workunit.client.0.smithi096.stdout:7/515: write db/d20/f66 [767439,130189] 0 2024-04-18T04:58:04.949 INFO:tasks.workunit.client.0.smithi096.stdout:4/516: dwrite d4/d14/d2d/d44/d58/f6b [0,4194304] 0 2024-04-18T04:58:04.954 INFO:tasks.workunit.client.0.smithi096.stdout:9/537: fsync d0/de/d17/d56/d6d/f7f 0 2024-04-18T04:58:04.954 INFO:tasks.workunit.client.0.smithi096.stdout:6/735: dwrite d0/d6/d29/f7f [0,4194304] 0 2024-04-18T04:58:04.955 INFO:tasks.workunit.client.0.smithi096.stdout:7/516: write db/d20/f35 [787981,84653] 0 2024-04-18T04:58:04.959 INFO:tasks.workunit.client.0.smithi096.stdout:7/517: write db/d1f/d42/f5f [6146413,39495] 0 2024-04-18T04:58:04.964 INFO:tasks.workunit.client.0.smithi096.stdout:6/736: mkdir d0/da0/ddc 0 2024-04-18T04:58:04.965 INFO:tasks.workunit.client.0.smithi096.stdout:5/446: dwrite d7/d25/f28 [0,4194304] 0 2024-04-18T04:58:04.965 INFO:tasks.workunit.client.0.smithi096.stdout:9/538: symlink d0/d41/lae 0 2024-04-18T04:58:04.967 INFO:tasks.workunit.client.0.smithi096.stdout:7/518: rename db/d1f/d39/f5c to db/d1f/d42/fab 0 2024-04-18T04:58:04.969 INFO:tasks.workunit.client.0.smithi096.stdout:4/517: dwrite d4/d14/d2d/d44/d58/d86/d3a/d39/d54/f5c [0,4194304] 0 2024-04-18T04:58:04.969 INFO:tasks.workunit.client.0.smithi096.stdout:9/539: readlink d0/d52/l87 0 2024-04-18T04:58:04.970 INFO:tasks.workunit.client.0.smithi096.stdout:5/447: write d7/f4c [4898605,94145] 0 2024-04-18T04:58:04.972 INFO:tasks.workunit.client.0.smithi096.stdout:7/519: dread - db/d1f/d24/f7c zero size 2024-04-18T04:58:04.972 INFO:tasks.workunit.client.0.smithi096.stdout:6/737: truncate d0/d6/d2b/d3b/d7d/fcd 587753 0 2024-04-18T04:58:04.972 INFO:tasks.workunit.client.0.smithi096.stdout:5/448: dread - d7/d39/f96 zero size 2024-04-18T04:58:04.977 INFO:tasks.workunit.client.0.smithi096.stdout:6/738: write d0/d6/d5d/f7b [3949157,55007] 0 2024-04-18T04:58:04.980 INFO:tasks.workunit.client.0.smithi096.stdout:9/540: truncate d0/de/d17/d2f/f84 848680 0 2024-04-18T04:58:04.981 INFO:tasks.workunit.client.0.smithi096.stdout:5/449: creat d7/d25/d7c/fa6 x:0 0 0 2024-04-18T04:58:04.981 INFO:tasks.workunit.client.0.smithi096.stdout:9/541: stat d0/de/d99/ca0 0 2024-04-18T04:58:04.981 INFO:tasks.workunit.client.0.smithi096.stdout:7/520: dread db/d20/f66 [0,4194304] 0 2024-04-18T04:58:04.982 INFO:tasks.workunit.client.0.smithi096.stdout:5/450: chown d7/dd/f2c 146475 1 2024-04-18T04:58:04.982 INFO:tasks.workunit.client.0.smithi096.stdout:9/542: chown d0/de/d17/d5c/f7c 275552928 1 2024-04-18T04:58:04.983 INFO:tasks.workunit.client.0.smithi096.stdout:5/451: chown d7/dd/f86 354781 1 2024-04-18T04:58:04.985 INFO:tasks.workunit.client.0.smithi096.stdout:4/518: symlink d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/la1 0 2024-04-18T04:58:04.988 INFO:tasks.workunit.client.0.smithi096.stdout:6/739: mkdir d0/d6/d5d/ddd 0 2024-04-18T04:58:04.988 INFO:tasks.workunit.client.0.smithi096.stdout:7/521: symlink db/d1d/d82/lac 0 2024-04-18T04:58:04.988 INFO:tasks.workunit.client.0.smithi096.stdout:9/543: rename d0/d52/d5a/f69 to d0/de/d17/d56/d59/d60/faf 0 2024-04-18T04:58:04.990 INFO:tasks.workunit.client.0.smithi096.stdout:4/519: mkdir d4/d14/d2d/d44/da2 0 2024-04-18T04:58:04.990 INFO:tasks.workunit.client.0.smithi096.stdout:9/544: fdatasync d0/de/d17/d56/d59/d68/dab/d3a/f4a 0 2024-04-18T04:58:04.991 INFO:tasks.workunit.client.0.smithi096.stdout:6/740: link d0/d6/d2b/d3b/d69/d6c/d85/fad d0/d6/d5d/ddd/fde 0 2024-04-18T04:58:04.994 INFO:tasks.workunit.client.0.smithi096.stdout:4/520: creat d4/d14/d2d/d44/fa3 x:0 0 0 2024-04-18T04:58:04.994 INFO:tasks.workunit.client.0.smithi096.stdout:9/545: readlink d0/de/d17/d56/d59/d68/dab/l3b 0 2024-04-18T04:58:04.995 INFO:tasks.workunit.client.0.smithi096.stdout:4/521: truncate d4/f18 2818330 0 2024-04-18T04:58:04.995 INFO:tasks.workunit.client.0.smithi096.stdout:7/522: getdents db/d20/d2f/d8d/da1 0 2024-04-18T04:58:04.995 INFO:tasks.workunit.client.0.smithi096.stdout:5/452: write d7/d25/f27 [275555,70086] 0 2024-04-18T04:58:04.997 INFO:tasks.workunit.client.0.smithi096.stdout:6/741: link d0/d6/d2e/l6f d0/d6/d2b/d3b/d69/d6c/dd8/ldf 0 2024-04-18T04:58:04.999 INFO:tasks.workunit.client.0.smithi096.stdout:6/742: mknod d0/d6/d2b/d7e/ce0 0 2024-04-18T04:58:05.000 INFO:tasks.workunit.client.0.smithi096.stdout:5/453: creat d7/d25/d30/fa7 x:0 0 0 2024-04-18T04:58:05.001 INFO:tasks.workunit.client.0.smithi096.stdout:7/523: getdents db/d1d 0 2024-04-18T04:58:05.002 INFO:tasks.workunit.client.0.smithi096.stdout:4/522: getdents d4/d14/d2d/d44/d58/d86/d3a 0 2024-04-18T04:58:05.006 INFO:tasks.workunit.client.0.smithi096.stdout:9/546: dwrite d0/de/d17/f97 [0,4194304] 0 2024-04-18T04:58:05.006 INFO:tasks.workunit.client.0.smithi096.stdout:5/454: rename d7/d39/f26 to d7/da3/d9a/fa8 0 2024-04-18T04:58:05.006 INFO:tasks.workunit.client.0.smithi096.stdout:9/547: dread - d0/de/f7b zero size 2024-04-18T04:58:05.006 INFO:tasks.workunit.client.0.smithi096.stdout:6/743: read d0/d6/d2b/d3b/d69/d6c/f76 [321377,93618] 0 2024-04-18T04:58:05.009 INFO:tasks.workunit.client.0.smithi096.stdout:7/524: rename db/d1f/d5b/d6a/l9f to db/d20/d45/lad 0 2024-04-18T04:58:05.009 INFO:tasks.workunit.client.0.smithi096.stdout:9/548: unlink d0/de/l1a 0 2024-04-18T04:58:05.010 INFO:tasks.workunit.client.0.smithi096.stdout:6/744: creat d0/d6/d2b/d3b/dbb/fe1 x:0 0 0 2024-04-18T04:58:05.013 INFO:tasks.workunit.client.0.smithi096.stdout:9/549: chown d0/l4d 1821291 1 2024-04-18T04:58:05.013 INFO:tasks.workunit.client.0.smithi096.stdout:7/525: write db/f11 [4116998,88211] 0 2024-04-18T04:58:05.013 INFO:tasks.workunit.client.0.smithi096.stdout:6/745: stat d0/d6/d29/c5a 0 2024-04-18T04:58:05.015 INFO:tasks.workunit.client.0.smithi096.stdout:5/455: dread d7/fe [0,4194304] 0 2024-04-18T04:58:05.015 INFO:tasks.workunit.client.0.smithi096.stdout:4/523: dwrite d4/d14/d2d/d44/d58/f6b [0,4194304] 0 2024-04-18T04:58:05.017 INFO:tasks.workunit.client.0.smithi096.stdout:9/550: dread - d0/de/d17/d56/d6d/f7f zero size 2024-04-18T04:58:05.018 INFO:tasks.workunit.client.0.smithi096.stdout:5/456: mkdir d7/d3b/da9 0 2024-04-18T04:58:05.022 INFO:tasks.workunit.client.0.smithi096.stdout:7/526: creat db/d1f/d39/d6d/d79/d83/fae x:0 0 0 2024-04-18T04:58:05.023 INFO:tasks.workunit.client.0.smithi096.stdout:5/457: write d7/f3c [441810,104183] 0 2024-04-18T04:58:05.023 INFO:tasks.workunit.client.0.smithi096.stdout:9/551: creat d0/d41/fb0 x:0 0 0 2024-04-18T04:58:05.023 INFO:tasks.workunit.client.0.smithi096.stdout:4/524: creat d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/fa4 x:0 0 0 2024-04-18T04:58:05.023 INFO:tasks.workunit.client.0.smithi096.stdout:6/746: creat d0/d6/d2b/d3b/d69/d6c/fe2 x:0 0 0 2024-04-18T04:58:05.023 INFO:tasks.workunit.client.0.smithi096.stdout:5/458: unlink d7/d39/d56/c64 0 2024-04-18T04:58:05.025 INFO:tasks.workunit.client.0.smithi096.stdout:4/525: rename d4/d14/d2d/d44/d55 to d4/d14/d1d/da5 0 2024-04-18T04:58:05.026 INFO:tasks.workunit.client.0.smithi096.stdout:6/747: truncate d0/d6/d2e/fa9 316783 0 2024-04-18T04:58:05.028 INFO:tasks.workunit.client.0.smithi096.stdout:9/552: rename d0/de/d17/d2f/f84 to d0/d41/fb1 0 2024-04-18T04:58:05.028 INFO:tasks.workunit.client.0.smithi096.stdout:6/748: chown d0/d6/d29/f42 8053951 1 2024-04-18T04:58:05.030 INFO:tasks.workunit.client.0.smithi096.stdout:9/553: fdatasync d0/de/d17/f23 0 2024-04-18T04:58:05.030 INFO:tasks.workunit.client.0.smithi096.stdout:7/527: dwrite db/d20/d45/f63 [0,4194304] 0 2024-04-18T04:58:05.031 INFO:tasks.workunit.client.0.smithi096.stdout:5/459: link d7/d39/f96 d7/d25/d30/faa 0 2024-04-18T04:58:05.034 INFO:tasks.workunit.client.0.smithi096.stdout:9/554: mknod d0/de/d99/cb2 0 2024-04-18T04:58:05.036 INFO:tasks.workunit.client.0.smithi096.stdout:7/528: chown db/d1f/d39/d6d/l92 54334 1 2024-04-18T04:58:05.039 INFO:tasks.workunit.client.0.smithi096.stdout:6/749: write d0/d6/f15 [6138899,16990] 0 2024-04-18T04:58:05.042 INFO:tasks.workunit.client.0.smithi096.stdout:4/526: getdents d4/d14/d2d/d44/d58/d86/d3a/d39 0 2024-04-18T04:58:05.042 INFO:tasks.workunit.client.0.smithi096.stdout:9/555: unlink d0/de/d17/d5c/ca2 0 2024-04-18T04:58:05.043 INFO:tasks.workunit.client.0.smithi096.stdout:6/750: rmdir d0/d6/d29 39 2024-04-18T04:58:05.044 INFO:tasks.workunit.client.0.smithi096.stdout:5/460: dread d7/d39/f29 [0,4194304] 0 2024-04-18T04:58:05.045 INFO:tasks.workunit.client.0.smithi096.stdout:7/529: mkdir db/d1f/daf 0 2024-04-18T04:58:05.050 INFO:tasks.workunit.client.0.smithi096.stdout:7/530: creat db/d1d/d82/fb0 x:0 0 0 2024-04-18T04:58:05.052 INFO:tasks.workunit.client.0.smithi096.stdout:9/556: rename d0/de/d17/d56/d59/d68/dab/f35 to d0/de/d17/d2f/d40/fb3 0 2024-04-18T04:58:05.052 INFO:tasks.workunit.client.0.smithi096.stdout:6/751: mknod d0/d6/d2b/d3b/dc9/ce3 0 2024-04-18T04:58:05.054 INFO:tasks.workunit.client.0.smithi096.stdout:6/752: fsync d0/f59 0 2024-04-18T04:58:05.056 INFO:tasks.workunit.client.0.smithi096.stdout:7/531: getdents db/d1f/d42 0 2024-04-18T04:58:05.057 INFO:tasks.workunit.client.0.smithi096.stdout:7/532: write db/d1d/f4a [372297,47435] 0 2024-04-18T04:58:05.058 INFO:tasks.workunit.client.0.smithi096.stdout:6/753: mkdir d0/d6/de4 0 2024-04-18T04:58:05.061 INFO:tasks.workunit.client.0.smithi096.stdout:7/533: unlink db/d1d/f4a 0 2024-04-18T04:58:05.062 INFO:tasks.workunit.client.0.smithi096.stdout:5/461: dread d7/d25/d7c/f87 [0,4194304] 0 2024-04-18T04:58:05.063 INFO:tasks.workunit.client.0.smithi096.stdout:3/695: sync 2024-04-18T04:58:05.063 INFO:tasks.workunit.client.0.smithi096.stdout:2/732: sync 2024-04-18T04:58:05.064 INFO:tasks.workunit.client.0.smithi096.stdout:2/733: stat df/f69 0 2024-04-18T04:58:05.064 INFO:tasks.workunit.client.0.smithi096.stdout:7/534: unlink db/f9c 0 2024-04-18T04:58:05.067 INFO:tasks.workunit.client.0.smithi096.stdout:5/462: mkdir d7/dd/d35/d74/dab 0 2024-04-18T04:58:05.069 INFO:tasks.workunit.client.0.smithi096.stdout:6/754: dwrite d0/d6/d2b/d3b/d69/d66/fbc [0,4194304] 0 2024-04-18T04:58:05.075 INFO:tasks.workunit.client.0.smithi096.stdout:2/734: mknod df/d18/d71/cf2 0 2024-04-18T04:58:05.076 INFO:tasks.workunit.client.0.smithi096.stdout:9/557: dread d0/de/d17/d2f/d40/fb3 [0,4194304] 0 2024-04-18T04:58:05.077 INFO:tasks.workunit.client.0.smithi096.stdout:7/535: mknod db/d1f/d39/cb1 0 2024-04-18T04:58:05.078 INFO:tasks.workunit.client.0.smithi096.stdout:5/463: mknod d7/d39/d78/cac 0 2024-04-18T04:58:05.081 INFO:tasks.workunit.client.0.smithi096.stdout:9/558: mkdir d0/de/d17/d5c/db4 0 2024-04-18T04:58:05.083 INFO:tasks.workunit.client.0.smithi096.stdout:5/464: write d7/dd/f2e [1039772,80768] 0 2024-04-18T04:58:05.084 INFO:tasks.workunit.client.0.smithi096.stdout:5/465: read d7/f4c [1514835,84278] 0 2024-04-18T04:58:05.085 INFO:tasks.workunit.client.0.smithi096.stdout:2/735: mknod df/d7d/cf3 0 2024-04-18T04:58:05.089 INFO:tasks.workunit.client.0.smithi096.stdout:6/755: write d0/d6/d2b/d3b/f41 [59921,113895] 0 2024-04-18T04:58:05.090 INFO:tasks.workunit.client.0.smithi096.stdout:9/559: creat d0/d52/fb5 x:0 0 0 2024-04-18T04:58:05.091 INFO:tasks.workunit.client.0.smithi096.stdout:7/536: getdents db/d20/d2f/d8d 0 2024-04-18T04:58:05.092 INFO:tasks.workunit.client.0.smithi096.stdout:2/736: mkdir df/d18/d24/d42/d3f/d4a/df4 0 2024-04-18T04:58:05.092 INFO:tasks.workunit.client.0.smithi096.stdout:3/696: dwrite dc/d26/d66/d7f/fcb [0,4194304] 0 2024-04-18T04:58:05.097 INFO:tasks.workunit.client.0.smithi096.stdout:2/737: symlink df/d18/lf5 0 2024-04-18T04:58:05.098 INFO:tasks.workunit.client.0.smithi096.stdout:5/466: dwrite d7/d25/d7c/fa6 [0,4194304] 0 2024-04-18T04:58:05.099 INFO:tasks.workunit.client.0.smithi096.stdout:6/756: dread d0/d6/d2b/d3b/d7d/f8c [0,4194304] 0 2024-04-18T04:58:05.099 INFO:tasks.workunit.client.0.smithi096.stdout:3/697: unlink dc/d26/d57/fa0 0 2024-04-18T04:58:05.102 INFO:tasks.workunit.client.0.smithi096.stdout:2/738: write df/d18/d71/db8/fea [525604,76036] 0 2024-04-18T04:58:05.104 INFO:tasks.workunit.client.0.smithi096.stdout:5/467: truncate d7/f4c 1812282 0 2024-04-18T04:58:05.105 INFO:tasks.workunit.client.0.smithi096.stdout:6/757: dread d0/f67 [0,4194304] 0 2024-04-18T04:58:05.106 INFO:tasks.workunit.client.0.smithi096.stdout:3/698: mkdir dc/d26/d48/dc2/d95/de3 0 2024-04-18T04:58:05.107 INFO:tasks.workunit.client.0.smithi096.stdout:7/537: dwrite db/d1f/d24/f7c [0,4194304] 0 2024-04-18T04:58:05.110 INFO:tasks.workunit.client.0.smithi096.stdout:2/739: mkdir df/d18/d71/d9c/db6/df6 0 2024-04-18T04:58:05.113 INFO:tasks.workunit.client.0.smithi096.stdout:7/538: mknod db/d1d/d82/cb2 0 2024-04-18T04:58:05.113 INFO:tasks.workunit.client.0.smithi096.stdout:9/560: truncate d0/de/d17/d56/d59/d68/f98 629790 0 2024-04-18T04:58:05.115 INFO:tasks.workunit.client.0.smithi096.stdout:5/468: creat d7/dd/d35/da0/fad x:0 0 0 2024-04-18T04:58:05.115 INFO:tasks.workunit.client.0.smithi096.stdout:7/539: readlink db/d1f/d42/l43 0 2024-04-18T04:58:05.120 INFO:tasks.workunit.client.0.smithi096.stdout:7/540: write db/d20/d45/f63 [4633150,9517] 0 2024-04-18T04:58:05.122 INFO:tasks.workunit.client.0.smithi096.stdout:5/469: write d7/d39/d52/f65 [3317058,4593] 0 2024-04-18T04:58:05.122 INFO:tasks.workunit.client.0.smithi096.stdout:3/699: dwrite dc/d26/d48/dae/fd8 [0,4194304] 0 2024-04-18T04:58:05.126 INFO:tasks.workunit.client.0.smithi096.stdout:6/758: dread d0/d6/d5d/f7b [0,4194304] 0 2024-04-18T04:58:05.127 INFO:tasks.workunit.client.0.smithi096.stdout:5/470: unlink f6 0 2024-04-18T04:58:05.129 INFO:tasks.workunit.client.0.smithi096.stdout:3/700: write dc/f24 [4814158,24614] 0 2024-04-18T04:58:05.132 INFO:tasks.workunit.client.0.smithi096.stdout:9/561: dwrite d0/de/d17/d5c/f7c [0,4194304] 0 2024-04-18T04:58:05.132 INFO:tasks.workunit.client.0.smithi096.stdout:2/740: write df/f63 [302695,114928] 0 2024-04-18T04:58:05.133 INFO:tasks.workunit.client.0.smithi096.stdout:5/471: creat d7/d25/d2b/fae x:0 0 0 2024-04-18T04:58:05.135 INFO:tasks.workunit.client.0.smithi096.stdout:3/701: write dc/d26/f72 [1527248,108091] 0 2024-04-18T04:58:05.137 INFO:tasks.workunit.client.0.smithi096.stdout:6/759: mkdir d0/d6/d29/de5 0 2024-04-18T04:58:05.138 INFO:tasks.workunit.client.0.smithi096.stdout:2/741: rmdir df/d18/d99 39 2024-04-18T04:58:05.139 INFO:tasks.workunit.client.0.smithi096.stdout:6/760: chown d0/d6/d2e/f7c 416 1 2024-04-18T04:58:05.140 INFO:tasks.workunit.client.0.smithi096.stdout:5/472: unlink d7/dd/f76 0 2024-04-18T04:58:05.141 INFO:tasks.workunit.client.0.smithi096.stdout:5/473: readlink d7/dd/d35/l5f 0 2024-04-18T04:58:05.142 INFO:tasks.workunit.client.0.smithi096.stdout:9/562: rmdir d0/de/d17/d5c/db4 0 2024-04-18T04:58:05.143 INFO:tasks.workunit.client.0.smithi096.stdout:5/474: fsync d7/dd/d35/f59 0 2024-04-18T04:58:05.145 INFO:tasks.workunit.client.0.smithi096.stdout:7/541: dread db/d1f/d42/f59 [0,4194304] 0 2024-04-18T04:58:05.148 INFO:tasks.workunit.client.0.smithi096.stdout:5/475: dread d7/f3c [0,4194304] 0 2024-04-18T04:58:05.151 INFO:tasks.workunit.client.0.smithi096.stdout:5/476: read d7/f22 [1034243,50024] 0 2024-04-18T04:58:05.153 INFO:tasks.workunit.client.0.smithi096.stdout:7/542: rename db/d20/d2f/d8d/da1/l96 to db/d20/d45/lb3 0 2024-04-18T04:58:05.153 INFO:tasks.workunit.client.0.smithi096.stdout:6/761: dwrite d0/d6/d2b/d3b/dbb/fd4 [0,4194304] 0 2024-04-18T04:58:05.154 INFO:tasks.workunit.client.0.smithi096.stdout:9/563: write d0/de/d17/d56/d59/d68/f98 [366711,129755] 0 2024-04-18T04:58:05.156 INFO:tasks.workunit.client.0.smithi096.stdout:6/762: dread - d0/d6/d2b/d3b/d69/d6c/fe2 zero size 2024-04-18T04:58:05.156 INFO:tasks.workunit.client.0.smithi096.stdout:2/742: dread fe [0,4194304] 0 2024-04-18T04:58:05.157 INFO:tasks.workunit.client.0.smithi096.stdout:5/477: rename d7/da3/l8e to d7/da3/laf 0 2024-04-18T04:58:05.157 INFO:tasks.workunit.client.0.smithi096.stdout:6/763: stat d0/d6/d2b/l4d 0 2024-04-18T04:58:05.158 INFO:tasks.workunit.client.0.smithi096.stdout:3/702: dread dc/d26/d48/dc2/f3e [0,4194304] 0 2024-04-18T04:58:05.158 INFO:tasks.workunit.client.0.smithi096.stdout:9/564: symlink d0/de/d17/d56/d59/d68/d96/lb6 0 2024-04-18T04:58:05.161 INFO:tasks.workunit.client.0.smithi096.stdout:5/478: mknod d7/d39/d36/cb0 0 2024-04-18T04:58:05.161 INFO:tasks.workunit.client.0.smithi096.stdout:9/565: fdatasync d0/d52/d5a/f7d 0 2024-04-18T04:58:05.161 INFO:tasks.workunit.client.0.smithi096.stdout:6/764: mkdir d0/d6/d5d/de6 0 2024-04-18T04:58:05.161 INFO:tasks.workunit.client.0.smithi096.stdout:2/743: chown df/d18/d71/lba 1751338126 1 2024-04-18T04:58:05.162 INFO:tasks.workunit.client.0.smithi096.stdout:5/479: readlink d7/d39/d36/l67 0 2024-04-18T04:58:05.163 INFO:tasks.workunit.client.0.smithi096.stdout:3/703: write dc/d70/f73 [4356137,51868] 0 2024-04-18T04:58:05.165 INFO:tasks.workunit.client.0.smithi096.stdout:7/543: dwrite db/d1d/f75 [4194304,4194304] 0 2024-04-18T04:58:05.167 INFO:tasks.workunit.client.0.smithi096.stdout:5/480: mkdir d7/dd/d35/db1 0 2024-04-18T04:58:05.171 INFO:tasks.workunit.client.0.smithi096.stdout:3/704: symlink dc/d26/d48/dbd/le4 0 2024-04-18T04:58:05.171 INFO:tasks.workunit.client.0.smithi096.stdout:2/744: dread fe [0,4194304] 0 2024-04-18T04:58:05.172 INFO:tasks.workunit.client.0.smithi096.stdout:7/544: rename db/f48 to db/d1f/d5b/fb4 0 2024-04-18T04:58:05.173 INFO:tasks.workunit.client.0.smithi096.stdout:5/481: creat d7/d3b/d95/fb2 x:0 0 0 2024-04-18T04:58:05.177 INFO:tasks.workunit.client.0.smithi096.stdout:6/765: dwrite d0/d6/d2b/d3b/d69/f71 [0,4194304] 0 2024-04-18T04:58:05.177 INFO:tasks.workunit.client.0.smithi096.stdout:3/705: write dc/d26/d4a/ddf/d93/fb9 [161432,23541] 0 2024-04-18T04:58:05.177 INFO:tasks.workunit.client.0.smithi096.stdout:5/482: fsync d7/d39/d36/f54 0 2024-04-18T04:58:05.178 INFO:tasks.workunit.client.0.smithi096.stdout:6/766: readlink d0/d6/d2b/d3b/l23 0 2024-04-18T04:58:05.179 INFO:tasks.workunit.client.0.smithi096.stdout:9/566: dwrite d0/de/d17/d56/d59/d68/dab/d3a/f8f [0,4194304] 0 2024-04-18T04:58:05.179 INFO:tasks.workunit.client.0.smithi096.stdout:7/545: read db/d1f/d42/f5f [9301546,70016] 0 2024-04-18T04:58:05.182 INFO:tasks.workunit.client.0.smithi096.stdout:3/706: unlink dc/d26/c3d 0 2024-04-18T04:58:05.184 INFO:tasks.workunit.client.0.smithi096.stdout:3/707: dread - dc/d26/d4a/faa zero size 2024-04-18T04:58:05.184 INFO:tasks.workunit.client.0.smithi096.stdout:7/546: rmdir db/d1f/d24 39 2024-04-18T04:58:05.186 INFO:tasks.workunit.client.0.smithi096.stdout:9/567: dread d0/de/d17/d56/d59/d60/f8a [0,4194304] 0 2024-04-18T04:58:05.186 INFO:tasks.workunit.client.0.smithi096.stdout:2/745: link df/d18/d24/c6a df/d18/d24/d42/d3f/d4a/d82/cf7 0 2024-04-18T04:58:05.189 INFO:tasks.workunit.client.0.smithi096.stdout:7/547: symlink db/d1f/d39/d6d/lb5 0 2024-04-18T04:58:05.189 INFO:tasks.workunit.client.0.smithi096.stdout:7/548: stat db/f18 0 2024-04-18T04:58:05.189 INFO:tasks.workunit.client.0.smithi096.stdout:6/767: dwrite d0/d6/d2b/d3b/d69/f71 [4194304,4194304] 0 2024-04-18T04:58:05.190 INFO:tasks.workunit.client.0.smithi096.stdout:6/768: stat d0/d6/cbd 0 2024-04-18T04:58:05.190 INFO:tasks.workunit.client.0.smithi096.stdout:7/549: chown db/d1f/d5b/d6a/f8b 0 1 2024-04-18T04:58:05.192 INFO:tasks.workunit.client.0.smithi096.stdout:3/708: getdents dc/d26/d48/dc2/d95/de3 0 2024-04-18T04:58:05.193 INFO:tasks.workunit.client.0.smithi096.stdout:6/769: readlink d0/d6/d2b/d3b/d69/d66/l88 0 2024-04-18T04:58:05.195 INFO:tasks.workunit.client.0.smithi096.stdout:2/746: creat df/d18/d24/ff8 x:0 0 0 2024-04-18T04:58:05.197 INFO:tasks.workunit.client.0.smithi096.stdout:9/568: rename d0/d52/l87 to d0/d52/lb7 0 2024-04-18T04:58:05.197 INFO:tasks.workunit.client.0.smithi096.stdout:2/747: chown df/d18/d24/d42/d3f 118 1 2024-04-18T04:58:05.202 INFO:tasks.workunit.client.0.smithi096.stdout:3/709: getdents dc/d26/d48/dc2/d95/de3 0 2024-04-18T04:58:05.203 INFO:tasks.workunit.client.0.smithi096.stdout:6/770: write d0/d6/d2b/d3b/d7d/fcd [657253,57536] 0 2024-04-18T04:58:05.205 INFO:tasks.workunit.client.0.smithi096.stdout:2/748: dread df/f65 [0,4194304] 0 2024-04-18T04:58:05.206 INFO:tasks.workunit.client.0.smithi096.stdout:6/771: creat d0/da0/fe7 x:0 0 0 2024-04-18T04:58:05.209 INFO:tasks.workunit.client.0.smithi096.stdout:9/569: dwrite d0/de/f86 [0,4194304] 0 2024-04-18T04:58:05.209 INFO:tasks.workunit.client.0.smithi096.stdout:3/710: getdents dc/d26/d4a/d8b 0 2024-04-18T04:58:05.210 INFO:tasks.workunit.client.0.smithi096.stdout:7/550: dwrite db/f18 [0,4194304] 0 2024-04-18T04:58:05.214 INFO:tasks.workunit.client.0.smithi096.stdout:6/772: mknod d0/d6/d2e/d7a/ce8 0 2024-04-18T04:58:05.215 INFO:tasks.workunit.client.0.smithi096.stdout:6/773: unlink d0/d6/d2b/l3d 0 2024-04-18T04:58:05.216 INFO:tasks.workunit.client.0.smithi096.stdout:2/749: write df/d7d/d9f/fa4 [1618572,38589] 0 2024-04-18T04:58:05.220 INFO:tasks.workunit.client.0.smithi096.stdout:6/774: truncate d0/d4a/fb1 361645 0 2024-04-18T04:58:05.220 INFO:tasks.workunit.client.0.smithi096.stdout:2/750: mknod df/d18/d24/d42/d6e/cf9 0 2024-04-18T04:58:05.221 INFO:tasks.workunit.client.0.smithi096.stdout:7/551: truncate db/d20/f66 716720 0 2024-04-18T04:58:05.222 INFO:tasks.workunit.client.0.smithi096.stdout:6/775: unlink d0/d6/d2b/d3b/d69/cbf 0 2024-04-18T04:58:05.226 INFO:tasks.workunit.client.0.smithi096.stdout:3/711: dread dc/f22 [0,4194304] 0 2024-04-18T04:58:05.227 INFO:tasks.workunit.client.0.smithi096.stdout:9/570: dread d0/de/d17/d56/d59/d68/d96/f9b [0,4194304] 0 2024-04-18T04:58:05.228 INFO:tasks.workunit.client.0.smithi096.stdout:6/776: rename d0/l77 to d0/d6/d2b/d3b/d69/le9 0 2024-04-18T04:58:05.229 INFO:tasks.workunit.client.0.smithi096.stdout:3/712: symlink dc/d26/d66/le5 0 2024-04-18T04:58:05.233 INFO:tasks.workunit.client.0.smithi096.stdout:9/571: mkdir d0/db8 0 2024-04-18T04:58:05.235 INFO:tasks.workunit.client.0.smithi096.stdout:3/713: rename dc/d5d/fe0 to dc/d26/d4a/ddf/d93/fe6 0 2024-04-18T04:58:05.237 INFO:tasks.workunit.client.0.smithi096.stdout:2/751: dwrite df/d18/d24/d42/dd9/fe2 [0,4194304] 0 2024-04-18T04:58:05.238 INFO:tasks.workunit.client.0.smithi096.stdout:7/552: dread db/d1f/d24/d49/f71 [0,4194304] 0 2024-04-18T04:58:05.239 INFO:tasks.workunit.client.0.smithi096.stdout:7/553: stat db/d1f/d24/d49/f86 0 2024-04-18T04:58:05.241 INFO:tasks.workunit.client.0.smithi096.stdout:3/714: dread dc/fa9 [0,4194304] 0 2024-04-18T04:58:05.242 INFO:tasks.workunit.client.0.smithi096.stdout:6/777: chown d0/d6/d5d/ddd/fde 0 1 2024-04-18T04:58:05.244 INFO:tasks.workunit.client.0.smithi096.stdout:2/752: mkdir df/d18/d71/dfa 0 2024-04-18T04:58:05.245 INFO:tasks.workunit.client.0.smithi096.stdout:9/572: write d0/f11 [1592269,77088] 0 2024-04-18T04:58:05.245 INFO:tasks.workunit.client.0.smithi096.stdout:7/554: mknod db/d1f/d5b/d6a/cb6 0 2024-04-18T04:58:05.246 INFO:tasks.workunit.client.0.smithi096.stdout:7/555: write db/d1d/f5a [2248264,46949] 0 2024-04-18T04:58:05.248 INFO:tasks.workunit.client.0.smithi096.stdout:3/715: creat dc/d5d/fe7 x:0 0 0 2024-04-18T04:58:05.252 INFO:tasks.workunit.client.0.smithi096.stdout:7/556: unlink db/c99 0 2024-04-18T04:58:05.254 INFO:tasks.workunit.client.0.smithi096.stdout:3/716: creat dc/fe8 x:0 0 0 2024-04-18T04:58:05.254 INFO:tasks.workunit.client.0.smithi096.stdout:0/467: sync 2024-04-18T04:58:05.256 INFO:tasks.workunit.client.0.smithi096.stdout:9/573: dwrite d0/f11 [0,4194304] 0 2024-04-18T04:58:05.256 INFO:tasks.workunit.client.0.smithi096.stdout:7/557: creat db/d1f/d24/d61/fb7 x:0 0 0 2024-04-18T04:58:05.258 INFO:tasks.workunit.client.0.smithi096.stdout:9/574: dread - d0/d52/fb5 zero size 2024-04-18T04:58:05.260 INFO:tasks.workunit.client.0.smithi096.stdout:6/778: dwrite d0/d6/d2e/f38 [4194304,4194304] 0 2024-04-18T04:58:05.262 INFO:tasks.workunit.client.0.smithi096.stdout:3/717: creat dc/d26/d48/dc2/d29/d7e/fe9 x:0 0 0 2024-04-18T04:58:05.262 INFO:tasks.workunit.client.0.smithi096.stdout:2/753: dread df/d18/f5f [0,4194304] 0 2024-04-18T04:58:05.263 INFO:tasks.workunit.client.0.smithi096.stdout:6/779: dread - d0/da0/fe7 zero size 2024-04-18T04:58:05.264 INFO:tasks.workunit.client.0.smithi096.stdout:9/575: creat d0/de/d17/d56/d59/d60/fb9 x:0 0 0 2024-04-18T04:58:05.266 INFO:tasks.workunit.client.0.smithi096.stdout:3/718: creat dc/d26/fea x:0 0 0 2024-04-18T04:58:05.266 INFO:tasks.workunit.client.0.smithi096.stdout:9/576: readlink d0/de/d17/d2f/l49 0 2024-04-18T04:58:05.268 INFO:tasks.workunit.client.0.smithi096.stdout:6/780: symlink d0/d6/d2b/d3b/lea 0 2024-04-18T04:58:05.268 INFO:tasks.workunit.client.0.smithi096.stdout:9/577: chown d0/de/d17/d56/c6e 2 1 2024-04-18T04:58:05.270 INFO:tasks.workunit.client.0.smithi096.stdout:2/754: rename df/d18/d24/d42/d3f/d4a/dbc/fe4 to df/d18/d26/d48/ffb 0 2024-04-18T04:58:05.272 INFO:tasks.workunit.client.0.smithi096.stdout:6/781: dread d0/d6/d2b/f90 [0,4194304] 0 2024-04-18T04:58:05.276 INFO:tasks.workunit.client.0.smithi096.stdout:6/782: creat d0/d6/d2b/d3b/dc9/feb x:0 0 0 2024-04-18T04:58:05.279 INFO:tasks.workunit.client.0.smithi096.stdout:7/558: dread db/d20/d2f/f30 [0,4194304] 0 2024-04-18T04:58:05.279 INFO:tasks.workunit.client.0.smithi096.stdout:3/719: dwrite dc/d26/d4a/f58 [4194304,4194304] 0 2024-04-18T04:58:05.283 INFO:tasks.workunit.client.0.smithi096.stdout:9/578: dwrite d0/de/d17/d56/d59/d68/f98 [0,4194304] 0 2024-04-18T04:58:05.285 INFO:tasks.workunit.client.0.smithi096.stdout:0/468: dread d16/f1b [0,4194304] 0 2024-04-18T04:58:05.285 INFO:tasks.workunit.client.0.smithi096.stdout:0/469: dread - d16/d1c/d4c/d4d/d5d/f7b zero size 2024-04-18T04:58:05.287 INFO:tasks.workunit.client.0.smithi096.stdout:7/559: unlink db/d20/f66 0 2024-04-18T04:58:05.288 INFO:tasks.workunit.client.0.smithi096.stdout:9/579: symlink d0/de/d17/d2f/d40/d8b/lba 0 2024-04-18T04:58:05.290 INFO:tasks.workunit.client.0.smithi096.stdout:6/783: creat d0/d6/d2b/d3b/d69/d6c/dd8/fec x:0 0 0 2024-04-18T04:58:05.290 INFO:tasks.workunit.client.0.smithi096.stdout:6/784: chown d0/d6/d2b/f4e 709 1 2024-04-18T04:58:05.292 INFO:tasks.workunit.client.0.smithi096.stdout:0/470: mknod d16/d55/c89 0 2024-04-18T04:58:05.292 INFO:tasks.workunit.client.0.smithi096.stdout:3/720: write dc/d26/d66/d7f/f85 [3238350,32646] 0 2024-04-18T04:58:05.294 INFO:tasks.workunit.client.0.smithi096.stdout:3/721: fdatasync dc/d26/d48/dc2/d29/d7e/fe9 0 2024-04-18T04:58:05.296 INFO:tasks.workunit.client.0.smithi096.stdout:0/471: creat d16/d1d/d3b/f8a x:0 0 0 2024-04-18T04:58:05.297 INFO:tasks.workunit.client.0.smithi096.stdout:3/722: symlink dc/d26/d48/dc2/d8d/leb 0 2024-04-18T04:58:05.297 INFO:tasks.workunit.client.0.smithi096.stdout:0/472: fsync d16/f21 0 2024-04-18T04:58:05.299 INFO:tasks.workunit.client.0.smithi096.stdout:6/785: getdents d0 0 2024-04-18T04:58:05.300 INFO:tasks.workunit.client.0.smithi096.stdout:9/580: rename d0/ld to d0/d52/lbb 0 2024-04-18T04:58:05.301 INFO:tasks.workunit.client.0.smithi096.stdout:0/473: unlink d16/d1c/d22/f28 0 2024-04-18T04:58:05.301 INFO:tasks.workunit.client.0.smithi096.stdout:6/786: stat d0/d6/d2b/f90 0 2024-04-18T04:58:05.302 INFO:tasks.workunit.client.0.smithi096.stdout:3/723: creat dc/d26/d48/dc2/d95/fec x:0 0 0 2024-04-18T04:58:05.302 INFO:tasks.workunit.client.0.smithi096.stdout:2/755: dwrite df/d18/d26/d48/f49 [0,4194304] 0 2024-04-18T04:58:05.303 INFO:tasks.workunit.client.0.smithi096.stdout:3/724: chown dc/d70 630902 1 2024-04-18T04:58:05.304 INFO:tasks.workunit.client.0.smithi096.stdout:9/581: fdatasync d0/de/d17/d56/d59/d68/dab/d3a/f4a 0 2024-04-18T04:58:05.305 INFO:tasks.workunit.client.0.smithi096.stdout:2/756: fsync df/d18/d24/f8d 0 2024-04-18T04:58:05.306 INFO:tasks.workunit.client.0.smithi096.stdout:0/474: unlink d16/d1c/d4c/d4d/d5d/f76 0 2024-04-18T04:58:05.306 INFO:tasks.workunit.client.0.smithi096.stdout:0/475: chown l5 409541 1 2024-04-18T04:58:05.308 INFO:tasks.workunit.client.0.smithi096.stdout:3/725: mknod dc/d26/d48/dc2/ced 0 2024-04-18T04:58:05.309 INFO:tasks.workunit.client.0.smithi096.stdout:6/787: creat d0/d6/d2b/d3b/d69/d6c/fed x:0 0 0 2024-04-18T04:58:05.312 INFO:tasks.workunit.client.0.smithi096.stdout:3/726: rmdir dc/d26/d48/dc2/d8d 39 2024-04-18T04:58:05.313 INFO:tasks.workunit.client.0.smithi096.stdout:6/788: mkdir d0/d6/d2b/d3b/d7d/dee 0 2024-04-18T04:58:05.314 INFO:tasks.workunit.client.0.smithi096.stdout:9/582: creat d0/de/d17/fbc x:0 0 0 2024-04-18T04:58:05.315 INFO:tasks.workunit.client.0.smithi096.stdout:2/757: dwrite df/f69 [0,4194304] 0 2024-04-18T04:58:05.315 INFO:tasks.workunit.client.0.smithi096.stdout:3/727: read - dc/d26/d48/dc2/d95/fa2 zero size 2024-04-18T04:58:05.317 INFO:tasks.workunit.client.0.smithi096.stdout:0/476: rmdir d16/d1c/d4c/d4d/d5d 39 2024-04-18T04:58:05.318 INFO:tasks.workunit.client.0.smithi096.stdout:6/789: read d0/d6/d29/f30 [2435260,83578] 0 2024-04-18T04:58:05.319 INFO:tasks.workunit.client.0.smithi096.stdout:3/728: write dc/d5d/fe7 [757228,36482] 0 2024-04-18T04:58:05.319 INFO:tasks.workunit.client.0.smithi096.stdout:2/758: symlink df/d18/d24/d42/d3f/d4a/dbc/lfc 0 2024-04-18T04:58:05.320 INFO:tasks.workunit.client.0.smithi096.stdout:9/583: write d0/de/d17/d56/d59/d68/dab/d33/f9f [169576,85799] 0 2024-04-18T04:58:05.322 INFO:tasks.workunit.client.0.smithi096.stdout:6/790: symlink d0/d4a/lef 0 2024-04-18T04:58:05.322 INFO:tasks.workunit.client.0.smithi096.stdout:0/477: creat d16/d1c/d4c/d4e/d67/f8b x:0 0 0 2024-04-18T04:58:05.324 INFO:tasks.workunit.client.0.smithi096.stdout:6/791: fdatasync d0/d6/d2b/d3b/d69/fca 0 2024-04-18T04:58:05.324 INFO:tasks.workunit.client.0.smithi096.stdout:7/560: dread db/d1f/d5b/d6a/f8b [0,4194304] 0 2024-04-18T04:58:05.324 INFO:tasks.workunit.client.0.smithi096.stdout:3/729: chown dc/d26/f78 2783504 1 2024-04-18T04:58:05.325 INFO:tasks.workunit.client.0.smithi096.stdout:0/478: write d16/f40 [2682665,6247] 0 2024-04-18T04:58:05.326 INFO:tasks.workunit.client.0.smithi096.stdout:9/584: fsync d0/de/d17/d56/d59/d68/dab/d33/f9f 0 2024-04-18T04:58:05.326 INFO:tasks.workunit.client.0.smithi096.stdout:2/759: creat df/d18/ffd x:0 0 0 2024-04-18T04:58:05.327 INFO:tasks.workunit.client.0.smithi096.stdout:7/561: creat db/d20/fb8 x:0 0 0 2024-04-18T04:58:05.327 INFO:tasks.workunit.client.0.smithi096.stdout:3/730: mkdir dc/d26/d48/dee 0 2024-04-18T04:58:05.329 INFO:tasks.workunit.client.0.smithi096.stdout:7/562: rmdir db/d1f/d5b 39 2024-04-18T04:58:05.330 INFO:tasks.workunit.client.0.smithi096.stdout:0/479: chown d16/d1c/d4c/d4d/d5d/f74 739 1 2024-04-18T04:58:05.331 INFO:tasks.workunit.client.0.smithi096.stdout:2/760: rename df/d18/fbd to df/d18/d71/db8/ffe 0 2024-04-18T04:58:05.331 INFO:tasks.workunit.client.0.smithi096.stdout:6/792: rename d0/d6/d2b/d3b/d7d to d0/d6/d2b/d3b/d7d/dee/df0 22 2024-04-18T04:58:05.332 INFO:tasks.workunit.client.0.smithi096.stdout:2/761: write df/d18/d26/f4c [3179259,129371] 0 2024-04-18T04:58:05.334 INFO:tasks.workunit.client.0.smithi096.stdout:3/731: mknod dc/d26/d4a/d8b/cef 0 2024-04-18T04:58:05.336 INFO:tasks.workunit.client.0.smithi096.stdout:0/480: creat d16/d1c/f8c x:0 0 0 2024-04-18T04:58:05.337 INFO:tasks.workunit.client.0.smithi096.stdout:0/481: write d16/d1c/d4c/d4d/d5a/f83 [591405,37624] 0 2024-04-18T04:58:05.339 INFO:tasks.workunit.client.0.smithi096.stdout:0/482: truncate d16/d1c/d4c/d4d/d5a/f6c 4935786 0 2024-04-18T04:58:05.339 INFO:tasks.workunit.client.0.smithi096.stdout:2/762: mkdir df/d18/d24/d42/d3f/d4a/dbc/dff 0 2024-04-18T04:58:05.340 INFO:tasks.workunit.client.0.smithi096.stdout:0/483: dread - d16/d1c/d4c/d4d/d5a/f70 zero size 2024-04-18T04:58:05.341 INFO:tasks.workunit.client.0.smithi096.stdout:7/563: rename db/d1f/d5b/d6a/f6e to db/d1f/d5b/d6a/d74/fb9 0 2024-04-18T04:58:05.342 INFO:tasks.workunit.client.0.smithi096.stdout:3/732: fsync dc/f22 0 2024-04-18T04:58:05.342 INFO:tasks.workunit.client.0.smithi096.stdout:7/564: read db/d1f/d24/d49/f86 [193142,55872] 0 2024-04-18T04:58:05.343 INFO:tasks.workunit.client.0.smithi096.stdout:9/585: write d0/de/d17/d2f/d40/fb3 [1453208,87515] 0 2024-04-18T04:58:05.344 INFO:tasks.workunit.client.0.smithi096.stdout:0/484: creat d16/d1c/d4c/d4e/d67/f8d x:0 0 0 2024-04-18T04:58:05.349 INFO:tasks.workunit.client.0.smithi096.stdout:0/485: symlink d16/d1d/d3b/l8e 0 2024-04-18T04:58:05.351 INFO:tasks.workunit.client.0.smithi096.stdout:9/586: chown d0/de/d17/d56/d59/d68/dab/c94 377 1 2024-04-18T04:58:05.351 INFO:tasks.workunit.client.0.smithi096.stdout:6/793: dwrite d0/d6/d2b/f90 [0,4194304] 0 2024-04-18T04:58:05.352 INFO:tasks.workunit.client.0.smithi096.stdout:7/565: dwrite db/d1f/d39/d6d/d79/f9a [0,4194304] 0 2024-04-18T04:58:05.353 INFO:tasks.workunit.client.0.smithi096.stdout:3/733: truncate dc/d26/d48/dc2/f63 808253 0 2024-04-18T04:58:05.354 INFO:tasks.workunit.client.0.smithi096.stdout:0/486: dread d16/d1c/d4c/d4e/f64 [0,4194304] 0 2024-04-18T04:58:05.359 INFO:tasks.workunit.client.0.smithi096.stdout:2/763: getdents df/d7d 0 2024-04-18T04:58:05.360 INFO:tasks.workunit.client.0.smithi096.stdout:9/587: write d0/de/f2d [1173313,62350] 0 2024-04-18T04:58:05.363 INFO:tasks.workunit.client.0.smithi096.stdout:0/487: truncate d16/d55/f5f 4598324 0 2024-04-18T04:58:05.363 INFO:tasks.workunit.client.0.smithi096.stdout:2/764: chown df/d18/d24/d42/d3f/d4a/dbc/le0 31805 1 2024-04-18T04:58:05.364 INFO:tasks.workunit.client.0.smithi096.stdout:3/734: symlink dc/d26/d48/dc2/d95/lf0 0 2024-04-18T04:58:05.365 INFO:tasks.workunit.client.0.smithi096.stdout:0/488: rename d16/d1d/d7c to d16/d1c/d4c/d4d/d5d/d8f 0 2024-04-18T04:58:05.366 INFO:tasks.workunit.client.0.smithi096.stdout:0/489: stat d16/f21 0 2024-04-18T04:58:05.366 INFO:tasks.workunit.client.0.smithi096.stdout:6/794: dread d0/d6/d2b/d3b/d69/d6c/d85/f9f [0,4194304] 0 2024-04-18T04:58:05.368 INFO:tasks.workunit.client.0.smithi096.stdout:3/735: dread dc/d26/d48/dc2/fab [0,4194304] 0 2024-04-18T04:58:05.372 INFO:tasks.workunit.client.0.smithi096.stdout:0/490: creat d16/d1c/d22/d2c/f90 x:0 0 0 2024-04-18T04:58:05.372 INFO:tasks.workunit.client.0.smithi096.stdout:2/765: truncate df/d18/d26/d48/fc6 423082 0 2024-04-18T04:58:05.375 INFO:tasks.workunit.client.0.smithi096.stdout:9/588: write d0/d41/f63 [231794,103619] 0 2024-04-18T04:58:05.377 INFO:tasks.workunit.client.0.smithi096.stdout:6/795: dwrite d0/d6/f37 [0,4194304] 0 2024-04-18T04:58:05.378 INFO:tasks.workunit.client.0.smithi096.stdout:9/589: readlink d0/de/d17/d56/d59/d68/dab/d3a/l45 0 2024-04-18T04:58:05.379 INFO:tasks.workunit.client.0.smithi096.stdout:7/566: getdents db/d1f/d39/d6d 0 2024-04-18T04:58:05.381 INFO:tasks.workunit.client.0.smithi096.stdout:2/766: chown df/d18/d24/c6a 35689864 1 2024-04-18T04:58:05.381 INFO:tasks.workunit.client.0.smithi096.stdout:3/736: creat dc/d26/d48/dee/ff1 x:0 0 0 2024-04-18T04:58:05.390 INFO:tasks.workunit.client.0.smithi096.stdout:3/737: creat dc/d26/d48/ff2 x:0 0 0 2024-04-18T04:58:05.390 INFO:tasks.workunit.client.0.smithi096.stdout:6/796: write d0/d6/d2e/f7c [1806099,49306] 0 2024-04-18T04:58:05.391 INFO:tasks.workunit.client.0.smithi096.stdout:0/491: dwrite d16/d1d/d3b/f8a [0,4194304] 0 2024-04-18T04:58:05.392 INFO:tasks.workunit.client.0.smithi096.stdout:3/738: chown dc/d26/d48/dc2/d95 556827 1 2024-04-18T04:58:05.398 INFO:tasks.workunit.client.0.smithi096.stdout:0/492: dread d16/d1c/d4c/d4d/d5d/d8f/f5e [0,4194304] 0 2024-04-18T04:58:05.398 INFO:tasks.workunit.client.0.smithi096.stdout:7/567: creat db/d20/fba x:0 0 0 2024-04-18T04:58:05.399 INFO:tasks.workunit.client.0.smithi096.stdout:9/590: mknod d0/de/d17/d56/cbd 0 2024-04-18T04:58:05.399 INFO:tasks.workunit.client.0.smithi096.stdout:0/493: readlink d16/d1c/d4c/d4d/d5d/d8f/l75 0 2024-04-18T04:58:05.399 INFO:tasks.workunit.client.0.smithi096.stdout:7/568: chown db/d1d/l94 0 1 2024-04-18T04:58:05.399 INFO:tasks.workunit.client.0.smithi096.stdout:2/767: truncate df/d18/d26/f4d 1319626 0 2024-04-18T04:58:05.400 INFO:tasks.workunit.client.0.smithi096.stdout:6/797: mknod d0/d6/d5d/cf1 0 2024-04-18T04:58:05.408 INFO:tasks.workunit.client.0.smithi096.stdout:9/591: link d0/de/d17/d56/d59/d68/dab/l44 d0/de/lbe 0 2024-04-18T04:58:05.411 INFO:tasks.workunit.client.0.smithi096.stdout:2/768: link df/d18/d26/d48/d7b/cd3 df/d18/d71/d9c/db6/df6/c100 0 2024-04-18T04:58:05.411 INFO:tasks.workunit.client.0.smithi096.stdout:6/798: dwrite d0/d6/d2b/d3b/dc9/feb [0,4194304] 0 2024-04-18T04:58:05.412 INFO:tasks.workunit.client.0.smithi096.stdout:3/739: dwrite dc/d26/d48/dc2/d29/fca [0,4194304] 0 2024-04-18T04:58:05.413 INFO:tasks.workunit.client.0.smithi096.stdout:6/799: mknod d0/d4a/cf2 0 2024-04-18T04:58:05.414 INFO:tasks.workunit.client.0.smithi096.stdout:9/592: creat d0/de/d17/d56/d59/d68/dab/d33/fbf x:0 0 0 2024-04-18T04:58:05.418 INFO:tasks.workunit.client.0.smithi096.stdout:2/769: unlink df/d18/d24/d42/d3f/d4a/d82/cc2 0 2024-04-18T04:58:05.419 INFO:tasks.workunit.client.0.smithi096.stdout:7/569: dread db/d1f/f40 [0,4194304] 0 2024-04-18T04:58:05.424 INFO:tasks.workunit.client.0.smithi096.stdout:7/570: mknod db/d1f/d4e/cbb 0 2024-04-18T04:58:05.427 INFO:tasks.workunit.client.0.smithi096.stdout:2/770: mkdir df/d18/d24/d42/d101 0 2024-04-18T04:58:05.428 INFO:tasks.workunit.client.0.smithi096.stdout:3/740: link dc/d26/d48/la6 dc/d26/d48/lf3 0 2024-04-18T04:58:05.435 INFO:tasks.workunit.client.0.smithi096.stdout:7/571: dwrite db/d1f/d24/f7c [0,4194304] 0 2024-04-18T04:58:05.439 INFO:tasks.workunit.client.0.smithi096.stdout:9/593: dread d0/de/d17/d56/d59/d68/f8e [0,4194304] 0 2024-04-18T04:58:05.442 INFO:tasks.workunit.client.0.smithi096.stdout:1/628: sync 2024-04-18T04:58:05.444 INFO:tasks.workunit.client.0.smithi096.stdout:6/800: dwrite d0/d6/d2b/f5e [0,4194304] 0 2024-04-18T04:58:05.445 INFO:tasks.workunit.client.0.smithi096.stdout:3/741: dwrite dc/d26/d4a/ddf/f7b [0,4194304] 0 2024-04-18T04:58:05.447 INFO:tasks.workunit.client.0.smithi096.stdout:6/801: stat d0/d6/d2b/f90 0 2024-04-18T04:58:05.447 INFO:tasks.workunit.client.0.smithi096.stdout:9/594: chown d0/de/d17/d2f/d40/fb3 0 1 2024-04-18T04:58:05.448 INFO:tasks.workunit.client.0.smithi096.stdout:2/771: dwrite df/d18/d26/d48/fa6 [0,4194304] 0 2024-04-18T04:58:05.449 INFO:tasks.workunit.client.0.smithi096.stdout:7/572: dread db/d20/d45/f63 [0,4194304] 0 2024-04-18T04:58:05.450 INFO:tasks.workunit.client.0.smithi096.stdout:1/629: read de/d1d/f52 [2424201,85008] 0 2024-04-18T04:58:05.458 INFO:tasks.workunit.client.0.smithi096.stdout:6/802: mkdir d0/d6/d2b/d3b/df3 0 2024-04-18T04:58:05.458 INFO:tasks.workunit.client.0.smithi096.stdout:7/573: fsync f7 0 2024-04-18T04:58:05.458 INFO:tasks.workunit.client.0.smithi096.stdout:1/630: write f9 [782758,53526] 0 2024-04-18T04:58:05.460 INFO:tasks.workunit.client.0.smithi096.stdout:9/595: write d0/de/d17/d56/d59/d60/f8a [1475652,17259] 0 2024-04-18T04:58:05.461 INFO:tasks.workunit.client.0.smithi096.stdout:3/742: dwrite dc/d26/d48/dc2/f46 [8388608,4194304] 0 2024-04-18T04:58:05.462 INFO:tasks.workunit.client.0.smithi096.stdout:7/574: dread - db/d1d/d82/fb0 zero size 2024-04-18T04:58:05.463 INFO:tasks.workunit.client.0.smithi096.stdout:6/803: read d0/d6/d2b/d7e/fc1 [1763847,98341] 0 2024-04-18T04:58:05.464 INFO:tasks.workunit.client.0.smithi096.stdout:3/743: dread dc/d26/d4a/d8b/f99 [0,4194304] 0 2024-04-18T04:58:05.465 INFO:tasks.workunit.client.0.smithi096.stdout:7/575: mkdir db/d1d/d82/dbc 0 2024-04-18T04:58:05.466 INFO:tasks.workunit.client.0.smithi096.stdout:6/804: write d0/d6/fc0 [3062616,40303] 0 2024-04-18T04:58:05.467 INFO:tasks.workunit.client.0.smithi096.stdout:9/596: write d0/f9a [4631699,121770] 0 2024-04-18T04:58:05.470 INFO:tasks.workunit.client.0.smithi096.stdout:3/744: symlink dc/dcf/dd2/lf4 0 2024-04-18T04:58:05.472 INFO:tasks.workunit.client.0.smithi096.stdout:9/597: creat d0/d52/d5a/fc0 x:0 0 0 2024-04-18T04:58:05.472 INFO:tasks.workunit.client.0.smithi096.stdout:2/772: dread df/d18/d24/d42/f2c [0,4194304] 0 2024-04-18T04:58:05.473 INFO:tasks.workunit.client.0.smithi096.stdout:7/576: getdents db/d1f/d39/d6d 0 2024-04-18T04:58:05.474 INFO:tasks.workunit.client.0.smithi096.stdout:3/745: creat dc/d26/d48/dbd/ff5 x:0 0 0 2024-04-18T04:58:05.476 INFO:tasks.workunit.client.0.smithi096.stdout:1/631: dwrite de/d1d/d32/d6f/f8a [0,4194304] 0 2024-04-18T04:58:05.476 INFO:tasks.workunit.client.0.smithi096.stdout:9/598: rmdir d0/de/d17/d56/d59/d68 39 2024-04-18T04:58:05.479 INFO:tasks.workunit.client.0.smithi096.stdout:1/632: truncate de/d1d/d32/f46 890094 0 2024-04-18T04:58:05.480 INFO:tasks.workunit.client.0.smithi096.stdout:9/599: mkdir d0/de/d17/d2f/d40/dc1 0 2024-04-18T04:58:05.483 INFO:tasks.workunit.client.0.smithi096.stdout:1/633: mkdir de/d1d/d32/d73/d8b/dc2/dcb 0 2024-04-18T04:58:05.485 INFO:tasks.workunit.client.0.smithi096.stdout:9/600: creat d0/de/d17/d56/d59/d60/fc2 x:0 0 0 2024-04-18T04:58:05.486 INFO:tasks.workunit.client.0.smithi096.stdout:1/634: creat de/d1d/d32/d73/fcc x:0 0 0 2024-04-18T04:58:05.487 INFO:tasks.workunit.client.0.smithi096.stdout:7/577: truncate db/d1d/f75 6357559 0 2024-04-18T04:58:05.489 INFO:tasks.workunit.client.0.smithi096.stdout:1/635: write de/d1d/d32/d73/fcc [891105,87324] 0 2024-04-18T04:58:05.489 INFO:tasks.workunit.client.0.smithi096.stdout:7/578: rmdir db/d20/d2f 39 2024-04-18T04:58:05.490 INFO:tasks.workunit.client.0.smithi096.stdout:3/746: dread f3 [0,4194304] 0 2024-04-18T04:58:05.492 INFO:tasks.workunit.client.0.smithi096.stdout:1/636: mknod de/d1d/d32/d6b/ccd 0 2024-04-18T04:58:05.493 INFO:tasks.workunit.client.0.smithi096.stdout:1/637: write f6 [4434875,34825] 0 2024-04-18T04:58:05.493 INFO:tasks.workunit.client.0.smithi096.stdout:7/579: unlink db/d20/d45/l60 0 2024-04-18T04:58:05.495 INFO:tasks.workunit.client.0.smithi096.stdout:9/601: dread d0/de/d17/d56/d59/d68/dab/f2e [0,4194304] 0 2024-04-18T04:58:05.496 INFO:tasks.workunit.client.0.smithi096.stdout:2/773: dread df/d18/d24/d42/d3f/d4a/fb2 [0,4194304] 0 2024-04-18T04:58:05.498 INFO:tasks.workunit.client.0.smithi096.stdout:9/602: creat d0/de/d17/d56/d6d/fc3 x:0 0 0 2024-04-18T04:58:05.500 INFO:tasks.workunit.client.0.smithi096.stdout:3/747: dread dc/d26/d48/dc2/d29/fca [0,4194304] 0 2024-04-18T04:58:05.500 INFO:tasks.workunit.client.0.smithi096.stdout:7/580: link db/d1d/c3e db/d1f/d4e/cbd 0 2024-04-18T04:58:05.500 INFO:tasks.workunit.client.0.smithi096.stdout:2/774: creat df/d18/d24/d42/d3f/d4a/dbc/f102 x:0 0 0 2024-04-18T04:58:05.500 INFO:tasks.workunit.client.0.smithi096.stdout:9/603: stat d0/d52/la3 0 2024-04-18T04:58:05.502 INFO:tasks.workunit.client.0.smithi096.stdout:1/638: write de/d1d/d3f/f63 [286420,118938] 0 2024-04-18T04:58:05.502 INFO:tasks.workunit.client.0.smithi096.stdout:7/581: chown db/d1d/d82/fa5 0 1 2024-04-18T04:58:05.502 INFO:tasks.workunit.client.0.smithi096.stdout:9/604: dread - d0/de/d17/d56/d6d/fc3 zero size 2024-04-18T04:58:05.504 INFO:tasks.workunit.client.0.smithi096.stdout:7/582: stat db/d1d/d82 0 2024-04-18T04:58:05.505 INFO:tasks.workunit.client.0.smithi096.stdout:7/583: fsync db/d1f/d24/d61/fb7 0 2024-04-18T04:58:05.506 INFO:tasks.workunit.client.0.smithi096.stdout:2/775: link df/d18/d24/d42/d3f/fe6 df/d7d/d9f/f103 0 2024-04-18T04:58:05.506 INFO:tasks.workunit.client.0.smithi096.stdout:9/605: fsync d0/de/d17/d56/d59/d68/d96/f9b 0 2024-04-18T04:58:05.507 INFO:tasks.workunit.client.0.smithi096.stdout:3/748: dread dc/d26/d48/dc2/d29/fca [0,4194304] 0 2024-04-18T04:58:05.508 INFO:tasks.workunit.client.0.smithi096.stdout:7/584: unlink db/d1f/d24/f7c 0 2024-04-18T04:58:05.511 INFO:tasks.workunit.client.0.smithi096.stdout:3/749: creat dc/d26/d48/dc2/d95/ff6 x:0 0 0 2024-04-18T04:58:05.514 INFO:tasks.workunit.client.0.smithi096.stdout:1/639: dwrite de/d1d/d81/da7/fc0 [0,4194304] 0 2024-04-18T04:58:05.517 INFO:tasks.workunit.client.0.smithi096.stdout:9/606: rmdir d0/de/d17/d56/d6d 39 2024-04-18T04:58:05.517 INFO:tasks.workunit.client.0.smithi096.stdout:9/607: stat d0/f4b 0 2024-04-18T04:58:05.518 INFO:tasks.workunit.client.0.smithi096.stdout:1/640: symlink de/d1d/d81/lce 0 2024-04-18T04:58:05.519 INFO:tasks.workunit.client.0.smithi096.stdout:2/776: dwrite df/d18/d71/d9c/db6/fed [0,4194304] 0 2024-04-18T04:58:05.519 INFO:tasks.workunit.client.0.smithi096.stdout:3/750: unlink dc/d26/d48/dc2/d8d/cd4 0 2024-04-18T04:58:05.521 INFO:tasks.workunit.client.0.smithi096.stdout:2/777: chown df/d18/d24/d42/l6c 82320234 1 2024-04-18T04:58:05.521 INFO:tasks.workunit.client.0.smithi096.stdout:3/751: write dc/d26/d66/f69 [1772757,9023] 0 2024-04-18T04:58:05.522 INFO:tasks.workunit.client.0.smithi096.stdout:9/608: creat d0/d6b/d89/fc4 x:0 0 0 2024-04-18T04:58:05.525 INFO:tasks.workunit.client.0.smithi096.stdout:9/609: stat d0/d6b/d89/fc4 0 2024-04-18T04:58:05.525 INFO:tasks.workunit.client.0.smithi096.stdout:1/641: dread de/f12 [0,4194304] 0 2024-04-18T04:58:05.528 INFO:tasks.workunit.client.0.smithi096.stdout:3/752: creat dc/ff7 x:0 0 0 2024-04-18T04:58:05.528 INFO:tasks.workunit.client.0.smithi096.stdout:9/610: rmdir d0/de/d17/d2f 39 2024-04-18T04:58:05.530 INFO:tasks.workunit.client.0.smithi096.stdout:1/642: write de/d1d/d3f/d7a/d96/f98 [745988,103514] 0 2024-04-18T04:58:05.532 INFO:tasks.workunit.client.0.smithi096.stdout:7/585: dwrite db/f7f [0,4194304] 0 2024-04-18T04:58:05.532 INFO:tasks.workunit.client.0.smithi096.stdout:9/611: chown d0/de/d17/fbc 1209 1 2024-04-18T04:58:05.532 INFO:tasks.workunit.client.0.smithi096.stdout:3/753: creat dc/ff8 x:0 0 0 2024-04-18T04:58:05.536 INFO:tasks.workunit.client.0.smithi096.stdout:9/612: write d0/de/d17/d56/d59/d68/d96/fa1 [242860,110815] 0 2024-04-18T04:58:05.536 INFO:tasks.workunit.client.0.smithi096.stdout:2/778: dwrite df/d18/d71/d9c/fda [0,4194304] 0 2024-04-18T04:58:05.538 INFO:tasks.workunit.client.0.smithi096.stdout:7/586: symlink db/d1f/d39/d6d/d79/d83/lbe 0 2024-04-18T04:58:05.539 INFO:tasks.workunit.client.0.smithi096.stdout:3/754: stat dc/d26/d48/dc2/f63 0 2024-04-18T04:58:05.543 INFO:tasks.workunit.client.0.smithi096.stdout:3/755: symlink dc/d70/lf9 0 2024-04-18T04:58:05.543 INFO:tasks.workunit.client.0.smithi096.stdout:1/643: write de/d1d/d32/f46 [1903853,127033] 0 2024-04-18T04:58:05.544 INFO:tasks.workunit.client.0.smithi096.stdout:1/644: stat de/d1d/l2d 0 2024-04-18T04:58:05.544 INFO:tasks.workunit.client.0.smithi096.stdout:7/587: write db/f12 [2001069,59069] 0 2024-04-18T04:58:05.546 INFO:tasks.workunit.client.0.smithi096.stdout:9/613: creat d0/de/d17/fc5 x:0 0 0 2024-04-18T04:58:05.548 INFO:tasks.workunit.client.0.smithi096.stdout:9/614: chown d0/c53 36671750 1 2024-04-18T04:58:05.550 INFO:tasks.workunit.client.0.smithi096.stdout:3/756: rename dc/d26/d48/f4f to dc/ffa 0 2024-04-18T04:58:05.550 INFO:tasks.workunit.client.0.smithi096.stdout:7/588: creat db/d1d/d82/dbc/fbf x:0 0 0 2024-04-18T04:58:05.552 INFO:tasks.workunit.client.0.smithi096.stdout:1/645: dread de/d1d/d32/f46 [0,4194304] 0 2024-04-18T04:58:05.553 INFO:tasks.workunit.client.0.smithi096.stdout:3/757: unlink dc/l55 0 2024-04-18T04:58:05.554 INFO:tasks.workunit.client.0.smithi096.stdout:9/615: symlink d0/de/d17/d2f/lc6 0 2024-04-18T04:58:05.555 INFO:tasks.workunit.client.0.smithi096.stdout:7/589: rename db/d1f/daf to db/d1f/d4e/dc0 0 2024-04-18T04:58:05.555 INFO:tasks.workunit.client.0.smithi096.stdout:1/646: readlink de/d1d/d3f/d7a/l9c 0 2024-04-18T04:58:05.556 INFO:tasks.workunit.client.0.smithi096.stdout:3/758: fsync dc/d26/d4a/f6c 0 2024-04-18T04:58:05.556 INFO:tasks.workunit.client.0.smithi096.stdout:9/616: mknod d0/de/d17/d56/d59/d68/d96/cc7 0 2024-04-18T04:58:05.557 INFO:tasks.workunit.client.0.smithi096.stdout:7/590: truncate db/d1f/d4e/f78 332177 0 2024-04-18T04:58:05.558 INFO:tasks.workunit.client.0.smithi096.stdout:9/617: write d0/de/d17/f2a [3594072,12959] 0 2024-04-18T04:58:05.559 INFO:tasks.workunit.client.0.smithi096.stdout:2/779: dread df/d18/d26/f54 [0,4194304] 0 2024-04-18T04:58:05.561 INFO:tasks.workunit.client.0.smithi096.stdout:7/591: chown fa 29445752 1 2024-04-18T04:58:05.564 INFO:tasks.workunit.client.0.smithi096.stdout:2/780: mkdir df/d18/d24/d42/d3f/d4a/dbc/d104 0 2024-04-18T04:58:05.565 INFO:tasks.workunit.client.0.smithi096.stdout:1/647: dwrite de/d1d/d32/f46 [0,4194304] 0 2024-04-18T04:58:05.567 INFO:tasks.workunit.client.0.smithi096.stdout:9/618: rmdir d0/db8 0 2024-04-18T04:58:05.568 INFO:tasks.workunit.client.0.smithi096.stdout:7/592: creat db/d20/d2f/d8d/fc1 x:0 0 0 2024-04-18T04:58:05.571 INFO:tasks.workunit.client.0.smithi096.stdout:7/593: fsync db/d20/d2f/f37 0 2024-04-18T04:58:05.572 INFO:tasks.workunit.client.0.smithi096.stdout:9/619: rmdir d0/de/d17/d56/d59/d60 39 2024-04-18T04:58:05.573 INFO:tasks.workunit.client.0.smithi096.stdout:7/594: read db/d20/d2f/f37 [2013915,40926] 0 2024-04-18T04:58:05.574 INFO:tasks.workunit.client.0.smithi096.stdout:7/595: truncate db/d1f/d4e/f78 411612 0 2024-04-18T04:58:05.576 INFO:tasks.workunit.client.0.smithi096.stdout:3/759: dread f8 [0,4194304] 0 2024-04-18T04:58:05.577 INFO:tasks.workunit.client.0.smithi096.stdout:9/620: creat d0/de/fc8 x:0 0 0 2024-04-18T04:58:05.578 INFO:tasks.workunit.client.0.smithi096.stdout:7/596: creat db/d20/d2f/d8d/da1/fc2 x:0 0 0 2024-04-18T04:58:05.578 INFO:tasks.workunit.client.0.smithi096.stdout:9/621: fsync d0/f9a 0 2024-04-18T04:58:05.581 INFO:tasks.workunit.client.0.smithi096.stdout:1/648: dwrite de/d1d/f87 [0,4194304] 0 2024-04-18T04:58:05.583 INFO:tasks.workunit.client.0.smithi096.stdout:9/622: symlink d0/de/d17/d56/d59/d68/dab/d3a/lc9 0 2024-04-18T04:58:05.586 INFO:tasks.workunit.client.0.smithi096.stdout:2/781: dread df/d18/d26/f29 [0,4194304] 0 2024-04-18T04:58:05.587 INFO:tasks.workunit.client.0.smithi096.stdout:9/623: read d0/de/d17/d56/d59/d68/f72 [1302281,17358] 0 2024-04-18T04:58:05.589 INFO:tasks.workunit.client.0.smithi096.stdout:2/782: getdents df/d7d/d9f 0 2024-04-18T04:58:05.590 INFO:tasks.workunit.client.0.smithi096.stdout:9/624: getdents d0/de/d17/d56/d59 0 2024-04-18T04:58:05.591 INFO:tasks.workunit.client.0.smithi096.stdout:2/783: mkdir df/d7d/d105 0 2024-04-18T04:58:05.592 INFO:tasks.workunit.client.0.smithi096.stdout:9/625: creat d0/d41/fca x:0 0 0 2024-04-18T04:58:05.594 INFO:tasks.workunit.client.0.smithi096.stdout:1/649: rename de/f2f to de/d1d/d32/d6f/d85/fcf 0 2024-04-18T04:58:05.595 INFO:tasks.workunit.client.0.smithi096.stdout:2/784: mkdir df/d18/d24/d42/d3f/d4a/dbc/d104/d106 0 2024-04-18T04:58:05.596 INFO:tasks.workunit.client.0.smithi096.stdout:3/760: dwrite f8 [4194304,4194304] 0 2024-04-18T04:58:05.598 INFO:tasks.workunit.client.0.smithi096.stdout:2/785: readlink df/d18/d24/d42/l90 0 2024-04-18T04:58:05.598 INFO:tasks.workunit.client.0.smithi096.stdout:1/650: symlink de/d1d/d32/d6f/ld0 0 2024-04-18T04:58:05.599 INFO:tasks.workunit.client.0.smithi096.stdout:7/597: dwrite db/d1f/d24/f56 [0,4194304] 0 2024-04-18T04:58:05.600 INFO:tasks.workunit.client.0.smithi096.stdout:3/761: mkdir dc/d26/d66/dfb 0 2024-04-18T04:58:05.602 INFO:tasks.workunit.client.0.smithi096.stdout:2/786: chown df/d18/d24/d42/d3f/fe6 316 1 2024-04-18T04:58:05.604 INFO:tasks.workunit.client.0.smithi096.stdout:7/598: mkdir db/d1f/d24/d49/d54/dc3 0 2024-04-18T04:58:05.605 INFO:tasks.workunit.client.0.smithi096.stdout:7/599: stat db/d20/fb8 0 2024-04-18T04:58:05.606 INFO:tasks.workunit.client.0.smithi096.stdout:9/626: dwrite d0/de/d17/d56/d59/d68/f72 [0,4194304] 0 2024-04-18T04:58:05.609 INFO:tasks.workunit.client.0.smithi096.stdout:8/510: sync 2024-04-18T04:58:05.609 INFO:tasks.workunit.client.0.smithi096.stdout:4/527: sync 2024-04-18T04:58:05.609 INFO:tasks.workunit.client.0.smithi096.stdout:5/483: sync 2024-04-18T04:58:05.609 INFO:tasks.workunit.client.0.smithi096.stdout:2/787: rmdir df/d18/d24/de8 0 2024-04-18T04:58:05.611 INFO:tasks.workunit.client.0.smithi096.stdout:4/528: write d4/d14/f31 [2286699,91831] 0 2024-04-18T04:58:05.612 INFO:tasks.workunit.client.0.smithi096.stdout:7/600: write db/d1f/d5b/fb4 [1222914,69837] 0 2024-04-18T04:58:05.613 INFO:tasks.workunit.client.0.smithi096.stdout:2/788: write df/d18/d26/d48/fa6 [1423158,27781] 0 2024-04-18T04:58:05.616 INFO:tasks.workunit.client.0.smithi096.stdout:3/762: dwrite dc/d26/d48/dc2/d95/da3/fc8 [0,4194304] 0 2024-04-18T04:58:05.616 INFO:tasks.workunit.client.0.smithi096.stdout:9/627: creat d0/fcb x:0 0 0 2024-04-18T04:58:05.618 INFO:tasks.workunit.client.0.smithi096.stdout:3/763: write dc/fe8 [890768,104914] 0 2024-04-18T04:58:05.621 INFO:tasks.workunit.client.0.smithi096.stdout:7/601: symlink db/lc4 0 2024-04-18T04:58:05.622 INFO:tasks.workunit.client.0.smithi096.stdout:2/789: creat df/d18/d24/f107 x:0 0 0 2024-04-18T04:58:05.622 INFO:tasks.workunit.client.0.smithi096.stdout:9/628: unlink d0/de/d17/d56/c9c 0 2024-04-18T04:58:05.623 INFO:tasks.workunit.client.0.smithi096.stdout:9/629: dread - d0/de/f92 zero size 2024-04-18T04:58:05.623 INFO:tasks.workunit.client.0.smithi096.stdout:3/764: mknod dc/d26/d66/dfb/cfc 0 2024-04-18T04:58:05.624 INFO:tasks.workunit.client.0.smithi096.stdout:9/630: fdatasync d0/de/d17/d56/f6a 0 2024-04-18T04:58:05.624 INFO:tasks.workunit.client.0.smithi096.stdout:4/529: unlink d4/d14/d2d/d44/d58/d86/d3a/d39/d54/l6c 0 2024-04-18T04:58:05.625 INFO:tasks.workunit.client.0.smithi096.stdout:7/602: rmdir db/d1f/d39/d6d 39 2024-04-18T04:58:05.627 INFO:tasks.workunit.client.0.smithi096.stdout:1/651: dread de/d1d/d32/d6f/d85/fcf [4194304,4194304] 0 2024-04-18T04:58:05.627 INFO:tasks.workunit.client.0.smithi096.stdout:2/790: mknod df/d7d/d105/c108 0 2024-04-18T04:58:05.627 INFO:tasks.workunit.client.0.smithi096.stdout:2/791: readlink df/d7d/l81 0 2024-04-18T04:58:05.628 INFO:tasks.workunit.client.0.smithi096.stdout:4/530: mkdir d4/d14/d2d/da6 0 2024-04-18T04:58:05.628 INFO:tasks.workunit.client.0.smithi096.stdout:3/765: symlink dc/lfd 0 2024-04-18T04:58:05.633 INFO:tasks.workunit.client.0.smithi096.stdout:3/766: fdatasync dc/d26/d4a/f6c 0 2024-04-18T04:58:05.633 INFO:tasks.workunit.client.0.smithi096.stdout:1/652: dread de/d1d/d3f/d7a/d96/f98 [0,4194304] 0 2024-04-18T04:58:05.633 INFO:tasks.workunit.client.0.smithi096.stdout:7/603: creat db/fc5 x:0 0 0 2024-04-18T04:58:05.633 INFO:tasks.workunit.client.0.smithi096.stdout:4/531: rename d4/d14/d2d/d44/d58/d86/d6f/d93 to d4/d14/d2d/d44/d58/d86/d97/da7 0 2024-04-18T04:58:05.634 INFO:tasks.workunit.client.0.smithi096.stdout:3/767: chown dc/d26/d48/dc2/d95/da3/lb1 716 1 2024-04-18T04:58:05.635 INFO:tasks.workunit.client.0.smithi096.stdout:3/768: truncate dc/d70/f94 533830 0 2024-04-18T04:58:05.635 INFO:tasks.workunit.client.0.smithi096.stdout:7/604: fdatasync db/d20/d45/fa6 0 2024-04-18T04:58:05.638 INFO:tasks.workunit.client.0.smithi096.stdout:3/769: symlink dc/dcf/lfe 0 2024-04-18T04:58:05.639 INFO:tasks.workunit.client.0.smithi096.stdout:1/653: rename de/d1d/d3f/c4b to de/d1d/d32/d6b/cd1 0 2024-04-18T04:58:05.640 INFO:tasks.workunit.client.0.smithi096.stdout:7/605: fsync db/d1f/d5b/d6a/f8b 0 2024-04-18T04:58:05.642 INFO:tasks.workunit.client.0.smithi096.stdout:1/654: chown de/d1d/d32/d73/d8b/l90 0 1 2024-04-18T04:58:05.642 INFO:tasks.workunit.client.0.smithi096.stdout:4/532: dwrite d4/d14/d16/f32 [0,4194304] 0 2024-04-18T04:58:05.643 INFO:tasks.workunit.client.0.smithi096.stdout:9/631: truncate d0/de/d17/d56/d59/d68/dab/f2e 6161009 0 2024-04-18T04:58:05.644 INFO:tasks.workunit.client.0.smithi096.stdout:2/792: dread df/d7a/f9d [0,4194304] 0 2024-04-18T04:58:05.645 INFO:tasks.workunit.client.0.smithi096.stdout:7/606: read - db/d1f/d39/d6d/d79/d83/fae zero size 2024-04-18T04:58:05.646 INFO:tasks.workunit.client.0.smithi096.stdout:1/655: dread de/d1d/d3f/d7a/d96/f98 [0,4194304] 0 2024-04-18T04:58:05.646 INFO:tasks.workunit.client.0.smithi096.stdout:4/533: symlink d4/d14/d2d/d44/d58/d86/d3a/d39/la8 0 2024-04-18T04:58:05.649 INFO:tasks.workunit.client.0.smithi096.stdout:2/793: creat df/d18/f109 x:0 0 0 2024-04-18T04:58:05.650 INFO:tasks.workunit.client.0.smithi096.stdout:1/656: write de/d1d/d32/d73/fcc [745399,42113] 0 2024-04-18T04:58:05.650 INFO:tasks.workunit.client.0.smithi096.stdout:4/534: mknod d4/d14/d2d/d44/d58/d86/d97/ca9 0 2024-04-18T04:58:05.652 INFO:tasks.workunit.client.0.smithi096.stdout:2/794: write df/d18/d26/d48/f49 [2641700,28945] 0 2024-04-18T04:58:05.653 INFO:tasks.workunit.client.0.smithi096.stdout:3/770: dwrite dc/f18 [4194304,4194304] 0 2024-04-18T04:58:05.654 INFO:tasks.workunit.client.0.smithi096.stdout:9/632: dread d0/de/d17/d56/d59/d68/f83 [0,4194304] 0 2024-04-18T04:58:05.655 INFO:tasks.workunit.client.0.smithi096.stdout:1/657: unlink de/d1d/d32/d6f/d85/fcf 0 2024-04-18T04:58:05.655 INFO:tasks.workunit.client.0.smithi096.stdout:2/795: fsync df/d7d/fee 0 2024-04-18T04:58:05.656 INFO:tasks.workunit.client.0.smithi096.stdout:1/658: write f6 [2305664,69856] 0 2024-04-18T04:58:05.658 INFO:tasks.workunit.client.0.smithi096.stdout:4/535: read d4/d14/d2d/d44/d58/d86/f3b [5321847,82770] 0 2024-04-18T04:58:05.661 INFO:tasks.workunit.client.0.smithi096.stdout:3/771: rename dc/d26/f72 to dc/d26/d48/dc2/d29/fff 0 2024-04-18T04:58:05.667 INFO:tasks.workunit.client.0.smithi096.stdout:3/772: readlink dc/d26/d48/dc2/d29/l89 0 2024-04-18T04:58:05.671 INFO:tasks.workunit.client.0.smithi096.stdout:4/536: link d4/d14/d2d/d44/d58/l64 d4/d7a/laa 0 2024-04-18T04:58:05.672 INFO:tasks.workunit.client.0.smithi096.stdout:3/773: fdatasync dc/d5d/f8a 0 2024-04-18T04:58:05.673 INFO:tasks.workunit.client.0.smithi096.stdout:3/774: write dc/d26/d4a/ddf/d93/fb9 [574532,105389] 0 2024-04-18T04:58:05.676 INFO:tasks.workunit.client.0.smithi096.stdout:2/796: write f2 [593400,41783] 0 2024-04-18T04:58:05.677 INFO:tasks.workunit.client.0.smithi096.stdout:4/537: rmdir d4/d14/d2d/d44/d58/d86/d97/da7 0 2024-04-18T04:58:05.678 INFO:tasks.workunit.client.0.smithi096.stdout:3/775: dread dc/d26/d4a/f6c [0,4194304] 0 2024-04-18T04:58:05.680 INFO:tasks.workunit.client.0.smithi096.stdout:3/776: read dc/d26/d48/dae/fe2 [2603590,117483] 0 2024-04-18T04:58:05.681 INFO:tasks.workunit.client.0.smithi096.stdout:3/777: dread - dc/d5d/fda zero size 2024-04-18T04:58:05.681 INFO:tasks.workunit.client.0.smithi096.stdout:3/778: read - dc/d26/d48/fd6 zero size 2024-04-18T04:58:05.682 INFO:tasks.workunit.client.0.smithi096.stdout:3/779: stat dc/d26/d4a/ddf/fba 0 2024-04-18T04:58:05.683 INFO:tasks.workunit.client.0.smithi096.stdout:4/538: stat d4/d14/d2d/d44/d58/d86/d3a/d39/d54/f91 0 2024-04-18T04:58:05.686 INFO:tasks.workunit.client.0.smithi096.stdout:2/797: link df/d18/d26/d48/f4f df/d18/d24/d42/dd9/f10a 0 2024-04-18T04:58:05.687 INFO:tasks.workunit.client.0.smithi096.stdout:2/798: read df/d18/d26/f91 [2395370,22187] 0 2024-04-18T04:58:05.692 INFO:tasks.workunit.client.0.smithi096.stdout:2/799: truncate df/d18/d26/f29 244775 0 2024-04-18T04:58:05.692 INFO:tasks.workunit.client.0.smithi096.stdout:4/539: truncate d4/d14/f31 2662954 0 2024-04-18T04:58:05.693 INFO:tasks.workunit.client.0.smithi096.stdout:3/780: dread dc/f18 [0,4194304] 0 2024-04-18T04:58:05.694 INFO:tasks.workunit.client.0.smithi096.stdout:2/800: chown df/d18/d24/d42/d3f/c8c 3076 1 2024-04-18T04:58:05.694 INFO:tasks.workunit.client.0.smithi096.stdout:4/540: write d4/d14/d16/f7d [883771,88356] 0 2024-04-18T04:58:05.694 INFO:tasks.workunit.client.0.smithi096.stdout:3/781: readlink dc/d5d/la7 0 2024-04-18T04:58:05.696 INFO:tasks.workunit.client.0.smithi096.stdout:3/782: rename dc/ff8 to dc/dcf/dd2/f100 0 2024-04-18T04:58:05.697 INFO:tasks.workunit.client.0.smithi096.stdout:4/541: fdatasync d4/d14/f31 0 2024-04-18T04:58:05.698 INFO:tasks.workunit.client.0.smithi096.stdout:3/783: read - dc/d70/fc9 zero size 2024-04-18T04:58:05.702 INFO:tasks.workunit.client.0.smithi096.stdout:2/801: dwrite df/d18/ffd [0,4194304] 0 2024-04-18T04:58:05.703 INFO:tasks.workunit.client.0.smithi096.stdout:4/542: dread d4/d14/d1d/da5/d67/f6d [0,4194304] 0 2024-04-18T04:58:05.706 INFO:tasks.workunit.client.0.smithi096.stdout:2/802: rmdir df/d18/d71/d9c/db6/df6 39 2024-04-18T04:58:05.706 INFO:tasks.workunit.client.0.smithi096.stdout:3/784: unlink dc/d26/d48/dc2/d29/c84 0 2024-04-18T04:58:05.708 INFO:tasks.workunit.client.0.smithi096.stdout:2/803: dread - df/d18/d99/fd8 zero size 2024-04-18T04:58:05.708 INFO:tasks.workunit.client.0.smithi096.stdout:3/785: rmdir dc/d26/d4a/ddf/d93 39 2024-04-18T04:58:05.708 INFO:tasks.workunit.client.0.smithi096.stdout:2/804: dread - df/d18/d71/fc4 zero size 2024-04-18T04:58:05.709 INFO:tasks.workunit.client.0.smithi096.stdout:4/543: creat d4/d14/d2d/d44/d58/d86/d3a/d39/fab x:0 0 0 2024-04-18T04:58:05.712 INFO:tasks.workunit.client.0.smithi096.stdout:3/786: creat dc/d26/d4a/ddf/d93/f101 x:0 0 0 2024-04-18T04:58:05.713 INFO:tasks.workunit.client.0.smithi096.stdout:4/544: creat d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/fac x:0 0 0 2024-04-18T04:58:05.714 INFO:tasks.workunit.client.0.smithi096.stdout:2/805: mknod df/d18/d26/d48/c10b 0 2024-04-18T04:58:05.715 INFO:tasks.workunit.client.0.smithi096.stdout:4/545: stat d4/d14/d2d/d44/d58/d86/d3a/d39/d54/f91 0 2024-04-18T04:58:05.715 INFO:tasks.workunit.client.0.smithi096.stdout:2/806: readlink df/d18/d24/d42/d3f/d4a/dbc/le0 0 2024-04-18T04:58:05.719 INFO:tasks.workunit.client.0.smithi096.stdout:4/546: truncate d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/f57 507295 0 2024-04-18T04:58:05.720 INFO:tasks.workunit.client.0.smithi096.stdout:2/807: creat df/d18/d24/d42/d3f/d4a/dbc/d104/d106/f10c x:0 0 0 2024-04-18T04:58:05.720 INFO:tasks.workunit.client.0.smithi096.stdout:3/787: dwrite dc/d26/d48/dc2/fad [0,4194304] 0 2024-04-18T04:58:05.721 INFO:tasks.workunit.client.0.smithi096.stdout:3/788: readlink dc/d70/la8 0 2024-04-18T04:58:05.723 INFO:tasks.workunit.client.0.smithi096.stdout:4/547: mknod d4/d14/d1d/da5/cad 0 2024-04-18T04:58:05.725 INFO:tasks.workunit.client.0.smithi096.stdout:3/789: mkdir dc/d26/d48/dc2/d29/d7e/d102 0 2024-04-18T04:58:05.725 INFO:tasks.workunit.client.0.smithi096.stdout:4/548: dread d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/f57 [0,4194304] 0 2024-04-18T04:58:05.726 INFO:tasks.workunit.client.0.smithi096.stdout:2/808: unlink df/d18/d26/f29 0 2024-04-18T04:58:05.727 INFO:tasks.workunit.client.0.smithi096.stdout:4/549: write d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/f74 [491452,81139] 0 2024-04-18T04:58:05.728 INFO:tasks.workunit.client.0.smithi096.stdout:2/809: chown df/d18/f38 91460821 1 2024-04-18T04:58:05.729 INFO:tasks.workunit.client.0.smithi096.stdout:2/810: stat df/d18/l6d 0 2024-04-18T04:58:05.733 INFO:tasks.workunit.client.0.smithi096.stdout:4/550: creat d4/d14/d2d/d44/d58/d86/d3a/d47/fae x:0 0 0 2024-04-18T04:58:05.734 INFO:tasks.workunit.client.0.smithi096.stdout:3/790: dwrite dc/f9d [0,4194304] 0 2024-04-18T04:58:05.738 INFO:tasks.workunit.client.0.smithi096.stdout:4/551: truncate d4/d14/d2d/d44/d58/d86/d3a/d47/fae 817782 0 2024-04-18T04:58:05.738 INFO:tasks.workunit.client.0.smithi096.stdout:2/811: dwrite df/d18/d71/f97 [0,4194304] 0 2024-04-18T04:58:05.742 INFO:tasks.workunit.client.0.smithi096.stdout:2/812: chown df/d18/d71/d9c/db6/df6/c100 105906410 1 2024-04-18T04:58:05.743 INFO:tasks.workunit.client.0.smithi096.stdout:2/813: read - df/d7d/d9f/f103 zero size 2024-04-18T04:58:05.746 INFO:tasks.workunit.client.0.smithi096.stdout:4/552: mknod d4/d14/d2d/d44/d58/d86/d3a/d39/d54/caf 0 2024-04-18T04:58:05.747 INFO:tasks.workunit.client.0.smithi096.stdout:4/553: readlink d4/d14/d1d/l79 0 2024-04-18T04:58:05.749 INFO:tasks.workunit.client.0.smithi096.stdout:0/494: sync 2024-04-18T04:58:05.749 INFO:tasks.workunit.client.0.smithi096.stdout:6/805: sync 2024-04-18T04:58:05.750 INFO:tasks.workunit.client.0.smithi096.stdout:2/814: rename df/d18/d71/dfa to df/d18/d24/d42/d3f/d4a/dbc/d104/d106/d10d 0 2024-04-18T04:58:05.752 INFO:tasks.workunit.client.0.smithi096.stdout:4/554: unlink d4/d14/d2d/d44/d58/d86/d3a/d39/d54/f5c 0 2024-04-18T04:58:05.752 INFO:tasks.workunit.client.0.smithi096.stdout:0/495: rmdir d16/d1c/d4c/d4d/d5d/d8f 39 2024-04-18T04:58:05.753 INFO:tasks.workunit.client.0.smithi096.stdout:0/496: write d16/f40 [5844607,104354] 0 2024-04-18T04:58:05.757 INFO:tasks.workunit.client.0.smithi096.stdout:2/815: mkdir df/d18/d26/d48/d7b/d10e 0 2024-04-18T04:58:05.759 INFO:tasks.workunit.client.0.smithi096.stdout:0/497: rmdir d16/d1c/d4c/d4e/d67 39 2024-04-18T04:58:05.761 INFO:tasks.workunit.client.0.smithi096.stdout:4/555: link d4/d14/d1d/f27 d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/fb0 0 2024-04-18T04:58:05.763 INFO:tasks.workunit.client.0.smithi096.stdout:6/806: rename d0/d6/d29/cc7 to d0/d6/d2b/d3b/d69/d6c/cf4 0 2024-04-18T04:58:05.767 INFO:tasks.workunit.client.0.smithi096.stdout:2/816: dread df/d18/d26/d48/f52 [0,4194304] 0 2024-04-18T04:58:05.768 INFO:tasks.workunit.client.0.smithi096.stdout:6/807: rmdir d0/da0 39 2024-04-18T04:58:05.769 INFO:tasks.workunit.client.0.smithi096.stdout:4/556: dwrite d4/d14/f9b [0,4194304] 0 2024-04-18T04:58:05.770 INFO:tasks.workunit.client.0.smithi096.stdout:4/557: read d4/d14/d1d/da5/d67/f6d [545906,88564] 0 2024-04-18T04:58:05.775 INFO:tasks.workunit.client.0.smithi096.stdout:2/817: creat df/d18/d71/d75/f10f x:0 0 0 2024-04-18T04:58:05.777 INFO:tasks.workunit.client.0.smithi096.stdout:4/558: creat d4/fb1 x:0 0 0 2024-04-18T04:58:05.778 INFO:tasks.workunit.client.0.smithi096.stdout:0/498: getdents d16/d1c/d4c/d4d/d5a 0 2024-04-18T04:58:05.779 INFO:tasks.workunit.client.0.smithi096.stdout:2/818: dread - df/d18/d26/d48/ffb zero size 2024-04-18T04:58:05.780 INFO:tasks.workunit.client.0.smithi096.stdout:2/819: truncate df/d7a/fc8 1022681 0 2024-04-18T04:58:05.781 INFO:tasks.workunit.client.0.smithi096.stdout:6/808: mknod d0/d6/d2b/d3b/df3/cf5 0 2024-04-18T04:58:05.783 INFO:tasks.workunit.client.0.smithi096.stdout:2/820: truncate df/d18/d26/d48/f49 4787304 0 2024-04-18T04:58:05.783 INFO:tasks.workunit.client.0.smithi096.stdout:6/809: mkdir d0/d6/d29/de5/df6 0 2024-04-18T04:58:05.786 INFO:tasks.workunit.client.0.smithi096.stdout:2/821: mknod df/d18/d24/d42/d3f/d4a/dbc/d104/d106/c110 0 2024-04-18T04:58:05.787 INFO:tasks.workunit.client.0.smithi096.stdout:6/810: symlink d0/d6/d2b/d3b/lf7 0 2024-04-18T04:58:05.787 INFO:tasks.workunit.client.0.smithi096.stdout:2/822: write fd [2313883,16051] 0 2024-04-18T04:58:05.788 INFO:tasks.workunit.client.0.smithi096.stdout:4/559: dread d4/d14/d2d/d44/d58/f88 [0,4194304] 0 2024-04-18T04:58:05.791 INFO:tasks.workunit.client.0.smithi096.stdout:6/811: rename d0/d6/d2b/d7e/fa5 to d0/d6/d2b/d3b/d7d/dee/ff8 0 2024-04-18T04:58:05.791 INFO:tasks.workunit.client.0.smithi096.stdout:2/823: mknod df/d18/d24/d42/d3f/d4a/d82/c111 0 2024-04-18T04:58:05.795 INFO:tasks.workunit.client.0.smithi096.stdout:2/824: write df/d18/d24/d42/d3f/d4a/fb2 [1583142,70771] 0 2024-04-18T04:58:05.797 INFO:tasks.workunit.client.0.smithi096.stdout:2/825: readlink df/d18/d24/lcb 0 2024-04-18T04:58:05.797 INFO:tasks.workunit.client.0.smithi096.stdout:4/560: dwrite d4/d14/d16/f40 [4194304,4194304] 0 2024-04-18T04:58:05.799 INFO:tasks.workunit.client.0.smithi096.stdout:2/826: chown df/d18/d71/d75/lc9 2626210 1 2024-04-18T04:58:05.800 INFO:tasks.workunit.client.0.smithi096.stdout:6/812: dwrite d0/d6/d2b/f5e [0,4194304] 0 2024-04-18T04:58:05.800 INFO:tasks.workunit.client.0.smithi096.stdout:4/561: mkdir d4/d14/d2d/d44/da2/db2 0 2024-04-18T04:58:05.801 INFO:tasks.workunit.client.0.smithi096.stdout:2/827: write df/d18/d24/d42/d3f/fde [477424,18264] 0 2024-04-18T04:58:05.802 INFO:tasks.workunit.client.0.smithi096.stdout:4/562: chown d4/fb1 373163 1 2024-04-18T04:58:05.804 INFO:tasks.workunit.client.0.smithi096.stdout:4/563: chown d4/d14/d2d/d44/d58/d86/d3a/d47/fae 588 1 2024-04-18T04:58:05.805 INFO:tasks.workunit.client.0.smithi096.stdout:2/828: creat df/d18/d87/f112 x:0 0 0 2024-04-18T04:58:05.806 INFO:tasks.workunit.client.0.smithi096.stdout:6/813: mknod d0/da0/ddc/cf9 0 2024-04-18T04:58:05.812 INFO:tasks.workunit.client.0.smithi096.stdout:6/814: getdents d0/d6/d2b/d3b/d69/d6c/dd8 0 2024-04-18T04:58:05.812 INFO:tasks.workunit.client.0.smithi096.stdout:2/829: dread df/d18/d26/d48/f4f [0,4194304] 0 2024-04-18T04:58:05.814 INFO:tasks.workunit.client.0.smithi096.stdout:6/815: read d0/d6/d2b/d3b/f41 [1827561,123638] 0 2024-04-18T04:58:05.814 INFO:tasks.workunit.client.0.smithi096.stdout:2/830: rmdir df/d7a 39 2024-04-18T04:58:05.815 INFO:tasks.workunit.client.0.smithi096.stdout:4/564: dwrite d4/d14/d2d/d44/d58/d86/d3a/d39/d54/f91 [0,4194304] 0 2024-04-18T04:58:05.820 INFO:tasks.workunit.client.0.smithi096.stdout:6/816: rmdir d0/d6/d29/d83/dd3 0 2024-04-18T04:58:05.821 INFO:tasks.workunit.client.0.smithi096.stdout:4/565: dread d4/d14/d2d/d44/d58/f6b [0,4194304] 0 2024-04-18T04:58:05.821 INFO:tasks.workunit.client.0.smithi096.stdout:6/817: chown d0/d6/d29/c5f 271323 1 2024-04-18T04:58:05.821 INFO:tasks.workunit.client.0.smithi096.stdout:2/831: getdents df/d18/d99 0 2024-04-18T04:58:05.826 INFO:tasks.workunit.client.0.smithi096.stdout:2/832: write df/d18/d24/d42/d6e/f8b [1313207,124457] 0 2024-04-18T04:58:05.826 INFO:tasks.workunit.client.0.smithi096.stdout:6/818: unlink d0/d6/d2b/cc5 0 2024-04-18T04:58:05.827 INFO:tasks.workunit.client.0.smithi096.stdout:4/566: creat d4/d14/d2d/d44/d90/fb3 x:0 0 0 2024-04-18T04:58:05.827 INFO:tasks.workunit.client.0.smithi096.stdout:2/833: dread - df/d18/d26/d48/d7b/ff1 zero size 2024-04-18T04:58:05.827 INFO:tasks.workunit.client.0.smithi096.stdout:6/819: read - d0/d6/d2b/d3b/d69/d6c/dd8/fec zero size 2024-04-18T04:58:05.827 INFO:tasks.workunit.client.0.smithi096.stdout:4/567: write d4/d14/d16/f38 [1420749,67386] 0 2024-04-18T04:58:05.829 INFO:tasks.workunit.client.0.smithi096.stdout:6/820: write d0/d6/d2b/d3b/d69/d6c/d85/fcb [1291353,36011] 0 2024-04-18T04:58:05.830 INFO:tasks.workunit.client.0.smithi096.stdout:4/568: creat d4/d14/d2d/d44/d58/d86/d97/fb4 x:0 0 0 2024-04-18T04:58:05.831 INFO:tasks.workunit.client.0.smithi096.stdout:6/821: write d0/d6/d29/f42 [4554244,34467] 0 2024-04-18T04:58:05.832 INFO:tasks.workunit.client.0.smithi096.stdout:2/834: rmdir df/d18/d24/d42/d3f/d4a/dbc/d104/d106/d10d 0 2024-04-18T04:58:05.833 INFO:tasks.workunit.client.0.smithi096.stdout:6/822: mkdir d0/d6/d2b/d3b/dfa 0 2024-04-18T04:58:05.835 INFO:tasks.workunit.client.0.smithi096.stdout:6/823: fdatasync d0/d6/d2b/d3b/d69/d6c/f76 0 2024-04-18T04:58:05.839 INFO:tasks.workunit.client.0.smithi096.stdout:6/824: rename d0/d6/d2b/d7e/f94 to d0/d6/d29/ffb 0 2024-04-18T04:58:05.841 INFO:tasks.workunit.client.0.smithi096.stdout:6/825: dread - d0/d6/d2b/d3b/d69/d6c/dd8/fec zero size 2024-04-18T04:58:05.842 INFO:tasks.workunit.client.0.smithi096.stdout:6/826: fdatasync d0/f82 0 2024-04-18T04:58:05.843 INFO:tasks.workunit.client.0.smithi096.stdout:2/835: dwrite df/d18/d26/d48/f52 [0,4194304] 0 2024-04-18T04:58:05.843 INFO:tasks.workunit.client.0.smithi096.stdout:6/827: chown d0/d6/d29/de5 41281114 1 2024-04-18T04:58:05.844 INFO:tasks.workunit.client.0.smithi096.stdout:2/836: fsync df/d18/d24/f8d 0 2024-04-18T04:58:05.846 INFO:tasks.workunit.client.0.smithi096.stdout:6/828: write d0/d6/d2b/d3b/d7d/f8c [1214558,128755] 0 2024-04-18T04:58:05.849 INFO:tasks.workunit.client.0.smithi096.stdout:6/829: mkdir d0/d6/d2b/d3b/dfc 0 2024-04-18T04:58:05.852 INFO:tasks.workunit.client.0.smithi096.stdout:6/830: unlink d0/d4a/l6e 0 2024-04-18T04:58:05.852 INFO:tasks.workunit.client.0.smithi096.stdout:2/837: dwrite df/d18/ffd [0,4194304] 0 2024-04-18T04:58:05.853 INFO:tasks.workunit.client.0.smithi096.stdout:2/838: fsync df/d18/d26/f84 0 2024-04-18T04:58:05.856 INFO:tasks.workunit.client.0.smithi096.stdout:6/831: write d0/d6/f98 [379734,19328] 0 2024-04-18T04:58:05.857 INFO:tasks.workunit.client.0.smithi096.stdout:2/839: write df/d18/d71/db8/fea [306085,84486] 0 2024-04-18T04:58:05.858 INFO:tasks.workunit.client.0.smithi096.stdout:2/840: write df/d7d/fee [921120,8139] 0 2024-04-18T04:58:05.859 INFO:tasks.workunit.client.0.smithi096.stdout:6/832: symlink d0/d6/d2b/d3b/d69/d6c/d85/lfd 0 2024-04-18T04:58:05.860 INFO:tasks.workunit.client.0.smithi096.stdout:2/841: mkdir df/d18/d24/d42/d3f/d4a/d113 0 2024-04-18T04:58:05.863 INFO:tasks.workunit.client.0.smithi096.stdout:2/842: write df/d18/d24/d42/d3f/d4a/d82/fe1 [2102336,85774] 0 2024-04-18T04:58:05.864 INFO:tasks.workunit.client.0.smithi096.stdout:2/843: chown df/d18/d24/d42/d101 213 1 2024-04-18T04:58:05.865 INFO:tasks.workunit.client.0.smithi096.stdout:2/844: write df/d18/f109 [59365,17327] 0 2024-04-18T04:58:05.866 INFO:tasks.workunit.client.0.smithi096.stdout:6/833: write d0/d6/d2e/f45 [513077,15708] 0 2024-04-18T04:58:05.878 INFO:tasks.workunit.client.0.smithi096.stdout:6/834: dread d0/d6/d5d/f91 [0,4194304] 0 2024-04-18T04:58:05.880 INFO:tasks.workunit.client.0.smithi096.stdout:2/845: dread df/d18/d24/d42/f21 [0,4194304] 0 2024-04-18T04:58:05.892 INFO:tasks.workunit.client.0.smithi096.stdout:6/835: dread d0/d6/d2e/f45 [0,4194304] 0 2024-04-18T04:58:05.895 INFO:tasks.workunit.client.0.smithi096.stdout:6/836: mkdir d0/d6/d2b/d3b/d69/dfe 0 2024-04-18T04:58:05.896 INFO:tasks.workunit.client.0.smithi096.stdout:6/837: chown d0/d6/d2e/d7a/la3 15206932 1 2024-04-18T04:58:05.899 INFO:tasks.workunit.client.0.smithi096.stdout:6/838: rename d0/d6/d2b/d3b/d7d/f8c to d0/d6/d2b/d3b/dfa/fff 0 2024-04-18T04:58:05.900 INFO:tasks.workunit.client.0.smithi096.stdout:6/839: write d0/f82 [2544143,23773] 0 2024-04-18T04:58:05.900 INFO:tasks.workunit.client.0.smithi096.stdout:6/840: dread - d0/d4a/fa2 zero size 2024-04-18T04:58:05.903 INFO:tasks.workunit.client.0.smithi096.stdout:6/841: creat d0/f100 x:0 0 0 2024-04-18T04:58:05.903 INFO:tasks.workunit.client.0.smithi096.stdout:6/842: chown d0/da0/fae 465 1 2024-04-18T04:58:05.906 INFO:tasks.workunit.client.0.smithi096.stdout:6/843: rename d0/d6/d2b/cc8 to d0/d6/d2b/d3b/d69/dfe/c101 0 2024-04-18T04:58:05.908 INFO:tasks.workunit.client.0.smithi096.stdout:6/844: fdatasync d0/d6/d2e/f31 0 2024-04-18T04:58:05.983 INFO:tasks.workunit.client.0.smithi096.stdout:5/484: sync 2024-04-18T04:58:05.990 INFO:tasks.workunit.client.0.smithi096.stdout:5/485: dread d7/dd/f2c [0,4194304] 0 2024-04-18T04:58:05.994 INFO:tasks.workunit.client.0.smithi096.stdout:5/486: symlink d7/d3b/d95/lb3 0 2024-04-18T04:58:06.006 INFO:tasks.workunit.client.0.smithi096.stdout:5/487: dwrite d7/d25/f41 [4194304,4194304] 0 2024-04-18T04:58:06.010 INFO:tasks.workunit.client.0.smithi096.stdout:5/488: creat d7/d25/d2b/fb4 x:0 0 0 2024-04-18T04:58:06.020 INFO:tasks.workunit.client.0.smithi096.stdout:5/489: truncate d7/d25/d7c/fa6 2485144 0 2024-04-18T04:58:06.021 INFO:tasks.workunit.client.0.smithi096.stdout:5/490: chown d7/f1a 59 1 2024-04-18T04:58:06.025 INFO:tasks.workunit.client.0.smithi096.stdout:5/491: getdents d7/da3 0 2024-04-18T04:58:06.026 INFO:tasks.workunit.client.0.smithi096.stdout:5/492: fdatasync d7/d39/f70 0 2024-04-18T04:58:06.039 INFO:tasks.workunit.client.0.smithi096.stdout:5/493: dwrite d7/dd/d35/da0/fad [0,4194304] 0 2024-04-18T04:58:06.044 INFO:tasks.workunit.client.0.smithi096.stdout:5/494: rename d7/d39/d36/d97 to d7/d39/d78/db5 0 2024-04-18T04:58:06.047 INFO:tasks.workunit.client.0.smithi096.stdout:5/495: creat d7/da3/d9a/fb6 x:0 0 0 2024-04-18T04:58:06.056 INFO:tasks.workunit.client.0.smithi096.stdout:5/496: truncate d7/f46 3312534 0 2024-04-18T04:58:06.059 INFO:tasks.workunit.client.0.smithi096.stdout:5/497: symlink d7/da3/lb7 0 2024-04-18T04:58:06.060 INFO:tasks.workunit.client.0.smithi096.stdout:5/498: truncate d7/d3b/f9d 901395 0 2024-04-18T04:58:06.064 INFO:tasks.workunit.client.0.smithi096.stdout:5/499: creat d7/dd/d35/db1/fb8 x:0 0 0 2024-04-18T04:58:06.065 INFO:tasks.workunit.client.0.smithi096.stdout:5/500: write d7/dd/d35/da0/fad [1862425,78632] 0 2024-04-18T04:58:06.082 INFO:tasks.workunit.client.0.smithi096.stdout:5/501: dread d7/d39/d78/db5/fa4 [0,4194304] 0 2024-04-18T04:58:06.086 INFO:tasks.workunit.client.0.smithi096.stdout:8/511: sync 2024-04-18T04:58:06.087 INFO:tasks.workunit.client.0.smithi096.stdout:5/502: creat d7/d25/fb9 x:0 0 0 2024-04-18T04:58:06.099 INFO:tasks.workunit.client.0.smithi096.stdout:5/503: dwrite d7/da3/d9a/fa5 [0,4194304] 0 2024-04-18T04:58:06.103 INFO:tasks.workunit.client.0.smithi096.stdout:8/512: dwrite d0/d7/d24/d78/f56 [0,4194304] 0 2024-04-18T04:58:06.106 INFO:tasks.workunit.client.0.smithi096.stdout:5/504: mknod d7/dd/d8f/d5e/cba 0 2024-04-18T04:58:06.107 INFO:tasks.workunit.client.0.smithi096.stdout:5/505: stat d7/fe 0 2024-04-18T04:58:06.110 INFO:tasks.workunit.client.0.smithi096.stdout:8/513: mknod d0/d15/d65/ca4 0 2024-04-18T04:58:06.114 INFO:tasks.workunit.client.0.smithi096.stdout:5/506: symlink d7/d39/d52/lbb 0 2024-04-18T04:58:06.117 INFO:tasks.workunit.client.0.smithi096.stdout:5/507: read d7/dd/f2c [553565,127002] 0 2024-04-18T04:58:06.122 INFO:tasks.workunit.client.0.smithi096.stdout:5/508: getdents d7/d25/d30/d9e 0 2024-04-18T04:58:06.123 INFO:tasks.workunit.client.0.smithi096.stdout:8/514: dwrite d0/d7/d24/d18/d27/f69 [0,4194304] 0 2024-04-18T04:58:06.124 INFO:tasks.workunit.client.0.smithi096.stdout:5/509: chown d7/dd/d8f/f2d 4 1 2024-04-18T04:58:06.127 INFO:tasks.workunit.client.0.smithi096.stdout:2/846: sync 2024-04-18T04:58:06.128 INFO:tasks.workunit.client.0.smithi096.stdout:7/607: sync 2024-04-18T04:58:06.128 INFO:tasks.workunit.client.0.smithi096.stdout:9/633: sync 2024-04-18T04:58:06.128 INFO:tasks.workunit.client.0.smithi096.stdout:0/499: sync 2024-04-18T04:58:06.128 INFO:tasks.workunit.client.0.smithi096.stdout:4/569: sync 2024-04-18T04:58:06.128 INFO:tasks.workunit.client.0.smithi096.stdout:3/791: sync 2024-04-18T04:58:06.128 INFO:tasks.workunit.client.0.smithi096.stdout:1/659: sync 2024-04-18T04:58:06.128 INFO:tasks.workunit.client.0.smithi096.stdout:6/845: sync 2024-04-18T04:58:06.131 INFO:tasks.workunit.client.0.smithi096.stdout:9/634: read d0/de/f62 [754232,787] 0 2024-04-18T04:58:06.132 INFO:tasks.workunit.client.0.smithi096.stdout:9/635: chown d0/de/d99/ca0 23789745 1 2024-04-18T04:58:06.133 INFO:tasks.workunit.client.0.smithi096.stdout:5/510: creat d7/dd/d35/fbc x:0 0 0 2024-04-18T04:58:06.133 INFO:tasks.workunit.client.0.smithi096.stdout:6/846: read d0/d6/f1d [2651827,54914] 0 2024-04-18T04:58:06.134 INFO:tasks.workunit.client.0.smithi096.stdout:6/847: write d0/f82 [4630902,69439] 0 2024-04-18T04:58:06.134 INFO:tasks.workunit.client.0.smithi096.stdout:5/511: write d7/da3/d9a/fa8 [1339439,109994] 0 2024-04-18T04:58:06.140 INFO:tasks.workunit.client.0.smithi096.stdout:9/636: dwrite d0/de/d17/d56/d59/d68/d96/f9b [0,4194304] 0 2024-04-18T04:58:06.140 INFO:tasks.workunit.client.0.smithi096.stdout:1/660: unlink de/d1d/f78 0 2024-04-18T04:58:06.143 INFO:tasks.workunit.client.0.smithi096.stdout:4/570: symlink d4/d14/d2d/d44/d89/lb5 0 2024-04-18T04:58:06.148 INFO:tasks.workunit.client.0.smithi096.stdout:9/637: dread d0/de/d17/d2f/d40/fb3 [0,4194304] 0 2024-04-18T04:58:06.149 INFO:tasks.workunit.client.0.smithi096.stdout:1/661: dwrite de/f2e [0,4194304] 0 2024-04-18T04:58:06.151 INFO:tasks.workunit.client.0.smithi096.stdout:7/608: fsync db/d1d/f75 0 2024-04-18T04:58:06.154 INFO:tasks.workunit.client.0.smithi096.stdout:5/512: unlink d7/d39/d78/f84 0 2024-04-18T04:58:06.166 INFO:tasks.workunit.client.0.smithi096.stdout:0/500: mkdir d16/d1c/d4c/d4d/d5d/d91 0 2024-04-18T04:58:06.170 INFO:tasks.workunit.client.0.smithi096.stdout:3/792: creat dc/d26/d48/dc2/d95/de3/f103 x:0 0 0 2024-04-18T04:58:06.173 INFO:tasks.workunit.client.0.smithi096.stdout:2/847: symlink df/d18/d24/d42/d3f/d4a/dbc/dff/l114 0 2024-04-18T04:58:06.180 INFO:tasks.workunit.client.0.smithi096.stdout:1/662: unlink de/d1d/d32/l94 0 2024-04-18T04:58:06.181 INFO:tasks.workunit.client.0.smithi096.stdout:4/571: dwrite d4/d14/d2d/d44/d58/d86/d3a/d39/f56 [0,4194304] 0 2024-04-18T04:58:06.185 INFO:tasks.workunit.client.0.smithi096.stdout:7/609: mkdir db/d1f/d5b/d6a/dc6 0 2024-04-18T04:58:06.187 INFO:tasks.workunit.client.0.smithi096.stdout:7/610: read db/d1f/d5b/d6a/f8b [3045400,40035] 0 2024-04-18T04:58:06.188 INFO:tasks.workunit.client.0.smithi096.stdout:6/848: mknod d0/d6/d2b/d3b/dfc/c102 0 2024-04-18T04:58:06.188 INFO:tasks.workunit.client.0.smithi096.stdout:7/611: chown db/d1f/f41 0 1 2024-04-18T04:58:06.188 INFO:tasks.workunit.client.0.smithi096.stdout:7/612: fsync db/d1d/d82/fa5 0 2024-04-18T04:58:06.189 INFO:tasks.workunit.client.0.smithi096.stdout:7/613: write db/d1d/f21 [3161985,13500] 0 2024-04-18T04:58:06.189 INFO:tasks.workunit.client.0.smithi096.stdout:7/614: stat db/d20/c3c 0 2024-04-18T04:58:06.190 INFO:tasks.workunit.client.0.smithi096.stdout:7/615: read - db/d20/fba zero size 2024-04-18T04:58:06.192 INFO:tasks.workunit.client.0.smithi096.stdout:8/515: getdents d0/d15/d65/d8f 0 2024-04-18T04:58:06.193 INFO:tasks.workunit.client.0.smithi096.stdout:8/516: fsync d0/d3/f8a 0 2024-04-18T04:58:06.193 INFO:tasks.workunit.client.0.smithi096.stdout:8/517: stat d0/d7/d24/d18/d27/c39 0 2024-04-18T04:58:06.194 INFO:tasks.workunit.client.0.smithi096.stdout:3/793: read dc/dcf/dd2/f6a [546387,72387] 0 2024-04-18T04:58:06.194 INFO:tasks.workunit.client.0.smithi096.stdout:2/848: rmdir df/d18/d24/d42/d3f/d4a/dbc/d104 39 2024-04-18T04:58:06.195 INFO:tasks.workunit.client.0.smithi096.stdout:3/794: chown dc/d26/d4a/ddf/d93/f101 0 1 2024-04-18T04:58:06.195 INFO:tasks.workunit.client.0.smithi096.stdout:3/795: fsync dc/d70/f94 0 2024-04-18T04:58:06.198 INFO:tasks.workunit.client.0.smithi096.stdout:1/663: creat de/d1d/d3f/d7a/d96/fd2 x:0 0 0 2024-04-18T04:58:06.200 INFO:tasks.workunit.client.0.smithi096.stdout:5/513: symlink d7/d39/d52/lbd 0 2024-04-18T04:58:06.202 INFO:tasks.workunit.client.0.smithi096.stdout:6/849: readlink d0/l32 0 2024-04-18T04:58:06.207 INFO:tasks.workunit.client.0.smithi096.stdout:6/850: dwrite d0/d6/d29/f7f [0,4194304] 0 2024-04-18T04:58:06.208 INFO:tasks.workunit.client.0.smithi096.stdout:6/851: chown d0/d6/d29/d83/f92 25448 1 2024-04-18T04:58:06.214 INFO:tasks.workunit.client.0.smithi096.stdout:1/664: rmdir de/d1d/d32/d6f/d85 39 2024-04-18T04:58:06.216 INFO:tasks.workunit.client.0.smithi096.stdout:6/852: dwrite d0/d6/d2b/d3b/d69/f71 [4194304,4194304] 0 2024-04-18T04:58:06.217 INFO:tasks.workunit.client.0.smithi096.stdout:5/514: chown d7/d25/d2b/f75 604 1 2024-04-18T04:58:06.222 INFO:tasks.workunit.client.0.smithi096.stdout:0/501: rename d16/d1c/d4c/d4d/c85 to d16/d1c/d4c/d4d/d5d/c92 0 2024-04-18T04:58:06.225 INFO:tasks.workunit.client.0.smithi096.stdout:3/796: write dc/d26/d48/dc2/fab [769971,120794] 0 2024-04-18T04:58:06.226 INFO:tasks.workunit.client.0.smithi096.stdout:3/797: truncate dc/dcf/dd2/fd1 5079450 0 2024-04-18T04:58:06.228 INFO:tasks.workunit.client.0.smithi096.stdout:8/518: mknod d0/d7/d24/d8d/ca5 0 2024-04-18T04:58:06.230 INFO:tasks.workunit.client.0.smithi096.stdout:2/849: mknod df/c115 0 2024-04-18T04:58:06.233 INFO:tasks.workunit.client.0.smithi096.stdout:7/616: write db/d1f/d24/d49/d54/f5d [22363,46966] 0 2024-04-18T04:58:06.234 INFO:tasks.workunit.client.0.smithi096.stdout:9/638: getdents d0/de 0 2024-04-18T04:58:06.235 INFO:tasks.workunit.client.0.smithi096.stdout:8/519: dwrite d0/d3/f8a [0,4194304] 0 2024-04-18T04:58:06.236 INFO:tasks.workunit.client.0.smithi096.stdout:1/665: readlink de/d1d/d32/d73/l93 0 2024-04-18T04:58:06.237 INFO:tasks.workunit.client.0.smithi096.stdout:9/639: write d0/de/d17/d56/d59/d60/fc2 [639546,99761] 0 2024-04-18T04:58:06.237 INFO:tasks.workunit.client.0.smithi096.stdout:1/666: dread - de/d1d/d32/d6b/f9d zero size 2024-04-18T04:58:06.239 INFO:tasks.workunit.client.0.smithi096.stdout:6/853: mkdir d0/d6/d29/de5/d103 0 2024-04-18T04:58:06.239 INFO:tasks.workunit.client.0.smithi096.stdout:1/667: write de/d1d/d3f/f63 [601374,104580] 0 2024-04-18T04:58:06.241 INFO:tasks.workunit.client.0.smithi096.stdout:5/515: write d7/d25/d7c/f87 [503216,40807] 0 2024-04-18T04:58:06.243 INFO:tasks.workunit.client.0.smithi096.stdout:4/572: rename d4/l10 to d4/d14/d2d/lb6 0 2024-04-18T04:58:06.245 INFO:tasks.workunit.client.0.smithi096.stdout:0/502: dread d16/d1c/d4c/d4d/d5a/f6c [0,4194304] 0 2024-04-18T04:58:06.246 INFO:tasks.workunit.client.0.smithi096.stdout:3/798: symlink dc/d26/d48/dc2/d95/de3/l104 0 2024-04-18T04:58:06.251 INFO:tasks.workunit.client.0.smithi096.stdout:4/573: dwrite d4/d14/d2d/d44/f5f [0,4194304] 0 2024-04-18T04:58:06.253 INFO:tasks.workunit.client.0.smithi096.stdout:8/520: creat d0/d7/fa6 x:0 0 0 2024-04-18T04:58:06.258 INFO:tasks.workunit.client.0.smithi096.stdout:6/854: rmdir d0/d6/d2b/d3b/d69/d6c 39 2024-04-18T04:58:06.264 INFO:tasks.workunit.client.0.smithi096.stdout:0/503: unlink d16/d1d/d3b/f8a 0 2024-04-18T04:58:06.266 INFO:tasks.workunit.client.0.smithi096.stdout:3/799: rmdir dc/d26/d4a 39 2024-04-18T04:58:06.268 INFO:tasks.workunit.client.0.smithi096.stdout:7/617: truncate db/d1f/d5b/d6a/fa4 79922 0 2024-04-18T04:58:06.270 INFO:tasks.workunit.client.0.smithi096.stdout:4/574: creat d4/d14/d2d/fb7 x:0 0 0 2024-04-18T04:58:06.272 INFO:tasks.workunit.client.0.smithi096.stdout:4/575: read d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/f82 [741694,62558] 0 2024-04-18T04:58:06.272 INFO:tasks.workunit.client.0.smithi096.stdout:8/521: creat d0/d7/d24/d18/d7c/fa7 x:0 0 0 2024-04-18T04:58:06.275 INFO:tasks.workunit.client.0.smithi096.stdout:6/855: rmdir d0/d6/d2b/d3b/dfc 39 2024-04-18T04:58:06.276 INFO:tasks.workunit.client.0.smithi096.stdout:5/516: symlink d7/dd/d35/d74/dab/lbe 0 2024-04-18T04:58:06.280 INFO:tasks.workunit.client.0.smithi096.stdout:2/850: rename df/c11 to df/d18/d71/d75/c116 0 2024-04-18T04:58:06.282 INFO:tasks.workunit.client.0.smithi096.stdout:0/504: symlink d16/d1c/d22/d2c/l93 0 2024-04-18T04:58:06.284 INFO:tasks.workunit.client.0.smithi096.stdout:3/800: symlink dc/d26/d48/dee/l105 0 2024-04-18T04:58:06.288 INFO:tasks.workunit.client.0.smithi096.stdout:1/668: dwrite de/d1d/d32/f69 [0,4194304] 0 2024-04-18T04:58:06.289 INFO:tasks.workunit.client.0.smithi096.stdout:4/576: fdatasync d4/d14/f2b 0 2024-04-18T04:58:06.291 INFO:tasks.workunit.client.0.smithi096.stdout:8/522: mknod d0/d7/d24/d35/ca8 0 2024-04-18T04:58:06.293 INFO:tasks.workunit.client.0.smithi096.stdout:6/856: symlink d0/d6/d29/de5/l104 0 2024-04-18T04:58:06.296 INFO:tasks.workunit.client.0.smithi096.stdout:5/517: symlink d7/dd/d8f/lbf 0 2024-04-18T04:58:06.297 INFO:tasks.workunit.client.0.smithi096.stdout:4/577: dwrite d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/f74 [4194304,4194304] 0 2024-04-18T04:58:06.300 INFO:tasks.workunit.client.0.smithi096.stdout:9/640: rename d0/de/d17/d56/d59/d68/dab/d3a/f4a to d0/de/d17/d56/d59/d68/d96/fcc 0 2024-04-18T04:58:06.304 INFO:tasks.workunit.client.0.smithi096.stdout:0/505: write d16/d1c/f88 [610513,3065] 0 2024-04-18T04:58:06.314 INFO:tasks.workunit.client.0.smithi096.stdout:1/669: mkdir de/d1d/d32/d9a/dad/dd3 0 2024-04-18T04:58:06.314 INFO:tasks.workunit.client.0.smithi096.stdout:2/851: dwrite df/d18/d24/d42/d6e/fd4 [0,4194304] 0 2024-04-18T04:58:06.314 INFO:tasks.workunit.client.0.smithi096.stdout:2/852: chown df/d7d 5310282 1 2024-04-18T04:58:06.316 INFO:tasks.workunit.client.0.smithi096.stdout:8/523: mkdir d0/d15/da9 0 2024-04-18T04:58:06.316 INFO:tasks.workunit.client.0.smithi096.stdout:6/857: stat d0/d6/d2b/d3b/d69/f84 0 2024-04-18T04:58:06.317 INFO:tasks.workunit.client.0.smithi096.stdout:5/518: mkdir d7/d25/d7c/dc0 0 2024-04-18T04:58:06.318 INFO:tasks.workunit.client.0.smithi096.stdout:4/578: mkdir d4/d14/d2d/d44/d58/d86/d6f/db8 0 2024-04-18T04:58:06.320 INFO:tasks.workunit.client.0.smithi096.stdout:0/506: rename d16/f21 to d16/d1c/d4c/d4d/d5a/f94 0 2024-04-18T04:58:06.321 INFO:tasks.workunit.client.0.smithi096.stdout:3/801: symlink dc/d26/d4a/ddf/d93/l106 0 2024-04-18T04:58:06.322 INFO:tasks.workunit.client.0.smithi096.stdout:0/507: truncate d16/d1c/d22/d2c/f90 893080 0 2024-04-18T04:58:06.322 INFO:tasks.workunit.client.0.smithi096.stdout:7/618: creat db/d1f/d39/fc7 x:0 0 0 2024-04-18T04:58:06.323 INFO:tasks.workunit.client.0.smithi096.stdout:7/619: write db/d1f/d39/d6d/d79/f9a [2918060,80116] 0 2024-04-18T04:58:06.326 INFO:tasks.workunit.client.0.smithi096.stdout:2/853: mknod df/d7d/d105/c117 0 2024-04-18T04:58:06.329 INFO:tasks.workunit.client.0.smithi096.stdout:8/524: creat d0/d3/d32/d6b/d7b/faa x:0 0 0 2024-04-18T04:58:06.329 INFO:tasks.workunit.client.0.smithi096.stdout:3/802: dwrite dc/d26/d48/fd6 [0,4194304] 0 2024-04-18T04:58:06.331 INFO:tasks.workunit.client.0.smithi096.stdout:5/519: mkdir d7/d39/d78/dc1 0 2024-04-18T04:58:06.332 INFO:tasks.workunit.client.0.smithi096.stdout:5/520: readlink d7/dd/d35/l5f 0 2024-04-18T04:58:06.333 INFO:tasks.workunit.client.0.smithi096.stdout:4/579: readlink d4/d7a/l95 0 2024-04-18T04:58:06.336 INFO:tasks.workunit.client.0.smithi096.stdout:0/508: rmdir d16/d1d/d3b 39 2024-04-18T04:58:06.337 INFO:tasks.workunit.client.0.smithi096.stdout:4/580: fsync d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/fac 0 2024-04-18T04:58:06.339 INFO:tasks.workunit.client.0.smithi096.stdout:8/525: dwrite d0/d7/d24/d18/d27/d3c/f9b [0,4194304] 0 2024-04-18T04:58:06.339 INFO:tasks.workunit.client.0.smithi096.stdout:7/620: fdatasync db/d1f/f41 0 2024-04-18T04:58:06.341 INFO:tasks.workunit.client.0.smithi096.stdout:4/581: write d4/d14/d1d/f52 [1783064,41769] 0 2024-04-18T04:58:06.342 INFO:tasks.workunit.client.0.smithi096.stdout:3/803: creat dc/d26/d48/f107 x:0 0 0 2024-04-18T04:58:06.342 INFO:tasks.workunit.client.0.smithi096.stdout:1/670: write de/d1d/f42 [2310758,42712] 0 2024-04-18T04:58:06.348 INFO:tasks.workunit.client.0.smithi096.stdout:0/509: creat d16/d1c/d4c/d4d/d5a/f95 x:0 0 0 2024-04-18T04:58:06.348 INFO:tasks.workunit.client.0.smithi096.stdout:5/521: dwrite d7/d25/d30/f99 [0,4194304] 0 2024-04-18T04:58:06.349 INFO:tasks.workunit.client.0.smithi096.stdout:6/858: mkdir d0/d6/d2b/d3b/d69/d6c/d105 0 2024-04-18T04:58:06.349 INFO:tasks.workunit.client.0.smithi096.stdout:9/641: getdents d0/d6b/d89 0 2024-04-18T04:58:06.349 INFO:tasks.workunit.client.0.smithi096.stdout:0/510: write d16/d1c/f29 [442463,50354] 0 2024-04-18T04:58:06.350 INFO:tasks.workunit.client.0.smithi096.stdout:7/621: creat db/d1f/d39/d6d/d79/d83/fc8 x:0 0 0 2024-04-18T04:58:06.354 INFO:tasks.workunit.client.0.smithi096.stdout:7/622: readlink db/d1f/d39/l67 0 2024-04-18T04:58:06.354 INFO:tasks.workunit.client.0.smithi096.stdout:3/804: creat dc/d26/d4a/ddf/f108 x:0 0 0 2024-04-18T04:58:06.356 INFO:tasks.workunit.client.0.smithi096.stdout:8/526: getdents d0/d4f 0 2024-04-18T04:58:06.356 INFO:tasks.workunit.client.0.smithi096.stdout:9/642: creat d0/de/d17/d2f/fcd x:0 0 0 2024-04-18T04:58:06.358 INFO:tasks.workunit.client.0.smithi096.stdout:6/859: getdents d0/da0 0 2024-04-18T04:58:06.359 INFO:tasks.workunit.client.0.smithi096.stdout:0/511: truncate d16/d1c/d4c/f50 471658 0 2024-04-18T04:58:06.360 INFO:tasks.workunit.client.0.smithi096.stdout:8/527: mknod d0/d7/d24/d78/cab 0 2024-04-18T04:58:06.362 INFO:tasks.workunit.client.0.smithi096.stdout:9/643: read d0/de/d17/d56/d59/d60/faf [1471802,22691] 0 2024-04-18T04:58:06.364 INFO:tasks.workunit.client.0.smithi096.stdout:6/860: creat d0/d6/d29/de5/d103/f106 x:0 0 0 2024-04-18T04:58:06.366 INFO:tasks.workunit.client.0.smithi096.stdout:8/528: write d0/d7/d24/f45 [541704,15862] 0 2024-04-18T04:58:06.368 INFO:tasks.workunit.client.0.smithi096.stdout:7/623: truncate db/f2a 3647602 0 2024-04-18T04:58:06.370 INFO:tasks.workunit.client.0.smithi096.stdout:0/512: write d16/d1c/d4c/f50 [824327,117611] 0 2024-04-18T04:58:06.371 INFO:tasks.workunit.client.0.smithi096.stdout:4/582: dwrite d4/d14/d2d/d44/d58/d86/f4c [0,4194304] 0 2024-04-18T04:58:06.371 INFO:tasks.workunit.client.0.smithi096.stdout:3/805: dwrite dc/d26/d48/dc2/d29/f6f [0,4194304] 0 2024-04-18T04:58:06.372 INFO:tasks.workunit.client.0.smithi096.stdout:8/529: fsync d0/d7/d24/d18/d27/f69 0 2024-04-18T04:58:06.372 INFO:tasks.workunit.client.0.smithi096.stdout:1/671: dread de/d1d/d32/d6f/f8a [0,4194304] 0 2024-04-18T04:58:06.374 INFO:tasks.workunit.client.0.smithi096.stdout:8/530: chown d0/d7/d24/f34 6260934 1 2024-04-18T04:58:06.374 INFO:tasks.workunit.client.0.smithi096.stdout:4/583: truncate d4/d14/d2d/fb7 55328 0 2024-04-18T04:58:06.376 INFO:tasks.workunit.client.0.smithi096.stdout:8/531: chown d0/d15/f88 31180817 1 2024-04-18T04:58:06.376 INFO:tasks.workunit.client.0.smithi096.stdout:3/806: symlink dc/d26/d48/dc2/d95/de3/l109 0 2024-04-18T04:58:06.377 INFO:tasks.workunit.client.0.smithi096.stdout:3/807: chown dc/d26/d4a/ddf/d93 168997861 1 2024-04-18T04:58:06.378 INFO:tasks.workunit.client.0.smithi096.stdout:4/584: creat d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/fb9 x:0 0 0 2024-04-18T04:58:06.379 INFO:tasks.workunit.client.0.smithi096.stdout:3/808: chown dc/dcf/dd2/lbf 0 1 2024-04-18T04:58:06.380 INFO:tasks.workunit.client.0.smithi096.stdout:4/585: stat d4/d14/d2d/d44/d58/d86/l48 0 2024-04-18T04:58:06.383 INFO:tasks.workunit.client.0.smithi096.stdout:3/809: rename dc/d26/d48/dbd/ff5 to dc/d26/d4a/f10a 0 2024-04-18T04:58:06.384 INFO:tasks.workunit.client.0.smithi096.stdout:7/624: truncate db/d1d/d82/f8c 29323 0 2024-04-18T04:58:06.388 INFO:tasks.workunit.client.0.smithi096.stdout:3/810: fdatasync dc/d26/d48/dc2/fab 0 2024-04-18T04:58:06.394 INFO:tasks.workunit.client.0.smithi096.stdout:3/811: write dc/d26/fea [5756,13436] 0 2024-04-18T04:58:06.394 INFO:tasks.workunit.client.0.smithi096.stdout:4/586: link d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/f82 d4/d14/d2d/d44/da2/fba 0 2024-04-18T04:58:06.395 INFO:tasks.workunit.client.0.smithi096.stdout:9/644: dread d0/de/d17/d56/f6a [0,4194304] 0 2024-04-18T04:58:06.397 INFO:tasks.workunit.client.0.smithi096.stdout:0/513: dwrite d16/f1b [0,4194304] 0 2024-04-18T04:58:06.398 INFO:tasks.workunit.client.0.smithi096.stdout:3/812: creat dc/d26/d48/dbd/f10b x:0 0 0 2024-04-18T04:58:06.399 INFO:tasks.workunit.client.0.smithi096.stdout:0/514: readlink d16/d1d/l31 0 2024-04-18T04:58:06.399 INFO:tasks.workunit.client.0.smithi096.stdout:4/587: chown d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/fb0 0 1 2024-04-18T04:58:06.400 INFO:tasks.workunit.client.0.smithi096.stdout:9/645: mknod d0/de/d17/d56/d59/d60/cce 0 2024-04-18T04:58:06.401 INFO:tasks.workunit.client.0.smithi096.stdout:3/813: symlink dc/d26/d48/dc2/d95/da3/l10c 0 2024-04-18T04:58:06.402 INFO:tasks.workunit.client.0.smithi096.stdout:4/588: mknod d4/d14/d16/cbb 0 2024-04-18T04:58:06.404 INFO:tasks.workunit.client.0.smithi096.stdout:4/589: chown d4/d14/d2d/d44 483 1 2024-04-18T04:58:06.404 INFO:tasks.workunit.client.0.smithi096.stdout:7/625: dwrite db/d1f/d39/d6d/f9d [0,4194304] 0 2024-04-18T04:58:06.406 INFO:tasks.workunit.client.0.smithi096.stdout:7/626: write db/f18 [8499233,43133] 0 2024-04-18T04:58:06.409 INFO:tasks.workunit.client.0.smithi096.stdout:9/646: rename d0/de/d17/d56/f50 to d0/de/d17/d56/d59/d60/fcf 0 2024-04-18T04:58:06.410 INFO:tasks.workunit.client.0.smithi096.stdout:0/515: getdents d16/d1c/d22/d2c 0 2024-04-18T04:58:06.411 INFO:tasks.workunit.client.0.smithi096.stdout:3/814: symlink dc/d26/d4a/ddf/l10d 0 2024-04-18T04:58:06.412 INFO:tasks.workunit.client.0.smithi096.stdout:0/516: write d16/f60 [1046268,71050] 0 2024-04-18T04:58:06.413 INFO:tasks.workunit.client.0.smithi096.stdout:7/627: link db/fc5 db/d20/d2f/d8d/da1/fc9 0 2024-04-18T04:58:06.416 INFO:tasks.workunit.client.0.smithi096.stdout:9/647: symlink d0/de/d17/d2f/d40/d8b/ld0 0 2024-04-18T04:58:06.419 INFO:tasks.workunit.client.0.smithi096.stdout:0/517: dread - d16/d1c/d4c/d4d/d5a/f70 zero size 2024-04-18T04:58:06.423 INFO:tasks.workunit.client.0.smithi096.stdout:4/590: dread d4/d14/d2d/d44/f5d [0,4194304] 0 2024-04-18T04:58:06.423 INFO:tasks.workunit.client.0.smithi096.stdout:9/648: getdents d0/de/d17/d56/d59/d68 0 2024-04-18T04:58:06.425 INFO:tasks.workunit.client.0.smithi096.stdout:3/815: dwrite dc/d26/d48/dee/ff1 [0,4194304] 0 2024-04-18T04:58:06.426 INFO:tasks.workunit.client.0.smithi096.stdout:7/628: dwrite db/d1d/d82/fa5 [0,4194304] 0 2024-04-18T04:58:06.431 INFO:tasks.workunit.client.0.smithi096.stdout:4/591: creat d4/d14/d2d/d44/d58/d86/d3a/d47/fbc x:0 0 0 2024-04-18T04:58:06.432 INFO:tasks.workunit.client.0.smithi096.stdout:9/649: creat d0/fd1 x:0 0 0 2024-04-18T04:58:06.435 INFO:tasks.workunit.client.0.smithi096.stdout:9/650: rmdir d0/d6b 39 2024-04-18T04:58:06.439 INFO:tasks.workunit.client.0.smithi096.stdout:0/518: dwrite d16/d1c/d4c/d4d/d5d/d8f/f5e [0,4194304] 0 2024-04-18T04:58:06.441 INFO:tasks.workunit.client.0.smithi096.stdout:4/592: symlink d4/d14/d2d/d44/d58/d86/d97/lbd 0 2024-04-18T04:58:06.441 INFO:tasks.workunit.client.0.smithi096.stdout:3/816: write dc/d5d/f8a [499990,13641] 0 2024-04-18T04:58:06.442 INFO:tasks.workunit.client.0.smithi096.stdout:7/629: getdents db/d1f/d4e 0 2024-04-18T04:58:06.443 INFO:tasks.workunit.client.0.smithi096.stdout:9/651: mkdir d0/de/d17/d2f/d40/dd2 0 2024-04-18T04:58:06.445 INFO:tasks.workunit.client.0.smithi096.stdout:4/593: readlink d4/d14/d2d/d44/d58/d86/d3a/d39/d54/l60 0 2024-04-18T04:58:06.446 INFO:tasks.workunit.client.0.smithi096.stdout:7/630: mknod db/d1f/d4e/dc0/cca 0 2024-04-18T04:58:06.448 INFO:tasks.workunit.client.0.smithi096.stdout:9/652: symlink d0/de/d17/d2f/ld3 0 2024-04-18T04:58:06.449 INFO:tasks.workunit.client.0.smithi096.stdout:7/631: mkdir db/d20/d2f/dcb 0 2024-04-18T04:58:06.450 INFO:tasks.workunit.client.0.smithi096.stdout:4/594: rename d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/fb9 to d4/d14/d2d/d44/d58/d86/d6f/db8/fbe 0 2024-04-18T04:58:06.451 INFO:tasks.workunit.client.0.smithi096.stdout:4/595: chown d4/d14/f72 16 1 2024-04-18T04:58:06.453 INFO:tasks.workunit.client.0.smithi096.stdout:9/653: read d0/de/d17/d56/d59/d60/f8a [646498,58726] 0 2024-04-18T04:58:06.453 INFO:tasks.workunit.client.0.smithi096.stdout:0/519: truncate d16/d1c/d4c/d4d/d5d/f74 3060229 0 2024-04-18T04:58:06.454 INFO:tasks.workunit.client.0.smithi096.stdout:9/654: chown d0/de/d17/d56/d59/caa 5245 1 2024-04-18T04:58:06.454 INFO:tasks.workunit.client.0.smithi096.stdout:3/817: dread dc/ffa [0,4194304] 0 2024-04-18T04:58:06.455 INFO:tasks.workunit.client.0.smithi096.stdout:4/596: creat d4/d14/d1d/da5/d8c/fbf x:0 0 0 2024-04-18T04:58:06.458 INFO:tasks.workunit.client.0.smithi096.stdout:3/818: rmdir dc/d26/d48/dae 39 2024-04-18T04:58:06.459 INFO:tasks.workunit.client.0.smithi096.stdout:9/655: mknod d0/d6b/d89/cd4 0 2024-04-18T04:58:06.461 INFO:tasks.workunit.client.0.smithi096.stdout:4/597: dread d4/f18 [0,4194304] 0 2024-04-18T04:58:06.461 INFO:tasks.workunit.client.0.smithi096.stdout:0/520: rename d16/d1d/d3b/f6e to d16/f96 0 2024-04-18T04:58:06.464 INFO:tasks.workunit.client.0.smithi096.stdout:0/521: fsync d16/d1c/d22/d2c/f68 0 2024-04-18T04:58:06.465 INFO:tasks.workunit.client.0.smithi096.stdout:7/632: dwrite db/fc5 [0,4194304] 0 2024-04-18T04:58:06.468 INFO:tasks.workunit.client.0.smithi096.stdout:0/522: truncate d16/d1c/d4c/d4e/d67/f8d 811536 0 2024-04-18T04:58:06.473 INFO:tasks.workunit.client.0.smithi096.stdout:3/819: write dc/d5d/f9f [1054633,119562] 0 2024-04-18T04:58:06.474 INFO:tasks.workunit.client.0.smithi096.stdout:9/656: dread d0/de/d17/d56/d59/d60/f8a [0,4194304] 0 2024-04-18T04:58:06.475 INFO:tasks.workunit.client.0.smithi096.stdout:0/523: creat d16/d1c/d4c/d4d/d5d/f97 x:0 0 0 2024-04-18T04:58:06.475 INFO:tasks.workunit.client.0.smithi096.stdout:3/820: chown dc/d26/d48/dc2/c37 45 1 2024-04-18T04:58:06.475 INFO:tasks.workunit.client.0.smithi096.stdout:4/598: truncate d4/d14/d2d/d44/d63/f7f 1973570 0 2024-04-18T04:58:06.476 INFO:tasks.workunit.client.0.smithi096.stdout:7/633: truncate db/d1f/f40 780061 0 2024-04-18T04:58:06.477 INFO:tasks.workunit.client.0.smithi096.stdout:0/524: write d16/f2b [3498904,111989] 0 2024-04-18T04:58:06.477 INFO:tasks.workunit.client.0.smithi096.stdout:4/599: readlink d4/d14/d2d/d44/d90/l9a 0 2024-04-18T04:58:06.477 INFO:tasks.workunit.client.0.smithi096.stdout:3/821: read - dc/d26/d4a/ddf/d93/fb8 zero size 2024-04-18T04:58:06.478 INFO:tasks.workunit.client.0.smithi096.stdout:9/657: mkdir d0/de/d17/d2f/dd5 0 2024-04-18T04:58:06.479 INFO:tasks.workunit.client.0.smithi096.stdout:9/658: readlink d0/l4d 0 2024-04-18T04:58:06.479 INFO:tasks.workunit.client.0.smithi096.stdout:0/525: creat d16/d1c/f98 x:0 0 0 2024-04-18T04:58:06.479 INFO:tasks.workunit.client.0.smithi096.stdout:4/600: readlink d4/d14/d2d/l5a 0 2024-04-18T04:58:06.479 INFO:tasks.workunit.client.0.smithi096.stdout:3/822: dread - dc/d26/d66/faf zero size 2024-04-18T04:58:06.482 INFO:tasks.workunit.client.0.smithi096.stdout:3/823: write dc/d26/d4a/ddf/d93/fb8 [136996,9726] 0 2024-04-18T04:58:06.482 INFO:tasks.workunit.client.0.smithi096.stdout:9/659: mkdir d0/de/d17/d2f/d40/d8b/dd6 0 2024-04-18T04:58:06.485 INFO:tasks.workunit.client.0.smithi096.stdout:9/660: rmdir d0/de/d17/d5c 39 2024-04-18T04:58:06.486 INFO:tasks.workunit.client.0.smithi096.stdout:0/526: fdatasync d16/d1c/d4c/d4d/d5d/d8f/f86 0 2024-04-18T04:58:06.487 INFO:tasks.workunit.client.0.smithi096.stdout:9/661: write d0/d41/f63 [209979,66356] 0 2024-04-18T04:58:06.488 INFO:tasks.workunit.client.0.smithi096.stdout:7/634: write db/f15 [248328,66900] 0 2024-04-18T04:58:06.492 INFO:tasks.workunit.client.0.smithi096.stdout:4/601: dwrite d4/d14/d2d/d44/d89/f8e [0,4194304] 0 2024-04-18T04:58:06.493 INFO:tasks.workunit.client.0.smithi096.stdout:0/527: creat d16/d1c/d4c/d4e/f99 x:0 0 0 2024-04-18T04:58:06.493 INFO:tasks.workunit.client.0.smithi096.stdout:9/662: write d0/de/d17/d56/d59/d68/d96/f9b [832624,94440] 0 2024-04-18T04:58:06.498 INFO:tasks.workunit.client.0.smithi096.stdout:3/824: truncate dc/d26/d48/dee/ff1 3628044 0 2024-04-18T04:58:06.498 INFO:tasks.workunit.client.0.smithi096.stdout:9/663: dread d0/de/d17/d56/d59/d60/fc2 [0,4194304] 0 2024-04-18T04:58:06.500 INFO:tasks.workunit.client.0.smithi096.stdout:7/635: truncate db/d1f/d4e/f78 346785 0 2024-04-18T04:58:06.501 INFO:tasks.workunit.client.0.smithi096.stdout:7/636: readlink db/lc4 0 2024-04-18T04:58:06.502 INFO:tasks.workunit.client.0.smithi096.stdout:3/825: dread dc/d26/d48/dc2/f33 [0,4194304] 0 2024-04-18T04:58:06.505 INFO:tasks.workunit.client.0.smithi096.stdout:3/826: fdatasync dc/f42 0 2024-04-18T04:58:06.506 INFO:tasks.workunit.client.0.smithi096.stdout:4/602: dwrite d4/d14/d16/f40 [8388608,4194304] 0 2024-04-18T04:58:06.508 INFO:tasks.workunit.client.0.smithi096.stdout:0/528: dwrite d16/d1c/d4c/d4e/d67/f8b [0,4194304] 0 2024-04-18T04:58:06.508 INFO:tasks.workunit.client.0.smithi096.stdout:7/637: rename db/d20/l87 to db/d1f/d24/d61/d77/lcc 0 2024-04-18T04:58:06.512 INFO:tasks.workunit.client.0.smithi096.stdout:4/603: write d4/d14/d2d/d44/d58/d86/d3a/d39/d54/f91 [3832009,30219] 0 2024-04-18T04:58:06.513 INFO:tasks.workunit.client.0.smithi096.stdout:9/664: link d0/de/d17/d2f/d40/d8b/ld0 d0/de/d17/d2f/d40/d8b/ld7 0 2024-04-18T04:58:06.515 INFO:tasks.workunit.client.0.smithi096.stdout:3/827: creat dc/d26/d4a/d8b/f10e x:0 0 0 2024-04-18T04:58:06.515 INFO:tasks.workunit.client.0.smithi096.stdout:7/638: creat db/d1f/d24/d61/fcd x:0 0 0 2024-04-18T04:58:06.515 INFO:tasks.workunit.client.0.smithi096.stdout:9/665: fsync d0/de/d17/f3f 0 2024-04-18T04:58:06.518 INFO:tasks.workunit.client.0.smithi096.stdout:4/604: mknod d4/d14/d2d/d44/da2/cc0 0 2024-04-18T04:58:06.521 INFO:tasks.workunit.client.0.smithi096.stdout:7/639: creat db/d1f/d24/d49/d54/dc3/fce x:0 0 0 2024-04-18T04:58:06.521 INFO:tasks.workunit.client.0.smithi096.stdout:7/640: stat db/d20/d45 0 2024-04-18T04:58:06.521 INFO:tasks.workunit.client.0.smithi096.stdout:2/854: sync 2024-04-18T04:58:06.521 INFO:tasks.workunit.client.0.smithi096.stdout:5/522: sync 2024-04-18T04:58:06.522 INFO:tasks.workunit.client.0.smithi096.stdout:3/828: creat dc/d26/d48/dc2/d29/d7e/d102/f10f x:0 0 0 2024-04-18T04:58:06.523 INFO:tasks.workunit.client.0.smithi096.stdout:4/605: creat d4/d14/d2d/d44/d58/d86/d3a/d47/fc1 x:0 0 0 2024-04-18T04:58:06.523 INFO:tasks.workunit.client.0.smithi096.stdout:7/641: mkdir db/d20/d45/dcf 0 2024-04-18T04:58:06.524 INFO:tasks.workunit.client.0.smithi096.stdout:0/529: dwrite d16/d1c/d4c/d4d/d5a/f94 [0,4194304] 0 2024-04-18T04:58:06.525 INFO:tasks.workunit.client.0.smithi096.stdout:2/855: readlink df/d18/d24/d42/d3f/ldb 0 2024-04-18T04:58:06.533 INFO:tasks.workunit.client.0.smithi096.stdout:5/523: link d7/fe d7/dd/d35/d74/fc2 0 2024-04-18T04:58:06.534 INFO:tasks.workunit.client.0.smithi096.stdout:4/606: creat d4/d14/d2d/d44/da2/db2/fc2 x:0 0 0 2024-04-18T04:58:06.534 INFO:tasks.workunit.client.0.smithi096.stdout:9/666: write d0/f28 [4434874,15191] 0 2024-04-18T04:58:06.536 INFO:tasks.workunit.client.0.smithi096.stdout:9/667: fdatasync d0/de/d17/d56/d59/d68/f72 0 2024-04-18T04:58:06.537 INFO:tasks.workunit.client.0.smithi096.stdout:4/607: dread - d4/d14/f6a zero size 2024-04-18T04:58:06.538 INFO:tasks.workunit.client.0.smithi096.stdout:7/642: dread db/d1f/d4e/f78 [0,4194304] 0 2024-04-18T04:58:06.539 INFO:tasks.workunit.client.0.smithi096.stdout:2/856: rename df/d18/d24/d42/l90 to df/d18/d26/d48/l118 0 2024-04-18T04:58:06.539 INFO:tasks.workunit.client.0.smithi096.stdout:5/524: mkdir d7/d25/d30/d9e/dc3 0 2024-04-18T04:58:06.541 INFO:tasks.workunit.client.0.smithi096.stdout:7/643: rmdir db/d1f/d24/d61/d77 39 2024-04-18T04:58:06.544 INFO:tasks.workunit.client.0.smithi096.stdout:2/857: rename df/d18/d24/d42/d3f/d4a/d82/fe1 to df/d18/d71/f119 0 2024-04-18T04:58:06.546 INFO:tasks.workunit.client.0.smithi096.stdout:2/858: fsync df/d18/d24/f107 0 2024-04-18T04:58:06.546 INFO:tasks.workunit.client.0.smithi096.stdout:9/668: dwrite d0/f28 [4194304,4194304] 0 2024-04-18T04:58:06.547 INFO:tasks.workunit.client.0.smithi096.stdout:4/608: dwrite d4/d14/d16/f3f [0,4194304] 0 2024-04-18T04:58:06.549 INFO:tasks.workunit.client.0.smithi096.stdout:4/609: dread d4/d14/d2d/fb7 [0,4194304] 0 2024-04-18T04:58:06.554 INFO:tasks.workunit.client.0.smithi096.stdout:5/525: truncate d7/dd/d8f/f2d 2322323 0 2024-04-18T04:58:06.555 INFO:tasks.workunit.client.0.smithi096.stdout:2/859: dread - df/d18/d24/d42/d3f/d4a/dbc/d104/d106/f10c zero size 2024-04-18T04:58:06.557 INFO:tasks.workunit.client.0.smithi096.stdout:4/610: rmdir d4/d14/d2d/d44/d90 39 2024-04-18T04:58:06.557 INFO:tasks.workunit.client.0.smithi096.stdout:2/860: read df/d7d/fee [886047,3927] 0 2024-04-18T04:58:06.557 INFO:tasks.workunit.client.0.smithi096.stdout:4/611: chown d4/d14/d16/c4f 0 1 2024-04-18T04:58:06.558 INFO:tasks.workunit.client.0.smithi096.stdout:5/526: stat d7/d39/f50 0 2024-04-18T04:58:06.559 INFO:tasks.workunit.client.0.smithi096.stdout:5/527: write d7/d25/d30/f5c [362545,127736] 0 2024-04-18T04:58:06.563 INFO:tasks.workunit.client.0.smithi096.stdout:9/669: rename d0/de/d17/d2f/d40/d8b/ld7 to d0/de/d17/d2f/dd5/ld8 0 2024-04-18T04:58:06.564 INFO:tasks.workunit.client.0.smithi096.stdout:7/644: dread db/d20/d45/f63 [0,4194304] 0 2024-04-18T04:58:06.565 INFO:tasks.workunit.client.0.smithi096.stdout:2/861: mknod df/d18/d24/d42/d3f/d4a/dbc/d104/c11a 0 2024-04-18T04:58:06.566 INFO:tasks.workunit.client.0.smithi096.stdout:5/528: mknod d7/d3b/d95/cc4 0 2024-04-18T04:58:06.568 INFO:tasks.workunit.client.0.smithi096.stdout:9/670: creat d0/de/d17/d2f/d40/fd9 x:0 0 0 2024-04-18T04:58:06.568 INFO:tasks.workunit.client.0.smithi096.stdout:4/612: dwrite d4/d14/d2d/d44/d58/d86/d97/fb4 [0,4194304] 0 2024-04-18T04:58:06.571 INFO:tasks.workunit.client.0.smithi096.stdout:4/613: unlink d4/d14/d2d/d44/d58/d86/d3a/d47/fbc 0 2024-04-18T04:58:06.571 INFO:tasks.workunit.client.0.smithi096.stdout:7/645: creat db/d1f/d5b/d6a/dc6/fd0 x:0 0 0 2024-04-18T04:58:06.573 INFO:tasks.workunit.client.0.smithi096.stdout:5/529: link d7/dd/f6b d7/d25/d7c/dc0/fc5 0 2024-04-18T04:58:06.574 INFO:tasks.workunit.client.0.smithi096.stdout:4/614: write d4/d14/d2d/d44/d58/d86/d3a/d39/d54/f91 [2861608,100968] 0 2024-04-18T04:58:06.574 INFO:tasks.workunit.client.0.smithi096.stdout:5/530: write d7/dd/d35/f59 [256722,27229] 0 2024-04-18T04:58:06.576 INFO:tasks.workunit.client.0.smithi096.stdout:2/862: write df/d7d/d9f/f103 [630580,120864] 0 2024-04-18T04:58:06.576 INFO:tasks.workunit.client.0.smithi096.stdout:4/615: fsync d4/d14/d16/f32 0 2024-04-18T04:58:06.577 INFO:tasks.workunit.client.0.smithi096.stdout:5/531: creat d7/d39/d78/dc1/fc6 x:0 0 0 2024-04-18T04:58:06.580 INFO:tasks.workunit.client.0.smithi096.stdout:5/532: truncate d7/dd/f2c 2090139 0 2024-04-18T04:58:06.580 INFO:tasks.workunit.client.0.smithi096.stdout:2/863: truncate df/d18/d71/fc4 359398 0 2024-04-18T04:58:06.581 INFO:tasks.workunit.client.0.smithi096.stdout:4/616: creat d4/d14/d2d/d44/d58/d86/d6f/db8/fc3 x:0 0 0 2024-04-18T04:58:06.581 INFO:tasks.workunit.client.0.smithi096.stdout:2/864: fdatasync df/d18/f89 0 2024-04-18T04:58:06.582 INFO:tasks.workunit.client.0.smithi096.stdout:7/646: dwrite db/f62 [0,4194304] 0 2024-04-18T04:58:06.582 INFO:tasks.workunit.client.0.smithi096.stdout:4/617: chown d4/d14/d2d/d44/d58/d86/d6f 120595483 1 2024-04-18T04:58:06.583 INFO:tasks.workunit.client.0.smithi096.stdout:2/865: fsync df/d18/f22 0 2024-04-18T04:58:06.584 INFO:tasks.workunit.client.0.smithi096.stdout:4/618: fsync d4/d14/d16/f7d 0 2024-04-18T04:58:06.588 INFO:tasks.workunit.client.0.smithi096.stdout:7/647: getdents db/d1f/d39/d6d/d79 0 2024-04-18T04:58:06.591 INFO:tasks.workunit.client.0.smithi096.stdout:2/866: creat df/d18/d26/d48/d7b/d10e/f11b x:0 0 0 2024-04-18T04:58:06.591 INFO:tasks.workunit.client.0.smithi096.stdout:4/619: truncate d4/d14/d2d/fb7 420673 0 2024-04-18T04:58:06.592 INFO:tasks.workunit.client.0.smithi096.stdout:5/533: dwrite d7/dd/f9b [0,4194304] 0 2024-04-18T04:58:06.596 INFO:tasks.workunit.client.0.smithi096.stdout:4/620: creat d4/d14/d2d/d44/d58/d86/d6f/db8/fc4 x:0 0 0 2024-04-18T04:58:06.597 INFO:tasks.workunit.client.0.smithi096.stdout:2/867: mkdir df/d18/d71/d9c/db6/d11c 0 2024-04-18T04:58:06.599 INFO:tasks.workunit.client.0.smithi096.stdout:7/648: dwrite db/f31 [0,4194304] 0 2024-04-18T04:58:06.600 INFO:tasks.workunit.client.0.smithi096.stdout:4/621: chown d4/d14/d2d/d44/d58/d86/d3a/d39/la8 531090312 1 2024-04-18T04:58:06.602 INFO:tasks.workunit.client.0.smithi096.stdout:7/649: write db/d1f/d5b/fb4 [2300338,97673] 0 2024-04-18T04:58:06.606 INFO:tasks.workunit.client.0.smithi096.stdout:2/868: getdents df/d18/d24/d42/d6e 0 2024-04-18T04:58:06.606 INFO:tasks.workunit.client.0.smithi096.stdout:5/534: dwrite d7/dd/d8f/d5e/f79 [0,4194304] 0 2024-04-18T04:58:06.606 INFO:tasks.workunit.client.0.smithi096.stdout:4/622: mkdir d4/d14/d2d/d44/d58/d86/d6f/dc5 0 2024-04-18T04:58:06.608 INFO:tasks.workunit.client.0.smithi096.stdout:2/869: fsync df/d18/d26/f91 0 2024-04-18T04:58:06.609 INFO:tasks.workunit.client.0.smithi096.stdout:7/650: symlink db/d1f/d24/d49/ld1 0 2024-04-18T04:58:06.610 INFO:tasks.workunit.client.0.smithi096.stdout:5/535: creat d7/fc7 x:0 0 0 2024-04-18T04:58:06.612 INFO:tasks.workunit.client.0.smithi096.stdout:4/623: truncate d4/d14/d16/f7d 331880 0 2024-04-18T04:58:06.617 INFO:tasks.workunit.client.0.smithi096.stdout:2/870: creat df/d18/d26/d48/f11d x:0 0 0 2024-04-18T04:58:06.621 INFO:tasks.workunit.client.0.smithi096.stdout:5/536: link d7/d25/d30/faa d7/da3/d9a/fc8 0 2024-04-18T04:58:06.621 INFO:tasks.workunit.client.0.smithi096.stdout:5/537: stat d7/dd/d35/db1 0 2024-04-18T04:58:06.622 INFO:tasks.workunit.client.0.smithi096.stdout:5/538: fdatasync d7/d3b/d95/fb2 0 2024-04-18T04:58:06.623 INFO:tasks.workunit.client.0.smithi096.stdout:2/871: rename df/d18/d71/db8 to df/d7a/d11e 0 2024-04-18T04:58:06.624 INFO:tasks.workunit.client.0.smithi096.stdout:7/651: truncate db/d1f/d24/f56 1473953 0 2024-04-18T04:58:06.626 INFO:tasks.workunit.client.0.smithi096.stdout:2/872: getdents df/d18/d24/d42/d3f/d4a/df4 0 2024-04-18T04:58:06.626 INFO:tasks.workunit.client.0.smithi096.stdout:4/624: dwrite d4/d14/d2d/d44/f5e [0,4194304] 0 2024-04-18T04:58:06.629 INFO:tasks.workunit.client.0.smithi096.stdout:2/873: rmdir df/d18/d26 39 2024-04-18T04:58:06.635 INFO:tasks.workunit.client.0.smithi096.stdout:5/539: dwrite d7/f1a [0,4194304] 0 2024-04-18T04:58:06.638 INFO:tasks.workunit.client.0.smithi096.stdout:2/874: write df/f1b [25522,87365] 0 2024-04-18T04:58:06.638 INFO:tasks.workunit.client.0.smithi096.stdout:4/625: dwrite d4/d14/f31 [0,4194304] 0 2024-04-18T04:58:06.641 INFO:tasks.workunit.client.0.smithi096.stdout:4/626: write d4/d14/d2d/d44/d58/d86/d3a/d39/d54/f91 [2651981,37847] 0 2024-04-18T04:58:06.641 INFO:tasks.workunit.client.0.smithi096.stdout:2/875: creat df/d18/d24/d42/d6e/f11f x:0 0 0 2024-04-18T04:58:06.646 INFO:tasks.workunit.client.0.smithi096.stdout:5/540: dread d7/d3b/f9d [0,4194304] 0 2024-04-18T04:58:06.646 INFO:tasks.workunit.client.0.smithi096.stdout:2/876: write df/d18/d26/d48/d7b/ff1 [563008,68097] 0 2024-04-18T04:58:06.647 INFO:tasks.workunit.client.0.smithi096.stdout:2/877: chown df/d18/d24/d42/d3f/l44 113060 1 2024-04-18T04:58:06.650 INFO:tasks.workunit.client.0.smithi096.stdout:4/627: dwrite d4/d14/d1d/f52 [0,4194304] 0 2024-04-18T04:58:06.653 INFO:tasks.workunit.client.0.smithi096.stdout:5/541: write d7/d25/d30/f4b [217635,19134] 0 2024-04-18T04:58:06.658 INFO:tasks.workunit.client.0.smithi096.stdout:4/628: truncate d4/d14/d2d/d44/d58/f6b 375493 0 2024-04-18T04:58:06.660 INFO:tasks.workunit.client.0.smithi096.stdout:8/532: sync 2024-04-18T04:58:06.660 INFO:tasks.workunit.client.0.smithi096.stdout:6/861: sync 2024-04-18T04:58:06.660 INFO:tasks.workunit.client.0.smithi096.stdout:1/672: sync 2024-04-18T04:58:06.661 INFO:tasks.workunit.client.0.smithi096.stdout:5/542: dwrite d7/d25/f2f [0,4194304] 0 2024-04-18T04:58:06.662 INFO:tasks.workunit.client.0.smithi096.stdout:6/862: stat d0/d6/d29/de5/d103 0 2024-04-18T04:58:06.663 INFO:tasks.workunit.client.0.smithi096.stdout:5/543: unlink f4 0 2024-04-18T04:58:06.664 INFO:tasks.workunit.client.0.smithi096.stdout:6/863: fdatasync d0/d6/d29/f7f 0 2024-04-18T04:58:06.664 INFO:tasks.workunit.client.0.smithi096.stdout:1/673: unlink de/d1d/d32/d73/f7f 0 2024-04-18T04:58:06.666 INFO:tasks.workunit.client.0.smithi096.stdout:8/533: creat d0/d7/d24/d18/d27/d60/fac x:0 0 0 2024-04-18T04:58:06.667 INFO:tasks.workunit.client.0.smithi096.stdout:5/544: write d7/dd/d8f/d5e/fa1 [927342,76904] 0 2024-04-18T04:58:06.670 INFO:tasks.workunit.client.0.smithi096.stdout:4/629: dwrite d4/d14/d1d/f52 [0,4194304] 0 2024-04-18T04:58:06.671 INFO:tasks.workunit.client.0.smithi096.stdout:2/878: dread df/d18/ffd [0,4194304] 0 2024-04-18T04:58:06.675 INFO:tasks.workunit.client.0.smithi096.stdout:4/630: stat d4/d14/d2d/d44/d58/d86/d6f/f77 0 2024-04-18T04:58:06.681 INFO:tasks.workunit.client.0.smithi096.stdout:8/534: dwrite d0/d7/d24/d35/d51/d5b/f63 [0,4194304] 0 2024-04-18T04:58:06.681 INFO:tasks.workunit.client.0.smithi096.stdout:6/864: link d0/d6/d2b/d3b/cbe d0/d6/d2b/d3b/d69/d6c/d85/c107 0 2024-04-18T04:58:06.684 INFO:tasks.workunit.client.0.smithi096.stdout:5/545: link d7/dd/d35/l5f d7/d25/d30/d9e/lc9 0 2024-04-18T04:58:06.685 INFO:tasks.workunit.client.0.smithi096.stdout:1/674: dread de/d1d/f87 [0,4194304] 0 2024-04-18T04:58:06.685 INFO:tasks.workunit.client.0.smithi096.stdout:8/535: unlink d0/d7/d24/d35/c42 0 2024-04-18T04:58:06.686 INFO:tasks.workunit.client.0.smithi096.stdout:1/675: write de/fbe [194357,59488] 0 2024-04-18T04:58:06.687 INFO:tasks.workunit.client.0.smithi096.stdout:8/536: dread d0/f75 [0,4194304] 0 2024-04-18T04:58:06.687 INFO:tasks.workunit.client.0.smithi096.stdout:6/865: symlink d0/d6/d5d/de6/l108 0 2024-04-18T04:58:06.688 INFO:tasks.workunit.client.0.smithi096.stdout:8/537: fdatasync d0/d7/d24/f82 0 2024-04-18T04:58:06.689 INFO:tasks.workunit.client.0.smithi096.stdout:4/631: getdents d4/d14/d2d/d44/d89 0 2024-04-18T04:58:06.690 INFO:tasks.workunit.client.0.smithi096.stdout:8/538: dread - d0/d7/d24/d8d/f95 zero size 2024-04-18T04:58:06.691 INFO:tasks.workunit.client.0.smithi096.stdout:4/632: fsync d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/fac 0 2024-04-18T04:58:06.691 INFO:tasks.workunit.client.0.smithi096.stdout:8/539: read - d0/d7/d24/d8d/f95 zero size 2024-04-18T04:58:06.692 INFO:tasks.workunit.client.0.smithi096.stdout:2/879: truncate df/d18/d24/d42/f2c 1397777 0 2024-04-18T04:58:06.694 INFO:tasks.workunit.client.0.smithi096.stdout:5/546: write d7/d3b/f9d [29095,111176] 0 2024-04-18T04:58:06.697 INFO:tasks.workunit.client.0.smithi096.stdout:8/540: mkdir d0/d7/d24/d18/d7c/dad 0 2024-04-18T04:58:06.698 INFO:tasks.workunit.client.0.smithi096.stdout:5/547: mknod d7/d39/cca 0 2024-04-18T04:58:06.698 INFO:tasks.workunit.client.0.smithi096.stdout:1/676: dwrite de/d1d/d32/d73/fcc [0,4194304] 0 2024-04-18T04:58:06.703 INFO:tasks.workunit.client.0.smithi096.stdout:8/541: chown d0/d7/d24/d35/d51/d5b/f89 57983 1 2024-04-18T04:58:06.706 INFO:tasks.workunit.client.0.smithi096.stdout:1/677: readlink de/d1d/d32/d6f/d85/l97 0 2024-04-18T04:58:06.708 INFO:tasks.workunit.client.0.smithi096.stdout:6/866: dwrite d0/d73/f80 [0,4194304] 0 2024-04-18T04:58:06.711 INFO:tasks.workunit.client.0.smithi096.stdout:4/633: truncate d4/d14/d2d/d44/d58/d86/d3a/d47/fae 217125 0 2024-04-18T04:58:06.711 INFO:tasks.workunit.client.0.smithi096.stdout:2/880: dwrite df/d7a/d11e/ffe [0,4194304] 0 2024-04-18T04:58:06.713 INFO:tasks.workunit.client.0.smithi096.stdout:8/542: mknod d0/d7/d24/d35/d51/d5b/cae 0 2024-04-18T04:58:06.713 INFO:tasks.workunit.client.0.smithi096.stdout:5/548: dwrite d7/d3b/f7f [0,4194304] 0 2024-04-18T04:58:06.714 INFO:tasks.workunit.client.0.smithi096.stdout:6/867: fdatasync d0/d6/d5d/f70 0 2024-04-18T04:58:06.714 INFO:tasks.workunit.client.0.smithi096.stdout:8/543: readlink d0/d3/d32/la2 0 2024-04-18T04:58:06.719 INFO:tasks.workunit.client.0.smithi096.stdout:4/634: mkdir d4/d14/d2d/da6/dc6 0 2024-04-18T04:58:06.722 INFO:tasks.workunit.client.0.smithi096.stdout:8/544: symlink d0/d7/d24/d18/d27/laf 0 2024-04-18T04:58:06.723 INFO:tasks.workunit.client.0.smithi096.stdout:2/881: dwrite df/d18/d24/d42/d3f/fde [0,4194304] 0 2024-04-18T04:58:06.727 INFO:tasks.workunit.client.0.smithi096.stdout:6/868: mknod d0/d6/d2b/c109 0 2024-04-18T04:58:06.727 INFO:tasks.workunit.client.0.smithi096.stdout:4/635: dread d4/d14/d2d/d44/d89/f8e [0,4194304] 0 2024-04-18T04:58:06.729 INFO:tasks.workunit.client.0.smithi096.stdout:2/882: write df/d7a/f9d [3069387,39903] 0 2024-04-18T04:58:06.729 INFO:tasks.workunit.client.0.smithi096.stdout:4/636: fdatasync d4/d14/d2d/d44/d58/d86/d6f/db8/fc4 0 2024-04-18T04:58:06.731 INFO:tasks.workunit.client.0.smithi096.stdout:6/869: unlink d0/d6/d2b/d3b/d7d/dee/ff8 0 2024-04-18T04:58:06.731 INFO:tasks.workunit.client.0.smithi096.stdout:2/883: dread - df/d18/d26/d48/d7b/d10e/f11b zero size 2024-04-18T04:58:06.731 INFO:tasks.workunit.client.0.smithi096.stdout:4/637: read d4/d14/d1d/f25 [3740634,64151] 0 2024-04-18T04:58:06.733 INFO:tasks.workunit.client.0.smithi096.stdout:4/638: write d4/d14/d2d/d44/f5e [901783,34378] 0 2024-04-18T04:58:06.734 INFO:tasks.workunit.client.0.smithi096.stdout:4/639: chown d4/fb1 15525118 1 2024-04-18T04:58:06.736 INFO:tasks.workunit.client.0.smithi096.stdout:6/870: truncate d0/d6/f34 840191 0 2024-04-18T04:58:06.737 INFO:tasks.workunit.client.0.smithi096.stdout:2/884: symlink df/d18/d24/l120 0 2024-04-18T04:58:06.741 INFO:tasks.workunit.client.0.smithi096.stdout:5/549: dwrite d7/d39/d52/f65 [0,4194304] 0 2024-04-18T04:58:06.741 INFO:tasks.workunit.client.0.smithi096.stdout:6/871: rename d0/d73/fa8 to d0/d6/d2b/d3b/d69/d66/dcf/f10a 0 2024-04-18T04:58:06.742 INFO:tasks.workunit.client.0.smithi096.stdout:4/640: truncate d4/d14/d2d/d44/d58/f65 174962 0 2024-04-18T04:58:06.742 INFO:tasks.workunit.client.0.smithi096.stdout:6/872: chown d0/d6/d5d/l6a 1642 1 2024-04-18T04:58:06.743 INFO:tasks.workunit.client.0.smithi096.stdout:5/550: rmdir d7/d25/d58 39 2024-04-18T04:58:06.748 INFO:tasks.workunit.client.0.smithi096.stdout:4/641: rename d4/d14/d2d/d44/d58/f6b to d4/d14/d2d/d44/da2/db2/fc7 0 2024-04-18T04:58:06.750 INFO:tasks.workunit.client.0.smithi096.stdout:4/642: write d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/fac [91994,110299] 0 2024-04-18T04:58:06.751 INFO:tasks.workunit.client.0.smithi096.stdout:6/873: rename d0/d6/d2b/d3b/f41 to d0/da0/f10b 0 2024-04-18T04:58:06.754 INFO:tasks.workunit.client.0.smithi096.stdout:4/643: creat d4/d14/d2d/d44/d58/d86/d3a/d47/fc8 x:0 0 0 2024-04-18T04:58:06.754 INFO:tasks.workunit.client.0.smithi096.stdout:6/874: truncate d0/d6/d2b/d3b/d69/d66/dcf/f10a 615437 0 2024-04-18T04:58:06.755 INFO:tasks.workunit.client.0.smithi096.stdout:6/875: rmdir d0/d6 39 2024-04-18T04:58:06.755 INFO:tasks.workunit.client.0.smithi096.stdout:2/885: dread df/d18/d26/f27 [0,4194304] 0 2024-04-18T04:58:06.757 INFO:tasks.workunit.client.0.smithi096.stdout:5/551: dread d7/d39/f70 [0,4194304] 0 2024-04-18T04:58:06.761 INFO:tasks.workunit.client.0.smithi096.stdout:5/552: rename d7/dd/d35/da0/fad to d7/dd/d8f/fcb 0 2024-04-18T04:58:06.763 INFO:tasks.workunit.client.0.smithi096.stdout:2/886: dwrite fe [0,4194304] 0 2024-04-18T04:58:06.765 INFO:tasks.workunit.client.0.smithi096.stdout:5/553: symlink d7/d25/d30/d9e/dc3/lcc 0 2024-04-18T04:58:06.766 INFO:tasks.workunit.client.0.smithi096.stdout:2/887: chown df/d18/d71/d75/c116 207 1 2024-04-18T04:58:06.766 INFO:tasks.workunit.client.0.smithi096.stdout:2/888: stat df/d18/d24/d42/d3f 0 2024-04-18T04:58:06.767 INFO:tasks.workunit.client.0.smithi096.stdout:4/644: write d4/d14/d2d/d44/d58/f88 [729963,46437] 0 2024-04-18T04:58:06.768 INFO:tasks.workunit.client.0.smithi096.stdout:6/876: write d0/d6/d2b/d3b/d69/d6c/d85/f9f [337204,74897] 0 2024-04-18T04:58:06.769 INFO:tasks.workunit.client.0.smithi096.stdout:2/889: mkdir df/d7d/d105/d121 0 2024-04-18T04:58:06.773 INFO:tasks.workunit.client.0.smithi096.stdout:5/554: rename d7/d25/d7c/dc0 to d7/dcd 0 2024-04-18T04:58:06.774 INFO:tasks.workunit.client.0.smithi096.stdout:4/645: creat d4/d14/d2d/d44/da2/fc9 x:0 0 0 2024-04-18T04:58:06.775 INFO:tasks.workunit.client.0.smithi096.stdout:5/555: truncate d7/dd/f2c 2861652 0 2024-04-18T04:58:06.776 INFO:tasks.workunit.client.0.smithi096.stdout:2/890: rename df/d18/d24/d42/d3f/ldb to df/d18/d87/l122 0 2024-04-18T04:58:06.778 INFO:tasks.workunit.client.0.smithi096.stdout:4/646: readlink d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/l85 0 2024-04-18T04:58:06.778 INFO:tasks.workunit.client.0.smithi096.stdout:6/877: dwrite d0/d6/d5d/f7b [0,4194304] 0 2024-04-18T04:58:06.783 INFO:tasks.workunit.client.0.smithi096.stdout:4/647: creat d4/d14/d2d/d44/d58/d86/d3a/fca x:0 0 0 2024-04-18T04:58:06.786 INFO:tasks.workunit.client.0.smithi096.stdout:5/556: getdents d7 0 2024-04-18T04:58:06.789 INFO:tasks.workunit.client.0.smithi096.stdout:5/557: creat d7/dcd/fce x:0 0 0 2024-04-18T04:58:06.790 INFO:tasks.workunit.client.0.smithi096.stdout:2/891: dwrite f9 [0,4194304] 0 2024-04-18T04:58:06.793 INFO:tasks.workunit.client.0.smithi096.stdout:4/648: dwrite d4/f62 [0,4194304] 0 2024-04-18T04:58:06.795 INFO:tasks.workunit.client.0.smithi096.stdout:5/558: rmdir d7/dd/d35/db1 39 2024-04-18T04:58:06.795 INFO:tasks.workunit.client.0.smithi096.stdout:2/892: creat df/d18/d24/d42/dd9/f123 x:0 0 0 2024-04-18T04:58:06.795 INFO:tasks.workunit.client.0.smithi096.stdout:5/559: write d7/d25/d7c/f87 [990184,121523] 0 2024-04-18T04:58:06.799 INFO:tasks.workunit.client.0.smithi096.stdout:5/560: rename d7/d25/d2b/f75 to d7/d3b/fcf 0 2024-04-18T04:58:06.799 INFO:tasks.workunit.client.0.smithi096.stdout:6/878: dread d0/d6/d2b/d3b/dc9/feb [0,4194304] 0 2024-04-18T04:58:06.802 INFO:tasks.workunit.client.0.smithi096.stdout:6/879: rmdir d0/d6/d29/de5 39 2024-04-18T04:58:06.802 INFO:tasks.workunit.client.0.smithi096.stdout:6/880: write d0/d6/d2e/f7c [870366,54181] 0 2024-04-18T04:58:06.804 INFO:tasks.workunit.client.0.smithi096.stdout:4/649: write d4/d14/d1d/f25 [479143,23446] 0 2024-04-18T04:58:06.805 INFO:tasks.workunit.client.0.smithi096.stdout:6/881: truncate d0/d6/d2b/d3b/d69/fca 627436 0 2024-04-18T04:58:06.806 INFO:tasks.workunit.client.0.smithi096.stdout:5/561: truncate d7/dd/f2e 1015233 0 2024-04-18T04:58:06.807 INFO:tasks.workunit.client.0.smithi096.stdout:6/882: creat d0/d6/d2e/d7a/f10c x:0 0 0 2024-04-18T04:58:06.808 INFO:tasks.workunit.client.0.smithi096.stdout:4/650: mkdir d4/d14/d2d/d44/dcb 0 2024-04-18T04:58:06.809 INFO:tasks.workunit.client.0.smithi096.stdout:6/883: write d0/d6/d2b/d3b/dbb/fd4 [3436327,100813] 0 2024-04-18T04:58:06.812 INFO:tasks.workunit.client.0.smithi096.stdout:4/651: rename d4/f19 to d4/d14/d2d/d44/d58/fcc 0 2024-04-18T04:58:06.816 INFO:tasks.workunit.client.0.smithi096.stdout:6/884: fdatasync d0/d6/d2b/d3b/d69/f84 0 2024-04-18T04:58:06.817 INFO:tasks.workunit.client.0.smithi096.stdout:4/652: rename d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/f57 to d4/d14/d16/fcd 0 2024-04-18T04:58:06.818 INFO:tasks.workunit.client.0.smithi096.stdout:5/562: dread d7/d39/f20 [0,4194304] 0 2024-04-18T04:58:06.818 INFO:tasks.workunit.client.0.smithi096.stdout:6/885: chown d0/d6/l72 924582313 1 2024-04-18T04:58:06.819 INFO:tasks.workunit.client.0.smithi096.stdout:4/653: mkdir d4/d14/d2d/da6/dc6/dce 0 2024-04-18T04:58:06.820 INFO:tasks.workunit.client.0.smithi096.stdout:6/886: read d0/d6/d2b/d3b/d69/fca [93136,23973] 0 2024-04-18T04:58:06.821 INFO:tasks.workunit.client.0.smithi096.stdout:4/654: stat d4/d14/d2d/l73 0 2024-04-18T04:58:06.822 INFO:tasks.workunit.client.0.smithi096.stdout:6/887: truncate d0/d6/d2b/d3b/dbb/fe1 186004 0 2024-04-18T04:58:06.823 INFO:tasks.workunit.client.0.smithi096.stdout:4/655: write d4/d14/d2d/d44/d58/f88 [665374,125074] 0 2024-04-18T04:58:06.824 INFO:tasks.workunit.client.0.smithi096.stdout:6/888: symlink d0/da0/l10d 0 2024-04-18T04:58:06.826 INFO:tasks.workunit.client.0.smithi096.stdout:5/563: dread d7/dd/f19 [0,4194304] 0 2024-04-18T04:58:06.828 INFO:tasks.workunit.client.0.smithi096.stdout:5/564: write d7/dd/d35/fbc [741469,27045] 0 2024-04-18T04:58:06.832 INFO:tasks.workunit.client.0.smithi096.stdout:6/889: dwrite d0/d6/d2e/fd2 [0,4194304] 0 2024-04-18T04:58:06.833 INFO:tasks.workunit.client.0.smithi096.stdout:4/656: write d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/f82 [2721538,25568] 0 2024-04-18T04:58:06.834 INFO:tasks.workunit.client.0.smithi096.stdout:4/657: dread - d4/d14/d2d/d44/d58/d86/d3a/d39/fab zero size 2024-04-18T04:58:06.844 INFO:tasks.workunit.client.0.smithi096.stdout:6/890: dread d0/d6/d29/f30 [0,4194304] 0 2024-04-18T04:58:06.846 INFO:tasks.workunit.client.0.smithi096.stdout:4/658: dwrite d4/d14/f6a [0,4194304] 0 2024-04-18T04:58:06.847 INFO:tasks.workunit.client.0.smithi096.stdout:6/891: mkdir d0/d6/d2b/d10e 0 2024-04-18T04:58:06.847 INFO:tasks.workunit.client.0.smithi096.stdout:4/659: rmdir d4/d7a 39 2024-04-18T04:58:06.848 INFO:tasks.workunit.client.0.smithi096.stdout:6/892: write d0/da0/fe7 [826877,45594] 0 2024-04-18T04:58:06.851 INFO:tasks.workunit.client.0.smithi096.stdout:6/893: dread - d0/d6/d5d/ddd/fde zero size 2024-04-18T04:58:06.852 INFO:tasks.workunit.client.0.smithi096.stdout:6/894: readlink d0/d6/d2b/d3b/d69/d6c/d85/lfd 0 2024-04-18T04:58:06.853 INFO:tasks.workunit.client.0.smithi096.stdout:4/660: read d4/d14/d2d/d44/d58/d86/d3a/d39/f51 [1942178,13864] 0 2024-04-18T04:58:06.854 INFO:tasks.workunit.client.0.smithi096.stdout:4/661: dread - d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/fa4 zero size 2024-04-18T04:58:06.855 INFO:tasks.workunit.client.0.smithi096.stdout:4/662: chown d4/d14/d2d/d44 0 1 2024-04-18T04:58:06.856 INFO:tasks.workunit.client.0.smithi096.stdout:6/895: link d0/d6/d2b/c109 d0/c10f 0 2024-04-18T04:58:06.858 INFO:tasks.workunit.client.0.smithi096.stdout:6/896: chown d0/da0/f10b 2 1 2024-04-18T04:58:06.871 INFO:tasks.workunit.client.0.smithi096.stdout:6/897: dread d0/d6/f1d [0,4194304] 0 2024-04-18T04:58:06.872 INFO:tasks.workunit.client.0.smithi096.stdout:6/898: write d0/f82 [2454607,37643] 0 2024-04-18T04:58:06.873 INFO:tasks.workunit.client.0.smithi096.stdout:6/899: write d0/d6/d5d/f75 [9139879,122423] 0 2024-04-18T04:58:06.875 INFO:tasks.workunit.client.0.smithi096.stdout:6/900: fdatasync d0/f59 0 2024-04-18T04:58:06.877 INFO:tasks.workunit.client.0.smithi096.stdout:6/901: stat d0/d6/d2e/d7a/l8d 0 2024-04-18T04:58:06.878 INFO:tasks.workunit.client.0.smithi096.stdout:6/902: fdatasync d0/da0/f10b 0 2024-04-18T04:58:06.881 INFO:tasks.workunit.client.0.smithi096.stdout:6/903: truncate d0/d6/d2e/f56 4857752 0 2024-04-18T04:58:06.883 INFO:tasks.workunit.client.0.smithi096.stdout:6/904: creat d0/d4a/f110 x:0 0 0 2024-04-18T04:58:06.883 INFO:tasks.workunit.client.0.smithi096.stdout:6/905: chown d0/d6/d2e/f31 244 1 2024-04-18T04:58:06.886 INFO:tasks.workunit.client.0.smithi096.stdout:6/906: truncate d0/d6/d29/f30 1200721 0 2024-04-18T04:58:06.898 INFO:tasks.workunit.client.0.smithi096.stdout:6/907: truncate d0/d6/d29/f30 87345 0 2024-04-18T04:58:06.903 INFO:tasks.workunit.client.0.smithi096.stdout:6/908: dwrite d0/d6/d2b/d3b/d69/d6c/d85/fcb [4194304,4194304] 0 2024-04-18T04:58:06.905 INFO:tasks.workunit.client.0.smithi096.stdout:6/909: write d0/d6/f98 [1116523,41468] 0 2024-04-18T04:58:06.906 INFO:tasks.workunit.client.0.smithi096.stdout:6/910: chown d0/da0/l10d 29 1 2024-04-18T04:58:06.909 INFO:tasks.workunit.client.0.smithi096.stdout:6/911: write d0/d6/d29/ffb [603773,20445] 0 2024-04-18T04:58:06.910 INFO:tasks.workunit.client.0.smithi096.stdout:6/912: fdatasync d0/d6/d29/d83/f92 0 2024-04-18T04:58:06.914 INFO:tasks.workunit.client.0.smithi096.stdout:6/913: rename d0/d6/d2b/d3b/d69/d6c/d85/cb8 to d0/d6/d2b/d3b/c111 0 2024-04-18T04:58:06.916 INFO:tasks.workunit.client.0.smithi096.stdout:6/914: stat d0/d6/d29/de5/df6 0 2024-04-18T04:58:06.918 INFO:tasks.workunit.client.0.smithi096.stdout:6/915: creat d0/d6/d2b/d3b/d69/d6c/f112 x:0 0 0 2024-04-18T04:58:06.920 INFO:tasks.workunit.client.0.smithi096.stdout:6/916: truncate d0/d6/d2b/d3b/f40 5227482 0 2024-04-18T04:58:06.921 INFO:tasks.workunit.client.0.smithi096.stdout:6/917: read d0/da0/fe7 [566708,26830] 0 2024-04-18T04:58:06.922 INFO:tasks.workunit.client.0.smithi096.stdout:6/918: rmdir d0/d6/d29 39 2024-04-18T04:58:06.926 INFO:tasks.workunit.client.0.smithi096.stdout:6/919: mkdir d0/d6/d29/d83/d113 0 2024-04-18T04:58:06.927 INFO:tasks.workunit.client.0.smithi096.stdout:6/920: rmdir d0/d6/d29 39 2024-04-18T04:58:06.927 INFO:tasks.workunit.client.0.smithi096.stdout:6/921: fsync d0/d6/d5d/f70 0 2024-04-18T04:58:06.944 INFO:tasks.workunit.client.0.smithi096.stdout:6/922: dwrite d0/d6/d5d/ddd/fde [0,4194304] 0 2024-04-18T04:58:06.945 INFO:tasks.workunit.client.0.smithi096.stdout:6/923: chown d0/d6/d2b/d3b/d69/d6c/fed 36259 1 2024-04-18T04:58:06.947 INFO:tasks.workunit.client.0.smithi096.stdout:6/924: read d0/d6/f34 [24704,116820] 0 2024-04-18T04:58:06.950 INFO:tasks.workunit.client.0.smithi096.stdout:6/925: creat d0/d6/d2b/d3b/d7d/f114 x:0 0 0 2024-04-18T04:58:06.952 INFO:tasks.workunit.client.0.smithi096.stdout:6/926: mkdir d0/d6/d2b/d3b/d7d/dee/d115 0 2024-04-18T04:58:06.954 INFO:tasks.workunit.client.0.smithi096.stdout:6/927: write d0/d6/d29/f7f [2754028,33941] 0 2024-04-18T04:58:06.955 INFO:tasks.workunit.client.0.smithi096.stdout:6/928: write d0/d6/d2b/d3b/d7d/fcd [857867,32934] 0 2024-04-18T04:58:06.960 INFO:tasks.workunit.client.0.smithi096.stdout:6/929: unlink d0/d6/d2b/d3b/cbe 0 2024-04-18T04:58:06.966 INFO:tasks.workunit.client.0.smithi096.stdout:6/930: dwrite d0/d6/f24 [4194304,4194304] 0 2024-04-18T04:58:06.967 INFO:tasks.workunit.client.0.smithi096.stdout:6/931: write d0/d6/d5d/ddd/fde [3531443,68522] 0 2024-04-18T04:58:06.974 INFO:tasks.workunit.client.0.smithi096.stdout:6/932: write d0/da0/f10b [2059985,71463] 0 2024-04-18T04:58:06.978 INFO:tasks.workunit.client.0.smithi096.stdout:6/933: mknod d0/d6/d5d/ddd/c116 0 2024-04-18T04:58:06.979 INFO:tasks.workunit.client.0.smithi096.stdout:6/934: write d0/d6/d2e/fd2 [1412309,60788] 0 2024-04-18T04:58:06.981 INFO:tasks.workunit.client.0.smithi096.stdout:6/935: write d0/d6/d2b/d3b/d7d/f114 [509970,69413] 0 2024-04-18T04:58:06.983 INFO:tasks.workunit.client.0.smithi096.stdout:6/936: symlink d0/da0/l117 0 2024-04-18T04:58:06.984 INFO:tasks.workunit.client.0.smithi096.stdout:6/937: write d0/d6/d2b/d3b/d69/f71 [8249430,111250] 0 2024-04-18T04:58:06.985 INFO:tasks.workunit.client.0.smithi096.stdout:6/938: chown d0/d6/d2e/d7a/l8d 74 1 2024-04-18T04:58:06.988 INFO:tasks.workunit.client.0.smithi096.stdout:6/939: symlink d0/d6/d2b/d3b/d69/d6c/dd8/l118 0 2024-04-18T04:58:06.992 INFO:tasks.workunit.client.0.smithi096.stdout:3/829: sync 2024-04-18T04:58:06.994 INFO:tasks.workunit.client.0.smithi096.stdout:3/830: truncate dc/d26/d57/fcd 95965 0 2024-04-18T04:58:06.994 INFO:tasks.workunit.client.0.smithi096.stdout:6/940: rename d0/d6/d2b/d3b/lf7 to d0/d6/d2b/d3b/d69/d66/dcf/dd5/l119 0 2024-04-18T04:58:06.994 INFO:tasks.workunit.client.0.smithi096.stdout:6/941: chown d0/d6/d2b/d3b/d7d/f114 1 1 2024-04-18T04:58:06.997 INFO:tasks.workunit.client.0.smithi096.stdout:6/942: creat d0/d6/d2b/d3b/dc9/f11a x:0 0 0 2024-04-18T04:58:07.000 INFO:tasks.workunit.client.0.smithi096.stdout:3/831: dwrite dc/d26/d48/f107 [0,4194304] 0 2024-04-18T04:58:07.002 INFO:tasks.workunit.client.0.smithi096.stdout:3/832: dread - dc/d26/d48/dc2/d95/ff6 zero size 2024-04-18T04:58:07.003 INFO:tasks.workunit.client.0.smithi096.stdout:6/943: creat d0/d6/d2b/d3b/d69/d6c/dd8/f11b x:0 0 0 2024-04-18T04:58:07.005 INFO:tasks.workunit.client.0.smithi096.stdout:3/833: symlink dc/d26/d48/dbd/dd3/l110 0 2024-04-18T04:58:07.011 INFO:tasks.workunit.client.0.smithi096.stdout:3/834: dwrite dc/d5d/fda [0,4194304] 0 2024-04-18T04:58:07.012 INFO:tasks.workunit.client.0.smithi096.stdout:6/944: link d0/d6/d2e/f31 d0/d6/d2b/f11c 0 2024-04-18T04:58:07.014 INFO:tasks.workunit.client.0.smithi096.stdout:6/945: truncate d0/d6/d29/de5/d103/f106 750016 0 2024-04-18T04:58:07.027 INFO:tasks.workunit.client.0.smithi096.stdout:6/946: dread d0/d6/d2b/d3b/d69/d6c/d85/fcb [8388608,4194304] 0 2024-04-18T04:58:07.030 INFO:tasks.workunit.client.0.smithi096.stdout:6/947: symlink d0/d6/l11d 0 2024-04-18T04:58:07.030 INFO:tasks.workunit.client.0.smithi096.stdout:6/948: chown d0/d6/d2b/d3b/d69/d6c/dd8 60 1 2024-04-18T04:58:07.032 INFO:tasks.workunit.client.0.smithi096.stdout:6/949: readlink d0/d6/d2b/d3b/d69/le9 0 2024-04-18T04:58:07.034 INFO:tasks.workunit.client.0.smithi096.stdout:6/950: read - d0/d6/d5d/f9a zero size 2024-04-18T04:58:07.035 INFO:tasks.workunit.client.0.smithi096.stdout:3/835: dread dc/d26/d48/dc2/d29/fff [0,4194304] 0 2024-04-18T04:58:07.040 INFO:tasks.workunit.client.0.smithi096.stdout:3/836: getdents dc/d70 0 2024-04-18T04:58:07.047 INFO:tasks.workunit.client.0.smithi096.stdout:3/837: dwrite dc/d26/d57/fcd [0,4194304] 0 2024-04-18T04:58:07.049 INFO:tasks.workunit.client.0.smithi096.stdout:3/838: write dc/d5d/fa4 [4883840,122612] 0 2024-04-18T04:58:07.054 INFO:tasks.workunit.client.0.smithi096.stdout:3/839: creat dc/d26/f111 x:0 0 0 2024-04-18T04:58:07.056 INFO:tasks.workunit.client.0.smithi096.stdout:3/840: rmdir dc/d26/d48/dc2/d29 39 2024-04-18T04:58:07.062 INFO:tasks.workunit.client.0.smithi096.stdout:3/841: dwrite dc/d26/d48/dc2/fab [0,4194304] 0 2024-04-18T04:58:07.069 INFO:tasks.workunit.client.0.smithi096.stdout:3/842: dwrite dc/d70/f94 [0,4194304] 0 2024-04-18T04:58:07.071 INFO:tasks.workunit.client.0.smithi096.stdout:3/843: write dc/d26/d66/d7f/fbe [2127936,122646] 0 2024-04-18T04:58:07.077 INFO:tasks.workunit.client.0.smithi096.stdout:3/844: symlink dc/d26/d48/dc2/l112 0 2024-04-18T04:58:07.077 INFO:tasks.workunit.client.0.smithi096.stdout:3/845: chown dc/d26/d48/dbd/le4 2121823 1 2024-04-18T04:58:07.080 INFO:tasks.workunit.client.0.smithi096.stdout:3/846: symlink dc/d70/l113 0 2024-04-18T04:58:07.085 INFO:tasks.workunit.client.0.smithi096.stdout:3/847: dread dc/d26/d4a/f6c [0,4194304] 0 2024-04-18T04:58:07.088 INFO:tasks.workunit.client.0.smithi096.stdout:3/848: unlink dc/d26/d4a/fc6 0 2024-04-18T04:58:07.101 INFO:tasks.workunit.client.0.smithi096.stdout:3/849: dread dc/f56 [0,4194304] 0 2024-04-18T04:58:07.102 INFO:tasks.workunit.client.0.smithi096.stdout:3/850: rename dc/d26 to dc/d26/d4a/ddf/d93/d114 22 2024-04-18T04:58:07.105 INFO:tasks.workunit.client.0.smithi096.stdout:3/851: creat dc/d26/d48/dc2/d95/de3/f115 x:0 0 0 2024-04-18T04:58:07.110 INFO:tasks.workunit.client.0.smithi096.stdout:3/852: dread dc/d26/d48/dc2/d29/fff [4194304,4194304] 0 2024-04-18T04:58:07.115 INFO:tasks.workunit.client.0.smithi096.stdout:3/853: rename dc/dcf/dd2/fd1 to dc/d26/d66/d7f/f116 0 2024-04-18T04:58:07.120 INFO:tasks.workunit.client.0.smithi096.stdout:3/854: link dc/d26/d48/dc2/l81 dc/dcf/l117 0 2024-04-18T04:58:07.121 INFO:tasks.workunit.client.0.smithi096.stdout:3/855: write dc/d26/d66/fb3 [4089766,26515] 0 2024-04-18T04:58:07.127 INFO:tasks.workunit.client.0.smithi096.stdout:3/856: dwrite dc/d26/d4a/ddf/fdb [0,4194304] 0 2024-04-18T04:58:07.131 INFO:tasks.workunit.client.0.smithi096.stdout:3/857: creat dc/d26/d66/f118 x:0 0 0 2024-04-18T04:58:07.132 INFO:tasks.workunit.client.0.smithi096.stdout:3/858: truncate dc/d26/d4a/faa 879082 0 2024-04-18T04:58:07.133 INFO:tasks.workunit.client.0.smithi096.stdout:3/859: write dc/d26/d48/ff2 [549612,64600] 0 2024-04-18T04:58:07.140 INFO:tasks.workunit.client.0.smithi096.stdout:3/860: link dc/dcf/dd2/cb0 dc/d26/d48/dc2/d29/c119 0 2024-04-18T04:58:07.144 INFO:tasks.workunit.client.0.smithi096.stdout:9/671: sync 2024-04-18T04:58:07.144 INFO:tasks.workunit.client.0.smithi096.stdout:0/530: sync 2024-04-18T04:58:07.147 INFO:tasks.workunit.client.0.smithi096.stdout:3/861: dwrite dc/d26/d48/dc2/d95/fa2 [0,4194304] 0 2024-04-18T04:58:07.152 INFO:tasks.workunit.client.0.smithi096.stdout:9/672: truncate d0/d41/f63 116005 0 2024-04-18T04:58:07.155 INFO:tasks.workunit.client.0.smithi096.stdout:3/862: rename dc/d26/d66/f69 to dc/d26/d48/dae/f11a 0 2024-04-18T04:58:07.157 INFO:tasks.workunit.client.0.smithi096.stdout:0/531: dread d16/d1d/f34 [0,4194304] 0 2024-04-18T04:58:07.159 INFO:tasks.workunit.client.0.smithi096.stdout:3/863: creat dc/d26/d57/f11b x:0 0 0 2024-04-18T04:58:07.160 INFO:tasks.workunit.client.0.smithi096.stdout:9/673: truncate d0/f11 2461214 0 2024-04-18T04:58:07.162 INFO:tasks.workunit.client.0.smithi096.stdout:2/893: sync 2024-04-18T04:58:07.162 INFO:tasks.workunit.client.0.smithi096.stdout:8/545: sync 2024-04-18T04:58:07.163 INFO:tasks.workunit.client.0.smithi096.stdout:8/546: dread - d0/d7/d24/d18/d7c/fa7 zero size 2024-04-18T04:58:07.164 INFO:tasks.workunit.client.0.smithi096.stdout:6/951: sync 2024-04-18T04:58:07.164 INFO:tasks.workunit.client.0.smithi096.stdout:1/678: sync 2024-04-18T04:58:07.164 INFO:tasks.workunit.client.0.smithi096.stdout:7/652: sync 2024-04-18T04:58:07.164 INFO:tasks.workunit.client.0.smithi096.stdout:5/565: sync 2024-04-18T04:58:07.164 INFO:tasks.workunit.client.0.smithi096.stdout:4/663: sync 2024-04-18T04:58:07.165 INFO:tasks.workunit.client.0.smithi096.stdout:9/674: unlink d0/de/d17/f2a 0 2024-04-18T04:58:07.165 INFO:tasks.workunit.client.0.smithi096.stdout:8/547: chown d0/f26 1519 1 2024-04-18T04:58:07.166 INFO:tasks.workunit.client.0.smithi096.stdout:1/679: write f6 [413040,73784] 0 2024-04-18T04:58:07.167 INFO:tasks.workunit.client.0.smithi096.stdout:3/864: dread dc/d5d/f8a [0,4194304] 0 2024-04-18T04:58:07.169 INFO:tasks.workunit.client.0.smithi096.stdout:5/566: symlink d7/d39/ld0 0 2024-04-18T04:58:07.172 INFO:tasks.workunit.client.0.smithi096.stdout:6/952: truncate d0/d6/d2b/d3b/d7d/fce 158285 0 2024-04-18T04:58:07.174 INFO:tasks.workunit.client.0.smithi096.stdout:0/532: dread d16/d1c/d22/d2c/f68 [0,4194304] 0 2024-04-18T04:58:07.176 INFO:tasks.workunit.client.0.smithi096.stdout:8/548: dread d0/f26 [0,4194304] 0 2024-04-18T04:58:07.177 INFO:tasks.workunit.client.0.smithi096.stdout:0/533: chown d16/d1c/d4c/d4e/f64 1383734 1 2024-04-18T04:58:07.179 INFO:tasks.workunit.client.0.smithi096.stdout:9/675: dread d0/de/d17/d56/d59/d60/f8a [0,4194304] 0 2024-04-18T04:58:07.179 INFO:tasks.workunit.client.0.smithi096.stdout:7/653: dread db/d1f/d5b/fb4 [0,4194304] 0 2024-04-18T04:58:07.180 INFO:tasks.workunit.client.0.smithi096.stdout:8/549: stat d0/d7/d24/d18/d27/laf 0 2024-04-18T04:58:07.181 INFO:tasks.workunit.client.0.smithi096.stdout:0/534: write d16/d1c/d4c/d4d/d5a/f83 [7649,81567] 0 2024-04-18T04:58:07.181 INFO:tasks.workunit.client.0.smithi096.stdout:4/664: symlink d4/d14/d2d/d44/d58/d86/d6f/dc5/lcf 0 2024-04-18T04:58:07.185 INFO:tasks.workunit.client.0.smithi096.stdout:6/953: dwrite d0/d6/d2b/d3b/dbb/fd0 [0,4194304] 0 2024-04-18T04:58:07.190 INFO:tasks.workunit.client.0.smithi096.stdout:1/680: link de/d1d/d3f/d7a/d96/fd2 de/d1d/d32/d8c/fd4 0 2024-04-18T04:58:07.191 INFO:tasks.workunit.client.0.smithi096.stdout:3/865: dread dc/f9d [0,4194304] 0 2024-04-18T04:58:07.192 INFO:tasks.workunit.client.0.smithi096.stdout:2/894: truncate df/d7a/fcc 1877480 0 2024-04-18T04:58:07.193 INFO:tasks.workunit.client.0.smithi096.stdout:2/895: chown df/d18/d24/d42/d3f/d4a/dbc/f102 96 1 2024-04-18T04:58:07.194 INFO:tasks.workunit.client.0.smithi096.stdout:8/550: creat d0/d3/fb0 x:0 0 0 2024-04-18T04:58:07.201 INFO:tasks.workunit.client.0.smithi096.stdout:0/535: creat d16/d1c/d4c/d4d/d36/f9a x:0 0 0 2024-04-18T04:58:07.202 INFO:tasks.workunit.client.0.smithi096.stdout:0/536: chown d16/f1b 4418488 1 2024-04-18T04:58:07.203 INFO:tasks.workunit.client.0.smithi096.stdout:7/654: dread db/d1f/d42/f59 [0,4194304] 0 2024-04-18T04:58:07.218 INFO:tasks.workunit.client.0.smithi096.stdout:1/681: write de/d1d/f4a [4456572,52304] 0 2024-04-18T04:58:07.242 INFO:tasks.workunit.client.0.smithi096.stdout:4/665: mkdir d4/d14/d2d/d44/d90/dd0 0 2024-04-18T04:58:07.243 INFO:tasks.workunit.client.0.smithi096.stdout:5/567: truncate d7/d25/d30/f99 1867524 0 2024-04-18T04:58:07.246 INFO:tasks.workunit.client.0.smithi096.stdout:0/537: creat d16/d1c/d4c/d4d/d36/f9b x:0 0 0 2024-04-18T04:58:07.247 INFO:tasks.workunit.client.0.smithi096.stdout:0/538: write d16/d1c/d4c/d4d/d5d/f97 [234413,108847] 0 2024-04-18T04:58:07.248 INFO:tasks.workunit.client.0.smithi096.stdout:7/655: unlink fa 0 2024-04-18T04:58:07.254 INFO:tasks.workunit.client.0.smithi096.stdout:6/954: dwrite d0/d6/d2b/d3b/d69/f5b [0,4194304] 0 2024-04-18T04:58:07.254 INFO:tasks.workunit.client.0.smithi096.stdout:1/682: mkdir de/d1d/d81/da7/dd5 0 2024-04-18T04:58:07.258 INFO:tasks.workunit.client.0.smithi096.stdout:5/568: write d7/dd/d8f/f44 [2481193,125920] 0 2024-04-18T04:58:07.259 INFO:tasks.workunit.client.0.smithi096.stdout:9/676: link d0/de/d17/d56/d59/d60/l70 d0/de/d17/d2f/d40/lda 0 2024-04-18T04:58:07.260 INFO:tasks.workunit.client.0.smithi096.stdout:0/539: chown d16/d1c/d4c/d6a/c72 16365 1 2024-04-18T04:58:07.263 INFO:tasks.workunit.client.0.smithi096.stdout:0/540: write d16/d1c/d4c/d4d/d5a/f94 [4574791,110690] 0 2024-04-18T04:58:07.263 INFO:tasks.workunit.client.0.smithi096.stdout:6/955: rmdir d0/da0/ddc 39 2024-04-18T04:58:07.265 INFO:tasks.workunit.client.0.smithi096.stdout:1/683: creat de/d1d/d32/d9a/dad/fd6 x:0 0 0 2024-04-18T04:58:07.266 INFO:tasks.workunit.client.0.smithi096.stdout:4/666: mkdir d4/d14/d2d/d44/dcb/dd1 0 2024-04-18T04:58:07.267 INFO:tasks.workunit.client.0.smithi096.stdout:4/667: chown d4/d14/d2d/d44/da2/cc0 44 1 2024-04-18T04:58:07.268 INFO:tasks.workunit.client.0.smithi096.stdout:5/569: creat d7/fd1 x:0 0 0 2024-04-18T04:58:07.273 INFO:tasks.workunit.client.0.smithi096.stdout:0/541: creat d16/d1c/f9c x:0 0 0 2024-04-18T04:58:07.274 INFO:tasks.workunit.client.0.smithi096.stdout:4/668: dwrite d4/d14/d16/f32 [0,4194304] 0 2024-04-18T04:58:07.275 INFO:tasks.workunit.client.0.smithi096.stdout:6/956: unlink d0/d6/d2e/f7c 0 2024-04-18T04:58:07.275 INFO:tasks.workunit.client.0.smithi096.stdout:4/669: write d4/d14/f6a [4759992,62081] 0 2024-04-18T04:58:07.276 INFO:tasks.workunit.client.0.smithi096.stdout:4/670: chown d4/d14/d1d/da5/d67 478 1 2024-04-18T04:58:07.276 INFO:tasks.workunit.client.0.smithi096.stdout:1/684: chown de/d1d/f66 27263 1 2024-04-18T04:58:07.280 INFO:tasks.workunit.client.0.smithi096.stdout:9/677: link d0/de/d17/d2f/d40/fd9 d0/de/d17/d2f/dd5/fdb 0 2024-04-18T04:58:07.288 INFO:tasks.workunit.client.0.smithi096.stdout:3/866: symlink dc/d26/d4a/l11c 0 2024-04-18T04:58:07.289 INFO:tasks.workunit.client.0.smithi096.stdout:1/685: creat de/d1d/d32/d9a/dad/fd7 x:0 0 0 2024-04-18T04:58:07.291 INFO:tasks.workunit.client.0.smithi096.stdout:5/570: creat d7/d39/d56/fd2 x:0 0 0 2024-04-18T04:58:07.294 INFO:tasks.workunit.client.0.smithi096.stdout:9/678: unlink d0/de/d17/d2f/d40/d8b/lba 0 2024-04-18T04:58:07.295 INFO:tasks.workunit.client.0.smithi096.stdout:6/957: fdatasync d0/d6/d2b/d3b/f40 0 2024-04-18T04:58:07.296 INFO:tasks.workunit.client.0.smithi096.stdout:6/958: write d0/d6/fc0 [2145035,53928] 0 2024-04-18T04:58:07.298 INFO:tasks.workunit.client.0.smithi096.stdout:3/867: rename dc/d26/d66/f118 to dc/d26/d48/dee/f11d 0 2024-04-18T04:58:07.303 INFO:tasks.workunit.client.0.smithi096.stdout:0/542: creat d16/d1c/d4c/d4e/f9d x:0 0 0 2024-04-18T04:58:07.305 INFO:tasks.workunit.client.0.smithi096.stdout:8/551: sync 2024-04-18T04:58:07.307 INFO:tasks.workunit.client.0.smithi096.stdout:8/552: write d0/d7/d24/d18/d5d/f5f [1066045,4417] 0 2024-04-18T04:58:07.310 INFO:tasks.workunit.client.0.smithi096.stdout:6/959: creat d0/d6/d5d/de6/f11e x:0 0 0 2024-04-18T04:58:07.312 INFO:tasks.workunit.client.0.smithi096.stdout:3/868: write dc/d26/d66/d7f/f116 [5705400,24268] 0 2024-04-18T04:58:07.312 INFO:tasks.workunit.client.0.smithi096.stdout:1/686: getdents de/d1d/d32/d73/d8b/dca 0 2024-04-18T04:58:07.314 INFO:tasks.workunit.client.0.smithi096.stdout:0/543: dwrite d16/f1b [0,4194304] 0 2024-04-18T04:58:07.316 INFO:tasks.workunit.client.0.smithi096.stdout:6/960: chown d0/d6/d2b/d3b/d69/d6c/d85/fa1 48 1 2024-04-18T04:58:07.316 INFO:tasks.workunit.client.0.smithi096.stdout:9/679: dwrite d0/de/d17/d2f/dd5/fdb [0,4194304] 0 2024-04-18T04:58:07.316 INFO:tasks.workunit.client.0.smithi096.stdout:0/544: readlink d16/d1c/l24 0 2024-04-18T04:58:07.316 INFO:tasks.workunit.client.0.smithi096.stdout:1/687: chown de/d1d/d32/fb5 692 1 2024-04-18T04:58:07.319 INFO:tasks.workunit.client.0.smithi096.stdout:8/553: creat d0/d7/d24/d18/d5d/fb1 x:0 0 0 2024-04-18T04:58:07.320 INFO:tasks.workunit.client.0.smithi096.stdout:6/961: truncate d0/d6/d2e/d7a/f10c 688162 0 2024-04-18T04:58:07.320 INFO:tasks.workunit.client.0.smithi096.stdout:8/554: write d0/d7/d24/d18/d5d/f5f [1911380,122937] 0 2024-04-18T04:58:07.321 INFO:tasks.workunit.client.0.smithi096.stdout:6/962: chown d0/d6/d2b/d3b/f40 48253797 1 2024-04-18T04:58:07.327 INFO:tasks.workunit.client.0.smithi096.stdout:9/680: creat d0/de/d17/d56/d59/d68/d96/fdc x:0 0 0 2024-04-18T04:58:07.328 INFO:tasks.workunit.client.0.smithi096.stdout:0/545: mknod d16/d1c/d4c/d4e/d67/c9e 0 2024-04-18T04:58:07.329 INFO:tasks.workunit.client.0.smithi096.stdout:9/681: dread - d0/de/d17/fbc zero size 2024-04-18T04:58:07.330 INFO:tasks.workunit.client.0.smithi096.stdout:0/546: chown d16/d1c/d22/d2c/f68 443179 1 2024-04-18T04:58:07.331 INFO:tasks.workunit.client.0.smithi096.stdout:6/963: dwrite d0/d6/d2b/d3b/d69/fba [0,4194304] 0 2024-04-18T04:58:07.332 INFO:tasks.workunit.client.0.smithi096.stdout:9/682: truncate d0/d52/f9d 4346115 0 2024-04-18T04:58:07.333 INFO:tasks.workunit.client.0.smithi096.stdout:6/964: readlink d0/d6/d2b/d3b/l23 0 2024-04-18T04:58:07.335 INFO:tasks.workunit.client.0.smithi096.stdout:0/547: mknod d16/d55/c9f 0 2024-04-18T04:58:07.336 INFO:tasks.workunit.client.0.smithi096.stdout:8/555: symlink d0/d7/d24/d35/d51/lb2 0 2024-04-18T04:58:07.337 INFO:tasks.workunit.client.0.smithi096.stdout:0/548: fdatasync d16/d1c/d4c/d4d/d5a/f70 0 2024-04-18T04:58:07.337 INFO:tasks.workunit.client.0.smithi096.stdout:8/556: readlink d0/d7/d24/d78/l66 0 2024-04-18T04:58:07.337 INFO:tasks.workunit.client.0.smithi096.stdout:3/869: creat dc/d26/d48/dc2/d29/f11e x:0 0 0 2024-04-18T04:58:07.338 INFO:tasks.workunit.client.0.smithi096.stdout:0/549: write d16/d1c/f8c [32340,31309] 0 2024-04-18T04:58:07.338 INFO:tasks.workunit.client.0.smithi096.stdout:8/557: stat d0/d7/d24/d18/f11 0 2024-04-18T04:58:07.339 INFO:tasks.workunit.client.0.smithi096.stdout:0/550: dread - d16/d1c/d4c/d4d/d36/f9a zero size 2024-04-18T04:58:07.339 INFO:tasks.workunit.client.0.smithi096.stdout:6/965: unlink d0/d4a/cf2 0 2024-04-18T04:58:07.342 INFO:tasks.workunit.client.0.smithi096.stdout:9/683: rename d0/c53 to d0/de/d17/d56/d6d/cdd 0 2024-04-18T04:58:07.344 INFO:tasks.workunit.client.0.smithi096.stdout:6/966: mknod d0/d73/c11f 0 2024-04-18T04:58:07.345 INFO:tasks.workunit.client.0.smithi096.stdout:3/870: dwrite dc/d26/d48/dc2/d95/de3/f103 [0,4194304] 0 2024-04-18T04:58:07.345 INFO:tasks.workunit.client.0.smithi096.stdout:7/656: write db/d1f/d24/d49/d54/f5d [376791,34743] 0 2024-04-18T04:58:07.347 INFO:tasks.workunit.client.0.smithi096.stdout:8/558: creat d0/d15/da9/fb3 x:0 0 0 2024-04-18T04:58:07.351 INFO:tasks.workunit.client.0.smithi096.stdout:9/684: mknod d0/de/d17/d2f/d40/dd2/cde 0 2024-04-18T04:58:07.352 INFO:tasks.workunit.client.0.smithi096.stdout:9/685: readlink d0/d52/la3 0 2024-04-18T04:58:07.353 INFO:tasks.workunit.client.0.smithi096.stdout:3/871: link dc/ffa dc/d26/d66/d7f/f11f 0 2024-04-18T04:58:07.356 INFO:tasks.workunit.client.0.smithi096.stdout:0/551: link d16/d1c/d4c/d4e/d67/c9e d16/d1c/d22/ca0 0 2024-04-18T04:58:07.356 INFO:tasks.workunit.client.0.smithi096.stdout:7/657: creat db/fd2 x:0 0 0 2024-04-18T04:58:07.357 INFO:tasks.workunit.client.0.smithi096.stdout:8/559: dwrite d0/d3/d32/d6b/fa3 [0,4194304] 0 2024-04-18T04:58:07.359 INFO:tasks.workunit.client.0.smithi096.stdout:8/560: readlink d0/d7/d24/d35/l4c 0 2024-04-18T04:58:07.360 INFO:tasks.workunit.client.0.smithi096.stdout:7/658: write db/d1f/f41 [938892,8990] 0 2024-04-18T04:58:07.360 INFO:tasks.workunit.client.0.smithi096.stdout:5/571: write d7/dd/d8f/d5e/f63 [747614,29664] 0 2024-04-18T04:58:07.365 INFO:tasks.workunit.client.0.smithi096.stdout:8/561: creat d0/d3/d32/fb4 x:0 0 0 2024-04-18T04:58:07.365 INFO:tasks.workunit.client.0.smithi096.stdout:2/896: chown df/f63 16601 1 2024-04-18T04:58:07.367 INFO:tasks.workunit.client.0.smithi096.stdout:9/686: dread d0/de/d17/d2f/d40/fb3 [0,4194304] 0 2024-04-18T04:58:07.368 INFO:tasks.workunit.client.0.smithi096.stdout:1/688: truncate de/d1d/f4a 1658398 0 2024-04-18T04:58:07.370 INFO:tasks.workunit.client.0.smithi096.stdout:3/872: dwrite dc/d26/d48/f9a [0,4194304] 0 2024-04-18T04:58:07.371 INFO:tasks.workunit.client.0.smithi096.stdout:7/659: chown db/d1f/c52 930 1 2024-04-18T04:58:07.371 INFO:tasks.workunit.client.0.smithi096.stdout:5/572: truncate d7/fc7 214079 0 2024-04-18T04:58:07.372 INFO:tasks.workunit.client.0.smithi096.stdout:0/552: rename d16/d1c/d4c/d4d/d36/f39 to d16/d1c/d4c/fa1 0 2024-04-18T04:58:07.374 INFO:tasks.workunit.client.0.smithi096.stdout:4/671: dwrite d4/d14/d16/fcd [0,4194304] 0 2024-04-18T04:58:07.378 INFO:tasks.workunit.client.0.smithi096.stdout:9/687: write d0/f4b [1240561,9578] 0 2024-04-18T04:58:07.378 INFO:tasks.workunit.client.0.smithi096.stdout:2/897: creat df/d18/d26/d48/d7b/f124 x:0 0 0 2024-04-18T04:58:07.378 INFO:tasks.workunit.client.0.smithi096.stdout:3/873: chown dc/d26/d48/dc2/d95/ff6 16744794 1 2024-04-18T04:58:07.379 INFO:tasks.workunit.client.0.smithi096.stdout:6/967: truncate d0/d6/d2b/f5e 866296 0 2024-04-18T04:58:07.380 INFO:tasks.workunit.client.0.smithi096.stdout:0/553: fdatasync d16/d1c/d4c/d4e/f64 0 2024-04-18T04:58:07.381 INFO:tasks.workunit.client.0.smithi096.stdout:0/554: fsync d16/d1c/f3c 0 2024-04-18T04:58:07.382 INFO:tasks.workunit.client.0.smithi096.stdout:1/689: rename de/d1d/c95 to de/d1d/d32/d73/d8b/dc2/cd8 0 2024-04-18T04:58:07.430 INFO:tasks.workunit.client.0.smithi096.stdout:2/898: dread df/d18/f109 [0,4194304] 0 2024-04-18T04:58:07.434 INFO:tasks.workunit.client.0.smithi096.stdout:6/968: unlink d0/d6/d2b/d3b/d69/d6c/l93 0 2024-04-18T04:58:07.436 INFO:tasks.workunit.client.0.smithi096.stdout:8/562: dread d0/f4d [0,4194304] 0 2024-04-18T04:58:07.437 INFO:tasks.workunit.client.0.smithi096.stdout:9/688: link d0/de/d17/d56/d59/d68/f83 d0/de/d99/fdf 0 2024-04-18T04:58:07.437 INFO:tasks.workunit.client.0.smithi096.stdout:7/660: dread db/d1f/d42/f5f [4194304,4194304] 0 2024-04-18T04:58:07.437 INFO:tasks.workunit.client.0.smithi096.stdout:1/690: creat de/d1d/d32/d9a/dad/dd3/fd9 x:0 0 0 2024-04-18T04:58:07.438 INFO:tasks.workunit.client.0.smithi096.stdout:2/899: mkdir df/d18/d26/d125 0 2024-04-18T04:58:07.441 INFO:tasks.workunit.client.0.smithi096.stdout:8/563: dread - d0/d7/d24/d18/d27/d60/fac zero size 2024-04-18T04:58:07.442 INFO:tasks.workunit.client.0.smithi096.stdout:1/691: mkdir de/d1d/d81/dda 0 2024-04-18T04:58:07.443 INFO:tasks.workunit.client.0.smithi096.stdout:5/573: dwrite d7/f4c [0,4194304] 0 2024-04-18T04:58:07.443 INFO:tasks.workunit.client.0.smithi096.stdout:0/555: dwrite d16/f42 [4194304,4194304] 0 2024-04-18T04:58:07.444 INFO:tasks.workunit.client.0.smithi096.stdout:6/969: rename d0/d6/d2e/d7a/ce8 to d0/d6/d2b/d3b/d7d/c120 0 2024-04-18T04:58:07.447 INFO:tasks.workunit.client.0.smithi096.stdout:7/661: truncate db/d1f/d42/f65 195474 0 2024-04-18T04:58:07.449 INFO:tasks.workunit.client.0.smithi096.stdout:1/692: creat de/fdb x:0 0 0 2024-04-18T04:58:07.450 INFO:tasks.workunit.client.0.smithi096.stdout:1/693: chown de/d1d/d3f/d7a 0 1 2024-04-18T04:58:07.450 INFO:tasks.workunit.client.0.smithi096.stdout:1/694: chown de/d1d/d32/c51 71164544 1 2024-04-18T04:58:07.452 INFO:tasks.workunit.client.0.smithi096.stdout:5/574: write d7/da3/d9a/fa5 [3720672,72955] 0 2024-04-18T04:58:07.458 INFO:tasks.workunit.client.0.smithi096.stdout:2/900: mknod df/d18/d26/d48/c126 0 2024-04-18T04:58:07.459 INFO:tasks.workunit.client.0.smithi096.stdout:2/901: stat df/d18/d26/d48 0 2024-04-18T04:58:07.460 INFO:tasks.workunit.client.0.smithi096.stdout:7/662: creat db/d20/d2f/d8d/da1/fd3 x:0 0 0 2024-04-18T04:58:07.462 INFO:tasks.workunit.client.0.smithi096.stdout:1/695: creat de/d1d/d32/d73/d8b/fdc x:0 0 0 2024-04-18T04:58:07.465 INFO:tasks.workunit.client.0.smithi096.stdout:1/696: write de/d1d/fab [605714,57492] 0 2024-04-18T04:58:07.467 INFO:tasks.workunit.client.0.smithi096.stdout:0/556: creat d16/fa2 x:0 0 0 2024-04-18T04:58:07.468 INFO:tasks.workunit.client.0.smithi096.stdout:5/575: creat d7/dd/d35/db1/fd3 x:0 0 0 2024-04-18T04:58:07.469 INFO:tasks.workunit.client.0.smithi096.stdout:7/663: dwrite db/d1f/d24/d61/fcd [0,4194304] 0 2024-04-18T04:58:07.469 INFO:tasks.workunit.client.0.smithi096.stdout:0/557: truncate d16/d1c/d4c/d4e/f64 594127 0 2024-04-18T04:58:07.470 INFO:tasks.workunit.client.0.smithi096.stdout:2/902: mkdir df/d18/d24/d42/d3f/d4a/df4/d127 0 2024-04-18T04:58:07.470 INFO:tasks.workunit.client.0.smithi096.stdout:5/576: write d7/d39/d56/fd2 [963792,114689] 0 2024-04-18T04:58:07.471 INFO:tasks.workunit.client.0.smithi096.stdout:2/903: readlink df/d18/d24/lcb 0 2024-04-18T04:58:07.471 INFO:tasks.workunit.client.0.smithi096.stdout:7/664: read db/d1f/f7d [2533290,96946] 0 2024-04-18T04:58:07.472 INFO:tasks.workunit.client.0.smithi096.stdout:1/697: creat de/d1d/d32/d8c/fdd x:0 0 0 2024-04-18T04:58:07.477 INFO:tasks.workunit.client.0.smithi096.stdout:0/558: mkdir d16/d1c/d4c/d6a/da3 0 2024-04-18T04:58:07.478 INFO:tasks.workunit.client.0.smithi096.stdout:0/559: chown d16/d1c/d22/d2c/c5c 1817022821 1 2024-04-18T04:58:07.480 INFO:tasks.workunit.client.0.smithi096.stdout:9/689: truncate d0/de/f86 409864 0 2024-04-18T04:58:07.483 INFO:tasks.workunit.client.0.smithi096.stdout:6/970: dwrite d0/d6/f34 [0,4194304] 0 2024-04-18T04:58:07.484 INFO:tasks.workunit.client.0.smithi096.stdout:6/971: chown d0/d6/d29/f42 10985987 1 2024-04-18T04:58:07.484 INFO:tasks.workunit.client.0.smithi096.stdout:2/904: mknod df/d18/d24/d42/d3f/d4a/d113/c128 0 2024-04-18T04:58:07.485 INFO:tasks.workunit.client.0.smithi096.stdout:0/560: creat d16/d1c/d4c/d4e/d67/fa4 x:0 0 0 2024-04-18T04:58:07.486 INFO:tasks.workunit.client.0.smithi096.stdout:7/665: mkdir db/d1f/d24/d49/dd4 0 2024-04-18T04:58:07.486 INFO:tasks.workunit.client.0.smithi096.stdout:6/972: write d0/d6/d2b/d3b/d69/f5b [1282765,77493] 0 2024-04-18T04:58:07.488 INFO:tasks.workunit.client.0.smithi096.stdout:9/690: creat d0/de/d17/d2f/dd5/fe0 x:0 0 0 2024-04-18T04:58:07.489 INFO:tasks.workunit.client.0.smithi096.stdout:6/973: write d0/d6/d2b/d3b/d7d/fce [822756,32959] 0 2024-04-18T04:58:07.492 INFO:tasks.workunit.client.0.smithi096.stdout:1/698: creat de/d1d/d3f/d5f/dc7/fde x:0 0 0 2024-04-18T04:58:07.495 INFO:tasks.workunit.client.0.smithi096.stdout:2/905: dwrite df/d7a/d11e/ffe [0,4194304] 0 2024-04-18T04:58:07.495 INFO:tasks.workunit.client.0.smithi096.stdout:7/666: mkdir db/dd5 0 2024-04-18T04:58:07.497 INFO:tasks.workunit.client.0.smithi096.stdout:5/577: rename d7/dd/d8f/d5e/f63 to d7/d25/d30/fd4 0 2024-04-18T04:58:07.498 INFO:tasks.workunit.client.0.smithi096.stdout:0/561: dwrite d16/d1c/d4c/d4e/f9d [0,4194304] 0 2024-04-18T04:58:07.500 INFO:tasks.workunit.client.0.smithi096.stdout:6/974: mknod d0/d6/d2b/d3b/d69/d66/dcf/c121 0 2024-04-18T04:58:07.503 INFO:tasks.workunit.client.0.smithi096.stdout:7/667: unlink db/d20/f35 0 2024-04-18T04:58:07.504 INFO:tasks.workunit.client.0.smithi096.stdout:5/578: mkdir d7/d39/d36/dd5 0 2024-04-18T04:58:07.506 INFO:tasks.workunit.client.0.smithi096.stdout:9/691: dwrite d0/de/d17/d56/d59/d68/d96/fdc [0,4194304] 0 2024-04-18T04:58:07.507 INFO:tasks.workunit.client.0.smithi096.stdout:9/692: chown d0/de/d17/d56/d59/d68/dab/d3a/f8f 79245 1 2024-04-18T04:58:07.507 INFO:tasks.workunit.client.0.smithi096.stdout:2/906: rename df/d18/d26/d48/d7b/cd3 to df/d18/d24/d42/d101/c129 0 2024-04-18T04:58:07.512 INFO:tasks.workunit.client.0.smithi096.stdout:6/975: mkdir d0/d6/d2b/d3b/d69/d6c/d85/d122 0 2024-04-18T04:58:07.516 INFO:tasks.workunit.client.0.smithi096.stdout:0/562: rename c13 to d16/d1c/d4c/d4d/d36/ca5 0 2024-04-18T04:58:07.517 INFO:tasks.workunit.client.0.smithi096.stdout:2/907: fsync df/d18/d26/f47 0 2024-04-18T04:58:07.517 INFO:tasks.workunit.client.0.smithi096.stdout:9/693: dread d0/d41/fb1 [0,4194304] 0 2024-04-18T04:58:07.519 INFO:tasks.workunit.client.0.smithi096.stdout:1/699: getdents de/d1d/d32/d8c 0 2024-04-18T04:58:07.520 INFO:tasks.workunit.client.0.smithi096.stdout:1/700: write de/d1d/d32/d6b/f9d [333013,65496] 0 2024-04-18T04:58:07.521 INFO:tasks.workunit.client.0.smithi096.stdout:0/563: symlink d16/d1d/d3b/la6 0 2024-04-18T04:58:07.522 INFO:tasks.workunit.client.0.smithi096.stdout:2/908: creat df/d18/d71/f12a x:0 0 0 2024-04-18T04:58:07.523 INFO:tasks.workunit.client.0.smithi096.stdout:2/909: readlink df/d18/l6d 0 2024-04-18T04:58:07.525 INFO:tasks.workunit.client.0.smithi096.stdout:1/701: creat de/d1d/d32/d6b/fdf x:0 0 0 2024-04-18T04:58:07.526 INFO:tasks.workunit.client.0.smithi096.stdout:9/694: dwrite d0/de/f7b [0,4194304] 0 2024-04-18T04:58:07.526 INFO:tasks.workunit.client.0.smithi096.stdout:5/579: getdents d7/d39/d52 0 2024-04-18T04:58:07.529 INFO:tasks.workunit.client.0.smithi096.stdout:6/976: rename d0/da0/l117 to d0/d6/d2b/d3b/l123 0 2024-04-18T04:58:07.529 INFO:tasks.workunit.client.0.smithi096.stdout:2/910: creat df/d18/d99/f12b x:0 0 0 2024-04-18T04:58:07.530 INFO:tasks.workunit.client.0.smithi096.stdout:1/702: symlink de/d1d/d3f/d5f/le0 0 2024-04-18T04:58:07.530 INFO:tasks.workunit.client.0.smithi096.stdout:0/564: rmdir d16/d1c/d22/d2c/d81 0 2024-04-18T04:58:07.532 INFO:tasks.workunit.client.0.smithi096.stdout:2/911: dread - df/d18/d24/d42/d6e/f11f zero size 2024-04-18T04:58:07.533 INFO:tasks.workunit.client.0.smithi096.stdout:7/668: dwrite db/f2a [0,4194304] 0 2024-04-18T04:58:07.535 INFO:tasks.workunit.client.0.smithi096.stdout:9/695: rename d0/de/d17/d56/d59/d68/d96 to d0/de/d17/d2f/d40/d8b/de1 0 2024-04-18T04:58:07.539 INFO:tasks.workunit.client.0.smithi096.stdout:0/565: rename d16/f26 to d16/d55/fa7 0 2024-04-18T04:58:07.539 INFO:tasks.workunit.client.0.smithi096.stdout:5/580: dwrite d7/d25/f91 [0,4194304] 0 2024-04-18T04:58:07.541 INFO:tasks.workunit.client.0.smithi096.stdout:2/912: mknod df/d18/d24/d42/d3f/d4a/dbc/c12c 0 2024-04-18T04:58:07.541 INFO:tasks.workunit.client.0.smithi096.stdout:0/566: write d16/d1c/f88 [57233,112271] 0 2024-04-18T04:58:07.542 INFO:tasks.workunit.client.0.smithi096.stdout:5/581: dread - d7/dd/d35/db1/fb8 zero size 2024-04-18T04:58:07.543 INFO:tasks.workunit.client.0.smithi096.stdout:7/669: mkdir db/d20/d45/dcf/dd6 0 2024-04-18T04:58:07.543 INFO:tasks.workunit.client.0.smithi096.stdout:6/977: dread d0/d6/d29/f42 [0,4194304] 0 2024-04-18T04:58:07.547 INFO:tasks.workunit.client.0.smithi096.stdout:2/913: rmdir df/d18/d24/d42/d3f/d4a 39 2024-04-18T04:58:07.548 INFO:tasks.workunit.client.0.smithi096.stdout:2/914: chown fd 6697 1 2024-04-18T04:58:07.550 INFO:tasks.workunit.client.0.smithi096.stdout:5/582: mknod d7/d25/cd6 0 2024-04-18T04:58:07.550 INFO:tasks.workunit.client.0.smithi096.stdout:2/915: write df/d7a/d11e/ffe [1069790,23895] 0 2024-04-18T04:58:07.553 INFO:tasks.workunit.client.0.smithi096.stdout:9/696: truncate d0/de/d17/d2f/d40/fd9 434829 0 2024-04-18T04:58:07.553 INFO:tasks.workunit.client.0.smithi096.stdout:5/583: read - d7/dcd/fce zero size 2024-04-18T04:58:07.554 INFO:tasks.workunit.client.0.smithi096.stdout:7/670: dwrite db/f3f [4194304,4194304] 0 2024-04-18T04:58:07.555 INFO:tasks.workunit.client.0.smithi096.stdout:6/978: link d0/d6/d2b/d3b/d69/c4f d0/d6/d5d/ddd/c124 0 2024-04-18T04:58:07.556 INFO:tasks.workunit.client.0.smithi096.stdout:2/916: creat df/d7d/d105/d121/f12d x:0 0 0 2024-04-18T04:58:07.556 INFO:tasks.workunit.client.0.smithi096.stdout:5/584: mknod d7/d39/cd7 0 2024-04-18T04:58:07.556 INFO:tasks.workunit.client.0.smithi096.stdout:9/697: dread - d0/de/d17/d2f/fcd zero size 2024-04-18T04:58:07.557 INFO:tasks.workunit.client.0.smithi096.stdout:0/567: dread d16/d1c/d4c/d4d/d5d/d8f/f86 [0,4194304] 0 2024-04-18T04:58:07.559 INFO:tasks.workunit.client.0.smithi096.stdout:6/979: creat d0/d6/d2b/d3b/dfa/f125 x:0 0 0 2024-04-18T04:58:07.560 INFO:tasks.workunit.client.0.smithi096.stdout:5/585: creat d7/d25/d2b/fd8 x:0 0 0 2024-04-18T04:58:07.561 INFO:tasks.workunit.client.0.smithi096.stdout:9/698: chown d0/de/d17/d2f/d40/l79 4496059 1 2024-04-18T04:58:07.561 INFO:tasks.workunit.client.0.smithi096.stdout:0/568: creat d16/d1c/d4c/d4d/d5d/d91/fa8 x:0 0 0 2024-04-18T04:58:07.562 INFO:tasks.workunit.client.0.smithi096.stdout:2/917: dread df/d18/d24/faf [0,4194304] 0 2024-04-18T04:58:07.563 INFO:tasks.workunit.client.0.smithi096.stdout:2/918: readlink df/d7d/l81 0 2024-04-18T04:58:07.565 INFO:tasks.workunit.client.0.smithi096.stdout:6/980: dread d0/d6/d29/f42 [0,4194304] 0 2024-04-18T04:58:07.566 INFO:tasks.workunit.client.0.smithi096.stdout:7/671: rename db/d1f/d5b/d6a/d74/c9b to db/cd7 0 2024-04-18T04:58:07.567 INFO:tasks.workunit.client.0.smithi096.stdout:7/672: write db/d1f/d24/d61/f80 [492575,18661] 0 2024-04-18T04:58:07.567 INFO:tasks.workunit.client.0.smithi096.stdout:0/569: creat d16/d1d/d3b/fa9 x:0 0 0 2024-04-18T04:58:07.569 INFO:tasks.workunit.client.0.smithi096.stdout:2/919: rmdir df/d7a 39 2024-04-18T04:58:07.569 INFO:tasks.workunit.client.0.smithi096.stdout:9/699: rmdir d0 39 2024-04-18T04:58:07.570 INFO:tasks.workunit.client.0.smithi096.stdout:6/981: mknod d0/d4a/c126 0 2024-04-18T04:58:07.573 INFO:tasks.workunit.client.0.smithi096.stdout:0/570: rename d16/d1c/d22/d2c/f4b to d16/d1c/d4c/d4d/d5d/d8f/faa 0 2024-04-18T04:58:07.576 INFO:tasks.workunit.client.0.smithi096.stdout:6/982: unlink d0/d6/d5d/f91 0 2024-04-18T04:58:07.576 INFO:tasks.workunit.client.0.smithi096.stdout:5/586: link d7/d3b/d95/cc4 d7/dd/d35/d74/cd9 0 2024-04-18T04:58:07.578 INFO:tasks.workunit.client.0.smithi096.stdout:9/700: rmdir d0/de/d17/d2f 39 2024-04-18T04:58:07.581 INFO:tasks.workunit.client.0.smithi096.stdout:0/571: rename d16/d1c/d4c/d4d/d5a/f94 to d16/d1c/d4c/d4e/d67/fab 0 2024-04-18T04:58:07.581 INFO:tasks.workunit.client.0.smithi096.stdout:6/983: mknod d0/d6/d2b/d3b/df3/c127 0 2024-04-18T04:58:07.582 INFO:tasks.workunit.client.0.smithi096.stdout:6/984: write d0/d4a/f110 [198828,26381] 0 2024-04-18T04:58:07.586 INFO:tasks.workunit.client.0.smithi096.stdout:0/572: creat d16/d1c/d4c/d4d/d5d/d8f/fac x:0 0 0 2024-04-18T04:58:07.587 INFO:tasks.workunit.client.0.smithi096.stdout:2/920: write df/d18/d24/d42/d3f/f43 [300833,5124] 0 2024-04-18T04:58:07.588 INFO:tasks.workunit.client.0.smithi096.stdout:9/701: rename d0/d52/d5a/fc0 to d0/de/d17/d2f/d40/dd2/fe2 0 2024-04-18T04:58:07.590 INFO:tasks.workunit.client.0.smithi096.stdout:6/985: dwrite d0/d6/d2b/d3b/d69/d66/dcf/dd5/fdb [0,4194304] 0 2024-04-18T04:58:07.591 INFO:tasks.workunit.client.0.smithi096.stdout:0/573: rename d16/d1c/d4c/d4d/d36/f9a to d16/d1c/d4c/d6a/fad 0 2024-04-18T04:58:07.591 INFO:tasks.workunit.client.0.smithi096.stdout:5/587: link d7/c8 d7/d25/cda 0 2024-04-18T04:58:07.592 INFO:tasks.workunit.client.0.smithi096.stdout:2/921: symlink df/d7a/d11e/l12e 0 2024-04-18T04:58:07.593 INFO:tasks.workunit.client.0.smithi096.stdout:9/702: rename d0/d6b/d89/cd4 to d0/de/d17/d2f/d40/d8b/ce3 0 2024-04-18T04:58:07.593 INFO:tasks.workunit.client.0.smithi096.stdout:0/574: fdatasync d16/d1c/d22/d2c/f90 0 2024-04-18T04:58:07.595 INFO:tasks.workunit.client.0.smithi096.stdout:6/986: chown d0/d6/d2b/d3b/d69/d66/dcf/c121 479043 1 2024-04-18T04:58:07.596 INFO:tasks.workunit.client.0.smithi096.stdout:6/987: read d0/d6/d2e/fd2 [191221,61172] 0 2024-04-18T04:58:07.598 INFO:tasks.workunit.client.0.smithi096.stdout:9/703: dread d0/de/d17/d56/d59/d60/fcf [0,4194304] 0 2024-04-18T04:58:07.600 INFO:tasks.workunit.client.0.smithi096.stdout:6/988: symlink d0/l128 0 2024-04-18T04:58:07.601 INFO:tasks.workunit.client.0.smithi096.stdout:5/588: dread d7/d39/f70 [0,4194304] 0 2024-04-18T04:58:07.602 INFO:tasks.workunit.client.0.smithi096.stdout:9/704: rename d0/de/d17/d2f/d40/d8b/de1/fa1 to d0/d6b/d89/fe4 0 2024-04-18T04:58:07.603 INFO:tasks.workunit.client.0.smithi096.stdout:5/589: stat d7/f3c 0 2024-04-18T04:58:07.603 INFO:tasks.workunit.client.0.smithi096.stdout:9/705: chown d0/de/d17/fc5 133458659 1 2024-04-18T04:58:07.605 INFO:tasks.workunit.client.0.smithi096.stdout:9/706: readlink d0/de/d17/d56/d59/d68/dab/d3a/l91 0 2024-04-18T04:58:07.605 INFO:tasks.workunit.client.0.smithi096.stdout:9/707: chown d0/f28 26587150 1 2024-04-18T04:58:07.605 INFO:tasks.workunit.client.0.smithi096.stdout:5/590: creat d7/d25/d7c/fdb x:0 0 0 2024-04-18T04:58:07.608 INFO:tasks.workunit.client.0.smithi096.stdout:9/708: unlink d0/d41/lae 0 2024-04-18T04:58:07.609 INFO:tasks.workunit.client.0.smithi096.stdout:2/922: dread df/d18/f38 [0,4194304] 0 2024-04-18T04:58:07.610 INFO:tasks.workunit.client.0.smithi096.stdout:5/591: symlink d7/dd/ldc 0 2024-04-18T04:58:07.611 INFO:tasks.workunit.client.0.smithi096.stdout:9/709: readlink d0/de/d17/d2f/d40/lda 0 2024-04-18T04:58:07.612 INFO:tasks.workunit.client.0.smithi096.stdout:5/592: write d7/d25/f28 [2254439,116038] 0 2024-04-18T04:58:07.613 INFO:tasks.workunit.client.0.smithi096.stdout:0/575: dread d16/d1c/f65 [0,4194304] 0 2024-04-18T04:58:07.613 INFO:tasks.workunit.client.0.smithi096.stdout:2/923: fdatasync df/f20 0 2024-04-18T04:58:07.613 INFO:tasks.workunit.client.0.smithi096.stdout:9/710: fsync d0/de/d17/d56/d59/d60/f8a 0 2024-04-18T04:58:07.614 INFO:tasks.workunit.client.0.smithi096.stdout:0/576: dread - d16/d1c/f9c zero size 2024-04-18T04:58:07.616 INFO:tasks.workunit.client.0.smithi096.stdout:2/924: symlink df/d7a/l12f 0 2024-04-18T04:58:07.619 INFO:tasks.workunit.client.0.smithi096.stdout:2/925: readlink df/d18/d24/d42/d3f/d4a/dbc/lfc 0 2024-04-18T04:58:07.621 INFO:tasks.workunit.client.0.smithi096.stdout:0/577: creat d16/d1c/d4c/d4e/fae x:0 0 0 2024-04-18T04:58:07.624 INFO:tasks.workunit.client.0.smithi096.stdout:0/578: symlink d16/d1c/d22/d2c/laf 0 2024-04-18T04:58:07.626 INFO:tasks.workunit.client.0.smithi096.stdout:0/579: creat d16/d55/fb0 x:0 0 0 2024-04-18T04:58:07.630 INFO:tasks.workunit.client.0.smithi096.stdout:2/926: truncate df/d7a/f9d 167383 0 2024-04-18T04:58:07.632 INFO:tasks.workunit.client.0.smithi096.stdout:2/927: fdatasync df/d18/d24/d42/dd9/f123 0 2024-04-18T04:58:07.633 INFO:tasks.workunit.client.0.smithi096.stdout:4/672: sync 2024-04-18T04:58:07.637 INFO:tasks.workunit.client.0.smithi096.stdout:5/593: dwrite d7/d39/f50 [0,4194304] 0 2024-04-18T04:58:07.637 INFO:tasks.workunit.client.0.smithi096.stdout:9/711: dwrite d0/de/d17/d56/d59/d68/f8e [0,4194304] 0 2024-04-18T04:58:07.638 INFO:tasks.workunit.client.0.smithi096.stdout:2/928: symlink df/d18/d24/d42/d3f/d4a/dbc/d104/l130 0 2024-04-18T04:58:07.641 INFO:tasks.workunit.client.0.smithi096.stdout:0/580: dread fd [0,4194304] 0 2024-04-18T04:58:07.645 INFO:tasks.workunit.client.0.smithi096.stdout:5/594: dread d7/dd/d35/fbc [0,4194304] 0 2024-04-18T04:58:07.645 INFO:tasks.workunit.client.0.smithi096.stdout:2/929: creat df/d18/d24/d42/d3f/d4a/dbc/f131 x:0 0 0 2024-04-18T04:58:07.647 INFO:tasks.workunit.client.0.smithi096.stdout:0/581: symlink d16/d1c/d4c/d4d/d5d/lb1 0 2024-04-18T04:58:07.649 INFO:tasks.workunit.client.0.smithi096.stdout:5/595: mkdir d7/d39/d56/ddd 0 2024-04-18T04:58:07.652 INFO:tasks.workunit.client.0.smithi096.stdout:9/712: truncate d0/de/d17/d56/d59/d68/f8e 830432 0 2024-04-18T04:58:07.654 INFO:tasks.workunit.client.0.smithi096.stdout:0/582: symlink d16/d1c/d4c/d4d/lb2 0 2024-04-18T04:58:07.654 INFO:tasks.workunit.client.0.smithi096.stdout:5/596: symlink d7/dd/lde 0 2024-04-18T04:58:07.655 INFO:tasks.workunit.client.0.smithi096.stdout:4/673: dread d4/d14/d1d/da5/f9d [0,4194304] 0 2024-04-18T04:58:07.655 INFO:tasks.workunit.client.0.smithi096.stdout:9/713: mknod d0/de/d17/d56/d59/d68/dab/d33/ce5 0 2024-04-18T04:58:07.657 INFO:tasks.workunit.client.0.smithi096.stdout:5/597: mknod d7/d3b/cdf 0 2024-04-18T04:58:07.658 INFO:tasks.workunit.client.0.smithi096.stdout:5/598: fdatasync d7/d39/d52/f65 0 2024-04-18T04:58:07.659 INFO:tasks.workunit.client.0.smithi096.stdout:2/930: truncate df/d18/d71/d9c/fd7 1169747 0 2024-04-18T04:58:07.659 INFO:tasks.workunit.client.0.smithi096.stdout:4/674: write d4/d14/d2d/d44/d58/fcc [4480540,93087] 0 2024-04-18T04:58:07.660 INFO:tasks.workunit.client.0.smithi096.stdout:9/714: rename d0/d6b/d89/fe4 to d0/de/d17/d56/d59/fe6 0 2024-04-18T04:58:07.661 INFO:tasks.workunit.client.0.smithi096.stdout:9/715: stat d0/de/d17/f97 0 2024-04-18T04:58:07.663 INFO:tasks.workunit.client.0.smithi096.stdout:4/675: write d4/d14/d2d/d44/d58/d86/d3a/d39/fab [236782,20118] 0 2024-04-18T04:58:07.663 INFO:tasks.workunit.client.0.smithi096.stdout:5/599: creat d7/da3/d9a/fe0 x:0 0 0 2024-04-18T04:58:07.663 INFO:tasks.workunit.client.0.smithi096.stdout:0/583: link d16/d1c/d4c/d6a/l82 d16/d1c/d4c/d4e/d67/lb3 0 2024-04-18T04:58:07.665 INFO:tasks.workunit.client.0.smithi096.stdout:9/716: rmdir d0/de/d17/d56/d59/d68/dab 39 2024-04-18T04:58:07.668 INFO:tasks.workunit.client.0.smithi096.stdout:0/584: creat d16/d1c/d4c/d4e/d67/fb4 x:0 0 0 2024-04-18T04:58:07.669 INFO:tasks.workunit.client.0.smithi096.stdout:4/676: mkdir d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/dd2 0 2024-04-18T04:58:07.674 INFO:tasks.workunit.client.0.smithi096.stdout:0/585: rmdir d16/d55 39 2024-04-18T04:58:07.674 INFO:tasks.workunit.client.0.smithi096.stdout:9/717: dwrite d0/de/d17/d2f/dd5/fe0 [0,4194304] 0 2024-04-18T04:58:07.674 INFO:tasks.workunit.client.0.smithi096.stdout:2/931: truncate df/d18/d71/fc4 306965 0 2024-04-18T04:58:07.677 INFO:tasks.workunit.client.0.smithi096.stdout:9/718: unlink d0/de/d17/d2f/dd5/fe0 0 2024-04-18T04:58:07.677 INFO:tasks.workunit.client.0.smithi096.stdout:5/600: write d7/d25/d30/f33 [3682857,11561] 0 2024-04-18T04:58:07.677 INFO:tasks.workunit.client.0.smithi096.stdout:2/932: dread df/d7a/fc8 [0,4194304] 0 2024-04-18T04:58:07.680 INFO:tasks.workunit.client.0.smithi096.stdout:4/677: getdents d4/d7a 0 2024-04-18T04:58:07.682 INFO:tasks.workunit.client.0.smithi096.stdout:5/601: rename d7/d39/d78/db5 to d7/d39/d36/de1 0 2024-04-18T04:58:07.685 INFO:tasks.workunit.client.0.smithi096.stdout:4/678: mknod d4/d14/d2d/d44/d58/d86/d6f/dc5/cd3 0 2024-04-18T04:58:07.686 INFO:tasks.workunit.client.0.smithi096.stdout:5/602: mkdir d7/dd/d8f/da2/de2 0 2024-04-18T04:58:07.687 INFO:tasks.workunit.client.0.smithi096.stdout:9/719: symlink d0/de/d17/d56/d59/d68/dab/d3a/le7 0 2024-04-18T04:58:07.688 INFO:tasks.workunit.client.0.smithi096.stdout:9/720: chown d0/de/d99/fdf 13592 1 2024-04-18T04:58:07.689 INFO:tasks.workunit.client.0.smithi096.stdout:0/586: dread d16/d1c/d22/d2c/f30 [0,4194304] 0 2024-04-18T04:58:07.690 INFO:tasks.workunit.client.0.smithi096.stdout:2/933: link df/d18/d24/d42/l68 df/d18/d24/d42/d3f/d4a/d113/l132 0 2024-04-18T04:58:07.692 INFO:tasks.workunit.client.0.smithi096.stdout:9/721: truncate d0/de/f62 3698381 0 2024-04-18T04:58:07.693 INFO:tasks.workunit.client.0.smithi096.stdout:0/587: symlink d16/d1c/d4c/d4e/lb5 0 2024-04-18T04:58:07.694 INFO:tasks.workunit.client.0.smithi096.stdout:2/934: mknod df/d18/d71/d9c/db6/df6/c133 0 2024-04-18T04:58:07.696 INFO:tasks.workunit.client.0.smithi096.stdout:5/603: dwrite d7/d39/f50 [0,4194304] 0 2024-04-18T04:58:07.696 INFO:tasks.workunit.client.0.smithi096.stdout:2/935: chown df/d18/d26/d48/c10b 76997182 1 2024-04-18T04:58:07.697 INFO:tasks.workunit.client.0.smithi096.stdout:0/588: dread d16/d1d/f25 [4194304,4194304] 0 2024-04-18T04:58:07.699 INFO:tasks.workunit.client.0.smithi096.stdout:0/589: chown d16/d1c/f6d 23982 1 2024-04-18T04:58:07.701 INFO:tasks.workunit.client.0.smithi096.stdout:5/604: rename d7/d39 to d7/dd/d8f/da2/de2/de3 0 2024-04-18T04:58:07.701 INFO:tasks.workunit.client.0.smithi096.stdout:9/722: dread d0/d52/d5a/f76 [0,4194304] 0 2024-04-18T04:58:07.701 INFO:tasks.workunit.client.0.smithi096.stdout:4/679: dread d4/d14/f6a [0,4194304] 0 2024-04-18T04:58:07.704 INFO:tasks.workunit.client.0.smithi096.stdout:2/936: rename df/d18/d24/d42/d3f/d4a/fb2 to df/d18/d71/d75/f134 0 2024-04-18T04:58:07.706 INFO:tasks.workunit.client.0.smithi096.stdout:0/590: symlink d16/d1c/d4c/d4e/d67/lb6 0 2024-04-18T04:58:07.708 INFO:tasks.workunit.client.0.smithi096.stdout:5/605: creat d7/d3b/d95/fe4 x:0 0 0 2024-04-18T04:58:07.709 INFO:tasks.workunit.client.0.smithi096.stdout:5/606: write d7/d25/f91 [276554,71346] 0 2024-04-18T04:58:07.709 INFO:tasks.workunit.client.0.smithi096.stdout:2/937: creat df/d18/d26/d48/d7b/f135 x:0 0 0 2024-04-18T04:58:07.713 INFO:tasks.workunit.client.0.smithi096.stdout:4/680: symlink d4/ld4 0 2024-04-18T04:58:07.715 INFO:tasks.workunit.client.0.smithi096.stdout:2/938: symlink df/d18/d24/d42/d3f/d4a/dbc/d104/l136 0 2024-04-18T04:58:07.715 INFO:tasks.workunit.client.0.smithi096.stdout:2/939: fsync df/d18/f89 0 2024-04-18T04:58:07.717 INFO:tasks.workunit.client.0.smithi096.stdout:4/681: mknod d4/d14/d2d/d44/d89/cd5 0 2024-04-18T04:58:07.718 INFO:tasks.workunit.client.0.smithi096.stdout:9/723: dread d0/de/d17/d5c/f7c [0,4194304] 0 2024-04-18T04:58:07.718 INFO:tasks.workunit.client.0.smithi096.stdout:5/607: dread d7/d3b/fcf [0,4194304] 0 2024-04-18T04:58:07.719 INFO:tasks.workunit.client.0.smithi096.stdout:0/591: rename d16/d1c/d4c/d4e/f64 to d16/d1c/d4c/d4d/fb7 0 2024-04-18T04:58:07.720 INFO:tasks.workunit.client.0.smithi096.stdout:0/592: write d16/d1c/d4c/d4d/d5a/f83 [533639,17752] 0 2024-04-18T04:58:07.723 INFO:tasks.workunit.client.0.smithi096.stdout:2/940: mkdir df/d18/d26/d137 0 2024-04-18T04:58:07.724 INFO:tasks.workunit.client.0.smithi096.stdout:5/608: symlink d7/dd/d35/le5 0 2024-04-18T04:58:07.724 INFO:tasks.workunit.client.0.smithi096.stdout:2/941: chown df/d7a/d11e/fef 4513 1 2024-04-18T04:58:07.724 INFO:tasks.workunit.client.0.smithi096.stdout:9/724: fdatasync d0/de/d17/d56/d6d/f7f 0 2024-04-18T04:58:07.726 INFO:tasks.workunit.client.0.smithi096.stdout:0/593: mkdir d16/d1c/d22/db8 0 2024-04-18T04:58:07.727 INFO:tasks.workunit.client.0.smithi096.stdout:4/682: dwrite d4/d14/d2d/d44/d58/d86/d3a/d47/f94 [0,4194304] 0 2024-04-18T04:58:07.730 INFO:tasks.workunit.client.0.smithi096.stdout:9/725: readlink d0/d52/lbb 0 2024-04-18T04:58:07.730 INFO:tasks.workunit.client.0.smithi096.stdout:2/942: creat df/d18/d26/d48/d7b/d10e/f138 x:0 0 0 2024-04-18T04:58:07.730 INFO:tasks.workunit.client.0.smithi096.stdout:0/594: fsync d16/d1d/d3b/f46 0 2024-04-18T04:58:07.732 INFO:tasks.workunit.client.0.smithi096.stdout:9/726: readlink d0/d41/l80 0 2024-04-18T04:58:07.732 INFO:tasks.workunit.client.0.smithi096.stdout:2/943: symlink df/d18/d71/d9c/l139 0 2024-04-18T04:58:07.733 INFO:tasks.workunit.client.0.smithi096.stdout:5/609: getdents d7/d25/d58 0 2024-04-18T04:58:07.735 INFO:tasks.workunit.client.0.smithi096.stdout:2/944: stat df/d18/d24/dd1 0 2024-04-18T04:58:07.735 INFO:tasks.workunit.client.0.smithi096.stdout:9/727: read d0/de/d17/f3f [59010,62094] 0 2024-04-18T04:58:07.736 INFO:tasks.workunit.client.0.smithi096.stdout:4/683: dwrite d4/d14/d2d/d44/d58/f88 [0,4194304] 0 2024-04-18T04:58:07.744 INFO:tasks.workunit.client.0.smithi096.stdout:9/728: rmdir d0/de/d17/d56/d59/d60 39 2024-04-18T04:58:07.744 INFO:tasks.workunit.client.0.smithi096.stdout:2/945: mknod df/d18/d26/d48/c13a 0 2024-04-18T04:58:07.744 INFO:tasks.workunit.client.0.smithi096.stdout:9/729: symlink d0/de/d17/d2f/dd5/le8 0 2024-04-18T04:58:07.745 INFO:tasks.workunit.client.0.smithi096.stdout:2/946: creat df/d18/d26/f13b x:0 0 0 2024-04-18T04:58:07.745 INFO:tasks.workunit.client.0.smithi096.stdout:9/730: write d0/de/d17/d56/d59/d60/f8a [2510577,74079] 0 2024-04-18T04:58:07.745 INFO:tasks.workunit.client.0.smithi096.stdout:0/595: link d16/d1c/d22/ca0 d16/d1c/d4c/d4d/d36/cb9 0 2024-04-18T04:58:07.747 INFO:tasks.workunit.client.0.smithi096.stdout:0/596: readlink d16/l45 0 2024-04-18T04:58:07.748 INFO:tasks.workunit.client.0.smithi096.stdout:2/947: write df/d18/f5f [3144593,10313] 0 2024-04-18T04:58:07.750 INFO:tasks.workunit.client.0.smithi096.stdout:9/731: symlink d0/de/d17/d2f/d40/d8b/de1/le9 0 2024-04-18T04:58:07.752 INFO:tasks.workunit.client.0.smithi096.stdout:5/610: dread d7/dd/d8f/fcb [0,4194304] 0 2024-04-18T04:58:07.753 INFO:tasks.workunit.client.0.smithi096.stdout:2/948: creat df/d18/d24/d42/d101/f13c x:0 0 0 2024-04-18T04:58:07.754 INFO:tasks.workunit.client.0.smithi096.stdout:5/611: unlink d7/d25/d2b/f49 0 2024-04-18T04:58:07.754 INFO:tasks.workunit.client.0.smithi096.stdout:0/597: dread d16/d1c/d22/d2c/f30 [0,4194304] 0 2024-04-18T04:58:07.755 INFO:tasks.workunit.client.0.smithi096.stdout:5/612: stat d7/da3/d9a/fb6 0 2024-04-18T04:58:07.755 INFO:tasks.workunit.client.0.smithi096.stdout:2/949: unlink df/d18/d71/d9c/fa7 0 2024-04-18T04:58:07.755 INFO:tasks.workunit.client.0.smithi096.stdout:0/598: fsync d16/d1d/d3b/fa9 0 2024-04-18T04:58:07.758 INFO:tasks.workunit.client.0.smithi096.stdout:2/950: dread - df/d18/d24/d42/dd9/f123 zero size 2024-04-18T04:58:07.758 INFO:tasks.workunit.client.0.smithi096.stdout:0/599: write d16/d1c/f9c [516780,123240] 0 2024-04-18T04:58:07.759 INFO:tasks.workunit.client.0.smithi096.stdout:5/613: mknod d7/dd/d8f/da2/de2/ce6 0 2024-04-18T04:58:07.760 INFO:tasks.workunit.client.0.smithi096.stdout:4/684: dread d4/d14/d1d/f27 [0,4194304] 0 2024-04-18T04:58:07.761 INFO:tasks.workunit.client.0.smithi096.stdout:2/951: write df/f1b [2721044,73255] 0 2024-04-18T04:58:07.762 INFO:tasks.workunit.client.0.smithi096.stdout:9/732: dwrite d0/d52/d5a/fa7 [0,4194304] 0 2024-04-18T04:58:07.762 INFO:tasks.workunit.client.0.smithi096.stdout:5/614: stat d7/dd/d8f/d5e/f79 0 2024-04-18T04:58:07.764 INFO:tasks.workunit.client.0.smithi096.stdout:2/952: write df/d18/d26/d48/d7b/d10e/f11b [801142,120372] 0 2024-04-18T04:58:07.766 INFO:tasks.workunit.client.0.smithi096.stdout:4/685: mknod d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/cd6 0 2024-04-18T04:58:07.767 INFO:tasks.workunit.client.0.smithi096.stdout:9/733: unlink d0/de/d17/d56/d59/d60/cce 0 2024-04-18T04:58:07.770 INFO:tasks.workunit.client.0.smithi096.stdout:3/874: sync 2024-04-18T04:58:07.770 INFO:tasks.workunit.client.0.smithi096.stdout:8/564: sync 2024-04-18T04:58:07.775 INFO:tasks.workunit.client.0.smithi096.stdout:8/565: rename d0/d7/d24/f1f to d0/d7/d24/d18/d5d/fb5 0 2024-04-18T04:58:07.776 INFO:tasks.workunit.client.0.smithi096.stdout:4/686: creat d4/d14/d1d/da5/fd7 x:0 0 0 2024-04-18T04:58:07.777 INFO:tasks.workunit.client.0.smithi096.stdout:0/600: truncate d16/f42 6787046 0 2024-04-18T04:58:07.777 INFO:tasks.workunit.client.0.smithi096.stdout:4/687: chown d4/d14/d16/cbb 32562 1 2024-04-18T04:58:07.809 INFO:tasks.workunit.client.0.smithi096.stdout:0/601: read - d16/d1c/d4c/d4d/d5d/d91/fa8 zero size 2024-04-18T04:58:07.809 INFO:tasks.workunit.client.0.smithi096.stdout:5/615: write d7/dd/f2e [1778816,58636] 0 2024-04-18T04:58:07.809 INFO:tasks.workunit.client.0.smithi096.stdout:9/734: truncate d0/de/f7b 3881449 0 2024-04-18T04:58:07.811 INFO:tasks.workunit.client.0.smithi096.stdout:8/566: write d0/d3/d32/f48 [788067,104314] 0 2024-04-18T04:58:07.811 INFO:tasks.workunit.client.0.smithi096.stdout:3/875: dread dc/d26/d48/dc2/f46 [8388608,4194304] 0 2024-04-18T04:58:07.813 INFO:tasks.workunit.client.0.smithi096.stdout:3/876: fsync dc/d26/d48/f9a 0 2024-04-18T04:58:07.815 INFO:tasks.workunit.client.0.smithi096.stdout:9/735: truncate d0/de/d17/d56/d59/d60/fc2 1734361 0 2024-04-18T04:58:07.816 INFO:tasks.workunit.client.0.smithi096.stdout:8/567: mkdir d0/d15/d65/d8f/db6 0 2024-04-18T04:58:07.817 INFO:tasks.workunit.client.0.smithi096.stdout:0/602: symlink d16/d1c/d4c/d4d/d5d/lba 0 2024-04-18T04:58:07.819 INFO:tasks.workunit.client.0.smithi096.stdout:9/736: chown d0/de/d17/d56/d59/d68/dab/d33 1560187 1 2024-04-18T04:58:07.820 INFO:tasks.workunit.client.0.smithi096.stdout:8/568: fsync d0/d7/d24/d18/d5d/f5f 0 2024-04-18T04:58:07.821 INFO:tasks.workunit.client.0.smithi096.stdout:4/688: dwrite d4/d14/d2d/d44/d89/f8e [0,4194304] 0 2024-04-18T04:58:07.822 INFO:tasks.workunit.client.0.smithi096.stdout:0/603: creat d16/fbb x:0 0 0 2024-04-18T04:58:07.822 INFO:tasks.workunit.client.0.smithi096.stdout:8/569: readlink d0/d3/l2e 0 2024-04-18T04:58:07.823 INFO:tasks.workunit.client.0.smithi096.stdout:5/616: dwrite d7/d25/d30/f4b [0,4194304] 0 2024-04-18T04:58:07.825 INFO:tasks.workunit.client.0.smithi096.stdout:0/604: write d16/f40 [8322978,45006] 0 2024-04-18T04:58:07.825 INFO:tasks.workunit.client.0.smithi096.stdout:8/570: fsync d0/d7/d24/d18/f11 0 2024-04-18T04:58:07.826 INFO:tasks.workunit.client.0.smithi096.stdout:9/737: rename d0/de/d17/d56/f6a to d0/d41/fea 0 2024-04-18T04:58:07.827 INFO:tasks.workunit.client.0.smithi096.stdout:5/617: write d7/da3/d9a/fa8 [2002100,71308] 0 2024-04-18T04:58:07.832 INFO:tasks.workunit.client.0.smithi096.stdout:3/877: dread dc/d26/d66/d7f/f11f [0,4194304] 0 2024-04-18T04:58:07.834 INFO:tasks.workunit.client.0.smithi096.stdout:8/571: dread - d0/d7/d24/d18/d7c/fa7 zero size 2024-04-18T04:58:07.834 INFO:tasks.workunit.client.0.smithi096.stdout:4/689: rename d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/f74 to d4/d14/d2d/da6/dc6/dce/fd8 0 2024-04-18T04:58:07.834 INFO:tasks.workunit.client.0.smithi096.stdout:0/605: mknod d16/d1c/d4c/d6a/cbc 0 2024-04-18T04:58:07.835 INFO:tasks.workunit.client.0.smithi096.stdout:5/618: mkdir d7/dd/d8f/da2/de2/de3/d36/de7 0 2024-04-18T04:58:07.836 INFO:tasks.workunit.client.0.smithi096.stdout:5/619: chown d7/d25/d7c/f87 66457256 1 2024-04-18T04:58:07.837 INFO:tasks.workunit.client.0.smithi096.stdout:9/738: symlink d0/de/d17/d2f/d40/d8b/dd6/leb 0 2024-04-18T04:58:07.838 INFO:tasks.workunit.client.0.smithi096.stdout:3/878: rename dc/d26/d48/dc2/d95/de3/l109 to dc/d5d/l120 0 2024-04-18T04:58:07.838 INFO:tasks.workunit.client.0.smithi096.stdout:4/690: chown d4/d14/d2d/fb7 828705 1 2024-04-18T04:58:07.839 INFO:tasks.workunit.client.0.smithi096.stdout:0/606: symlink d16/d1c/d4c/d4e/d67/lbd 0 2024-04-18T04:58:07.839 INFO:tasks.workunit.client.0.smithi096.stdout:5/620: rmdir d7/dd/d8f/da2/de2/de3 39 2024-04-18T04:58:07.841 INFO:tasks.workunit.client.0.smithi096.stdout:3/879: fsync dc/d26/d4a/f6c 0 2024-04-18T04:58:07.842 INFO:tasks.workunit.client.0.smithi096.stdout:3/880: chown dc/d70/l113 1297327 1 2024-04-18T04:58:07.842 INFO:tasks.workunit.client.0.smithi096.stdout:0/607: unlink d16/d1c/d4c/d4d/l66 0 2024-04-18T04:58:07.843 INFO:tasks.workunit.client.0.smithi096.stdout:4/691: mkdir d4/d14/d2d/d44/d58/d86/d3a/d39/d54/dd9 0 2024-04-18T04:58:07.844 INFO:tasks.workunit.client.0.smithi096.stdout:3/881: chown dc/d26/d48/dc2/c37 5 1 2024-04-18T04:58:07.844 INFO:tasks.workunit.client.0.smithi096.stdout:4/692: chown d4/d14/d16 3 1 2024-04-18T04:58:07.846 INFO:tasks.workunit.client.0.smithi096.stdout:9/739: dwrite d0/de/d17/d2f/d40/d8b/de1/f9b [0,4194304] 0 2024-04-18T04:58:07.847 INFO:tasks.workunit.client.0.smithi096.stdout:9/740: chown d0/de/d17/d56/d59/fe6 1 1 2024-04-18T04:58:07.851 INFO:tasks.workunit.client.0.smithi096.stdout:8/572: truncate d0/d7/d24/f34 422680 0 2024-04-18T04:58:07.853 INFO:tasks.workunit.client.0.smithi096.stdout:9/741: unlink d0/de/d17/d56/d59/d68/dab/c94 0 2024-04-18T04:58:07.854 INFO:tasks.workunit.client.0.smithi096.stdout:4/693: dread d4/d14/d16/f7d [0,4194304] 0 2024-04-18T04:58:07.855 INFO:tasks.workunit.client.0.smithi096.stdout:0/608: write d16/d1d/f34 [660117,42553] 0 2024-04-18T04:58:07.855 INFO:tasks.workunit.client.0.smithi096.stdout:8/573: write d0/f55 [4998126,63143] 0 2024-04-18T04:58:07.858 INFO:tasks.workunit.client.0.smithi096.stdout:3/882: dwrite dc/d26/d48/dc2/d29/f11e [0,4194304] 0 2024-04-18T04:58:07.860 INFO:tasks.workunit.client.0.smithi096.stdout:9/742: fdatasync d0/de/f7b 0 2024-04-18T04:58:07.860 INFO:tasks.workunit.client.0.smithi096.stdout:5/621: dwrite d7/dd/d8f/da2/de2/de3/f20 [4194304,4194304] 0 2024-04-18T04:58:07.860 INFO:tasks.workunit.client.0.smithi096.stdout:8/574: read d0/f26 [3783,127695] 0 2024-04-18T04:58:07.862 INFO:tasks.workunit.client.0.smithi096.stdout:4/694: stat d4/d14/d2d/d44/d58/d86/d6f/dc5/cd3 0 2024-04-18T04:58:07.865 INFO:tasks.workunit.client.0.smithi096.stdout:8/575: unlink d0/d7/d24/d18/d5d/f87 0 2024-04-18T04:58:07.869 INFO:tasks.workunit.client.0.smithi096.stdout:3/883: truncate dc/d70/fd9 354057 0 2024-04-18T04:58:07.871 INFO:tasks.workunit.client.0.smithi096.stdout:5/622: rename d7/d25/l92 to d7/d25/d58/le8 0 2024-04-18T04:58:07.872 INFO:tasks.workunit.client.0.smithi096.stdout:9/743: write d0/de/d17/d56/d59/d60/faf [1058459,37483] 0 2024-04-18T04:58:07.873 INFO:tasks.workunit.client.0.smithi096.stdout:5/623: readlink d7/dd/d35/d74/l7e 0 2024-04-18T04:58:07.874 INFO:tasks.workunit.client.0.smithi096.stdout:8/576: dwrite d0/d7/f73 [0,4194304] 0 2024-04-18T04:58:07.878 INFO:tasks.workunit.client.0.smithi096.stdout:0/609: link d16/d1c/d4c/d4e/f99 d16/d1c/d22/fbe 0 2024-04-18T04:58:07.878 INFO:tasks.workunit.client.0.smithi096.stdout:8/577: chown d0/d7/d24/d35/f8e 634360 1 2024-04-18T04:58:07.878 INFO:tasks.workunit.client.0.smithi096.stdout:9/744: dread d0/de/d17/d2f/d40/fb3 [0,4194304] 0 2024-04-18T04:58:07.878 INFO:tasks.workunit.client.0.smithi096.stdout:8/578: write d0/d7/d24/d18/d5d/fb1 [255792,102037] 0 2024-04-18T04:58:07.879 INFO:tasks.workunit.client.0.smithi096.stdout:5/624: unlink d7/dd/d35/d74/f81 0 2024-04-18T04:58:07.879 INFO:tasks.workunit.client.0.smithi096.stdout:8/579: stat d0/d3 0 2024-04-18T04:58:07.879 INFO:tasks.workunit.client.0.smithi096.stdout:9/745: write d0/f4b [5536854,26953] 0 2024-04-18T04:58:07.882 INFO:tasks.workunit.client.0.smithi096.stdout:8/580: rmdir d0/d15 39 2024-04-18T04:58:07.883 INFO:tasks.workunit.client.0.smithi096.stdout:8/581: rename d0/d7 to d0/d7/d24/d18/d5d/db7 22 2024-04-18T04:58:07.883 INFO:tasks.workunit.client.0.smithi096.stdout:5/625: creat d7/d25/d2b/fe9 x:0 0 0 2024-04-18T04:58:07.884 INFO:tasks.workunit.client.0.smithi096.stdout:8/582: chown d0/d7/d24/d35/ca8 14665898 1 2024-04-18T04:58:07.886 INFO:tasks.workunit.client.0.smithi096.stdout:8/583: read d0/d3/f31 [1634440,86766] 0 2024-04-18T04:58:07.886 INFO:tasks.workunit.client.0.smithi096.stdout:5/626: creat d7/d25/d2b/fea x:0 0 0 2024-04-18T04:58:07.890 INFO:tasks.workunit.client.0.smithi096.stdout:8/584: dread d0/d7/d24/d35/f4a [0,4194304] 0 2024-04-18T04:58:07.890 INFO:tasks.workunit.client.0.smithi096.stdout:5/627: mkdir d7/d25/d2b/deb 0 2024-04-18T04:58:07.891 INFO:tasks.workunit.client.0.smithi096.stdout:8/585: chown d0/d7/d24/d78/l6f 1 1 2024-04-18T04:58:07.891 INFO:tasks.workunit.client.0.smithi096.stdout:4/695: truncate d4/d14/d1d/f52 958140 0 2024-04-18T04:58:07.891 INFO:tasks.workunit.client.0.smithi096.stdout:8/586: chown d0/d7/c2f 0 1 2024-04-18T04:58:07.892 INFO:tasks.workunit.client.0.smithi096.stdout:8/587: chown d0/d7/d24/d35/d51/d5b/cae 1838 1 2024-04-18T04:58:07.896 INFO:tasks.workunit.client.0.smithi096.stdout:4/696: creat d4/d14/d2d/d44/d90/fda x:0 0 0 2024-04-18T04:58:07.896 INFO:tasks.workunit.client.0.smithi096.stdout:0/610: dwrite d16/d1c/d4c/d4d/d5a/f6c [0,4194304] 0 2024-04-18T04:58:07.897 INFO:tasks.workunit.client.0.smithi096.stdout:4/697: dread - d4/d14/d1d/da5/d8c/fbf zero size 2024-04-18T04:58:07.898 INFO:tasks.workunit.client.0.smithi096.stdout:0/611: write d16/f2b [3418344,13026] 0 2024-04-18T04:58:07.898 INFO:tasks.workunit.client.0.smithi096.stdout:8/588: rename d0/d7/l6d to d0/d7/d24/d18/d5d/lb8 0 2024-04-18T04:58:07.898 INFO:tasks.workunit.client.0.smithi096.stdout:9/746: write d0/de/f62 [2075207,122673] 0 2024-04-18T04:58:07.899 INFO:tasks.workunit.client.0.smithi096.stdout:5/628: creat d7/d3b/da9/fec x:0 0 0 2024-04-18T04:58:07.904 INFO:tasks.workunit.client.0.smithi096.stdout:4/698: mkdir d4/d14/d2d/da6/dc6/dce/ddb 0 2024-04-18T04:58:07.906 INFO:tasks.workunit.client.0.smithi096.stdout:0/612: truncate d16/f42 293915 0 2024-04-18T04:58:07.907 INFO:tasks.workunit.client.0.smithi096.stdout:8/589: symlink d0/d15/d65/d8f/lb9 0 2024-04-18T04:58:07.912 INFO:tasks.workunit.client.0.smithi096.stdout:1/703: sync 2024-04-18T04:58:07.912 INFO:tasks.workunit.client.0.smithi096.stdout:6/989: sync 2024-04-18T04:58:07.912 INFO:tasks.workunit.client.0.smithi096.stdout:7/673: sync 2024-04-18T04:58:07.912 INFO:tasks.workunit.client.0.smithi096.stdout:9/747: dwrite d0/de/d17/d2f/d40/d8b/de1/fcc [0,4194304] 0 2024-04-18T04:58:07.914 INFO:tasks.workunit.client.0.smithi096.stdout:1/704: dread - de/d1d/d3f/d5f/dc7/fde zero size 2024-04-18T04:58:07.915 INFO:tasks.workunit.client.0.smithi096.stdout:8/590: fdatasync d0/d3/d32/f90 0 2024-04-18T04:58:07.916 INFO:tasks.workunit.client.0.smithi096.stdout:8/591: stat d0/d4f 0 2024-04-18T04:58:07.918 INFO:tasks.workunit.client.0.smithi096.stdout:6/990: mkdir d0/d4a/d129 0 2024-04-18T04:58:07.920 INFO:tasks.workunit.client.0.smithi096.stdout:7/674: creat db/d1f/d24/d49/d54/fd8 x:0 0 0 2024-04-18T04:58:07.921 INFO:tasks.workunit.client.0.smithi096.stdout:9/748: readlink d0/de/d17/d2f/d40/d8b/ld0 0 2024-04-18T04:58:07.924 INFO:tasks.workunit.client.0.smithi096.stdout:4/699: truncate d4/d14/d2d/d44/d58/d86/d3a/d39/f56 2124032 0 2024-04-18T04:58:07.925 INFO:tasks.workunit.client.0.smithi096.stdout:1/705: mknod de/d1d/d81/dda/ce1 0 2024-04-18T04:58:07.926 INFO:tasks.workunit.client.0.smithi096.stdout:8/592: mknod d0/d7/d86/d91/d93/cba 0 2024-04-18T04:58:07.928 INFO:tasks.workunit.client.0.smithi096.stdout:0/613: write d16/d1c/d4c/d4d/d5d/f74 [1887962,42286] 0 2024-04-18T04:58:07.928 INFO:tasks.workunit.client.0.smithi096.stdout:5/629: dwrite d7/dd/d8f/da2/de2/de3/f70 [0,4194304] 0 2024-04-18T04:58:07.931 INFO:tasks.workunit.client.0.smithi096.stdout:4/700: write d4/d14/d2d/d44/f5f [3994457,58406] 0 2024-04-18T04:58:07.933 INFO:tasks.workunit.client.0.smithi096.stdout:1/706: mknod de/d1d/d81/dda/ce2 0 2024-04-18T04:58:07.934 INFO:tasks.workunit.client.0.smithi096.stdout:6/991: dwrite d0/d6/f37 [0,4194304] 0 2024-04-18T04:58:07.937 INFO:tasks.workunit.client.0.smithi096.stdout:0/614: creat d16/d55/fbf x:0 0 0 2024-04-18T04:58:07.939 INFO:tasks.workunit.client.0.smithi096.stdout:9/749: dwrite d0/d41/fca [0,4194304] 0 2024-04-18T04:58:07.940 INFO:tasks.workunit.client.0.smithi096.stdout:7/675: dwrite db/d1d/f44 [0,4194304] 0 2024-04-18T04:58:07.941 INFO:tasks.workunit.client.0.smithi096.stdout:0/615: dread - d16/d1c/d4c/d4d/d5d/d91/fa8 zero size 2024-04-18T04:58:07.943 INFO:tasks.workunit.client.0.smithi096.stdout:8/593: rename d0/d3/d32/f54 to d0/d15/da9/fbb 0 2024-04-18T04:58:07.945 INFO:tasks.workunit.client.0.smithi096.stdout:1/707: creat de/d1d/fe3 x:0 0 0 2024-04-18T04:58:07.947 INFO:tasks.workunit.client.0.smithi096.stdout:7/676: dread db/d1d/d82/f8c [0,4194304] 0 2024-04-18T04:58:07.951 INFO:tasks.workunit.client.0.smithi096.stdout:6/992: dread d0/d6/d2b/d3b/d69/fca [0,4194304] 0 2024-04-18T04:58:07.956 INFO:tasks.workunit.client.0.smithi096.stdout:4/701: link d4/d14/f2b d4/d14/d2d/d44/d90/dd0/fdc 0 2024-04-18T04:58:07.956 INFO:tasks.workunit.client.0.smithi096.stdout:8/594: dwrite d0/f55 [0,4194304] 0 2024-04-18T04:58:07.957 INFO:tasks.workunit.client.0.smithi096.stdout:6/993: creat d0/d6/d2b/d7e/f12a x:0 0 0 2024-04-18T04:58:07.959 INFO:tasks.workunit.client.0.smithi096.stdout:4/702: write d4/d14/d2d/d44/da2/fba [1966846,16585] 0 2024-04-18T04:58:07.961 INFO:tasks.workunit.client.0.smithi096.stdout:8/595: symlink d0/d7/d24/d35/d51/d5b/lbc 0 2024-04-18T04:58:07.966 INFO:tasks.workunit.client.0.smithi096.stdout:6/994: rename d0/d73/c89 to d0/d6/d2e/d7a/c12b 0 2024-04-18T04:58:07.967 INFO:tasks.workunit.client.0.smithi096.stdout:8/596: mknod d0/d7/d86/d91/cbd 0 2024-04-18T04:58:07.971 INFO:tasks.workunit.client.0.smithi096.stdout:0/616: dread d16/d1c/d4c/d4e/d67/fab [0,4194304] 0 2024-04-18T04:58:07.974 INFO:tasks.workunit.client.0.smithi096.stdout:8/597: symlink d0/d7/d86/d91/lbe 0 2024-04-18T04:58:07.975 INFO:tasks.workunit.client.0.smithi096.stdout:4/703: dwrite d4/d14/d16/fcd [0,4194304] 0 2024-04-18T04:58:07.978 INFO:tasks.workunit.client.0.smithi096.stdout:9/750: dread d0/de/d17/d2f/d40/d8b/de1/fcc [4194304,4194304] 0 2024-04-18T04:58:07.979 INFO:tasks.workunit.client.0.smithi096.stdout:0/617: mknod d16/d1c/d4c/d4d/cc0 0 2024-04-18T04:58:07.979 INFO:tasks.workunit.client.0.smithi096.stdout:8/598: stat d0/d7/d24/d18/d27/c39 0 2024-04-18T04:58:07.980 INFO:tasks.workunit.client.0.smithi096.stdout:1/708: dwrite de/d1d/f25 [0,4194304] 0 2024-04-18T04:58:07.983 INFO:tasks.workunit.client.0.smithi096.stdout:7/677: dwrite db/d1f/d5b/d6a/fa4 [0,4194304] 0 2024-04-18T04:58:07.984 INFO:tasks.workunit.client.0.smithi096.stdout:5/630: dread d7/d25/d30/f33 [4194304,4194304] 0 2024-04-18T04:58:07.986 INFO:tasks.workunit.client.0.smithi096.stdout:9/751: dread d0/d41/fb1 [0,4194304] 0 2024-04-18T04:58:07.988 INFO:tasks.workunit.client.0.smithi096.stdout:6/995: dwrite d0/d6/f1d [4194304,4194304] 0 2024-04-18T04:58:07.992 INFO:tasks.workunit.client.0.smithi096.stdout:1/709: rmdir de/d1d/d32/d6f 39 2024-04-18T04:58:07.993 INFO:tasks.workunit.client.0.smithi096.stdout:0/618: write d16/d1c/d4c/fa1 [2569379,28321] 0 2024-04-18T04:58:07.993 INFO:tasks.workunit.client.0.smithi096.stdout:8/599: rmdir d0/d3/d32/d6b/d7b 39 2024-04-18T04:58:07.997 INFO:tasks.workunit.client.0.smithi096.stdout:8/600: stat d0/d7/d24/d35/d51/d5b/cae 0 2024-04-18T04:58:07.997 INFO:tasks.workunit.client.0.smithi096.stdout:5/631: dread - d7/d25/d2b/f3d zero size 2024-04-18T04:58:07.998 INFO:tasks.workunit.client.0.smithi096.stdout:1/710: mkdir de/d1d/d32/d73/d8b/de4 0 2024-04-18T04:58:07.998 INFO:tasks.workunit.client.0.smithi096.stdout:7/678: dread db/f12 [0,4194304] 0 2024-04-18T04:58:07.998 INFO:tasks.workunit.client.0.smithi096.stdout:0/619: mknod d16/d1c/d4c/cc1 0 2024-04-18T04:58:07.999 INFO:tasks.workunit.client.0.smithi096.stdout:9/752: mknod d0/d52/cec 0 2024-04-18T04:58:08.000 INFO:tasks.workunit.client.0.smithi096.stdout:8/601: unlink d0/d7/d24/d18/la0 0 2024-04-18T04:58:08.002 INFO:tasks.workunit.client.0.smithi096.stdout:5/632: read d7/d25/d7c/f87 [369587,24219] 0 2024-04-18T04:58:08.002 INFO:tasks.workunit.client.0.smithi096.stdout:4/704: dread d4/d14/d16/f32 [0,4194304] 0 2024-04-18T04:58:08.002 INFO:tasks.workunit.client.0.smithi096.stdout:6/996: getdents d0/d6/d2b/d3b/d7d 0 2024-04-18T04:58:08.002 INFO:tasks.workunit.client.0.smithi096.stdout:8/602: readlink d0/d7/d24/l8b 0 2024-04-18T04:58:08.003 INFO:tasks.workunit.client.0.smithi096.stdout:1/711: mknod de/d1d/d32/d9a/dad/ce5 0 2024-04-18T04:58:08.003 INFO:tasks.workunit.client.0.smithi096.stdout:0/620: fdatasync d16/d1c/d4c/d4d/d5d/f97 0 2024-04-18T04:58:08.004 INFO:tasks.workunit.client.0.smithi096.stdout:6/997: write d0/d4a/fb1 [901929,21362] 0 2024-04-18T04:58:08.005 INFO:tasks.workunit.client.0.smithi096.stdout:1/712: chown de/l1b 1440857941 1 2024-04-18T04:58:08.005 INFO:tasks.workunit.client.0.smithi096.stdout:0/621: dread - d16/f96 zero size 2024-04-18T04:58:08.007 INFO:tasks.workunit.client.0.smithi096.stdout:9/753: creat d0/d52/fed x:0 0 0 2024-04-18T04:58:08.010 INFO:tasks.workunit.client.0.smithi096.stdout:9/754: fdatasync d0/de/d17/d56/d59/d60/faf 0 2024-04-18T04:58:08.011 INFO:tasks.workunit.client.0.smithi096.stdout:5/633: truncate d7/dd/d8f/da2/de2/de3/d78/dc1/fc6 710869 0 2024-04-18T04:58:08.012 INFO:tasks.workunit.client.0.smithi096.stdout:0/622: symlink d16/d1c/d4c/d4d/d5d/d8f/lc2 0 2024-04-18T04:58:08.013 INFO:tasks.workunit.client.0.smithi096.stdout:5/634: read - d7/fd1 zero size 2024-04-18T04:58:08.015 INFO:tasks.workunit.client.0.smithi096.stdout:0/623: write d16/d1c/f88 [482431,87573] 0 2024-04-18T04:58:08.015 INFO:tasks.workunit.client.0.smithi096.stdout:7/679: dwrite db/d1f/d39/d6d/d79/f9a [0,4194304] 0 2024-04-18T04:58:08.018 INFO:tasks.workunit.client.0.smithi096.stdout:9/755: mkdir d0/de/d17/d56/d59/d68/dab/d3a/dee 0 2024-04-18T04:58:08.019 INFO:tasks.workunit.client.0.smithi096.stdout:7/680: chown db/f31 736 1 2024-04-18T04:58:08.019 INFO:tasks.workunit.client.0.smithi096.stdout:6/998: dread d0/d6/d2b/d3b/d69/d66/dcf/dd5/fdb [0,4194304] 0 2024-04-18T04:58:08.023 INFO:tasks.workunit.client.0.smithi096.stdout:1/713: dwrite de/d1d/fab [0,4194304] 0 2024-04-18T04:58:08.023 INFO:tasks.workunit.client.0.smithi096.stdout:0/624: dread d16/d1c/f9c [0,4194304] 0 2024-04-18T04:58:08.025 INFO:tasks.workunit.client.0.smithi096.stdout:8/603: dread d0/d3/d32/f72 [0,4194304] 0 2024-04-18T04:58:08.025 INFO:tasks.workunit.client.0.smithi096.stdout:1/714: write de/d1d/d3f/f76 [904375,64079] 0 2024-04-18T04:58:08.028 INFO:tasks.workunit.client.0.smithi096.stdout:9/756: rename d0/d52/fed to d0/de/d17/d56/d59/d68/dab/d33/fef 0 2024-04-18T04:58:08.028 INFO:tasks.workunit.client.0.smithi096.stdout:0/625: fdatasync d16/f96 0 2024-04-18T04:58:08.030 INFO:tasks.workunit.client.0.smithi096.stdout:6/999: write d0/d6/d2b/d3b/d69/f5b [3799847,75570] 0 2024-04-18T04:58:08.030 INFO:tasks.workunit.client.0.smithi096.stdout:7/681: creat db/d1f/d24/d61/d77/fd9 x:0 0 0 2024-04-18T04:58:08.032 INFO:tasks.workunit.client.0.smithi096.stdout:0/626: write d16/f1b [3793264,71892] 0 2024-04-18T04:58:08.033 INFO:tasks.workunit.client.0.smithi096.stdout:1/715: mknod de/d1d/d3f/d5f/ce6 0 2024-04-18T04:58:08.034 INFO:tasks.workunit.client.0.smithi096.stdout:7/682: mkdir db/d1f/d5b/dda 0 2024-04-18T04:58:08.036 INFO:tasks.workunit.client.0.smithi096.stdout:0/627: mkdir d16/d1d/d3b/dc3 0 2024-04-18T04:58:08.037 INFO:tasks.workunit.client.0.smithi096.stdout:1/716: mknod de/d1d/d32/d9a/dad/dd3/ce7 0 2024-04-18T04:58:08.038 INFO:tasks.workunit.client.0.smithi096.stdout:5/635: dwrite d7/dd/d8f/da2/de2/de3/d56/f6a [0,4194304] 0 2024-04-18T04:58:08.040 INFO:tasks.workunit.client.0.smithi096.stdout:1/717: chown de/d1d/c26 21119815 1 2024-04-18T04:58:08.042 INFO:tasks.workunit.client.0.smithi096.stdout:0/628: write d16/d1c/d4c/d4d/d5d/f7b [859005,127440] 0 2024-04-18T04:58:08.046 INFO:tasks.workunit.client.0.smithi096.stdout:8/604: dwrite d0/d7/d24/d18/d5d/f83 [0,4194304] 0 2024-04-18T04:58:08.047 INFO:tasks.workunit.client.0.smithi096.stdout:5/636: write d7/dd/d8f/da2/de2/de3/f20 [6630247,43270] 0 2024-04-18T04:58:08.049 INFO:tasks.workunit.client.0.smithi096.stdout:9/757: dwrite d0/de/d17/d56/d59/d68/dab/d33/fef [0,4194304] 0 2024-04-18T04:58:08.051 INFO:tasks.workunit.client.0.smithi096.stdout:7/683: truncate db/d1f/d5b/d6a/fa4 3675820 0 2024-04-18T04:58:08.054 INFO:tasks.workunit.client.0.smithi096.stdout:9/758: fsync d0/de/d17/d56/d59/d68/dab/d33/fbf 0 2024-04-18T04:58:08.055 INFO:tasks.workunit.client.0.smithi096.stdout:1/718: dwrite de/d1d/f42 [0,4194304] 0 2024-04-18T04:58:08.055 INFO:tasks.workunit.client.0.smithi096.stdout:5/637: write d7/dd/d8f/da2/de2/de3/f29 [2525064,101916] 0 2024-04-18T04:58:08.055 INFO:tasks.workunit.client.0.smithi096.stdout:7/684: mkdir db/d1f/d4e/dc0/ddb 0 2024-04-18T04:58:08.062 INFO:tasks.workunit.client.0.smithi096.stdout:8/605: truncate d0/d15/f44 528881 0 2024-04-18T04:58:08.062 INFO:tasks.workunit.client.0.smithi096.stdout:7/685: write db/d1f/d39/d6d/d79/d83/fc8 [1019017,93314] 0 2024-04-18T04:58:08.062 INFO:tasks.workunit.client.0.smithi096.stdout:9/759: mknod d0/de/d17/d56/d59/cf0 0 2024-04-18T04:58:08.066 INFO:tasks.workunit.client.0.smithi096.stdout:1/719: creat de/d1d/d32/d73/d8b/dca/fe8 x:0 0 0 2024-04-18T04:58:08.066 INFO:tasks.workunit.client.0.smithi096.stdout:7/686: fsync db/d1f/f41 0 2024-04-18T04:58:08.069 INFO:tasks.workunit.client.0.smithi096.stdout:0/629: dwrite d16/d1c/f37 [0,4194304] 0 2024-04-18T04:58:08.069 INFO:tasks.workunit.client.0.smithi096.stdout:5/638: rename d7/dd/d35/f59 to d7/dd/d8f/da2/de2/de3/d36/dd5/fed 0 2024-04-18T04:58:08.071 INFO:tasks.workunit.client.0.smithi096.stdout:1/720: mkdir de/d1d/d32/d73/d8b/de9 0 2024-04-18T04:58:08.071 INFO:tasks.workunit.client.0.smithi096.stdout:5/639: write d7/d25/d58/f62 [1544647,46213] 0 2024-04-18T04:58:08.073 INFO:tasks.workunit.client.0.smithi096.stdout:7/687: rmdir db/d1f/d24/d49/d54 39 2024-04-18T04:58:08.077 INFO:tasks.workunit.client.0.smithi096.stdout:9/760: dwrite d0/de/f7b [0,4194304] 0 2024-04-18T04:58:08.082 INFO:tasks.workunit.client.0.smithi096.stdout:8/606: dread d0/d3/f8a [0,4194304] 0 2024-04-18T04:58:08.082 INFO:tasks.workunit.client.0.smithi096.stdout:5/640: read d7/dd/d8f/da2/f8c [191269,69628] 0 2024-04-18T04:58:08.082 INFO:tasks.workunit.client.0.smithi096.stdout:1/721: unlink de/d1d/d32/d8c/fc3 0 2024-04-18T04:58:08.085 INFO:tasks.workunit.client.0.smithi096.stdout:9/761: creat d0/de/d17/d2f/dd5/ff1 x:0 0 0 2024-04-18T04:58:08.086 INFO:tasks.workunit.client.0.smithi096.stdout:1/722: chown de/d1d/d32/d9a/cc4 405366 1 2024-04-18T04:58:08.087 INFO:tasks.workunit.client.0.smithi096.stdout:7/688: mkdir db/d1f/d24/d49/ddc 0 2024-04-18T04:58:08.087 INFO:tasks.workunit.client.0.smithi096.stdout:0/630: link d16/d1d/d3b/f46 d16/d1c/d4c/fc4 0 2024-04-18T04:58:08.089 INFO:tasks.workunit.client.0.smithi096.stdout:0/631: read d16/d1c/d4c/d4d/d5d/d8f/f86 [5142423,43359] 0 2024-04-18T04:58:08.090 INFO:tasks.workunit.client.0.smithi096.stdout:7/689: creat db/d1f/d39/d6d/d79/fdd x:0 0 0 2024-04-18T04:58:08.091 INFO:tasks.workunit.client.0.smithi096.stdout:0/632: read - d16/d1c/f98 zero size 2024-04-18T04:58:08.091 INFO:tasks.workunit.client.0.smithi096.stdout:7/690: stat db/d1f/c52 0 2024-04-18T04:58:08.092 INFO:tasks.workunit.client.0.smithi096.stdout:8/607: getdents d0/d3/d32 0 2024-04-18T04:58:08.093 INFO:tasks.workunit.client.0.smithi096.stdout:5/641: getdents d7 0 2024-04-18T04:58:08.093 INFO:tasks.workunit.client.0.smithi096.stdout:9/762: link d0/d41/l80 d0/de/d17/d2f/d40/d8b/dd6/lf2 0 2024-04-18T04:58:08.095 INFO:tasks.workunit.client.0.smithi096.stdout:0/633: creat d16/d1c/d4c/d4d/d5a/fc5 x:0 0 0 2024-04-18T04:58:08.096 INFO:tasks.workunit.client.0.smithi096.stdout:8/608: creat d0/d15/d65/fbf x:0 0 0 2024-04-18T04:58:08.097 INFO:tasks.workunit.client.0.smithi096.stdout:1/723: dwrite de/d1d/d3f/d4f/fa4 [0,4194304] 0 2024-04-18T04:58:08.097 INFO:tasks.workunit.client.0.smithi096.stdout:5/642: write d7/dd/d8f/da2/de2/de3/f29 [3715693,49495] 0 2024-04-18T04:58:08.098 INFO:tasks.workunit.client.0.smithi096.stdout:0/634: write d16/f40 [6128987,55616] 0 2024-04-18T04:58:08.101 INFO:tasks.workunit.client.0.smithi096.stdout:1/724: creat de/d1d/d32/d9a/fea x:0 0 0 2024-04-18T04:58:08.103 INFO:tasks.workunit.client.0.smithi096.stdout:0/635: rmdir d16/d1c/d4c/d4d/d36 39 2024-04-18T04:58:08.105 INFO:tasks.workunit.client.0.smithi096.stdout:7/691: truncate db/fc5 775316 0 2024-04-18T04:58:08.105 INFO:tasks.workunit.client.0.smithi096.stdout:9/763: dwrite d0/de/d17/d2f/fcd [0,4194304] 0 2024-04-18T04:58:08.105 INFO:tasks.workunit.client.0.smithi096.stdout:0/636: write d16/d1c/d4c/d4d/d5a/f70 [240865,108075] 0 2024-04-18T04:58:08.106 INFO:tasks.workunit.client.0.smithi096.stdout:5/643: mknod d7/dd/d8f/da2/cee 0 2024-04-18T04:58:08.107 INFO:tasks.workunit.client.0.smithi096.stdout:5/644: truncate d7/d25/d30/fa7 117360 0 2024-04-18T04:58:08.108 INFO:tasks.workunit.client.0.smithi096.stdout:1/725: creat de/d1d/d32/d9a/feb x:0 0 0 2024-04-18T04:58:08.109 INFO:tasks.workunit.client.0.smithi096.stdout:8/609: creat d0/fc0 x:0 0 0 2024-04-18T04:58:08.112 INFO:tasks.workunit.client.0.smithi096.stdout:0/637: rmdir d16 39 2024-04-18T04:58:08.112 INFO:tasks.workunit.client.0.smithi096.stdout:9/764: dwrite d0/d41/fca [0,4194304] 0 2024-04-18T04:58:08.115 INFO:tasks.workunit.client.0.smithi096.stdout:2/953: sync 2024-04-18T04:58:08.116 INFO:tasks.workunit.client.0.smithi096.stdout:5/645: rmdir d7/d25/d30 39 2024-04-18T04:58:08.116 INFO:tasks.workunit.client.0.smithi096.stdout:5/646: chown d7/d25/d58/c7d 3614 1 2024-04-18T04:58:08.118 INFO:tasks.workunit.client.0.smithi096.stdout:1/726: symlink de/d1d/d32/d9a/dad/dd3/lec 0 2024-04-18T04:58:08.121 INFO:tasks.workunit.client.0.smithi096.stdout:9/765: write d0/de/d17/d2f/d40/d8b/de1/fcc [5649470,20263] 0 2024-04-18T04:58:08.122 INFO:tasks.workunit.client.0.smithi096.stdout:9/766: fdatasync d0/d6b/d89/fc4 0 2024-04-18T04:58:08.124 INFO:tasks.workunit.client.0.smithi096.stdout:2/954: rename df/d18/f38 to df/d18/d24/d42/dd9/f13d 0 2024-04-18T04:58:08.125 INFO:tasks.workunit.client.0.smithi096.stdout:1/727: mkdir de/d1d/d81/ded 0 2024-04-18T04:58:08.126 INFO:tasks.workunit.client.0.smithi096.stdout:5/647: fsync d7/d25/d30/f4b 0 2024-04-18T04:58:08.126 INFO:tasks.workunit.client.0.smithi096.stdout:1/728: write de/d1d/d32/d8c/fdd [452836,45524] 0 2024-04-18T04:58:08.128 INFO:tasks.workunit.client.0.smithi096.stdout:7/692: read db/fc5 [451047,34896] 0 2024-04-18T04:58:08.129 INFO:tasks.workunit.client.0.smithi096.stdout:8/610: getdents d0/d3/d32/d6b/d7b 0 2024-04-18T04:58:08.130 INFO:tasks.workunit.client.0.smithi096.stdout:1/729: creat de/d1d/d81/ded/fee x:0 0 0 2024-04-18T04:58:08.132 INFO:tasks.workunit.client.0.smithi096.stdout:0/638: truncate d16/f60 630095 0 2024-04-18T04:58:08.135 INFO:tasks.workunit.client.0.smithi096.stdout:2/955: dread df/d18/d71/d75/f88 [0,4194304] 0 2024-04-18T04:58:08.137 INFO:tasks.workunit.client.0.smithi096.stdout:9/767: dread d0/de/d17/f97 [0,4194304] 0 2024-04-18T04:58:08.138 INFO:tasks.workunit.client.0.smithi096.stdout:1/730: link de/d1d/d32/d73/d8b/la1 de/d1d/d3f/d5f/lef 0 2024-04-18T04:58:08.140 INFO:tasks.workunit.client.0.smithi096.stdout:5/648: dwrite d7/da3/d9a/fe0 [0,4194304] 0 2024-04-18T04:58:08.141 INFO:tasks.workunit.client.0.smithi096.stdout:1/731: chown de/d1d/d3f/f76 342259 1 2024-04-18T04:58:08.141 INFO:tasks.workunit.client.0.smithi096.stdout:7/693: dwrite db/d20/fb8 [0,4194304] 0 2024-04-18T04:58:08.141 INFO:tasks.workunit.client.0.smithi096.stdout:0/639: rename d16/d1c/d4c/d4d/d5d/d8f to d16/d1c/d4c/d4d/d5d/dc6 0 2024-04-18T04:58:08.145 INFO:tasks.workunit.client.0.smithi096.stdout:5/649: mknod d7/d3b/d95/cef 0 2024-04-18T04:58:08.145 INFO:tasks.workunit.client.0.smithi096.stdout:0/640: dread - d16/d1c/d4c/d4d/d5a/f95 zero size 2024-04-18T04:58:08.146 INFO:tasks.workunit.client.0.smithi096.stdout:1/732: rmdir de/d1d/d32 39 2024-04-18T04:58:08.149 INFO:tasks.workunit.client.0.smithi096.stdout:7/694: mkdir db/d20/d45/dcf/dd6/dde 0 2024-04-18T04:58:08.155 INFO:tasks.workunit.client.0.smithi096.stdout:1/733: write de/f12 [641027,93888] 0 2024-04-18T04:58:08.156 INFO:tasks.workunit.client.0.smithi096.stdout:0/641: write d16/f42 [914542,89749] 0 2024-04-18T04:58:08.158 INFO:tasks.workunit.client.0.smithi096.stdout:2/956: dwrite df/d18/d24/d42/d3f/d4a/dbc/f131 [0,4194304] 0 2024-04-18T04:58:08.159 INFO:tasks.workunit.client.0.smithi096.stdout:1/734: creat de/d7b/ff0 x:0 0 0 2024-04-18T04:58:08.164 INFO:tasks.workunit.client.0.smithi096.stdout:9/768: dwrite d0/de/d17/d56/d6d/f7f [0,4194304] 0 2024-04-18T04:58:08.167 INFO:tasks.workunit.client.0.smithi096.stdout:5/650: dwrite d7/dd/d35/fbc [0,4194304] 0 2024-04-18T04:58:08.168 INFO:tasks.workunit.client.0.smithi096.stdout:0/642: rename d16/d1c/f62 to d16/d1c/d4c/d4d/d5d/fc7 0 2024-04-18T04:58:08.170 INFO:tasks.workunit.client.0.smithi096.stdout:9/769: chown d0/d41/l43 498 1 2024-04-18T04:58:08.170 INFO:tasks.workunit.client.0.smithi096.stdout:9/770: chown d0/de/f2d 1 1 2024-04-18T04:58:08.172 INFO:tasks.workunit.client.0.smithi096.stdout:1/735: read de/d1d/d32/d73/fcc [2985801,93891] 0 2024-04-18T04:58:08.173 INFO:tasks.workunit.client.0.smithi096.stdout:9/771: fdatasync d0/d41/fb1 0 2024-04-18T04:58:08.174 INFO:tasks.workunit.client.0.smithi096.stdout:7/695: dwrite db/d20/d2f/d8d/da1/fc9 [0,4194304] 0 2024-04-18T04:58:08.180 INFO:tasks.workunit.client.0.smithi096.stdout:9/772: write d0/de/d17/d56/d59/d60/f8a [1931471,61879] 0 2024-04-18T04:58:08.182 INFO:tasks.workunit.client.0.smithi096.stdout:1/736: unlink de/d1d/d32/d73/d8b/fb3 0 2024-04-18T04:58:08.183 INFO:tasks.workunit.client.0.smithi096.stdout:0/643: dwrite d16/d1c/d4c/d4d/d5d/dc6/fac [0,4194304] 0 2024-04-18T04:58:08.184 INFO:tasks.workunit.client.0.smithi096.stdout:2/957: rename df/d18/d24/d42/d3f/d4a/dbc/d104/c11a to df/d18/d26/c13e 0 2024-04-18T04:58:08.186 INFO:tasks.workunit.client.0.smithi096.stdout:7/696: creat db/d1f/d39/d6d/fdf x:0 0 0 2024-04-18T04:58:08.191 INFO:tasks.workunit.client.0.smithi096.stdout:9/773: fsync d0/f11 0 2024-04-18T04:58:08.193 INFO:tasks.workunit.client.0.smithi096.stdout:0/644: dread d16/d1c/d4c/d4d/d5d/dc6/fac [0,4194304] 0 2024-04-18T04:58:08.193 INFO:tasks.workunit.client.0.smithi096.stdout:1/737: dwrite de/d1d/d32/d8c/fdd [0,4194304] 0 2024-04-18T04:58:08.197 INFO:tasks.workunit.client.0.smithi096.stdout:1/738: readlink de/d1d/d32/d6f/l71 0 2024-04-18T04:58:08.200 INFO:tasks.workunit.client.0.smithi096.stdout:0/645: rmdir d16/d1c/d4c/d4d/d5a 39 2024-04-18T04:58:08.200 INFO:tasks.workunit.client.0.smithi096.stdout:9/774: symlink d0/lf3 0 2024-04-18T04:58:08.200 INFO:tasks.workunit.client.0.smithi096.stdout:1/739: truncate de/d1d/d3f/f63 1541843 0 2024-04-18T04:58:08.201 INFO:tasks.workunit.client.0.smithi096.stdout:2/958: write df/d18/d87/f9e [26713,8971] 0 2024-04-18T04:58:08.201 INFO:tasks.workunit.client.0.smithi096.stdout:7/697: getdents db/d1d 0 2024-04-18T04:58:08.202 INFO:tasks.workunit.client.0.smithi096.stdout:9/775: readlink d0/de/d17/d56/d59/d68/dab/l54 0 2024-04-18T04:58:08.203 INFO:tasks.workunit.client.0.smithi096.stdout:2/959: stat df/d18/d24/dd1 0 2024-04-18T04:58:08.203 INFO:tasks.workunit.client.0.smithi096.stdout:0/646: truncate d16/f19 1478835 0 2024-04-18T04:58:08.204 INFO:tasks.workunit.client.0.smithi096.stdout:1/740: truncate de/d7b/fc9 29658 0 2024-04-18T04:58:08.206 INFO:tasks.workunit.client.0.smithi096.stdout:5/651: dwrite d7/d25/d30/f99 [0,4194304] 0 2024-04-18T04:58:08.207 INFO:tasks.workunit.client.0.smithi096.stdout:7/698: mknod db/d1f/d4e/dc0/ddb/ce0 0 2024-04-18T04:58:08.207 INFO:tasks.workunit.client.0.smithi096.stdout:2/960: read df/d18/d26/f54 [700664,27022] 0 2024-04-18T04:58:08.208 INFO:tasks.workunit.client.0.smithi096.stdout:0/647: rename fd to d16/d1c/d22/d2c/fc8 0 2024-04-18T04:58:08.211 INFO:tasks.workunit.client.0.smithi096.stdout:1/741: truncate de/f35 638152 0 2024-04-18T04:58:08.212 INFO:tasks.workunit.client.0.smithi096.stdout:2/961: rmdir df/d7d 39 2024-04-18T04:58:08.214 INFO:tasks.workunit.client.0.smithi096.stdout:1/742: fdatasync de/d1d/d32/d9a/dad/fd6 0 2024-04-18T04:58:08.215 INFO:tasks.workunit.client.0.smithi096.stdout:2/962: write df/d18/d26/f84 [819080,89078] 0 2024-04-18T04:58:08.219 INFO:tasks.workunit.client.0.smithi096.stdout:5/652: dwrite d7/dd/d35/fbc [0,4194304] 0 2024-04-18T04:58:08.220 INFO:tasks.workunit.client.0.smithi096.stdout:1/743: mknod de/d1d/d81/dda/cf1 0 2024-04-18T04:58:08.221 INFO:tasks.workunit.client.0.smithi096.stdout:2/963: symlink df/l13f 0 2024-04-18T04:58:08.222 INFO:tasks.workunit.client.0.smithi096.stdout:5/653: creat d7/ff0 x:0 0 0 2024-04-18T04:58:08.225 INFO:tasks.workunit.client.0.smithi096.stdout:2/964: chown df/d18/d26/d125 20356857 1 2024-04-18T04:58:08.227 INFO:tasks.workunit.client.0.smithi096.stdout:9/776: dwrite d0/de/d17/d56/d59/d68/f83 [0,4194304] 0 2024-04-18T04:58:08.230 INFO:tasks.workunit.client.0.smithi096.stdout:7/699: dwrite db/d1d/d82/f8c [0,4194304] 0 2024-04-18T04:58:08.232 INFO:tasks.workunit.client.0.smithi096.stdout:7/700: dread - db/d1f/d39/d6d/d79/f9e zero size 2024-04-18T04:58:08.232 INFO:tasks.workunit.client.0.smithi096.stdout:0/648: dwrite d16/d1c/d4c/d4d/d5d/f63 [0,4194304] 0 2024-04-18T04:58:08.232 INFO:tasks.workunit.client.0.smithi096.stdout:9/777: rmdir d0/d6b 39 2024-04-18T04:58:08.234 INFO:tasks.workunit.client.0.smithi096.stdout:1/744: write de/d1d/d3f/f6e [8535126,117644] 0 2024-04-18T04:58:08.240 INFO:tasks.workunit.client.0.smithi096.stdout:1/745: rename de/fdb to de/d1d/d81/ded/ff2 0 2024-04-18T04:58:08.241 INFO:tasks.workunit.client.0.smithi096.stdout:7/701: mkdir db/d1f/d24/d61/de1 0 2024-04-18T04:58:08.241 INFO:tasks.workunit.client.0.smithi096.stdout:2/965: write df/d18/d24/d42/dd9/f13d [3526749,123897] 0 2024-04-18T04:58:08.242 INFO:tasks.workunit.client.0.smithi096.stdout:5/654: stat d7/dd/d8f/da2/l71 0 2024-04-18T04:58:08.243 INFO:tasks.workunit.client.0.smithi096.stdout:9/778: dwrite d0/de/d17/f3f [4194304,4194304] 0 2024-04-18T04:58:08.243 INFO:tasks.workunit.client.0.smithi096.stdout:1/746: chown de/d1d/d3f/l58 11284787 1 2024-04-18T04:58:08.245 INFO:tasks.workunit.client.0.smithi096.stdout:3/884: sync 2024-04-18T04:58:08.247 INFO:tasks.workunit.client.0.smithi096.stdout:1/747: chown de/d1d/d32/d6f/ld0 458 1 2024-04-18T04:58:08.247 INFO:tasks.workunit.client.0.smithi096.stdout:7/702: unlink db/d1f/d24/f2e 0 2024-04-18T04:58:08.248 INFO:tasks.workunit.client.0.smithi096.stdout:7/703: fdatasync db/f3f 0 2024-04-18T04:58:08.249 INFO:tasks.workunit.client.0.smithi096.stdout:1/748: write de/fbe [328177,33592] 0 2024-04-18T04:58:08.250 INFO:tasks.workunit.client.0.smithi096.stdout:3/885: fsync dc/d26/d48/dc2/f74 0 2024-04-18T04:58:08.255 INFO:tasks.workunit.client.0.smithi096.stdout:2/966: rename df/d18/d24/d42/d6e/fd4 to df/d18/d71/d9c/db6/f140 0 2024-04-18T04:58:08.255 INFO:tasks.workunit.client.0.smithi096.stdout:9/779: dread d0/de/f2d [0,4194304] 0 2024-04-18T04:58:08.258 INFO:tasks.workunit.client.0.smithi096.stdout:0/649: dwrite d16/d1c/d22/d2c/f30 [4194304,4194304] 0 2024-04-18T04:58:08.260 INFO:tasks.workunit.client.0.smithi096.stdout:7/704: creat db/d1f/d39/d6d/d79/d83/daa/fe2 x:0 0 0 2024-04-18T04:58:08.264 INFO:tasks.workunit.client.0.smithi096.stdout:5/655: dwrite d7/d25/fb9 [0,4194304] 0 2024-04-18T04:58:08.270 INFO:tasks.workunit.client.0.smithi096.stdout:2/967: mknod df/d18/d24/d42/d3f/d4a/dbc/dff/c141 0 2024-04-18T04:58:08.277 INFO:tasks.workunit.client.0.smithi096.stdout:1/749: dwrite de/d1d/d32/d6f/d85/fac [0,4194304] 0 2024-04-18T04:58:08.283 INFO:tasks.workunit.client.0.smithi096.stdout:3/886: dwrite dc/d26/d48/dc2/d29/fff [8388608,4194304] 0 2024-04-18T04:58:08.286 INFO:tasks.workunit.client.0.smithi096.stdout:0/650: dread d16/d1c/f3c [0,4194304] 0 2024-04-18T04:58:08.286 INFO:tasks.workunit.client.0.smithi096.stdout:7/705: dwrite db/f31 [0,4194304] 0 2024-04-18T04:58:08.286 INFO:tasks.workunit.client.0.smithi096.stdout:5/656: truncate d7/da3/d9a/fa5 2875466 0 2024-04-18T04:58:08.288 INFO:tasks.workunit.client.0.smithi096.stdout:9/780: dwrite d0/de/d17/d2f/fcd [0,4194304] 0 2024-04-18T04:58:08.290 INFO:tasks.workunit.client.0.smithi096.stdout:1/750: creat de/d1d/d32/d73/d8b/de9/ff3 x:0 0 0 2024-04-18T04:58:08.290 INFO:tasks.workunit.client.0.smithi096.stdout:0/651: stat d16/f60 0 2024-04-18T04:58:08.290 INFO:tasks.workunit.client.0.smithi096.stdout:7/706: chown db/d20/d2f/f30 4 1 2024-04-18T04:58:08.291 INFO:tasks.workunit.client.0.smithi096.stdout:5/657: write d7/d25/d2b/fe9 [843042,33836] 0 2024-04-18T04:58:08.292 INFO:tasks.workunit.client.0.smithi096.stdout:1/751: fsync de/f12 0 2024-04-18T04:58:08.292 INFO:tasks.workunit.client.0.smithi096.stdout:9/781: fsync d0/de/d99/fdf 0 2024-04-18T04:58:08.293 INFO:tasks.workunit.client.0.smithi096.stdout:3/887: truncate dc/f39 2456828 0 2024-04-18T04:58:08.293 INFO:tasks.workunit.client.0.smithi096.stdout:2/968: dwrite df/d18/d71/f12a [0,4194304] 0 2024-04-18T04:58:08.294 INFO:tasks.workunit.client.0.smithi096.stdout:2/969: read - df/d18/d24/ff8 zero size 2024-04-18T04:58:08.295 INFO:tasks.workunit.client.0.smithi096.stdout:0/652: chown d16/d1c/d4c/d4d/d5d/c92 3 1 2024-04-18T04:58:08.300 INFO:tasks.workunit.client.0.smithi096.stdout:9/782: fdatasync d0/de/d17/d56/d59/d68/dab/f2e 0 2024-04-18T04:58:08.302 INFO:tasks.workunit.client.0.smithi096.stdout:0/653: mkdir d16/d55/dc9 0 2024-04-18T04:58:08.302 INFO:tasks.workunit.client.0.smithi096.stdout:2/970: fsync df/d18/d71/feb 0 2024-04-18T04:58:08.303 INFO:tasks.workunit.client.0.smithi096.stdout:3/888: creat dc/d26/d48/dc2/f121 x:0 0 0 2024-04-18T04:58:08.303 INFO:tasks.workunit.client.0.smithi096.stdout:0/654: write d16/d1c/f29 [214445,85059] 0 2024-04-18T04:58:08.304 INFO:tasks.workunit.client.0.smithi096.stdout:9/783: symlink d0/de/d17/d56/d59/d68/dab/d33/lf4 0 2024-04-18T04:58:08.304 INFO:tasks.workunit.client.0.smithi096.stdout:3/889: dread - dc/d26/d4a/ddf/d93/fe6 zero size 2024-04-18T04:58:08.306 INFO:tasks.workunit.client.0.smithi096.stdout:2/971: getdents df/d18/d71/d9c/db6/d11c 0 2024-04-18T04:58:08.307 INFO:tasks.workunit.client.0.smithi096.stdout:2/972: write df/f10 [2525061,25938] 0 2024-04-18T04:58:08.307 INFO:tasks.workunit.client.0.smithi096.stdout:9/784: creat d0/de/d17/d56/d6d/ff5 x:0 0 0 2024-04-18T04:58:08.309 INFO:tasks.workunit.client.0.smithi096.stdout:0/655: creat d16/fca x:0 0 0 2024-04-18T04:58:08.312 INFO:tasks.workunit.client.0.smithi096.stdout:9/785: creat d0/de/d17/d2f/dd5/ff6 x:0 0 0 2024-04-18T04:58:08.313 INFO:tasks.workunit.client.0.smithi096.stdout:7/707: truncate db/d1f/d42/f5f 1504603 0 2024-04-18T04:58:08.315 INFO:tasks.workunit.client.0.smithi096.stdout:9/786: chown d0/de/d17/d56/d59/d60/f77 105773491 1 2024-04-18T04:58:08.316 INFO:tasks.workunit.client.0.smithi096.stdout:1/752: dwrite de/d1d/d3f/d7a/d96/fd2 [0,4194304] 0 2024-04-18T04:58:08.317 INFO:tasks.workunit.client.0.smithi096.stdout:0/656: creat d16/d1c/d4c/d4d/fcb x:0 0 0 2024-04-18T04:58:08.318 INFO:tasks.workunit.client.0.smithi096.stdout:7/708: write db/d1f/d42/fab [58456,64152] 0 2024-04-18T04:58:08.321 INFO:tasks.workunit.client.0.smithi096.stdout:3/890: dread dc/d26/d4a/ddf/f7b [0,4194304] 0 2024-04-18T04:58:08.322 INFO:tasks.workunit.client.0.smithi096.stdout:1/753: symlink de/d1d/d32/lf4 0 2024-04-18T04:58:08.325 INFO:tasks.workunit.client.0.smithi096.stdout:3/891: dread dc/d26/d48/dc2/d29/d7e/fb6 [0,4194304] 0 2024-04-18T04:58:08.327 INFO:tasks.workunit.client.0.smithi096.stdout:7/709: mkdir db/d1f/d5b/d6a/dc6/de3 0 2024-04-18T04:58:08.327 INFO:tasks.workunit.client.0.smithi096.stdout:0/657: getdents d16/d55/dc9 0 2024-04-18T04:58:08.328 INFO:tasks.workunit.client.0.smithi096.stdout:9/787: creat d0/de/d17/d56/d59/d68/dab/ff7 x:0 0 0 2024-04-18T04:58:08.329 INFO:tasks.workunit.client.0.smithi096.stdout:7/710: readlink db/d1f/d39/l67 0 2024-04-18T04:58:08.329 INFO:tasks.workunit.client.0.smithi096.stdout:3/892: readlink dc/d26/l59 0 2024-04-18T04:58:08.330 INFO:tasks.workunit.client.0.smithi096.stdout:1/754: dread - de/d1d/d3f/d4f/fa0 zero size 2024-04-18T04:58:08.332 INFO:tasks.workunit.client.0.smithi096.stdout:1/755: read de/d1d/f42 [3802251,18186] 0 2024-04-18T04:58:08.334 INFO:tasks.workunit.client.0.smithi096.stdout:9/788: write d0/de/d17/d56/d59/d60/fc2 [683382,21592] 0 2024-04-18T04:58:08.335 INFO:tasks.workunit.client.0.smithi096.stdout:2/973: dwrite df/d18/d26/d48/fc6 [0,4194304] 0 2024-04-18T04:58:08.335 INFO:tasks.workunit.client.0.smithi096.stdout:0/658: dread d16/d1c/d4c/d4d/d5d/f7b [0,4194304] 0 2024-04-18T04:58:08.337 INFO:tasks.workunit.client.0.smithi096.stdout:3/893: getdents dc/d26/d48/dee 0 2024-04-18T04:58:08.337 INFO:tasks.workunit.client.0.smithi096.stdout:0/659: dread - d16/d1c/d4c/d4e/fae zero size 2024-04-18T04:58:08.338 INFO:tasks.workunit.client.0.smithi096.stdout:1/756: creat de/d1d/d32/d73/ff5 x:0 0 0 2024-04-18T04:58:08.338 INFO:tasks.workunit.client.0.smithi096.stdout:7/711: chown db/d1f/d42/f5f 3343 1 2024-04-18T04:58:08.340 INFO:tasks.workunit.client.0.smithi096.stdout:2/974: mkdir df/d18/d24/d42/dd9/d142 0 2024-04-18T04:58:08.341 INFO:tasks.workunit.client.0.smithi096.stdout:9/789: mknod d0/de/d17/d56/cf8 0 2024-04-18T04:58:08.344 INFO:tasks.workunit.client.0.smithi096.stdout:7/712: write db/d1f/d5b/d6a/f8b [3017992,111575] 0 2024-04-18T04:58:08.346 INFO:tasks.workunit.client.0.smithi096.stdout:3/894: getdents dc/d26/d4a/ddf 0 2024-04-18T04:58:08.348 INFO:tasks.workunit.client.0.smithi096.stdout:2/975: getdents df/d18/d24/d42/d101 0 2024-04-18T04:58:08.349 INFO:tasks.workunit.client.0.smithi096.stdout:7/713: chown db/c64 98 1 2024-04-18T04:58:08.349 INFO:tasks.workunit.client.0.smithi096.stdout:3/895: chown dc/d26/d48/dc2/d95/de3 74 1 2024-04-18T04:58:08.349 INFO:tasks.workunit.client.0.smithi096.stdout:9/790: mkdir d0/de/d17/d56/d59/d68/df9 0 2024-04-18T04:58:08.351 INFO:tasks.workunit.client.0.smithi096.stdout:2/976: fdatasync df/f14 0 2024-04-18T04:58:08.352 INFO:tasks.workunit.client.0.smithi096.stdout:1/757: dwrite de/d1d/d32/d9a/dad/fd7 [0,4194304] 0 2024-04-18T04:58:08.353 INFO:tasks.workunit.client.0.smithi096.stdout:3/896: unlink dc/d26/d66/d7f/f85 0 2024-04-18T04:58:08.353 INFO:tasks.workunit.client.0.smithi096.stdout:0/660: dwrite d16/d1c/d4c/d4d/d5d/fc7 [0,4194304] 0 2024-04-18T04:58:08.354 INFO:tasks.workunit.client.0.smithi096.stdout:2/977: dread - df/d18/d24/d42/d3f/d4a/dbc/f102 zero size 2024-04-18T04:58:08.354 INFO:tasks.workunit.client.0.smithi096.stdout:3/897: chown dc/d5d 484558151 1 2024-04-18T04:58:08.355 INFO:tasks.workunit.client.0.smithi096.stdout:0/661: write d16/f2b [3864598,126231] 0 2024-04-18T04:58:08.357 INFO:tasks.workunit.client.0.smithi096.stdout:3/898: rmdir dc/d26/d66 39 2024-04-18T04:58:08.359 INFO:tasks.workunit.client.0.smithi096.stdout:3/899: fdatasync dc/d26/d48/dae/fcc 0 2024-04-18T04:58:08.364 INFO:tasks.workunit.client.0.smithi096.stdout:0/662: mknod d16/d1c/d4c/d4d/d5a/ccc 0 2024-04-18T04:58:08.367 INFO:tasks.workunit.client.0.smithi096.stdout:9/791: truncate d0/d52/d5a/fa7 3553775 0 2024-04-18T04:58:08.368 INFO:tasks.workunit.client.0.smithi096.stdout:2/978: dwrite df/d18/d24/d42/dd9/f10a [0,4194304] 0 2024-04-18T04:58:08.377 INFO:tasks.workunit.client.0.smithi096.stdout:7/714: dwrite db/d1f/d24/d49/f86 [0,4194304] 0 2024-04-18T04:58:08.379 INFO:tasks.workunit.client.0.smithi096.stdout:1/758: dwrite de/d7b/f88 [0,4194304] 0 2024-04-18T04:58:08.380 INFO:tasks.workunit.client.0.smithi096.stdout:9/792: rmdir d0/de/d17/d56/d59/d68/df9 0 2024-04-18T04:58:08.383 INFO:tasks.workunit.client.0.smithi096.stdout:1/759: read - de/d1d/d32/d9a/feb zero size 2024-04-18T04:58:08.383 INFO:tasks.workunit.client.0.smithi096.stdout:7/715: dread db/d1f/d4e/f78 [0,4194304] 0 2024-04-18T04:58:08.383 INFO:tasks.workunit.client.0.smithi096.stdout:2/979: rename df/d7a to df/d18/d24/d42/d143 0 2024-04-18T04:58:08.385 INFO:tasks.workunit.client.0.smithi096.stdout:0/663: dwrite d16/d1c/d4c/d4d/d5d/d91/fa8 [0,4194304] 0 2024-04-18T04:58:08.385 INFO:tasks.workunit.client.0.smithi096.stdout:3/900: dwrite dc/d26/d48/dc2/f74 [0,4194304] 0 2024-04-18T04:58:08.385 INFO:tasks.workunit.client.0.smithi096.stdout:1/760: chown de/d1d/d3f/c48 129246 1 2024-04-18T04:58:08.388 INFO:tasks.workunit.client.0.smithi096.stdout:0/664: write d16/d1c/f98 [904660,100805] 0 2024-04-18T04:58:08.392 INFO:tasks.workunit.client.0.smithi096.stdout:2/980: creat df/d18/d26/d48/d7b/d10e/f144 x:0 0 0 2024-04-18T04:58:08.394 INFO:tasks.workunit.client.0.smithi096.stdout:1/761: mkdir de/d1d/d3f/d7a/df6 0 2024-04-18T04:58:08.398 INFO:tasks.workunit.client.0.smithi096.stdout:0/665: mknod d16/d1c/d4c/d6a/ccd 0 2024-04-18T04:58:08.398 INFO:tasks.workunit.client.0.smithi096.stdout:3/901: dwrite dc/d26/d48/dc2/d95/ff6 [0,4194304] 0 2024-04-18T04:58:08.399 INFO:tasks.workunit.client.0.smithi096.stdout:9/793: dwrite d0/de/d17/d56/d59/d68/f8e [0,4194304] 0 2024-04-18T04:58:08.401 INFO:tasks.workunit.client.0.smithi096.stdout:3/902: mknod dc/d26/d57/c122 0 2024-04-18T04:58:08.402 INFO:tasks.workunit.client.0.smithi096.stdout:1/762: rmdir de/d1d/d32 39 2024-04-18T04:58:08.404 INFO:tasks.workunit.client.0.smithi096.stdout:2/981: dwrite df/d18/d26/d48/f49 [0,4194304] 0 2024-04-18T04:58:08.407 INFO:tasks.workunit.client.0.smithi096.stdout:9/794: rmdir d0/de/d17/d2f/d40 39 2024-04-18T04:58:08.408 INFO:tasks.workunit.client.0.smithi096.stdout:3/903: creat dc/d26/d48/dc2/d29/d7e/d102/f123 x:0 0 0 2024-04-18T04:58:08.409 INFO:tasks.workunit.client.0.smithi096.stdout:2/982: mkdir df/d18/d87/d145 0 2024-04-18T04:58:08.410 INFO:tasks.workunit.client.0.smithi096.stdout:3/904: chown dc/d26/d4a/f10a 5100210 1 2024-04-18T04:58:08.411 INFO:tasks.workunit.client.0.smithi096.stdout:1/763: mknod de/d1d/d32/cf7 0 2024-04-18T04:58:08.414 INFO:tasks.workunit.client.0.smithi096.stdout:2/983: chown df/d18/d87/l122 225342889 1 2024-04-18T04:58:08.414 INFO:tasks.workunit.client.0.smithi096.stdout:1/764: write de/f12 [254476,14745] 0 2024-04-18T04:58:08.415 INFO:tasks.workunit.client.0.smithi096.stdout:7/716: dwrite db/fe [0,4194304] 0 2024-04-18T04:58:08.422 INFO:tasks.workunit.client.0.smithi096.stdout:9/795: dwrite d0/de/d17/d56/d59/d60/f8a [0,4194304] 0 2024-04-18T04:58:08.423 INFO:tasks.workunit.client.0.smithi096.stdout:7/717: getdents db/d1f/d5b/dda 0 2024-04-18T04:58:08.424 INFO:tasks.workunit.client.0.smithi096.stdout:3/905: dwrite dc/d5d/f6d [0,4194304] 0 2024-04-18T04:58:08.427 INFO:tasks.workunit.client.0.smithi096.stdout:3/906: fdatasync dc/d26/d48/dc2/d29/fff 0 2024-04-18T04:58:08.428 INFO:tasks.workunit.client.0.smithi096.stdout:9/796: read - d0/de/d17/d2f/d40/dd2/fe2 zero size 2024-04-18T04:58:08.428 INFO:tasks.workunit.client.0.smithi096.stdout:4/705: sync 2024-04-18T04:58:08.428 INFO:tasks.workunit.client.0.smithi096.stdout:7/718: mkdir db/d1f/d39/d6d/d79/de4 0 2024-04-18T04:58:08.438 INFO:tasks.workunit.client.0.smithi096.stdout:1/765: dwrite de/d1d/d32/d6f/f8a [0,4194304] 0 2024-04-18T04:58:08.440 INFO:tasks.workunit.client.0.smithi096.stdout:7/719: fsync db/d20/d2f/f37 0 2024-04-18T04:58:08.441 INFO:tasks.workunit.client.0.smithi096.stdout:3/907: write dc/d26/d4a/ddf/d93/fb8 [452293,6015] 0 2024-04-18T04:58:08.443 INFO:tasks.workunit.client.0.smithi096.stdout:4/706: write d4/d14/d2d/d44/d58/d86/d97/fb4 [2620892,16385] 0 2024-04-18T04:58:08.451 INFO:tasks.workunit.client.0.smithi096.stdout:1/766: rmdir de/d1d/d32/d9a/dad/dd3 39 2024-04-18T04:58:08.451 INFO:tasks.workunit.client.0.smithi096.stdout:9/797: write d0/de/d17/d56/d59/d60/faf [373577,107220] 0 2024-04-18T04:58:08.452 INFO:tasks.workunit.client.0.smithi096.stdout:3/908: fsync dc/d26/d4a/f91 0 2024-04-18T04:58:08.454 INFO:tasks.workunit.client.0.smithi096.stdout:7/720: creat db/d1f/d24/d49/d54/fe5 x:0 0 0 2024-04-18T04:58:08.455 INFO:tasks.workunit.client.0.smithi096.stdout:1/767: dread - de/d1d/d32/d6b/fdf zero size 2024-04-18T04:58:08.456 INFO:tasks.workunit.client.0.smithi096.stdout:1/768: readlink de/lc1 0 2024-04-18T04:58:08.456 INFO:tasks.workunit.client.0.smithi096.stdout:3/909: unlink dc/d26/d48/dc2/d95/da3/lb1 0 2024-04-18T04:58:08.457 INFO:tasks.workunit.client.0.smithi096.stdout:9/798: symlink d0/de/d17/d2f/d40/dd2/lfa 0 2024-04-18T04:58:08.457 INFO:tasks.workunit.client.0.smithi096.stdout:1/769: chown de/d1d/d32/d73/d8b/cc6 4719 1 2024-04-18T04:58:08.460 INFO:tasks.workunit.client.0.smithi096.stdout:2/984: dread df/d18/d71/d9c/fda [0,4194304] 0 2024-04-18T04:58:08.460 INFO:tasks.workunit.client.0.smithi096.stdout:7/721: getdents db/d1f/d4e 0 2024-04-18T04:58:08.464 INFO:tasks.workunit.client.0.smithi096.stdout:2/985: mknod df/d18/d26/d48/c146 0 2024-04-18T04:58:08.465 INFO:tasks.workunit.client.0.smithi096.stdout:7/722: truncate f5 862007 0 2024-04-18T04:58:08.465 INFO:tasks.workunit.client.0.smithi096.stdout:9/799: dwrite d0/de/d17/f3f [0,4194304] 0 2024-04-18T04:58:08.472 INFO:tasks.workunit.client.0.smithi096.stdout:7/723: creat db/d1f/d24/d49/d54/dc3/fe6 x:0 0 0 2024-04-18T04:58:08.472 INFO:tasks.workunit.client.0.smithi096.stdout:9/800: dread d0/d52/d5a/f76 [0,4194304] 0 2024-04-18T04:58:08.473 INFO:tasks.workunit.client.0.smithi096.stdout:7/724: write db/d1f/d24/d61/f84 [1889630,121100] 0 2024-04-18T04:58:08.477 INFO:tasks.workunit.client.0.smithi096.stdout:2/986: dwrite df/f69 [0,4194304] 0 2024-04-18T04:58:08.481 INFO:tasks.workunit.client.0.smithi096.stdout:3/910: dread dc/d26/d4a/f58 [4194304,4194304] 0 2024-04-18T04:58:08.483 INFO:tasks.workunit.client.0.smithi096.stdout:2/987: symlink df/d18/d26/d48/l147 0 2024-04-18T04:58:08.484 INFO:tasks.workunit.client.0.smithi096.stdout:4/707: dwrite d4/f87 [0,4194304] 0 2024-04-18T04:58:08.486 INFO:tasks.workunit.client.0.smithi096.stdout:3/911: write dc/d26/d48/dc2/fad [2003222,128683] 0 2024-04-18T04:58:08.490 INFO:tasks.workunit.client.0.smithi096.stdout:4/708: stat d4/d14/d2d/d44/d58/d86/d6f/dc5 0 2024-04-18T04:58:08.490 INFO:tasks.workunit.client.0.smithi096.stdout:1/770: dwrite de/d1d/d3f/d4f/f64 [0,4194304] 0 2024-04-18T04:58:08.490 INFO:tasks.workunit.client.0.smithi096.stdout:2/988: fsync df/d18/d24/d42/fb0 0 2024-04-18T04:58:08.491 INFO:tasks.workunit.client.0.smithi096.stdout:7/725: dread db/d20/fb8 [0,4194304] 0 2024-04-18T04:58:08.493 INFO:tasks.workunit.client.0.smithi096.stdout:3/912: write dc/d26/d4a/d8b/f10e [851845,21953] 0 2024-04-18T04:58:08.495 INFO:tasks.workunit.client.0.smithi096.stdout:2/989: chown df/d18/d24/f77 12695146 1 2024-04-18T04:58:08.495 INFO:tasks.workunit.client.0.smithi096.stdout:3/913: write dc/d26/d48/dc2/d29/d7e/d102/f10f [865329,20854] 0 2024-04-18T04:58:08.497 INFO:tasks.workunit.client.0.smithi096.stdout:4/709: rmdir d4/d7a 39 2024-04-18T04:58:08.497 INFO:tasks.workunit.client.0.smithi096.stdout:7/726: rmdir db/d1f/d24/d61 39 2024-04-18T04:58:08.497 INFO:tasks.workunit.client.0.smithi096.stdout:3/914: chown dc/d26/d4a 3 1 2024-04-18T04:58:08.497 INFO:tasks.workunit.client.0.smithi096.stdout:2/990: creat df/d18/d24/d42/d101/f148 x:0 0 0 2024-04-18T04:58:08.503 INFO:tasks.workunit.client.0.smithi096.stdout:4/710: chown d4/d14/c68 212317 1 2024-04-18T04:58:08.503 INFO:tasks.workunit.client.0.smithi096.stdout:9/801: dread d0/de/d17/d56/d59/f65 [0,4194304] 0 2024-04-18T04:58:08.504 INFO:tasks.workunit.client.0.smithi096.stdout:1/771: truncate de/d1d/d32/fb5 742675 0 2024-04-18T04:58:08.504 INFO:tasks.workunit.client.0.smithi096.stdout:7/727: chown db/d1f/d5b/fb4 1 1 2024-04-18T04:58:08.504 INFO:tasks.workunit.client.0.smithi096.stdout:1/772: dread - de/d1d/fbf zero size 2024-04-18T04:58:08.505 INFO:tasks.workunit.client.0.smithi096.stdout:3/915: mkdir dc/d26/d4a/ddf/d124 0 2024-04-18T04:58:08.505 INFO:tasks.workunit.client.0.smithi096.stdout:4/711: write d4/d14/d2d/d44/da2/fba [2078441,99867] 0 2024-04-18T04:58:08.507 INFO:tasks.workunit.client.0.smithi096.stdout:2/991: creat df/d18/d24/d42/dd9/d142/f149 x:0 0 0 2024-04-18T04:58:08.508 INFO:tasks.workunit.client.0.smithi096.stdout:1/773: mkdir de/d1d/d3f/d7a/d96/df8 0 2024-04-18T04:58:08.510 INFO:tasks.workunit.client.0.smithi096.stdout:2/992: chown df/f64 2875365 1 2024-04-18T04:58:08.511 INFO:tasks.workunit.client.0.smithi096.stdout:7/728: dread db/d20/fb8 [0,4194304] 0 2024-04-18T04:58:08.512 INFO:tasks.workunit.client.0.smithi096.stdout:3/916: rename dc/d26/d48/dc2/l81 to dc/d26/d48/dbd/l125 0 2024-04-18T04:58:08.513 INFO:tasks.workunit.client.0.smithi096.stdout:7/729: stat db/d1f/d4e/dc0 0 2024-04-18T04:58:08.514 INFO:tasks.workunit.client.0.smithi096.stdout:2/993: truncate df/d18/f23 4421063 0 2024-04-18T04:58:08.516 INFO:tasks.workunit.client.0.smithi096.stdout:7/730: read db/d20/d2f/f30 [1329934,26736] 0 2024-04-18T04:58:08.517 INFO:tasks.workunit.client.0.smithi096.stdout:4/712: dwrite d4/d14/d2d/d44/d58/f88 [0,4194304] 0 2024-04-18T04:58:08.517 INFO:tasks.workunit.client.0.smithi096.stdout:2/994: chown df/d18/d26/c3c 231103664 1 2024-04-18T04:58:08.518 INFO:tasks.workunit.client.0.smithi096.stdout:3/917: mknod dc/d26/d4a/ddf/c126 0 2024-04-18T04:58:08.519 INFO:tasks.workunit.client.0.smithi096.stdout:1/774: dwrite de/f6a [0,4194304] 0 2024-04-18T04:58:08.521 INFO:tasks.workunit.client.0.smithi096.stdout:7/731: write db/d1f/d24/d49/d54/dc3/fe6 [199784,111428] 0 2024-04-18T04:58:08.521 INFO:tasks.workunit.client.0.smithi096.stdout:2/995: write df/d18/d24/d42/d3f/fe6 [1446574,56800] 0 2024-04-18T04:58:08.524 INFO:tasks.workunit.client.0.smithi096.stdout:2/996: stat df/d18/d24/d42/d3f/d4a/dbc/ce5 0 2024-04-18T04:58:08.530 INFO:tasks.workunit.client.0.smithi096.stdout:4/713: link d4/d14/d2d/d44/d58/d86/d6f/db8/fc3 d4/d14/d2d/d44/d90/fdd 0 2024-04-18T04:58:08.531 INFO:tasks.workunit.client.0.smithi096.stdout:3/918: creat dc/d26/d48/dc2/f127 x:0 0 0 2024-04-18T04:58:08.531 INFO:tasks.workunit.client.0.smithi096.stdout:2/997: link df/d18/d71/d9c/cac df/d18/d71/c14a 0 2024-04-18T04:58:08.533 INFO:tasks.workunit.client.0.smithi096.stdout:4/714: fdatasync d4/d14/d2d/d44/d58/d86/d6f/f77 0 2024-04-18T04:58:08.533 INFO:tasks.workunit.client.0.smithi096.stdout:7/732: dwrite db/d1f/f41 [0,4194304] 0 2024-04-18T04:58:08.536 INFO:tasks.workunit.client.0.smithi096.stdout:4/715: fsync d4/d14/d2d/d44/d58/d86/d97/fb4 0 2024-04-18T04:58:08.545 INFO:tasks.workunit.client.0.smithi096.stdout:1/775: dread de/f5e [0,4194304] 0 2024-04-18T04:58:08.545 INFO:tasks.workunit.client.0.smithi096.stdout:2/998: dwrite df/d18/d24/faf [0,4194304] 0 2024-04-18T04:58:08.548 INFO:tasks.workunit.client.0.smithi096.stdout:2/999: mkdir df/d18/d26/d137/d14b 0 2024-04-18T04:58:08.549 INFO:tasks.workunit.client.0.smithi096.stdout:1/776: creat de/d1d/d3f/d4f/ff9 x:0 0 0 2024-04-18T04:58:08.550 INFO:tasks.workunit.client.0.smithi096.stdout:4/716: dread d4/d14/d1d/f52 [0,4194304] 0 2024-04-18T04:58:08.551 INFO:tasks.workunit.client.0.smithi096.stdout:7/733: dwrite db/d20/d45/f63 [0,4194304] 0 2024-04-18T04:58:08.553 INFO:tasks.workunit.client.0.smithi096.stdout:3/919: dread dc/d26/d4a/f91 [0,4194304] 0 2024-04-18T04:58:08.554 INFO:tasks.workunit.client.0.smithi096.stdout:1/777: unlink de/d1d/d3f/d4f/da9/cc5 0 2024-04-18T04:58:08.554 INFO:tasks.workunit.client.0.smithi096.stdout:7/734: rmdir db/d1f/d24/d49/d54 39 2024-04-18T04:58:08.559 INFO:tasks.workunit.client.0.smithi096.stdout:7/735: rename db/d1d/d82/fa5 to db/d1f/d5b/fe7 0 2024-04-18T04:58:08.559 INFO:tasks.workunit.client.0.smithi096.stdout:1/778: dread de/d1d/d3f/d4f/f64 [0,4194304] 0 2024-04-18T04:58:08.562 INFO:tasks.workunit.client.0.smithi096.stdout:1/779: read de/d1d/d3f/d4f/fa4 [2253826,85696] 0 2024-04-18T04:58:08.562 INFO:tasks.workunit.client.0.smithi096.stdout:1/780: chown de/c13 41938 1 2024-04-18T04:58:08.563 INFO:tasks.workunit.client.0.smithi096.stdout:3/920: creat dc/d26/d4a/ddf/d124/f128 x:0 0 0 2024-04-18T04:58:08.565 INFO:tasks.workunit.client.0.smithi096.stdout:4/717: truncate d4/d14/d2d/d44/d58/d86/d3a/d47/f94 679305 0 2024-04-18T04:58:08.568 INFO:tasks.workunit.client.0.smithi096.stdout:3/921: creat dc/d26/d4a/f129 x:0 0 0 2024-04-18T04:58:08.568 INFO:tasks.workunit.client.0.smithi096.stdout:7/736: mknod db/ce8 0 2024-04-18T04:58:08.569 INFO:tasks.workunit.client.0.smithi096.stdout:7/737: write db/d1f/d39/d6d/d79/d83/fae [111563,33509] 0 2024-04-18T04:58:08.571 INFO:tasks.workunit.client.0.smithi096.stdout:4/718: rename d4/d14/d2d/d44/da2/cc0 to d4/d14/d2d/d44/d58/d86/d3a/cde 0 2024-04-18T04:58:08.573 INFO:tasks.workunit.client.0.smithi096.stdout:3/922: write dc/d26/d4a/ddf/d93/fb9 [1711801,56835] 0 2024-04-18T04:58:08.574 INFO:tasks.workunit.client.0.smithi096.stdout:1/781: creat de/d1d/d3f/d4f/ffa x:0 0 0 2024-04-18T04:58:08.576 INFO:tasks.workunit.client.0.smithi096.stdout:7/738: creat db/d20/d2f/dcb/fe9 x:0 0 0 2024-04-18T04:58:08.579 INFO:tasks.workunit.client.0.smithi096.stdout:7/739: creat db/d1f/d5b/d6a/dc6/fea x:0 0 0 2024-04-18T04:58:08.580 INFO:tasks.workunit.client.0.smithi096.stdout:4/719: dread d4/d14/d16/f38 [0,4194304] 0 2024-04-18T04:58:08.583 INFO:tasks.workunit.client.0.smithi096.stdout:7/740: mknod db/d1f/d24/d61/de1/ceb 0 2024-04-18T04:58:08.584 INFO:tasks.workunit.client.0.smithi096.stdout:1/782: dwrite de/d1d/d32/d6b/fdf [0,4194304] 0 2024-04-18T04:58:08.588 INFO:tasks.workunit.client.0.smithi096.stdout:3/923: dread dc/d5d/f9f [0,4194304] 0 2024-04-18T04:58:08.588 INFO:tasks.workunit.client.0.smithi096.stdout:1/783: rename de/d1d/d81/da7 to de/d1d/d32/d6f/d85/dfb 0 2024-04-18T04:58:08.590 INFO:tasks.workunit.client.0.smithi096.stdout:4/720: dread d4/d14/d16/f7d [0,4194304] 0 2024-04-18T04:58:08.591 INFO:tasks.workunit.client.0.smithi096.stdout:3/924: rename dc/dcf/ld0 to dc/d26/d4a/d8b/l12a 0 2024-04-18T04:58:08.592 INFO:tasks.workunit.client.0.smithi096.stdout:7/741: link db/d1f/d24/d49/ca0 db/d1f/d39/d6d/cec 0 2024-04-18T04:58:08.593 INFO:tasks.workunit.client.0.smithi096.stdout:3/925: write dc/d26/d48/fd6 [5199552,58062] 0 2024-04-18T04:58:08.596 INFO:tasks.workunit.client.0.smithi096.stdout:1/784: mknod de/d1d/d3f/d7a/d96/df8/cfc 0 2024-04-18T04:58:08.597 INFO:tasks.workunit.client.0.smithi096.stdout:3/926: creat dc/d26/d4a/d8b/f12b x:0 0 0 2024-04-18T04:58:08.598 INFO:tasks.workunit.client.0.smithi096.stdout:7/742: symlink db/d20/d45/dcf/dd6/dde/led 0 2024-04-18T04:58:08.598 INFO:tasks.workunit.client.0.smithi096.stdout:1/785: creat de/d1d/d32/d73/d8b/dca/ffd x:0 0 0 2024-04-18T04:58:08.600 INFO:tasks.workunit.client.0.smithi096.stdout:7/743: symlink db/d1d/lee 0 2024-04-18T04:58:08.601 INFO:tasks.workunit.client.0.smithi096.stdout:1/786: dread de/d1d/f66 [4194304,4194304] 0 2024-04-18T04:58:08.603 INFO:tasks.workunit.client.0.smithi096.stdout:1/787: chown de/d1d/d3f/f45 2280881 1 2024-04-18T04:58:08.604 INFO:tasks.workunit.client.0.smithi096.stdout:7/744: creat db/d1f/d24/d61/de1/fef x:0 0 0 2024-04-18T04:58:08.605 INFO:tasks.workunit.client.0.smithi096.stdout:7/745: fsync db/f3f 0 2024-04-18T04:58:08.607 INFO:tasks.workunit.client.0.smithi096.stdout:3/927: dwrite dc/f56 [4194304,4194304] 0 2024-04-18T04:58:08.607 INFO:tasks.workunit.client.0.smithi096.stdout:4/721: dread d4/d14/d16/f40 [8388608,4194304] 0 2024-04-18T04:58:08.609 INFO:tasks.workunit.client.0.smithi096.stdout:7/746: getdents db/d1f/d5b/d6a/dc6 0 2024-04-18T04:58:08.611 INFO:tasks.workunit.client.0.smithi096.stdout:3/928: truncate dc/d70/fc9 50058 0 2024-04-18T04:58:08.613 INFO:tasks.workunit.client.0.smithi096.stdout:7/747: mkdir db/d1f/d4e/df0 0 2024-04-18T04:58:08.615 INFO:tasks.workunit.client.0.smithi096.stdout:1/788: dwrite de/d1d/d32/d9a/fea [0,4194304] 0 2024-04-18T04:58:08.615 INFO:tasks.workunit.client.0.smithi096.stdout:3/929: mknod dc/d26/d4a/ddf/d124/c12c 0 2024-04-18T04:58:08.615 INFO:tasks.workunit.client.0.smithi096.stdout:7/748: chown db/d1f/d24/d61/ca9 202 1 2024-04-18T04:58:08.616 INFO:tasks.workunit.client.0.smithi096.stdout:4/722: getdents d4/d14/d2d/d44/d90 0 2024-04-18T04:58:08.619 INFO:tasks.workunit.client.0.smithi096.stdout:3/930: creat dc/d26/d4a/d8b/f12d x:0 0 0 2024-04-18T04:58:08.619 INFO:tasks.workunit.client.0.smithi096.stdout:1/789: dread - de/d1d/d3f/f61 zero size 2024-04-18T04:58:08.621 INFO:tasks.workunit.client.0.smithi096.stdout:4/723: read d4/d14/d2d/d44/d63/f7f [1635499,57773] 0 2024-04-18T04:58:08.622 INFO:tasks.workunit.client.0.smithi096.stdout:7/749: mkdir db/d1f/d39/d6d/d79/d83/daa/df1 0 2024-04-18T04:58:08.623 INFO:tasks.workunit.client.0.smithi096.stdout:3/931: symlink dc/dcf/dd2/l12e 0 2024-04-18T04:58:08.624 INFO:tasks.workunit.client.0.smithi096.stdout:3/932: write dc/d26/d48/dc2/d29/f6f [3736922,82921] 0 2024-04-18T04:58:08.624 INFO:tasks.workunit.client.0.smithi096.stdout:3/933: dread - dc/ff7 zero size 2024-04-18T04:58:08.625 INFO:tasks.workunit.client.0.smithi096.stdout:3/934: write dc/d5d/f9b [3436389,35060] 0 2024-04-18T04:58:08.627 INFO:tasks.workunit.client.0.smithi096.stdout:4/724: rmdir d4/d14/d2d 39 2024-04-18T04:58:08.632 INFO:tasks.workunit.client.0.smithi096.stdout:1/790: link l2 de/d1d/d32/d6f/d85/lfe 0 2024-04-18T04:58:08.633 INFO:tasks.workunit.client.0.smithi096.stdout:3/935: mkdir dc/d12f 0 2024-04-18T04:58:08.634 INFO:tasks.workunit.client.0.smithi096.stdout:1/791: mknod de/d1d/d81/dda/cff 0 2024-04-18T04:58:08.635 INFO:tasks.workunit.client.0.smithi096.stdout:3/936: symlink dc/d26/d48/dbd/dd3/l130 0 2024-04-18T04:58:08.636 INFO:tasks.workunit.client.0.smithi096.stdout:3/937: fdatasync dc/d26/f111 0 2024-04-18T04:58:08.638 INFO:tasks.workunit.client.0.smithi096.stdout:1/792: getdents de/d1d/d3f/d7a/d96 0 2024-04-18T04:58:08.640 INFO:tasks.workunit.client.0.smithi096.stdout:7/750: dwrite db/ff [0,4194304] 0 2024-04-18T04:58:08.640 INFO:tasks.workunit.client.0.smithi096.stdout:3/938: unlink dc/d26/d48/f107 0 2024-04-18T04:58:08.640 INFO:tasks.workunit.client.0.smithi096.stdout:4/725: dread d4/d14/d2d/d44/d63/f7f [0,4194304] 0 2024-04-18T04:58:08.640 INFO:tasks.workunit.client.0.smithi096.stdout:1/793: stat de/d1d/d81/dda/ce1 0 2024-04-18T04:58:08.641 INFO:tasks.workunit.client.0.smithi096.stdout:3/939: chown dc/d26 37 1 2024-04-18T04:58:08.641 INFO:tasks.workunit.client.0.smithi096.stdout:4/726: chown d4/l7c 1437486 1 2024-04-18T04:58:08.641 INFO:tasks.workunit.client.0.smithi096.stdout:1/794: chown de/d1d/fab 21563 1 2024-04-18T04:58:08.643 INFO:tasks.workunit.client.0.smithi096.stdout:7/751: read db/d1f/d24/d49/d54/dc3/fe6 [245140,18105] 0 2024-04-18T04:58:08.643 INFO:tasks.workunit.client.0.smithi096.stdout:4/727: fdatasync d4/f18 0 2024-04-18T04:58:08.645 INFO:tasks.workunit.client.0.smithi096.stdout:3/940: rename dc/d26/d48/dc2/d95/da3/cb2 to dc/d12f/c131 0 2024-04-18T04:58:08.646 INFO:tasks.workunit.client.0.smithi096.stdout:3/941: fsync dc/d26/d48/dc2/d95/fec 0 2024-04-18T04:58:08.649 INFO:tasks.workunit.client.0.smithi096.stdout:4/728: write d4/d14/d2d/d44/d58/d86/d6f/db8/fbe [715090,120644] 0 2024-04-18T04:58:08.649 INFO:tasks.workunit.client.0.smithi096.stdout:1/795: creat de/d1d/d3f/d4f/f100 x:0 0 0 2024-04-18T04:58:08.653 INFO:tasks.workunit.client.0.smithi096.stdout:1/796: symlink de/d1d/d3f/d7a/df6/l101 0 2024-04-18T04:58:08.654 INFO:tasks.workunit.client.0.smithi096.stdout:7/752: dwrite db/d1f/d39/d6d/d79/f9a [4194304,4194304] 0 2024-04-18T04:58:08.654 INFO:tasks.workunit.client.0.smithi096.stdout:3/942: dread dc/d26/d48/dc2/d95/ff6 [0,4194304] 0 2024-04-18T04:58:08.655 INFO:tasks.workunit.client.0.smithi096.stdout:4/729: write d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/fb0 [4166484,24591] 0 2024-04-18T04:58:08.655 INFO:tasks.workunit.client.0.smithi096.stdout:1/797: write de/d1d/fab [2198305,88703] 0 2024-04-18T04:58:08.657 INFO:tasks.workunit.client.0.smithi096.stdout:1/798: write f6 [2659361,87883] 0 2024-04-18T04:58:08.659 INFO:tasks.workunit.client.0.smithi096.stdout:4/730: fsync d4/d14/f6a 0 2024-04-18T04:58:08.660 INFO:tasks.workunit.client.0.smithi096.stdout:4/731: chown d4/d14/d1d/f27 17980401 1 2024-04-18T04:58:08.661 INFO:tasks.workunit.client.0.smithi096.stdout:8/611: sync 2024-04-18T04:58:08.661 INFO:tasks.workunit.client.0.smithi096.stdout:3/943: fsync dc/d26/d48/dae/f11a 0 2024-04-18T04:58:08.665 INFO:tasks.workunit.client.0.smithi096.stdout:8/612: write d0/d7/d24/d18/d5d/f98 [215574,80027] 0 2024-04-18T04:58:08.667 INFO:tasks.workunit.client.0.smithi096.stdout:3/944: fsync dc/d26/d66/faf 0 2024-04-18T04:58:08.669 INFO:tasks.workunit.client.0.smithi096.stdout:7/753: dwrite db/d1f/d42/f65 [0,4194304] 0 2024-04-18T04:58:08.670 INFO:tasks.workunit.client.0.smithi096.stdout:1/799: dread f9 [0,4194304] 0 2024-04-18T04:58:08.674 INFO:tasks.workunit.client.0.smithi096.stdout:3/945: getdents dc/d26/d48/dc2 0 2024-04-18T04:58:08.674 INFO:tasks.workunit.client.0.smithi096.stdout:1/800: creat de/d1d/d32/d73/d8b/f102 x:0 0 0 2024-04-18T04:58:08.677 INFO:tasks.workunit.client.0.smithi096.stdout:8/613: dwrite d0/d7/d24/f45 [0,4194304] 0 2024-04-18T04:58:08.679 INFO:tasks.workunit.client.0.smithi096.stdout:7/754: dwrite db/d1d/f5a [0,4194304] 0 2024-04-18T04:58:08.680 INFO:tasks.workunit.client.0.smithi096.stdout:7/755: chown db/d1f/d5b/d6a/d74 29430539 1 2024-04-18T04:58:08.682 INFO:tasks.workunit.client.0.smithi096.stdout:3/946: rename dc/d26/d48/dc2/l112 to dc/d26/d4a/ddf/d93/l132 0 2024-04-18T04:58:08.683 INFO:tasks.workunit.client.0.smithi096.stdout:8/614: mkdir d0/d3/dc1 0 2024-04-18T04:58:08.684 INFO:tasks.workunit.client.0.smithi096.stdout:7/756: truncate db/d1f/d5b/d6a/d74/f81 516057 0 2024-04-18T04:58:08.686 INFO:tasks.workunit.client.0.smithi096.stdout:1/801: dwrite de/d1d/d3f/d7a/d96/f98 [0,4194304] 0 2024-04-18T04:58:08.694 INFO:tasks.workunit.client.0.smithi096.stdout:8/615: rename d0/d3/d32/d6b/fa3 to d0/d7/d24/d18/d5d/fc2 0 2024-04-18T04:58:08.694 INFO:tasks.workunit.client.0.smithi096.stdout:8/616: chown d0/d3 425489 1 2024-04-18T04:58:08.699 INFO:tasks.workunit.client.0.smithi096.stdout:3/947: truncate dc/d26/d48/dc2/f3e 3780911 0 2024-04-18T04:58:08.701 INFO:tasks.workunit.client.0.smithi096.stdout:1/802: dread de/fbe [0,4194304] 0 2024-04-18T04:58:08.703 INFO:tasks.workunit.client.0.smithi096.stdout:7/757: dread db/d1d/d82/f8c [0,4194304] 0 2024-04-18T04:58:08.711 INFO:tasks.workunit.client.0.smithi096.stdout:8/617: dread d0/d7/d24/d18/d5d/fb5 [0,4194304] 0 2024-04-18T04:58:08.712 INFO:tasks.workunit.client.0.smithi096.stdout:3/948: dwrite dc/d26/d48/dc2/d29/f11e [0,4194304] 0 2024-04-18T04:58:08.714 INFO:tasks.workunit.client.0.smithi096.stdout:7/758: dwrite db/d1f/d5b/d6a/d74/f81 [0,4194304] 0 2024-04-18T04:58:08.714 INFO:tasks.workunit.client.0.smithi096.stdout:8/618: mkdir d0/d15/dc3 0 2024-04-18T04:58:08.716 INFO:tasks.workunit.client.0.smithi096.stdout:8/619: write d0/d3/fb0 [769773,93459] 0 2024-04-18T04:58:08.719 INFO:tasks.workunit.client.0.smithi096.stdout:7/759: truncate db/d20/d2f/d8d/da1/fd3 473894 0 2024-04-18T04:58:08.721 INFO:tasks.workunit.client.0.smithi096.stdout:1/803: dread de/d1d/d32/d6f/d85/dfb/fae [0,4194304] 0 2024-04-18T04:58:08.722 INFO:tasks.workunit.client.0.smithi096.stdout:1/804: dread - de/d1d/d81/ded/ff2 zero size 2024-04-18T04:58:08.726 INFO:tasks.workunit.client.0.smithi096.stdout:1/805: rename de/d1d/d32/c43 to de/d1d/d3f/d7a/c103 0 2024-04-18T04:58:08.727 INFO:tasks.workunit.client.0.smithi096.stdout:8/620: write d0/d7/d24/d35/f5e [864971,20090] 0 2024-04-18T04:58:08.729 INFO:tasks.workunit.client.0.smithi096.stdout:3/949: dwrite dc/d26/f111 [0,4194304] 0 2024-04-18T04:58:08.729 INFO:tasks.workunit.client.0.smithi096.stdout:8/621: read - d0/d3/d32/fb4 zero size 2024-04-18T04:58:08.731 INFO:tasks.workunit.client.0.smithi096.stdout:3/950: mknod dc/d26/d4a/d8b/c133 0 2024-04-18T04:58:08.731 INFO:tasks.workunit.client.0.smithi096.stdout:8/622: truncate d0/d7/d24/d18/d27/d60/fac 329992 0 2024-04-18T04:58:08.733 INFO:tasks.workunit.client.0.smithi096.stdout:8/623: creat d0/d7/d86/fc4 x:0 0 0 2024-04-18T04:58:08.734 INFO:tasks.workunit.client.0.smithi096.stdout:8/624: dread - d0/d7/d86/fc4 zero size 2024-04-18T04:58:08.734 INFO:tasks.workunit.client.0.smithi096.stdout:3/951: creat dc/d26/d4a/ddf/f134 x:0 0 0 2024-04-18T04:58:08.735 INFO:tasks.workunit.client.0.smithi096.stdout:8/625: dread - d0/d7/d24/d35/d51/f7f zero size 2024-04-18T04:58:08.739 INFO:tasks.workunit.client.0.smithi096.stdout:8/626: link d0/d7/d24/d18/d27/laf d0/d7/d86/d91/lc5 0 2024-04-18T04:58:08.745 INFO:tasks.workunit.client.0.smithi096.stdout:1/806: dread de/d1d/d32/f69 [0,4194304] 0 2024-04-18T04:58:08.747 INFO:tasks.workunit.client.0.smithi096.stdout:1/807: chown de/d1d/d32/d6f/d85/lb1 217 1 2024-04-18T04:58:08.748 INFO:tasks.workunit.client.0.smithi096.stdout:3/952: dread dc/d26/d48/dc2/d29/fff [8388608,4194304] 0 2024-04-18T04:58:08.749 INFO:tasks.workunit.client.0.smithi096.stdout:8/627: dwrite d0/d7/f2b [0,4194304] 0 2024-04-18T04:58:08.750 INFO:tasks.workunit.client.0.smithi096.stdout:3/953: creat dc/d12f/f135 x:0 0 0 2024-04-18T04:58:08.750 INFO:tasks.workunit.client.0.smithi096.stdout:1/808: getdents de/d1d/d32/d73/d8b/dc2/dcb 0 2024-04-18T04:58:08.752 INFO:tasks.workunit.client.0.smithi096.stdout:8/628: stat d0/d7/d24/d18/d27/laf 0 2024-04-18T04:58:08.754 INFO:tasks.workunit.client.0.smithi096.stdout:3/954: fdatasync dc/d26/d48/dc2/d95/da3/fc8 0 2024-04-18T04:58:08.754 INFO:tasks.workunit.client.0.smithi096.stdout:8/629: truncate d0/d7/d24/f82 419644 0 2024-04-18T04:58:08.759 INFO:tasks.workunit.client.0.smithi096.stdout:8/630: link d0/d15/d65/d8f/c9e d0/d3/d32/cc6 0 2024-04-18T04:58:08.760 INFO:tasks.workunit.client.0.smithi096.stdout:1/809: dwrite de/d1d/d3f/d4f/f7d [0,4194304] 0 2024-04-18T04:58:08.763 INFO:tasks.workunit.client.0.smithi096.stdout:3/955: dwrite dc/d26/d48/dc2/f46 [4194304,4194304] 0 2024-04-18T04:58:08.766 INFO:tasks.workunit.client.0.smithi096.stdout:1/810: creat de/d1d/d32/d9a/dad/dd3/f104 x:0 0 0 2024-04-18T04:58:08.767 INFO:tasks.workunit.client.0.smithi096.stdout:8/631: link d0/d3/l2e d0/d7/d24/d35/d51/lc7 0 2024-04-18T04:58:08.767 INFO:tasks.workunit.client.0.smithi096.stdout:1/811: chown de/d7b/fc9 118226 1 2024-04-18T04:58:08.768 INFO:tasks.workunit.client.0.smithi096.stdout:1/812: chown c8 1560103 1 2024-04-18T04:58:08.768 INFO:tasks.workunit.client.0.smithi096.stdout:1/813: stat de/d1d/d32/cf7 0 2024-04-18T04:58:08.769 INFO:tasks.workunit.client.0.smithi096.stdout:3/956: getdents dc/d26/d57 0 2024-04-18T04:58:08.771 INFO:tasks.workunit.client.0.smithi096.stdout:3/957: write dc/d5d/f9f [1528597,44491] 0 2024-04-18T04:58:08.772 INFO:tasks.workunit.client.0.smithi096.stdout:3/958: truncate dc/d5d/f9f 4382631 0 2024-04-18T04:58:08.773 INFO:tasks.workunit.client.0.smithi096.stdout:1/814: rename de/d1d/d32/d6b/fdf to de/d1d/d32/d8c/f105 0 2024-04-18T04:58:08.776 INFO:tasks.workunit.client.0.smithi096.stdout:1/815: unlink de/d1d/d32/d6f/lb7 0 2024-04-18T04:58:08.776 INFO:tasks.workunit.client.0.smithi096.stdout:1/816: readlink de/d1d/l55 0 2024-04-18T04:58:08.777 INFO:tasks.workunit.client.0.smithi096.stdout:1/817: dread - de/d1d/d3f/d4f/ffa zero size 2024-04-18T04:58:08.779 INFO:tasks.workunit.client.0.smithi096.stdout:1/818: symlink de/d1d/d3f/d4f/da9/l106 0 2024-04-18T04:58:08.785 INFO:tasks.workunit.client.0.smithi096.stdout:8/632: dread d0/d7/f73 [0,4194304] 0 2024-04-18T04:58:08.785 INFO:tasks.workunit.client.0.smithi096.stdout:8/633: fdatasync d0/d3/d32/fb4 0 2024-04-18T04:58:08.789 INFO:tasks.workunit.client.0.smithi096.stdout:1/819: write de/f16 [527497,46945] 0 2024-04-18T04:58:08.789 INFO:tasks.workunit.client.0.smithi096.stdout:3/959: dread dc/d26/d66/d7f/fbe [0,4194304] 0 2024-04-18T04:58:08.791 INFO:tasks.workunit.client.0.smithi096.stdout:1/820: symlink de/d1d/d32/d6f/d85/dfb/l107 0 2024-04-18T04:58:08.792 INFO:tasks.workunit.client.0.smithi096.stdout:1/821: write de/d7b/f80 [1482406,47054] 0 2024-04-18T04:58:08.793 INFO:tasks.workunit.client.0.smithi096.stdout:3/960: unlink dc/d26/d48/dc2/d29/d7e/cb7 0 2024-04-18T04:58:08.794 INFO:tasks.workunit.client.0.smithi096.stdout:8/634: truncate d0/d7/d24/f82 282329 0 2024-04-18T04:58:08.796 INFO:tasks.workunit.client.0.smithi096.stdout:1/822: rename de/d1d/d3f/d5f/cb8 to de/d1d/d81/ded/c108 0 2024-04-18T04:58:08.798 INFO:tasks.workunit.client.0.smithi096.stdout:8/635: mknod d0/d7/d86/cc8 0 2024-04-18T04:58:08.801 INFO:tasks.workunit.client.0.smithi096.stdout:1/823: rename de/d1d/d3f/d7a to de/d109 0 2024-04-18T04:58:08.801 INFO:tasks.workunit.client.0.smithi096.stdout:1/824: chown de/d1d/d3f/l58 36826 1 2024-04-18T04:58:08.802 INFO:tasks.workunit.client.0.smithi096.stdout:1/825: readlink de/d1d/d32/d6f/ld0 0 2024-04-18T04:58:08.802 INFO:tasks.workunit.client.0.smithi096.stdout:3/961: unlink dc/d26/d48/la6 0 2024-04-18T04:58:08.805 INFO:tasks.workunit.client.0.smithi096.stdout:0/666: sync 2024-04-18T04:58:08.805 INFO:tasks.workunit.client.0.smithi096.stdout:5/658: sync 2024-04-18T04:58:08.805 INFO:tasks.workunit.client.0.smithi096.stdout:3/962: chown dc/d26/d48/dbd/l125 101758676 1 2024-04-18T04:58:08.808 INFO:tasks.workunit.client.0.smithi096.stdout:3/963: write dc/d26/d48/dc2/f127 [854410,15188] 0 2024-04-18T04:58:08.809 INFO:tasks.workunit.client.0.smithi096.stdout:0/667: dread d16/d1c/d4c/d4d/d5d/f97 [0,4194304] 0 2024-04-18T04:58:08.810 INFO:tasks.workunit.client.0.smithi096.stdout:8/636: dread d0/d7/d24/d18/d5d/fc2 [0,4194304] 0 2024-04-18T04:58:08.811 INFO:tasks.workunit.client.0.smithi096.stdout:5/659: dread d7/dd/d8f/da2/de2/de3/d36/dd5/fed [0,4194304] 0 2024-04-18T04:58:08.812 INFO:tasks.workunit.client.0.smithi096.stdout:3/964: truncate dc/d26/d4a/ddf/fba 1045284 0 2024-04-18T04:58:08.813 INFO:tasks.workunit.client.0.smithi096.stdout:3/965: chown f3 116364 1 2024-04-18T04:58:08.813 INFO:tasks.workunit.client.0.smithi096.stdout:8/637: mkdir d0/d3/d32/d6b/d7b/dc9 0 2024-04-18T04:58:08.813 INFO:tasks.workunit.client.0.smithi096.stdout:5/660: mkdir d7/d25/d7c/df1 0 2024-04-18T04:58:08.814 INFO:tasks.workunit.client.0.smithi096.stdout:8/638: write d0/d7/d24/d35/d51/f7f [329354,36736] 0 2024-04-18T04:58:08.814 INFO:tasks.workunit.client.0.smithi096.stdout:3/966: mknod dc/d26/d57/c136 0 2024-04-18T04:58:08.815 INFO:tasks.workunit.client.0.smithi096.stdout:5/661: dread - d7/d25/d2b/f3d zero size 2024-04-18T04:58:08.815 INFO:tasks.workunit.client.0.smithi096.stdout:0/668: getdents d16/d1c/d4c/d4d/d5a 0 2024-04-18T04:58:08.816 INFO:tasks.workunit.client.0.smithi096.stdout:3/967: chown dc/d26/d48/dc2/d95/de3 63422 1 2024-04-18T04:58:08.817 INFO:tasks.workunit.client.0.smithi096.stdout:8/639: mknod d0/d7/d24/d78/cca 0 2024-04-18T04:58:08.817 INFO:tasks.workunit.client.0.smithi096.stdout:5/662: chown d7/dd/d8f/da2/de2/de3/d52/f6d 5697 1 2024-04-18T04:58:08.817 INFO:tasks.workunit.client.0.smithi096.stdout:0/669: creat d16/d1c/d4c/d6a/fce x:0 0 0 2024-04-18T04:58:08.818 INFO:tasks.workunit.client.0.smithi096.stdout:0/670: read - d16/d1c/d4c/d4e/d67/fb4 zero size 2024-04-18T04:58:08.821 INFO:tasks.workunit.client.0.smithi096.stdout:0/671: symlink d16/d1c/d22/lcf 0 2024-04-18T04:58:08.825 INFO:tasks.workunit.client.0.smithi096.stdout:3/968: dwrite dc/d5d/f5c [4194304,4194304] 0 2024-04-18T04:58:08.825 INFO:tasks.workunit.client.0.smithi096.stdout:0/672: truncate d16/d1c/d4c/d4d/fb7 1016006 0 2024-04-18T04:58:08.826 INFO:tasks.workunit.client.0.smithi096.stdout:8/640: rmdir d0/d3 39 2024-04-18T04:58:08.826 INFO:tasks.workunit.client.0.smithi096.stdout:0/673: stat d16/d1c/f88 0 2024-04-18T04:58:08.827 INFO:tasks.workunit.client.0.smithi096.stdout:5/663: dwrite d7/dd/d8f/da2/de2/de3/d52/f65 [0,4194304] 0 2024-04-18T04:58:08.827 INFO:tasks.workunit.client.0.smithi096.stdout:3/969: readlink dc/d26/d4a/ddf/l10d 0 2024-04-18T04:58:08.828 INFO:tasks.workunit.client.0.smithi096.stdout:5/664: write d7/dd/d35/db1/fb8 [179896,22427] 0 2024-04-18T04:58:08.831 INFO:tasks.workunit.client.0.smithi096.stdout:8/641: unlink d0/d4f/f79 0 2024-04-18T04:58:08.832 INFO:tasks.workunit.client.0.smithi096.stdout:8/642: chown d0/d15/d65/d8f 1947967569 1 2024-04-18T04:58:08.834 INFO:tasks.workunit.client.0.smithi096.stdout:5/665: rename d7/dd/d35/db1/fb8 to d7/d25/d2b/ff2 0 2024-04-18T04:58:08.834 INFO:tasks.workunit.client.0.smithi096.stdout:0/674: mknod d16/d1c/d4c/d4d/d5d/cd0 0 2024-04-18T04:58:08.923 INFO:tasks.workunit.client.0.smithi096.stdout:8/643: creat d0/d3/d32/fcb x:0 0 0 2024-04-18T04:58:08.925 INFO:tasks.workunit.client.0.smithi096.stdout:5/666: creat d7/dd/d8f/da2/de2/de3/d56/ddd/ff3 x:0 0 0 2024-04-18T04:58:08.925 INFO:tasks.workunit.client.0.smithi096.stdout:0/675: symlink d16/ld1 0 2024-04-18T04:58:08.927 INFO:tasks.workunit.client.0.smithi096.stdout:5/667: fdatasync d7/d25/d2b/fd8 0 2024-04-18T04:58:08.929 INFO:tasks.workunit.client.0.smithi096.stdout:5/668: readlink d7/da3/laf 0 2024-04-18T04:58:08.929 INFO:tasks.workunit.client.0.smithi096.stdout:8/644: read d0/d7/d24/d78/f4e [296811,33248] 0 2024-04-18T04:58:08.930 INFO:tasks.workunit.client.0.smithi096.stdout:0/676: creat d16/d1c/d22/d2c/fd2 x:0 0 0 2024-04-18T04:58:08.936 INFO:tasks.workunit.client.0.smithi096.stdout:3/970: rename dc/d26/d48/dbd to dc/d26/d48/d137 0 2024-04-18T04:58:08.939 INFO:tasks.workunit.client.0.smithi096.stdout:3/971: dread dc/dcf/dd2/f6a [0,4194304] 0 2024-04-18T04:58:08.940 INFO:tasks.workunit.client.0.smithi096.stdout:8/645: unlink d0/d7/d24/d78/l66 0 2024-04-18T04:58:08.943 INFO:tasks.workunit.client.0.smithi096.stdout:5/669: symlink d7/dd/d35/lf4 0 2024-04-18T04:58:08.945 INFO:tasks.workunit.client.0.smithi096.stdout:0/677: fsync d16/d1c/d22/d2c/f35 0 2024-04-18T04:58:08.949 INFO:tasks.workunit.client.0.smithi096.stdout:8/646: creat d0/d7/d24/d18/d27/d3c/fcc x:0 0 0 2024-04-18T04:58:08.950 INFO:tasks.workunit.client.0.smithi096.stdout:5/670: dread d7/d25/d2b/fe9 [0,4194304] 0 2024-04-18T04:58:08.961 INFO:tasks.workunit.client.0.smithi096.stdout:8/647: read d0/d7/d24/d18/f23 [425985,79303] 0 2024-04-18T04:58:08.963 INFO:tasks.workunit.client.0.smithi096.stdout:8/648: truncate d0/d15/da9/fb3 616414 0 2024-04-18T04:58:08.964 INFO:tasks.workunit.client.0.smithi096.stdout:5/671: rename d7/d25/d2b/fea to d7/dd/d8f/d5e/ff5 0 2024-04-18T04:58:08.966 INFO:tasks.workunit.client.0.smithi096.stdout:8/649: stat d0/d7/d24/d18/d27/d3c/f9b 0 2024-04-18T04:58:08.967 INFO:tasks.workunit.client.0.smithi096.stdout:5/672: truncate d7/dd/d35/f51 995365 0 2024-04-18T04:58:08.967 INFO:tasks.workunit.client.0.smithi096.stdout:0/678: unlink d16/d1c/d22/ca0 0 2024-04-18T04:58:08.972 INFO:tasks.workunit.client.0.smithi096.stdout:5/673: chown d7/d3b/cdf 49207552 1 2024-04-18T04:58:08.974 INFO:tasks.workunit.client.0.smithi096.stdout:8/650: creat d0/d15/dc3/fcd x:0 0 0 2024-04-18T04:58:08.976 INFO:tasks.workunit.client.0.smithi096.stdout:0/679: creat d16/d1c/d4c/d4d/fd3 x:0 0 0 2024-04-18T04:58:08.979 INFO:tasks.workunit.client.0.smithi096.stdout:8/651: dread - d0/d3/d32/d6b/d7b/faa zero size 2024-04-18T04:58:08.987 INFO:tasks.workunit.client.0.smithi096.stdout:3/972: dwrite dc/d26/d48/dc2/d29/d7e/d102/f123 [0,4194304] 0 2024-04-18T04:58:08.988 INFO:tasks.workunit.client.0.smithi096.stdout:9/802: sync 2024-04-18T04:58:08.992 INFO:tasks.workunit.client.0.smithi096.stdout:3/973: symlink dc/dcf/dd2/l138 0 2024-04-18T04:58:09.000 INFO:tasks.workunit.client.0.smithi096.stdout:8/652: dwrite d0/d3/d32/fb4 [0,4194304] 0 2024-04-18T04:58:09.002 INFO:tasks.workunit.client.0.smithi096.stdout:9/803: link d0/d41/fca d0/ffb 0 2024-04-18T04:58:09.003 INFO:tasks.workunit.client.0.smithi096.stdout:0/680: dwrite d16/d1c/d4c/d4e/d67/fab [0,4194304] 0 2024-04-18T04:58:09.005 INFO:tasks.workunit.client.0.smithi096.stdout:5/674: dwrite d7/dd/d8f/da2/f8c [0,4194304] 0 2024-04-18T04:58:09.007 INFO:tasks.workunit.client.0.smithi096.stdout:8/653: readlink d0/d7/d24/d18/d5d/lb8 0 2024-04-18T04:58:09.011 INFO:tasks.workunit.client.0.smithi096.stdout:3/974: mknod dc/d26/d48/dc2/d8d/c139 0 2024-04-18T04:58:09.015 INFO:tasks.workunit.client.0.smithi096.stdout:8/654: symlink d0/d3/d32/d6b/d7b/lce 0 2024-04-18T04:58:09.017 INFO:tasks.workunit.client.0.smithi096.stdout:5/675: creat d7/dd/d35/db1/ff6 x:0 0 0 2024-04-18T04:58:09.023 INFO:tasks.workunit.client.0.smithi096.stdout:0/681: creat d16/d1c/d22/fd4 x:0 0 0 2024-04-18T04:58:09.025 INFO:tasks.workunit.client.0.smithi096.stdout:0/682: dread - d16/d1d/d3b/fa9 zero size 2024-04-18T04:58:09.026 INFO:tasks.workunit.client.0.smithi096.stdout:5/676: mknod d7/d25/d58/cf7 0 2024-04-18T04:58:09.031 INFO:tasks.workunit.client.0.smithi096.stdout:9/804: dwrite d0/d41/fb1 [0,4194304] 0 2024-04-18T04:58:09.032 INFO:tasks.workunit.client.0.smithi096.stdout:9/805: stat d0/de/f2d 0 2024-04-18T04:58:09.039 INFO:tasks.workunit.client.0.smithi096.stdout:5/677: creat d7/dd/d8f/da2/de2/de3/d78/ff8 x:0 0 0 2024-04-18T04:58:09.039 INFO:tasks.workunit.client.0.smithi096.stdout:8/655: getdents d0/d7/d24/d78 0 2024-04-18T04:58:09.044 INFO:tasks.workunit.client.0.smithi096.stdout:5/678: truncate d7/d3b/d95/fb2 691367 0 2024-04-18T04:58:09.046 INFO:tasks.workunit.client.0.smithi096.stdout:8/656: creat d0/d7/d24/d8d/fcf x:0 0 0 2024-04-18T04:58:09.047 INFO:tasks.workunit.client.0.smithi096.stdout:0/683: dread d16/d1d/d3b/f7a [0,4194304] 0 2024-04-18T04:58:09.048 INFO:tasks.workunit.client.0.smithi096.stdout:4/732: sync 2024-04-18T04:58:09.048 INFO:tasks.workunit.client.0.smithi096.stdout:9/806: dwrite d0/d41/fb1 [0,4194304] 0 2024-04-18T04:58:09.051 INFO:tasks.workunit.client.0.smithi096.stdout:5/679: unlink d7/dd/d8f/d5e/fa1 0 2024-04-18T04:58:09.052 INFO:tasks.workunit.client.0.smithi096.stdout:0/684: read d16/d1c/f29 [747573,101676] 0 2024-04-18T04:58:09.052 INFO:tasks.workunit.client.0.smithi096.stdout:3/975: dwrite dc/d26/d4a/f65 [0,4194304] 0 2024-04-18T04:58:09.053 INFO:tasks.workunit.client.0.smithi096.stdout:8/657: creat d0/d4f/fd0 x:0 0 0 2024-04-18T04:58:09.055 INFO:tasks.workunit.client.0.smithi096.stdout:0/685: write d16/d1c/d4c/d4e/f9d [5037978,46466] 0 2024-04-18T04:58:09.057 INFO:tasks.workunit.client.0.smithi096.stdout:0/686: write d16/d1c/d22/d2c/f30 [8719593,18911] 0 2024-04-18T04:58:09.061 INFO:tasks.workunit.client.0.smithi096.stdout:9/807: creat d0/de/d99/ffc x:0 0 0 2024-04-18T04:58:09.062 INFO:tasks.workunit.client.0.smithi096.stdout:9/808: readlink d0/l67 0 2024-04-18T04:58:09.064 INFO:tasks.workunit.client.0.smithi096.stdout:8/658: dwrite d0/d3/f6c [0,4194304] 0 2024-04-18T04:58:09.070 INFO:tasks.workunit.client.0.smithi096.stdout:3/976: fsync dc/d26/d48/dc2/f121 0 2024-04-18T04:58:09.076 INFO:tasks.workunit.client.0.smithi096.stdout:4/733: write d4/d14/d16/f7d [1269759,13376] 0 2024-04-18T04:58:09.076 INFO:tasks.workunit.client.0.smithi096.stdout:9/809: dread d0/de/d17/d2f/f42 [0,4194304] 0 2024-04-18T04:58:09.077 INFO:tasks.workunit.client.0.smithi096.stdout:9/810: stat d0/de/d17/d56/cbd 0 2024-04-18T04:58:09.079 INFO:tasks.workunit.client.0.smithi096.stdout:5/680: symlink d7/dd/d8f/da2/de2/de3/d36/de7/lf9 0 2024-04-18T04:58:09.082 INFO:tasks.workunit.client.0.smithi096.stdout:4/734: rmdir d4/d14/d2d 39 2024-04-18T04:58:09.082 INFO:tasks.workunit.client.0.smithi096.stdout:4/735: stat l3 0 2024-04-18T04:58:09.084 INFO:tasks.workunit.client.0.smithi096.stdout:0/687: truncate d16/d1c/d4c/d4d/d5d/fc7 4128170 0 2024-04-18T04:58:09.085 INFO:tasks.workunit.client.0.smithi096.stdout:5/681: creat d7/d25/d30/d9e/dc3/ffa x:0 0 0 2024-04-18T04:58:09.086 INFO:tasks.workunit.client.0.smithi096.stdout:5/682: readlink d7/dd/l23 0 2024-04-18T04:58:09.086 INFO:tasks.workunit.client.0.smithi096.stdout:8/659: dwrite d0/d7/f2a [0,4194304] 0 2024-04-18T04:58:09.088 INFO:tasks.workunit.client.0.smithi096.stdout:3/977: link dc/d26/d48/dae/fd8 dc/d26/d66/dfb/f13a 0 2024-04-18T04:58:09.090 INFO:tasks.workunit.client.0.smithi096.stdout:3/978: chown dc/d26/d48/dc2/d8d 195424 1 2024-04-18T04:58:09.091 INFO:tasks.workunit.client.0.smithi096.stdout:9/811: rename d0/de/d17/d2f/f42 to d0/de/d17/d56/d59/d68/dab/ffd 0 2024-04-18T04:58:09.091 INFO:tasks.workunit.client.0.smithi096.stdout:0/688: mknod d16/d1d/d3b/dc3/cd5 0 2024-04-18T04:58:09.096 INFO:tasks.workunit.client.0.smithi096.stdout:3/979: creat dc/d70/f13b x:0 0 0 2024-04-18T04:58:09.097 INFO:tasks.workunit.client.0.smithi096.stdout:8/660: fdatasync d0/d15/f44 0 2024-04-18T04:58:09.098 INFO:tasks.workunit.client.0.smithi096.stdout:7/760: sync 2024-04-18T04:58:09.099 INFO:tasks.workunit.client.0.smithi096.stdout:1/826: sync 2024-04-18T04:58:09.100 INFO:tasks.workunit.client.0.smithi096.stdout:5/683: dwrite d7/da3/d9a/fa8 [0,4194304] 0 2024-04-18T04:58:09.102 INFO:tasks.workunit.client.0.smithi096.stdout:4/736: dwrite d4/d14/d1d/da5/f9d [0,4194304] 0 2024-04-18T04:58:09.102 INFO:tasks.workunit.client.0.smithi096.stdout:3/980: rmdir dc/d26/d48/dc2/d95 39 2024-04-18T04:58:09.102 INFO:tasks.workunit.client.0.smithi096.stdout:7/761: write db/d1f/d39/d6d/d79/f9a [5727590,18217] 0 2024-04-18T04:58:09.104 INFO:tasks.workunit.client.0.smithi096.stdout:0/689: link d16/d1c/d4c/d4e/c5b d16/d1c/d4c/d4d/d5d/dc6/cd6 0 2024-04-18T04:58:09.106 INFO:tasks.workunit.client.0.smithi096.stdout:5/684: link d7/d25/f4d d7/d3b/d95/ffb 0 2024-04-18T04:58:09.107 INFO:tasks.workunit.client.0.smithi096.stdout:3/981: rmdir dc/d26/d4a/ddf/d124 39 2024-04-18T04:58:09.111 INFO:tasks.workunit.client.0.smithi096.stdout:1/827: dwrite de/d1d/f52 [4194304,4194304] 0 2024-04-18T04:58:09.111 INFO:tasks.workunit.client.0.smithi096.stdout:4/737: rename d4/d14/f2b to d4/d14/d16/fdf 0 2024-04-18T04:58:09.112 INFO:tasks.workunit.client.0.smithi096.stdout:5/685: symlink d7/dd/d8f/d5e/lfc 0 2024-04-18T04:58:09.112 INFO:tasks.workunit.client.0.smithi096.stdout:9/812: link d0/de/d17/d2f/dd5/fdb d0/de/d17/d56/d59/d68/ffe 0 2024-04-18T04:58:09.114 INFO:tasks.workunit.client.0.smithi096.stdout:3/982: symlink dc/d26/d48/dc2/d29/d7e/l13c 0 2024-04-18T04:58:09.115 INFO:tasks.workunit.client.0.smithi096.stdout:7/762: mkdir db/d1f/d39/d6d/d79/d83/daa/df1/df2 0 2024-04-18T04:58:09.125 INFO:tasks.workunit.client.0.smithi096.stdout:5/686: mkdir d7/dd/d8f/da2/de2/de3/dfd 0 2024-04-18T04:58:09.126 INFO:tasks.workunit.client.0.smithi096.stdout:5/687: write d7/dd/d8f/da2/de2/de3/d56/f6a [1955502,20115] 0 2024-04-18T04:58:09.127 INFO:tasks.workunit.client.0.smithi096.stdout:9/813: mknod d0/de/d17/d56/d59/d68/dab/d3a/cff 0 2024-04-18T04:58:09.128 INFO:tasks.workunit.client.0.smithi096.stdout:7/763: rmdir db/d1f/d5b/d6a 39 2024-04-18T04:58:09.131 INFO:tasks.workunit.client.0.smithi096.stdout:4/738: mkdir d4/d14/d2d/da6/dc6/de0 0 2024-04-18T04:58:09.131 INFO:tasks.workunit.client.0.smithi096.stdout:1/828: write de/f6a [4221464,22250] 0 2024-04-18T04:58:09.135 INFO:tasks.workunit.client.0.smithi096.stdout:9/814: rename d0/de/d17/l1d to d0/de/l100 0 2024-04-18T04:58:09.138 INFO:tasks.workunit.client.0.smithi096.stdout:1/829: mknod de/d1d/d32/d73/c10a 0 2024-04-18T04:58:09.139 INFO:tasks.workunit.client.0.smithi096.stdout:4/739: dwrite d4/fb1 [0,4194304] 0 2024-04-18T04:58:09.141 INFO:tasks.workunit.client.0.smithi096.stdout:4/740: write d4/f62 [5213444,98088] 0 2024-04-18T04:58:09.141 INFO:tasks.workunit.client.0.smithi096.stdout:5/688: write d7/d25/d2b/f45 [1416411,58927] 0 2024-04-18T04:58:09.144 INFO:tasks.workunit.client.0.smithi096.stdout:5/689: chown d7/d25/d30/d9e/dc3/lcc 6775 1 2024-04-18T04:58:09.146 INFO:tasks.workunit.client.0.smithi096.stdout:0/690: getdents d16/d1c/d4c/d4d/d36 0 2024-04-18T04:58:09.146 INFO:tasks.workunit.client.0.smithi096.stdout:9/815: dwrite d0/de/d17/d2f/d40/d8b/de1/f9b [0,4194304] 0 2024-04-18T04:58:09.147 INFO:tasks.workunit.client.0.smithi096.stdout:4/741: creat d4/d14/d2d/d44/d58/d86/fe1 x:0 0 0 2024-04-18T04:58:09.148 INFO:tasks.workunit.client.0.smithi096.stdout:1/830: link de/d7b/f88 de/d1d/d81/f10b 0 2024-04-18T04:58:09.149 INFO:tasks.workunit.client.0.smithi096.stdout:3/983: dread dc/d26/d66/d7f/fcb [0,4194304] 0 2024-04-18T04:58:09.149 INFO:tasks.workunit.client.0.smithi096.stdout:4/742: write d4/d14/d2d/d44/d58/d86/d97/fb4 [932546,83444] 0 2024-04-18T04:58:09.153 INFO:tasks.workunit.client.0.smithi096.stdout:7/764: write f5 [121029,35425] 0 2024-04-18T04:58:09.155 INFO:tasks.workunit.client.0.smithi096.stdout:3/984: creat dc/d26/d48/dc2/d29/d7e/f13d x:0 0 0 2024-04-18T04:58:09.156 INFO:tasks.workunit.client.0.smithi096.stdout:5/690: creat d7/dd/d8f/da2/de2/ffe x:0 0 0 2024-04-18T04:58:09.157 INFO:tasks.workunit.client.0.smithi096.stdout:0/691: dwrite d16/f42 [0,4194304] 0 2024-04-18T04:58:09.157 INFO:tasks.workunit.client.0.smithi096.stdout:4/743: creat d4/d14/d2d/d44/d58/d86/fe2 x:0 0 0 2024-04-18T04:58:09.159 INFO:tasks.workunit.client.0.smithi096.stdout:1/831: write de/f29 [5224790,125521] 0 2024-04-18T04:58:09.161 INFO:tasks.workunit.client.0.smithi096.stdout:3/985: fdatasync dc/d26/d48/dc2/f74 0 2024-04-18T04:58:09.161 INFO:tasks.workunit.client.0.smithi096.stdout:9/816: getdents d0/de 0 2024-04-18T04:58:09.162 INFO:tasks.workunit.client.0.smithi096.stdout:5/691: unlink d7/dd/d8f/f1f 0 2024-04-18T04:58:09.163 INFO:tasks.workunit.client.0.smithi096.stdout:4/744: mknod d4/d14/d2d/d44/d58/d86/ce3 0 2024-04-18T04:58:09.164 INFO:tasks.workunit.client.0.smithi096.stdout:5/692: dread - d7/d25/d2b/fd8 zero size 2024-04-18T04:58:09.164 INFO:tasks.workunit.client.0.smithi096.stdout:0/692: read d16/d1c/d22/d2c/fc8 [1811544,117761] 0 2024-04-18T04:58:09.165 INFO:tasks.workunit.client.0.smithi096.stdout:3/986: truncate dc/d26/d66/dfb/f13a 4776542 0 2024-04-18T04:58:09.166 INFO:tasks.workunit.client.0.smithi096.stdout:1/832: rename de/d1d/l2d to de/d1d/d32/d73/l10c 0 2024-04-18T04:58:09.167 INFO:tasks.workunit.client.0.smithi096.stdout:4/745: write d4/d14/d2d/d44/d58/d86/d3a/d39/f56 [2772248,16684] 0 2024-04-18T04:58:09.169 INFO:tasks.workunit.client.0.smithi096.stdout:5/693: unlink d7/dd/d8f/da2/de2/de3/l90 0 2024-04-18T04:58:09.169 INFO:tasks.workunit.client.0.smithi096.stdout:4/746: write d4/d14/d2d/d44/d58/d86/d3a/fca [191958,46475] 0 2024-04-18T04:58:09.170 INFO:tasks.workunit.client.0.smithi096.stdout:4/747: chown d4/d14/d2d/d44/fa3 23699866 1 2024-04-18T04:58:09.170 INFO:tasks.workunit.client.0.smithi096.stdout:5/694: truncate d7/da3/d9a/fe0 4649153 0 2024-04-18T04:58:09.171 INFO:tasks.workunit.client.0.smithi096.stdout:3/987: chown dc/d26/d48/dc2/c97 1277910730 1 2024-04-18T04:58:09.172 INFO:tasks.workunit.client.0.smithi096.stdout:3/988: fsync dc/d26/d4a/ddf/d93/fb8 0 2024-04-18T04:58:09.172 INFO:tasks.workunit.client.0.smithi096.stdout:9/817: rename d0/de/d17/d56/d59/d68/c75 to d0/de/d17/d5c/c101 0 2024-04-18T04:58:09.173 INFO:tasks.workunit.client.0.smithi096.stdout:7/765: truncate db/d1f/d24/d49/f71 3466571 0 2024-04-18T04:58:09.175 INFO:tasks.workunit.client.0.smithi096.stdout:4/748: chown d4/d14/c21 131363 1 2024-04-18T04:58:09.176 INFO:tasks.workunit.client.0.smithi096.stdout:5/695: creat d7/dd/d8f/da2/de2/de3/d36/de1/fff x:0 0 0 2024-04-18T04:58:09.176 INFO:tasks.workunit.client.0.smithi096.stdout:5/696: fsync d7/d3b/d95/fe4 0 2024-04-18T04:58:09.177 INFO:tasks.workunit.client.0.smithi096.stdout:9/818: rmdir d0/de/d17/d56/d59 39 2024-04-18T04:58:09.178 INFO:tasks.workunit.client.0.smithi096.stdout:0/693: rmdir d16/d55/dc9 0 2024-04-18T04:58:09.179 INFO:tasks.workunit.client.0.smithi096.stdout:0/694: chown d16/d1c/d22/d2c/f68 213678 1 2024-04-18T04:58:09.183 INFO:tasks.workunit.client.0.smithi096.stdout:3/989: write dc/d26/d4a/f6c [1107731,74584] 0 2024-04-18T04:58:09.185 INFO:tasks.workunit.client.0.smithi096.stdout:1/833: rmdir de/d1d/d32/d73/d8b/de4 0 2024-04-18T04:58:09.188 INFO:tasks.workunit.client.0.smithi096.stdout:3/990: write dc/d26/d4a/f58 [9121725,129694] 0 2024-04-18T04:58:09.189 INFO:tasks.workunit.client.0.smithi096.stdout:0/695: mkdir d16/d1c/d4c/d4d/d5d/dd7 0 2024-04-18T04:58:09.191 INFO:tasks.workunit.client.0.smithi096.stdout:0/696: readlink d16/d1d/l31 0 2024-04-18T04:58:09.192 INFO:tasks.workunit.client.0.smithi096.stdout:9/819: truncate d0/d41/f63 2424729 0 2024-04-18T04:58:09.193 INFO:tasks.workunit.client.0.smithi096.stdout:3/991: symlink dc/d26/d48/dae/l13e 0 2024-04-18T04:58:09.195 INFO:tasks.workunit.client.0.smithi096.stdout:1/834: read de/d1d/f42 [2257260,23659] 0 2024-04-18T04:58:09.199 INFO:tasks.workunit.client.0.smithi096.stdout:0/697: write d16/d1c/d4c/d4d/d5a/f95 [1016952,31796] 0 2024-04-18T04:58:09.199 INFO:tasks.workunit.client.0.smithi096.stdout:5/697: dwrite d7/d25/d2b/fe9 [0,4194304] 0 2024-04-18T04:58:09.199 INFO:tasks.workunit.client.0.smithi096.stdout:4/749: dread d4/f24 [4194304,4194304] 0 2024-04-18T04:58:09.202 INFO:tasks.workunit.client.0.smithi096.stdout:1/835: write de/d1d/d32/d9a/feb [824614,59900] 0 2024-04-18T04:58:09.203 INFO:tasks.workunit.client.0.smithi096.stdout:7/766: dwrite db/d1f/f40 [0,4194304] 0 2024-04-18T04:58:09.207 INFO:tasks.workunit.client.0.smithi096.stdout:1/836: chown de/d1d/d32/d8c/l9f 38 1 2024-04-18T04:58:09.208 INFO:tasks.workunit.client.0.smithi096.stdout:4/750: fdatasync d4/d14/d2d/d44/da2/db2/fc7 0 2024-04-18T04:58:09.209 INFO:tasks.workunit.client.0.smithi096.stdout:0/698: creat d16/d1d/fd8 x:0 0 0 2024-04-18T04:58:09.209 INFO:tasks.workunit.client.0.smithi096.stdout:3/992: dwrite dc/d12f/f135 [0,4194304] 0 2024-04-18T04:58:09.210 INFO:tasks.workunit.client.0.smithi096.stdout:1/837: readlink de/d109/l9c 0 2024-04-18T04:58:09.211 INFO:tasks.workunit.client.0.smithi096.stdout:3/993: fdatasync dc/fe8 0 2024-04-18T04:58:09.216 INFO:tasks.workunit.client.0.smithi096.stdout:0/699: dread - d16/d1d/fd8 zero size 2024-04-18T04:58:09.216 INFO:tasks.workunit.client.0.smithi096.stdout:1/838: read de/d1d/d32/d8c/f105 [1968455,68852] 0 2024-04-18T04:58:09.216 INFO:tasks.workunit.client.0.smithi096.stdout:4/751: symlink d4/d14/d2d/d44/d58/d86/d3a/le4 0 2024-04-18T04:58:09.217 INFO:tasks.workunit.client.0.smithi096.stdout:5/698: truncate d7/d3b/f94 163887 0 2024-04-18T04:58:09.220 INFO:tasks.workunit.client.0.smithi096.stdout:1/839: fsync de/d1d/d32/d9a/dad/fb4 0 2024-04-18T04:58:09.220 INFO:tasks.workunit.client.0.smithi096.stdout:0/700: creat d16/d1c/d4c/d4e/fd9 x:0 0 0 2024-04-18T04:58:09.222 INFO:tasks.workunit.client.0.smithi096.stdout:7/767: dwrite db/d1f/d39/d6d/d79/d83/daa/fe2 [0,4194304] 0 2024-04-18T04:58:09.222 INFO:tasks.workunit.client.0.smithi096.stdout:5/699: mkdir d7/dd/d35/d74/dab/d100 0 2024-04-18T04:58:09.223 INFO:tasks.workunit.client.0.smithi096.stdout:1/840: fsync de/d1d/d32/d8c/fd4 0 2024-04-18T04:58:09.225 INFO:tasks.workunit.client.0.smithi096.stdout:5/700: write d7/d25/d2b/fd8 [78204,56064] 0 2024-04-18T04:58:09.228 INFO:tasks.workunit.client.0.smithi096.stdout:4/752: link d4/d14/d16/c34 d4/d14/d2d/d44/d58/d86/d3a/d39/d54/dd9/ce5 0 2024-04-18T04:58:09.229 INFO:tasks.workunit.client.0.smithi096.stdout:1/841: read de/f35 [182621,78365] 0 2024-04-18T04:58:09.231 INFO:tasks.workunit.client.0.smithi096.stdout:9/820: dread d0/de/d17/d56/d59/d68/f83 [0,4194304] 0 2024-04-18T04:58:09.233 INFO:tasks.workunit.client.0.smithi096.stdout:4/753: getdents d4/d7a 0 2024-04-18T04:58:09.236 INFO:tasks.workunit.client.0.smithi096.stdout:1/842: truncate de/d1d/d32/d9a/dad/dd3/fd9 360183 0 2024-04-18T04:58:09.236 INFO:tasks.workunit.client.0.smithi096.stdout:9/821: creat d0/de/d17/d56/d6d/f102 x:0 0 0 2024-04-18T04:58:09.237 INFO:tasks.workunit.client.0.smithi096.stdout:0/701: dwrite d16/d1c/d22/d2c/f30 [4194304,4194304] 0 2024-04-18T04:58:09.242 INFO:tasks.workunit.client.0.smithi096.stdout:1/843: dread de/d1d/d32/d9a/dad/dd3/fd9 [0,4194304] 0 2024-04-18T04:58:09.244 INFO:tasks.workunit.client.0.smithi096.stdout:5/701: dwrite d7/d25/d7c/fa6 [0,4194304] 0 2024-04-18T04:58:09.244 INFO:tasks.workunit.client.0.smithi096.stdout:0/702: mkdir d16/d1c/d4c/d4d/d5d/dd7/dda 0 2024-04-18T04:58:09.245 INFO:tasks.workunit.client.0.smithi096.stdout:9/822: mkdir d0/de/d17/d56/d59/d68/dab/d103 0 2024-04-18T04:58:09.246 INFO:tasks.workunit.client.0.smithi096.stdout:7/768: dread db/f2a [0,4194304] 0 2024-04-18T04:58:09.248 INFO:tasks.workunit.client.0.smithi096.stdout:9/823: dread - d0/fcb zero size 2024-04-18T04:58:09.249 INFO:tasks.workunit.client.0.smithi096.stdout:5/702: dread - d7/d3b/d95/fe4 zero size 2024-04-18T04:58:09.249 INFO:tasks.workunit.client.0.smithi096.stdout:4/754: dwrite d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/fac [0,4194304] 0 2024-04-18T04:58:09.250 INFO:tasks.workunit.client.0.smithi096.stdout:4/755: stat d4/f62 0 2024-04-18T04:58:09.251 INFO:tasks.workunit.client.0.smithi096.stdout:5/703: chown d7/d25/d7c/fa6 93439 1 2024-04-18T04:58:09.252 INFO:tasks.workunit.client.0.smithi096.stdout:0/703: truncate d16/d1c/d4c/d4d/fd3 872887 0 2024-04-18T04:58:09.252 INFO:tasks.workunit.client.0.smithi096.stdout:5/704: chown d7/dd/d8f/da2/de2/de3/dfd 135855 1 2024-04-18T04:58:09.255 INFO:tasks.workunit.client.0.smithi096.stdout:9/824: symlink d0/de/d17/d2f/d40/l104 0 2024-04-18T04:58:09.257 INFO:tasks.workunit.client.0.smithi096.stdout:0/704: readlink d16/d1c/d4c/d4d/d5d/dc6/lc2 0 2024-04-18T04:58:09.258 INFO:tasks.workunit.client.0.smithi096.stdout:7/769: dread db/d1d/d82/f8c [0,4194304] 0 2024-04-18T04:58:09.259 INFO:tasks.workunit.client.0.smithi096.stdout:5/705: dread d7/d25/d2b/ff2 [0,4194304] 0 2024-04-18T04:58:09.263 INFO:tasks.workunit.client.0.smithi096.stdout:0/705: truncate d16/d1c/d22/fd4 1007882 0 2024-04-18T04:58:09.264 INFO:tasks.workunit.client.0.smithi096.stdout:7/770: write db/d20/d2f/dcb/fe9 [372264,110273] 0 2024-04-18T04:58:09.264 INFO:tasks.workunit.client.0.smithi096.stdout:1/844: dwrite de/d109/d96/fa6 [0,4194304] 0 2024-04-18T04:58:09.265 INFO:tasks.workunit.client.0.smithi096.stdout:4/756: dwrite d4/d14/d2d/d44/d58/d86/d6f/db8/fbe [0,4194304] 0 2024-04-18T04:58:09.268 INFO:tasks.workunit.client.0.smithi096.stdout:7/771: fdatasync db/d20/d45/fa6 0 2024-04-18T04:58:09.270 INFO:tasks.workunit.client.0.smithi096.stdout:4/757: dread - d4/d14/d1d/da5/d8c/fbf zero size 2024-04-18T04:58:09.272 INFO:tasks.workunit.client.0.smithi096.stdout:5/706: symlink d7/dd/d8f/da2/de2/de3/d56/ddd/l101 0 2024-04-18T04:58:09.272 INFO:tasks.workunit.client.0.smithi096.stdout:1/845: unlink de/d1d/d32/d73/d8b/c8d 0 2024-04-18T04:58:09.273 INFO:tasks.workunit.client.0.smithi096.stdout:9/825: dwrite d0/de/d17/d56/d59/d60/fc2 [0,4194304] 0 2024-04-18T04:58:09.274 INFO:tasks.workunit.client.0.smithi096.stdout:1/846: dread - de/d1d/d32/d9a/dad/fb4 zero size 2024-04-18T04:58:09.276 INFO:tasks.workunit.client.0.smithi096.stdout:9/826: fsync d0/de/d17/d56/d59/d68/f98 0 2024-04-18T04:58:09.277 INFO:tasks.workunit.client.0.smithi096.stdout:0/706: link d16/d1c/d4c/d4e/f9d d16/d1c/d4c/d4d/d5d/dd7/dda/fdb 0 2024-04-18T04:58:09.278 INFO:tasks.workunit.client.0.smithi096.stdout:5/707: rmdir d7/dd/d8f/da2/de2/de3/d52 39 2024-04-18T04:58:09.279 INFO:tasks.workunit.client.0.smithi096.stdout:7/772: dwrite db/d1f/d42/f65 [0,4194304] 0 2024-04-18T04:58:09.281 INFO:tasks.workunit.client.0.smithi096.stdout:5/708: chown d7/dd/d8f/da2/de2/ffe 227 1 2024-04-18T04:58:09.282 INFO:tasks.workunit.client.0.smithi096.stdout:1/847: creat de/d1d/d3f/d4f/da9/f10d x:0 0 0 2024-04-18T04:58:09.283 INFO:tasks.workunit.client.0.smithi096.stdout:9/827: stat d0/d52/lb7 0 2024-04-18T04:58:09.284 INFO:tasks.workunit.client.0.smithi096.stdout:5/709: creat d7/d25/d58/f102 x:0 0 0 2024-04-18T04:58:09.284 INFO:tasks.workunit.client.0.smithi096.stdout:0/707: dread d16/d1c/d4c/d4d/d5a/f70 [0,4194304] 0 2024-04-18T04:58:09.285 INFO:tasks.workunit.client.0.smithi096.stdout:5/710: chown d7/dd/f2c 204521678 1 2024-04-18T04:58:09.286 INFO:tasks.workunit.client.0.smithi096.stdout:1/848: creat de/d1d/d3f/f10e x:0 0 0 2024-04-18T04:58:09.287 INFO:tasks.workunit.client.0.smithi096.stdout:5/711: chown d7/d25/d58/cf7 0 1 2024-04-18T04:58:09.287 INFO:tasks.workunit.client.0.smithi096.stdout:7/773: creat db/d1f/d39/d6d/d79/d83/daa/df1/ff3 x:0 0 0 2024-04-18T04:58:09.288 INFO:tasks.workunit.client.0.smithi096.stdout:4/758: write d4/d14/d2d/d44/d90/dd0/fdc [3729609,39687] 0 2024-04-18T04:58:09.289 INFO:tasks.workunit.client.0.smithi096.stdout:0/708: unlink d16/d1d/d3b/f7a 0 2024-04-18T04:58:09.290 INFO:tasks.workunit.client.0.smithi096.stdout:1/849: unlink de/d1d/d32/d9a/dad/ce5 0 2024-04-18T04:58:09.290 INFO:tasks.workunit.client.0.smithi096.stdout:5/712: symlink d7/dd/d35/d74/l103 0 2024-04-18T04:58:09.291 INFO:tasks.workunit.client.0.smithi096.stdout:0/709: dread - d16/fa2 zero size 2024-04-18T04:58:09.293 INFO:tasks.workunit.client.0.smithi096.stdout:0/710: chown d16/d1d/d3b/l8e 1610 1 2024-04-18T04:58:09.293 INFO:tasks.workunit.client.0.smithi096.stdout:7/774: truncate db/d1f/d39/d6d/d79/d83/f85 4366393 0 2024-04-18T04:58:09.294 INFO:tasks.workunit.client.0.smithi096.stdout:5/713: truncate d7/d3b/da9/fec 511431 0 2024-04-18T04:58:09.294 INFO:tasks.workunit.client.0.smithi096.stdout:9/828: dwrite d0/d41/fb1 [0,4194304] 0 2024-04-18T04:58:09.296 INFO:tasks.workunit.client.0.smithi096.stdout:1/850: rename de/d1d/d3f/d4f/ff9 to de/d109/f10f 0 2024-04-18T04:58:09.301 INFO:tasks.workunit.client.0.smithi096.stdout:1/851: getdents de/d109/d96 0 2024-04-18T04:58:09.306 INFO:tasks.workunit.client.0.smithi096.stdout:9/829: truncate d0/f4b 4630849 0 2024-04-18T04:58:09.306 INFO:tasks.workunit.client.0.smithi096.stdout:1/852: creat de/d1d/d3f/d5f/f110 x:0 0 0 2024-04-18T04:58:09.307 INFO:tasks.workunit.client.0.smithi096.stdout:5/714: dwrite d7/da3/d9a/fa8 [0,4194304] 0 2024-04-18T04:58:09.308 INFO:tasks.workunit.client.0.smithi096.stdout:0/711: dwrite d16/d1c/d22/d2c/f90 [0,4194304] 0 2024-04-18T04:58:09.309 INFO:tasks.workunit.client.0.smithi096.stdout:9/830: write d0/de/d17/d2f/d40/fac [1738552,35516] 0 2024-04-18T04:58:09.309 INFO:tasks.workunit.client.0.smithi096.stdout:9/831: readlink d0/l67 0 2024-04-18T04:58:09.316 INFO:tasks.workunit.client.0.smithi096.stdout:5/715: dwrite d7/dd/d8f/da2/de2/de3/f70 [0,4194304] 0 2024-04-18T04:58:09.317 INFO:tasks.workunit.client.0.smithi096.stdout:7/775: dread db/d1f/d24/d61/fcd [0,4194304] 0 2024-04-18T04:58:09.317 INFO:tasks.workunit.client.0.smithi096.stdout:1/853: creat de/d1d/d3f/d4f/da9/f111 x:0 0 0 2024-04-18T04:58:09.318 INFO:tasks.workunit.client.0.smithi096.stdout:7/776: readlink db/d1d/l94 0 2024-04-18T04:58:09.320 INFO:tasks.workunit.client.0.smithi096.stdout:9/832: mknod d0/de/d17/d56/d6d/c105 0 2024-04-18T04:58:09.323 INFO:tasks.workunit.client.0.smithi096.stdout:5/716: rename d7/dd/f2e to d7/dd/d8f/da2/de2/de3/dfd/f104 0 2024-04-18T04:58:09.324 INFO:tasks.workunit.client.0.smithi096.stdout:7/777: readlink db/l26 0 2024-04-18T04:58:09.324 INFO:tasks.workunit.client.0.smithi096.stdout:5/717: stat d7/dd/d8f/da2/de2/de3/d56/ddd 0 2024-04-18T04:58:09.329 INFO:tasks.workunit.client.0.smithi096.stdout:1/854: creat de/d1d/d3f/d4f/f112 x:0 0 0 2024-04-18T04:58:09.330 INFO:tasks.workunit.client.0.smithi096.stdout:8/661: sync 2024-04-18T04:58:09.330 INFO:tasks.workunit.client.0.smithi096.stdout:5/718: symlink d7/dd/d8f/da2/l105 0 2024-04-18T04:58:09.331 INFO:tasks.workunit.client.0.smithi096.stdout:7/778: dread f7 [0,4194304] 0 2024-04-18T04:58:09.331 INFO:tasks.workunit.client.0.smithi096.stdout:9/833: rename d0/f11 to d0/de/d17/d56/d59/d68/f106 0 2024-04-18T04:58:09.332 INFO:tasks.workunit.client.0.smithi096.stdout:9/834: fsync d0/de/f7b 0 2024-04-18T04:58:09.333 INFO:tasks.workunit.client.0.smithi096.stdout:5/719: fdatasync d7/dd/d8f/da2/de2/de3/dfd/f104 0 2024-04-18T04:58:09.334 INFO:tasks.workunit.client.0.smithi096.stdout:1/855: rename de/l1c to de/d1d/d32/d6b/l113 0 2024-04-18T04:58:09.335 INFO:tasks.workunit.client.0.smithi096.stdout:1/856: chown de/d109 872208 1 2024-04-18T04:58:09.336 INFO:tasks.workunit.client.0.smithi096.stdout:0/712: write d16/d1c/d4c/d4d/d5d/fc7 [442520,16747] 0 2024-04-18T04:58:09.339 INFO:tasks.workunit.client.0.smithi096.stdout:8/662: getdents d0/d15/d65 0 2024-04-18T04:58:09.341 INFO:tasks.workunit.client.0.smithi096.stdout:1/857: rename de/d1d/d3f/d4f/f7d to de/d1d/d32/d6f/d85/f114 0 2024-04-18T04:58:09.342 INFO:tasks.workunit.client.0.smithi096.stdout:0/713: rmdir d16/d1c/d22/d2c 39 2024-04-18T04:58:09.343 INFO:tasks.workunit.client.0.smithi096.stdout:9/835: dwrite d0/de/d17/d56/d6d/ff5 [0,4194304] 0 2024-04-18T04:58:09.348 INFO:tasks.workunit.client.0.smithi096.stdout:1/858: mkdir de/d109/d96/df8/d115 0 2024-04-18T04:58:09.349 INFO:tasks.workunit.client.0.smithi096.stdout:5/720: dwrite d7/d25/d2b/ff2 [0,4194304] 0 2024-04-18T04:58:09.350 INFO:tasks.workunit.client.0.smithi096.stdout:9/836: rmdir d0/de/d17/d56/d59 39 2024-04-18T04:58:09.352 INFO:tasks.workunit.client.0.smithi096.stdout:8/663: mknod d0/d15/d65/d8f/db6/cd1 0 2024-04-18T04:58:09.354 INFO:tasks.workunit.client.0.smithi096.stdout:7/779: dread db/d1f/d5b/d6a/fa4 [0,4194304] 0 2024-04-18T04:58:09.355 INFO:tasks.workunit.client.0.smithi096.stdout:0/714: link d16/l59 d16/d1c/d4c/d6a/ldc 0 2024-04-18T04:58:09.356 INFO:tasks.workunit.client.0.smithi096.stdout:0/715: write d16/d1c/d4c/d4e/d67/fb4 [612777,126354] 0 2024-04-18T04:58:09.359 INFO:tasks.workunit.client.0.smithi096.stdout:9/837: unlink d0/d6b/d89/fc4 0 2024-04-18T04:58:09.361 INFO:tasks.workunit.client.0.smithi096.stdout:0/716: creat d16/d1c/d4c/fdd x:0 0 0 2024-04-18T04:58:09.362 INFO:tasks.workunit.client.0.smithi096.stdout:7/780: dwrite db/d1d/f5a [0,4194304] 0 2024-04-18T04:58:09.363 INFO:tasks.workunit.client.0.smithi096.stdout:7/781: write db/d1f/d39/d6d/d79/f9a [1203154,91862] 0 2024-04-18T04:58:09.365 INFO:tasks.workunit.client.0.smithi096.stdout:1/859: getdents de/d109 0 2024-04-18T04:58:09.366 INFO:tasks.workunit.client.0.smithi096.stdout:8/664: link d0/d7/d24/d35/f4a d0/d15/fd2 0 2024-04-18T04:58:09.366 INFO:tasks.workunit.client.0.smithi096.stdout:7/782: fdatasync db/d20/d2f/d8d/da1/fc2 0 2024-04-18T04:58:09.367 INFO:tasks.workunit.client.0.smithi096.stdout:9/838: chown d0/de/d17/d56/d59/l5d 5 1 2024-04-18T04:58:09.367 INFO:tasks.workunit.client.0.smithi096.stdout:1/860: chown de/d1d/fab 1 1 2024-04-18T04:58:09.367 INFO:tasks.workunit.client.0.smithi096.stdout:0/717: mknod d16/d1c/d22/db8/cde 0 2024-04-18T04:58:09.370 INFO:tasks.workunit.client.0.smithi096.stdout:7/783: write db/d1f/d5b/d6a/f8b [1754878,34664] 0 2024-04-18T04:58:09.370 INFO:tasks.workunit.client.0.smithi096.stdout:0/718: fdatasync d16/d1c/d4c/d4d/d36/f9b 0 2024-04-18T04:58:09.371 INFO:tasks.workunit.client.0.smithi096.stdout:5/721: dwrite d7/d25/d30/faa [0,4194304] 0 2024-04-18T04:58:09.371 INFO:tasks.workunit.client.0.smithi096.stdout:8/665: creat d0/d7/d24/d18/d27/fd3 x:0 0 0 2024-04-18T04:58:09.373 INFO:tasks.workunit.client.0.smithi096.stdout:9/839: rename d0/l4d to d0/d6b/d89/l107 0 2024-04-18T04:58:09.376 INFO:tasks.workunit.client.0.smithi096.stdout:0/719: unlink d16/d1c/f37 0 2024-04-18T04:58:09.379 INFO:tasks.workunit.client.0.smithi096.stdout:8/666: dwrite d0/d3/f6c [0,4194304] 0 2024-04-18T04:58:09.379 INFO:tasks.workunit.client.0.smithi096.stdout:5/722: creat d7/d3b/f106 x:0 0 0 2024-04-18T04:58:09.380 INFO:tasks.workunit.client.0.smithi096.stdout:8/667: chown d0/d7/d24/d18/d5d/fb1 9608 1 2024-04-18T04:58:09.381 INFO:tasks.workunit.client.0.smithi096.stdout:8/668: fdatasync d0/d7/d24/d35/d51/d5b/f89 0 2024-04-18T04:58:09.383 INFO:tasks.workunit.client.0.smithi096.stdout:9/840: rmdir d0/d41 39 2024-04-18T04:58:09.384 INFO:tasks.workunit.client.0.smithi096.stdout:9/841: chown d0/de/d17/d2f/d40/f34 18 1 2024-04-18T04:58:09.385 INFO:tasks.workunit.client.0.smithi096.stdout:5/723: mkdir d7/dd/d8f/da2/de2/de3/d36/dd5/d107 0 2024-04-18T04:58:09.386 INFO:tasks.workunit.client.0.smithi096.stdout:5/724: stat d7/d25/d58/cf7 0 2024-04-18T04:58:09.386 INFO:tasks.workunit.client.0.smithi096.stdout:8/669: creat d0/d4f/fd4 x:0 0 0 2024-04-18T04:58:09.387 INFO:tasks.workunit.client.0.smithi096.stdout:7/784: write db/d1f/f7d [1841245,3815] 0 2024-04-18T04:58:09.389 INFO:tasks.workunit.client.0.smithi096.stdout:7/785: fsync db/f18 0 2024-04-18T04:58:09.389 INFO:tasks.workunit.client.0.smithi096.stdout:0/720: rename d16/d1c/d4c/d4d/d5d/d91/fa8 to d16/d1c/d4c/d4e/fdf 0 2024-04-18T04:58:09.391 INFO:tasks.workunit.client.0.smithi096.stdout:0/721: write d16/f1b [2203180,82124] 0 2024-04-18T04:58:09.392 INFO:tasks.workunit.client.0.smithi096.stdout:7/786: symlink db/d20/d45/dcf/lf4 0 2024-04-18T04:58:09.393 INFO:tasks.workunit.client.0.smithi096.stdout:8/670: mknod d0/d7/d24/d18/cd5 0 2024-04-18T04:58:09.394 INFO:tasks.workunit.client.0.smithi096.stdout:9/842: symlink d0/de/d17/d2f/d40/dc1/l108 0 2024-04-18T04:58:09.395 INFO:tasks.workunit.client.0.smithi096.stdout:8/671: symlink d0/d15/ld6 0 2024-04-18T04:58:09.395 INFO:tasks.workunit.client.0.smithi096.stdout:5/725: dwrite d7/dd/d8f/f44 [4194304,4194304] 0 2024-04-18T04:58:09.396 INFO:tasks.workunit.client.0.smithi096.stdout:0/722: mknod d16/d1c/d4c/d4d/d5d/dc6/ce0 0 2024-04-18T04:58:09.400 INFO:tasks.workunit.client.0.smithi096.stdout:8/672: dread d0/d3/fb0 [0,4194304] 0 2024-04-18T04:58:09.401 INFO:tasks.workunit.client.0.smithi096.stdout:5/726: symlink d7/dd/d8f/da2/de2/de3/d78/dc1/l108 0 2024-04-18T04:58:09.403 INFO:tasks.workunit.client.0.smithi096.stdout:0/723: rename d16/f40 to d16/d55/fe1 0 2024-04-18T04:58:09.406 INFO:tasks.workunit.client.0.smithi096.stdout:8/673: dread d0/d7/d24/d35/f5e [0,4194304] 0 2024-04-18T04:58:09.408 INFO:tasks.workunit.client.0.smithi096.stdout:0/724: fdatasync d16/d1c/f9c 0 2024-04-18T04:58:09.409 INFO:tasks.workunit.client.0.smithi096.stdout:7/787: getdents db/d20/d45/dcf/dd6/dde 0 2024-04-18T04:58:09.410 INFO:tasks.workunit.client.0.smithi096.stdout:5/727: mkdir d7/dd/d35/d109 0 2024-04-18T04:58:09.411 INFO:tasks.workunit.client.0.smithi096.stdout:9/843: dwrite d0/ffb [0,4194304] 0 2024-04-18T04:58:09.412 INFO:tasks.workunit.client.0.smithi096.stdout:5/728: dread d7/d25/d30/f6c [0,4194304] 0 2024-04-18T04:58:09.414 INFO:tasks.workunit.client.0.smithi096.stdout:0/725: creat d16/d78/fe2 x:0 0 0 2024-04-18T04:58:09.417 INFO:tasks.workunit.client.0.smithi096.stdout:5/729: mkdir d7/dd/d8f/da2/de2/de3/d56/ddd/d10a 0 2024-04-18T04:58:09.418 INFO:tasks.workunit.client.0.smithi096.stdout:7/788: dwrite db/ff [0,4194304] 0 2024-04-18T04:58:09.422 INFO:tasks.workunit.client.0.smithi096.stdout:9/844: dread d0/de/d17/d2f/d40/d8b/de1/f9b [0,4194304] 0 2024-04-18T04:58:09.426 INFO:tasks.workunit.client.0.smithi096.stdout:0/726: dwrite d16/d1c/d4c/d4d/d5a/f6c [0,4194304] 0 2024-04-18T04:58:09.431 INFO:tasks.workunit.client.0.smithi096.stdout:0/727: rmdir d16/d1c/d4c/d4d/d5d/dc6 39 2024-04-18T04:58:09.431 INFO:tasks.workunit.client.0.smithi096.stdout:9/845: symlink d0/de/d17/d56/d59/d68/dab/l109 0 2024-04-18T04:58:09.434 INFO:tasks.workunit.client.0.smithi096.stdout:0/728: unlink d16/d1c/c3d 0 2024-04-18T04:58:09.434 INFO:tasks.workunit.client.0.smithi096.stdout:7/789: dread db/d1f/f7d [0,4194304] 0 2024-04-18T04:58:09.436 INFO:tasks.workunit.client.0.smithi096.stdout:7/790: readlink db/d1f/d39/d6d/lb5 0 2024-04-18T04:58:09.437 INFO:tasks.workunit.client.0.smithi096.stdout:0/729: readlink d16/d1c/d4c/d6a/l82 0 2024-04-18T04:58:09.438 INFO:tasks.workunit.client.0.smithi096.stdout:7/791: write db/d1f/d5b/d6a/dc6/fea [700368,14612] 0 2024-04-18T04:58:09.445 INFO:tasks.workunit.client.0.smithi096.stdout:9/846: dwrite d0/de/f7b [0,4194304] 0 2024-04-18T04:58:09.446 INFO:tasks.workunit.client.0.smithi096.stdout:5/730: dread d7/d25/d30/f4b [0,4194304] 0 2024-04-18T04:58:09.448 INFO:tasks.workunit.client.0.smithi096.stdout:5/731: truncate d7/d25/d30/fa7 930666 0 2024-04-18T04:58:09.449 INFO:tasks.workunit.client.0.smithi096.stdout:9/847: creat d0/de/d17/d56/d59/d68/dab/d33/f10a x:0 0 0 2024-04-18T04:58:09.450 INFO:tasks.workunit.client.0.smithi096.stdout:9/848: truncate d0/de/d17/d2f/dd5/ff6 213414 0 2024-04-18T04:58:09.452 INFO:tasks.workunit.client.0.smithi096.stdout:5/732: truncate d7/f46 3339131 0 2024-04-18T04:58:09.453 INFO:tasks.workunit.client.0.smithi096.stdout:7/792: link db/d1f/d24/d49/f71 db/d1f/d5b/d6a/dc6/de3/ff5 0 2024-04-18T04:58:09.459 INFO:tasks.workunit.client.0.smithi096.stdout:9/849: dwrite d0/de/d17/d56/d59/d60/fcf [0,4194304] 0 2024-04-18T04:58:09.468 INFO:tasks.workunit.client.0.smithi096.stdout:5/733: write d7/d3b/fcf [972674,113085] 0 2024-04-18T04:58:09.473 INFO:tasks.workunit.client.0.smithi096.stdout:5/734: truncate d7/d25/d58/f62 874052 0 2024-04-18T04:58:09.476 INFO:tasks.workunit.client.0.smithi096.stdout:9/850: dread d0/de/d17/d56/d59/d68/dab/d33/fef [0,4194304] 0 2024-04-18T04:58:09.477 INFO:tasks.workunit.client.0.smithi096.stdout:5/735: symlink d7/dd/d8f/da2/de2/de3/d52/l10b 0 2024-04-18T04:58:09.479 INFO:tasks.workunit.client.0.smithi096.stdout:5/736: mkdir d7/da3/d9a/d10c 0 2024-04-18T04:58:09.479 INFO:tasks.workunit.client.0.smithi096.stdout:5/737: fdatasync d7/d25/d7c/fa6 0 2024-04-18T04:58:09.482 INFO:tasks.workunit.client.0.smithi096.stdout:5/738: creat d7/da3/d9a/d10c/f10d x:0 0 0 2024-04-18T04:58:09.483 INFO:tasks.workunit.client.0.smithi096.stdout:9/851: dwrite d0/de/d17/d56/d59/d68/f8e [0,4194304] 0 2024-04-18T04:58:09.483 INFO:tasks.workunit.client.0.smithi096.stdout:5/739: readlink d7/dd/d8f/d5e/lfc 0 2024-04-18T04:58:09.486 INFO:tasks.workunit.client.0.smithi096.stdout:5/740: rmdir d7/d3b/d95 39 2024-04-18T04:58:09.487 INFO:tasks.workunit.client.0.smithi096.stdout:3/994: sync 2024-04-18T04:58:09.487 INFO:tasks.workunit.client.0.smithi096.stdout:5/741: creat d7/da3/f10e x:0 0 0 2024-04-18T04:58:09.489 INFO:tasks.workunit.client.0.smithi096.stdout:3/995: write dc/d26/d4a/f58 [4057378,35687] 0 2024-04-18T04:58:09.489 INFO:tasks.workunit.client.0.smithi096.stdout:5/742: dread - d7/d25/d58/f102 zero size 2024-04-18T04:58:09.493 INFO:tasks.workunit.client.0.smithi096.stdout:5/743: dread d7/dd/d8f/da2/de2/de3/f70 [0,4194304] 0 2024-04-18T04:58:09.497 INFO:tasks.workunit.client.0.smithi096.stdout:5/744: rename d7/dd/d8f/da2/de2/de3/d56/f83 to d7/d25/d30/d9e/f10f 0 2024-04-18T04:58:09.500 INFO:tasks.workunit.client.0.smithi096.stdout:5/745: getdents d7/da3/d9a/d10c 0 2024-04-18T04:58:09.502 INFO:tasks.workunit.client.0.smithi096.stdout:5/746: mkdir d7/d3b/d110 0 2024-04-18T04:58:09.505 INFO:tasks.workunit.client.0.smithi096.stdout:5/747: rmdir d7/dd/d35 39 2024-04-18T04:58:09.507 INFO:tasks.workunit.client.0.smithi096.stdout:5/748: mkdir d7/d25/d2b/d111 0 2024-04-18T04:58:09.513 INFO:tasks.workunit.client.0.smithi096.stdout:5/749: dwrite d7/dd/d8f/f2d [0,4194304] 0 2024-04-18T04:58:09.514 INFO:tasks.workunit.client.0.smithi096.stdout:5/750: stat d7/d3b/d95/ffb 0 2024-04-18T04:58:09.517 INFO:tasks.workunit.client.0.smithi096.stdout:5/751: symlink d7/dd/d8f/da2/de2/de3/d36/de7/l112 0 2024-04-18T04:58:09.517 INFO:tasks.workunit.client.0.smithi096.stdout:5/752: readlink d7/d25/l4e 0 2024-04-18T04:58:09.518 INFO:tasks.workunit.client.0.smithi096.stdout:5/753: stat d7/d25/d2b 0 2024-04-18T04:58:09.534 INFO:tasks.workunit.client.0.smithi096.stdout:5/754: dread d7/d3b/f7f [0,4194304] 0 2024-04-18T04:58:09.534 INFO:tasks.workunit.client.0.smithi096.stdout:5/755: chown d7/d25/d30/f99 22013141 1 2024-04-18T04:58:09.536 INFO:tasks.workunit.client.0.smithi096.stdout:5/756: creat d7/d25/d7c/df1/f113 x:0 0 0 2024-04-18T04:58:09.537 INFO:tasks.workunit.client.0.smithi096.stdout:5/757: dread - d7/d3b/f106 zero size 2024-04-18T04:58:09.538 INFO:tasks.workunit.client.0.smithi096.stdout:5/758: mknod d7/da3/d9a/c114 0 2024-04-18T04:58:09.539 INFO:tasks.workunit.client.0.smithi096.stdout:5/759: chown d7/dd/d8f/da2/cee 243 1 2024-04-18T04:58:09.545 INFO:tasks.workunit.client.0.smithi096.stdout:5/760: dread d7/f22 [0,4194304] 0 2024-04-18T04:58:09.548 INFO:tasks.workunit.client.0.smithi096.stdout:5/761: rmdir d7/dd/d8f/da2/de2/de3 39 2024-04-18T04:58:09.549 INFO:tasks.workunit.client.0.smithi096.stdout:5/762: write d7/dd/d8f/d5e/f79 [3669485,1004] 0 2024-04-18T04:58:09.555 INFO:tasks.workunit.client.0.smithi096.stdout:5/763: dwrite d7/d25/d2b/fae [0,4194304] 0 2024-04-18T04:58:09.556 INFO:tasks.workunit.client.0.smithi096.stdout:5/764: fsync d7/d25/d2b/f45 0 2024-04-18T04:58:09.557 INFO:tasks.workunit.client.0.smithi096.stdout:5/765: truncate d7/da3/d9a/fc8 4468221 0 2024-04-18T04:58:09.565 INFO:tasks.workunit.client.0.smithi096.stdout:5/766: dwrite d7/d25/d30/f6c [0,4194304] 0 2024-04-18T04:58:09.576 INFO:tasks.workunit.client.0.smithi096.stdout:5/767: dread d7/da3/d9a/fe0 [0,4194304] 0 2024-04-18T04:58:09.582 INFO:tasks.workunit.client.0.smithi096.stdout:5/768: truncate d7/dd/f19 3264140 0 2024-04-18T04:58:09.586 INFO:tasks.workunit.client.0.smithi096.stdout:5/769: getdents d7/d25/d7c/df1 0 2024-04-18T04:58:09.589 INFO:tasks.workunit.client.0.smithi096.stdout:5/770: mknod d7/d25/d30/d9e/dc3/c115 0 2024-04-18T04:58:09.596 INFO:tasks.workunit.client.0.smithi096.stdout:5/771: truncate d7/d25/d30/faa 3990579 0 2024-04-18T04:58:09.600 INFO:tasks.workunit.client.0.smithi096.stdout:5/772: mknod d7/dd/d8f/da2/de2/de3/d36/de1/c116 0 2024-04-18T04:58:09.600 INFO:tasks.workunit.client.0.smithi096.stdout:5/773: truncate d7/d3b/f106 817327 0 2024-04-18T04:58:09.607 INFO:tasks.workunit.client.0.smithi096.stdout:5/774: truncate d7/d25/d30/fa7 820561 0 2024-04-18T04:58:09.611 INFO:tasks.workunit.client.0.smithi096.stdout:5/775: mknod d7/d3b/d110/c117 0 2024-04-18T04:58:09.614 INFO:tasks.workunit.client.0.smithi096.stdout:5/776: mknod d7/d3b/c118 0 2024-04-18T04:58:09.620 INFO:tasks.workunit.client.0.smithi096.stdout:5/777: dwrite d7/d25/d7c/fa6 [0,4194304] 0 2024-04-18T04:58:09.632 INFO:tasks.workunit.client.0.smithi096.stdout:5/778: rename d7/dcd/fc5 to d7/d3b/f119 0 2024-04-18T04:58:09.633 INFO:tasks.workunit.client.0.smithi096.stdout:5/779: write d7/dd/d8f/da2/de2/de3/d36/de1/fa4 [3428805,26256] 0 2024-04-18T04:58:09.636 INFO:tasks.workunit.client.0.smithi096.stdout:4/759: sync 2024-04-18T04:58:09.638 INFO:tasks.workunit.client.0.smithi096.stdout:5/780: creat d7/dd/d35/d74/dab/d100/f11a x:0 0 0 2024-04-18T04:58:09.638 INFO:tasks.workunit.client.0.smithi096.stdout:4/760: rmdir d4/d14/d2d/d44 39 2024-04-18T04:58:09.642 INFO:tasks.workunit.client.0.smithi096.stdout:5/781: truncate d7/d25/f4d 1732681 0 2024-04-18T04:58:09.645 INFO:tasks.workunit.client.0.smithi096.stdout:5/782: mknod d7/d25/d2b/c11b 0 2024-04-18T04:58:09.645 INFO:tasks.workunit.client.0.smithi096.stdout:5/783: chown d7/d25/f27 75255 1 2024-04-18T04:58:09.652 INFO:tasks.workunit.client.0.smithi096.stdout:5/784: dwrite d7/da3/d9a/fb6 [0,4194304] 0 2024-04-18T04:58:09.662 INFO:tasks.workunit.client.0.smithi096.stdout:4/761: dread d4/d14/d16/f3f [0,4194304] 0 2024-04-18T04:58:09.667 INFO:tasks.workunit.client.0.smithi096.stdout:5/785: getdents d7/d25/d2b 0 2024-04-18T04:58:09.667 INFO:tasks.workunit.client.0.smithi096.stdout:5/786: readlink d7/dd/d35/le5 0 2024-04-18T04:58:09.669 INFO:tasks.workunit.client.0.smithi096.stdout:4/762: creat d4/d14/fe6 x:0 0 0 2024-04-18T04:58:09.673 INFO:tasks.workunit.client.0.smithi096.stdout:4/763: dread d4/fb1 [0,4194304] 0 2024-04-18T04:58:09.677 INFO:tasks.workunit.client.0.smithi096.stdout:4/764: chown d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/f96 198645207 1 2024-04-18T04:58:09.682 INFO:tasks.workunit.client.0.smithi096.stdout:5/787: write d7/d3b/d95/ffb [1633245,107412] 0 2024-04-18T04:58:09.689 INFO:tasks.workunit.client.0.smithi096.stdout:4/765: truncate d4/d14/d2d/d44/da2/fba 1507534 0 2024-04-18T04:58:09.691 INFO:tasks.workunit.client.0.smithi096.stdout:4/766: write d4/d14/d2d/d44/da2/fc9 [807582,100520] 0 2024-04-18T04:58:09.694 INFO:tasks.workunit.client.0.smithi096.stdout:5/788: dwrite d7/d25/d2b/f3d [0,4194304] 0 2024-04-18T04:58:09.696 INFO:tasks.workunit.client.0.smithi096.stdout:4/767: rename d4/d14/d2d/d44/f5e to d4/d14/d2d/d44/dcb/dd1/fe7 0 2024-04-18T04:58:09.706 INFO:tasks.workunit.client.0.smithi096.stdout:5/789: creat d7/da3/f11c x:0 0 0 2024-04-18T04:58:09.707 INFO:tasks.workunit.client.0.smithi096.stdout:5/790: truncate d7/dd/d8f/da2/de2/de3/d78/dc1/fc6 1630703 0 2024-04-18T04:58:09.708 INFO:tasks.workunit.client.0.smithi096.stdout:4/768: creat d4/d14/d2d/d44/d58/fe8 x:0 0 0 2024-04-18T04:58:09.711 INFO:tasks.workunit.client.0.smithi096.stdout:5/791: creat d7/dd/d8f/da2/de2/de3/d56/f11d x:0 0 0 2024-04-18T04:58:09.713 INFO:tasks.workunit.client.0.smithi096.stdout:4/769: rename d4/c12 to d4/d14/d2d/d44/d58/d86/d6f/dc5/ce9 0 2024-04-18T04:58:09.714 INFO:tasks.workunit.client.0.smithi096.stdout:5/792: dread d7/dd/d8f/da2/de2/de3/d36/dd5/fed [0,4194304] 0 2024-04-18T04:58:09.715 INFO:tasks.workunit.client.0.smithi096.stdout:5/793: chown d7/d25/d30/d9e/dc3/c115 14671840 1 2024-04-18T04:58:09.717 INFO:tasks.workunit.client.0.smithi096.stdout:5/794: creat d7/da3/d9a/f11e x:0 0 0 2024-04-18T04:58:09.722 INFO:tasks.workunit.client.0.smithi096.stdout:4/770: rename d4/d14/d2d/d44/d58/d86/f36 to d4/d7a/fea 0 2024-04-18T04:58:09.726 INFO:tasks.workunit.client.0.smithi096.stdout:4/771: link d4/d14/d2d/d44/d58/d86/d3a/le4 d4/d14/d2d/da6/dc6/leb 0 2024-04-18T04:58:09.737 INFO:tasks.workunit.client.0.smithi096.stdout:4/772: dwrite d4/f24 [4194304,4194304] 0 2024-04-18T04:58:09.742 INFO:tasks.workunit.client.0.smithi096.stdout:4/773: rename d4/d14/d16/c3e to d4/d14/d2d/d44/d90/dd0/cec 0 2024-04-18T04:58:09.747 INFO:tasks.workunit.client.0.smithi096.stdout:8/674: sync 2024-04-18T04:58:09.747 INFO:tasks.workunit.client.0.smithi096.stdout:1/861: sync 2024-04-18T04:58:09.749 INFO:tasks.workunit.client.0.smithi096.stdout:4/774: dread d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/fb0 [0,4194304] 0 2024-04-18T04:58:09.751 INFO:tasks.workunit.client.0.smithi096.stdout:1/862: unlink de/d1d/d32/d6f/d85/l97 0 2024-04-18T04:58:09.755 INFO:tasks.workunit.client.0.smithi096.stdout:8/675: dwrite d0/d3/d32/f72 [0,4194304] 0 2024-04-18T04:58:09.758 INFO:tasks.workunit.client.0.smithi096.stdout:8/676: symlink d0/d7/d24/d78/ld7 0 2024-04-18T04:58:09.759 INFO:tasks.workunit.client.0.smithi096.stdout:4/775: dwrite d4/d14/d1d/f27 [0,4194304] 0 2024-04-18T04:58:09.759 INFO:tasks.workunit.client.0.smithi096.stdout:1/863: dwrite de/d1d/d3f/d4f/da9/f111 [0,4194304] 0 2024-04-18T04:58:09.762 INFO:tasks.workunit.client.0.smithi096.stdout:8/677: mkdir d0/d3/dd8 0 2024-04-18T04:58:09.768 INFO:tasks.workunit.client.0.smithi096.stdout:4/776: creat d4/d14/d2d/d44/d89/fed x:0 0 0 2024-04-18T04:58:09.778 INFO:tasks.workunit.client.0.smithi096.stdout:4/777: rmdir d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/dd2 0 2024-04-18T04:58:09.785 INFO:tasks.workunit.client.0.smithi096.stdout:1/864: dwrite de/d1d/f42 [0,4194304] 0 2024-04-18T04:58:09.786 INFO:tasks.workunit.client.0.smithi096.stdout:8/678: dwrite d0/d7/d24/d18/d5d/fb5 [0,4194304] 0 2024-04-18T04:58:09.787 INFO:tasks.workunit.client.0.smithi096.stdout:1/865: chown de/d1d/d81/ded/ff2 0 1 2024-04-18T04:58:09.788 INFO:tasks.workunit.client.0.smithi096.stdout:8/679: truncate d0/d3/fb0 1814653 0 2024-04-18T04:58:09.793 INFO:tasks.workunit.client.0.smithi096.stdout:4/778: dread d4/d14/d16/f40 [8388608,4194304] 0 2024-04-18T04:58:09.796 INFO:tasks.workunit.client.0.smithi096.stdout:4/779: creat d4/d7a/fee x:0 0 0 2024-04-18T04:58:09.798 INFO:tasks.workunit.client.0.smithi096.stdout:4/780: read d4/d14/d2d/d44/f5f [3140718,28393] 0 2024-04-18T04:58:09.800 INFO:tasks.workunit.client.0.smithi096.stdout:1/866: write de/d1d/d81/fb6 [1037444,93331] 0 2024-04-18T04:58:09.801 INFO:tasks.workunit.client.0.smithi096.stdout:4/781: mkdir d4/d14/d1d/da5/d67/def 0 2024-04-18T04:58:09.802 INFO:tasks.workunit.client.0.smithi096.stdout:1/867: rmdir de/d1d/d81/ded 39 2024-04-18T04:58:09.806 INFO:tasks.workunit.client.0.smithi096.stdout:8/680: truncate d0/d7/d24/f45 1414425 0 2024-04-18T04:58:09.809 INFO:tasks.workunit.client.0.smithi096.stdout:1/868: rename de/d1d/l1f to de/d1d/d32/d73/d8b/l116 0 2024-04-18T04:58:09.813 INFO:tasks.workunit.client.0.smithi096.stdout:8/681: dwrite d0/fc0 [0,4194304] 0 2024-04-18T04:58:09.813 INFO:tasks.workunit.client.0.smithi096.stdout:1/869: mknod de/d1d/d81/dda/c117 0 2024-04-18T04:58:09.817 INFO:tasks.workunit.client.0.smithi096.stdout:8/682: mkdir d0/d7/d24/d18/dd9 0 2024-04-18T04:58:09.818 INFO:tasks.workunit.client.0.smithi096.stdout:8/683: readlink d0/d7/d24/d78/l9a 0 2024-04-18T04:58:09.820 INFO:tasks.workunit.client.0.smithi096.stdout:8/684: stat d0/d7/d24/d35/d51/d5b/cae 0 2024-04-18T04:58:09.821 INFO:tasks.workunit.client.0.smithi096.stdout:1/870: dwrite de/d1d/d32/d9a/dad/fd6 [0,4194304] 0 2024-04-18T04:58:09.825 INFO:tasks.workunit.client.0.smithi096.stdout:4/782: dread d4/d14/d1d/f25 [0,4194304] 0 2024-04-18T04:58:09.826 INFO:tasks.workunit.client.0.smithi096.stdout:4/783: fdatasync d4/d14/d2d/d44/d58/d86/d3a/d39/d54/f91 0 2024-04-18T04:58:09.829 INFO:tasks.workunit.client.0.smithi096.stdout:8/685: creat d0/d7/d24/d18/dd9/fda x:0 0 0 2024-04-18T04:58:09.829 INFO:tasks.workunit.client.0.smithi096.stdout:8/686: stat d0/d7/d86/c9f 0 2024-04-18T04:58:09.833 INFO:tasks.workunit.client.0.smithi096.stdout:4/784: mknod d4/d14/d2d/d44/d58/d86/d3a/d39/cf0 0 2024-04-18T04:58:09.836 INFO:tasks.workunit.client.0.smithi096.stdout:4/785: unlink d4/d14/d2d/d44/d58/d86/d3a/d39/cf0 0 2024-04-18T04:58:09.841 INFO:tasks.workunit.client.0.smithi096.stdout:1/871: write de/d1d/f4a [991700,16103] 0 2024-04-18T04:58:09.844 INFO:tasks.workunit.client.0.smithi096.stdout:1/872: symlink de/d1d/l118 0 2024-04-18T04:58:09.844 INFO:tasks.workunit.client.0.smithi096.stdout:4/786: rmdir d4/d14/d2d/d44/d58/d86 39 2024-04-18T04:58:09.845 INFO:tasks.workunit.client.0.smithi096.stdout:1/873: dread de/d7b/fc9 [0,4194304] 0 2024-04-18T04:58:09.846 INFO:tasks.workunit.client.0.smithi096.stdout:4/787: mkdir d4/d14/d2d/d44/d58/d86/d3a/df1 0 2024-04-18T04:58:09.847 INFO:tasks.workunit.client.0.smithi096.stdout:1/874: mknod de/d109/d96/df8/c119 0 2024-04-18T04:58:09.847 INFO:tasks.workunit.client.0.smithi096.stdout:1/875: chown de/d109/d96/df8/c119 389166 1 2024-04-18T04:58:09.848 INFO:tasks.workunit.client.0.smithi096.stdout:0/730: sync 2024-04-18T04:58:09.848 INFO:tasks.workunit.client.0.smithi096.stdout:4/788: creat d4/d14/d1d/ff2 x:0 0 0 2024-04-18T04:58:09.850 INFO:tasks.workunit.client.0.smithi096.stdout:0/731: creat d16/d1d/fe3 x:0 0 0 2024-04-18T04:58:09.851 INFO:tasks.workunit.client.0.smithi096.stdout:4/789: mkdir d4/d14/d1d/da5/d67/def/df3 0 2024-04-18T04:58:09.851 INFO:tasks.workunit.client.0.smithi096.stdout:0/732: dread - d16/d1d/fe3 zero size 2024-04-18T04:58:09.853 INFO:tasks.workunit.client.0.smithi096.stdout:1/876: dread de/f5e [0,4194304] 0 2024-04-18T04:58:09.854 INFO:tasks.workunit.client.0.smithi096.stdout:0/733: creat d16/d1c/d22/d2c/fe4 x:0 0 0 2024-04-18T04:58:09.857 INFO:tasks.workunit.client.0.smithi096.stdout:1/877: rename de/d1d/d3f/d5f to de/d1d/d32/d9a/d11a 0 2024-04-18T04:58:09.857 INFO:tasks.workunit.client.0.smithi096.stdout:1/878: stat de/d1d/d32/d9a/d11a/dc7/fde 0 2024-04-18T04:58:09.860 INFO:tasks.workunit.client.0.smithi096.stdout:1/879: symlink de/d1d/d32/d9a/l11b 0 2024-04-18T04:58:09.866 INFO:tasks.workunit.client.0.smithi096.stdout:0/734: truncate d16/d1c/d4c/d4d/d5a/f6c 1422751 0 2024-04-18T04:58:09.866 INFO:tasks.workunit.client.0.smithi096.stdout:1/880: rmdir de/d1d/d32/d9a 39 2024-04-18T04:58:09.867 INFO:tasks.workunit.client.0.smithi096.stdout:1/881: dread - de/d7b/ff0 zero size 2024-04-18T04:58:09.867 INFO:tasks.workunit.client.0.smithi096.stdout:0/735: unlink d16/d1c/d4c/d4e/c52 0 2024-04-18T04:58:09.868 INFO:tasks.workunit.client.0.smithi096.stdout:1/882: fsync de/d1d/d3f/f61 0 2024-04-18T04:58:09.874 INFO:tasks.workunit.client.0.smithi096.stdout:1/883: dwrite de/f2e [0,4194304] 0 2024-04-18T04:58:09.875 INFO:tasks.workunit.client.0.smithi096.stdout:0/736: write d16/d1c/d22/fbe [141365,98966] 0 2024-04-18T04:58:09.878 INFO:tasks.workunit.client.0.smithi096.stdout:1/884: creat de/d1d/d32/d6f/d85/dfb/f11c x:0 0 0 2024-04-18T04:58:09.883 INFO:tasks.workunit.client.0.smithi096.stdout:1/885: mkdir de/d1d/d3f/d4f/d11d 0 2024-04-18T04:58:09.888 INFO:tasks.workunit.client.0.smithi096.stdout:0/737: dread d16/d55/fe1 [0,4194304] 0 2024-04-18T04:58:09.889 INFO:tasks.workunit.client.0.smithi096.stdout:0/738: truncate d16/f42 4460336 0 2024-04-18T04:58:09.889 INFO:tasks.workunit.client.0.smithi096.stdout:0/739: chown d16/d1c/d4c/d4d/d5d/d91 1178 1 2024-04-18T04:58:09.890 INFO:tasks.workunit.client.0.smithi096.stdout:0/740: stat d16/c20 0 2024-04-18T04:58:09.891 INFO:tasks.workunit.client.0.smithi096.stdout:0/741: chown d16/d1d/d3b/dc3/cd5 977 1 2024-04-18T04:58:09.891 INFO:tasks.workunit.client.0.smithi096.stdout:1/886: truncate de/d1d/d3f/f45 5989654 0 2024-04-18T04:58:09.891 INFO:tasks.workunit.client.0.smithi096.stdout:0/742: chown d16/d1d/c4f 722 1 2024-04-18T04:58:09.892 INFO:tasks.workunit.client.0.smithi096.stdout:0/743: chown d16/d1c/d4c/d4d/d5d/c77 9 1 2024-04-18T04:58:09.893 INFO:tasks.workunit.client.0.smithi096.stdout:1/887: dread - de/d1d/d32/d9a/d11a/f110 zero size 2024-04-18T04:58:09.895 INFO:tasks.workunit.client.0.smithi096.stdout:0/744: rename d16/d55/fbf to d16/d1c/d4c/d4d/d5d/d91/fe5 0 2024-04-18T04:58:09.896 INFO:tasks.workunit.client.0.smithi096.stdout:0/745: chown d16/fbb 446 1 2024-04-18T04:58:09.898 INFO:tasks.workunit.client.0.smithi096.stdout:0/746: creat d16/d1d/d3b/fe6 x:0 0 0 2024-04-18T04:58:09.899 INFO:tasks.workunit.client.0.smithi096.stdout:0/747: fsync d16/d1c/d22/d2c/fd2 0 2024-04-18T04:58:09.901 INFO:tasks.workunit.client.0.smithi096.stdout:1/888: dwrite de/d109/d96/fa6 [0,4194304] 0 2024-04-18T04:58:09.902 INFO:tasks.workunit.client.0.smithi096.stdout:1/889: chown de/d1d/d3f/f10e 391092770 1 2024-04-18T04:58:09.907 INFO:tasks.workunit.client.0.smithi096.stdout:0/748: write d16/d1d/d3b/f46 [1664282,18392] 0 2024-04-18T04:58:09.910 INFO:tasks.workunit.client.0.smithi096.stdout:0/749: symlink d16/d1c/d4c/d4d/d5d/dd7/le7 0 2024-04-18T04:58:09.912 INFO:tasks.workunit.client.0.smithi096.stdout:0/750: mkdir d16/d1c/d4c/d4d/d5d/de8 0 2024-04-18T04:58:09.916 INFO:tasks.workunit.client.0.smithi096.stdout:1/890: dwrite de/d1d/d3f/f45 [4194304,4194304] 0 2024-04-18T04:58:09.922 INFO:tasks.workunit.client.0.smithi096.stdout:1/891: rename de/d109/d96/df8/d115 to de/d1d/d32/d11e 0 2024-04-18T04:58:09.922 INFO:tasks.workunit.client.0.smithi096.stdout:1/892: write de/d7b/ff0 [1011994,13630] 0 2024-04-18T04:58:09.923 INFO:tasks.workunit.client.0.smithi096.stdout:0/751: dwrite d16/d1c/f29 [0,4194304] 0 2024-04-18T04:58:09.927 INFO:tasks.workunit.client.0.smithi096.stdout:1/893: rename de/d109/d96/fb9 to de/d1d/d32/d11e/f11f 0 2024-04-18T04:58:09.929 INFO:tasks.workunit.client.0.smithi096.stdout:1/894: dread - de/d1d/d32/d73/ff5 zero size 2024-04-18T04:58:09.931 INFO:tasks.workunit.client.0.smithi096.stdout:1/895: write de/d1d/f87 [1350492,47716] 0 2024-04-18T04:58:09.932 INFO:tasks.workunit.client.0.smithi096.stdout:0/752: dwrite d16/d78/fe2 [0,4194304] 0 2024-04-18T04:58:09.934 INFO:tasks.workunit.client.0.smithi096.stdout:0/753: write d16/d1c/f8c [857239,478] 0 2024-04-18T04:58:09.935 INFO:tasks.workunit.client.0.smithi096.stdout:0/754: dread - d16/d1c/d4c/d4e/fd9 zero size 2024-04-18T04:58:09.936 INFO:tasks.workunit.client.0.smithi096.stdout:1/896: mknod de/d1d/d3f/d4f/c120 0 2024-04-18T04:58:09.937 INFO:tasks.workunit.client.0.smithi096.stdout:0/755: chown d16/d1c/d4c/d4d/d5d/dc6 1753 1 2024-04-18T04:58:09.939 INFO:tasks.workunit.client.0.smithi096.stdout:1/897: mknod de/d1d/c121 0 2024-04-18T04:58:09.941 INFO:tasks.workunit.client.0.smithi096.stdout:1/898: creat de/d1d/d3f/d4f/da9/f122 x:0 0 0 2024-04-18T04:58:09.943 INFO:tasks.workunit.client.0.smithi096.stdout:0/756: dread d16/d1d/f1e [0,4194304] 0 2024-04-18T04:58:09.944 INFO:tasks.workunit.client.0.smithi096.stdout:0/757: readlink d16/d1c/d4c/d4d/d5d/dc6/l75 0 2024-04-18T04:58:09.946 INFO:tasks.workunit.client.0.smithi096.stdout:0/758: creat d16/d1c/d4c/d4d/d5d/dc6/fe9 x:0 0 0 2024-04-18T04:58:09.948 INFO:tasks.workunit.client.0.smithi096.stdout:1/899: dwrite de/d1d/d32/f69 [0,4194304] 0 2024-04-18T04:58:09.951 INFO:tasks.workunit.client.0.smithi096.stdout:1/900: unlink de/l24 0 2024-04-18T04:58:09.953 INFO:tasks.workunit.client.0.smithi096.stdout:1/901: mknod de/d7b/c123 0 2024-04-18T04:58:09.954 INFO:tasks.workunit.client.0.smithi096.stdout:3/996: sync 2024-04-18T04:58:09.954 INFO:tasks.workunit.client.0.smithi096.stdout:7/793: sync 2024-04-18T04:58:09.954 INFO:tasks.workunit.client.0.smithi096.stdout:9/852: sync 2024-04-18T04:58:09.954 INFO:tasks.workunit.client.0.smithi096.stdout:5/795: sync 2024-04-18T04:58:09.960 INFO:tasks.workunit.client.0.smithi096.stdout:5/796: rename d7/dd/d8f/da2/de2/de3/d36 to d7/da3/d11f 0 2024-04-18T04:58:09.962 INFO:tasks.workunit.client.0.smithi096.stdout:3/997: creat dc/d26/d48/dc2/d29/f13f x:0 0 0 2024-04-18T04:58:09.963 INFO:tasks.workunit.client.0.smithi096.stdout:1/902: dwrite de/d1d/fe3 [0,4194304] 0 2024-04-18T04:58:09.966 INFO:tasks.workunit.client.0.smithi096.stdout:7/794: dwrite db/d1f/d4e/f7a [4194304,4194304] 0 2024-04-18T04:58:09.970 INFO:tasks.workunit.client.0.smithi096.stdout:3/998: creat dc/d26/d48/dc2/d95/da3/f140 x:0 0 0 2024-04-18T04:58:09.972 INFO:tasks.workunit.client.0.smithi096.stdout:9/853: dread d0/de/d17/d56/d59/d68/f83 [0,4194304] 0 2024-04-18T04:58:09.973 INFO:tasks.workunit.client.0.smithi096.stdout:3/999: rename dc/d26/d66/faf to dc/dcf/dd2/f141 0 2024-04-18T04:58:09.973 INFO:tasks.workunit.client.0.smithi096.stdout:9/854: chown d0/de/d17/d2f/d40/d8b/ld0 667 1 2024-04-18T04:58:09.979 INFO:tasks.workunit.client.0.smithi096.stdout:1/903: dread de/d1d/f4a [0,4194304] 0 2024-04-18T04:58:09.979 INFO:tasks.workunit.client.0.smithi096.stdout:9/855: rename d0/de/d17/d2f/dd5 to d0/d52/d10b 0 2024-04-18T04:58:09.979 INFO:tasks.workunit.client.0.smithi096.stdout:7/795: dwrite db/d1f/f7d [4194304,4194304] 0 2024-04-18T04:58:09.980 INFO:tasks.workunit.client.0.smithi096.stdout:7/796: write db/fe [1836449,34496] 0 2024-04-18T04:58:09.984 INFO:tasks.workunit.client.0.smithi096.stdout:7/797: unlink db/d1f/d39/l67 0 2024-04-18T04:58:09.985 INFO:tasks.workunit.client.0.smithi096.stdout:1/904: mknod de/d1d/d32/d6f/c124 0 2024-04-18T04:58:09.987 INFO:tasks.workunit.client.0.smithi096.stdout:1/905: fdatasync de/d1d/f66 0 2024-04-18T04:58:09.988 INFO:tasks.workunit.client.0.smithi096.stdout:7/798: dread db/d1f/d5b/d6a/fa4 [0,4194304] 0 2024-04-18T04:58:09.989 INFO:tasks.workunit.client.0.smithi096.stdout:1/906: creat de/d1d/d32/d73/d8b/de9/f125 x:0 0 0 2024-04-18T04:58:09.990 INFO:tasks.workunit.client.0.smithi096.stdout:1/907: read - de/d1d/d32/d6f/f83 zero size 2024-04-18T04:58:09.990 INFO:tasks.workunit.client.0.smithi096.stdout:7/799: creat db/d1f/d39/d6d/d79/ff6 x:0 0 0 2024-04-18T04:58:09.993 INFO:tasks.workunit.client.0.smithi096.stdout:1/908: rename de/d1d/d3f/d4f/da9/f122 to de/d1d/d32/d9a/f126 0 2024-04-18T04:58:09.996 INFO:tasks.workunit.client.0.smithi096.stdout:1/909: creat de/d1d/d32/d9a/f127 x:0 0 0 2024-04-18T04:58:09.996 INFO:tasks.workunit.client.0.smithi096.stdout:1/910: chown de/d1d/d32/d73/d8b 0 1 2024-04-18T04:58:09.997 INFO:tasks.workunit.client.0.smithi096.stdout:7/800: mkdir db/d1f/d39/d6d/d79/d83/daa/df1/df2/df7 0 2024-04-18T04:58:09.997 INFO:tasks.workunit.client.0.smithi096.stdout:1/911: fsync de/d7b/f80 0 2024-04-18T04:58:09.997 INFO:tasks.workunit.client.0.smithi096.stdout:9/856: truncate d0/de/d17/d56/d59/d60/faf 2401243 0 2024-04-18T04:58:09.999 INFO:tasks.workunit.client.0.smithi096.stdout:1/912: write de/d1d/d32/d6f/d85/dfb/fc0 [453264,121967] 0 2024-04-18T04:58:09.999 INFO:tasks.workunit.client.0.smithi096.stdout:9/857: chown d0/de/d17/d2f/d40/l104 28037280 1 2024-04-18T04:58:10.000 INFO:tasks.workunit.client.0.smithi096.stdout:7/801: dread db/f15 [0,4194304] 0 2024-04-18T04:58:10.000 INFO:tasks.workunit.client.0.smithi096.stdout:1/913: chown de/d1d/c8f 1 1 2024-04-18T04:58:10.002 INFO:tasks.workunit.client.0.smithi096.stdout:7/802: read - db/d1f/d39/d6d/d79/d83/daa/df1/ff3 zero size 2024-04-18T04:58:10.002 INFO:tasks.workunit.client.0.smithi096.stdout:9/858: symlink d0/de/d17/d2f/d40/dd2/l10c 0 2024-04-18T04:58:10.003 INFO:tasks.workunit.client.0.smithi096.stdout:9/859: dread - d0/de/d99/ffc zero size 2024-04-18T04:58:10.003 INFO:tasks.workunit.client.0.smithi096.stdout:7/803: dread db/d1f/d4e/f78 [0,4194304] 0 2024-04-18T04:58:10.004 INFO:tasks.workunit.client.0.smithi096.stdout:1/914: link de/d1d/d32/d6f/d85/dfb/fae de/d7b/f128 0 2024-04-18T04:58:10.005 INFO:tasks.workunit.client.0.smithi096.stdout:7/804: chown db/d1f/d39/d6d/d79/d83/daa/df1/df2 142 1 2024-04-18T04:58:10.006 INFO:tasks.workunit.client.0.smithi096.stdout:1/915: symlink de/d109/d96/l129 0 2024-04-18T04:58:10.007 INFO:tasks.workunit.client.0.smithi096.stdout:9/860: mknod d0/d41/c10d 0 2024-04-18T04:58:10.008 INFO:tasks.workunit.client.0.smithi096.stdout:7/805: creat db/d20/d2f/d8d/ff8 x:0 0 0 2024-04-18T04:58:10.009 INFO:tasks.workunit.client.0.smithi096.stdout:7/806: stat db/d20/d45/dcf/dd6/dde/led 0 2024-04-18T04:58:10.010 INFO:tasks.workunit.client.0.smithi096.stdout:9/861: mknod d0/de/d17/d56/d59/d68/c10e 0 2024-04-18T04:58:10.016 INFO:tasks.workunit.client.0.smithi096.stdout:7/807: dwrite db/d1f/d4e/f7a [8388608,4194304] 0 2024-04-18T04:58:10.018 INFO:tasks.workunit.client.0.smithi096.stdout:7/808: mknod db/d1f/d24/d61/de1/cf9 0 2024-04-18T04:58:10.019 INFO:tasks.workunit.client.0.smithi096.stdout:9/862: dwrite d0/de/d17/d5c/f7c [4194304,4194304] 0 2024-04-18T04:58:10.019 INFO:tasks.workunit.client.0.smithi096.stdout:7/809: chown db/f3f 1010291 1 2024-04-18T04:58:10.019 INFO:tasks.workunit.client.0.smithi096.stdout:9/863: read - d0/de/f92 zero size 2024-04-18T04:58:10.021 INFO:tasks.workunit.client.0.smithi096.stdout:7/810: mkdir db/dfa 0 2024-04-18T04:58:10.022 INFO:tasks.workunit.client.0.smithi096.stdout:7/811: dread db/f15 [0,4194304] 0 2024-04-18T04:58:10.024 INFO:tasks.workunit.client.0.smithi096.stdout:7/812: creat db/d20/d45/dcf/dd6/ffb x:0 0 0 2024-04-18T04:58:10.027 INFO:tasks.workunit.client.0.smithi096.stdout:9/864: dwrite d0/de/d17/d2f/d40/d8b/de1/fcc [4194304,4194304] 0 2024-04-18T04:58:10.030 INFO:tasks.workunit.client.0.smithi096.stdout:9/865: rename d0/d41/fb0 to d0/de/d17/d2f/d40/da8/f10f 0 2024-04-18T04:58:10.031 INFO:tasks.workunit.client.0.smithi096.stdout:9/866: read d0/de/d17/d56/d59/d68/f83 [2596050,110] 0 2024-04-18T04:58:10.035 INFO:tasks.workunit.client.0.smithi096.stdout:9/867: link d0/d52/fb5 d0/de/d17/d2f/d40/dc1/f110 0 2024-04-18T04:58:10.037 INFO:tasks.workunit.client.0.smithi096.stdout:9/868: unlink d0/de/d17/d56/d6d/cdd 0 2024-04-18T04:58:10.038 INFO:tasks.workunit.client.0.smithi096.stdout:9/869: write d0/de/d17/d56/d59/d68/dab/d33/f10a [752183,5054] 0 2024-04-18T04:58:10.047 INFO:tasks.workunit.client.0.smithi096.stdout:9/870: write d0/de/d17/d56/d6d/f7f [850936,54139] 0 2024-04-18T04:58:10.050 INFO:tasks.workunit.client.0.smithi096.stdout:9/871: getdents d0/de/d99 0 2024-04-18T04:58:10.051 INFO:tasks.workunit.client.0.smithi096.stdout:9/872: fdatasync d0/d52/d5a/f76 0 2024-04-18T04:58:10.059 INFO:tasks.workunit.client.0.smithi096.stdout:9/873: dwrite d0/de/d17/d2f/d40/da8/f10f [0,4194304] 0 2024-04-18T04:58:10.060 INFO:tasks.workunit.client.0.smithi096.stdout:9/874: mknod d0/d52/d10b/c111 0 2024-04-18T04:58:10.061 INFO:tasks.workunit.client.0.smithi096.stdout:9/875: dread - d0/de/d17/d56/d6d/f102 zero size 2024-04-18T04:58:10.064 INFO:tasks.workunit.client.0.smithi096.stdout:9/876: mkdir d0/d6b/d89/d112 0 2024-04-18T04:58:10.067 INFO:tasks.workunit.client.0.smithi096.stdout:9/877: unlink d0/de/d17/d2f/d40/d8b/dd6/lf2 0 2024-04-18T04:58:10.073 INFO:tasks.workunit.client.0.smithi096.stdout:9/878: truncate d0/d52/f9d 2435479 0 2024-04-18T04:58:10.074 INFO:tasks.workunit.client.0.smithi096.stdout:9/879: mkdir d0/de/d17/d2f/d40/dd2/d113 0 2024-04-18T04:58:10.077 INFO:tasks.workunit.client.0.smithi096.stdout:9/880: creat d0/de/d17/d56/f114 x:0 0 0 2024-04-18T04:58:10.078 INFO:tasks.workunit.client.0.smithi096.stdout:9/881: write d0/de/d17/d56/d59/d60/fcf [1765365,103006] 0 2024-04-18T04:58:10.080 INFO:tasks.workunit.client.0.smithi096.stdout:9/882: read d0/de/d17/d56/d59/f65 [1905702,95996] 0 2024-04-18T04:58:10.084 INFO:tasks.workunit.client.0.smithi096.stdout:9/883: creat d0/de/d17/f115 x:0 0 0 2024-04-18T04:58:10.085 INFO:tasks.workunit.client.0.smithi096.stdout:9/884: write d0/de/d17/d2f/d40/da8/f10f [2918643,84178] 0 2024-04-18T04:58:10.092 INFO:tasks.workunit.client.0.smithi096.stdout:9/885: dwrite d0/d52/d10b/ff1 [0,4194304] 0 2024-04-18T04:58:10.093 INFO:tasks.workunit.client.0.smithi096.stdout:9/886: chown d0/de/d17/d2f/d40/l79 2260415 1 2024-04-18T04:58:10.100 INFO:tasks.workunit.client.0.smithi096.stdout:9/887: dwrite d0/de/d17/d56/d6d/f102 [0,4194304] 0 2024-04-18T04:58:10.102 INFO:tasks.workunit.client.0.smithi096.stdout:9/888: write d0/de/d17/d56/d59/fe6 [1168394,10627] 0 2024-04-18T04:58:10.103 INFO:tasks.workunit.client.0.smithi096.stdout:9/889: write d0/de/f92 [246035,54886] 0 2024-04-18T04:58:10.104 INFO:tasks.workunit.client.0.smithi096.stdout:9/890: fdatasync d0/de/d17/d2f/d40/d8b/de1/fcc 0 2024-04-18T04:58:10.109 INFO:tasks.workunit.client.0.smithi096.stdout:9/891: rename d0/de/d17/d56/d59/d68/dab to d0/d6b/d89/d112/d116 0 2024-04-18T04:58:10.116 INFO:tasks.workunit.client.0.smithi096.stdout:9/892: write d0/de/d17/d56/d59/d68/f106 [435862,32293] 0 2024-04-18T04:58:10.128 INFO:tasks.workunit.client.0.smithi096.stdout:8/687: sync 2024-04-18T04:58:10.132 INFO:tasks.workunit.client.0.smithi096.stdout:8/688: getdents d0/d7/d86/d91 0 2024-04-18T04:58:10.132 INFO:tasks.workunit.client.0.smithi096.stdout:9/893: dread d0/de/d17/d56/d59/d60/f8a [0,4194304] 0 2024-04-18T04:58:10.136 INFO:tasks.workunit.client.0.smithi096.stdout:9/894: rename d0/de/d17/d56/d59/d60/f8a to d0/de/d17/f117 0 2024-04-18T04:58:10.136 INFO:tasks.workunit.client.0.smithi096.stdout:8/689: write d0/d7/d24/d18/f23 [1566987,335] 0 2024-04-18T04:58:10.137 INFO:tasks.workunit.client.0.smithi096.stdout:9/895: stat d0/de/d17/d2f/d40/l79 0 2024-04-18T04:58:10.143 INFO:tasks.workunit.client.0.smithi096.stdout:9/896: mkdir d0/de/d17/d2f/d40/dd2/d118 0 2024-04-18T04:58:10.145 INFO:tasks.workunit.client.0.smithi096.stdout:8/690: link d0/d7/l43 d0/d7/d24/d35/d51/d5b/ldb 0 2024-04-18T04:58:10.146 INFO:tasks.workunit.client.0.smithi096.stdout:9/897: creat d0/de/d17/d56/f119 x:0 0 0 2024-04-18T04:58:10.149 INFO:tasks.workunit.client.0.smithi096.stdout:9/898: creat d0/de/d17/d2f/d40/d8b/dd6/f11a x:0 0 0 2024-04-18T04:58:10.150 INFO:tasks.workunit.client.0.smithi096.stdout:9/899: dread - d0/de/d17/d56/d59/d60/fb9 zero size 2024-04-18T04:58:10.152 INFO:tasks.workunit.client.0.smithi096.stdout:8/691: dwrite d0/d7/d24/d35/d51/d5b/f89 [0,4194304] 0 2024-04-18T04:58:10.157 INFO:tasks.workunit.client.0.smithi096.stdout:9/900: rename d0/de/d17/d56/d59/c64 to d0/de/d17/d2f/d40/dd2/d113/c11b 0 2024-04-18T04:58:10.158 INFO:tasks.workunit.client.0.smithi096.stdout:9/901: chown d0/d6b/d89/d112/d116/d33/l74 144 1 2024-04-18T04:58:10.159 INFO:tasks.workunit.client.0.smithi096.stdout:8/692: creat d0/d7/d24/d35/fdc x:0 0 0 2024-04-18T04:58:10.165 INFO:tasks.workunit.client.0.smithi096.stdout:9/902: creat d0/d6b/d89/d112/d116/f11c x:0 0 0 2024-04-18T04:58:10.166 INFO:tasks.workunit.client.0.smithi096.stdout:8/693: dwrite d0/d3/d32/d6b/d7b/faa [0,4194304] 0 2024-04-18T04:58:10.166 INFO:tasks.workunit.client.0.smithi096.stdout:9/903: write d0/de/f62 [1945609,86209] 0 2024-04-18T04:58:10.170 INFO:tasks.workunit.client.0.smithi096.stdout:8/694: mkdir d0/d3/d32/d6b/ddd 0 2024-04-18T04:58:10.174 INFO:tasks.workunit.client.0.smithi096.stdout:8/695: symlink d0/d7/lde 0 2024-04-18T04:58:10.176 INFO:tasks.workunit.client.0.smithi096.stdout:9/904: dwrite d0/d6b/d89/d112/d116/d33/fbf [0,4194304] 0 2024-04-18T04:58:10.179 INFO:tasks.workunit.client.0.smithi096.stdout:9/905: dread d0/de/f92 [0,4194304] 0 2024-04-18T04:58:10.183 INFO:tasks.workunit.client.0.smithi096.stdout:8/696: link d0/d7/f2a d0/d3/d32/d6b/d7b/dc9/fdf 0 2024-04-18T04:58:10.186 INFO:tasks.workunit.client.0.smithi096.stdout:8/697: rmdir d0/d7/d24/d8d 39 2024-04-18T04:58:10.193 INFO:tasks.workunit.client.0.smithi096.stdout:9/906: write d0/de/d17/d2f/d40/fd9 [1296649,117227] 0 2024-04-18T04:58:10.193 INFO:tasks.workunit.client.0.smithi096.stdout:9/907: readlink d0/de/d17/d2f/d40/l104 0 2024-04-18T04:58:10.196 INFO:tasks.workunit.client.0.smithi096.stdout:9/908: creat d0/de/d17/d2f/d40/dd2/d118/f11d x:0 0 0 2024-04-18T04:58:10.197 INFO:tasks.workunit.client.0.smithi096.stdout:8/698: dread d0/d3/f6c [0,4194304] 0 2024-04-18T04:58:10.204 INFO:tasks.workunit.client.0.smithi096.stdout:8/699: dwrite d0/d4f/fd4 [0,4194304] 0 2024-04-18T04:58:10.205 INFO:tasks.workunit.client.0.smithi096.stdout:9/909: dwrite d0/d41/fea [0,4194304] 0 2024-04-18T04:58:10.209 INFO:tasks.workunit.client.0.smithi096.stdout:9/910: creat d0/de/d17/d2f/d40/dd2/d113/f11e x:0 0 0 2024-04-18T04:58:10.210 INFO:tasks.workunit.client.0.smithi096.stdout:9/911: readlink d0/de/d17/d2f/d40/l79 0 2024-04-18T04:58:10.213 INFO:tasks.workunit.client.0.smithi096.stdout:9/912: write d0/de/d17/fbc [835021,828] 0 2024-04-18T04:58:10.213 INFO:tasks.workunit.client.0.smithi096.stdout:8/700: dwrite d0/d7/d24/d18/d27/fd3 [0,4194304] 0 2024-04-18T04:58:10.218 INFO:tasks.workunit.client.0.smithi096.stdout:9/913: creat d0/d41/f11f x:0 0 0 2024-04-18T04:58:10.219 INFO:tasks.workunit.client.0.smithi096.stdout:9/914: write d0/de/d17/d56/d59/fe6 [1799555,38589] 0 2024-04-18T04:58:10.220 INFO:tasks.workunit.client.0.smithi096.stdout:8/701: fdatasync d0/d7/d24/d18/f2d 0 2024-04-18T04:58:10.224 INFO:tasks.workunit.client.0.smithi096.stdout:9/915: creat d0/de/d99/f120 x:0 0 0 2024-04-18T04:58:10.225 INFO:tasks.workunit.client.0.smithi096.stdout:9/916: write d0/fd1 [235772,24117] 0 2024-04-18T04:58:10.226 INFO:tasks.workunit.client.0.smithi096.stdout:9/917: write d0/de/d17/d5c/f7c [2857295,96291] 0 2024-04-18T04:58:10.227 INFO:tasks.workunit.client.0.smithi096.stdout:8/702: creat d0/d15/d65/d8f/db6/fe0 x:0 0 0 2024-04-18T04:58:10.231 INFO:tasks.workunit.client.0.smithi096.stdout:8/703: rename d0/d15/ld6 to d0/d7/d24/d35/d51/d5b/le1 0 2024-04-18T04:58:10.233 INFO:tasks.workunit.client.0.smithi096.stdout:8/704: read d0/d15/f44 [502170,29660] 0 2024-04-18T04:58:10.239 INFO:tasks.workunit.client.0.smithi096.stdout:8/705: write d0/d3/d32/f48 [1327126,60143] 0 2024-04-18T04:58:10.240 INFO:tasks.workunit.client.0.smithi096.stdout:8/706: stat d0/d7/d24/d35/d51/lb2 0 2024-04-18T04:58:10.242 INFO:tasks.workunit.client.0.smithi096.stdout:9/918: dread d0/d52/f9d [0,4194304] 0 2024-04-18T04:58:10.243 INFO:tasks.workunit.client.0.smithi096.stdout:8/707: rename d0/d3/d32/d6b/d96 to d0/d7/d24/d18/d7c/dad/de2 0 2024-04-18T04:58:10.245 INFO:tasks.workunit.client.0.smithi096.stdout:9/919: mkdir d0/d52/d121 0 2024-04-18T04:58:10.246 INFO:tasks.workunit.client.0.smithi096.stdout:9/920: dread - d0/de/d17/d2f/d40/dc1/f110 zero size 2024-04-18T04:58:10.248 INFO:tasks.workunit.client.0.smithi096.stdout:9/921: read d0/d6b/d89/d112/d116/d3a/f8f [3964197,16028] 0 2024-04-18T04:58:10.255 INFO:tasks.workunit.client.0.smithi096.stdout:8/708: truncate d0/d3/f8a 2123923 0 2024-04-18T04:58:10.259 INFO:tasks.workunit.client.0.smithi096.stdout:8/709: link d0/d7/d24/d18/d27/d3c/f9b d0/d7/d24/d35/d51/d5b/fe3 0 2024-04-18T04:58:10.262 INFO:tasks.workunit.client.0.smithi096.stdout:8/710: rename d0/d7/lde to d0/d7/d86/d91/le4 0 2024-04-18T04:58:10.264 INFO:tasks.workunit.client.0.smithi096.stdout:8/711: creat d0/d7/d24/d8d/fe5 x:0 0 0 2024-04-18T04:58:10.270 INFO:tasks.workunit.client.0.smithi096.stdout:8/712: rmdir d0/d7/d24/d18/d27 39 2024-04-18T04:58:10.275 INFO:tasks.workunit.client.0.smithi096.stdout:8/713: symlink d0/d7/d24/le6 0 2024-04-18T04:58:10.278 INFO:tasks.workunit.client.0.smithi096.stdout:8/714: dread d0/d3/f6c [0,4194304] 0 2024-04-18T04:58:10.284 INFO:tasks.workunit.client.0.smithi096.stdout:8/715: rename d0/d7/d24/d78/cca to d0/d7/d24/d18/d27/ce7 0 2024-04-18T04:58:10.284 INFO:tasks.workunit.client.0.smithi096.stdout:8/716: readlink d0/d3/d32/la2 0 2024-04-18T04:58:10.288 INFO:tasks.workunit.client.0.smithi096.stdout:8/717: creat d0/d3/d32/d6b/d7b/dc9/fe8 x:0 0 0 2024-04-18T04:58:10.288 INFO:tasks.workunit.client.0.smithi096.stdout:0/759: sync 2024-04-18T04:58:10.288 INFO:tasks.workunit.client.0.smithi096.stdout:4/790: sync 2024-04-18T04:58:10.290 INFO:tasks.workunit.client.0.smithi096.stdout:8/718: dread - d0/d7/d24/d35/f8e zero size 2024-04-18T04:58:10.290 INFO:tasks.workunit.client.0.smithi096.stdout:0/760: write d16/d55/fa7 [2288497,82171] 0 2024-04-18T04:58:10.293 INFO:tasks.workunit.client.0.smithi096.stdout:4/791: rename d4/d14/d2d/d44/da2/fba to d4/d14/d1d/da5/d67/def/ff4 0 2024-04-18T04:58:10.294 INFO:tasks.workunit.client.0.smithi096.stdout:4/792: dread - d4/d14/d2d/d44/d90/fda zero size 2024-04-18T04:58:10.295 INFO:tasks.workunit.client.0.smithi096.stdout:0/761: symlink d16/d1c/d4c/d4d/d5d/de8/lea 0 2024-04-18T04:58:10.297 INFO:tasks.workunit.client.0.smithi096.stdout:0/762: symlink d16/d1c/d4c/d4d/d5d/d91/leb 0 2024-04-18T04:58:10.301 INFO:tasks.workunit.client.0.smithi096.stdout:4/793: dwrite d4/d14/d2d/d44/d90/fb3 [0,4194304] 0 2024-04-18T04:58:10.305 INFO:tasks.workunit.client.0.smithi096.stdout:4/794: creat d4/d14/d2d/da6/ff5 x:0 0 0 2024-04-18T04:58:10.305 INFO:tasks.workunit.client.0.smithi096.stdout:0/763: dwrite d16/d1c/f9c [0,4194304] 0 2024-04-18T04:58:10.306 INFO:tasks.workunit.client.0.smithi096.stdout:8/719: truncate d0/f4d 2473234 0 2024-04-18T04:58:10.306 INFO:tasks.workunit.client.0.smithi096.stdout:0/764: chown d16/f2b 1441268 1 2024-04-18T04:58:10.309 INFO:tasks.workunit.client.0.smithi096.stdout:4/795: creat d4/d14/d2d/d44/da2/ff6 x:0 0 0 2024-04-18T04:58:10.311 INFO:tasks.workunit.client.0.smithi096.stdout:4/796: chown d4/d14/d2d/d44/d58/d86/d6f/dc5/cd3 14583 1 2024-04-18T04:58:10.311 INFO:tasks.workunit.client.0.smithi096.stdout:8/720: mknod d0/d7/d24/d78/ce9 0 2024-04-18T04:58:10.317 INFO:tasks.workunit.client.0.smithi096.stdout:0/765: mknod d16/d1c/d4c/d4d/cec 0 2024-04-18T04:58:10.319 INFO:tasks.workunit.client.0.smithi096.stdout:4/797: write d4/d14/d2d/d44/d90/fdd [574870,39616] 0 2024-04-18T04:58:10.321 INFO:tasks.workunit.client.0.smithi096.stdout:4/798: mkdir d4/d14/d1d/da5/d67/df7 0 2024-04-18T04:58:10.322 INFO:tasks.workunit.client.0.smithi096.stdout:4/799: write d4/f62 [4315488,64930] 0 2024-04-18T04:58:10.322 INFO:tasks.workunit.client.0.smithi096.stdout:4/800: stat d4/d14/d2d/da6/dc6/dce 0 2024-04-18T04:58:10.324 INFO:tasks.workunit.client.0.smithi096.stdout:4/801: symlink d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/lf8 0 2024-04-18T04:58:10.326 INFO:tasks.workunit.client.0.smithi096.stdout:4/802: rmdir d4/d14/d2d/d44/da2/db2 39 2024-04-18T04:58:10.327 INFO:tasks.workunit.client.0.smithi096.stdout:4/803: mknod d4/d14/d2d/d44/d58/d86/d97/cf9 0 2024-04-18T04:58:10.338 INFO:tasks.workunit.client.0.smithi096.stdout:4/804: dread d4/d14/d2d/d44/f5d [0,4194304] 0 2024-04-18T04:58:10.339 INFO:tasks.workunit.client.0.smithi096.stdout:4/805: fdatasync d4/d7a/fee 0 2024-04-18T04:58:10.339 INFO:tasks.workunit.client.0.smithi096.stdout:4/806: dread - d4/d14/d2d/d44/d58/d86/fe1 zero size 2024-04-18T04:58:10.340 INFO:tasks.workunit.client.0.smithi096.stdout:4/807: write d4/d14/d2d/d44/d58/fe8 [157039,24456] 0 2024-04-18T04:58:10.346 INFO:tasks.workunit.client.0.smithi096.stdout:4/808: dwrite d4/f62 [4194304,4194304] 0 2024-04-18T04:58:10.353 INFO:tasks.workunit.client.0.smithi096.stdout:4/809: dwrite d4/d14/f9b [4194304,4194304] 0 2024-04-18T04:58:10.357 INFO:tasks.workunit.client.0.smithi096.stdout:4/810: rmdir d4/d14/d2d/d44/d58/d86/d3a/d47 39 2024-04-18T04:58:10.359 INFO:tasks.workunit.client.0.smithi096.stdout:4/811: chown d4/d14/d2d/d44/da2/db2 1192155 1 2024-04-18T04:58:10.368 INFO:tasks.workunit.client.0.smithi096.stdout:4/812: dwrite d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/f96 [0,4194304] 0 2024-04-18T04:58:10.374 INFO:tasks.workunit.client.0.smithi096.stdout:4/813: write d4/f43 [1624119,57082] 0 2024-04-18T04:58:10.375 INFO:tasks.workunit.client.0.smithi096.stdout:4/814: mknod d4/d14/d2d/d44/d90/dd0/cfa 0 2024-04-18T04:58:10.376 INFO:tasks.workunit.client.0.smithi096.stdout:4/815: dread - d4/d14/d2d/d44/d90/fda zero size 2024-04-18T04:58:10.422 INFO:tasks.workunit.client.0.smithi096.stdout:5/797: sync 2024-04-18T04:58:10.430 INFO:tasks.workunit.client.0.smithi096.stdout:5/798: mkdir d7/d25/d30/d9e/dc3/d120 0 2024-04-18T04:58:10.440 INFO:tasks.workunit.client.0.smithi096.stdout:5/799: link d7/dd/d8f/f15 d7/dd/d8f/da2/de2/f121 0 2024-04-18T04:58:10.464 INFO:tasks.workunit.client.0.smithi096.stdout:5/800: dwrite d7/d25/d30/f6c [0,4194304] 0 2024-04-18T04:58:10.466 INFO:tasks.workunit.client.0.smithi096.stdout:5/801: dread - d7/d25/d7c/fdb zero size 2024-04-18T04:58:10.468 INFO:tasks.workunit.client.0.smithi096.stdout:5/802: write d7/dd/d8f/da2/de2/de3/d56/fd2 [9658,85554] 0 2024-04-18T04:58:10.470 INFO:tasks.workunit.client.0.smithi096.stdout:5/803: chown d7/d3b/d95/fb2 15 1 2024-04-18T04:58:10.472 INFO:tasks.workunit.client.0.smithi096.stdout:5/804: write d7/d25/d30/d9e/dc3/ffa [913394,92390] 0 2024-04-18T04:58:10.493 INFO:tasks.workunit.client.0.smithi096.stdout:1/916: sync 2024-04-18T04:58:10.496 INFO:tasks.workunit.client.0.smithi096.stdout:5/805: creat d7/dd/d8f/da2/de2/de3/d52/f122 x:0 0 0 2024-04-18T04:58:10.496 INFO:tasks.workunit.client.0.smithi096.stdout:5/806: readlink d7/dd/d35/le5 0 2024-04-18T04:58:10.497 INFO:tasks.workunit.client.0.smithi096.stdout:1/917: write de/d109/f10f [884203,78818] 0 2024-04-18T04:58:10.499 INFO:tasks.workunit.client.0.smithi096.stdout:5/807: fsync d7/d3b/f7f 0 2024-04-18T04:58:10.505 INFO:tasks.workunit.client.0.smithi096.stdout:1/918: rename de/d1d/d3f/d9b/fb2 to de/d1d/d32/d6f/f12a 0 2024-04-18T04:58:10.506 INFO:tasks.workunit.client.0.smithi096.stdout:1/919: fsync de/d1d/d32/fb5 0 2024-04-18T04:58:10.511 INFO:tasks.workunit.client.0.smithi096.stdout:5/808: rename d7/f22 to d7/dd/d8f/da2/de2/de3/d56/ddd/f123 0 2024-04-18T04:58:10.516 INFO:tasks.workunit.client.0.smithi096.stdout:1/920: link c8 de/d1d/d32/d73/d8b/de9/c12b 0 2024-04-18T04:58:10.528 INFO:tasks.workunit.client.0.smithi096.stdout:7/813: sync 2024-04-18T04:58:10.531 INFO:tasks.workunit.client.0.smithi096.stdout:7/814: creat db/d1f/d39/d6d/d79/d83/daa/df1/ffc x:0 0 0 2024-04-18T04:58:10.532 INFO:tasks.workunit.client.0.smithi096.stdout:7/815: fsync db/d20/fba 0 2024-04-18T04:58:10.544 INFO:tasks.workunit.client.0.smithi096.stdout:7/816: dwrite db/d1f/d24/d49/d54/dc3/fce [0,4194304] 0 2024-04-18T04:58:10.548 INFO:tasks.workunit.client.0.smithi096.stdout:7/817: dread - db/d20/d2f/d8d/da1/fc2 zero size 2024-04-18T04:58:10.548 INFO:tasks.workunit.client.0.smithi096.stdout:5/809: unlink d7/dd/d8f/da2/de2/de3/d78/dc1/l108 0 2024-04-18T04:58:10.551 INFO:tasks.workunit.client.0.smithi096.stdout:1/921: dwrite de/d1d/d32/f8e [0,4194304] 0 2024-04-18T04:58:10.554 INFO:tasks.workunit.client.0.smithi096.stdout:7/818: mknod db/d1f/d24/d49/d54/dc3/cfd 0 2024-04-18T04:58:10.559 INFO:tasks.workunit.client.0.smithi096.stdout:5/810: mknod d7/d3b/da9/c124 0 2024-04-18T04:58:10.563 INFO:tasks.workunit.client.0.smithi096.stdout:5/811: truncate d7/dd/d8f/da2/de2/de3/dfd/f104 4965020 0 2024-04-18T04:58:10.568 INFO:tasks.workunit.client.0.smithi096.stdout:7/819: write db/d1f/d24/f56 [503558,103816] 0 2024-04-18T04:58:10.568 INFO:tasks.workunit.client.0.smithi096.stdout:1/922: dwrite de/d1d/f3e [0,4194304] 0 2024-04-18T04:58:10.579 INFO:tasks.workunit.client.0.smithi096.stdout:5/812: dwrite d7/dd/d35/db1/fd3 [0,4194304] 0 2024-04-18T04:58:10.583 INFO:tasks.workunit.client.0.smithi096.stdout:9/922: sync 2024-04-18T04:58:10.584 INFO:tasks.workunit.client.0.smithi096.stdout:8/721: sync 2024-04-18T04:58:10.584 INFO:tasks.workunit.client.0.smithi096.stdout:4/816: sync 2024-04-18T04:58:10.584 INFO:tasks.workunit.client.0.smithi096.stdout:0/766: sync 2024-04-18T04:58:10.584 INFO:tasks.workunit.client.0.smithi096.stdout:1/923: dwrite de/d1d/d32/d9a/fea [4194304,4194304] 0 2024-04-18T04:58:10.584 INFO:tasks.workunit.client.0.smithi096.stdout:7/820: dread db/d1f/d24/d49/d54/dc3/fe6 [0,4194304] 0 2024-04-18T04:58:10.586 INFO:tasks.workunit.client.0.smithi096.stdout:9/923: chown d0/de/d17/fbc 60873305 1 2024-04-18T04:58:10.587 INFO:tasks.workunit.client.0.smithi096.stdout:1/924: write de/d1d/d32/d9a/fea [6623660,7697] 0 2024-04-18T04:58:10.588 INFO:tasks.workunit.client.0.smithi096.stdout:4/817: chown d4/d14/d2d/d44/d58/d86/d97/fb4 2 1 2024-04-18T04:58:10.592 INFO:tasks.workunit.client.0.smithi096.stdout:7/821: dwrite db/f31 [0,4194304] 0 2024-04-18T04:58:10.598 INFO:tasks.workunit.client.0.smithi096.stdout:5/813: getdents d7/da3/d11f/dd5/d107 0 2024-04-18T04:58:10.601 INFO:tasks.workunit.client.0.smithi096.stdout:1/925: mknod de/d1d/d3f/d4f/da9/c12c 0 2024-04-18T04:58:10.603 INFO:tasks.workunit.client.0.smithi096.stdout:4/818: dread d4/d14/d2d/d44/d58/f65 [0,4194304] 0 2024-04-18T04:58:10.608 INFO:tasks.workunit.client.0.smithi096.stdout:1/926: mkdir de/d1d/d81/dda/d12d 0 2024-04-18T04:58:10.609 INFO:tasks.workunit.client.0.smithi096.stdout:7/822: fsync db/d1f/d24/d49/f71 0 2024-04-18T04:58:10.611 INFO:tasks.workunit.client.0.smithi096.stdout:1/927: readlink de/d1d/d32/d9a/d11a/le0 0 2024-04-18T04:58:10.611 INFO:tasks.workunit.client.0.smithi096.stdout:9/924: creat d0/de/d17/d56/d59/f122 x:0 0 0 2024-04-18T04:58:10.612 INFO:tasks.workunit.client.0.smithi096.stdout:5/814: rename d7/f3c to d7/dd/d8f/f125 0 2024-04-18T04:58:10.613 INFO:tasks.workunit.client.0.smithi096.stdout:0/767: dwrite d16/f19 [0,4194304] 0 2024-04-18T04:58:10.613 INFO:tasks.workunit.client.0.smithi096.stdout:7/823: chown db/d20/d45/dcf/dd6/ffb 285 1 2024-04-18T04:58:10.615 INFO:tasks.workunit.client.0.smithi096.stdout:4/819: symlink d4/d14/lfb 0 2024-04-18T04:58:10.615 INFO:tasks.workunit.client.0.smithi096.stdout:8/722: link d0/d7/d24/d35/d51/lc7 d0/d3/dd8/lea 0 2024-04-18T04:58:10.618 INFO:tasks.workunit.client.0.smithi096.stdout:4/820: write d4/d7a/fee [362174,18539] 0 2024-04-18T04:58:10.620 INFO:tasks.workunit.client.0.smithi096.stdout:0/768: rmdir d16/d1d/d3b/dc3 39 2024-04-18T04:58:10.621 INFO:tasks.workunit.client.0.smithi096.stdout:7/824: creat db/d20/d45/dcf/dd6/dde/ffe x:0 0 0 2024-04-18T04:58:10.624 INFO:tasks.workunit.client.0.smithi096.stdout:0/769: read d16/f60 [344513,121828] 0 2024-04-18T04:58:10.624 INFO:tasks.workunit.client.0.smithi096.stdout:4/821: dread - d4/d14/d2d/d44/d58/d86/d6f/db8/fc4 zero size 2024-04-18T04:58:10.625 INFO:tasks.workunit.client.0.smithi096.stdout:1/928: dwrite de/f29 [0,4194304] 0 2024-04-18T04:58:10.628 INFO:tasks.workunit.client.0.smithi096.stdout:8/723: dwrite d0/d3/d32/f72 [0,4194304] 0 2024-04-18T04:58:10.629 INFO:tasks.workunit.client.0.smithi096.stdout:7/825: creat db/d1f/d24/d49/d54/dc3/fff x:0 0 0 2024-04-18T04:58:10.629 INFO:tasks.workunit.client.0.smithi096.stdout:1/929: read de/d1d/d32/f46 [579834,93118] 0 2024-04-18T04:58:10.632 INFO:tasks.workunit.client.0.smithi096.stdout:7/826: fsync db/d1f/d24/d61/fb7 0 2024-04-18T04:58:10.632 INFO:tasks.workunit.client.0.smithi096.stdout:8/724: dread - d0/d15/d65/fbf zero size 2024-04-18T04:58:10.634 INFO:tasks.workunit.client.0.smithi096.stdout:9/925: dwrite d0/d6b/d89/d112/d116/d3a/f8f [0,4194304] 0 2024-04-18T04:58:10.635 INFO:tasks.workunit.client.0.smithi096.stdout:1/930: creat de/d1d/d32/d6f/d85/f12e x:0 0 0 2024-04-18T04:58:10.641 INFO:tasks.workunit.client.0.smithi096.stdout:9/926: write d0/de/d17/d56/d59/fe6 [2587541,92182] 0 2024-04-18T04:58:10.642 INFO:tasks.workunit.client.0.smithi096.stdout:4/822: dwrite d4/d14/f31 [0,4194304] 0 2024-04-18T04:58:10.645 INFO:tasks.workunit.client.0.smithi096.stdout:8/725: fsync d0/d3/d32/d6b/d7b/dc9/fdf 0 2024-04-18T04:58:10.646 INFO:tasks.workunit.client.0.smithi096.stdout:7/827: rename db/d20/d45/dcf/lf4 to db/d1f/d4e/df0/l100 0 2024-04-18T04:58:10.648 INFO:tasks.workunit.client.0.smithi096.stdout:0/770: dwrite d16/d1c/d4c/d4d/d5d/dc6/f86 [0,4194304] 0 2024-04-18T04:58:10.648 INFO:tasks.workunit.client.0.smithi096.stdout:9/927: mknod d0/de/d17/d5c/c123 0 2024-04-18T04:58:10.649 INFO:tasks.workunit.client.0.smithi096.stdout:5/815: dread d7/d25/d30/f5c [0,4194304] 0 2024-04-18T04:58:10.649 INFO:tasks.workunit.client.0.smithi096.stdout:7/828: chown db/d1d/f21 1543 1 2024-04-18T04:58:10.650 INFO:tasks.workunit.client.0.smithi096.stdout:9/928: fdatasync d0/d41/fb1 0 2024-04-18T04:58:10.652 INFO:tasks.workunit.client.0.smithi096.stdout:8/726: creat d0/d3/d32/feb x:0 0 0 2024-04-18T04:58:10.652 INFO:tasks.workunit.client.0.smithi096.stdout:1/931: dwrite de/d109/d96/fa6 [0,4194304] 0 2024-04-18T04:58:10.660 INFO:tasks.workunit.client.0.smithi096.stdout:9/929: write d0/de/d17/d56/d59/d68/f72 [5031243,69875] 0 2024-04-18T04:58:10.660 INFO:tasks.workunit.client.0.smithi096.stdout:1/932: creat de/d1d/d32/d6b/f12f x:0 0 0 2024-04-18T04:58:10.663 INFO:tasks.workunit.client.0.smithi096.stdout:9/930: creat d0/de/d17/d56/d59/d60/f124 x:0 0 0 2024-04-18T04:58:10.666 INFO:tasks.workunit.client.0.smithi096.stdout:0/771: dwrite d16/d1c/d4c/d4d/d5a/fc5 [0,4194304] 0 2024-04-18T04:58:10.666 INFO:tasks.workunit.client.0.smithi096.stdout:7/829: dwrite db/d1d/d82/f8c [0,4194304] 0 2024-04-18T04:58:10.667 INFO:tasks.workunit.client.0.smithi096.stdout:7/830: chown db/f12 2533 1 2024-04-18T04:58:10.671 INFO:tasks.workunit.client.0.smithi096.stdout:5/816: write d7/dd/d8f/f125 [1181098,65207] 0 2024-04-18T04:58:10.674 INFO:tasks.workunit.client.0.smithi096.stdout:7/831: rename db/d1f/c52 to db/d1f/d24/d61/de1/c101 0 2024-04-18T04:58:10.677 INFO:tasks.workunit.client.0.smithi096.stdout:0/772: dwrite d16/d1c/d4c/fa1 [0,4194304] 0 2024-04-18T04:58:10.677 INFO:tasks.workunit.client.0.smithi096.stdout:4/823: dread d4/d14/d16/f32 [0,4194304] 0 2024-04-18T04:58:10.678 INFO:tasks.workunit.client.0.smithi096.stdout:5/817: dread d7/d3b/f94 [0,4194304] 0 2024-04-18T04:58:10.678 INFO:tasks.workunit.client.0.smithi096.stdout:0/773: write d16/d1c/f8c [696576,3637] 0 2024-04-18T04:58:10.680 INFO:tasks.workunit.client.0.smithi096.stdout:0/774: write d16/d1d/f34 [2746980,125520] 0 2024-04-18T04:58:10.686 INFO:tasks.workunit.client.0.smithi096.stdout:0/775: rename d16/d1d/f34 to d16/d1c/d4c/d6a/da3/fed 0 2024-04-18T04:58:10.688 INFO:tasks.workunit.client.0.smithi096.stdout:4/824: dwrite d4/d14/d1d/da5/fd7 [0,4194304] 0 2024-04-18T04:58:10.689 INFO:tasks.workunit.client.0.smithi096.stdout:4/825: chown d4/d14/lfb 156631 1 2024-04-18T04:58:10.691 INFO:tasks.workunit.client.0.smithi096.stdout:4/826: readlink d4/d14/d2d/da6/dc6/leb 0 2024-04-18T04:58:10.694 INFO:tasks.workunit.client.0.smithi096.stdout:4/827: write d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/fac [2576149,64048] 0 2024-04-18T04:58:10.696 INFO:tasks.workunit.client.0.smithi096.stdout:4/828: mknod d4/d14/d1d/cfc 0 2024-04-18T04:58:10.697 INFO:tasks.workunit.client.0.smithi096.stdout:0/776: dread d16/d1c/d22/d2c/f68 [0,4194304] 0 2024-04-18T04:58:10.698 INFO:tasks.workunit.client.0.smithi096.stdout:5/818: dread d7/dd/d8f/da2/de2/de3/f20 [4194304,4194304] 0 2024-04-18T04:58:10.698 INFO:tasks.workunit.client.0.smithi096.stdout:0/777: dread - d16/d1c/d4c/d4e/fd9 zero size 2024-04-18T04:58:10.702 INFO:tasks.workunit.client.0.smithi096.stdout:5/819: symlink d7/dd/d8f/da2/l126 0 2024-04-18T04:58:10.705 INFO:tasks.workunit.client.0.smithi096.stdout:5/820: write d7/da3/d11f/dd5/fed [1216133,4219] 0 2024-04-18T04:58:10.706 INFO:tasks.workunit.client.0.smithi096.stdout:0/778: link d16/d1c/d4c/d4d/d36/cb9 d16/cee 0 2024-04-18T04:58:10.706 INFO:tasks.workunit.client.0.smithi096.stdout:4/829: write d4/d7a/fea [75079,35577] 0 2024-04-18T04:58:10.707 INFO:tasks.workunit.client.0.smithi096.stdout:5/821: readlink d7/dd/d8f/da2/de2/de3/ld0 0 2024-04-18T04:58:10.709 INFO:tasks.workunit.client.0.smithi096.stdout:4/830: mkdir d4/d14/d2d/da6/dc6/dfd 0 2024-04-18T04:58:10.710 INFO:tasks.workunit.client.0.smithi096.stdout:5/822: mknod d7/dd/d8f/da2/de2/de3/d56/ddd/d10a/c127 0 2024-04-18T04:58:10.710 INFO:tasks.workunit.client.0.smithi096.stdout:0/779: getdents d16/d1c/d4c/d4d/d5d/de8 0 2024-04-18T04:58:10.711 INFO:tasks.workunit.client.0.smithi096.stdout:5/823: fdatasync d7/d25/f28 0 2024-04-18T04:58:10.711 INFO:tasks.workunit.client.0.smithi096.stdout:4/831: mkdir d4/d14/d2d/da6/dc6/dce/dfe 0 2024-04-18T04:58:10.713 INFO:tasks.workunit.client.0.smithi096.stdout:0/780: chown d16/d1c/d4c/d4e/d67/c9e 3 1 2024-04-18T04:58:10.718 INFO:tasks.workunit.client.0.smithi096.stdout:5/824: write d7/d25/d58/f62 [594110,107699] 0 2024-04-18T04:58:10.719 INFO:tasks.workunit.client.0.smithi096.stdout:0/781: dwrite d16/d1c/f8c [0,4194304] 0 2024-04-18T04:58:10.722 INFO:tasks.workunit.client.0.smithi096.stdout:5/825: creat d7/dd/d8f/da2/de2/de3/dfd/f128 x:0 0 0 2024-04-18T04:58:10.722 INFO:tasks.workunit.client.0.smithi096.stdout:0/782: rmdir d16/d1c/d4c/d4d/d5d 39 2024-04-18T04:58:10.724 INFO:tasks.workunit.client.0.smithi096.stdout:0/783: mknod d16/d1c/d22/db8/cef 0 2024-04-18T04:58:10.724 INFO:tasks.workunit.client.0.smithi096.stdout:5/826: symlink d7/dd/d35/da0/l129 0 2024-04-18T04:58:10.725 INFO:tasks.workunit.client.0.smithi096.stdout:0/784: creat d16/d78/ff0 x:0 0 0 2024-04-18T04:58:10.728 INFO:tasks.workunit.client.0.smithi096.stdout:5/827: truncate d7/dd/d8f/da2/de2/de3/f96 2424819 0 2024-04-18T04:58:10.728 INFO:tasks.workunit.client.0.smithi096.stdout:5/828: stat d7/da3/d9a/fa8 0 2024-04-18T04:58:10.729 INFO:tasks.workunit.client.0.smithi096.stdout:0/785: creat d16/d1c/d4c/d4e/ff1 x:0 0 0 2024-04-18T04:58:10.730 INFO:tasks.workunit.client.0.smithi096.stdout:5/829: mknod d7/d25/d7c/c12a 0 2024-04-18T04:58:10.732 INFO:tasks.workunit.client.0.smithi096.stdout:0/786: unlink d16/d1c/d4c/d4d/d5d/dc6/faa 0 2024-04-18T04:58:10.734 INFO:tasks.workunit.client.0.smithi096.stdout:0/787: symlink d16/d1d/lf2 0 2024-04-18T04:58:10.735 INFO:tasks.workunit.client.0.smithi096.stdout:5/830: dread d7/d25/d30/fd4 [0,4194304] 0 2024-04-18T04:58:10.740 INFO:tasks.workunit.client.0.smithi096.stdout:5/831: dread d7/da3/d11f/f4f [0,4194304] 0 2024-04-18T04:58:10.740 INFO:tasks.workunit.client.0.smithi096.stdout:0/788: dwrite d16/d1c/d4c/d4e/fdf [0,4194304] 0 2024-04-18T04:58:10.741 INFO:tasks.workunit.client.0.smithi096.stdout:5/832: chown d7/d25/d30/f6c 15567 1 2024-04-18T04:58:10.746 INFO:tasks.workunit.client.0.smithi096.stdout:0/789: mknod d16/d1c/cf3 0 2024-04-18T04:58:10.746 INFO:tasks.workunit.client.0.smithi096.stdout:5/833: write d7/d25/d30/f5c [4078494,21159] 0 2024-04-18T04:58:10.746 INFO:tasks.workunit.client.0.smithi096.stdout:0/790: unlink d16/d1c/d4c/fdd 0 2024-04-18T04:58:10.749 INFO:tasks.workunit.client.0.smithi096.stdout:0/791: creat d16/d1c/d4c/d6a/ff4 x:0 0 0 2024-04-18T04:58:10.754 INFO:tasks.workunit.client.0.smithi096.stdout:0/792: truncate d16/d1c/d22/d2c/f68 3957724 0 2024-04-18T04:58:10.754 INFO:tasks.workunit.client.0.smithi096.stdout:0/793: readlink d16/d1c/d4c/d4d/d5d/dc6/l75 0 2024-04-18T04:58:10.769 INFO:tasks.workunit.client.0.smithi096.stdout:5/834: dwrite d7/dd/d8f/da2/de2/de3/d56/ddd/f123 [0,4194304] 0 2024-04-18T04:58:10.769 INFO:tasks.workunit.client.0.smithi096.stdout:5/835: chown l5 6165 1 2024-04-18T04:58:10.770 INFO:tasks.workunit.client.0.smithi096.stdout:5/836: dread - d7/fd1 zero size 2024-04-18T04:58:10.774 INFO:tasks.workunit.client.0.smithi096.stdout:5/837: rename d7/dd/d8f/da2/de2/de3/d78/dc1 to d7/da3/d11f/d12b 0 2024-04-18T04:58:10.775 INFO:tasks.workunit.client.0.smithi096.stdout:0/794: dread d16/d1c/d4c/d4d/d5d/fc7 [0,4194304] 0 2024-04-18T04:58:10.777 INFO:tasks.workunit.client.0.smithi096.stdout:5/838: mknod d7/dd/d8f/da2/c12c 0 2024-04-18T04:58:10.777 INFO:tasks.workunit.client.0.smithi096.stdout:0/795: read d16/d1c/d22/d2c/f90 [2384640,7800] 0 2024-04-18T04:58:10.778 INFO:tasks.workunit.client.0.smithi096.stdout:5/839: write d7/dd/d8f/da2/de2/de3/d56/f6a [1558939,18087] 0 2024-04-18T04:58:10.779 INFO:tasks.workunit.client.0.smithi096.stdout:0/796: readlink d16/d1c/d4c/d4d/d5d/dc6/lc2 0 2024-04-18T04:58:10.782 INFO:tasks.workunit.client.0.smithi096.stdout:5/840: dread d7/d25/d30/fa7 [0,4194304] 0 2024-04-18T04:58:10.783 INFO:tasks.workunit.client.0.smithi096.stdout:5/841: read d7/dd/d35/f51 [383246,118044] 0 2024-04-18T04:58:10.784 INFO:tasks.workunit.client.0.smithi096.stdout:5/842: chown d7/d3b/c118 2140 1 2024-04-18T04:58:10.786 INFO:tasks.workunit.client.0.smithi096.stdout:0/797: dwrite d16/d1c/d22/d2c/fe4 [0,4194304] 0 2024-04-18T04:58:10.788 INFO:tasks.workunit.client.0.smithi096.stdout:0/798: symlink d16/d1c/d4c/d6a/lf5 0 2024-04-18T04:58:10.790 INFO:tasks.workunit.client.0.smithi096.stdout:5/843: write d7/d25/f27 [691145,129065] 0 2024-04-18T04:58:10.791 INFO:tasks.workunit.client.0.smithi096.stdout:5/844: write d7/d25/d7c/fdb [398956,64761] 0 2024-04-18T04:58:10.802 INFO:tasks.workunit.client.0.smithi096.stdout:5/845: dread d7/d25/d30/f4b [0,4194304] 0 2024-04-18T04:58:10.803 INFO:tasks.workunit.client.0.smithi096.stdout:5/846: write d7/dd/d8f/da2/de2/de3/d56/fd2 [1599264,78745] 0 2024-04-18T04:58:10.804 INFO:tasks.workunit.client.0.smithi096.stdout:5/847: write d7/d25/d58/f102 [1022668,100139] 0 2024-04-18T04:58:10.810 INFO:tasks.workunit.client.0.smithi096.stdout:5/848: dwrite d7/ff0 [0,4194304] 0 2024-04-18T04:58:10.816 INFO:tasks.workunit.client.0.smithi096.stdout:5/849: creat d7/d25/d2b/deb/f12d x:0 0 0 2024-04-18T04:58:10.817 INFO:tasks.workunit.client.0.smithi096.stdout:5/850: chown d7/da3/d9a/fa8 23 1 2024-04-18T04:58:10.863 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-18T04:58:10.864 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:58:10.942 INFO:tasks.workunit.client.0.smithi096.stdout:8/727: sync 2024-04-18T04:58:10.945 INFO:tasks.workunit.client.0.smithi096.stdout:8/728: mkdir d0/d7/d86/d91/d93/dec 0 2024-04-18T04:58:10.950 INFO:tasks.workunit.client.0.smithi096.stdout:8/729: symlink d0/d7/d86/led 0 2024-04-18T04:58:10.951 INFO:tasks.workunit.client.0.smithi096.stdout:8/730: stat d0/d7/d24/f82 0 2024-04-18T04:58:10.954 INFO:tasks.workunit.client.0.smithi096.stdout:8/731: rmdir d0/d4f 39 2024-04-18T04:58:10.966 INFO:tasks.workunit.client.0.smithi096.stdout:8/732: dwrite d0/d7/d24/d18/d27/d3c/f9b [0,4194304] 0 2024-04-18T04:58:10.972 INFO:tasks.workunit.client.0.smithi096.stdout:8/733: rename d0/d7/d24/d18/d27 to d0/d3/d32/dee 0 2024-04-18T04:58:10.973 INFO:tasks.workunit.client.0.smithi096.stdout:8/734: stat d0/d7/d24/d35/d51 0 2024-04-18T04:58:10.974 INFO:tasks.workunit.client.0.smithi096.stdout:8/735: stat d0/d7/d24/d18/dd9 0 2024-04-18T04:58:10.977 INFO:tasks.workunit.client.0.smithi096.stdout:8/736: creat d0/d3/d32/d6b/d7b/dc9/fef x:0 0 0 2024-04-18T04:58:10.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.977+0000 7f2c3dfd4640 1 Processor -- start 2024-04-18T04:58:10.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.977+0000 7f2c3dfd4640 1 -- start start 2024-04-18T04:58:10.979 INFO:tasks.workunit.client.0.smithi096.stdout:8/737: truncate d0/d7/d24/d18/d5d/f98 610284 0 2024-04-18T04:58:10.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.977+0000 7f2c3dfd4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c3814fee0 0x7f2c3806b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:10.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.977+0000 7f2c3dfd4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2c380c1a90 0x7f2c380c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:10.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.977+0000 7f2c3dfd4640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2c380bfeb0 0x7f2c380b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:10.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.977+0000 7f2c3dfd4640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c38065bc0 con 0x7f2c380c1a90 2024-04-18T04:58:10.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.977+0000 7f2c3dfd4640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c38065e60 con 0x7f2c380bfeb0 2024-04-18T04:58:10.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.977+0000 7f2c3dfd4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c381502c0 con 0x7f2c3814fee0 2024-04-18T04:58:10.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.977+0000 7f2c36ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2c380c1a90 0x7f2c380c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:10.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.977+0000 7f2c36ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2c380c1a90 0x7f2c380c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47414/0 (socket says 172.21.15.96:47414) 2024-04-18T04:58:10.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.977+0000 7f2c36ffd640 1 -- 172.21.15.96:0/527926949 learned_addr learned my addr 172.21.15.96:0/527926949 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:10.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.977+0000 7f2c377fe640 1 --2- 172.21.15.96:0/527926949 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c3814fee0 0x7f2c3806b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:10.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.977+0000 7f2c37fff640 1 --2- 172.21.15.96:0/527926949 >> v2:172.21.15.139:3300/0 conn(0x7f2c380bfeb0 0x7f2c380b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:10.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c36ffd640 1 -- 172.21.15.96:0/527926949 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c3814fee0 msgr2=0x7f2c3806b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:10.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c36ffd640 1 --2- 172.21.15.96:0/527926949 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c3814fee0 0x7f2c3806b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:10.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c36ffd640 1 -- 172.21.15.96:0/527926949 >> v2:172.21.15.139:3300/0 conn(0x7f2c380bfeb0 msgr2=0x7f2c380b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:10.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c36ffd640 1 --2- 172.21.15.96:0/527926949 >> v2:172.21.15.139:3300/0 conn(0x7f2c380bfeb0 0x7f2c380b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:10.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c36ffd640 1 -- 172.21.15.96:0/527926949 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c38066120 con 0x7f2c380c1a90 2024-04-18T04:58:10.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c36ffd640 1 --2- 172.21.15.96:0/527926949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c380c1a90 0x7f2c380c5550 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2c3806bc70 tx=0x7f2c2c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b986449555eb1f35 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:10.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c367fc640 1 -- 172.21.15.96:0/527926949 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c0a89d0 con 0x7f2c380c1a90 2024-04-18T04:58:10.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c367fc640 1 -- 172.21.15.96:0/527926949 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2c0a8b30 con 0x7f2c380c1a90 2024-04-18T04:58:10.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c367fc640 1 -- 172.21.15.96:0/527926949 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c0b0440 con 0x7f2c380c1a90 2024-04-18T04:58:10.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c3dfd4640 1 -- 172.21.15.96:0/527926949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c380c1a90 msgr2=0x7f2c380c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:10.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c3dfd4640 1 --2- 172.21.15.96:0/527926949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c380c1a90 0x7f2c380c5550 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2c3806bc70 tx=0x7f2c2c01ed10 comp rx=0 tx=0).stop 2024-04-18T04:58:10.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c3dfd4640 1 -- 172.21.15.96:0/527926949 shutdown_connections 2024-04-18T04:58:10.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c3dfd4640 1 --2- 172.21.15.96:0/527926949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c380c1a90 0x7f2c380c5550 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:10.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c3dfd4640 1 --2- 172.21.15.96:0/527926949 >> v2:172.21.15.139:3300/0 conn(0x7f2c380bfeb0 0x7f2c380b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:10.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c3dfd4640 1 --2- 172.21.15.96:0/527926949 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c3814fee0 0x7f2c3806b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:10.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c3dfd4640 1 -- 172.21.15.96:0/527926949 >> 172.21.15.96:0/527926949 conn(0x7f2c380cab90 msgr2=0x7f2c380cafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:10.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c3dfd4640 1 -- 172.21.15.96:0/527926949 shutdown_connections 2024-04-18T04:58:10.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.981+0000 7f2c3dfd4640 1 -- 172.21.15.96:0/527926949 wait complete. 2024-04-18T04:58:10.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c3dfd4640 1 Processor -- start 2024-04-18T04:58:10.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c3dfd4640 1 -- start start 2024-04-18T04:58:10.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c3dfd4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c380bfeb0 0x7f2c38071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:10.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c3dfd4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c380c1a90 0x7f2c38149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:10.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c3dfd4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c3814fee0 0x7f2c38149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:10.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c3dfd4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c38154ca0 con 0x7f2c3814fee0 2024-04-18T04:58:10.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c3dfd4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c38155190 con 0x7f2c380c1a90 2024-04-18T04:58:10.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c3dfd4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c381560a0 con 0x7f2c380bfeb0 2024-04-18T04:58:10.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c37fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c3814fee0 0x7f2c38149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:10.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c37fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c3814fee0 0x7f2c38149ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47420/0 (socket says 172.21.15.96:47420) 2024-04-18T04:58:10.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c37fff640 1 -- 172.21.15.96:0/1800735166 learned_addr learned my addr 172.21.15.96:0/1800735166 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:10.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c377fe640 1 --2- 172.21.15.96:0/1800735166 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c380bfeb0 0x7f2c38071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:10.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c36ffd640 1 --2- 172.21.15.96:0/1800735166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c380c1a90 0x7f2c38149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:10.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c37fff640 1 -- 172.21.15.96:0/1800735166 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c380bfeb0 msgr2=0x7f2c38071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:10.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c37fff640 1 --2- 172.21.15.96:0/1800735166 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c380bfeb0 0x7f2c38071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:10.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c37fff640 1 -- 172.21.15.96:0/1800735166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c380c1a90 msgr2=0x7f2c38149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:10.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c37fff640 1 --2- 172.21.15.96:0/1800735166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c380c1a90 0x7f2c38149590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:10.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c37fff640 1 -- 172.21.15.96:0/1800735166 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c0094d0 con 0x7f2c3814fee0 2024-04-18T04:58:10.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c377fe640 1 --2- 172.21.15.96:0/1800735166 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c380bfeb0 0x7f2c38071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:58:10.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c36ffd640 1 --2- 172.21.15.96:0/1800735166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c380c1a90 0x7f2c38149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:58:10.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c37fff640 1 --2- 172.21.15.96:0/1800735166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c3814fee0 0x7f2c38149ad0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000ccf0 tx=0x7f2c3000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:10.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c1ffff640 1 -- 172.21.15.96:0/1800735166 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30003ba0 con 0x7f2c3814fee0 2024-04-18T04:58:10.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c1ffff640 1 -- 172.21.15.96:0/1800735166 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c30003d00 con 0x7f2c3814fee0 2024-04-18T04:58:10.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c3dfd4640 1 -- 172.21.15.96:0/1800735166 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c380c2770 con 0x7f2c3814fee0 2024-04-18T04:58:10.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c1ffff640 1 -- 172.21.15.96:0/1800735166 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30004240 con 0x7f2c3814fee0 2024-04-18T04:58:10.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c3dfd4640 1 -- 172.21.15.96:0/1800735166 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c38154300 con 0x7f2c3814fee0 2024-04-18T04:58:10.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c3dfd4640 1 -- 172.21.15.96:0/1800735166 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c38154de0 con 0x7f2c3814fee0 2024-04-18T04:58:10.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c1ffff640 1 -- 172.21.15.96:0/1800735166 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2c300043a0 con 0x7f2c3814fee0 2024-04-18T04:58:10.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c1ffff640 1 --2- 172.21.15.96:0/1800735166 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2c24066690 0x7f2c24068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:10.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c1ffff640 1 -- 172.21.15.96:0/1800735166 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2c30012070 con 0x7f2c3814fee0 2024-04-18T04:58:10.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c377fe640 1 --2- 172.21.15.96:0/1800735166 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2c24066690 0x7f2c24068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:10.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.985+0000 7f2c377fe640 1 --2- 172.21.15.96:0/1800735166 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2c24066690 0x7f2c24068b50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2c28006fd0 tx=0x7f2c28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:10.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:10.989+0000 7f2c1ffff640 1 -- 172.21.15.96:0/1800735166 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2c30051cf0 con 0x7f2c3814fee0 2024-04-18T04:58:10.994 INFO:tasks.workunit.client.0.smithi096.stdout:8/738: dread d0/f2 [0,4194304] 0 2024-04-18T04:58:10.996 INFO:tasks.workunit.client.0.smithi096.stdout:8/739: creat d0/d15/da9/ff0 x:0 0 0 2024-04-18T04:58:10.998 INFO:tasks.workunit.client.0.smithi096.stdout:8/740: write d0/d7/d24/d35/d51/f7f [255108,113578] 0 2024-04-18T04:58:11.005 INFO:tasks.workunit.client.0.smithi096.stdout:8/741: dwrite d0/d15/da9/fb3 [0,4194304] 0 2024-04-18T04:58:11.006 INFO:tasks.workunit.client.0.smithi096.stdout:8/742: stat d0/d3/d32/d6b/d7b/faa 0 2024-04-18T04:58:11.008 INFO:tasks.workunit.client.0.smithi096.stdout:8/743: dread d0/d7/d24/f82 [0,4194304] 0 2024-04-18T04:58:11.010 INFO:tasks.workunit.client.0.smithi096.stdout:9/931: sync 2024-04-18T04:58:11.010 INFO:tasks.workunit.client.0.smithi096.stdout:1/933: sync 2024-04-18T04:58:11.012 INFO:tasks.workunit.client.0.smithi096.stdout:8/744: fdatasync d0/d7/d24/d18/d7c/f84 0 2024-04-18T04:58:11.012 INFO:tasks.workunit.client.0.smithi096.stdout:1/934: chown de/d1d/d32/d73 7684 1 2024-04-18T04:58:11.013 INFO:tasks.workunit.client.0.smithi096.stdout:9/932: rmdir d0/de/d17/d2f 39 2024-04-18T04:58:11.018 INFO:tasks.workunit.client.0.smithi096.stdout:1/935: dwrite de/d1d/d32/f69 [0,4194304] 0 2024-04-18T04:58:11.018 INFO:tasks.workunit.client.0.smithi096.stdout:1/936: fdatasync de/d1d/d32/d9a/dad/fb4 0 2024-04-18T04:58:11.019 INFO:tasks.workunit.client.0.smithi096.stdout:1/937: chown de/d109/d96/fa6 2311 1 2024-04-18T04:58:11.020 INFO:tasks.workunit.client.0.smithi096.stdout:1/938: stat de/d109/d96/df8 0 2024-04-18T04:58:11.027 INFO:tasks.workunit.client.0.smithi096.stdout:1/939: mkdir de/d109/d130 0 2024-04-18T04:58:11.032 INFO:tasks.workunit.client.0.smithi096.stdout:8/745: dwrite d0/d3/d32/dee/d60/f70 [0,4194304] 0 2024-04-18T04:58:11.036 INFO:tasks.workunit.client.0.smithi096.stdout:8/746: mknod d0/d15/dc3/cf1 0 2024-04-18T04:58:11.037 INFO:tasks.workunit.client.0.smithi096.stdout:8/747: write d0/d7/f2b [5201507,64839] 0 2024-04-18T04:58:11.037 INFO:tasks.workunit.client.0.smithi096.stdout:1/940: creat de/d1d/d3f/d4f/f131 x:0 0 0 2024-04-18T04:58:11.042 INFO:tasks.workunit.client.0.smithi096.stdout:1/941: truncate de/d1d/d32/f57 118203 0 2024-04-18T04:58:11.043 INFO:tasks.workunit.client.0.smithi096.stdout:1/942: fsync de/d1d/d3f/d4f/f100 0 2024-04-18T04:58:11.045 INFO:tasks.workunit.client.0.smithi096.stdout:8/748: symlink d0/d4f/lf2 0 2024-04-18T04:58:11.051 INFO:tasks.workunit.client.0.smithi096.stdout:8/749: rmdir d0/d3/dd8 39 2024-04-18T04:58:11.052 INFO:tasks.workunit.client.0.smithi096.stdout:8/750: write d0/d4f/fd0 [791877,33362] 0 2024-04-18T04:58:11.053 INFO:tasks.workunit.client.0.smithi096.stdout:9/933: dwrite d0/f4b [4194304,4194304] 0 2024-04-18T04:58:11.055 INFO:tasks.workunit.client.0.smithi096.stdout:9/934: fdatasync d0/de/d17/d56/d6d/f7f 0 2024-04-18T04:58:11.061 INFO:tasks.workunit.client.0.smithi096.stdout:8/751: getdents d0/d15/d65 0 2024-04-18T04:58:11.062 INFO:tasks.workunit.client.0.smithi096.stdout:9/935: dread d0/d6b/d89/d112/d116/ffd [0,4194304] 0 2024-04-18T04:58:11.063 INFO:tasks.workunit.client.0.smithi096.stdout:1/943: write de/d1d/f66 [5003454,15719] 0 2024-04-18T04:58:11.069 INFO:tasks.workunit.client.0.smithi096.stdout:1/944: creat de/d1d/d3f/f132 x:0 0 0 2024-04-18T04:58:11.070 INFO:tasks.workunit.client.0.smithi096.stdout:9/936: mknod d0/de/d17/d2f/d40/dd2/d118/c125 0 2024-04-18T04:58:11.072 INFO:tasks.workunit.client.0.smithi096.stdout:0/799: sync 2024-04-18T04:58:11.072 INFO:tasks.workunit.client.0.smithi096.stdout:4/832: sync 2024-04-18T04:58:11.072 INFO:tasks.workunit.client.0.smithi096.stdout:5/851: sync 2024-04-18T04:58:11.072 INFO:tasks.workunit.client.0.smithi096.stdout:7/832: sync 2024-04-18T04:58:11.073 INFO:tasks.workunit.client.0.smithi096.stdout:0/800: stat d16/d1c/d22/d2c/fd2 0 2024-04-18T04:58:11.074 INFO:tasks.workunit.client.0.smithi096.stdout:9/937: mkdir d0/d6b/d89/d112/d116/d33/d126 0 2024-04-18T04:58:11.075 INFO:tasks.workunit.client.0.smithi096.stdout:8/752: truncate d0/fc0 2902728 0 2024-04-18T04:58:11.078 INFO:tasks.workunit.client.0.smithi096.stdout:7/833: symlink db/d20/d2f/d8d/l102 0 2024-04-18T04:58:11.081 INFO:tasks.workunit.client.0.smithi096.stdout:5/852: unlink d7/dd/d8f/da2/de2/de3/d56/ddd/f123 0 2024-04-18T04:58:11.083 INFO:tasks.workunit.client.0.smithi096.stdout:1/945: getdents de/d1d/d32/d9a/d11a/dc7 0 2024-04-18T04:58:11.085 INFO:tasks.workunit.client.0.smithi096.stdout:4/833: dread d4/d14/d1d/f27 [0,4194304] 0 2024-04-18T04:58:11.087 INFO:tasks.workunit.client.0.smithi096.stdout:0/801: dread d16/d1c/d22/d2c/f30 [4194304,4194304] 0 2024-04-18T04:58:11.087 INFO:tasks.workunit.client.0.smithi096.stdout:7/834: unlink db/d1f/d39/d6d/f9d 0 2024-04-18T04:58:11.090 INFO:tasks.workunit.client.0.smithi096.stdout:5/853: dwrite d7/dd/d35/fbc [0,4194304] 0 2024-04-18T04:58:11.096 INFO:tasks.workunit.client.0.smithi096.stdout:1/946: mkdir de/d1d/d3f/d4f/da9/d133 0 2024-04-18T04:58:11.098 INFO:tasks.workunit.client.0.smithi096.stdout:4/834: rmdir d4/d14/d2d/d44/dcb 39 2024-04-18T04:58:11.099 INFO:tasks.workunit.client.0.smithi096.stdout:4/835: truncate d4/d14/d2d/d44/d58/d86/d6f/db8/fc4 381491 0 2024-04-18T04:58:11.100 INFO:tasks.workunit.client.0.smithi096.stdout:0/802: symlink d16/d1c/d22/db8/lf6 0 2024-04-18T04:58:11.104 INFO:tasks.workunit.client.0.smithi096.stdout:7/835: symlink db/d1f/d39/d6d/d79/d83/daa/df1/df2/l103 0 2024-04-18T04:58:11.104 INFO:tasks.workunit.client.0.smithi096.stdout:4/836: dread d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/f96 [0,4194304] 0 2024-04-18T04:58:11.107 INFO:tasks.workunit.client.0.smithi096.stdout:1/947: symlink de/d1d/d32/d6b/l134 0 2024-04-18T04:58:11.112 INFO:tasks.workunit.client.0.smithi096.stdout:7/836: creat db/d20/d45/dcf/dd6/dde/f104 x:0 0 0 2024-04-18T04:58:11.115 INFO:tasks.workunit.client.0.smithi096.stdout:1/948: creat de/d1d/d32/d9a/dad/dd3/f135 x:0 0 0 2024-04-18T04:58:11.119 INFO:tasks.workunit.client.0.smithi096.stdout:7/837: rename db/d1d/f21 to db/d20/d45/dcf/dd6/f105 0 2024-04-18T04:58:11.120 INFO:tasks.workunit.client.0.smithi096.stdout:7/838: fdatasync db/d1f/d39/d6d/d79/d83/daa/fe2 0 2024-04-18T04:58:11.120 INFO:tasks.workunit.client.0.smithi096.stdout:9/938: truncate d0/de/d17/d2f/fcd 1743739 0 2024-04-18T04:58:11.121 INFO:tasks.workunit.client.0.smithi096.stdout:1/949: dread - de/d1d/d3f/d9b/fbd zero size 2024-04-18T04:58:11.122 INFO:tasks.workunit.client.0.smithi096.stdout:1/950: fsync de/d1d/fab 0 2024-04-18T04:58:11.122 INFO:tasks.workunit.client.0.smithi096.stdout:9/939: write d0/de/d17/d56/d6d/f7f [1452421,104666] 0 2024-04-18T04:58:11.124 INFO:tasks.workunit.client.0.smithi096.stdout:8/753: truncate d0/d3/d32/dee/d60/fac 84828 0 2024-04-18T04:58:11.126 INFO:tasks.workunit.client.0.smithi096.stdout:7/839: rename db/fd2 to db/d1d/d82/f106 0 2024-04-18T04:58:11.129 INFO:tasks.workunit.client.0.smithi096.stdout:9/940: symlink d0/de/d17/d2f/d40/da8/l127 0 2024-04-18T04:58:11.130 INFO:tasks.workunit.client.0.smithi096.stdout:1/951: creat de/d1d/d32/d9a/dad/dd3/f136 x:0 0 0 2024-04-18T04:58:11.134 INFO:tasks.workunit.client.0.smithi096.stdout:8/754: rename d0/d7/d24/d18/d7c/f7e to d0/d3/d32/dee/ff3 0 2024-04-18T04:58:11.136 INFO:tasks.workunit.client.0.smithi096.stdout:7/840: creat db/d20/d45/f107 x:0 0 0 2024-04-18T04:58:11.137 INFO:tasks.workunit.client.0.smithi096.stdout:9/941: dwrite d0/d41/fb1 [0,4194304] 0 2024-04-18T04:58:11.137 INFO:tasks.workunit.client.0.smithi096.stdout:5/854: dwrite d7/dd/f6b [0,4194304] 0 2024-04-18T04:58:11.141 INFO:tasks.workunit.client.0.smithi096.stdout:5/855: dread - d7/d25/d2b/fb4 zero size 2024-04-18T04:58:11.141 INFO:tasks.workunit.client.0.smithi096.stdout:1/952: fsync de/d1d/d32/d8c/f105 0 2024-04-18T04:58:11.151 INFO:tasks.workunit.client.0.smithi096.stdout:9/942: mknod d0/d6b/d89/d112/d116/d3a/dee/c128 0 2024-04-18T04:58:11.154 INFO:tasks.workunit.client.0.smithi096.stdout:8/755: dwrite d0/d4f/fd4 [0,4194304] 0 2024-04-18T04:58:11.155 INFO:tasks.workunit.client.0.smithi096.stdout:9/943: write d0/de/d17/d2f/d40/d8b/de1/fdc [4687541,37386] 0 2024-04-18T04:58:11.156 INFO:tasks.workunit.client.0.smithi096.stdout:5/856: dwrite d7/dd/d8f/da2/de2/de3/d56/f6a [0,4194304] 0 2024-04-18T04:58:11.159 INFO:tasks.workunit.client.0.smithi096.stdout:5/857: write d7/d3b/d95/ffb [2644225,12493] 0 2024-04-18T04:58:11.165 INFO:tasks.workunit.client.0.smithi096.stdout:5/858: unlink d7/d25/f41 0 2024-04-18T04:58:11.166 INFO:tasks.workunit.client.0.smithi096.stdout:9/944: dwrite d0/d6b/d89/d112/d116/f3c [0,4194304] 0 2024-04-18T04:58:11.167 INFO:tasks.workunit.client.0.smithi096.stdout:5/859: write d7/d25/f2f [761791,44628] 0 2024-04-18T04:58:11.167 INFO:tasks.workunit.client.0.smithi096.stdout:5/860: chown d7/d25/l2a 25837 1 2024-04-18T04:58:11.168 INFO:tasks.workunit.client.0.smithi096.stdout:8/756: rename d0/d15/d65/d8f/c9e to d0/d3/d32/dee/cf4 0 2024-04-18T04:58:11.171 INFO:tasks.workunit.client.0.smithi096.stdout:1/953: write de/d1d/d32/d9a/dad/dd3/fd9 [598911,99552] 0 2024-04-18T04:58:11.177 INFO:tasks.workunit.client.0.smithi096.stdout:8/757: fsync d0/d7/f50 0 2024-04-18T04:58:11.180 INFO:tasks.workunit.client.0.smithi096.stdout:5/861: link d7/d25/d30/d9e/dc3/c115 d7/da3/d11f/de7/c12e 0 2024-04-18T04:58:11.182 INFO:tasks.workunit.client.0.smithi096.stdout:1/954: creat de/d1d/d32/d9a/dad/f137 x:0 0 0 2024-04-18T04:58:11.183 INFO:tasks.workunit.client.0.smithi096.stdout:5/862: mkdir d7/da3/d11f/de7/d12f 0 2024-04-18T04:58:11.185 INFO:tasks.workunit.client.0.smithi096.stdout:8/758: dwrite d0/d3/d32/d6b/d7b/dc9/fe8 [0,4194304] 0 2024-04-18T04:58:11.187 INFO:tasks.workunit.client.0.smithi096.stdout:5/863: truncate d7/f1a 4364844 0 2024-04-18T04:58:11.189 INFO:tasks.workunit.client.0.smithi096.stdout:1/955: mkdir de/d1d/d32/d6f/d85/dfb/dd5/d138 0 2024-04-18T04:58:11.192 INFO:tasks.workunit.client.0.smithi096.stdout:1/956: dread de/d1d/d32/d9a/feb [0,4194304] 0 2024-04-18T04:58:11.193 INFO:tasks.workunit.client.0.smithi096.stdout:8/759: getdents d0/d7/d24/d35 0 2024-04-18T04:58:11.195 INFO:tasks.workunit.client.0.smithi096.stdout:1/957: write de/d1d/f65 [2458066,90005] 0 2024-04-18T04:58:11.195 INFO:tasks.workunit.client.0.smithi096.stdout:5/864: dwrite d7/da3/d9a/f11e [0,4194304] 0 2024-04-18T04:58:11.200 INFO:tasks.workunit.client.0.smithi096.stdout:8/760: fsync d0/d7/d24/f3d 0 2024-04-18T04:58:11.200 INFO:tasks.workunit.client.0.smithi096.stdout:8/761: readlink d0/d7/d24/d35/d51/l6e 0 2024-04-18T04:58:11.200 INFO:tasks.workunit.client.0.smithi096.stdout:1/958: mkdir de/d1d/d3f/d4f/da9/d139 0 2024-04-18T04:58:11.201 INFO:tasks.workunit.client.0.smithi096.stdout:5/865: link d7/d25/d7c/c8a d7/d3b/c130 0 2024-04-18T04:58:11.204 INFO:tasks.workunit.client.0.smithi096.stdout:8/762: rename d0/d7/d24/f45 to d0/d15/d65/d8f/db6/ff5 0 2024-04-18T04:58:11.205 INFO:tasks.workunit.client.0.smithi096.stdout:1/959: getdents de/d1d/d32/d73 0 2024-04-18T04:58:11.206 INFO:tasks.workunit.client.0.smithi096.stdout:8/763: mkdir d0/d3/d32/dee/df6 0 2024-04-18T04:58:11.210 INFO:tasks.workunit.client.0.smithi096.stdout:5/866: write d7/ff [3255391,47013] 0 2024-04-18T04:58:11.212 INFO:tasks.workunit.client.0.smithi096.stdout:5/867: write d7/d25/d2b/fb4 [353681,85860] 0 2024-04-18T04:58:11.215 INFO:tasks.workunit.client.0.smithi096.stdout:8/764: dwrite d0/d3/f31 [0,4194304] 0 2024-04-18T04:58:11.219 INFO:tasks.workunit.client.0.smithi096.stdout:1/960: dread de/d1d/d32/d6f/d85/f114 [0,4194304] 0 2024-04-18T04:58:11.220 INFO:tasks.workunit.client.0.smithi096.stdout:8/765: symlink d0/d15/d65/d8f/db6/lf7 0 2024-04-18T04:58:11.220 INFO:tasks.workunit.client.0.smithi096.stdout:8/766: stat d0/d7/c16 0 2024-04-18T04:58:11.221 INFO:tasks.workunit.client.0.smithi096.stdout:5/868: fsync d7/dd/d8f/da2/de2/de3/d52/f6d 0 2024-04-18T04:58:11.222 INFO:tasks.workunit.client.0.smithi096.stdout:5/869: stat d7/d25/d2b/d111 0 2024-04-18T04:58:11.223 INFO:tasks.workunit.client.0.smithi096.stdout:5/870: fdatasync d7/d25/d30/f5c 0 2024-04-18T04:58:11.224 INFO:tasks.workunit.client.0.smithi096.stdout:8/767: rename d0/d7/d86/d91/lbe to d0/d15/d65/lf8 0 2024-04-18T04:58:11.227 INFO:tasks.workunit.client.0.smithi096.stdout:1/961: write de/d1d/d32/d8c/fa8 [21352,106128] 0 2024-04-18T04:58:11.229 INFO:tasks.workunit.client.0.smithi096.stdout:8/768: creat d0/d3/d32/dee/df6/ff9 x:0 0 0 2024-04-18T04:58:11.230 INFO:tasks.workunit.client.0.smithi096.stdout:8/769: readlink d0/d15/d65/d8f/lb9 0 2024-04-18T04:58:11.230 INFO:tasks.workunit.client.0.smithi096.stdout:5/871: dwrite d7/d25/d2b/fb4 [0,4194304] 0 2024-04-18T04:58:11.235 INFO:tasks.workunit.client.0.smithi096.stdout:1/962: truncate f6 4655720 0 2024-04-18T04:58:11.235 INFO:tasks.workunit.client.0.smithi096.stdout:8/770: link d0/d7/d24/f82 d0/d3/d32/ffa 0 2024-04-18T04:58:11.241 INFO:tasks.workunit.client.0.smithi096.stdout:5/872: dwrite d7/d25/d2b/deb/f12d [0,4194304] 0 2024-04-18T04:58:11.242 INFO:tasks.workunit.client.0.smithi096.stdout:1/963: write de/f59 [3835995,47768] 0 2024-04-18T04:58:11.243 INFO:tasks.workunit.client.0.smithi096.stdout:5/873: chown d7/dd/d8f/da2/de2/de3/l5b 3 1 2024-04-18T04:58:11.244 INFO:tasks.workunit.client.0.smithi096.stdout:1/964: fdatasync de/d1d/d32/d6b/f9d 0 2024-04-18T04:58:11.246 INFO:tasks.workunit.client.0.smithi096.stdout:5/874: write d7/d3b/d95/fe4 [690830,87304] 0 2024-04-18T04:58:11.246 INFO:tasks.workunit.client.0.smithi096.stdout:1/965: symlink de/d1d/d3f/l13a 0 2024-04-18T04:58:11.247 INFO:tasks.workunit.client.0.smithi096.stdout:1/966: readlink de/d1d/d32/d8c/l9f 0 2024-04-18T04:58:11.247 INFO:tasks.workunit.client.0.smithi096.stdout:5/875: mkdir d7/dd/d35/db1/d131 0 2024-04-18T04:58:11.248 INFO:tasks.workunit.client.0.smithi096.stdout:8/771: write d0/d7/d24/d35/f5e [87062,36538] 0 2024-04-18T04:58:11.249 INFO:tasks.workunit.client.0.smithi096.stdout:5/876: creat d7/da3/f132 x:0 0 0 2024-04-18T04:58:11.251 INFO:tasks.workunit.client.0.smithi096.stdout:8/772: dread d0/d3/d32/ffa [0,4194304] 0 2024-04-18T04:58:11.253 INFO:tasks.workunit.client.0.smithi096.stdout:8/773: symlink d0/d15/d65/d8f/lfb 0 2024-04-18T04:58:11.254 INFO:tasks.workunit.client.0.smithi096.stdout:5/877: creat d7/dcd/f133 x:0 0 0 2024-04-18T04:58:11.259 INFO:tasks.workunit.client.0.smithi096.stdout:8/774: dread d0/d7/d24/d18/f23 [0,4194304] 0 2024-04-18T04:58:11.261 INFO:tasks.workunit.client.0.smithi096.stdout:5/878: dwrite d7/d25/d7c/fa6 [0,4194304] 0 2024-04-18T04:58:11.262 INFO:tasks.workunit.client.0.smithi096.stdout:8/775: rename d0/d3/dd8 to d0/d4f/dfc 0 2024-04-18T04:58:11.265 INFO:tasks.workunit.client.0.smithi096.stdout:5/879: rename d7/d3b/c118 to d7/d25/d2b/d111/c134 0 2024-04-18T04:58:11.269 INFO:tasks.workunit.client.0.smithi096.stdout:5/880: truncate d7/dd/d8f/da2/de2/de3/d78/ff8 747080 0 2024-04-18T04:58:11.270 INFO:tasks.workunit.client.0.smithi096.stdout:8/776: dwrite d0/d4f/fd4 [4194304,4194304] 0 2024-04-18T04:58:11.271 INFO:tasks.workunit.client.0.smithi096.stdout:8/777: chown d0/d15/d65/d8f/lfb 1739829 1 2024-04-18T04:58:11.271 INFO:tasks.workunit.client.0.smithi096.stdout:5/881: symlink d7/dd/d35/d74/dab/l135 0 2024-04-18T04:58:11.272 INFO:tasks.workunit.client.0.smithi096.stdout:8/778: write d0/d3/d32/d6b/d7b/dc9/fef [42660,110037] 0 2024-04-18T04:58:11.273 INFO:tasks.workunit.client.0.smithi096.stdout:5/882: write d7/dd/f2c [1415518,31529] 0 2024-04-18T04:58:11.276 INFO:tasks.workunit.client.0.smithi096.stdout:8/779: unlink d0/d7/d24/d35/d51/d5b/fe3 0 2024-04-18T04:58:11.277 INFO:tasks.workunit.client.0.smithi096.stdout:5/883: mknod d7/d25/d30/d9e/dc3/d120/c136 0 2024-04-18T04:58:11.279 INFO:tasks.workunit.client.0.smithi096.stdout:8/780: symlink d0/d7/d86/d91/lfd 0 2024-04-18T04:58:11.279 INFO:tasks.workunit.client.0.smithi096.stdout:5/884: rmdir d7/d25/d30 39 2024-04-18T04:58:11.280 INFO:tasks.workunit.client.0.smithi096.stdout:5/885: write d7/f4c [507705,121885] 0 2024-04-18T04:58:11.284 INFO:tasks.workunit.client.0.smithi096.stdout:5/886: mkdir d7/dd/d8f/da2/d137 0 2024-04-18T04:58:11.286 INFO:tasks.workunit.client.0.smithi096.stdout:5/887: creat d7/dd/d35/d74/dab/f138 x:0 0 0 2024-04-18T04:58:11.286 INFO:tasks.workunit.client.0.smithi096.stdout:8/781: dread d0/d7/d24/d18/d5d/f5f [0,4194304] 0 2024-04-18T04:58:11.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.285+0000 7f2c3dfd4640 1 -- 172.21.15.96:0/1800735166 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2c380c2770 con 0x7f2c3814fee0 2024-04-18T04:58:11.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.285+0000 7f2c1ffff640 1 -- 172.21.15.96:0/1800735166 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f2c380c2770 con 0x7f2c3814fee0 2024-04-18T04:58:11.287 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:58:11.288 INFO:tasks.workunit.client.0.smithi096.stdout:5/888: readlink d7/dd/d8f/d5e/lfc 0 2024-04-18T04:58:11.288 INFO:tasks.workunit.client.0.smithi096.stdout:5/889: read - d7/dd/d35/db1/ff6 zero size 2024-04-18T04:58:11.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.289+0000 7f2c3dfd4640 1 -- 172.21.15.96:0/1800735166 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2c24066690 msgr2=0x7f2c24068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.289+0000 7f2c3dfd4640 1 --2- 172.21.15.96:0/1800735166 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2c24066690 0x7f2c24068b50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2c28006fd0 tx=0x7f2c28008040 comp rx=0 tx=0).stop 2024-04-18T04:58:11.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.289+0000 7f2c3dfd4640 1 -- 172.21.15.96:0/1800735166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c3814fee0 msgr2=0x7f2c38149ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.289+0000 7f2c3dfd4640 1 --2- 172.21.15.96:0/1800735166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c3814fee0 0x7f2c38149ad0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000ccf0 tx=0x7f2c3000a660 comp rx=0 tx=0).stop 2024-04-18T04:58:11.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.289+0000 7f2c3dfd4640 1 -- 172.21.15.96:0/1800735166 shutdown_connections 2024-04-18T04:58:11.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.289+0000 7f2c3dfd4640 1 --2- 172.21.15.96:0/1800735166 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2c24066690 0x7f2c24068b50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.289+0000 7f2c3dfd4640 1 --2- 172.21.15.96:0/1800735166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c3814fee0 0x7f2c38149ad0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.289+0000 7f2c3dfd4640 1 --2- 172.21.15.96:0/1800735166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c380c1a90 0x7f2c38149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.289+0000 7f2c3dfd4640 1 --2- 172.21.15.96:0/1800735166 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c380bfeb0 0x7f2c38071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.289+0000 7f2c3dfd4640 1 -- 172.21.15.96:0/1800735166 >> 172.21.15.96:0/1800735166 conn(0x7f2c380cab90 msgr2=0x7f2c38069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:11.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.289+0000 7f2c3dfd4640 1 -- 172.21.15.96:0/1800735166 shutdown_connections 2024-04-18T04:58:11.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.289+0000 7f2c3dfd4640 1 -- 172.21.15.96:0/1800735166 wait complete. 2024-04-18T04:58:11.291 INFO:tasks.workunit.client.0.smithi096.stdout:8/782: mkdir d0/d3/dc1/dfe 0 2024-04-18T04:58:11.291 INFO:tasks.workunit.client.0.smithi096.stdout:5/890: symlink d7/d3b/d95/l139 0 2024-04-18T04:58:11.292 INFO:tasks.workunit.client.0.smithi096.stdout:8/783: rename d0/d3/d32/d6b/d7b/faa to d0/d3/d32/fff 0 2024-04-18T04:58:11.294 INFO:tasks.workunit.client.0.smithi096.stdout:5/891: write d7/d25/d30/f4b [3264302,125240] 0 2024-04-18T04:58:11.296 INFO:tasks.workunit.client.0.smithi096.stdout:8/784: creat d0/d3/dc1/f100 x:0 0 0 2024-04-18T04:58:11.297 INFO:tasks.workunit.client.0.smithi096.stdout:5/892: creat d7/dd/d8f/d5e/f13a x:0 0 0 2024-04-18T04:58:11.298 INFO:tasks.workunit.client.0.smithi096.stdout:8/785: read d0/d7/d24/d18/f11 [2705320,46497] 0 2024-04-18T04:58:11.302 INFO:tasks.workunit.client.0.smithi096.stdout:8/786: creat d0/d3/dc1/dfe/f101 x:0 0 0 2024-04-18T04:58:11.304 INFO:tasks.workunit.client.0.smithi096.stdout:5/893: dwrite d7/d25/f28 [0,4194304] 0 2024-04-18T04:58:11.305 INFO:tasks.workunit.client.0.smithi096.stdout:5/894: dread - d7/dd/d8f/d5e/ff5 zero size 2024-04-18T04:58:11.308 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-18T04:58:11.308 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-18T04:58:11.308 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-18T04:58:11.308 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T04:58:11.308 INFO:tasks.workunit.client.0.smithi096.stdout:5/895: symlink d7/d25/d58/l13b 0 2024-04-18T04:58:11.309 INFO:tasks.workunit.client.0.smithi096.stdout:5/896: write d7/fd1 [140510,8570] 0 2024-04-18T04:58:11.311 INFO:tasks.workunit.client.0.smithi096.stdout:5/897: readlink l5 0 2024-04-18T04:58:11.312 INFO:tasks.workunit.client.0.smithi096.stdout:8/787: dwrite d0/d7/d24/d18/d7c/fa7 [0,4194304] 0 2024-04-18T04:58:11.313 INFO:tasks.workunit.client.0.smithi096.stdout:8/788: stat d0/d3/d32/fff 0 2024-04-18T04:58:11.318 INFO:tasks.workunit.client.0.smithi096.stdout:5/898: truncate d7/dd/d35/fbc 545483 0 2024-04-18T04:58:11.325 INFO:tasks.workunit.client.0.smithi096.stdout:8/789: dread d0/d3/f6c [0,4194304] 0 2024-04-18T04:58:11.332 INFO:tasks.workunit.client.0.smithi096.stdout:5/899: dread d7/f1a [0,4194304] 0 2024-04-18T04:58:11.335 INFO:tasks.workunit.client.0.smithi096.stdout:5/900: rename d7/dd/d35/d74/dab/f138 to d7/da3/d11f/dd5/f13c 0 2024-04-18T04:58:11.337 INFO:tasks.workunit.client.0.smithi096.stdout:5/901: mkdir d7/d25/d58/d13d 0 2024-04-18T04:58:11.338 INFO:tasks.workunit.client.0.smithi096.stdout:5/902: symlink d7/dd/d8f/d5e/l13e 0 2024-04-18T04:58:11.340 INFO:tasks.workunit.client.0.smithi096.stdout:5/903: symlink d7/da3/d11f/dd5/d107/l13f 0 2024-04-18T04:58:11.341 INFO:tasks.workunit.client.0.smithi096.stdout:8/790: dread d0/d3/d32/dee/f69 [0,4194304] 0 2024-04-18T04:58:11.343 INFO:tasks.workunit.client.0.smithi096.stdout:5/904: getdents d7/d25/d7c 0 2024-04-18T04:58:11.348 INFO:tasks.workunit.client.0.smithi096.stdout:5/905: unlink d7/da3/d11f/c85 0 2024-04-18T04:58:11.349 INFO:tasks.workunit.client.0.smithi096.stdout:8/791: dwrite d0/d15/d65/d8f/db6/fe0 [0,4194304] 0 2024-04-18T04:58:11.354 INFO:tasks.workunit.client.0.smithi096.stdout:8/792: rename d0/fc0 to d0/f102 0 2024-04-18T04:58:11.358 INFO:tasks.workunit.client.0.smithi096.stdout:5/906: read d7/da3/d11f/de1/fa4 [2383800,130610] 0 2024-04-18T04:58:11.358 INFO:tasks.workunit.client.0.smithi096.stdout:5/907: truncate d7/d25/d58/f62 1078637 0 2024-04-18T04:58:11.364 INFO:tasks.workunit.client.0.smithi096.stdout:8/793: dwrite d0/d7/d24/d78/f61 [0,4194304] 0 2024-04-18T04:58:11.367 INFO:tasks.workunit.client.0.smithi096.stdout:8/794: creat d0/d15/da9/f103 x:0 0 0 2024-04-18T04:58:11.369 INFO:tasks.workunit.client.0.smithi096.stdout:8/795: symlink d0/d4f/dfc/l104 0 2024-04-18T04:58:11.371 INFO:tasks.workunit.client.0.smithi096.stdout:8/796: creat d0/d3/dc1/f105 x:0 0 0 2024-04-18T04:58:11.374 INFO:tasks.workunit.client.0.smithi096.stdout:8/797: unlink d0/d3/d32/f90 0 2024-04-18T04:58:11.375 INFO:tasks.workunit.client.0.smithi096.stdout:5/908: dread d7/d25/d2b/f3d [0,4194304] 0 2024-04-18T04:58:11.376 INFO:tasks.workunit.client.0.smithi096.stdout:5/909: dread - d7/dd/d35/d74/dab/d100/f11a zero size 2024-04-18T04:58:11.378 INFO:tasks.workunit.client.0.smithi096.stdout:8/798: link d0/d3/d32/c4b d0/d3/d32/d6b/d7b/dc9/c106 0 2024-04-18T04:58:11.379 INFO:tasks.workunit.client.0.smithi096.stdout:8/799: truncate d0/d15/d65/f6a 2584043 0 2024-04-18T04:58:11.379 INFO:tasks.workunit.client.0.smithi096.stdout:5/910: mknod d7/d25/c140 0 2024-04-18T04:58:11.384 INFO:tasks.workunit.client.0.smithi096.stdout:5/911: creat d7/d25/f141 x:0 0 0 2024-04-18T04:58:11.384 INFO:tasks.workunit.client.0.smithi096.stdout:8/800: link d0/d3/d32/dee/laf d0/d3/d32/d6b/d7b/dc9/l107 0 2024-04-18T04:58:11.385 INFO:tasks.workunit.client.0.smithi096.stdout:8/801: stat d0/d7/d24/d8d/fcf 0 2024-04-18T04:58:11.386 INFO:tasks.workunit.client.0.smithi096.stdout:5/912: mkdir d7/d142 0 2024-04-18T04:58:11.388 INFO:tasks.workunit.client.0.smithi096.stdout:8/802: creat d0/d7/d24/d18/d7c/dad/de2/f108 x:0 0 0 2024-04-18T04:58:11.389 INFO:tasks.workunit.client.0.smithi096.stdout:5/913: chown d7/dd/d35/d74/dab/l135 21 1 2024-04-18T04:58:11.396 INFO:tasks.workunit.client.0.smithi096.stdout:5/914: dwrite d7/dd/f9b [0,4194304] 0 2024-04-18T04:58:11.400 INFO:tasks.workunit.client.0.smithi096.stdout:5/915: mknod d7/d3b/c143 0 2024-04-18T04:58:11.400 INFO:tasks.workunit.client.0.smithi096.stdout:8/803: truncate d0/d7/d24/d18/d7c/fa7 653663 0 2024-04-18T04:58:11.404 INFO:tasks.workunit.client.0.smithi096.stdout:5/916: mkdir d7/d25/d30/d9e/dc3/d120/d144 0 2024-04-18T04:58:11.406 INFO:tasks.workunit.client.0.smithi096.stdout:5/917: write d7/fd1 [179600,22724] 0 2024-04-18T04:58:11.409 INFO:tasks.workunit.client.0.smithi096.stdout:8/804: dwrite d0/d3/dc1/dfe/f101 [0,4194304] 0 2024-04-18T04:58:11.410 INFO:tasks.workunit.client.0.smithi096.stdout:5/918: mknod d7/d25/d30/c145 0 2024-04-18T04:58:11.418 INFO:tasks.workunit.client.0.smithi096.stdout:5/919: mkdir d7/d3b/d95/d146 0 2024-04-18T04:58:11.421 INFO:tasks.workunit.client.0.smithi096.stdout:5/920: unlink d7/dd/d8f/f44 0 2024-04-18T04:58:11.421 INFO:tasks.workunit.client.0.smithi096.stdout:5/921: chown d7/d3b/d110/c117 10276 1 2024-04-18T04:58:11.425 INFO:tasks.workunit.client.0.smithi096.stdout:5/922: dread d7/ff0 [0,4194304] 0 2024-04-18T04:58:11.429 INFO:tasks.workunit.client.0.smithi096.stdout:5/923: mkdir d7/da3/d11f/de7/d147 0 2024-04-18T04:58:11.432 INFO:tasks.workunit.client.0.smithi096.stdout:5/924: stat d7/d3b/c57 0 2024-04-18T04:58:11.437 INFO:tasks.workunit.client.0.smithi096.stdout:5/925: link d7/dd/d8f/da2/de2/de3/d56/ddd/ff3 d7/da3/d11f/de7/d12f/f148 0 2024-04-18T04:58:11.437 INFO:tasks.workunit.client.0.smithi096.stdout:5/926: stat d7/d25/d2b 0 2024-04-18T04:58:11.438 INFO:tasks.workunit.client.0.smithi096.stdout:5/927: dread - d7/dd/d8f/da2/de2/de3/dfd/f128 zero size 2024-04-18T04:58:11.438 INFO:tasks.workunit.client.0.smithi096.stdout:5/928: fdatasync d7/da3/d11f/d12b/fc6 0 2024-04-18T04:58:11.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.441+0000 7f72facfe640 1 Processor -- start 2024-04-18T04:58:11.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.441+0000 7f72facfe640 1 -- start start 2024-04-18T04:58:11.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.441+0000 7f72facfe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f72f40c4770 0x7f72f4070d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.441+0000 7f72facfe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f72f40c4b50 0x7f72f4065ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.441+0000 7f72facfe640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f4070870 con 0x7f72f4156e30 2024-04-18T04:58:11.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.441+0000 7f72facfe640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f4071240 con 0x7f72f40c4770 2024-04-18T04:58:11.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.441+0000 7f72facfe640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f40c19f0 con 0x7f72f40c4b50 2024-04-18T04:58:11.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.441+0000 7f72f8a9a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f72f40c4770 0x7f72f4070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.441+0000 7f72f8a9a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f72f40c4770 0x7f72f4070d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47436/0 (socket says 172.21.15.96:47436) 2024-04-18T04:58:11.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.441+0000 7f72f8a9a640 1 -- 172.21.15.96:0/279827497 learned_addr learned my addr 172.21.15.96:0/279827497 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:11.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.441+0000 7f72f3fff640 1 --2- 172.21.15.96:0/279827497 >> v2:172.21.15.139:3300/0 conn(0x7f72f40c4b50 0x7f72f4065ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.441+0000 7f72f8a9a640 1 -- 172.21.15.96:0/279827497 >> v2:172.21.15.139:3300/0 conn(0x7f72f40c4b50 msgr2=0x7f72f4065ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:11.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.441+0000 7f72f8a9a640 1 --2- 172.21.15.96:0/279827497 >> v2:172.21.15.139:3300/0 conn(0x7f72f40c4b50 0x7f72f4065ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.441+0000 7f72f8a9a640 1 -- 172.21.15.96:0/279827497 >> v1:172.21.15.139:6789/0 conn(0x7f72f4156e30 legacy=0x7f72f40b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:11.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.441+0000 7f72f8a9a640 1 -- 172.21.15.96:0/279827497 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f40c5d60 con 0x7f72f40c4770 2024-04-18T04:58:11.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.441+0000 7f72f3fff640 1 --2- 172.21.15.96:0/279827497 >> v2:172.21.15.139:3300/0 conn(0x7f72f40c4b50 0x7f72f4065ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:58:11.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.445+0000 7f72f8a9a640 1 --2- 172.21.15.96:0/279827497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f40c4770 0x7f72f4070d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f72f40be7a0 tx=0x7f72e801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b47cf54a1dacb35 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:11.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.445+0000 7f72f37fe640 1 -- 172.21.15.96:0/279827497 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e80a89d0 con 0x7f72f40c4770 2024-04-18T04:58:11.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.445+0000 7f72f37fe640 1 -- 172.21.15.96:0/279827497 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e80a8b30 con 0x7f72f40c4770 2024-04-18T04:58:11.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.445+0000 7f72f37fe640 1 -- 172.21.15.96:0/279827497 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e80b0440 con 0x7f72f40c4770 2024-04-18T04:58:11.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.445+0000 7f72facfe640 1 -- 172.21.15.96:0/279827497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f40c4770 msgr2=0x7f72f4070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.445+0000 7f72facfe640 1 --2- 172.21.15.96:0/279827497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f40c4770 0x7f72f4070d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f72f40be7a0 tx=0x7f72e801ecd0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.445+0000 7f72facfe640 1 -- 172.21.15.96:0/279827497 shutdown_connections 2024-04-18T04:58:11.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.445+0000 7f72facfe640 1 --2- 172.21.15.96:0/279827497 >> v2:172.21.15.139:3300/0 conn(0x7f72f40c4b50 0x7f72f4065ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.445+0000 7f72facfe640 1 --2- 172.21.15.96:0/279827497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f40c4770 0x7f72f4070d00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.445+0000 7f72facfe640 1 -- 172.21.15.96:0/279827497 >> 172.21.15.96:0/279827497 conn(0x7f72f406e020 msgr2=0x7f72f406e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:11.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.445+0000 7f72facfe640 1 -- 172.21.15.96:0/279827497 shutdown_connections 2024-04-18T04:58:11.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.445+0000 7f72facfe640 1 -- 172.21.15.96:0/279827497 wait complete. 2024-04-18T04:58:11.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72facfe640 1 Processor -- start 2024-04-18T04:58:11.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72facfe640 1 -- start start 2024-04-18T04:58:11.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72facfe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f40c4770 0x7f72f41e0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72facfe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f72f40c4b50 0x7f72f41efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72facfe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72f4156e30 0x7f72f41eb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72facfe640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f41f07a0 con 0x7f72f40c4770 2024-04-18T04:58:11.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72facfe640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f41eb1b0 con 0x7f72f4156e30 2024-04-18T04:58:11.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72facfe640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f414f190 con 0x7f72f40c4b50 2024-04-18T04:58:11.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f8a9a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f40c4770 0x7f72f41e0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f8a9a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f40c4770 0x7f72f41e0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47446/0 (socket says 172.21.15.96:47446) 2024-04-18T04:58:11.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f8a9a640 1 -- 172.21.15.96:0/4286130048 learned_addr learned my addr 172.21.15.96:0/4286130048 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:11.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f3fff640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f72f40c4b50 0x7f72f41efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f929b640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72f4156e30 0x7f72f41eb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f8a9a640 1 -- 172.21.15.96:0/4286130048 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f72f40c4b50 msgr2=0x7f72f41efa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f8a9a640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f72f40c4b50 0x7f72f41efa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f8a9a640 1 -- 172.21.15.96:0/4286130048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72f4156e30 msgr2=0x7f72f41eb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f8a9a640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72f4156e30 0x7f72f41eb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f8a9a640 1 -- 172.21.15.96:0/4286130048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e80094d0 con 0x7f72f40c4770 2024-04-18T04:58:11.452 INFO:tasks.workunit.client.0.smithi096.stdout:5/929: dread d7/dd/d8f/da2/de2/de3/f70 [0,4194304] 0 2024-04-18T04:58:11.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f8a9a640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f40c4770 0x7f72f41e0540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f72e80b3040 tx=0x7f72e801ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:11.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f17fa640 1 -- 172.21.15.96:0/4286130048 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e80b0e80 con 0x7f72f40c4770 2024-04-18T04:58:11.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f17fa640 1 -- 172.21.15.96:0/4286130048 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e80bb480 con 0x7f72f40c4770 2024-04-18T04:58:11.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72facfe640 1 -- 172.21.15.96:0/4286130048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f41f04c0 con 0x7f72f40c4770 2024-04-18T04:58:11.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f17fa640 1 -- 172.21.15.96:0/4286130048 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e80bb810 con 0x7f72f40c4770 2024-04-18T04:58:11.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72facfe640 1 -- 172.21.15.96:0/4286130048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f41e0a80 con 0x7f72f40c4770 2024-04-18T04:58:11.454 INFO:tasks.workunit.client.0.smithi096.stdout:5/930: write d7/fd1 [1102487,54433] 0 2024-04-18T04:58:11.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72facfe640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f41eff50 0x7f72f41ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72facfe640 1 -- 172.21.15.96:0/4286130048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f41f0650 con 0x7f72f41eff50 2024-04-18T04:58:11.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f3fff640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f41eff50 0x7f72f41ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f3fff640 1 -- 172.21.15.96:0/4286130048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72f41eb010 con 0x7f72f41eff50 2024-04-18T04:58:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.449+0000 7f72f3fff640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f41eff50 0x7f72f41ebb80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f72f40bdec0 tx=0x7f72e000f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.453+0000 7f72f17fa640 1 -- 172.21.15.96:0/4286130048 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e0004230 con 0x7f72f41eff50 2024-04-18T04:58:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.453+0000 7f72f17fa640 1 -- 172.21.15.96:0/4286130048 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f72e80bb970 con 0x7f72f40c4770 2024-04-18T04:58:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.453+0000 7f72f17fa640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f72d8066730 0x7f72d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.453+0000 7f72f17fa640 1 -- 172.21.15.96:0/4286130048 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f72e000c030 con 0x7f72f41eff50 2024-04-18T04:58:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.453+0000 7f72f17fa640 1 -- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f41eff50 msgr2=0x7f72f41ebb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.453+0000 7f72f17fa640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f41eff50 0x7f72f41ebb80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f72f40bdec0 tx=0x7f72e000f8f0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.453+0000 7f72f17fa640 1 -- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f41eff50 msgr2=0x7f72f41ebb80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.453+0000 7f72f17fa640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f41eff50 0x7f72f41ebb80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.453+0000 7f72f929b640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f72d8066730 0x7f72d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.453+0000 7f72f17fa640 1 -- 172.21.15.96:0/4286130048 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f72e8122860 con 0x7f72f40c4770 2024-04-18T04:58:11.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.453+0000 7f72f929b640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f72d8066730 0x7f72d8068bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009ee0 tx=0x7f72ec009450 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:11.457 INFO:tasks.workunit.client.0.smithi096.stdout:5/931: rmdir d7/dd/d8f/da2/de2/de3/dfd 39 2024-04-18T04:58:11.458 INFO:tasks.workunit.client.0.smithi096.stdout:5/932: dread - d7/dd/d8f/da2/de2/de3/d52/f122 zero size 2024-04-18T04:58:11.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72facfe640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f414e3a0 0x7f72f414e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72facfe640 1 -- 172.21.15.96:0/4286130048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f41eb320 con 0x7f72f414e3a0 2024-04-18T04:58:11.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72f3fff640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f414e3a0 0x7f72f414e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72f3fff640 1 -- 172.21.15.96:0/4286130048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f72f40c1f90 con 0x7f72f414e3a0 2024-04-18T04:58:11.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72f3fff640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f414e3a0 0x7f72f414e780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f72e0004000 tx=0x7f72e00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:11.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72f17fa640 1 -- 172.21.15.96:0/4286130048 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e0003b30 con 0x7f72f414e3a0 2024-04-18T04:58:11.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72f17fa640 1 -- 172.21.15.96:0/4286130048 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7f72e0003c90 con 0x7f72f414e3a0 2024-04-18T04:58:11.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72f17fa640 1 -- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f414e3a0 msgr2=0x7f72f414e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72f17fa640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f414e3a0 0x7f72f414e780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f72e0004000 tx=0x7f72e00046d0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72f17fa640 1 -- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f414e3a0 msgr2=0x7f72f414e780 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:11.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72f17fa640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f414e3a0 0x7f72f414e780 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f72e0004000 tx=0x7f72e00046d0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.463 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:58:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:58:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:58:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T04:58:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 36, 2024-04-18T04:58:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:58:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:58:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:58:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:58:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 16, 2024-04-18T04:58:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:58:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:58:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:58:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:58:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:58:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:58:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:58:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:58:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:58:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:58:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:58:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:58:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:58:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:58:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:58:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:58:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:58:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:58:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:58:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:58:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:58:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:58:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:58:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:58:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:58:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:58:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:58:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:58:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:58:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:58:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:58:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:58:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:58:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:58:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:58:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:58:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:58:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:58:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:58:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:58:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:58:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:58:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:58:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:58:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:58:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5 2024-04-18T04:58:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:58:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:58:11.479 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:58:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72facfe640 1 -- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f72d8066730 msgr2=0x7f72d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72facfe640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f72d8066730 0x7f72d8068bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009ee0 tx=0x7f72ec009450 comp rx=0 tx=0).stop 2024-04-18T04:58:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72facfe640 1 -- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f40c4770 msgr2=0x7f72f41e0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72facfe640 1 --2- 172.21.15.96:0/4286130048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72f40c4770 0x7f72f41e0540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f72e80b3040 tx=0x7f72e801ba70 comp rx=0 tx=0).stop 2024-04-18T04:58:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72f929b640 1 -- 172.21.15.96:0/4286130048 reap_dead start 2024-04-18T04:58:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72f929b640 1 -- 172.21.15.96:0/4286130048 reap_dead start 2024-04-18T04:58:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72facfe640 1 -- 172.21.15.96:0/4286130048 shutdown_connections 2024-04-18T04:58:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72facfe640 1 -- 172.21.15.96:0/4286130048 >> 172.21.15.96:0/4286130048 conn(0x7f72f406e020 msgr2=0x7f72f406a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:11.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72facfe640 1 -- 172.21.15.96:0/4286130048 shutdown_connections 2024-04-18T04:58:11.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.461+0000 7f72facfe640 1 -- 172.21.15.96:0/4286130048 wait complete. 2024-04-18T04:58:11.482 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:58:11.482 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-18T04:58:11.482 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-18T04:58:11.494 INFO:tasks.workunit.client.0.smithi096.stdout:5/933: symlink d7/d25/d2b/l149 0 2024-04-18T04:58:11.499 INFO:tasks.workunit.client.0.smithi096.stdout:5/934: link d7/d25/d30/d9e/dc3/lcc d7/dd/d35/d74/l14a 0 2024-04-18T04:58:11.501 INFO:tasks.workunit.client.0.smithi096.stdout:5/935: write d7/da3/d11f/dd5/f13c [778595,100026] 0 2024-04-18T04:58:11.508 INFO:tasks.workunit.client.0.smithi096.stdout:5/936: dwrite d7/da3/d11f/de1/fff [0,4194304] 0 2024-04-18T04:58:11.515 INFO:tasks.workunit.client.0.smithi096.stdout:5/937: dwrite d7/d25/d2b/fae [0,4194304] 0 2024-04-18T04:58:11.516 INFO:tasks.workunit.client.0.smithi096.stdout:5/938: fsync d7/da3/f11c 0 2024-04-18T04:58:11.520 INFO:tasks.workunit.client.0.smithi096.stdout:7/841: sync 2024-04-18T04:58:11.520 INFO:tasks.workunit.client.0.smithi096.stdout:0/803: sync 2024-04-18T04:58:11.520 INFO:tasks.workunit.client.0.smithi096.stdout:4/837: sync 2024-04-18T04:58:11.525 INFO:tasks.workunit.client.0.smithi096.stdout:7/842: mknod db/d20/d2f/c108 0 2024-04-18T04:58:11.526 INFO:tasks.workunit.client.0.smithi096.stdout:5/939: dwrite d7/da3/f11c [0,4194304] 0 2024-04-18T04:58:11.528 INFO:tasks.workunit.client.0.smithi096.stdout:0/804: unlink d16/d1c/d4c/f50 0 2024-04-18T04:58:11.529 INFO:tasks.workunit.client.0.smithi096.stdout:0/805: write d16/d1c/d4c/d4e/d67/f8d [40887,82901] 0 2024-04-18T04:58:11.534 INFO:tasks.workunit.client.0.smithi096.stdout:5/940: dwrite d7/d25/fb9 [0,4194304] 0 2024-04-18T04:58:11.534 INFO:tasks.workunit.client.0.smithi096.stdout:7/843: fsync db/d1f/d4e/f78 0 2024-04-18T04:58:11.540 INFO:tasks.workunit.client.0.smithi096.stdout:0/806: creat d16/d1c/d22/db8/ff7 x:0 0 0 2024-04-18T04:58:11.546 INFO:tasks.workunit.client.0.smithi096.stdout:7/844: mknod db/d1f/d5b/c109 0 2024-04-18T04:58:11.548 INFO:tasks.workunit.client.0.smithi096.stdout:0/807: dwrite d16/d1d/f25 [0,4194304] 0 2024-04-18T04:58:11.548 INFO:tasks.workunit.client.0.smithi096.stdout:7/845: chown db/d1f/d39/d6d/l92 98776 1 2024-04-18T04:58:11.552 INFO:tasks.workunit.client.0.smithi096.stdout:7/846: creat db/dd5/f10a x:0 0 0 2024-04-18T04:58:11.557 INFO:tasks.workunit.client.0.smithi096.stdout:4/838: write d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/f96 [288385,50535] 0 2024-04-18T04:58:11.558 INFO:tasks.workunit.client.0.smithi096.stdout:5/941: dread d7/da3/d9a/fc8 [0,4194304] 0 2024-04-18T04:58:11.562 INFO:tasks.workunit.client.0.smithi096.stdout:5/942: unlink d7/dd/d35/d74/l103 0 2024-04-18T04:58:11.562 INFO:tasks.workunit.client.0.smithi096.stdout:4/839: rename d4/d14/d2d/d44/d58/d86/d6f/dc5 to d4/d14/d2d/d44/d58/d86/dff 0 2024-04-18T04:58:11.565 INFO:tasks.workunit.client.0.smithi096.stdout:0/808: dwrite d16/d55/f5f [0,4194304] 0 2024-04-18T04:58:11.565 INFO:tasks.workunit.client.0.smithi096.stdout:5/943: creat d7/dd/d35/d74/dab/f14b x:0 0 0 2024-04-18T04:58:11.566 INFO:tasks.workunit.client.0.smithi096.stdout:7/847: dwrite db/d1f/d5b/d6a/d74/fa7 [0,4194304] 0 2024-04-18T04:58:11.572 INFO:tasks.workunit.client.0.smithi096.stdout:4/840: dread d4/f43 [0,4194304] 0 2024-04-18T04:58:11.575 INFO:tasks.workunit.client.0.smithi096.stdout:0/809: rmdir d16/d1c 39 2024-04-18T04:58:11.576 INFO:tasks.workunit.client.0.smithi096.stdout:7/848: dread db/f2a [0,4194304] 0 2024-04-18T04:58:11.577 INFO:tasks.workunit.client.0.smithi096.stdout:7/849: truncate db/d1f/d42/fab 646810 0 2024-04-18T04:58:11.581 INFO:tasks.workunit.client.0.smithi096.stdout:4/841: truncate d4/d14/d2d/d44/d63/f7f 2058803 0 2024-04-18T04:58:11.586 INFO:tasks.workunit.client.0.smithi096.stdout:7/850: rename db/f31 to db/d1f/d4e/dc0/ddb/f10b 0 2024-04-18T04:58:11.587 INFO:tasks.workunit.client.0.smithi096.stdout:4/842: mkdir d4/d14/d2d/d44/d58/d86/d3a/d39/d54/d100 0 2024-04-18T04:58:11.588 INFO:tasks.workunit.client.0.smithi096.stdout:0/810: creat d16/d1c/ff8 x:0 0 0 2024-04-18T04:58:11.588 INFO:tasks.workunit.client.0.smithi096.stdout:4/843: read - d4/d14/fe6 zero size 2024-04-18T04:58:11.588 INFO:tasks.workunit.client.0.smithi096.stdout:5/944: dwrite d7/f4c [0,4194304] 0 2024-04-18T04:58:11.590 INFO:tasks.workunit.client.0.smithi096.stdout:5/945: chown d7/dd/f2c 8730 1 2024-04-18T04:58:11.591 INFO:tasks.workunit.client.0.smithi096.stdout:0/811: write d16/d1c/d4c/d4d/fcb [448694,30110] 0 2024-04-18T04:58:11.593 INFO:tasks.workunit.client.0.smithi096.stdout:4/844: mkdir d4/d14/d1d/da5/d67/def/d101 0 2024-04-18T04:58:11.594 INFO:tasks.workunit.client.0.smithi096.stdout:4/845: chown d4/d7a 1499734 1 2024-04-18T04:58:11.602 INFO:tasks.workunit.client.0.smithi096.stdout:5/946: mkdir d7/d25/d58/d13d/d14c 0 2024-04-18T04:58:11.605 INFO:tasks.workunit.client.0.smithi096.stdout:4/846: creat d4/d14/f102 x:0 0 0 2024-04-18T04:58:11.605 INFO:tasks.workunit.client.0.smithi096.stdout:0/812: dread d16/d1c/f56 [0,4194304] 0 2024-04-18T04:58:11.606 INFO:tasks.workunit.client.0.smithi096.stdout:7/851: dread db/d1f/f41 [0,4194304] 0 2024-04-18T04:58:11.607 INFO:tasks.workunit.client.0.smithi096.stdout:0/813: chown d16/d1d/d3b/dc3/cd5 14 1 2024-04-18T04:58:11.607 INFO:tasks.workunit.client.0.smithi096.stdout:4/847: creat d4/d14/d2d/d44/d89/f103 x:0 0 0 2024-04-18T04:58:11.608 INFO:tasks.workunit.client.0.smithi096.stdout:7/852: chown db/d20/d45/dcf/dd6/ffb 31387424 1 2024-04-18T04:58:11.608 INFO:tasks.workunit.client.0.smithi096.stdout:0/814: chown d16/d1d/fe3 14695 1 2024-04-18T04:58:11.609 INFO:tasks.workunit.client.0.smithi096.stdout:4/848: mknod d4/d14/d2d/d44/d90/c104 0 2024-04-18T04:58:11.611 INFO:tasks.workunit.client.0.smithi096.stdout:4/849: write d4/d14/d2d/d44/d89/f8e [4577712,12975] 0 2024-04-18T04:58:11.611 INFO:tasks.workunit.client.0.smithi096.stdout:7/853: getdents db/d1f/d4e/dc0/ddb 0 2024-04-18T04:58:11.612 INFO:tasks.workunit.client.0.smithi096.stdout:4/850: creat d4/d14/d16/f105 x:0 0 0 2024-04-18T04:58:11.614 INFO:tasks.workunit.client.0.smithi096.stdout:7/854: mkdir db/d1f/d39/d10c 0 2024-04-18T04:58:11.614 INFO:tasks.workunit.client.0.smithi096.stdout:7/855: chown c0 1368854764 1 2024-04-18T04:58:11.617 INFO:tasks.workunit.client.0.smithi096.stdout:0/815: dwrite d16/d1c/d4c/d4d/d5d/fc7 [0,4194304] 0 2024-04-18T04:58:11.619 INFO:tasks.workunit.client.0.smithi096.stdout:0/816: dread - d16/d1d/d3b/fa9 zero size 2024-04-18T04:58:11.623 INFO:tasks.workunit.client.0.smithi096.stdout:0/817: creat d16/d1c/d4c/d4d/d36/ff9 x:0 0 0 2024-04-18T04:58:11.623 INFO:tasks.workunit.client.0.smithi096.stdout:4/851: write d4/d14/d2d/d44/d58/d86/d3a/d39/f51 [5312584,120027] 0 2024-04-18T04:58:11.626 INFO:tasks.workunit.client.0.smithi096.stdout:9/945: sync 2024-04-18T04:58:11.626 INFO:tasks.workunit.client.0.smithi096.stdout:7/856: dwrite db/d1f/d39/d6d/d79/fdd [0,4194304] 0 2024-04-18T04:58:11.626 INFO:tasks.workunit.client.0.smithi096.stdout:0/818: truncate d16/d1c/d4c/d4e/fd9 170615 0 2024-04-18T04:58:11.627 INFO:tasks.workunit.client.0.smithi096.stdout:7/857: stat db/f62 0 2024-04-18T04:58:11.628 INFO:tasks.workunit.client.0.smithi096.stdout:9/946: fsync d0/de/d17/d2f/d40/dd2/d113/f11e 0 2024-04-18T04:58:11.628 INFO:tasks.workunit.client.0.smithi096.stdout:4/852: symlink d4/d14/d2d/d44/d58/d86/d3a/d39/d54/l106 0 2024-04-18T04:58:11.632 INFO:tasks.workunit.client.0.smithi096.stdout:0/819: unlink d16/d1c/f9c 0 2024-04-18T04:58:11.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.637+0000 7f21d5494640 1 Processor -- start 2024-04-18T04:58:11.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.637+0000 7f21d5494640 1 -- start start 2024-04-18T04:58:11.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21d5494640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f21d015c610 0x7f21d00ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21d5494640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f21d00ca920 0x7f21d0069e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21d5494640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d00c9990 con 0x7f21d01533d0 2024-04-18T04:58:11.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21d5494640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d00c9f50 con 0x7f21d015c610 2024-04-18T04:58:11.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21d5494640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0159870 con 0x7f21d00ca920 2024-04-18T04:58:11.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ceffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f21d01533d0 0x7f21d01590a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46346/0 (socket says 172.21.15.96:46346) 2024-04-18T04:58:11.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ceffd640 1 -- 172.21.15.96:0/1122877022 learned_addr learned my addr 172.21.15.96:0/1122877022 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:58:11.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21cf7fe640 1 --2- 172.21.15.96:0/1122877022 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f21d00ca920 0x7f21d0069e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21c7fff640 1 --2- 172.21.15.96:0/1122877022 >> v2:172.21.15.139:3300/0 conn(0x7f21d015c610 0x7f21d00ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ce7fc640 1 -- 172.21.15.96:0/1122877022 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214895998 0 0) 0x7f21d00c9990 con 0x7f21d01533d0 2024-04-18T04:58:11.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ce7fc640 1 -- 172.21.15.96:0/1122877022 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21bc003530 con 0x7f21d01533d0 2024-04-18T04:58:11.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ce7fc640 1 -- 172.21.15.96:0/1122877022 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1726091123 0 0) 0x7f21bc003530 con 0x7f21d01533d0 2024-04-18T04:58:11.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ce7fc640 1 -- 172.21.15.96:0/1122877022 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f21d00ca920 msgr2=0x7f21d0069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:11.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ce7fc640 1 --2- 172.21.15.96:0/1122877022 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f21d00ca920 0x7f21d0069e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ce7fc640 1 -- 172.21.15.96:0/1122877022 >> v2:172.21.15.139:3300/0 conn(0x7f21d015c610 msgr2=0x7f21d00ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:11.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ce7fc640 1 --2- 172.21.15.96:0/1122877022 >> v2:172.21.15.139:3300/0 conn(0x7f21d015c610 0x7f21d00ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ce7fc640 1 -- 172.21.15.96:0/1122877022 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d0159b50 con 0x7f21d01533d0 2024-04-18T04:58:11.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21c7fff640 1 --2- 172.21.15.96:0/1122877022 >> v2:172.21.15.139:3300/0 conn(0x7f21d015c610 0x7f21d00ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:58:11.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ce7fc640 1 -- 172.21.15.96:0/1122877022 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f21c0001680 con 0x7f21d01533d0 2024-04-18T04:58:11.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21cf7fe640 1 --2- 172.21.15.96:0/1122877022 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f21d00ca920 0x7f21d0069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:58:11.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ce7fc640 1 -- 172.21.15.96:0/1122877022 >> v1:172.21.15.96:6789/0 conn(0x7f21d01533d0 legacy=0x7f21d01590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ce7fc640 1 --2- 172.21.15.96:0/1122877022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21bc003980 0x7f21bc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ce7fc640 1 --2- 172.21.15.96:0/1122877022 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f21d00ca920 0x7f21bc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ce7fc640 1 --2- 172.21.15.96:0/1122877022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21bc004d10 0x7f21bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ce7fc640 1 -- 172.21.15.96:0/1122877022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00c9f50 con 0x7f21bc004d10 2024-04-18T04:58:11.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ce7fc640 1 -- 172.21.15.96:0/1122877022 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0159870 con 0x7f21bc003980 2024-04-18T04:58:11.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ce7fc640 1 -- 172.21.15.96:0/1122877022 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc00b990 con 0x7f21d00ca920 2024-04-18T04:58:11.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21cf7fe640 1 --2- 172.21.15.96:0/1122877022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21bc004d10 0x7f21bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21ceffd640 1 --2- 172.21.15.96:0/1122877022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21bc003980 0x7f21bc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21c7fff640 1 --2- 172.21.15.96:0/1122877022 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f21d00ca920 0x7f21bc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21cf7fe640 1 -- 172.21.15.96:0/1122877022 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f21d00ca920 msgr2=0x7f21bc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:11.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21cf7fe640 1 --2- 172.21.15.96:0/1122877022 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f21d00ca920 0x7f21bc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21cf7fe640 1 -- 172.21.15.96:0/1122877022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21bc003980 msgr2=0x7f21bc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:11.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21cf7fe640 1 --2- 172.21.15.96:0/1122877022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21bc003980 0x7f21bc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21cf7fe640 1 -- 172.21.15.96:0/1122877022 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c8009a70 con 0x7f21bc004d10 2024-04-18T04:58:11.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.641+0000 7f21cf7fe640 1 --2- 172.21.15.96:0/1122877022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21bc004d10 0x7f21bc005190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f21c800e320 tx=0x7f21c801cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4acf8ca454f82863 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:11.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21ce7fc640 1 -- 172.21.15.96:0/1122877022 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80a5dd0 con 0x7f21bc004d10 2024-04-18T04:58:11.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21ce7fc640 1 -- 172.21.15.96:0/1122877022 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c800f040 con 0x7f21bc004d10 2024-04-18T04:58:11.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21ce7fc640 1 -- 172.21.15.96:0/1122877022 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80ad640 con 0x7f21bc004d10 2024-04-18T04:58:11.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21d5494640 1 -- 172.21.15.96:0/1122877022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21bc004d10 msgr2=0x7f21bc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21d5494640 1 --2- 172.21.15.96:0/1122877022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21bc004d10 0x7f21bc005190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f21c800e320 tx=0x7f21c801cdc0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21cf7fe640 1 -- 172.21.15.96:0/1122877022 reap_dead start 2024-04-18T04:58:11.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21d5494640 1 -- 172.21.15.96:0/1122877022 shutdown_connections 2024-04-18T04:58:11.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21d5494640 1 -- 172.21.15.96:0/1122877022 >> 172.21.15.96:0/1122877022 conn(0x7f21d00c7e80 msgr2=0x7f21d00c8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:11.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21d5494640 1 -- 172.21.15.96:0/1122877022 shutdown_connections 2024-04-18T04:58:11.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21d5494640 1 -- 172.21.15.96:0/1122877022 wait complete. 2024-04-18T04:58:11.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21d5494640 1 Processor -- start 2024-04-18T04:58:11.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21d5494640 1 -- start start 2024-04-18T04:58:11.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21d5494640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d014e130 0x7f21d01f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21d5494640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f21d00c1cc0 0x7f21d014e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21d5494640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d00bfe80 0x7f21d01ef240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21d5494640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d01ee830 con 0x7f21d014e130 2024-04-18T04:58:11.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21d5494640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00bf9c0 con 0x7f21d00bfe80 2024-04-18T04:58:11.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21d5494640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00bf1b0 con 0x7f21d00c1cc0 2024-04-18T04:58:11.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21ceffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d014e130 0x7f21d01f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21ceffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d014e130 0x7f21d01f27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47466/0 (socket says 172.21.15.96:47466) 2024-04-18T04:58:11.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21ceffd640 1 -- 172.21.15.96:0/3039193822 learned_addr learned my addr 172.21.15.96:0/3039193822 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:11.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21c7fff640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f21d00c1cc0 0x7f21d014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21cf7fe640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d00bfe80 0x7f21d01ef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21ceffd640 1 -- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f21d00c1cc0 msgr2=0x7f21d014e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21ceffd640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f21d00c1cc0 0x7f21d014e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21ceffd640 1 -- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d00bfe80 msgr2=0x7f21d01ef240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21ceffd640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d00bfe80 0x7f21d01ef240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21ceffd640 1 -- 172.21.15.96:0/3039193822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d014ea50 con 0x7f21d014e130 2024-04-18T04:58:11.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21ceffd640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d014e130 0x7f21d01f27b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f21c0004850 tx=0x7f21c0004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:11.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21c77fe640 1 -- 172.21.15.96:0/3039193822 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c000f960 con 0x7f21d014e130 2024-04-18T04:58:11.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21c77fe640 1 -- 172.21.15.96:0/3039193822 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c000fac0 con 0x7f21d014e130 2024-04-18T04:58:11.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21d5494640 1 -- 172.21.15.96:0/3039193822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d01ef780 con 0x7f21d014e130 2024-04-18T04:58:11.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21c77fe640 1 -- 172.21.15.96:0/3039193822 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c000fe70 con 0x7f21d014e130 2024-04-18T04:58:11.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.645+0000 7f21d5494640 1 -- 172.21.15.96:0/3039193822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d00bf6e0 con 0x7f21d014e130 2024-04-18T04:58:11.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.649+0000 7f21d5494640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d0159130 0x7f21d01ee9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.649+0000 7f21d5494640 1 -- 172.21.15.96:0/3039193822 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0066b90 con 0x7f21d0159130 2024-04-18T04:58:11.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.649+0000 7f21c7fff640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d0159130 0x7f21d01ee9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.649+0000 7f21c7fff640 1 -- 172.21.15.96:0/3039193822 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21d01537b0 con 0x7f21d0159130 2024-04-18T04:58:11.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.649+0000 7f21c77fe640 1 -- 172.21.15.96:0/3039193822 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f21c001d460 con 0x7f21d014e130 2024-04-18T04:58:11.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.649+0000 7f21c7fff640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d0159130 0x7f21d01ee9a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f21d00beb30 tx=0x7f21b8012700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:11.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.649+0000 7f21c77fe640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f21b0066690 0x7f21b0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.649+0000 7f21c77fe640 1 -- 172.21.15.96:0/3039193822 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f21c0084270 con 0x7f21d014e130 2024-04-18T04:58:11.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.649+0000 7f21cf7fe640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f21b0066690 0x7f21b0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.649+0000 7f21c77fe640 1 -- 172.21.15.96:0/3039193822 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8004030 con 0x7f21d0159130 2024-04-18T04:58:11.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.649+0000 7f21c77fe640 1 -- 172.21.15.96:0/3039193822 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f21b8004190 con 0x7f21d0159130 2024-04-18T04:58:11.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.649+0000 7f21c77fe640 1 -- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d0159130 msgr2=0x7f21d01ee9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.649+0000 7f21c77fe640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d0159130 0x7f21d01ee9a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f21d00beb30 tx=0x7f21b8012700 comp rx=0 tx=0).stop 2024-04-18T04:58:11.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.649+0000 7f21c77fe640 1 -- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d0159130 msgr2=0x7f21d01ee9a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:11.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.649+0000 7f21c77fe640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d0159130 0x7f21d01ee9a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.649+0000 7f21cf7fe640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f21b0066690 0x7f21b0068b50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f21c80af000 tx=0x7f21c8004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:11.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.653+0000 7f21d5494640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d014bbb0 0x7f21d014bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.653+0000 7f21d5494640 1 -- 172.21.15.96:0/3039193822 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00c9be0 con 0x7f21d014bbb0 2024-04-18T04:58:11.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.653+0000 7f21c7fff640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d014bbb0 0x7f21d014bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.653+0000 7f21c7fff640 1 -- 172.21.15.96:0/3039193822 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f21d006c380 con 0x7f21d014bbb0 2024-04-18T04:58:11.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.653+0000 7f21c7fff640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d014bbb0 0x7f21d014bfc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f21b801e000 tx=0x7f21b8004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:11.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.657+0000 7f21c77fe640 1 -- 172.21.15.96:0/3039193822 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8005db0 con 0x7f21d014bbb0 2024-04-18T04:58:11.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.657+0000 7f21c77fe640 1 -- 172.21.15.96:0/3039193822 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f21b801d700 con 0x7f21d014bbb0 2024-04-18T04:58:11.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.657+0000 7f21c77fe640 1 -- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d014bbb0 msgr2=0x7f21d014bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.657+0000 7f21c77fe640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d014bbb0 0x7f21d014bfc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f21b801e000 tx=0x7f21b8004740 comp rx=0 tx=0).stop 2024-04-18T04:58:11.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.657+0000 7f21c77fe640 1 -- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d014bbb0 msgr2=0x7f21d014bfc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:11.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.657+0000 7f21c77fe640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d014bbb0 0x7f21d014bfc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.657 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:58:11.657 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:58:11.657 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:58:11.657 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:58:11.657 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 36, 2024-04-18T04:58:11.657 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:58:11.658 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:58:11.658 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:58:11.658 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:58:11.658 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.658 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 16, 2024-04-18T04:58:11.658 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:11.658 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:58:11.658 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:58:11.658 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:11.658 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:11.658 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:11.658 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:11.658 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:11.658 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:11.659 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:11.659 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:11.659 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:11.659 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:11.659 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.659 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:58:11.659 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:58:11.659 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:11.659 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:11.659 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:11.659 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:11.659 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:11.659 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:11.659 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:11.659 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:11.660 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:11.660 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:11.660 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.660 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:58:11.660 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:58:11.660 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:58:11.660 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:58:11.660 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:58:11.660 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:58:11.660 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:11.660 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:11.660 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:58:11.660 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:58:11.660 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:58:11.660 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:58:11.661 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:58:11.661 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:58:11.661 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:58:11.661 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:11.661 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:58:11.661 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:11.661 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:11.661 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:11.661 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:11.661 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:11.661 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:11.661 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:11.661 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:11.661 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:11.661 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:11.662 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.662 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:58:11.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.662 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:58:11.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.662 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:58:11.662 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:58:11.662 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:11.662 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:11.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.662 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:11.662 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:58:11.662 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.663 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:11.663 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:58:11.663 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.663 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.663 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.663 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:58:11.663 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:58:11.663 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:11.663 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:11.663 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:11.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.663 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:58:11.664 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:58:11.664 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:11.664 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:11.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.664 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:11.664 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:58:11.664 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.664 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:11.664 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:58:11.664 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.664 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.664 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.665 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:58:11.665 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:58:11.665 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:11.665 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:11.665 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:11.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.665 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:58:11.665 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:58:11.665 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:11.665 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:11.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.665 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:11.666 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:58:11.666 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.666 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:11.666 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:58:11.666 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.666 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.666 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.666 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:58:11.666 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:58:11.666 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:11.667 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:11.667 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:11.667 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.667 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.667 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:58:11.667 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:58:11.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.667 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:11.667 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:11.667 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:11.667 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.667 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.667 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:58:11.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.668 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:11.668 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:11.668 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:11.668 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.668 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.668 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:58:11.668 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:58:11.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.657+0000 7f21d5494640 1 -- 172.21.15.96:0/3039193822 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f21b0066690 msgr2=0x7f21b0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.657+0000 7f21d5494640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f21b0066690 0x7f21b0068b50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f21c80af000 tx=0x7f21c8004ac0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.657+0000 7f21d5494640 1 -- 172.21.15.96:0/3039193822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d014e130 msgr2=0x7f21d01f27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.657+0000 7f21d5494640 1 --2- 172.21.15.96:0/3039193822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d014e130 0x7f21d01f27b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f21c0004850 tx=0x7f21c0004f90 comp rx=0 tx=0).stop 2024-04-18T04:58:11.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.657+0000 7f21cf7fe640 1 -- 172.21.15.96:0/3039193822 reap_dead start 2024-04-18T04:58:11.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.657+0000 7f21cf7fe640 1 -- 172.21.15.96:0/3039193822 reap_dead start 2024-04-18T04:58:11.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.657+0000 7f21d5494640 1 -- 172.21.15.96:0/3039193822 shutdown_connections 2024-04-18T04:58:11.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.657+0000 7f21d5494640 1 -- 172.21.15.96:0/3039193822 >> 172.21.15.96:0/3039193822 conn(0x7f21d00c7e80 msgr2=0x7f21d0071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:11.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.657+0000 7f21d5494640 1 -- 172.21.15.96:0/3039193822 shutdown_connections 2024-04-18T04:58:11.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.657+0000 7f21d5494640 1 -- 172.21.15.96:0/3039193822 wait complete. 2024-04-18T04:58:11.671 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:58:11.671 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-18T04:58:11.671 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-18T04:58:11.791 INFO:tasks.workunit.client.0.smithi096.stdout:0/820: readlink d16/d1c/d4c/d6a/ldc 0 2024-04-18T04:58:11.794 INFO:tasks.workunit.client.0.smithi096.stdout:9/947: mknod d0/d52/c129 0 2024-04-18T04:58:11.796 INFO:tasks.workunit.client.0.smithi096.stdout:0/821: mknod d16/d1c/d4c/d4d/d36/cfa 0 2024-04-18T04:58:11.798 INFO:tasks.workunit.client.0.smithi096.stdout:0/822: write d16/d1c/f3c [1867924,35492] 0 2024-04-18T04:58:11.798 INFO:tasks.workunit.client.0.smithi096.stdout:7/858: truncate db/d1f/d24/d61/f84 1653496 0 2024-04-18T04:58:11.801 INFO:tasks.workunit.client.0.smithi096.stdout:9/948: fsync d0/de/d17/d2f/d40/dc1/f110 0 2024-04-18T04:58:11.801 INFO:tasks.workunit.client.0.smithi096.stdout:7/859: read - db/d1f/d39/d6d/d79/ff6 zero size 2024-04-18T04:58:11.802 INFO:tasks.workunit.client.0.smithi096.stdout:4/853: dwrite d4/d14/d2d/d44/d58/d86/f3b [0,4194304] 0 2024-04-18T04:58:11.803 INFO:tasks.workunit.client.0.smithi096.stdout:7/860: fsync db/d1d/f5a 0 2024-04-18T04:58:11.810 INFO:tasks.workunit.client.0.smithi096.stdout:7/861: read db/d1f/d42/fab [406180,26149] 0 2024-04-18T04:58:11.810 INFO:tasks.workunit.client.0.smithi096.stdout:0/823: dread d16/d1c/d4c/d4d/fcb [0,4194304] 0 2024-04-18T04:58:11.811 INFO:tasks.workunit.client.0.smithi096.stdout:7/862: fdatasync db/f3f 0 2024-04-18T04:58:11.811 INFO:tasks.workunit.client.0.smithi096.stdout:0/824: stat d16/d1c/d4c/d4d/d5d/d91/leb 0 2024-04-18T04:58:11.816 INFO:tasks.workunit.client.0.smithi096.stdout:4/854: creat d4/d14/d1d/da5/d67/def/f107 x:0 0 0 2024-04-18T04:58:11.821 INFO:tasks.workunit.client.0.smithi096.stdout:9/949: dread d0/de/d17/d56/d59/d68/f72 [0,4194304] 0 2024-04-18T04:58:11.823 INFO:tasks.workunit.client.0.smithi096.stdout:4/855: creat d4/d14/d2d/d44/d58/d86/dff/f108 x:0 0 0 2024-04-18T04:58:11.824 INFO:tasks.workunit.client.0.smithi096.stdout:1/967: sync 2024-04-18T04:58:11.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.825+0000 7f22a81db640 1 Processor -- start 2024-04-18T04:58:11.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.825+0000 7f22a81db640 1 -- start start 2024-04-18T04:58:11.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.825+0000 7f22a81db640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f22a0156f50 0x7f22a0157330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.825+0000 7f22a81db640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a00c6c40 con 0x7f22a006a950 2024-04-18T04:58:11.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.825+0000 7f22a81db640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a00c5230 con 0x7f22a0150b40 2024-04-18T04:58:11.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.825+0000 7f22a81db640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a0157b50 con 0x7f22a0156f50 2024-04-18T04:58:11.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.825+0000 7f22a5f77640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f22a0156f50 0x7f22a0157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.825+0000 7f22a5776640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f22a006a950 0x7f22a00c7690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46348/0 (socket says 172.21.15.96:46348) 2024-04-18T04:58:11.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.825+0000 7f22a5776640 1 -- 172.21.15.96:0/1699342232 learned_addr learned my addr 172.21.15.96:0/1699342232 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:58:11.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.825+0000 7f22a5f77640 1 -- 172.21.15.96:0/1699342232 >> v1:172.21.15.139:6789/0 conn(0x7f22a0150b40 legacy=0x7f22a01615a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:11.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.825+0000 7f22a5f77640 1 -- 172.21.15.96:0/1699342232 >> v1:172.21.15.96:6789/0 conn(0x7f22a006a950 legacy=0x7f22a00c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.825+0000 7f22a4f75640 1 -- 172.21.15.96:0/1699342232 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126800036 0 0) 0x7f22a00c6c40 con 0x7f22a006a950 2024-04-18T04:58:11.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.825+0000 7f22a5f77640 1 -- 172.21.15.96:0/1699342232 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a00c32f0 con 0x7f22a0156f50 2024-04-18T04:58:11.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.829+0000 7f22a5f77640 1 --2- 172.21.15.96:0/1699342232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a0156f50 0x7f22a0157330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f229c0097c0 tx=0x7f229c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98f00a5f0ae8139 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:11.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.829+0000 7f22a4f75640 1 -- 172.21.15.96:0/1699342232 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c0a8950 con 0x7f22a0156f50 2024-04-18T04:58:11.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.829+0000 7f22a4f75640 1 -- 172.21.15.96:0/1699342232 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229c0a8ab0 con 0x7f22a0156f50 2024-04-18T04:58:11.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.829+0000 7f22a4f75640 1 -- 172.21.15.96:0/1699342232 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c0a8e40 con 0x7f22a0156f50 2024-04-18T04:58:11.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.829+0000 7f22a81db640 1 -- 172.21.15.96:0/1699342232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a0156f50 msgr2=0x7f22a0157330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.829+0000 7f22a81db640 1 --2- 172.21.15.96:0/1699342232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a0156f50 0x7f22a0157330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f229c0097c0 tx=0x7f229c01ec50 comp rx=0 tx=0).stop 2024-04-18T04:58:11.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.829+0000 7f22a81db640 1 -- 172.21.15.96:0/1699342232 shutdown_connections 2024-04-18T04:58:11.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.829+0000 7f22a81db640 1 --2- 172.21.15.96:0/1699342232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a0156f50 0x7f22a0157330 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.829+0000 7f22a81db640 1 -- 172.21.15.96:0/1699342232 >> 172.21.15.96:0/1699342232 conn(0x7f22a0069e60 msgr2=0x7f22a006a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:11.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.829+0000 7f22a81db640 1 -- 172.21.15.96:0/1699342232 shutdown_connections 2024-04-18T04:58:11.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.829+0000 7f22a81db640 1 -- 172.21.15.96:0/1699342232 wait complete. 2024-04-18T04:58:11.833 INFO:tasks.workunit.client.0.smithi096.stdout:4/856: rmdir d4/d14/d1d 39 2024-04-18T04:58:11.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a81db640 1 Processor -- start 2024-04-18T04:58:11.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a81db640 1 -- start start 2024-04-18T04:58:11.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a81db640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a006a950 0x7f22a0155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a81db640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a0150b40 0x7f22a0154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a81db640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a0156f50 0x7f22a01e5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a81db640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00722c0 con 0x7f22a0156f50 2024-04-18T04:58:11.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a81db640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a01563d0 con 0x7f22a0150b40 2024-04-18T04:58:11.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a81db640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00703f0 con 0x7f22a006a950 2024-04-18T04:58:11.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a6778640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a0156f50 0x7f22a01e5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a6778640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a0156f50 0x7f22a01e5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47490/0 (socket says 172.21.15.96:47490) 2024-04-18T04:58:11.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a6778640 1 -- 172.21.15.96:0/4191802815 learned_addr learned my addr 172.21.15.96:0/4191802815 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:11.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a5f77640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a006a950 0x7f22a0155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a5776640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a0150b40 0x7f22a0154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a6778640 1 -- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a006a950 msgr2=0x7f22a0155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a6778640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a006a950 0x7f22a0155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a6778640 1 -- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a0150b40 msgr2=0x7f22a0154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a6778640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a0150b40 0x7f22a0154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a6778640 1 -- 172.21.15.96:0/4191802815 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c009420 con 0x7f22a0156f50 2024-04-18T04:58:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a6778640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a0156f50 0x7f22a01e5ff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f229800b9e0 tx=0x7f229800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22967fc640 1 -- 172.21.15.96:0/4191802815 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2298003b80 con 0x7f22a0156f50 2024-04-18T04:58:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22967fc640 1 -- 172.21.15.96:0/4191802815 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2298003ce0 con 0x7f22a0156f50 2024-04-18T04:58:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22967fc640 1 -- 172.21.15.96:0/4191802815 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229800cae0 con 0x7f22a0156f50 2024-04-18T04:58:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a81db640 1 -- 172.21.15.96:0/4191802815 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a00c1600 con 0x7f22a0156f50 2024-04-18T04:58:11.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.833+0000 7f22a81db640 1 -- 172.21.15.96:0/4191802815 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a00c1320 con 0x7f22a0156f50 2024-04-18T04:58:11.838 INFO:tasks.workunit.client.0.smithi096.stdout:7/863: creat db/f10d x:0 0 0 2024-04-18T04:58:11.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.837+0000 7f22a81db640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a01e6530 0x7f22a00c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.837+0000 7f22a81db640 1 -- 172.21.15.96:0/4191802815 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00738a0 con 0x7f22a01e6530 2024-04-18T04:58:11.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.837+0000 7f22a5f77640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a01e6530 0x7f22a00c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.837+0000 7f22967fc640 1 -- 172.21.15.96:0/4191802815 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f229800cc40 con 0x7f22a0156f50 2024-04-18T04:58:11.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.837+0000 7f22967fc640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2284066690 0x7f2284068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.837+0000 7f22967fc640 1 -- 172.21.15.96:0/4191802815 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2298083f60 con 0x7f22a0156f50 2024-04-18T04:58:11.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.837+0000 7f22a5f77640 1 -- 172.21.15.96:0/4191802815 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22a00c7170 con 0x7f22a01e6530 2024-04-18T04:58:11.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.837+0000 7f22a5776640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2284066690 0x7f2284068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.837+0000 7f22a5f77640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a01e6530 0x7f22a00c0ac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22a00cb8a0 tx=0x7f229c01b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:11.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.837+0000 7f22a5776640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2284066690 0x7f2284068b50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f22a00c0a50 tx=0x7f2290007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:11.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.837+0000 7f22967fc640 1 -- 172.21.15.96:0/4191802815 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c003a30 con 0x7f22a01e6530 2024-04-18T04:58:11.841 INFO:tasks.workunit.client.0.smithi096.stdout:0/825: dwrite d16/d1c/d22/d2c/f35 [0,4194304] 0 2024-04-18T04:58:11.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.837+0000 7f22967fc640 1 -- 172.21.15.96:0/4191802815 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f229c006e20 con 0x7f22a01e6530 2024-04-18T04:58:11.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.837+0000 7f22967fc640 1 -- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a01e6530 msgr2=0x7f22a00c0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.837+0000 7f22967fc640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a01e6530 0x7f22a00c0ac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22a00cb8a0 tx=0x7f229c01b9f0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.837+0000 7f22967fc640 1 -- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a01e6530 msgr2=0x7f22a00c0ac0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:11.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.837+0000 7f22967fc640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a01e6530 0x7f22a00c0ac0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.842 INFO:tasks.workunit.client.0.smithi096.stdout:9/950: link d0/de/d17/d2f/d40/dd2/d118/f11d d0/d6b/d89/d112/f12a 0 2024-04-18T04:58:11.844 INFO:tasks.workunit.client.0.smithi096.stdout:4/857: creat d4/d14/d2d/d44/d90/dd0/f109 x:0 0 0 2024-04-18T04:58:11.846 INFO:tasks.workunit.client.0.smithi096.stdout:7/864: write db/f12 [1926175,17834] 0 2024-04-18T04:58:11.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.845+0000 7f22a81db640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a014e4b0 0x7f22a00bf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:11.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.845+0000 7f22a81db640 1 -- 172.21.15.96:0/4191802815 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00c4600 con 0x7f22a014e4b0 2024-04-18T04:58:11.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.845+0000 7f22a5f77640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a014e4b0 0x7f22a00bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:11.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.845+0000 7f22a5f77640 1 -- 172.21.15.96:0/4191802815 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f22a00c6e90 con 0x7f22a014e4b0 2024-04-18T04:58:11.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22a5f77640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a014e4b0 0x7f22a00bf720 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f229c01c880 tx=0x7f229c009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:11.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22967fc640 1 -- 172.21.15.96:0/4191802815 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c0ba820 con 0x7f22a014e4b0 2024-04-18T04:58:11.849 INFO:tasks.workunit.client.0.smithi096.stdout:1/968: link de/d1d/f65 de/d109/df6/f13b 0 2024-04-18T04:58:11.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22967fc640 1 -- 172.21.15.96:0/4191802815 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7f229c0cd440 con 0x7f22a014e4b0 2024-04-18T04:58:11.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22967fc640 1 -- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a014e4b0 msgr2=0x7f22a00bf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22967fc640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a014e4b0 0x7f22a00bf720 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f229c01c880 tx=0x7f229c009190 comp rx=0 tx=0).stop 2024-04-18T04:58:11.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22967fc640 1 -- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a014e4b0 msgr2=0x7f22a00bf720 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:11.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22967fc640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a014e4b0 0x7f22a00bf720 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f229c01c880 tx=0x7f229c009190 comp rx=0 tx=0).stop 2024-04-18T04:58:11.850 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:58:11.850 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:58:11.850 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:58:11.850 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:58:11.850 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 36, 2024-04-18T04:58:11.850 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:58:11.850 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:58:11.850 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:58:11.851 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:58:11.851 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.851 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 16, 2024-04-18T04:58:11.851 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:11.851 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:58:11.851 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:58:11.851 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:11.851 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:11.851 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:11.851 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:11.851 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:11.851 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:11.851 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:11.851 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:11.851 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:11.852 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:11.852 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.852 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:58:11.852 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:58:11.852 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:11.852 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:11.852 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:11.852 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:11.852 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:11.852 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:11.852 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:11.852 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:11.852 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:11.852 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:11.853 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.853 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:58:11.853 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:58:11.853 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:58:11.853 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:58:11.853 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:58:11.853 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:58:11.853 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:11.853 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:11.853 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:58:11.853 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:58:11.853 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:58:11.853 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:58:11.853 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:58:11.854 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:58:11.854 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:58:11.854 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:11.854 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:58:11.854 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:11.854 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:11.854 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:11.854 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:11.854 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:11.854 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:11.854 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:11.855 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:11.855 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:11.855 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:11.855 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.855 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:58:11.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.855 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:58:11.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.855 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:58:11.856 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:58:11.856 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:11.856 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:11.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.856 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:11.856 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:58:11.856 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.856 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:11.856 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:58:11.856 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.856 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.857 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.857 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:58:11.857 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:58:11.857 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:11.857 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:11.857 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:11.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.857 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:58:11.857 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:58:11.857 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:11.857 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:11.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.858 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:11.858 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:58:11.858 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.858 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:11.858 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:58:11.858 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.858 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.858 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.858 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:58:11.859 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:58:11.859 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:11.859 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:11.859 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:11.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.859 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:58:11.859 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:58:11.859 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:11.859 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:11.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.859 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:11.859 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:58:11.859 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.860 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.860 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:11.860 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:58:11.860 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:11.860 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.860 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.860 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:58:11.860 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:58:11.860 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:11.860 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:11.860 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:58:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:58:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:58:11.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.862 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:11.862 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:11.862 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:58:11.862 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.862 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.862 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:58:11.862 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.862 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:11.862 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:11.862 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:58:11.862 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:58:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:58:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:58:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:11.863 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:11.864 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:11.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:11.864 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:58:11.864 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:58:11.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22a81db640 1 -- 172.21.15.96:0/4191802815 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2284066690 msgr2=0x7f2284068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22a81db640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2284066690 0x7f2284068b50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f22a00c0a50 tx=0x7f2290007c10 comp rx=0 tx=0).stop 2024-04-18T04:58:11.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22a6778640 1 -- 172.21.15.96:0/4191802815 reap_dead start 2024-04-18T04:58:11.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22a81db640 1 -- 172.21.15.96:0/4191802815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a0156f50 msgr2=0x7f22a01e5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:11.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22a81db640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a0156f50 0x7f22a01e5ff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f229800b9e0 tx=0x7f229800bea0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22a81db640 1 -- 172.21.15.96:0/4191802815 shutdown_connections 2024-04-18T04:58:11.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22a81db640 1 --2- 172.21.15.96:0/4191802815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22a0156f50 0x7f22a01e5ff0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:11.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22a81db640 1 -- 172.21.15.96:0/4191802815 >> 172.21.15.96:0/4191802815 conn(0x7f22a0069e60 msgr2=0x7f22a014f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:11.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22a81db640 1 -- 172.21.15.96:0/4191802815 shutdown_connections 2024-04-18T04:58:11.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:11.849+0000 7f22a81db640 1 -- 172.21.15.96:0/4191802815 wait complete. 2024-04-18T04:58:11.866 INFO:tasks.workunit.client.0.smithi096.stdout:1/969: fdatasync de/d1d/d32/d9a/fea 0 2024-04-18T04:58:11.866 INFO:tasks.workunit.client.0.smithi096.stdout:0/826: mknod d16/d1c/d22/d2c/cfb 0 2024-04-18T04:58:11.867 INFO:tasks.workunit.client.0.smithi096.stdout:0/827: dread - d16/d1d/fe3 zero size 2024-04-18T04:58:11.867 INFO:tasks.workunit.client.0.smithi096.stdout:9/951: symlink d0/de/d99/l12b 0 2024-04-18T04:58:11.867 INFO:tasks.workunit.client.0.smithi096.stdout:4/858: creat d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/f10a x:0 0 0 2024-04-18T04:58:11.867 INFO:tasks.workunit.client.0.smithi096.stdout:9/952: dwrite d0/de/d17/d56/d6d/ff5 [0,4194304] 0 2024-04-18T04:58:11.869 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:58:11.869 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-04-18T04:58:11.869 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-18T04:58:11.869 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-04-18T04:58:11.869 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-18T04:58:11.870 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-18T04:58:11.870 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:58:11.880 INFO:tasks.workunit.client.0.smithi096.stdout:7/865: rmdir db 39 2024-04-18T04:58:11.884 INFO:tasks.workunit.client.0.smithi096.stdout:1/970: creat de/d1d/d32/d6f/d85/f13c x:0 0 0 2024-04-18T04:58:11.884 INFO:tasks.workunit.client.0.smithi096.stdout:1/971: dread - de/d1d/d32/d6b/f12f zero size 2024-04-18T04:58:11.885 INFO:tasks.ceph.mon.b:Stopped 2024-04-18T04:58:11.885 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-18T04:58:11.886 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:58:11.888 INFO:tasks.workunit.client.0.smithi096.stdout:9/953: fdatasync d0/de/f2d 0 2024-04-18T04:58:11.889 INFO:tasks.workunit.client.0.smithi096.stdout:7/866: dread - db/d1d/d82/f106 zero size 2024-04-18T04:58:11.892 INFO:tasks.workunit.client.0.smithi096.stdout:0/828: rename d16/d1c/d4c/d4d/d5a/c61 to d16/d1d/cfc 0 2024-04-18T04:58:11.893 INFO:tasks.workunit.client.0.smithi096.stdout:4/859: write d4/d14/d2d/d44/d58/d86/d3a/d39/f59 [971448,130295] 0 2024-04-18T04:58:11.895 INFO:tasks.workunit.client.0.smithi096.stdout:1/972: rename de/d1d/fe3 to de/d1d/d32/d73/f13d 0 2024-04-18T04:58:11.896 INFO:tasks.workunit.client.0.smithi096.stdout:7/867: rename db/c64 to db/c10e 0 2024-04-18T04:58:11.897 INFO:tasks.workunit.client.0.smithi096.stdout:0/829: creat d16/d1c/ffd x:0 0 0 2024-04-18T04:58:11.898 INFO:tasks.workunit.client.0.smithi096.stdout:4/860: symlink d4/d14/d2d/d44/d58/d86/d97/l10b 0 2024-04-18T04:58:11.899 INFO:tasks.workunit.client.0.smithi096.stdout:0/830: dread - d16/d1c/ff8 zero size 2024-04-18T04:58:11.900 INFO:tasks.workunit.client.0.smithi096.stdout:7/868: creat db/d1f/d5b/d6a/dc6/f10f x:0 0 0 2024-04-18T04:58:11.900 INFO:tasks.workunit.client.0.smithi096.stdout:9/954: dwrite d0/de/f92 [0,4194304] 0 2024-04-18T04:58:11.901 INFO:tasks.workunit.client.0.smithi096.stdout:4/861: stat d4/d14/d1d/da5/d67 0 2024-04-18T04:58:11.902 INFO:tasks.workunit.client.0.smithi096.stdout:1/973: rmdir de/d1d/d32/d73/d8b/dc2/dcb 0 2024-04-18T04:58:11.905 INFO:tasks.workunit.client.0.smithi096.stdout:0/831: mkdir d16/d55/dfe 0 2024-04-18T04:58:11.906 INFO:tasks.workunit.client.0.smithi096.stdout:0/832: chown d16/d1c/d4c/d6a/ccd 23169 1 2024-04-18T04:58:11.907 INFO:tasks.workunit.client.0.smithi096.stdout:0/833: truncate d16/d1c/d4c/d4d/d36/ff9 911198 0 2024-04-18T04:58:11.908 INFO:tasks.workunit.client.0.smithi096.stdout:1/974: dread de/d109/f10f [0,4194304] 0 2024-04-18T04:58:11.911 INFO:tasks.workunit.client.0.smithi096.stdout:9/955: rmdir d0/de/d17/d56/d59/d60 39 2024-04-18T04:58:11.911 INFO:tasks.workunit.client.0.smithi096.stdout:9/956: readlink d0/de/d17/d2f/lc6 0 2024-04-18T04:58:11.916 INFO:tasks.workunit.client.0.smithi096.stdout:4/862: rename d4/d14/d2d/da6/dc6/dfd to d4/d14/d2d/d44/d58/d86/d3a/df1/d10c 0 2024-04-18T04:58:11.918 INFO:tasks.workunit.client.0.smithi096.stdout:0/834: symlink d16/d1c/d4c/d4d/d5d/de8/lff 0 2024-04-18T04:58:11.921 INFO:tasks.workunit.client.0.smithi096.stdout:1/975: unlink de/d1d/d32/f8e 0 2024-04-18T04:58:11.922 INFO:tasks.workunit.client.0.smithi096.stdout:1/976: stat de/d1d/d32/d73/c7e 0 2024-04-18T04:58:11.925 INFO:tasks.workunit.client.0.smithi096.stdout:4/863: fsync d4/d14/d2d/d44/f5f 0 2024-04-18T04:58:11.929 INFO:tasks.workunit.client.0.smithi096.stdout:7/869: link db/d1d/l32 db/d1f/d24/d61/d77/l110 0 2024-04-18T04:58:11.929 INFO:tasks.workunit.client.0.smithi096.stdout:9/957: write d0/de/d17/fc5 [809503,104389] 0 2024-04-18T04:58:11.930 INFO:tasks.workunit.client.0.smithi096.stdout:1/977: dwrite de/d109/d96/f98 [0,4194304] 0 2024-04-18T04:58:11.931 INFO:tasks.workunit.client.0.smithi096.stdout:1/978: chown de/d1d/d3f/f61 347914 1 2024-04-18T04:58:11.933 INFO:tasks.workunit.client.0.smithi096.stdout:1/979: write de/d1d/d32/d6f/d85/f13c [703215,111483] 0 2024-04-18T04:58:11.933 INFO:tasks.workunit.client.0.smithi096.stdout:9/958: mkdir d0/de/d17/d2f/d40/dc1/d12c 0 2024-04-18T04:58:11.936 INFO:tasks.workunit.client.0.smithi096.stdout:4/864: mknod d4/d14/d2d/d44/d58/d86/d3a/c10d 0 2024-04-18T04:58:11.936 INFO:tasks.workunit.client.0.smithi096.stdout:1/980: write de/d1d/f5d [938258,79275] 0 2024-04-18T04:58:11.937 INFO:tasks.workunit.client.0.smithi096.stdout:7/870: mknod db/d1f/d5b/d6a/dc6/de3/c111 0 2024-04-18T04:58:11.938 INFO:tasks.workunit.client.0.smithi096.stdout:0/835: dread d16/d1c/d4c/d4e/d67/f8b [0,4194304] 0 2024-04-18T04:58:11.940 INFO:tasks.workunit.client.0.smithi096.stdout:4/865: symlink d4/d14/l10e 0 2024-04-18T04:58:11.941 INFO:tasks.workunit.client.0.smithi096.stdout:7/871: chown db/d1f/d39/d6d/d79/d83/fc8 4723 1 2024-04-18T04:58:11.943 INFO:tasks.workunit.client.0.smithi096.stdout:0/836: creat d16/d1c/d4c/d4d/d5d/de8/f100 x:0 0 0 2024-04-18T04:58:11.944 INFO:tasks.workunit.client.0.smithi096.stdout:1/981: creat de/d1d/d3f/d4f/da9/d133/f13e x:0 0 0 2024-04-18T04:58:11.945 INFO:tasks.workunit.client.0.smithi096.stdout:4/866: mkdir d4/d14/d1d/da5/d67/def/d10f 0 2024-04-18T04:58:11.946 INFO:tasks.workunit.client.0.smithi096.stdout:7/872: creat db/d1f/d5b/d6a/d74/f112 x:0 0 0 2024-04-18T04:58:11.946 INFO:tasks.workunit.client.0.smithi096.stdout:0/837: creat d16/d1c/d4c/d6a/f101 x:0 0 0 2024-04-18T04:58:11.947 INFO:tasks.workunit.client.0.smithi096.stdout:7/873: chown db/d1f/d5b/d6a 50319004 1 2024-04-18T04:58:11.947 INFO:tasks.workunit.client.0.smithi096.stdout:4/867: write d4/d14/d2d/d44/d58/d86/d97/fb4 [4054142,11833] 0 2024-04-18T04:58:11.948 INFO:tasks.workunit.client.0.smithi096.stdout:1/982: mknod de/d1d/d3f/d4f/d11d/c13f 0 2024-04-18T04:58:11.948 INFO:tasks.workunit.client.0.smithi096.stdout:9/959: dread d0/d6b/d89/d112/d116/d33/fbf [0,4194304] 0 2024-04-18T04:58:11.948 INFO:tasks.workunit.client.0.smithi096.stdout:0/838: write d16/d1d/fe3 [413498,5162] 0 2024-04-18T04:58:11.951 INFO:tasks.workunit.client.0.smithi096.stdout:7/874: fdatasync db/d1f/d39/d6d/d79/d83/fc8 0 2024-04-18T04:58:11.952 INFO:tasks.workunit.client.0.smithi096.stdout:7/875: write db/dd5/f10a [56911,35151] 0 2024-04-18T04:58:11.957 INFO:tasks.workunit.client.0.smithi096.stdout:7/876: creat db/d1f/d24/d49/d54/dc3/f113 x:0 0 0 2024-04-18T04:58:11.957 INFO:tasks.workunit.client.0.smithi096.stdout:0/839: link d16/d1c/d4c/cc1 d16/d1c/d4c/d4e/d67/c102 0 2024-04-18T04:58:11.959 INFO:tasks.workunit.client.0.smithi096.stdout:4/868: dwrite d4/d14/d2d/d44/d89/f8e [0,4194304] 0 2024-04-18T04:58:11.961 INFO:tasks.workunit.client.0.smithi096.stdout:7/877: read f5 [375752,122006] 0 2024-04-18T04:58:11.963 INFO:tasks.workunit.client.0.smithi096.stdout:7/878: readlink db/d20/d45/lb3 0 2024-04-18T04:58:11.965 INFO:tasks.workunit.client.0.smithi096.stdout:7/879: dread - db/d1f/d24/d49/d54/fd8 zero size 2024-04-18T04:58:11.966 INFO:tasks.workunit.client.0.smithi096.stdout:7/880: chown db/d1f/d5b/d6a/d74/f112 159 1 2024-04-18T04:58:11.974 INFO:tasks.workunit.client.0.smithi096.stdout:7/881: getdents db/d20/d45 0 2024-04-18T04:58:11.974 INFO:tasks.workunit.client.0.smithi096.stdout:4/869: write d4/d14/d2d/d44/d58/d86/d3a/d47/fae [547024,12682] 0 2024-04-18T04:58:11.974 INFO:tasks.workunit.client.0.smithi096.stdout:0/840: write d16/d1c/d4c/d4d/d5a/f6c [1327553,61023] 0 2024-04-18T04:58:11.976 INFO:tasks.workunit.client.0.smithi096.stdout:7/882: chown db/d1f/d39/d6d/d79/d83/lbe 75163181 1 2024-04-18T04:58:11.977 INFO:tasks.workunit.client.0.smithi096.stdout:1/983: dread de/d1d/d81/f10b [0,4194304] 0 2024-04-18T04:58:11.977 INFO:tasks.workunit.client.0.smithi096.stdout:4/870: rmdir d4/d14/d1d 39 2024-04-18T04:58:11.978 INFO:tasks.workunit.client.0.smithi096.stdout:4/871: chown d4/fb1 375213 1 2024-04-18T04:58:11.980 INFO:tasks.workunit.client.0.smithi096.stdout:9/960: dread d0/d52/d5a/f7d [0,4194304] 0 2024-04-18T04:58:11.980 INFO:tasks.workunit.client.0.smithi096.stdout:7/883: mkdir db/d1f/d24/d61/d114 0 2024-04-18T04:58:11.981 INFO:tasks.workunit.client.0.smithi096.stdout:1/984: mkdir de/d1d/d3f/d4f/da9/d139/d140 0 2024-04-18T04:58:11.984 INFO:tasks.workunit.client.0.smithi096.stdout:9/961: mkdir d0/de/d17/d2f/d40/dd2/d113/d12d 0 2024-04-18T04:58:11.985 INFO:tasks.workunit.client.0.smithi096.stdout:9/962: chown d0/de/d99/f120 511024156 1 2024-04-18T04:58:11.986 INFO:tasks.workunit.client.0.smithi096.stdout:4/872: link d4/d14/d2d/d44/d89/lb5 d4/d14/d2d/da6/dc6/dce/ddb/l110 0 2024-04-18T04:58:11.988 INFO:tasks.workunit.client.0.smithi096.stdout:4/873: chown d4/d14/d2d/d44/d58/d86/d3a/d39/d54/l60 1282049 1 2024-04-18T04:58:11.988 INFO:tasks.workunit.client.0.smithi096.stdout:1/985: dread de/d1d/fbf [0,4194304] 0 2024-04-18T04:58:11.988 INFO:tasks.workunit.client.0.smithi096.stdout:9/963: mkdir d0/de/d17/d56/d59/d68/d12e 0 2024-04-18T04:58:11.990 INFO:tasks.workunit.client.0.smithi096.stdout:9/964: write d0/de/d17/d56/d6d/f102 [4457839,87685] 0 2024-04-18T04:58:11.991 INFO:tasks.workunit.client.0.smithi096.stdout:7/884: truncate db/d1f/d5b/d6a/d74/fb9 1599840 0 2024-04-18T04:58:11.993 INFO:tasks.workunit.client.0.smithi096.stdout:7/885: fdatasync db/d20/d45/fa6 0 2024-04-18T04:58:11.994 INFO:tasks.workunit.client.0.smithi096.stdout:0/841: dread d16/d1c/d4c/d4e/fdf [0,4194304] 0 2024-04-18T04:58:12.001 INFO:tasks.workunit.client.0.smithi096.stdout:0/842: creat d16/d1c/d4c/d4d/f103 x:0 0 0 2024-04-18T04:58:12.003 INFO:tasks.workunit.client.0.smithi096.stdout:1/986: dwrite de/d1d/d32/d9a/dad/dd3/fd9 [0,4194304] 0 2024-04-18T04:58:12.003 INFO:tasks.workunit.client.0.smithi096.stdout:4/874: dwrite d4/d14/d2d/d44/d58/d86/d6f/db8/fc4 [0,4194304] 0 2024-04-18T04:58:12.006 INFO:tasks.workunit.client.0.smithi096.stdout:0/843: write d16/d1c/d4c/d4d/d5a/f83 [1382027,109565] 0 2024-04-18T04:58:12.007 INFO:tasks.workunit.client.0.smithi096.stdout:9/965: dwrite d0/d6b/d89/d112/d116/d33/f10a [0,4194304] 0 2024-04-18T04:58:12.012 INFO:tasks.workunit.client.0.smithi096.stdout:9/966: fsync d0/de/d17/d56/d6d/ff5 0 2024-04-18T04:58:12.012 INFO:tasks.workunit.client.0.smithi096.stdout:0/844: fdatasync d16/d1c/d4c/d4e/d67/fab 0 2024-04-18T04:58:12.014 INFO:tasks.workunit.client.0.smithi096.stdout:4/875: mkdir d4/d14/d2d/da6/d111 0 2024-04-18T04:58:12.015 INFO:tasks.workunit.client.0.smithi096.stdout:9/967: mkdir d0/d41/d12f 0 2024-04-18T04:58:12.016 INFO:tasks.workunit.client.0.smithi096.stdout:0/845: dread d16/d1c/d4c/d4e/fd9 [0,4194304] 0 2024-04-18T04:58:12.017 INFO:tasks.workunit.client.0.smithi096.stdout:0/846: stat d16/d1c/d4c/d6a/fad 0 2024-04-18T04:58:12.018 INFO:tasks.workunit.client.0.smithi096.stdout:9/968: unlink d0/de/d17/d56/cf8 0 2024-04-18T04:58:12.019 INFO:tasks.workunit.client.0.smithi096.stdout:0/847: stat d16/d1c/d4c/d4d/lb2 0 2024-04-18T04:58:12.019 INFO:tasks.workunit.client.0.smithi096.stdout:4/876: mknod d4/d14/d1d/da5/d8c/c112 0 2024-04-18T04:58:12.021 INFO:tasks.workunit.client.0.smithi096.stdout:4/877: dread - d4/d14/d16/f105 zero size 2024-04-18T04:58:12.021 INFO:tasks.workunit.client.0.smithi096.stdout:1/987: dread de/d7b/f88 [0,4194304] 0 2024-04-18T04:58:12.023 INFO:tasks.workunit.client.0.smithi096.stdout:9/969: dread d0/de/d17/fc5 [0,4194304] 0 2024-04-18T04:58:12.024 INFO:tasks.workunit.client.0.smithi096.stdout:9/970: stat d0/fcb 0 2024-04-18T04:58:12.026 INFO:tasks.workunit.client.0.smithi096.stdout:1/988: mkdir de/d109/d96/d141 0 2024-04-18T04:58:12.026 INFO:tasks.workunit.client.0.smithi096.stdout:9/971: chown d0/d41/c46 525 1 2024-04-18T04:58:12.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe58b0eb640 1 Processor -- start 2024-04-18T04:58:12.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe58b0eb640 1 -- start start 2024-04-18T04:58:12.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe58b0eb640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe584150dd0 0x7fe584156db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:12.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe58b0eb640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe5840cbd30 0x7fe5841572f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:12.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe58b0eb640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5841511b0 con 0x7fe58406e960 2024-04-18T04:58:12.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe58b0eb640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5840c9ac0 con 0x7fe5840cbd30 2024-04-18T04:58:12.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe58b0eb640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5840722f0 con 0x7fe584150dd0 2024-04-18T04:58:12.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe588e87640 1 -- >> v2:172.21.15.139:3300/0 conn(0x7fe584150dd0 msgr2=0x7fe584156db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:58:12.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe589688640 1 -- >> v1:172.21.15.139:6789/0 conn(0x7fe58406e960 legacy=0x7fe58406ed70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:58:12.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe588e87640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe584150dd0 0x7fe584156db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:58:12.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe583fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe5840cbd30 0x7fe5841572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:12.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe583fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe5840cbd30 0x7fe5841572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47494/0 (socket says 172.21.15.96:47494) 2024-04-18T04:58:12.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe583fff640 1 -- 172.21.15.96:0/3784820723 learned_addr learned my addr 172.21.15.96:0/3784820723 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:12.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe583fff640 1 -- 172.21.15.96:0/3784820723 >> v2:172.21.15.139:3300/0 conn(0x7fe584150dd0 msgr2=0x7fe584156db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:58:12.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe583fff640 1 --2- 172.21.15.96:0/3784820723 >> v2:172.21.15.139:3300/0 conn(0x7fe584150dd0 0x7fe584156db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:12.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe583fff640 1 -- 172.21.15.96:0/3784820723 >> v1:172.21.15.139:6789/0 conn(0x7fe58406e960 legacy=0x7fe58406ed70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:58:12.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.029+0000 7fe583fff640 1 -- 172.21.15.96:0/3784820723 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe584071d70 con 0x7fe5840cbd30 2024-04-18T04:58:12.033 INFO:tasks.workunit.client.0.smithi096.stdout:4/878: write d4/d14/d2d/d44/fa3 [1013943,120251] 0 2024-04-18T04:58:12.033 INFO:tasks.workunit.client.0.smithi096.stdout:1/989: write de/f5e [4761570,104398] 0 2024-04-18T04:58:12.033 INFO:tasks.workunit.client.0.smithi096.stdout:4/879: fdatasync d4/d14/d2d/d44/d90/fdd 0 2024-04-18T04:58:12.034 INFO:tasks.workunit.client.0.smithi096.stdout:0/848: dread d16/d55/fe1 [4194304,4194304] 0 2024-04-18T04:58:12.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.033+0000 7fe583fff640 1 --2- 172.21.15.96:0/3784820723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5840cbd30 0x7fe5841572f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe5840cb570 tx=0x7fe57001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26632f3bda08c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:12.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.033+0000 7fe5837fe640 1 -- 172.21.15.96:0/3784820723 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5700a89f0 con 0x7fe5840cbd30 2024-04-18T04:58:12.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.033+0000 7fe5837fe640 1 -- 172.21.15.96:0/3784820723 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5700a8b50 con 0x7fe5840cbd30 2024-04-18T04:58:12.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.033+0000 7fe5837fe640 1 -- 172.21.15.96:0/3784820723 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5700b0440 con 0x7fe5840cbd30 2024-04-18T04:58:12.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.033+0000 7fe58b0eb640 1 -- 172.21.15.96:0/3784820723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5840cbd30 msgr2=0x7fe5841572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:12.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.033+0000 7fe58b0eb640 1 --2- 172.21.15.96:0/3784820723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5840cbd30 0x7fe5841572f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe5840cb570 tx=0x7fe57001ecf0 comp rx=0 tx=0).stop 2024-04-18T04:58:12.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.033+0000 7fe58b0eb640 1 -- 172.21.15.96:0/3784820723 shutdown_connections 2024-04-18T04:58:12.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.033+0000 7fe58b0eb640 1 --2- 172.21.15.96:0/3784820723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5840cbd30 0x7fe5841572f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:12.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.033+0000 7fe58b0eb640 1 --2- 172.21.15.96:0/3784820723 >> v2:172.21.15.139:3300/0 conn(0x7fe584150dd0 0x7fe584156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:12.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.033+0000 7fe58b0eb640 1 -- 172.21.15.96:0/3784820723 >> 172.21.15.96:0/3784820723 conn(0x7fe58406af70 msgr2=0x7fe58406b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:12.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.033+0000 7fe58b0eb640 1 -- 172.21.15.96:0/3784820723 shutdown_connections 2024-04-18T04:58:12.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.033+0000 7fe58b0eb640 1 -- 172.21.15.96:0/3784820723 wait complete. 2024-04-18T04:58:12.037 INFO:tasks.workunit.client.0.smithi096.stdout:4/880: dread - d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/fa4 zero size 2024-04-18T04:58:12.037 INFO:tasks.workunit.client.0.smithi096.stdout:1/990: rename de/d1d/d32/d8c to de/d1d/d32/d73/d8b/d142 0 2024-04-18T04:58:12.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe58b0eb640 1 Processor -- start 2024-04-18T04:58:12.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe58b0eb640 1 -- start start 2024-04-18T04:58:12.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe58b0eb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe58406e960 0x7fe5841441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:12.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe58b0eb640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5840cbd30 0x7fe584159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:12.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe58b0eb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe584150dd0 0x7fe58415a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:12.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe58b0eb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5841e0980 con 0x7fe584150dd0 2024-04-18T04:58:12.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe58b0eb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe584144700 con 0x7fe58406e960 2024-04-18T04:58:12.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe58b0eb640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe584151b50 con 0x7fe5840cbd30 2024-04-18T04:58:12.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe588e87640 1 -- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe58406e960 msgr2=0x7fe5841441c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:58:12.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe588e87640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe58406e960 0x7fe5841441c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:58:12.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe589688640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe584150dd0 0x7fe58415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:12.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe583fff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5840cbd30 0x7fe584159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:12.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe589688640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe584150dd0 0x7fe58415a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47508/0 (socket says 172.21.15.96:47508) 2024-04-18T04:58:12.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe589688640 1 -- 172.21.15.96:0/3261541852 learned_addr learned my addr 172.21.15.96:0/3261541852 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:12.039 INFO:tasks.workunit.client.0.smithi096.stdout:1/991: dread - de/d1d/d32/d9a/dad/dd3/f136 zero size 2024-04-18T04:58:12.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe583fff640 1 -- 172.21.15.96:0/3261541852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe58406e960 msgr2=0x7fe5841441c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:58:12.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe583fff640 1 --2- 172.21.15.96:0/3261541852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe58406e960 0x7fe5841441c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:12.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe583fff640 1 -- 172.21.15.96:0/3261541852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe584150dd0 msgr2=0x7fe58415a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:12.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe583fff640 1 --2- 172.21.15.96:0/3261541852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe584150dd0 0x7fe58415a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:12.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe583fff640 1 -- 172.21.15.96:0/3261541852 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5700094d0 con 0x7fe5840cbd30 2024-04-18T04:58:12.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe589688640 1 --2- 172.21.15.96:0/3261541852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe584150dd0 0x7fe58415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:58:12.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe583fff640 1 --2- 172.21.15.96:0/3261541852 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5840cbd30 0x7fe584159360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe5700af000 tx=0x7fe57001ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:12.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe5817fa640 1 -- 172.21.15.96:0/3261541852 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5700bf070 con 0x7fe5840cbd30 2024-04-18T04:58:12.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe5817fa640 1 -- 172.21.15.96:0/3261541852 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5700b0c60 con 0x7fe5840cbd30 2024-04-18T04:58:12.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe58b0eb640 1 -- 172.21.15.96:0/3261541852 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe584151e10 con 0x7fe5840cbd30 2024-04-18T04:58:12.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe5817fa640 1 -- 172.21.15.96:0/3261541852 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5700bb470 con 0x7fe5840cbd30 2024-04-18T04:58:12.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.037+0000 7fe58b0eb640 1 -- 172.21.15.96:0/3261541852 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe584158880 con 0x7fe5840cbd30 2024-04-18T04:58:12.041 INFO:tasks.workunit.client.0.smithi096.stdout:4/881: read d4/d14/d2d/d44/f5d [3862872,118420] 0 2024-04-18T04:58:12.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.041+0000 7fe58b0eb640 1 -- 172.21.15.96:0/3261541852 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe584067050 con 0x7fe5840cbd30 2024-04-18T04:58:12.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.041+0000 7fe5817fa640 1 -- 172.21.15.96:0/3261541852 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe5700b7070 con 0x7fe5840cbd30 2024-04-18T04:58:12.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.041+0000 7fe5817fa640 1 --2- 172.21.15.96:0/3261541852 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe568066670 0x7fe568068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:12.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.041+0000 7fe5817fa640 1 -- 172.21.15.96:0/3261541852 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe570121cd0 con 0x7fe5840cbd30 2024-04-18T04:58:12.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.041+0000 7fe588e87640 1 --2- 172.21.15.96:0/3261541852 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe568066670 0x7fe568068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:12.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.041+0000 7fe588e87640 1 --2- 172.21.15.96:0/3261541852 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe568066670 0x7fe568068b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe58406dfe0 tx=0x7fe578006d90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:12.044 INFO:tasks.workunit.client.0.smithi096.stdout:0/849: dread d16/d1c/d4c/d6a/da3/fed [0,4194304] 0 2024-04-18T04:58:12.044 INFO:tasks.workunit.client.0.smithi096.stdout:4/882: link d4/d14/d2d/d44/d58/d86/fe2 d4/d14/d2d/da6/dc6/de0/f113 0 2024-04-18T04:58:12.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.045+0000 7fe5817fa640 1 -- 172.21.15.96:0/3261541852 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe5700ef030 con 0x7fe5840cbd30 2024-04-18T04:58:12.047 INFO:tasks.workunit.client.0.smithi096.stdout:1/992: dwrite de/d109/d96/f98 [0,4194304] 0 2024-04-18T04:58:12.047 INFO:tasks.workunit.client.0.smithi096.stdout:0/850: symlink d16/d1c/d4c/d4d/d36/l104 0 2024-04-18T04:58:12.047 INFO:tasks.workunit.client.0.smithi096.stdout:4/883: chown d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/f96 5 1 2024-04-18T04:58:12.048 INFO:tasks.workunit.client.0.smithi096.stdout:1/993: chown de/d1d/d32/d6b/ccd 28338030 1 2024-04-18T04:58:12.051 INFO:tasks.workunit.client.0.smithi096.stdout:0/851: truncate d16/d1c/d4c/d4d/d5d/dc6/fe9 806527 0 2024-04-18T04:58:12.051 INFO:tasks.workunit.client.0.smithi096.stdout:4/884: mknod d4/d14/d2d/da6/dc6/de0/c114 0 2024-04-18T04:58:12.052 INFO:tasks.workunit.client.0.smithi096.stdout:1/994: mknod de/d1d/d81/c143 0 2024-04-18T04:58:12.054 INFO:tasks.workunit.client.0.smithi096.stdout:0/852: creat d16/d1c/d4c/d6a/da3/f105 x:0 0 0 2024-04-18T04:58:12.055 INFO:tasks.workunit.client.0.smithi096.stdout:1/995: creat de/d1d/d32/d73/d8b/dc2/f144 x:0 0 0 2024-04-18T04:58:12.056 INFO:tasks.workunit.client.0.smithi096.stdout:0/853: symlink d16/d1c/d4c/d4d/d5a/l106 0 2024-04-18T04:58:12.058 INFO:tasks.workunit.client.0.smithi096.stdout:0/854: write d16/d1c/f88 [526641,75340] 0 2024-04-18T04:58:12.059 INFO:tasks.workunit.client.0.smithi096.stdout:4/885: dwrite d4/d14/d2d/d44/d58/d86/d3a/d39/f56 [0,4194304] 0 2024-04-18T04:58:12.066 INFO:tasks.workunit.client.0.smithi096.stdout:1/996: truncate de/d1d/f66 1681911 0 2024-04-18T04:58:12.067 INFO:tasks.workunit.client.0.smithi096.stdout:4/886: link d4/d14/d2d/d44/d58/d86/f76 d4/d14/d2d/d44/d58/d86/d3a/d39/d54/d100/f115 0 2024-04-18T04:58:12.068 INFO:tasks.workunit.client.0.smithi096.stdout:1/997: mknod de/c145 0 2024-04-18T04:58:12.069 INFO:tasks.workunit.client.0.smithi096.stdout:0/855: dwrite d16/d55/fe1 [4194304,4194304] 0 2024-04-18T04:58:12.072 INFO:tasks.workunit.client.0.smithi096.stdout:4/887: creat d4/d14/d2d/d44/da2/db2/f116 x:0 0 0 2024-04-18T04:58:12.073 INFO:tasks.workunit.client.0.smithi096.stdout:1/998: unlink de/d1d/d32/d9a/d11a/lef 0 2024-04-18T04:58:12.073 INFO:tasks.workunit.client.0.smithi096.stdout:4/888: write d4/d14/d2d/d44/d90/fda [813436,119385] 0 2024-04-18T04:58:12.074 INFO:tasks.workunit.client.0.smithi096.stdout:0/856: creat d16/d1d/d3b/f107 x:0 0 0 2024-04-18T04:58:12.074 INFO:tasks.workunit.client.0.smithi096.stdout:1/999: chown de/d1d/d32/d73/fcc 614062308 1 2024-04-18T04:58:12.083 INFO:tasks.workunit.client.0.smithi096.stdout:4/889: dwrite d4/d14/d1d/da5/d67/def/f107 [0,4194304] 0 2024-04-18T04:58:12.083 INFO:tasks.workunit.client.0.smithi096.stdout:0/857: dwrite d16/d1c/d4c/d4d/d36/ff9 [0,4194304] 0 2024-04-18T04:58:12.086 INFO:tasks.workunit.client.0.smithi096.stdout:0/858: write d16/d1c/d4c/d4d/d5d/f63 [4126382,115956] 0 2024-04-18T04:58:12.087 INFO:tasks.workunit.client.0.smithi096.stdout:4/890: mknod d4/d14/d2d/d44/d89/c117 0 2024-04-18T04:58:12.090 INFO:tasks.workunit.client.0.smithi096.stdout:4/891: symlink d4/d7a/l118 0 2024-04-18T04:58:12.096 INFO:tasks.workunit.client.0.smithi096.stdout:0/859: rename d16/d1d/d3b/fa9 to d16/d1c/d4c/d4d/f108 0 2024-04-18T04:58:12.096 INFO:tasks.workunit.client.0.smithi096.stdout:0/860: fdatasync d16/d1c/d4c/d4d/f103 0 2024-04-18T04:58:12.098 INFO:tasks.workunit.client.0.smithi096.stdout:8/805: sync 2024-04-18T04:58:12.099 INFO:tasks.workunit.client.0.smithi096.stdout:4/892: link d4/d14/d2d/d44/d58/d86/d3a/d39/d54/f91 d4/d14/d2d/f119 0 2024-04-18T04:58:12.103 INFO:tasks.workunit.client.0.smithi096.stdout:0/861: unlink d16/d1c/d4c/d4e/f9d 0 2024-04-18T04:58:12.105 INFO:tasks.workunit.client.0.smithi096.stdout:4/893: mknod d4/d14/d2d/d44/dcb/dd1/c11a 0 2024-04-18T04:58:12.107 INFO:tasks.workunit.client.0.smithi096.stdout:0/862: link d16/d1c/d4c/d4d/d36/f9b d16/d1d/d3b/dc3/f109 0 2024-04-18T04:58:12.108 INFO:tasks.workunit.client.0.smithi096.stdout:4/894: creat d4/d14/d2d/d44/d58/d86/d3a/d39/d54/f11b x:0 0 0 2024-04-18T04:58:12.108 INFO:tasks.workunit.client.0.smithi096.stdout:8/806: link d0/d15/d65/d8f/db6/cd1 d0/d7/d86/d91/d93/dec/c109 0 2024-04-18T04:58:12.109 INFO:tasks.workunit.client.0.smithi096.stdout:0/863: symlink d16/d1c/l10a 0 2024-04-18T04:58:12.110 INFO:tasks.workunit.client.0.smithi096.stdout:4/895: mknod d4/d14/d2d/d44/d63/c11c 0 2024-04-18T04:58:12.110 INFO:tasks.workunit.client.0.smithi096.stdout:0/864: write d16/d1c/f29 [4301545,21235] 0 2024-04-18T04:58:12.111 INFO:tasks.workunit.client.0.smithi096.stdout:4/896: chown d4/f18 14429082 1 2024-04-18T04:58:12.112 INFO:tasks.workunit.client.0.smithi096.stdout:4/897: write d4/d14/d2d/d44/d58/fe8 [37592,66325] 0 2024-04-18T04:58:12.116 INFO:tasks.workunit.client.0.smithi096.stdout:4/898: symlink d4/d14/d1d/da5/l11d 0 2024-04-18T04:58:12.117 INFO:tasks.workunit.client.0.smithi096.stdout:0/865: dwrite d16/f96 [0,4194304] 0 2024-04-18T04:58:12.119 INFO:tasks.workunit.client.0.smithi096.stdout:0/866: chown d16/d1c/d4c/d4d/d5d/d91/leb 44 1 2024-04-18T04:58:12.120 INFO:tasks.workunit.client.0.smithi096.stdout:0/867: dread - d16/d1d/d3b/f107 zero size 2024-04-18T04:58:12.121 INFO:tasks.workunit.client.0.smithi096.stdout:4/899: symlink d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/l11e 0 2024-04-18T04:58:12.123 INFO:tasks.workunit.client.0.smithi096.stdout:4/900: fdatasync d4/d14/d1d/f25 0 2024-04-18T04:58:12.130 INFO:tasks.workunit.client.0.smithi096.stdout:8/807: truncate d0/d3/f6c 2198075 0 2024-04-18T04:58:12.130 INFO:tasks.workunit.client.0.smithi096.stdout:8/808: unlink d0/d7/d24/d78/f56 0 2024-04-18T04:58:12.130 INFO:tasks.workunit.client.0.smithi096.stdout:0/868: truncate d16/d55/fa7 329634 0 2024-04-18T04:58:12.132 INFO:tasks.workunit.client.0.smithi096.stdout:0/869: symlink d16/d1c/d22/l10b 0 2024-04-18T04:58:12.132 INFO:tasks.workunit.client.0.smithi096.stdout:8/809: truncate d0/d7/d24/d18/d7c/dad/de2/f108 674446 0 2024-04-18T04:58:12.135 INFO:tasks.workunit.client.0.smithi096.stdout:8/810: mknod d0/d15/d65/d8f/db6/c10a 0 2024-04-18T04:58:12.135 INFO:tasks.workunit.client.0.smithi096.stdout:5/947: sync 2024-04-18T04:58:12.135 INFO:tasks.workunit.client.0.smithi096.stdout:4/901: dwrite d4/d14/d2d/d44/d58/d86/f3b [4194304,4194304] 0 2024-04-18T04:58:12.136 INFO:tasks.workunit.client.0.smithi096.stdout:5/948: dread - d7/dd/d8f/d5e/f13a zero size 2024-04-18T04:58:12.137 INFO:tasks.workunit.client.0.smithi096.stdout:5/949: write d7/d25/d2b/fae [3527378,43261] 0 2024-04-18T04:58:12.141 INFO:tasks.workunit.client.0.smithi096.stdout:8/811: symlink d0/d15/l10b 0 2024-04-18T04:58:12.144 INFO:tasks.workunit.client.0.smithi096.stdout:0/870: dwrite d16/d1c/d4c/d4d/d5a/f70 [0,4194304] 0 2024-04-18T04:58:12.147 INFO:tasks.workunit.client.0.smithi096.stdout:5/950: mkdir d7/d25/d2b/d14d 0 2024-04-18T04:58:12.147 INFO:tasks.workunit.client.0.smithi096.stdout:8/812: write d0/d3/d32/fcb [825987,101541] 0 2024-04-18T04:58:12.153 INFO:tasks.workunit.client.0.smithi096.stdout:0/871: chown d16/d1c/d22/db8/lf6 60 1 2024-04-18T04:58:12.153 INFO:tasks.workunit.client.0.smithi096.stdout:8/813: creat d0/d3/d32/d6b/d7b/f10c x:0 0 0 2024-04-18T04:58:12.153 INFO:tasks.workunit.client.0.smithi096.stdout:0/872: mkdir d16/d1c/d4c/d10c 0 2024-04-18T04:58:12.154 INFO:tasks.workunit.client.0.smithi096.stdout:8/814: write d0/f55 [5141344,85082] 0 2024-04-18T04:58:12.154 INFO:tasks.workunit.client.0.smithi096.stdout:4/902: truncate d4/d14/d2d/da6/dc6/dce/fd8 6698295 0 2024-04-18T04:58:12.154 INFO:tasks.workunit.client.0.smithi096.stdout:5/951: dread d7/d25/f27 [0,4194304] 0 2024-04-18T04:58:12.155 INFO:tasks.workunit.client.0.smithi096.stdout:0/873: fsync d16/d1c/d22/d2c/f30 0 2024-04-18T04:58:12.156 INFO:tasks.workunit.client.0.smithi096.stdout:5/952: mknod d7/d3b/d110/c14e 0 2024-04-18T04:58:12.157 INFO:tasks.workunit.client.0.smithi096.stdout:4/903: mkdir d4/d14/d1d/da5/d11f 0 2024-04-18T04:58:12.158 INFO:tasks.workunit.client.0.smithi096.stdout:4/904: stat d4/d14/d2d/d44/d90/l9a 0 2024-04-18T04:58:12.159 INFO:tasks.workunit.client.0.smithi096.stdout:8/815: creat d0/f10d x:0 0 0 2024-04-18T04:58:12.160 INFO:tasks.workunit.client.0.smithi096.stdout:4/905: write d4/d14/d2d/d44/d58/d86/d3a/d39/fab [603949,41360] 0 2024-04-18T04:58:12.161 INFO:tasks.workunit.client.0.smithi096.stdout:5/953: creat d7/f14f x:0 0 0 2024-04-18T04:58:12.162 INFO:tasks.workunit.client.0.smithi096.stdout:4/906: chown d4/d14/d2d/d44/d58/d86/d3a/df1 57345 1 2024-04-18T04:58:12.163 INFO:tasks.workunit.client.0.smithi096.stdout:4/907: stat d4/d14/d2d/d44/da2/fc9 0 2024-04-18T04:58:12.164 INFO:tasks.workunit.client.0.smithi096.stdout:5/954: read d7/ff [2762501,36038] 0 2024-04-18T04:58:12.167 INFO:tasks.workunit.client.0.smithi096.stdout:5/955: rename d7/d3b/da9/fec to d7/da3/d9a/d10c/f150 0 2024-04-18T04:58:12.168 INFO:tasks.workunit.client.0.smithi096.stdout:5/956: write d7/da3/d11f/d12b/fc6 [371079,22147] 0 2024-04-18T04:58:12.170 INFO:tasks.workunit.client.0.smithi096.stdout:5/957: write d7/d25/f91 [2914910,66348] 0 2024-04-18T04:58:12.170 INFO:tasks.workunit.client.0.smithi096.stdout:0/874: dread d16/f2b [0,4194304] 0 2024-04-18T04:58:12.172 INFO:tasks.workunit.client.0.smithi096.stdout:5/958: rmdir d7/d25/d7c/df1 39 2024-04-18T04:58:12.173 INFO:tasks.workunit.client.0.smithi096.stdout:4/908: link d4/c1b d4/d14/d2d/d44/d58/d86/d97/c120 0 2024-04-18T04:58:12.179 INFO:tasks.workunit.client.0.smithi096.stdout:4/909: mknod d4/d14/d1d/da5/d67/c121 0 2024-04-18T04:58:12.179 INFO:tasks.workunit.client.0.smithi096.stdout:0/875: getdents d16/d1c/d4c/d10c 0 2024-04-18T04:58:12.181 INFO:tasks.workunit.client.0.smithi096.stdout:5/959: mknod d7/dd/d8f/da2/de2/c151 0 2024-04-18T04:58:12.183 INFO:tasks.workunit.client.0.smithi096.stdout:0/876: symlink d16/d1c/d4c/d4d/d36/l10d 0 2024-04-18T04:58:12.186 INFO:tasks.workunit.client.0.smithi096.stdout:5/960: mknod d7/dcd/c152 0 2024-04-18T04:58:12.188 INFO:tasks.workunit.client.0.smithi096.stdout:4/910: rename d4/d14/d2d/d44/d90/dd0 to d4/d14/d2d/d44/d58/d122 0 2024-04-18T04:58:12.189 INFO:tasks.workunit.client.0.smithi096.stdout:8/816: dwrite d0/d7/d24/f3d [0,4194304] 0 2024-04-18T04:58:12.191 INFO:tasks.workunit.client.0.smithi096.stdout:0/877: dwrite d16/fca [0,4194304] 0 2024-04-18T04:58:12.192 INFO:tasks.workunit.client.0.smithi096.stdout:4/911: stat d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/fa4 0 2024-04-18T04:58:12.198 INFO:tasks.workunit.client.0.smithi096.stdout:4/912: stat d4/d14/c42 0 2024-04-18T04:58:12.198 INFO:tasks.workunit.client.0.smithi096.stdout:0/878: read d16/d1c/d4c/d4e/d67/f8b [1094429,26866] 0 2024-04-18T04:58:12.198 INFO:tasks.workunit.client.0.smithi096.stdout:0/879: chown d16/f42 6 1 2024-04-18T04:58:12.199 INFO:tasks.workunit.client.0.smithi096.stdout:5/961: mknod d7/d25/d30/d9e/dc3/d120/d144/c153 0 2024-04-18T04:58:12.201 INFO:tasks.workunit.client.0.smithi096.stdout:5/962: chown d7/dd/d8f/da2/de2/de3/d52/f122 6 1 2024-04-18T04:58:12.202 INFO:tasks.workunit.client.0.smithi096.stdout:4/913: truncate d4/d14/f6a 3613546 0 2024-04-18T04:58:12.205 INFO:tasks.workunit.client.0.smithi096.stdout:0/880: dwrite d16/d1c/f3c [0,4194304] 0 2024-04-18T04:58:12.210 INFO:tasks.workunit.client.0.smithi096.stdout:0/881: dread d16/d1c/d22/fbe [0,4194304] 0 2024-04-18T04:58:12.212 INFO:tasks.workunit.client.0.smithi096.stdout:0/882: write d16/d1d/fe3 [798528,31973] 0 2024-04-18T04:58:12.213 INFO:tasks.workunit.client.0.smithi096.stdout:0/883: chown d16/d55/c9f 1463 1 2024-04-18T04:58:12.223 INFO:tasks.workunit.client.0.smithi096.stdout:8/817: dread d0/d3/d32/fb4 [0,4194304] 0 2024-04-18T04:58:12.262 INFO:tasks.workunit.client.0.smithi096.stdout:8/818: creat d0/d3/d32/d6b/d7b/dc9/f10e x:0 0 0 2024-04-18T04:58:12.266 INFO:tasks.workunit.client.0.smithi096.stdout:8/819: mknod d0/d7/d24/d35/c10f 0 2024-04-18T04:58:12.267 INFO:tasks.workunit.client.0.smithi096.stdout:4/914: getdents d4/d14/d2d/d44/d58/d86/d3a/d39/d54/dd9 0 2024-04-18T04:58:12.268 INFO:tasks.workunit.client.0.smithi096.stdout:0/884: dwrite d16/f42 [4194304,4194304] 0 2024-04-18T04:58:12.270 INFO:tasks.workunit.client.0.smithi096.stdout:8/820: fsync d0/d7/f50 0 2024-04-18T04:58:12.273 INFO:tasks.workunit.client.0.smithi096.stdout:0/885: symlink d16/d1c/d4c/d4e/d67/l10e 0 2024-04-18T04:58:12.283 INFO:tasks.workunit.client.0.smithi096.stdout:5/963: creat d7/dd/d35/f154 x:0 0 0 2024-04-18T04:58:12.296 INFO:tasks.workunit.client.0.smithi096.stdout:5/964: dread d7/d25/d7c/fa6 [0,4194304] 0 2024-04-18T04:58:12.298 INFO:tasks.workunit.client.0.smithi096.stdout:5/965: fsync d7/f1a 0 2024-04-18T04:58:12.299 INFO:tasks.workunit.client.0.smithi096.stdout:5/966: stat d7/dd/d8f/da2/de2 0 2024-04-18T04:58:12.300 INFO:tasks.workunit.client.0.smithi096.stdout:5/967: read d7/d3b/f106 [569480,122570] 0 2024-04-18T04:58:12.302 INFO:tasks.workunit.client.0.smithi096.stdout:5/968: creat d7/d25/d30/d9e/f155 x:0 0 0 2024-04-18T04:58:12.305 INFO:tasks.workunit.client.0.smithi096.stdout:5/969: creat d7/d142/f156 x:0 0 0 2024-04-18T04:58:12.317 INFO:tasks.workunit.client.0.smithi096.stdout:8/821: rmdir d0 39 2024-04-18T04:58:12.326 INFO:tasks.workunit.client.0.smithi096.stdout:0/886: link d16/d78/ff0 d16/d1c/d4c/f10f 0 2024-04-18T04:58:12.328 INFO:tasks.workunit.client.0.smithi096.stdout:0/887: mknod d16/d1c/d4c/d4d/d5d/de8/c110 0 2024-04-18T04:58:12.330 INFO:tasks.workunit.client.0.smithi096.stdout:5/970: dread d7/d25/d2b/f45 [0,4194304] 0 2024-04-18T04:58:12.331 INFO:tasks.workunit.client.0.smithi096.stdout:0/888: truncate d16/d1c/d22/d2c/f30 5961226 0 2024-04-18T04:58:12.337 INFO:tasks.workunit.client.0.smithi096.stdout:4/915: rename d4/c84 to d4/d14/d1d/c123 0 2024-04-18T04:58:12.338 INFO:tasks.workunit.client.0.smithi096.stdout:8/822: creat d0/d3/f110 x:0 0 0 2024-04-18T04:58:12.339 INFO:tasks.workunit.client.0.smithi096.stdout:4/916: fsync d4/d14/d2d/d44/f5d 0 2024-04-18T04:58:12.340 INFO:tasks.workunit.client.0.smithi096.stdout:4/917: write d4/d14/d2d/d44/d58/d86/dff/f108 [41534,38683] 0 2024-04-18T04:58:12.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.341+0000 7fe58b0eb640 1 -- 172.21.15.96:0/3261541852 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe5841e3f20 con 0x7fe5840cbd30 2024-04-18T04:58:12.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.341+0000 7fe5817fa640 1 -- 172.21.15.96:0/3261541852 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fe5700b5620 con 0x7fe5840cbd30 2024-04-18T04:58:12.341 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:58:12.342 INFO:tasks.workunit.client.0.smithi096.stdout:8/823: truncate d0/d7/f2a 1456302 0 2024-04-18T04:58:12.344 INFO:tasks.workunit.client.0.smithi096.stdout:5/971: write d7/da3/d9a/fa5 [2828135,94112] 0 2024-04-18T04:58:12.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.345+0000 7fe58b0eb640 1 -- 172.21.15.96:0/3261541852 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe568066670 msgr2=0x7fe568068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:12.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.345+0000 7fe58b0eb640 1 --2- 172.21.15.96:0/3261541852 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe568066670 0x7fe568068b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe58406dfe0 tx=0x7fe578006d90 comp rx=0 tx=0).stop 2024-04-18T04:58:12.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.345+0000 7fe58b0eb640 1 -- 172.21.15.96:0/3261541852 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5840cbd30 msgr2=0x7fe584159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:12.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.345+0000 7fe58b0eb640 1 --2- 172.21.15.96:0/3261541852 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5840cbd30 0x7fe584159360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe5700af000 tx=0x7fe57001ba90 comp rx=0 tx=0).stop 2024-04-18T04:58:12.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.345+0000 7fe58b0eb640 1 -- 172.21.15.96:0/3261541852 shutdown_connections 2024-04-18T04:58:12.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.345+0000 7fe58b0eb640 1 --2- 172.21.15.96:0/3261541852 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe568066670 0x7fe568068b30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:12.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.345+0000 7fe58b0eb640 1 --2- 172.21.15.96:0/3261541852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe584150dd0 0x7fe58415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:12.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.345+0000 7fe58b0eb640 1 --2- 172.21.15.96:0/3261541852 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5840cbd30 0x7fe584159360 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:12.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.345+0000 7fe58b0eb640 1 --2- 172.21.15.96:0/3261541852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe58406e960 0x7fe5841441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:12.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.345+0000 7fe58b0eb640 1 -- 172.21.15.96:0/3261541852 >> 172.21.15.96:0/3261541852 conn(0x7fe58406af70 msgr2=0x7fe584155ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:12.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.345+0000 7fe58b0eb640 1 -- 172.21.15.96:0/3261541852 shutdown_connections 2024-04-18T04:58:12.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:12.345+0000 7fe58b0eb640 1 -- 172.21.15.96:0/3261541852 wait complete. 2024-04-18T04:58:12.351 INFO:tasks.workunit.client.0.smithi096.stdout:8/824: truncate d0/d7/d24/d18/d5d/f83 1177003 0 2024-04-18T04:58:12.352 INFO:tasks.workunit.client.0.smithi096.stdout:5/972: link d7/dd/d35/d74/dab/f14b d7/d25/d2b/d111/f157 0 2024-04-18T04:58:12.354 INFO:tasks.workunit.client.0.smithi096.stdout:0/889: dwrite d16/f60 [0,4194304] 0 2024-04-18T04:58:12.355 INFO:tasks.workunit.client.0.smithi096.stdout:4/918: dwrite d4/d14/d2d/d44/d58/d86/dff/f108 [0,4194304] 0 2024-04-18T04:58:12.358 INFO:tasks.workunit.client.0.smithi096.stdout:8/825: dread d0/d7/d24/d18/d5d/f98 [0,4194304] 0 2024-04-18T04:58:12.358 INFO:tasks.workunit.client.0.smithi096.stdout:0/890: symlink d16/d78/l111 0 2024-04-18T04:58:12.359 INFO:tasks.workunit.client.0.smithi096.stdout:8/826: readlink d0/l68 0 2024-04-18T04:58:12.360 INFO:tasks.workunit.client.0.smithi096.stdout:0/891: chown d16/d1c/d4c/d4d/fcb 0 1 2024-04-18T04:58:12.360 INFO:tasks.workunit.client.0.smithi096.stdout:8/827: chown d0/d7/d24/d78/cab 39099 1 2024-04-18T04:58:12.361 INFO:tasks.workunit.client.0.smithi096.stdout:0/892: readlink d16/d1c/d4c/d4d/d5d/lb1 0 2024-04-18T04:58:12.361 INFO:tasks.workunit.client.0.smithi096.stdout:8/828: chown d0/d3/d32/d6b/d7b/f10c 1102121964 1 2024-04-18T04:58:12.362 INFO:tasks.workunit.client.0.smithi096.stdout:4/919: dread d4/d14/d2d/d44/d58/d86/d6f/db8/fc3 [0,4194304] 0 2024-04-18T04:58:12.362 INFO:tasks.workunit.client.0.smithi096.stdout:5/973: getdents d7/da3/d11f/de7/d12f 0 2024-04-18T04:58:12.364 INFO:tasks.workunit.client.0.smithi096.stdout:0/893: write d16/d1c/d4c/d4d/fcb [273647,93599] 0 2024-04-18T04:58:12.364 INFO:tasks.workunit.client.0.smithi096.stdout:5/974: read - d7/d25/d2b/d111/f157 zero size 2024-04-18T04:58:12.366 INFO:tasks.workunit.client.0.smithi096.stdout:8/829: unlink d0/d3/d32/dee/fd3 0 2024-04-18T04:58:12.372 INFO:tasks.workunit.client.0.smithi096.stdout:4/920: creat d4/d14/d2d/d44/d58/d86/d3a/df1/d10c/f124 x:0 0 0 2024-04-18T04:58:12.373 INFO:tasks.workunit.client.0.smithi096.stdout:8/830: truncate d0/d7/d24/d35/f9d 322896 0 2024-04-18T04:58:12.374 INFO:tasks.workunit.client.0.smithi096.stdout:5/975: mknod d7/c158 0 2024-04-18T04:58:12.378 INFO:tasks.workunit.client.0.smithi096.stdout:8/831: mkdir d0/d7/d24/d18/d5d/d111 0 2024-04-18T04:58:12.378 INFO:tasks.workunit.client.0.smithi096.stdout:5/976: chown d7/dd/d8f/da2/de2/de3/l5b 0 1 2024-04-18T04:58:12.380 INFO:tasks.workunit.client.0.smithi096.stdout:5/977: creat d7/d25/d30/f159 x:0 0 0 2024-04-18T04:58:12.380 INFO:tasks.workunit.client.0.smithi096.stdout:0/894: dwrite d16/d1c/d4c/d4d/f108 [0,4194304] 0 2024-04-18T04:58:12.381 INFO:tasks.workunit.client.0.smithi096.stdout:8/832: getdents d0/d7/d24/d78 0 2024-04-18T04:58:12.382 INFO:tasks.workunit.client.0.smithi096.stdout:5/978: write d7/dd/d8f/da2/f8c [5080831,126645] 0 2024-04-18T04:58:12.383 INFO:tasks.workunit.client.0.smithi096.stdout:8/833: stat d0/d15/c64 0 2024-04-18T04:58:12.384 INFO:tasks.workunit.client.0.smithi096.stdout:0/895: creat d16/d1c/d4c/d6a/f112 x:0 0 0 2024-04-18T04:58:12.385 INFO:tasks.workunit.client.0.smithi096.stdout:0/896: dread - d16/d1c/d4c/d6a/fad zero size 2024-04-18T04:58:12.387 INFO:tasks.workunit.client.0.smithi096.stdout:0/897: creat d16/d1c/d4c/d6a/da3/f113 x:0 0 0 2024-04-18T04:58:12.388 INFO:tasks.workunit.client.0.smithi096.stdout:4/921: dread d4/d14/d16/f3f [0,4194304] 0 2024-04-18T04:58:12.388 INFO:tasks.workunit.client.0.smithi096.stdout:5/979: creat d7/dd/d8f/da2/de2/de3/d56/ddd/f15a x:0 0 0 2024-04-18T04:58:12.389 INFO:tasks.workunit.client.0.smithi096.stdout:0/898: mkdir d16/d1c/d4c/d4d/d5d/dd7/d114 0 2024-04-18T04:58:12.390 INFO:tasks.workunit.client.0.smithi096.stdout:5/980: mkdir d7/da3/d15b 0 2024-04-18T04:58:12.391 INFO:tasks.workunit.client.0.smithi096.stdout:0/899: mknod d16/d1c/c115 0 2024-04-18T04:58:12.392 INFO:tasks.workunit.client.0.smithi096.stdout:5/981: chown d7/d25/d30/d9e/dc3/d120 2 1 2024-04-18T04:58:12.396 INFO:tasks.workunit.client.0.smithi096.stdout:8/834: dwrite d0/d7/f50 [0,4194304] 0 2024-04-18T04:58:12.398 INFO:tasks.workunit.client.0.smithi096.stdout:4/922: dwrite d4/d14/f31 [0,4194304] 0 2024-04-18T04:58:12.399 INFO:tasks.workunit.client.0.smithi096.stdout:8/835: symlink d0/d3/d32/d6b/d7b/l112 0 2024-04-18T04:58:12.401 INFO:tasks.workunit.client.0.smithi096.stdout:4/923: unlink d4/d14/d2d/d44/d58/d86/d3a/d39/fab 0 2024-04-18T04:58:12.402 INFO:tasks.workunit.client.0.smithi096.stdout:8/836: creat d0/d3/d32/dee/df6/f113 x:0 0 0 2024-04-18T04:58:12.403 INFO:tasks.workunit.client.0.smithi096.stdout:4/924: read d4/d14/d1d/da5/d67/f6d [77647,84751] 0 2024-04-18T04:58:12.406 INFO:tasks.workunit.client.0.smithi096.stdout:5/982: dread d7/da3/d11f/dd5/f13c [0,4194304] 0 2024-04-18T04:58:12.407 INFO:tasks.workunit.client.0.smithi096.stdout:4/925: write d4/d14/d16/f32 [2492860,127244] 0 2024-04-18T04:58:12.408 INFO:tasks.workunit.client.0.smithi096.stdout:5/983: fsync d7/d3b/fcf 0 2024-04-18T04:58:12.409 INFO:tasks.workunit.client.0.smithi096.stdout:7/886: sync 2024-04-18T04:58:12.409 INFO:tasks.workunit.client.0.smithi096.stdout:9/972: sync 2024-04-18T04:58:12.411 INFO:tasks.workunit.client.0.smithi096.stdout:5/984: symlink d7/da3/d9a/d10c/l15c 0 2024-04-18T04:58:12.412 INFO:tasks.workunit.client.0.smithi096.stdout:7/887: symlink db/d1d/l115 0 2024-04-18T04:58:12.413 INFO:tasks.workunit.client.0.smithi096.stdout:0/900: dread d16/d1c/d4c/d4d/d5a/fc5 [0,4194304] 0 2024-04-18T04:58:12.415 INFO:tasks.workunit.client.0.smithi096.stdout:8/837: dwrite d0/d3/d32/d6b/d7b/f10c [0,4194304] 0 2024-04-18T04:58:12.416 INFO:tasks.workunit.client.0.smithi096.stdout:9/973: getdents d0/d6b/d89 0 2024-04-18T04:58:12.418 INFO:tasks.workunit.client.0.smithi096.stdout:0/901: creat d16/d1c/d4c/d6a/f116 x:0 0 0 2024-04-18T04:58:12.421 INFO:tasks.workunit.client.0.smithi096.stdout:4/926: dwrite d4/d14/d2d/d44/da2/db2/fc7 [0,4194304] 0 2024-04-18T04:58:12.422 INFO:tasks.workunit.client.0.smithi096.stdout:8/838: getdents d0/d7/d86/d91/d93/dec 0 2024-04-18T04:58:12.425 INFO:tasks.workunit.client.0.smithi096.stdout:0/902: truncate d16/d1c/d22/d2c/f30 5911546 0 2024-04-18T04:58:12.427 INFO:tasks.workunit.client.0.smithi096.stdout:8/839: creat d0/d7/d24/d18/dd9/f114 x:0 0 0 2024-04-18T04:58:12.428 INFO:tasks.workunit.client.0.smithi096.stdout:5/985: dwrite d7/dd/d8f/da2/de2/de3/f96 [0,4194304] 0 2024-04-18T04:58:12.432 INFO:tasks.workunit.client.0.smithi096.stdout:4/927: dread d4/d14/d16/f3f [0,4194304] 0 2024-04-18T04:58:12.435 INFO:tasks.workunit.client.0.smithi096.stdout:8/840: symlink d0/d15/d65/d8f/db6/l115 0 2024-04-18T04:58:12.436 INFO:tasks.workunit.client.0.smithi096.stdout:5/986: chown d7/da3/d11f/dd5/f13c 24615 1 2024-04-18T04:58:12.438 INFO:tasks.workunit.client.0.smithi096.stdout:4/928: rename d4/f43 to d4/d14/d1d/da5/d67/df7/f125 0 2024-04-18T04:58:12.439 INFO:tasks.workunit.client.0.smithi096.stdout:0/903: dwrite d16/d1c/d4c/d4d/d5d/fc7 [0,4194304] 0 2024-04-18T04:58:12.440 INFO:tasks.workunit.client.0.smithi096.stdout:8/841: dread - d0/d4f/f85 zero size 2024-04-18T04:58:12.441 INFO:tasks.workunit.client.0.smithi096.stdout:7/888: dread db/d1f/d5b/fe7 [0,4194304] 0 2024-04-18T04:58:12.443 INFO:tasks.workunit.client.0.smithi096.stdout:4/929: creat d4/d14/d2d/da6/dc6/f126 x:0 0 0 2024-04-18T04:58:12.445 INFO:tasks.workunit.client.0.smithi096.stdout:8/842: mknod d0/d7/d24/d78/c116 0 2024-04-18T04:58:12.447 INFO:tasks.workunit.client.0.smithi096.stdout:0/904: mkdir d16/d1c/d4c/d4d/d117 0 2024-04-18T04:58:12.447 INFO:tasks.workunit.client.0.smithi096.stdout:8/843: rmdir d0/d15/d65/d8f/db6 39 2024-04-18T04:58:12.448 INFO:tasks.workunit.client.0.smithi096.stdout:4/930: symlink d4/d14/d1d/da5/d67/def/d101/l127 0 2024-04-18T04:58:12.449 INFO:tasks.workunit.client.0.smithi096.stdout:0/905: creat d16/d1c/d4c/d4d/d36/f118 x:0 0 0 2024-04-18T04:58:12.450 INFO:tasks.workunit.client.0.smithi096.stdout:4/931: write d4/d14/d2d/d44/da2/db2/fc2 [113384,93057] 0 2024-04-18T04:58:12.451 INFO:tasks.workunit.client.0.smithi096.stdout:8/844: unlink d0/d3/d32/d6b/d7b/f10c 0 2024-04-18T04:58:12.451 INFO:tasks.workunit.client.0.smithi096.stdout:4/932: write d4/d14/f102 [1019280,126114] 0 2024-04-18T04:58:12.453 INFO:tasks.workunit.client.0.smithi096.stdout:8/845: write d0/d7/d24/d35/d51/f7f [246494,70865] 0 2024-04-18T04:58:12.453 INFO:tasks.workunit.client.0.smithi096.stdout:5/987: truncate d7/dd/f2c 1891004 0 2024-04-18T04:58:12.454 INFO:tasks.workunit.client.0.smithi096.stdout:7/889: write db/d1d/d82/dbc/fbf [759189,92452] 0 2024-04-18T04:58:12.457 INFO:tasks.workunit.client.0.smithi096.stdout:8/846: chown d0/d7/d24/d35/d51/l57 0 1 2024-04-18T04:58:12.463 INFO:tasks.workunit.client.0.smithi096.stdout:5/988: truncate d7/d3b/f7f 2180470 0 2024-04-18T04:58:12.464 INFO:tasks.workunit.client.0.smithi096.stdout:0/906: write d16/d1c/d22/fbe [251022,96879] 0 2024-04-18T04:58:12.465 INFO:tasks.workunit.client.0.smithi096.stdout:7/890: write db/d1d/d82/fb0 [1015350,77367] 0 2024-04-18T04:58:12.465 INFO:tasks.workunit.client.0.smithi096.stdout:8/847: write d0/d3/d32/dee/f69 [2463292,38299] 0 2024-04-18T04:58:12.467 INFO:tasks.workunit.client.0.smithi096.stdout:5/989: fsync d7/da3/d9a/d10c/f10d 0 2024-04-18T04:58:12.468 INFO:tasks.workunit.client.0.smithi096.stdout:4/933: dwrite d4/d14/d2d/d44/d58/d86/fe1 [0,4194304] 0 2024-04-18T04:58:12.475 INFO:tasks.workunit.client.0.smithi096.stdout:7/891: dwrite db/d20/d2f/d8d/da1/fd3 [0,4194304] 0 2024-04-18T04:58:12.477 INFO:tasks.workunit.client.0.smithi096.stdout:7/892: dread - db/d1f/d24/d49/d54/dc3/f113 zero size 2024-04-18T04:58:12.488 INFO:tasks.workunit.client.0.smithi096.stdout:8/848: readlink d0/d7/d86/d91/le4 0 2024-04-18T04:58:12.490 INFO:tasks.workunit.client.0.smithi096.stdout:5/990: creat d7/d3b/d110/f15d x:0 0 0 2024-04-18T04:58:12.494 INFO:tasks.workunit.client.0.smithi096.stdout:8/849: symlink d0/d3/d32/d6b/d7b/dc9/l117 0 2024-04-18T04:58:12.494 INFO:tasks.workunit.client.0.smithi096.stdout:8/850: readlink d0/d7/d24/d18/l53 0 2024-04-18T04:58:12.496 INFO:tasks.workunit.client.0.smithi096.stdout:5/991: symlink d7/dd/d8f/da2/d137/l15e 0 2024-04-18T04:58:12.496 INFO:tasks.workunit.client.0.smithi096.stdout:7/893: getdents db/d20/d45 0 2024-04-18T04:58:12.498 INFO:tasks.workunit.client.0.smithi096.stdout:8/851: chown d0/d3/d32/d6b/d7b/dc9/c106 8598717 1 2024-04-18T04:58:12.498 INFO:tasks.workunit.client.0.smithi096.stdout:7/894: write db/d1d/d82/dbc/fbf [1747340,115645] 0 2024-04-18T04:58:12.499 INFO:tasks.workunit.client.0.smithi096.stdout:5/992: creat d7/dd/d8f/da2/de2/de3/d78/f15f x:0 0 0 2024-04-18T04:58:12.500 INFO:tasks.workunit.client.0.smithi096.stdout:8/852: mknod d0/d4f/dfc/c118 0 2024-04-18T04:58:12.500 INFO:tasks.workunit.client.0.smithi096.stdout:7/895: write db/fc5 [4198181,54245] 0 2024-04-18T04:58:12.502 INFO:tasks.workunit.client.0.smithi096.stdout:7/896: stat db/d1f/d5b/c109 0 2024-04-18T04:58:12.503 INFO:tasks.workunit.client.0.smithi096.stdout:7/897: truncate db/f10d 274796 0 2024-04-18T04:58:12.503 INFO:tasks.workunit.client.0.smithi096.stdout:5/993: mknod d7/da3/d11f/de7/c160 0 2024-04-18T04:58:12.505 INFO:tasks.workunit.client.0.smithi096.stdout:0/907: dread d16/d1c/d4c/d4d/d5d/dd7/dda/fdb [0,4194304] 0 2024-04-18T04:58:12.508 INFO:tasks.workunit.client.0.smithi096.stdout:0/908: creat d16/d1c/d4c/d4d/d5d/de8/f119 x:0 0 0 2024-04-18T04:58:12.510 INFO:tasks.workunit.client.0.smithi096.stdout:7/898: dread db/d1f/d5b/fe7 [0,4194304] 0 2024-04-18T04:58:12.512 INFO:tasks.workunit.client.0.smithi096.stdout:0/909: fdatasync d16/d1c/d22/d2c/f30 0 2024-04-18T04:58:12.513 INFO:tasks.workunit.client.0.smithi096.stdout:5/994: dwrite d7/dd/d8f/d5e/f79 [0,4194304] 0 2024-04-18T04:58:12.516 INFO:tasks.workunit.client.0.smithi096.stdout:0/910: fsync d16/d1d/d3b/f58 0 2024-04-18T04:58:12.516 INFO:tasks.workunit.client.0.smithi096.stdout:5/995: symlink d7/da3/d11f/dd5/l161 0 2024-04-18T04:58:12.519 INFO:tasks.workunit.client.0.smithi096.stdout:0/911: chown d16/d1c/d4c/d4d/d36/l104 5201 1 2024-04-18T04:58:12.520 INFO:tasks.workunit.client.0.smithi096.stdout:5/996: symlink d7/d25/d30/d9e/l162 0 2024-04-18T04:58:12.520 INFO:tasks.workunit.client.0.smithi096.stdout:8/853: dread d0/d3/d32/dee/d3c/f9b [0,4194304] 0 2024-04-18T04:58:12.521 INFO:tasks.workunit.client.0.smithi096.stdout:8/854: stat d0/d15/c1b 0 2024-04-18T04:58:12.522 INFO:tasks.workunit.client.0.smithi096.stdout:7/899: dwrite db/d1f/d24/d49/d54/fe5 [0,4194304] 0 2024-04-18T04:58:12.522 INFO:tasks.workunit.client.0.smithi096.stdout:0/912: mkdir d16/d1c/d4c/d10c/d11a 0 2024-04-18T04:58:12.523 INFO:tasks.workunit.client.0.smithi096.stdout:8/855: rmdir d0/d15/da9 39 2024-04-18T04:58:12.524 INFO:tasks.workunit.client.0.smithi096.stdout:5/997: getdents d7/d25/d2b/d14d 0 2024-04-18T04:58:12.525 INFO:tasks.workunit.client.0.smithi096.stdout:7/900: mkdir db/d20/d45/dcf/d116 0 2024-04-18T04:58:12.527 INFO:tasks.workunit.client.0.smithi096.stdout:0/913: rmdir d16/d1c/d4c/d4d/d5d/dc6 39 2024-04-18T04:58:12.527 INFO:tasks.workunit.client.0.smithi096.stdout:0/914: dread - d16/d1c/d4c/d4d/f103 zero size 2024-04-18T04:58:12.528 INFO:tasks.workunit.client.0.smithi096.stdout:0/915: dread d16/d1c/d4c/d4d/fcb [0,4194304] 0 2024-04-18T04:58:12.531 INFO:tasks.workunit.client.0.smithi096.stdout:5/998: creat d7/da3/f163 x:0 0 0 2024-04-18T04:58:12.531 INFO:tasks.workunit.client.0.smithi096.stdout:7/901: mknod db/d1f/d39/d6d/d79/d83/daa/df1/c117 0 2024-04-18T04:58:12.535 INFO:tasks.workunit.client.0.smithi096.stdout:5/999: creat d7/da3/d15b/f164 x:0 0 0 2024-04-18T04:58:12.537 INFO:tasks.workunit.client.0.smithi096.stdout:8/856: write d0/d7/d24/d35/f9d [1053274,51436] 0 2024-04-18T04:58:12.539 INFO:tasks.workunit.client.0.smithi096.stdout:8/857: chown d0/d3/f5c 417575 1 2024-04-18T04:58:12.541 INFO:tasks.workunit.client.0.smithi096.stdout:0/916: dwrite d16/d1c/d4c/d4d/fb7 [0,4194304] 0 2024-04-18T04:58:12.541 INFO:tasks.workunit.client.0.smithi096.stdout:7/902: dwrite db/d1f/d5b/d6a/d74/fa7 [0,4194304] 0 2024-04-18T04:58:12.544 INFO:tasks.workunit.client.0.smithi096.stdout:8/858: rmdir d0/d7/d24/d18/d7c/dad/de2 39 2024-04-18T04:58:12.544 INFO:tasks.workunit.client.0.smithi096.stdout:8/859: write d0/d3/dc1/f100 [104083,83916] 0 2024-04-18T04:58:12.546 INFO:tasks.workunit.client.0.smithi096.stdout:0/917: creat d16/d1c/d4c/d4d/d5a/f11b x:0 0 0 2024-04-18T04:58:12.548 INFO:tasks.workunit.client.0.smithi096.stdout:0/918: write d16/d1c/d22/d2c/f35 [3018015,35965] 0 2024-04-18T04:58:12.551 INFO:tasks.workunit.client.0.smithi096.stdout:7/903: dwrite db/d1f/d5b/d6a/dc6/fea [0,4194304] 0 2024-04-18T04:58:12.552 INFO:tasks.workunit.client.0.smithi096.stdout:0/919: mkdir d16/d1c/d4c/d4d/d5a/d11c 0 2024-04-18T04:58:12.553 INFO:tasks.workunit.client.0.smithi096.stdout:0/920: fsync d16/f19 0 2024-04-18T04:58:12.555 INFO:tasks.workunit.client.0.smithi096.stdout:0/921: write d16/d1c/d4c/d4d/d5d/f74 [4028877,56693] 0 2024-04-18T04:58:12.555 INFO:tasks.workunit.client.0.smithi096.stdout:7/904: unlink db/d1f/d4e/dc0/cca 0 2024-04-18T04:58:12.557 INFO:tasks.workunit.client.0.smithi096.stdout:7/905: fdatasync db/d1f/d5b/d6a/f8b 0 2024-04-18T04:58:12.558 INFO:tasks.workunit.client.0.smithi096.stdout:0/922: symlink d16/d1c/d4c/d10c/d11a/l11d 0 2024-04-18T04:58:12.559 INFO:tasks.workunit.client.0.smithi096.stdout:7/906: creat db/d1f/d5b/d6a/d74/f118 x:0 0 0 2024-04-18T04:58:12.560 INFO:tasks.workunit.client.0.smithi096.stdout:0/923: rmdir d16/d1c/d4c/d4d 39 2024-04-18T04:58:12.560 INFO:tasks.workunit.client.0.smithi096.stdout:7/907: rmdir db/d1f/d24/d49 39 2024-04-18T04:58:12.561 INFO:tasks.workunit.client.0.smithi096.stdout:0/924: creat d16/d1c/d4c/d10c/f11e x:0 0 0 2024-04-18T04:58:12.562 INFO:tasks.workunit.client.0.smithi096.stdout:7/908: truncate db/d20/d2f/f30 112978 0 2024-04-18T04:58:12.564 INFO:tasks.workunit.client.0.smithi096.stdout:7/909: symlink db/d1f/d24/d61/de1/l119 0 2024-04-18T04:58:12.565 INFO:tasks.workunit.client.0.smithi096.stdout:0/925: mknod d16/d1c/d4c/d4d/d5d/dd7/c11f 0 2024-04-18T04:58:12.566 INFO:tasks.workunit.client.0.smithi096.stdout:8/860: dread d0/d7/d24/d35/d51/d5b/f63 [0,4194304] 0 2024-04-18T04:58:12.569 INFO:tasks.workunit.client.0.smithi096.stdout:7/910: getdents db/d1f/d5b/d6a 0 2024-04-18T04:58:12.573 INFO:tasks.workunit.client.0.smithi096.stdout:8/861: rename d0/d7/d24/d18/d7c/f84 to d0/d15/d65/d8f/f119 0 2024-04-18T04:58:12.576 INFO:tasks.workunit.client.0.smithi096.stdout:0/926: dread d16/d1c/d22/d2c/f68 [0,4194304] 0 2024-04-18T04:58:12.577 INFO:tasks.workunit.client.0.smithi096.stdout:0/927: readlink d16/d1c/d4c/d6a/l82 0 2024-04-18T04:58:12.577 INFO:tasks.workunit.client.0.smithi096.stdout:8/862: dread d0/d3/d32/fb4 [0,4194304] 0 2024-04-18T04:58:12.578 INFO:tasks.workunit.client.0.smithi096.stdout:0/928: chown d16/d1c/d4c/d6a/da3/f105 1150 1 2024-04-18T04:58:12.579 INFO:tasks.workunit.client.0.smithi096.stdout:8/863: write d0/d7/d24/d78/f4e [28512,49210] 0 2024-04-18T04:58:12.582 INFO:tasks.workunit.client.0.smithi096.stdout:8/864: read - d0/d7/fa6 zero size 2024-04-18T04:58:12.582 INFO:tasks.workunit.client.0.smithi096.stdout:7/911: dread db/d1f/d5b/d6a/fa4 [0,4194304] 0 2024-04-18T04:58:12.582 INFO:tasks.workunit.client.0.smithi096.stdout:8/865: read - d0/d3/dc1/f105 zero size 2024-04-18T04:58:12.583 INFO:tasks.workunit.client.0.smithi096.stdout:8/866: chown d0/d7/d24/d35/d51/lb2 336545 1 2024-04-18T04:58:12.584 INFO:tasks.workunit.client.0.smithi096.stdout:7/912: creat db/d1f/d24/d49/d54/f11a x:0 0 0 2024-04-18T04:58:12.584 INFO:tasks.workunit.client.0.smithi096.stdout:8/867: readlink d0/d7/d24/l8b 0 2024-04-18T04:58:12.586 INFO:tasks.workunit.client.0.smithi096.stdout:0/929: dwrite d16/d1c/f98 [0,4194304] 0 2024-04-18T04:58:12.587 INFO:tasks.workunit.client.0.smithi096.stdout:8/868: creat d0/d7/d24/d18/dd9/f11a x:0 0 0 2024-04-18T04:58:12.587 INFO:tasks.workunit.client.0.smithi096.stdout:7/913: truncate db/d1f/d39/fc7 983023 0 2024-04-18T04:58:12.587 INFO:tasks.workunit.client.0.smithi096.stdout:8/869: dread - d0/d7/d24/d8d/fe5 zero size 2024-04-18T04:58:12.588 INFO:tasks.workunit.client.0.smithi096.stdout:0/930: symlink d16/d1c/d4c/d4d/d5a/l120 0 2024-04-18T04:58:12.589 INFO:tasks.workunit.client.0.smithi096.stdout:7/914: symlink db/dfa/l11b 0 2024-04-18T04:58:12.590 INFO:tasks.workunit.client.0.smithi096.stdout:8/870: creat d0/d3/d32/dee/d3c/f11b x:0 0 0 2024-04-18T04:58:12.590 INFO:tasks.workunit.client.0.smithi096.stdout:0/931: mkdir d16/d1c/d4c/d4e/d67/d121 0 2024-04-18T04:58:12.591 INFO:tasks.workunit.client.0.smithi096.stdout:8/871: chown d0/d7/d24/d35/fdc 4 1 2024-04-18T04:58:12.592 INFO:tasks.workunit.client.0.smithi096.stdout:8/872: write d0/d7/d24/d8d/fcf [20232,90056] 0 2024-04-18T04:58:12.595 INFO:tasks.workunit.client.0.smithi096.stdout:0/932: getdents d16/d1d/d3b 0 2024-04-18T04:58:12.599 INFO:tasks.workunit.client.0.smithi096.stdout:7/915: dwrite db/d20/fb8 [0,4194304] 0 2024-04-18T04:58:12.601 INFO:tasks.workunit.client.0.smithi096.stdout:7/916: symlink db/d1d/l11c 0 2024-04-18T04:58:12.601 INFO:tasks.workunit.client.0.smithi096.stdout:0/933: link d16/d1c/d22/db8/lf6 d16/d1c/d4c/l122 0 2024-04-18T04:58:12.603 INFO:tasks.workunit.client.0.smithi096.stdout:0/934: chown d16/d1c/d4c/d4d/d5a/f83 0 1 2024-04-18T04:58:12.604 INFO:tasks.workunit.client.0.smithi096.stdout:0/935: write d16/d1c/d4c/d4d/d36/f118 [627733,83277] 0 2024-04-18T04:58:12.606 INFO:tasks.workunit.client.0.smithi096.stdout:0/936: chown d16/d1d/fd8 14 1 2024-04-18T04:58:12.609 INFO:tasks.workunit.client.0.smithi096.stdout:7/917: dwrite db/d1d/d82/dbc/fbf [0,4194304] 0 2024-04-18T04:58:12.609 INFO:tasks.workunit.client.0.smithi096.stdout:0/937: rename d16/d1c/d22/fd4 to d16/d1c/d4c/d6a/da3/f123 0 2024-04-18T04:58:12.611 INFO:tasks.workunit.client.0.smithi096.stdout:0/938: symlink d16/d1c/d4c/d4e/d67/l124 0 2024-04-18T04:58:12.613 INFO:tasks.workunit.client.0.smithi096.stdout:7/918: creat db/d1f/d39/d6d/d79/d83/daa/df1/df2/df7/f11d x:0 0 0 2024-04-18T04:58:12.614 INFO:tasks.workunit.client.0.smithi096.stdout:0/939: creat d16/d1c/d4c/d6a/f125 x:0 0 0 2024-04-18T04:58:12.615 INFO:tasks.workunit.client.0.smithi096.stdout:0/940: stat d16/d1c/d4c/d4e/fdf 0 2024-04-18T04:58:12.615 INFO:tasks.workunit.client.0.smithi096.stdout:7/919: mknod db/d1f/d5b/d6a/c11e 0 2024-04-18T04:58:12.616 INFO:tasks.workunit.client.0.smithi096.stdout:0/941: fsync d16/d1c/d22/d2c/f68 0 2024-04-18T04:58:12.618 INFO:tasks.workunit.client.0.smithi096.stdout:7/920: mknod db/d1f/d24/d49/c11f 0 2024-04-18T04:58:12.619 INFO:tasks.workunit.client.0.smithi096.stdout:7/921: truncate db/d20/d2f/d8d/da1/fc2 652474 0 2024-04-18T04:58:12.621 INFO:tasks.workunit.client.0.smithi096.stdout:7/922: creat db/f120 x:0 0 0 2024-04-18T04:58:12.622 INFO:tasks.workunit.client.0.smithi096.stdout:7/923: fsync db/d1f/d39/d6d/d79/ff6 0 2024-04-18T04:58:12.623 INFO:tasks.workunit.client.0.smithi096.stdout:7/924: creat db/d1f/d24/d61/d77/f121 x:0 0 0 2024-04-18T04:58:12.630 INFO:tasks.workunit.client.0.smithi096.stdout:7/925: dwrite db/d1d/d82/f106 [0,4194304] 0 2024-04-18T04:58:12.632 INFO:tasks.workunit.client.0.smithi096.stdout:7/926: symlink db/d1f/d5b/l122 0 2024-04-18T04:58:12.635 INFO:tasks.workunit.client.0.smithi096.stdout:7/927: write db/d20/d45/dcf/dd6/dde/ffe [234695,126932] 0 2024-04-18T04:58:12.635 INFO:tasks.workunit.client.0.smithi096.stdout:7/928: readlink db/d1d/d82/lac 0 2024-04-18T04:58:12.641 INFO:tasks.workunit.client.0.smithi096.stdout:7/929: truncate db/d1f/d24/d49/f86 3497715 0 2024-04-18T04:58:12.645 INFO:tasks.workunit.client.0.smithi096.stdout:7/930: getdents db/d1d/d82 0 2024-04-18T04:58:12.645 INFO:tasks.workunit.client.0.smithi096.stdout:7/931: dread - db/d20/d45/f107 zero size 2024-04-18T04:58:12.645 INFO:tasks.workunit.client.0.smithi096.stdout:7/932: chown db/d1f/d4e/c4f 819 1 2024-04-18T04:58:12.646 INFO:tasks.workunit.client.0.smithi096.stdout:7/933: fdatasync db/d1f/d5b/d6a/d74/fa7 0 2024-04-18T04:58:12.649 INFO:tasks.workunit.client.0.smithi096.stdout:7/934: creat db/d1f/d24/d61/f123 x:0 0 0 2024-04-18T04:58:12.653 INFO:tasks.workunit.client.0.smithi096.stdout:7/935: rename db/d1d/c3e to db/d1f/d24/d61/de1/c124 0 2024-04-18T04:58:12.655 INFO:tasks.workunit.client.0.smithi096.stdout:7/936: truncate db/f7f 4601406 0 2024-04-18T04:58:12.657 INFO:tasks.workunit.client.0.smithi096.stdout:7/937: creat db/dd5/f125 x:0 0 0 2024-04-18T04:58:12.668 INFO:tasks.workunit.client.0.smithi096.stdout:7/938: dwrite db/d1f/d5b/d6a/dc6/fd0 [0,4194304] 0 2024-04-18T04:58:12.670 INFO:tasks.workunit.client.0.smithi096.stdout:7/939: write db/d1f/d24/d49/d54/dc3/f113 [137433,47090] 0 2024-04-18T04:58:12.673 INFO:tasks.workunit.client.0.smithi096.stdout:7/940: mknod db/d1f/d5b/c126 0 2024-04-18T04:58:12.673 INFO:tasks.workunit.client.0.smithi096.stdout:7/941: chown db/d1f/d39/d6d/c8a 182 1 2024-04-18T04:58:12.679 INFO:tasks.workunit.client.0.smithi096.stdout:7/942: write db/d1f/d42/f5f [674975,11179] 0 2024-04-18T04:58:12.685 INFO:tasks.workunit.client.0.smithi096.stdout:7/943: dwrite db/d1f/d5b/d6a/d74/f81 [0,4194304] 0 2024-04-18T04:58:12.688 INFO:tasks.workunit.client.0.smithi096.stdout:7/944: symlink db/d1f/d39/d6d/d79/d83/daa/df1/df2/df7/l127 0 2024-04-18T04:58:12.689 INFO:tasks.workunit.client.0.smithi096.stdout:7/945: read - db/d1f/d24/d49/d54/dc3/fff zero size 2024-04-18T04:58:12.692 INFO:tasks.workunit.client.0.smithi096.stdout:7/946: creat db/d1f/d4e/dc0/f128 x:0 0 0 2024-04-18T04:58:12.694 INFO:tasks.workunit.client.0.smithi096.stdout:7/947: mknod db/d1f/d42/c129 0 2024-04-18T04:58:12.694 INFO:tasks.workunit.client.0.smithi096.stdout:7/948: write db/d1f/d39/d6d/d79/fdd [3116680,104507] 0 2024-04-18T04:58:12.695 INFO:tasks.workunit.client.0.smithi096.stdout:7/949: dread - db/d20/d2f/d8d/ff8 zero size 2024-04-18T04:58:12.699 INFO:tasks.workunit.client.0.smithi096.stdout:7/950: rename db/d1f/d4e/f78 to db/d1f/d4e/dc0/ddb/f12a 0 2024-04-18T04:58:12.699 INFO:tasks.workunit.client.0.smithi096.stdout:7/951: fsync db/d20/fb8 0 2024-04-18T04:58:12.813 INFO:tasks.workunit.client.0.smithi096.stdout:9/974: sync 2024-04-18T04:58:12.823 INFO:tasks.workunit.client.0.smithi096.stdout:9/975: write d0/d52/d5a/f7d [4139295,86566] 0 2024-04-18T04:58:12.852 INFO:tasks.workunit.client.0.smithi096.stdout:9/976: dread d0/d52/d5a/fa7 [0,4194304] 0 2024-04-18T04:58:12.857 INFO:tasks.workunit.client.0.smithi096.stdout:9/977: creat d0/de/d17/d2f/d40/d8b/f130 x:0 0 0 2024-04-18T04:58:12.862 INFO:tasks.workunit.client.0.smithi096.stdout:9/978: creat d0/d6b/d89/d112/d116/d33/d126/f131 x:0 0 0 2024-04-18T04:58:12.865 INFO:tasks.workunit.client.0.smithi096.stdout:9/979: dread d0/fd1 [0,4194304] 0 2024-04-18T04:58:12.867 INFO:tasks.workunit.client.0.smithi096.stdout:9/980: dread - d0/de/d17/d2f/d40/dd2/d113/f11e zero size 2024-04-18T04:58:12.867 INFO:tasks.workunit.client.0.smithi096.stdout:9/981: chown d0/d41/fea 517209161 1 2024-04-18T04:58:12.875 INFO:tasks.workunit.client.0.smithi096.stdout:9/982: write d0/f28 [2602662,45871] 0 2024-04-18T04:58:12.876 INFO:tasks.workunit.client.0.smithi096.stdout:9/983: chown d0/f4b 0 1 2024-04-18T04:58:12.881 INFO:tasks.workunit.client.0.smithi096.stdout:9/984: mkdir d0/de/d17/d2f/d40/dc1/d12c/d132 0 2024-04-18T04:58:12.893 INFO:tasks.workunit.client.0.smithi096.stdout:9/985: dwrite d0/de/d17/d56/d59/d60/fcf [0,4194304] 0 2024-04-18T04:58:12.897 INFO:tasks.workunit.client.0.smithi096.stdout:9/986: fdatasync d0/de/d17/d2f/d40/dd2/d118/f11d 0 2024-04-18T04:58:12.900 INFO:tasks.workunit.client.0.smithi096.stdout:9/987: mknod d0/d52/d10b/c133 0 2024-04-18T04:58:12.911 INFO:tasks.workunit.client.0.smithi096.stdout:9/988: dwrite d0/de/d17/d2f/d40/dd2/fe2 [0,4194304] 0 2024-04-18T04:58:12.919 INFO:tasks.workunit.client.0.smithi096.stdout:9/989: getdents d0/de/d17/d56 0 2024-04-18T04:58:12.921 INFO:tasks.workunit.client.0.smithi096.stdout:9/990: chown d0/d52/d5a/c81 39 1 2024-04-18T04:58:12.922 INFO:tasks.workunit.client.0.smithi096.stdout:9/991: chown d0/de/d17/f3f 400 1 2024-04-18T04:58:12.926 INFO:tasks.workunit.client.0.smithi096.stdout:9/992: mkdir d0/d6b/d89/d112/d116/d103/d134 0 2024-04-18T04:58:12.929 INFO:tasks.workunit.client.0.smithi096.stdout:9/993: rmdir d0/de/d17/d2f/d40/dc1/d12c 39 2024-04-18T04:58:12.932 INFO:tasks.workunit.client.0.smithi096.stdout:9/994: rmdir d0/d6b/d89/d112/d116/d103 39 2024-04-18T04:58:12.933 INFO:tasks.workunit.client.0.smithi096.stdout:4/934: sync 2024-04-18T04:58:12.936 INFO:tasks.workunit.client.0.smithi096.stdout:9/995: creat d0/d52/d10b/f135 x:0 0 0 2024-04-18T04:58:12.938 INFO:tasks.workunit.client.0.smithi096.stdout:4/935: symlink d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/l128 0 2024-04-18T04:58:12.942 INFO:tasks.workunit.client.0.smithi096.stdout:4/936: mknod d4/d14/d2d/d44/d58/d86/d3a/c129 0 2024-04-18T04:58:12.954 INFO:tasks.workunit.client.0.smithi096.stdout:4/937: truncate d4/d14/d2d/d44/d90/fda 151160 0 2024-04-18T04:58:12.954 INFO:tasks.workunit.client.0.smithi096.stdout:4/938: chown d4/d14/f102 6 1 2024-04-18T04:58:12.958 INFO:tasks.workunit.client.0.smithi096.stdout:4/939: creat d4/d14/d1d/da5/d11f/f12a x:0 0 0 2024-04-18T04:58:12.965 INFO:tasks.workunit.client.0.smithi096.stdout:4/940: truncate d4/d14/d2d/d44/d58/d86/d6f/f77 1422415 0 2024-04-18T04:58:12.974 INFO:tasks.workunit.client.0.smithi096.stdout:4/941: unlink d4/d14/d2d/d44/d58/d86/d3a/d39/d54/dd9/ce5 0 2024-04-18T04:58:12.984 INFO:tasks.workunit.client.0.smithi096.stdout:4/942: rmdir d4/d14/d2d/da6/dc6/dce/dfe 0 2024-04-18T04:58:12.984 INFO:tasks.workunit.client.0.smithi096.stdout:4/943: chown d4/d14/l8b 9 1 2024-04-18T04:58:12.986 INFO:tasks.workunit.client.0.smithi096.stdout:4/944: chown d4/d14/d2d/d44/d58/d86/d6f/db8/fc3 105 1 2024-04-18T04:58:12.990 INFO:tasks.workunit.client.0.smithi096.stdout:4/945: fsync d4/d14/d2d/d44/d58/d86/d3a/d39/d54/d100/f115 0 2024-04-18T04:58:12.990 INFO:tasks.workunit.client.0.smithi096.stdout:4/946: chown d4/d14/l8b 16652528 1 2024-04-18T04:58:12.990 INFO:tasks.workunit.client.0.smithi096.stdout:4/947: readlink d4/d14/d1d/da5/l11d 0 2024-04-18T04:58:12.991 INFO:tasks.workunit.client.0.smithi096.stdout:4/948: truncate d4/d14/d2d/d44/d90/fdd 773078 0 2024-04-18T04:58:12.993 INFO:tasks.workunit.client.0.smithi096.stdout:4/949: mknod d4/d14/d16/c12b 0 2024-04-18T04:58:12.996 INFO:tasks.workunit.client.0.smithi096.stdout:4/950: getdents d4/d14/d1d/da5/d67/def/df3 0 2024-04-18T04:58:12.997 INFO:tasks.workunit.client.0.smithi096.stdout:4/951: write d4/d14/d2d/d44/d58/d122/fdc [1904526,123856] 0 2024-04-18T04:58:12.999 INFO:tasks.workunit.client.0.smithi096.stdout:4/952: stat d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/la1 0 2024-04-18T04:58:13.002 INFO:tasks.workunit.client.0.smithi096.stdout:4/953: mkdir d4/d14/d2d/d44/d63/d12c 0 2024-04-18T04:58:13.005 INFO:tasks.workunit.client.0.smithi096.stdout:4/954: creat d4/d14/d1d/f12d x:0 0 0 2024-04-18T04:58:13.013 INFO:tasks.workunit.client.0.smithi096.stdout:4/955: dread d4/d14/d1d/f52 [0,4194304] 0 2024-04-18T04:58:13.018 INFO:tasks.workunit.client.0.smithi096.stdout:4/956: unlink d4/d14/d2d/da6/dc6/f126 0 2024-04-18T04:58:13.023 INFO:tasks.workunit.client.0.smithi096.stdout:4/957: rename d4/ld4 to d4/d14/d1d/da5/d67/def/d10f/l12e 0 2024-04-18T04:58:13.025 INFO:tasks.workunit.client.0.smithi096.stdout:0/942: sync 2024-04-18T04:58:13.025 INFO:tasks.workunit.client.0.smithi096.stdout:7/952: sync 2024-04-18T04:58:13.025 INFO:tasks.workunit.client.0.smithi096.stdout:8/873: sync 2024-04-18T04:58:13.028 INFO:tasks.workunit.client.0.smithi096.stdout:7/953: write db/d20/d45/dcf/dd6/ffb [989466,105553] 0 2024-04-18T04:58:13.028 INFO:tasks.workunit.client.0.smithi096.stdout:8/874: write d0/d3/d32/dee/d3c/f11b [434505,74361] 0 2024-04-18T04:58:13.030 INFO:tasks.workunit.client.0.smithi096.stdout:0/943: write d16/d1c/d4c/d4d/d5d/de8/f100 [526236,15853] 0 2024-04-18T04:58:13.033 INFO:tasks.workunit.client.0.smithi096.stdout:7/954: creat db/d1d/d82/f12b x:0 0 0 2024-04-18T04:58:13.036 INFO:tasks.workunit.client.0.smithi096.stdout:4/958: dwrite d4/d14/d2d/d44/da2/fc9 [0,4194304] 0 2024-04-18T04:58:13.036 INFO:tasks.workunit.client.0.smithi096.stdout:0/944: write d16/d1c/d4c/d4e/d67/fb4 [24672,45228] 0 2024-04-18T04:58:13.041 INFO:tasks.workunit.client.0.smithi096.stdout:7/955: creat db/d1f/f12c x:0 0 0 2024-04-18T04:58:13.045 INFO:tasks.workunit.client.0.smithi096.stdout:4/959: unlink d4/d14/d2d/d44/d58/d86/d97/lbd 0 2024-04-18T04:58:13.048 INFO:tasks.workunit.client.0.smithi096.stdout:4/960: read d4/d14/d2d/d44/d58/f65 [86348,31532] 0 2024-04-18T04:58:13.050 INFO:tasks.workunit.client.0.smithi096.stdout:4/961: fsync d4/d14/d2d/d44/d58/d86/d6f/db8/fc4 0 2024-04-18T04:58:13.050 INFO:tasks.workunit.client.0.smithi096.stdout:7/956: rename db/d20/d2f/f30 to db/d20/d45/dcf/dd6/f12d 0 2024-04-18T04:58:13.051 INFO:tasks.workunit.client.0.smithi096.stdout:0/945: dread d16/d1c/d4c/d4d/d5d/f7b [0,4194304] 0 2024-04-18T04:58:13.052 INFO:tasks.workunit.client.0.smithi096.stdout:7/957: write db/ff [3296474,129430] 0 2024-04-18T04:58:13.053 INFO:tasks.workunit.client.0.smithi096.stdout:0/946: stat d16/d1c/d4c/d6a/f116 0 2024-04-18T04:58:13.053 INFO:tasks.workunit.client.0.smithi096.stdout:7/958: fdatasync db/d1f/d5b/d6a/d74/fa7 0 2024-04-18T04:58:13.055 INFO:tasks.workunit.client.0.smithi096.stdout:9/996: sync 2024-04-18T04:58:13.061 INFO:tasks.workunit.client.0.smithi096.stdout:0/947: creat d16/d78/f126 x:0 0 0 2024-04-18T04:58:13.063 INFO:tasks.workunit.client.0.smithi096.stdout:7/959: creat db/d20/d2f/f12e x:0 0 0 2024-04-18T04:58:13.066 INFO:tasks.workunit.client.0.smithi096.stdout:9/997: symlink d0/de/d17/d56/d6d/l136 0 2024-04-18T04:58:13.073 INFO:tasks.workunit.client.0.smithi096.stdout:8/875: dwrite d0/d7/d24/d35/f8e [0,4194304] 0 2024-04-18T04:58:13.073 INFO:tasks.workunit.client.0.smithi096.stdout:7/960: creat db/d20/d45/dcf/d116/f12f x:0 0 0 2024-04-18T04:58:13.078 INFO:tasks.workunit.client.0.smithi096.stdout:7/961: write db/d1f/d5b/d6a/dc6/fea [1723894,20699] 0 2024-04-18T04:58:13.079 INFO:tasks.workunit.client.0.smithi096.stdout:9/998: creat d0/d41/d12f/f137 x:0 0 0 2024-04-18T04:58:13.080 INFO:tasks.workunit.client.0.smithi096.stdout:8/876: read d0/d3/dc1/dfe/f101 [2944935,127923] 0 2024-04-18T04:58:13.082 INFO:tasks.workunit.client.0.smithi096.stdout:7/962: truncate db/d1f/d5b/d6a/d74/f112 768985 0 2024-04-18T04:58:13.088 INFO:tasks.workunit.client.0.smithi096.stdout:0/948: write d16/d1c/d4c/d4d/fcb [811939,123360] 0 2024-04-18T04:58:13.094 INFO:tasks.workunit.client.0.smithi096.stdout:7/963: symlink db/l130 0 2024-04-18T04:58:13.094 INFO:tasks.workunit.client.0.smithi096.stdout:8/877: dwrite d0/d7/d24/d8d/fcf [0,4194304] 0 2024-04-18T04:58:13.096 INFO:tasks.workunit.client.0.smithi096.stdout:8/878: write d0/d3/dc1/f100 [452593,82864] 0 2024-04-18T04:58:13.096 INFO:tasks.workunit.client.0.smithi096.stdout:0/949: rename d16/d1d/lf2 to d16/d55/l127 0 2024-04-18T04:58:13.101 INFO:tasks.workunit.client.0.smithi096.stdout:0/950: symlink d16/d1c/d4c/d4e/d67/l128 0 2024-04-18T04:58:13.108 INFO:tasks.workunit.client.0.smithi096.stdout:9/999: dwrite d0/de/d17/d56/d59/d60/faf [0,4194304] 0 2024-04-18T04:58:13.108 INFO:tasks.workunit.client.0.smithi096.stdout:8/879: link d0/d3/d32/dee/ff3 d0/d3/d32/d6b/d7b/f11c 0 2024-04-18T04:58:13.113 INFO:tasks.workunit.client.0.smithi096.stdout:8/880: fdatasync d0/d3/fb0 0 2024-04-18T04:58:13.114 INFO:tasks.workunit.client.0.smithi096.stdout:8/881: chown d0/d3/f110 27143 1 2024-04-18T04:58:13.120 INFO:tasks.workunit.client.0.smithi096.stdout:0/951: dwrite d16/d1d/d3b/f58 [0,4194304] 0 2024-04-18T04:58:13.122 INFO:tasks.workunit.client.0.smithi096.stdout:8/882: truncate d0/d3/d32/dee/d3c/f9b 2689109 0 2024-04-18T04:58:13.127 INFO:tasks.workunit.client.0.smithi096.stdout:8/883: mkdir d0/d3/d32/d11d 0 2024-04-18T04:58:13.127 INFO:tasks.workunit.client.0.smithi096.stdout:0/952: truncate d16/d1c/d4c/d4d/d5d/d91/fe5 963889 0 2024-04-18T04:58:13.128 INFO:tasks.workunit.client.0.smithi096.stdout:8/884: symlink d0/d7/d86/l11e 0 2024-04-18T04:58:13.130 INFO:tasks.workunit.client.0.smithi096.stdout:0/953: mknod d16/d1c/d4c/d4d/d5d/de8/c129 0 2024-04-18T04:58:13.130 INFO:tasks.workunit.client.0.smithi096.stdout:8/885: dread d0/d7/d24/f82 [0,4194304] 0 2024-04-18T04:58:13.133 INFO:tasks.workunit.client.0.smithi096.stdout:0/954: dread d16/d1c/d4c/d4e/fd9 [0,4194304] 0 2024-04-18T04:58:13.135 INFO:tasks.workunit.client.0.smithi096.stdout:8/886: symlink d0/d7/d24/d18/d7c/dad/de2/l11f 0 2024-04-18T04:58:13.142 INFO:tasks.workunit.client.0.smithi096.stdout:8/887: rename d0/d15/dc3/fcd to d0/d7/d24/d18/f120 0 2024-04-18T04:58:13.144 INFO:tasks.workunit.client.0.smithi096.stdout:8/888: truncate d0/d3/d32/d6b/d7b/dc9/f10e 941489 0 2024-04-18T04:58:13.146 INFO:tasks.workunit.client.0.smithi096.stdout:8/889: write d0/d7/f73 [4150107,101670] 0 2024-04-18T04:58:13.155 INFO:tasks.workunit.client.0.smithi096.stdout:8/890: link d0/d3/d32/dee/d60/fac d0/d7/d24/d18/d7c/dad/f121 0 2024-04-18T04:58:13.169 INFO:tasks.workunit.client.0.smithi096.stdout:8/891: write d0/d7/d24/d8d/fcf [4479285,15623] 0 2024-04-18T04:58:13.170 INFO:tasks.workunit.client.0.smithi096.stdout:8/892: write d0/d7/f73 [3523529,12871] 0 2024-04-18T04:58:13.175 INFO:tasks.workunit.client.0.smithi096.stdout:8/893: creat d0/d3/d32/d6b/d7b/dc9/f122 x:0 0 0 2024-04-18T04:58:13.176 INFO:tasks.workunit.client.0.smithi096.stdout:8/894: dread - d0/d7/d24/d18/f120 zero size 2024-04-18T04:58:13.180 INFO:tasks.workunit.client.0.smithi096.stdout:8/895: stat d0/d15/d65/d8f/db6/cd1 0 2024-04-18T04:58:13.181 INFO:tasks.workunit.client.0.smithi096.stdout:4/962: sync 2024-04-18T04:58:13.186 INFO:tasks.workunit.client.0.smithi096.stdout:4/963: creat d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/f12f x:0 0 0 2024-04-18T04:58:13.187 INFO:tasks.workunit.client.0.smithi096.stdout:4/964: chown d4/d14/d2d/d44/d58/d86/d97/cf9 240033043 1 2024-04-18T04:58:13.194 INFO:tasks.workunit.client.0.smithi096.stdout:4/965: mknod d4/d14/d2d/d44/d58/d86/d3a/c130 0 2024-04-18T04:58:13.194 INFO:tasks.workunit.client.0.smithi096.stdout:4/966: dread - d4/d14/d2d/d44/d89/fed zero size 2024-04-18T04:58:13.197 INFO:tasks.workunit.client.0.smithi096.stdout:4/967: symlink d4/d14/d2d/d44/d58/d86/d3a/d39/d54/dd9/l131 0 2024-04-18T04:58:13.201 INFO:tasks.workunit.client.0.smithi096.stdout:4/968: unlink d4/d14/d2d/d44/d58/d86/d3a/d39/d54/d100/f115 0 2024-04-18T04:58:13.205 INFO:tasks.workunit.client.0.smithi096.stdout:4/969: creat d4/d14/d1d/da5/d67/def/f132 x:0 0 0 2024-04-18T04:58:13.207 INFO:tasks.workunit.client.0.smithi096.stdout:8/896: dread d0/d3/d32/d6b/d7b/dc9/fe8 [0,4194304] 0 2024-04-18T04:58:13.208 INFO:tasks.workunit.client.0.smithi096.stdout:8/897: chown d0/f75 475860 1 2024-04-18T04:58:13.209 INFO:tasks.workunit.client.0.smithi096.stdout:8/898: dread - d0/d3/d32/d6b/d7b/dc9/f122 zero size 2024-04-18T04:58:13.212 INFO:tasks.workunit.client.0.smithi096.stdout:4/970: link d4/d14/d16/fcd d4/d14/d1d/da5/d8c/f133 0 2024-04-18T04:58:13.214 INFO:tasks.workunit.client.0.smithi096.stdout:8/899: creat d0/d7/d24/d35/f123 x:0 0 0 2024-04-18T04:58:13.215 INFO:tasks.workunit.client.0.smithi096.stdout:8/900: write d0/d3/dc1/f100 [1229797,45477] 0 2024-04-18T04:58:13.216 INFO:tasks.workunit.client.0.smithi096.stdout:4/971: creat d4/d14/d1d/da5/d8c/f134 x:0 0 0 2024-04-18T04:58:13.217 INFO:tasks.workunit.client.0.smithi096.stdout:4/972: read - d4/d14/d2d/da6/ff5 zero size 2024-04-18T04:58:13.219 INFO:tasks.workunit.client.0.smithi096.stdout:4/973: write d4/d14/d2d/d44/d58/d86/d3a/d39/f56 [3280572,123797] 0 2024-04-18T04:58:13.223 INFO:tasks.workunit.client.0.smithi096.stdout:4/974: dread d4/d14/d2d/d44/d58/fe8 [0,4194304] 0 2024-04-18T04:58:13.223 INFO:tasks.workunit.client.0.smithi096.stdout:4/975: readlink d4/d14/l8b 0 2024-04-18T04:58:13.224 INFO:tasks.workunit.client.0.smithi096.stdout:8/901: link d0/f10d d0/d7/d24/f124 0 2024-04-18T04:58:13.225 INFO:tasks.workunit.client.0.smithi096.stdout:4/976: write d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/f12f [1048400,105917] 0 2024-04-18T04:58:13.225 INFO:tasks.workunit.client.0.smithi096.stdout:8/902: fdatasync d0/d7/d24/d35/f9d 0 2024-04-18T04:58:13.226 INFO:tasks.workunit.client.0.smithi096.stdout:8/903: chown d0/d3/d32/dee/f69 20404295 1 2024-04-18T04:58:13.229 INFO:tasks.workunit.client.0.smithi096.stdout:8/904: chown d0/d3/d32/dee/d3c/f9b 3 1 2024-04-18T04:58:13.289 INFO:tasks.workunit.client.0.smithi096.stdout:7/964: sync 2024-04-18T04:58:13.292 INFO:tasks.workunit.client.0.smithi096.stdout:7/965: write db/d1f/d39/d6d/d79/d83/daa/fe2 [1870885,77412] 0 2024-04-18T04:58:13.300 INFO:tasks.workunit.client.0.smithi096.stdout:7/966: rename db/d20/d45/dcf/dd6/f12d to db/d1f/d24/d61/d77/f131 0 2024-04-18T04:58:13.303 INFO:tasks.workunit.client.0.smithi096.stdout:7/967: chown db/d1f/d24/d49/d54/dc3/fce 397813367 1 2024-04-18T04:58:13.307 INFO:tasks.workunit.client.0.smithi096.stdout:7/968: symlink db/d1f/d24/d61/d77/l132 0 2024-04-18T04:58:13.309 INFO:tasks.workunit.client.0.smithi096.stdout:7/969: write db/f10d [522325,54742] 0 2024-04-18T04:58:13.312 INFO:tasks.workunit.client.0.smithi096.stdout:7/970: fsync db/d1f/f41 0 2024-04-18T04:58:13.314 INFO:tasks.workunit.client.0.smithi096.stdout:7/971: readlink db/d20/l23 0 2024-04-18T04:58:13.316 INFO:tasks.workunit.client.0.smithi096.stdout:7/972: chown db/d1f/d39/d6d/d79/d83/daa/df1/df2/l103 22 1 2024-04-18T04:58:13.320 INFO:tasks.workunit.client.0.smithi096.stdout:7/973: rmdir db/d20/d45/dcf/d116 39 2024-04-18T04:58:13.327 INFO:tasks.workunit.client.0.smithi096.stdout:7/974: creat db/d20/d45/dcf/f133 x:0 0 0 2024-04-18T04:58:13.328 INFO:tasks.workunit.client.0.smithi096.stdout:7/975: chown db/d20/d2f/dcb/fe9 926899 1 2024-04-18T04:58:13.330 INFO:tasks.workunit.client.0.smithi096.stdout:7/976: write db/d1d/f44 [3475282,113259] 0 2024-04-18T04:58:13.333 INFO:tasks.workunit.client.0.smithi096.stdout:7/977: stat db/d1f/d24/d49/d54/dc3/fce 0 2024-04-18T04:58:13.339 INFO:tasks.workunit.client.0.smithi096.stdout:7/978: unlink db/d1f/d24/d61/d77/l132 0 2024-04-18T04:58:13.340 INFO:tasks.workunit.client.0.smithi096.stdout:0/955: sync 2024-04-18T04:58:13.346 INFO:tasks.workunit.client.0.smithi096.stdout:0/956: dread d16/d1c/d4c/d6a/da3/f123 [0,4194304] 0 2024-04-18T04:58:13.348 INFO:tasks.workunit.client.0.smithi096.stdout:0/957: fdatasync d16/d1c/d4c/d4d/d5a/f70 0 2024-04-18T04:58:13.352 INFO:tasks.workunit.client.0.smithi096.stdout:0/958: truncate d16/d1c/d4c/d4e/fae 44368 0 2024-04-18T04:58:13.353 INFO:tasks.workunit.client.0.smithi096.stdout:7/979: truncate db/d1f/d5b/fe7 3835051 0 2024-04-18T04:58:13.359 INFO:tasks.workunit.client.0.smithi096.stdout:0/959: rename d16/c20 to d16/d1c/d22/db8/c12a 0 2024-04-18T04:58:13.364 INFO:tasks.workunit.client.0.smithi096.stdout:0/960: write d16/d1c/d4c/d4d/d5d/dd7/dda/fdb [5201114,38573] 0 2024-04-18T04:58:13.375 INFO:tasks.workunit.client.0.smithi096.stdout:7/980: dwrite db/d20/d45/dcf/dd6/f105 [0,4194304] 0 2024-04-18T04:58:13.377 INFO:tasks.workunit.client.0.smithi096.stdout:7/981: chown db/d20/c2d 9504 1 2024-04-18T04:58:13.382 INFO:tasks.workunit.client.0.smithi096.stdout:8/905: sync 2024-04-18T04:58:13.382 INFO:tasks.workunit.client.0.smithi096.stdout:4/977: sync 2024-04-18T04:58:13.382 INFO:tasks.workunit.client.0.smithi096.stdout:7/982: symlink db/d1f/d5b/d6a/dc6/de3/l134 0 2024-04-18T04:58:13.387 INFO:tasks.workunit.client.0.smithi096.stdout:7/983: read db/fe [2944975,49352] 0 2024-04-18T04:58:13.389 INFO:tasks.workunit.client.0.smithi096.stdout:8/906: unlink d0/d4f/dfc/c118 0 2024-04-18T04:58:13.393 INFO:tasks.workunit.client.0.smithi096.stdout:4/978: mknod d4/d14/d2d/d44/d58/d86/d6f/db8/c135 0 2024-04-18T04:58:13.394 INFO:tasks.workunit.client.0.smithi096.stdout:0/961: dread d16/d1c/d4c/fc4 [0,4194304] 0 2024-04-18T04:58:13.395 INFO:tasks.workunit.client.0.smithi096.stdout:0/962: chown d16/d55 1049897168 1 2024-04-18T04:58:13.397 INFO:tasks.workunit.client.0.smithi096.stdout:0/963: truncate d16/d1c/f56 9305687 0 2024-04-18T04:58:13.398 INFO:tasks.workunit.client.0.smithi096.stdout:7/984: unlink db/d1f/d5b/d6a/dc6/de3/l134 0 2024-04-18T04:58:13.398 INFO:tasks.workunit.client.0.smithi096.stdout:0/964: chown d16/d1d/d3b/fe6 16062 1 2024-04-18T04:58:13.400 INFO:tasks.workunit.client.0.smithi096.stdout:8/907: creat d0/d7/d24/d18/dd9/f125 x:0 0 0 2024-04-18T04:58:13.401 INFO:tasks.workunit.client.0.smithi096.stdout:4/979: fsync d4/d14/d2d/d44/d58/fe8 0 2024-04-18T04:58:13.403 INFO:tasks.workunit.client.0.smithi096.stdout:8/908: chown d0/d7/d24/d35/f9d 0 1 2024-04-18T04:58:13.407 INFO:tasks.workunit.client.0.smithi096.stdout:4/980: unlink d4/d14/d1d/da5/d8c/f133 0 2024-04-18T04:58:13.408 INFO:tasks.workunit.client.0.smithi096.stdout:7/985: link db/d1f/d24/d61/de1/ceb db/d1d/c135 0 2024-04-18T04:58:13.410 INFO:tasks.workunit.client.0.smithi096.stdout:7/986: read db/d1f/d5b/d6a/dc6/fd0 [3521600,116434] 0 2024-04-18T04:58:13.411 INFO:tasks.workunit.client.0.smithi096.stdout:8/909: rename d0/d7/c5a to d0/d7/d24/d78/c126 0 2024-04-18T04:58:13.412 INFO:tasks.workunit.client.0.smithi096.stdout:4/981: write d4/d14/d2d/d44/d58/d86/dff/f108 [2328594,47103] 0 2024-04-18T04:58:13.412 INFO:tasks.workunit.client.0.smithi096.stdout:0/965: dwrite d16/d1c/d4c/d4d/d5d/f63 [0,4194304] 0 2024-04-18T04:58:13.417 INFO:tasks.workunit.client.0.smithi096.stdout:7/987: dread - db/d20/d2f/d8d/fc1 zero size 2024-04-18T04:58:13.420 INFO:tasks.workunit.client.0.smithi096.stdout:4/982: mknod d4/d14/d2d/d44/d58/d86/d3a/d39/d54/d100/c136 0 2024-04-18T04:58:13.423 INFO:tasks.workunit.client.0.smithi096.stdout:7/988: creat db/d1f/d24/d61/d77/f136 x:0 0 0 2024-04-18T04:58:13.427 INFO:tasks.workunit.client.0.smithi096.stdout:0/966: getdents d16/d1c/d4c/d10c/d11a 0 2024-04-18T04:58:13.429 INFO:tasks.workunit.client.0.smithi096.stdout:0/967: readlink d16/d1c/d4c/d4d/d36/l104 0 2024-04-18T04:58:13.429 INFO:tasks.workunit.client.0.smithi096.stdout:8/910: dwrite d0/d3/f110 [0,4194304] 0 2024-04-18T04:58:13.431 INFO:tasks.workunit.client.0.smithi096.stdout:0/968: chown d16/d1c/d4c/d6a/da3/fed 54610510 1 2024-04-18T04:58:13.439 INFO:tasks.workunit.client.0.smithi096.stdout:7/989: dwrite db/d1f/d24/d49/d54/fd8 [0,4194304] 0 2024-04-18T04:58:13.445 INFO:tasks.workunit.client.0.smithi096.stdout:0/969: mkdir d16/d1c/d4c/d4d/d5d/dc6/d12b 0 2024-04-18T04:58:13.445 INFO:tasks.workunit.client.0.smithi096.stdout:8/911: dwrite d0/d7/d24/d35/d51/f7f [0,4194304] 0 2024-04-18T04:58:13.446 INFO:tasks.workunit.client.0.smithi096.stdout:0/970: dread d16/d1c/d4c/d4e/fd9 [0,4194304] 0 2024-04-18T04:58:13.448 INFO:tasks.workunit.client.0.smithi096.stdout:7/990: creat db/d1f/d24/d61/d77/f137 x:0 0 0 2024-04-18T04:58:13.450 INFO:tasks.workunit.client.0.smithi096.stdout:0/971: creat d16/d1c/d4c/d4d/d5d/de8/f12c x:0 0 0 2024-04-18T04:58:13.463 INFO:tasks.workunit.client.0.smithi096.stdout:7/991: dwrite db/d1f/f12c [0,4194304] 0 2024-04-18T04:58:13.468 INFO:tasks.workunit.client.0.smithi096.stdout:0/972: mkdir d16/d1c/d4c/d4d/d12d 0 2024-04-18T04:58:13.469 INFO:tasks.workunit.client.0.smithi096.stdout:7/992: chown db/d1f/d39/cb1 352027 1 2024-04-18T04:58:13.469 INFO:tasks.workunit.client.0.smithi096.stdout:7/993: fsync db/d1d/f5a 0 2024-04-18T04:58:13.476 INFO:tasks.workunit.client.0.smithi096.stdout:8/912: truncate d0/d7/d24/d35/d51/d5b/f89 4180455 0 2024-04-18T04:58:13.484 INFO:tasks.workunit.client.0.smithi096.stdout:8/913: dwrite d0/d7/d24/d18/dd9/f125 [0,4194304] 0 2024-04-18T04:58:13.491 INFO:tasks.workunit.client.0.smithi096.stdout:4/983: sync 2024-04-18T04:58:13.492 INFO:tasks.workunit.client.0.smithi096.stdout:4/984: dread - d4/d14/d1d/da5/d8c/f134 zero size 2024-04-18T04:58:13.493 INFO:tasks.workunit.client.0.smithi096.stdout:4/985: stat d4/d14/d2d/d44/d58/d86/d3a/d47/fae 0 2024-04-18T04:58:13.511 INFO:tasks.workunit.client.0.smithi096.stdout:7/994: creat db/d1f/d39/d6d/d79/d83/daa/df1/df2/f138 x:0 0 0 2024-04-18T04:58:13.515 INFO:tasks.workunit.client.0.smithi096.stdout:0/973: rmdir d16/d1c/d4c/d4d/d5d/dc6/d12b 0 2024-04-18T04:58:13.516 INFO:tasks.workunit.client.0.smithi096.stdout:0/974: fdatasync d16/d78/fe2 0 2024-04-18T04:58:13.517 INFO:tasks.workunit.client.0.smithi096.stdout:4/986: creat d4/d14/d2d/f137 x:0 0 0 2024-04-18T04:58:13.520 INFO:tasks.workunit.client.0.smithi096.stdout:7/995: dwrite db/d20/d45/f63 [0,4194304] 0 2024-04-18T04:58:13.522 INFO:tasks.workunit.client.0.smithi096.stdout:7/996: fsync db/d1f/d5b/d6a/d74/f118 0 2024-04-18T04:58:13.524 INFO:tasks.workunit.client.0.smithi096.stdout:0/975: dread d16/d1d/d3b/f58 [0,4194304] 0 2024-04-18T04:58:13.524 INFO:tasks.workunit.client.0.smithi096.stdout:4/987: truncate d4/d14/d2d/d44/d58/d86/d3a/d47/f94 1510858 0 2024-04-18T04:58:13.528 INFO:tasks.workunit.client.0.smithi096.stdout:0/976: rmdir d16/d1c/d22 39 2024-04-18T04:58:13.533 INFO:tasks.workunit.client.0.smithi096.stdout:7/997: unlink db/cd7 0 2024-04-18T04:58:13.537 INFO:tasks.workunit.client.0.smithi096.stdout:0/977: rename d16/d1c/d4c/d10c/d11a to d16/d1c/d4c/d4d/d5d/dd7/d114/d12e 0 2024-04-18T04:58:13.538 INFO:tasks.workunit.client.0.smithi096.stdout:4/988: dwrite d4/d14/d1d/da5/d67/df7/f125 [0,4194304] 0 2024-04-18T04:58:13.539 INFO:tasks.workunit.client.0.smithi096.stdout:4/989: chown d4/d14/d16 0 1 2024-04-18T04:58:13.541 INFO:tasks.workunit.client.0.smithi096.stdout:7/998: dread db/d1f/d5b/d6a/d74/f81 [0,4194304] 0 2024-04-18T04:58:13.543 INFO:tasks.workunit.client.0.smithi096.stdout:7/999: write db/d20/d2f/d8d/da1/fd3 [5139732,115102] 0 2024-04-18T04:58:13.548 INFO:tasks.workunit.client.0.smithi096.stdout:4/990: rename d4/c1b to d4/d14/d1d/da5/d67/def/d10f/c138 0 2024-04-18T04:58:13.548 INFO:tasks.workunit.client.0.smithi096.stdout:0/978: dwrite d16/d1c/d4c/d4e/d67/f8b [0,4194304] 0 2024-04-18T04:58:13.552 INFO:tasks.workunit.client.0.smithi096.stdout:4/991: rename d4/f87 to d4/d14/d2d/d44/d63/f139 0 2024-04-18T04:58:13.557 INFO:tasks.workunit.client.0.smithi096.stdout:4/992: creat d4/d14/d2d/da6/dc6/de0/f13a x:0 0 0 2024-04-18T04:58:13.558 INFO:tasks.workunit.client.0.smithi096.stdout:0/979: dwrite d16/d1c/d4c/d4d/d5a/f70 [0,4194304] 0 2024-04-18T04:58:13.560 INFO:tasks.workunit.client.0.smithi096.stdout:4/993: symlink d4/d14/d2d/d44/d63/l13b 0 2024-04-18T04:58:13.569 INFO:tasks.workunit.client.0.smithi096.stdout:0/980: dwrite d16/d1c/d4c/d4d/d5d/de8/f12c [0,4194304] 0 2024-04-18T04:58:13.570 INFO:tasks.workunit.client.0.smithi096.stdout:0/981: write d16/d1d/d3b/f107 [160086,66015] 0 2024-04-18T04:58:13.573 INFO:tasks.workunit.client.0.smithi096.stdout:0/982: fdatasync d16/d1d/d3b/f58 0 2024-04-18T04:58:13.575 INFO:tasks.workunit.client.0.smithi096.stdout:0/983: read d16/d1c/d4c/d4d/d5d/f74 [2596015,64886] 0 2024-04-18T04:58:13.575 INFO:tasks.workunit.client.0.smithi096.stdout:8/914: sync 2024-04-18T04:58:13.578 INFO:tasks.workunit.client.0.smithi096.stdout:0/984: chown d16/d1c/d22 1 1 2024-04-18T04:58:13.580 INFO:tasks.workunit.client.0.smithi096.stdout:8/915: creat d0/d7/d24/d35/d51/d5b/f127 x:0 0 0 2024-04-18T04:58:13.580 INFO:tasks.workunit.client.0.smithi096.stdout:4/994: dread d4/d14/d2d/d44/d58/fcc [0,4194304] 0 2024-04-18T04:58:13.582 INFO:tasks.workunit.client.0.smithi096.stdout:0/985: mknod d16/c12f 0 2024-04-18T04:58:13.583 INFO:tasks.workunit.client.0.smithi096.stdout:8/916: symlink d0/d15/dc3/l128 0 2024-04-18T04:58:13.586 INFO:tasks.workunit.client.0.smithi096.stdout:4/995: rename d4/f62 to d4/d14/d2d/d44/da2/f13c 0 2024-04-18T04:58:13.587 INFO:tasks.workunit.client.0.smithi096.stdout:4/996: truncate d4/d14/d1d/da5/d8c/f134 402426 0 2024-04-18T04:58:13.588 INFO:tasks.workunit.client.0.smithi096.stdout:0/986: creat d16/d1c/d4c/d4e/f130 x:0 0 0 2024-04-18T04:58:13.588 INFO:tasks.workunit.client.0.smithi096.stdout:0/987: readlink d16/d1d/d3b/l8e 0 2024-04-18T04:58:13.589 INFO:tasks.workunit.client.0.smithi096.stdout:8/917: mkdir d0/d7/d24/d18/d5d/d111/d129 0 2024-04-18T04:58:13.590 INFO:tasks.workunit.client.0.smithi096.stdout:0/988: chown d16/d1c/d22/db8/c12a 1304 1 2024-04-18T04:58:13.590 INFO:tasks.workunit.client.0.smithi096.stdout:8/918: chown d0/d7/d86/d91/le4 3879 1 2024-04-18T04:58:13.591 INFO:tasks.workunit.client.0.smithi096.stdout:8/919: rmdir d0/d15 39 2024-04-18T04:58:13.592 INFO:tasks.workunit.client.0.smithi096.stdout:0/989: fsync d16/d1c/d22/d2c/f30 0 2024-04-18T04:58:13.594 INFO:tasks.workunit.client.0.smithi096.stdout:8/920: fdatasync d0/d7/d24/d18/f2d 0 2024-04-18T04:58:13.595 INFO:tasks.workunit.client.0.smithi096.stdout:0/990: rmdir d16/d1c/d4c/d4d/d5d/dd7/d114/d12e 39 2024-04-18T04:58:13.599 INFO:tasks.workunit.client.0.smithi096.stdout:0/991: creat d16/d1c/d4c/d6a/f131 x:0 0 0 2024-04-18T04:58:13.600 INFO:tasks.workunit.client.0.smithi096.stdout:4/997: write d4/d14/d2d/d44/d58/d86/fe2 [889667,73427] 0 2024-04-18T04:58:13.601 INFO:tasks.workunit.client.0.smithi096.stdout:0/992: creat d16/d1d/d3b/dc3/f132 x:0 0 0 2024-04-18T04:58:13.601 INFO:tasks.workunit.client.0.smithi096.stdout:8/921: write d0/d7/fa6 [786571,118153] 0 2024-04-18T04:58:13.603 INFO:tasks.workunit.client.0.smithi096.stdout:4/998: unlink d4/d14/d2d/da6/dc6/de0/f13a 0 2024-04-18T04:58:13.606 INFO:tasks.workunit.client.0.smithi096.stdout:4/999: write d4/d14/d2d/d44/d58/d86/d3a/d47/d4b/d81/f12f [1706600,74801] 0 2024-04-18T04:58:13.608 INFO:tasks.workunit.client.0.smithi096.stdout:8/922: truncate d0/d7/d24/d18/d7c/dad/f121 926970 0 2024-04-18T04:58:13.609 INFO:tasks.workunit.client.0.smithi096.stdout:0/993: dwrite d16/d1d/d3b/f107 [0,4194304] 0 2024-04-18T04:58:13.610 INFO:tasks.workunit.client.0.smithi096.stdout:8/923: fdatasync d0/d3/d32/dee/ff3 0 2024-04-18T04:58:13.612 INFO:tasks.workunit.client.0.smithi096.stdout:0/994: dread d16/d1c/d4c/d4d/d5d/f7b [0,4194304] 0 2024-04-18T04:58:13.613 INFO:tasks.workunit.client.0.smithi096.stdout:8/924: mkdir d0/d7/d24/d78/d12a 0 2024-04-18T04:58:13.614 INFO:tasks.workunit.client.0.smithi096.stdout:0/995: truncate d16/d1c/d4c/d6a/ff4 438606 0 2024-04-18T04:58:13.616 INFO:tasks.workunit.client.0.smithi096.stdout:8/925: creat d0/d7/d24/d18/d7c/f12b x:0 0 0 2024-04-18T04:58:13.619 INFO:tasks.workunit.client.0.smithi096.stdout:0/996: creat d16/d1c/d22/f133 x:0 0 0 2024-04-18T04:58:13.620 INFO:tasks.workunit.client.0.smithi096.stdout:0/997: chown d16/d1c/d4c/d4d/d5d/de8 111 1 2024-04-18T04:58:13.626 INFO:tasks.workunit.client.0.smithi096.stdout:0/998: truncate d16/f60 76371 0 2024-04-18T04:58:13.627 INFO:tasks.workunit.client.0.smithi096.stdout:0/999: truncate d16/d1c/f6d 695880 0 2024-04-18T04:58:13.628 INFO:tasks.workunit.client.0.smithi096.stdout:8/926: dread d0/f102 [0,4194304] 0 2024-04-18T04:58:13.629 INFO:tasks.workunit.client.0.smithi096.stdout:8/927: chown d0/d4f/dfc/l104 2541 1 2024-04-18T04:58:13.629 INFO:tasks.workunit.client.0.smithi096.stdout:8/928: read - d0/d7/d24/d35/fdc zero size 2024-04-18T04:58:13.631 INFO:tasks.workunit.client.0.smithi096.stdout:8/929: symlink d0/d7/d24/d78/d12a/l12c 0 2024-04-18T04:58:13.633 INFO:tasks.workunit.client.0.smithi096.stdout:8/930: creat d0/d7/d24/d18/d5d/d111/f12d x:0 0 0 2024-04-18T04:58:13.641 INFO:tasks.workunit.client.0.smithi096.stdout:8/931: dwrite d0/d3/dc1/f105 [0,4194304] 0 2024-04-18T04:58:13.648 INFO:tasks.workunit.client.0.smithi096.stdout:8/932: write d0/d3/f8a [1412239,60732] 0 2024-04-18T04:58:13.652 INFO:tasks.workunit.client.0.smithi096.stdout:8/933: unlink d0/d3/fb0 0 2024-04-18T04:58:13.654 INFO:tasks.workunit.client.0.smithi096.stdout:8/934: unlink d0/f55 0 2024-04-18T04:58:13.654 INFO:tasks.workunit.client.0.smithi096.stdout:8/935: chown d0/d7/d24/d35/f5e 1290950 1 2024-04-18T04:58:13.657 INFO:tasks.workunit.client.0.smithi096.stdout:8/936: unlink d0/d7/d24/f82 0 2024-04-18T04:58:13.660 INFO:tasks.workunit.client.0.smithi096.stdout:8/937: rename d0/d7/d24/d18/f23 to d0/d4f/dfc/f12e 0 2024-04-18T04:58:13.661 INFO:tasks.workunit.client.0.smithi096.stdout:8/938: fsync d0/d7/d24/d18/d5d/fc2 0 2024-04-18T04:58:13.662 INFO:tasks.workunit.client.0.smithi096.stdout:8/939: truncate d0/d7/f50 4707442 0 2024-04-18T04:58:13.663 INFO:tasks.workunit.client.0.smithi096.stdout:8/940: chown d0/d3/d32/d6b/d7b/l112 2 1 2024-04-18T04:58:13.675 INFO:tasks.workunit.client.0.smithi096.stdout:8/941: dwrite d0/f4d [0,4194304] 0 2024-04-18T04:58:13.678 INFO:tasks.workunit.client.0.smithi096.stdout:8/942: dread d0/f26 [0,4194304] 0 2024-04-18T04:58:13.681 INFO:tasks.workunit.client.0.smithi096.stdout:8/943: read d0/d7/d24/d78/f4e [1777011,41942] 0 2024-04-18T04:58:13.689 INFO:tasks.workunit.client.0.smithi096.stdout:8/944: dwrite d0/d4f/dfc/f12e [0,4194304] 0 2024-04-18T04:58:13.696 INFO:tasks.workunit.client.0.smithi096.stdout:8/945: rename d0/d3/d32/dee/d3c/f11b to d0/d3/d32/dee/f12f 0 2024-04-18T04:58:13.698 INFO:tasks.workunit.client.0.smithi096.stdout:8/946: mkdir d0/d7/d24/d35/d51/d130 0 2024-04-18T04:58:13.701 INFO:tasks.workunit.client.0.smithi096.stdout:8/947: write d0/d15/da9/fb3 [1458356,497] 0 2024-04-18T04:58:13.702 INFO:tasks.workunit.client.0.smithi096.stdout:8/948: write d0/d7/d24/d18/d5d/d111/f12d [181587,71375] 0 2024-04-18T04:58:13.704 INFO:tasks.workunit.client.0.smithi096.stdout:8/949: write d0/d7/d24/d78/f61 [1156674,80263] 0 2024-04-18T04:58:13.715 INFO:tasks.workunit.client.0.smithi096.stdout:8/950: dread d0/d7/f2b [0,4194304] 0 2024-04-18T04:58:13.718 INFO:tasks.workunit.client.0.smithi096.stdout:8/951: mkdir d0/d3/d32/dee/df6/d131 0 2024-04-18T04:58:13.730 INFO:tasks.workunit.client.0.smithi096.stdout:8/952: dwrite d0/d3/d32/d6b/d7b/dc9/fdf [0,4194304] 0 2024-04-18T04:58:13.743 INFO:tasks.workunit.client.0.smithi096.stdout:8/953: dwrite d0/d7/d24/f34 [0,4194304] 0 2024-04-18T04:58:13.746 INFO:tasks.workunit.client.0.smithi096.stdout:8/954: mkdir d0/d7/d86/d91/d93/dec/d132 0 2024-04-18T04:58:13.749 INFO:tasks.workunit.client.0.smithi096.stdout:8/955: getdents d0/d15 0 2024-04-18T04:58:13.761 INFO:tasks.workunit.client.0.smithi096.stdout:8/956: dwrite d0/f2 [0,4194304] 0 2024-04-18T04:58:13.770 INFO:tasks.workunit.client.0.smithi096.stdout:8/957: truncate d0/d4f/fd4 1062382 0 2024-04-18T04:58:13.773 INFO:tasks.workunit.client.0.smithi096.stdout:8/958: readlink d0/d7/d24/d35/d51/d5b/le1 0 2024-04-18T04:58:13.776 INFO:tasks.workunit.client.0.smithi096.stdout:8/959: creat d0/d7/d86/d91/f133 x:0 0 0 2024-04-18T04:58:13.777 INFO:tasks.workunit.client.0.smithi096.stdout:8/960: fdatasync d0/d7/d24/d35/f5e 0 2024-04-18T04:58:13.782 INFO:tasks.workunit.client.0.smithi096.stdout:8/961: unlink d0/d15/da9/ff0 0 2024-04-18T04:58:13.787 INFO:tasks.workunit.client.0.smithi096.stdout:8/962: creat d0/d7/d86/d91/d93/dec/f134 x:0 0 0 2024-04-18T04:58:13.791 INFO:tasks.workunit.client.0.smithi096.stdout:8/963: mknod d0/d3/d32/dee/df6/d131/c135 0 2024-04-18T04:58:13.802 INFO:tasks.workunit.client.0.smithi096.stdout:8/964: write d0/d4f/f58 [387963,66368] 0 2024-04-18T04:58:13.803 INFO:tasks.workunit.client.0.smithi096.stdout:8/965: fsync d0/d3/d32/d6b/d7b/dc9/fdf 0 2024-04-18T04:58:13.807 INFO:tasks.workunit.client.0.smithi096.stdout:8/966: symlink d0/d7/d24/d18/d5d/d111/d129/l136 0 2024-04-18T04:58:13.977 INFO:tasks.workunit.client.0.smithi096.stdout:8/967: sync 2024-04-18T04:58:13.981 INFO:tasks.workunit.client.0.smithi096.stdout:8/968: fsync d0/d7/d24/d18/f2d 0 2024-04-18T04:58:13.985 INFO:tasks.workunit.client.0.smithi096.stdout:8/969: mknod d0/d7/d86/c137 0 2024-04-18T04:58:13.993 INFO:tasks.workunit.client.0.smithi096.stdout:8/970: getdents d0/d15/d65 0 2024-04-18T04:58:14.085 INFO:tasks.workunit.client.0.smithi096.stdout:8/971: sync 2024-04-18T04:58:14.091 INFO:tasks.workunit.client.0.smithi096.stdout:8/972: unlink d0/d3/d32/fcb 0 2024-04-18T04:58:14.097 INFO:tasks.workunit.client.0.smithi096.stdout:8/973: getdents d0/d3/d32/dee/df6/d131 0 2024-04-18T04:58:14.101 INFO:tasks.workunit.client.0.smithi096.stdout:8/974: symlink d0/d7/d24/d18/d7c/l138 0 2024-04-18T04:58:14.102 INFO:tasks.workunit.client.0.smithi096.stdout:8/975: readlink d0/d3/d32/d6b/d7b/l112 0 2024-04-18T04:58:14.104 INFO:tasks.workunit.client.0.smithi096.stdout:8/976: read d0/d3/dc1/f105 [1739890,40741] 0 2024-04-18T04:58:14.109 INFO:tasks.workunit.client.0.smithi096.stdout:8/977: creat d0/d15/dc3/f139 x:0 0 0 2024-04-18T04:58:14.116 INFO:tasks.workunit.client.0.smithi096.stdout:8/978: read d0/d3/d32/dee/d60/f70 [2902957,85494] 0 2024-04-18T04:58:14.126 INFO:tasks.workunit.client.0.smithi096.stdout:8/979: dread d0/d3/d32/d6b/d7b/dc9/fe8 [0,4194304] 0 2024-04-18T04:58:14.130 INFO:tasks.workunit.client.0.smithi096.stdout:8/980: chown d0/d4f/dfc/lea 41183646 1 2024-04-18T04:58:14.134 INFO:tasks.workunit.client.0.smithi096.stdout:8/981: mknod d0/d3/d32/c13a 0 2024-04-18T04:58:14.136 INFO:tasks.workunit.client.0.smithi096.stdout:8/982: dread - d0/f10d zero size 2024-04-18T04:58:14.137 INFO:tasks.workunit.client.0.smithi096.stdout:8/983: write d0/d7/fa6 [643072,5488] 0 2024-04-18T04:58:14.146 INFO:tasks.workunit.client.0.smithi096.stdout:8/984: mknod d0/d7/d24/d18/d7c/dad/c13b 0 2024-04-18T04:58:14.149 INFO:tasks.workunit.client.0.smithi096.stdout:8/985: rename d0/d7/d24/d35/d51/d5b/f127 to d0/d15/da9/f13c 0 2024-04-18T04:58:14.155 INFO:tasks.workunit.client.0.smithi096.stdout:8/986: creat d0/d7/d24/d18/d7c/dad/f13d x:0 0 0 2024-04-18T04:58:14.157 INFO:tasks.workunit.client.0.smithi096.stdout:8/987: dread - d0/d7/d86/fc4 zero size 2024-04-18T04:58:14.164 INFO:tasks.workunit.client.0.smithi096.stdout:8/988: dread d0/d7/d24/d18/d7c/dad/f121 [0,4194304] 0 2024-04-18T04:58:14.165 INFO:tasks.workunit.client.0.smithi096.stdout:8/989: stat d0/d15/d65/d8f/lb9 0 2024-04-18T04:58:14.175 INFO:tasks.workunit.client.0.smithi096.stdout:8/990: rename d0/d3/d32/la2 to d0/d3/d32/dee/l13e 0 2024-04-18T04:58:14.180 INFO:tasks.workunit.client.0.smithi096.stdout:8/991: creat d0/d15/f13f x:0 0 0 2024-04-18T04:58:14.200 INFO:tasks.workunit.client.0.smithi096.stdout:8/992: truncate d0/d3/d32/f48 730194 0 2024-04-18T04:58:14.205 INFO:tasks.workunit.client.0.smithi096.stdout:8/993: fsync d0/d7/d24/d18/d7c/dad/f121 0 2024-04-18T04:58:14.215 INFO:tasks.workunit.client.0.smithi096.stdout:8/994: creat d0/d7/d24/d18/d5d/d111/d129/f140 x:0 0 0 2024-04-18T04:58:14.220 INFO:tasks.workunit.client.0.smithi096.stdout:8/995: mkdir d0/d3/d32/d6b/d141 0 2024-04-18T04:58:14.225 INFO:tasks.workunit.client.0.smithi096.stdout:8/996: getdents d0/d15/d65 0 2024-04-18T04:58:14.230 INFO:tasks.workunit.client.0.smithi096.stdout:8/997: mkdir d0/d3/d32/dee/d142 0 2024-04-18T04:58:14.233 INFO:tasks.workunit.client.0.smithi096.stdout:8/998: stat d0/d3/d32/dee/c39 0 2024-04-18T04:58:14.235 INFO:tasks.workunit.client.0.smithi096.stdout:8/999: chown d0/d7/d86/fc4 32 1 2024-04-18T04:58:14.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm -rf -- ./tmp.vgR2QHme0q 2024-04-18T04:58:15.372 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:58:15.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.501+0000 7fbf3eb88640 1 Processor -- start 2024-04-18T04:58:15.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.501+0000 7fbf3eb88640 1 -- start start 2024-04-18T04:58:15.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3eb88640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf38153360 0x7fbf3815cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:15.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3eb88640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbf380c9b50 0x7fbf380c3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:15.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3eb88640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf38153740 con 0x7fbf380c9730 2024-04-18T04:58:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3eb88640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf380b2030 con 0x7fbf380c9b50 2024-04-18T04:58:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3eb88640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf380ca150 con 0x7fbf38153360 2024-04-18T04:58:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3d125640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbf380c9b50 0x7fbf380c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf37fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fbf380c9730 0x7fbf380ce700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46354/0 (socket says 172.21.15.96:46354) 2024-04-18T04:58:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf37fff640 1 -- 172.21.15.96:0/4215169406 learned_addr learned my addr 172.21.15.96:0/4215169406 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:58:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3c924640 1 --2- 172.21.15.96:0/4215169406 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf38153360 0x7fbf3815cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3d125640 1 -- 172.21.15.96:0/4215169406 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf38153360 msgr2=0x7fbf3815cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3d125640 1 --2- 172.21.15.96:0/4215169406 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf38153360 0x7fbf3815cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3d125640 1 -- 172.21.15.96:0/4215169406 >> v1:172.21.15.96:6789/0 conn(0x7fbf380c9730 legacy=0x7fbf380ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf377fe640 1 -- 172.21.15.96:0/4215169406 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733753392 0 0) 0x7fbf38153740 con 0x7fbf380c9730 2024-04-18T04:58:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3d125640 1 -- 172.21.15.96:0/4215169406 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf38159d80 con 0x7fbf380c9b50 2024-04-18T04:58:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3d125640 1 --2- 172.21.15.96:0/4215169406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf380c9b50 0x7fbf380c3880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbf300097c0 tx=0x7fbf3001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7331fd1b60f9fadb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf377fe640 1 -- 172.21.15.96:0/4215169406 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf300ab600 con 0x7fbf380c9b50 2024-04-18T04:58:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf377fe640 1 -- 172.21.15.96:0/4215169406 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf300a7050 con 0x7fbf380c9b50 2024-04-18T04:58:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf377fe640 1 -- 172.21.15.96:0/4215169406 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf300ab980 con 0x7fbf380c9b50 2024-04-18T04:58:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3eb88640 1 -- 172.21.15.96:0/4215169406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf380c9b50 msgr2=0x7fbf380c3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3eb88640 1 --2- 172.21.15.96:0/4215169406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf380c9b50 0x7fbf380c3880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbf300097c0 tx=0x7fbf3001c4a0 comp rx=0 tx=0).stop 2024-04-18T04:58:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3eb88640 1 -- 172.21.15.96:0/4215169406 shutdown_connections 2024-04-18T04:58:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3eb88640 1 --2- 172.21.15.96:0/4215169406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf380c9b50 0x7fbf380c3880 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3eb88640 1 --2- 172.21.15.96:0/4215169406 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf38153360 0x7fbf3815cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3eb88640 1 -- 172.21.15.96:0/4215169406 >> 172.21.15.96:0/4215169406 conn(0x7fbf38071760 msgr2=0x7fbf3806b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3eb88640 1 -- 172.21.15.96:0/4215169406 shutdown_connections 2024-04-18T04:58:15.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.505+0000 7fbf3eb88640 1 -- 172.21.15.96:0/4215169406 wait complete. 2024-04-18T04:58:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3eb88640 1 Processor -- start 2024-04-18T04:58:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3eb88640 1 -- start start 2024-04-18T04:58:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3eb88640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf380c9730 0x7fbf380cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3eb88640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf380c9b50 0x7fbf380cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3eb88640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf38153360 0x7fbf380cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3eb88640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf381420c0 con 0x7fbf380c9730 2024-04-18T04:58:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3eb88640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf38142360 con 0x7fbf380c9b50 2024-04-18T04:58:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3eb88640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf38158010 con 0x7fbf38153360 2024-04-18T04:58:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3c924640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf380c9730 0x7fbf380cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3c924640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf380c9730 0x7fbf380cc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47524/0 (socket says 172.21.15.96:47524) 2024-04-18T04:58:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf37fff640 1 -- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf380c9b50 msgr2=0x7fbf380cd7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:58:15.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3c924640 1 -- 172.21.15.96:0/128876848 learned_addr learned my addr 172.21.15.96:0/128876848 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:15.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf37fff640 1 --2- 172.21.15.96:0/128876848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf380c9b50 0x7fbf380cd7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:58:15.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3d125640 1 --2- 172.21.15.96:0/128876848 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf38153360 0x7fbf380cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:15.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3c924640 1 -- 172.21.15.96:0/128876848 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf38153360 msgr2=0x7fbf380cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:15.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3c924640 1 --2- 172.21.15.96:0/128876848 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf38153360 0x7fbf380cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:15.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3c924640 1 -- 172.21.15.96:0/128876848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf380c9b50 msgr2=0x7fbf380cd7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:58:15.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3c924640 1 --2- 172.21.15.96:0/128876848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf380c9b50 0x7fbf380cd7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:15.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3c924640 1 -- 172.21.15.96:0/128876848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf30009420 con 0x7fbf380c9730 2024-04-18T04:58:15.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3c924640 1 --2- 172.21.15.96:0/128876848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf380c9730 0x7fbf380cc740 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbf28007e40 tx=0x7fbf2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:15.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf357fa640 1 -- 172.21.15.96:0/128876848 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf28014620 con 0x7fbf380c9730 2024-04-18T04:58:15.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf357fa640 1 -- 172.21.15.96:0/128876848 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2800ee90 con 0x7fbf380c9730 2024-04-18T04:58:15.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3eb88640 1 -- 172.21.15.96:0/128876848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf381582f0 con 0x7fbf380c9730 2024-04-18T04:58:15.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf357fa640 1 -- 172.21.15.96:0/128876848 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf280149c0 con 0x7fbf380c9730 2024-04-18T04:58:15.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3eb88640 1 -- 172.21.15.96:0/128876848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf381585d0 con 0x7fbf380c9730 2024-04-18T04:58:15.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.509+0000 7fbf3eb88640 1 -- 172.21.15.96:0/128876848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf38067050 con 0x7fbf380c9730 2024-04-18T04:58:15.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.513+0000 7fbf357fa640 1 -- 172.21.15.96:0/128876848 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbf28014b20 con 0x7fbf380c9730 2024-04-18T04:58:15.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.513+0000 7fbf357fa640 1 --2- 172.21.15.96:0/128876848 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbf24066640 0x7fbf24068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:15.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.513+0000 7fbf357fa640 1 -- 172.21.15.96:0/128876848 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fbf280858e0 con 0x7fbf380c9730 2024-04-18T04:58:15.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.513+0000 7fbf37fff640 1 --2- 172.21.15.96:0/128876848 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbf24066640 0x7fbf24068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:15.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.513+0000 7fbf37fff640 1 --2- 172.21.15.96:0/128876848 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbf24066640 0x7fbf24068b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbf381530d0 tx=0x7fbf2c007ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:15.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.517+0000 7fbf357fa640 1 -- 172.21.15.96:0/128876848 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fbf28052d10 con 0x7fbf380c9730 2024-04-18T04:58:15.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.753+0000 7fbf3eb88640 1 -- 172.21.15.96:0/128876848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbf380cf460 con 0x7fbf380c9730 2024-04-18T04:58:15.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.753+0000 7fbf357fa640 1 -- 172.21.15.96:0/128876848 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fbf28056330 con 0x7fbf380c9730 2024-04-18T04:58:15.753 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:58:15.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.753+0000 7fbf3eb88640 1 -- 172.21.15.96:0/128876848 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbf24066640 msgr2=0x7fbf24068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:15.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.753+0000 7fbf3eb88640 1 --2- 172.21.15.96:0/128876848 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbf24066640 0x7fbf24068b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbf381530d0 tx=0x7fbf2c007ad0 comp rx=0 tx=0).stop 2024-04-18T04:58:15.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.753+0000 7fbf3eb88640 1 -- 172.21.15.96:0/128876848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf380c9730 msgr2=0x7fbf380cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:15.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.753+0000 7fbf3eb88640 1 --2- 172.21.15.96:0/128876848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf380c9730 0x7fbf380cc740 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbf28007e40 tx=0x7fbf2800e4b0 comp rx=0 tx=0).stop 2024-04-18T04:58:15.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.753+0000 7fbf3eb88640 1 -- 172.21.15.96:0/128876848 shutdown_connections 2024-04-18T04:58:15.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.753+0000 7fbf3eb88640 1 --2- 172.21.15.96:0/128876848 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fbf24066640 0x7fbf24068b00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:15.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.753+0000 7fbf3eb88640 1 --2- 172.21.15.96:0/128876848 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf38153360 0x7fbf380cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:15.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.753+0000 7fbf3eb88640 1 --2- 172.21.15.96:0/128876848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf380c9b50 0x7fbf380cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:15.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.753+0000 7fbf3eb88640 1 --2- 172.21.15.96:0/128876848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf380c9730 0x7fbf380cc740 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:15.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.753+0000 7fbf3eb88640 1 -- 172.21.15.96:0/128876848 >> 172.21.15.96:0/128876848 conn(0x7fbf38071760 msgr2=0x7fbf3814fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:15.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.757+0000 7fbf3eb88640 1 -- 172.21.15.96:0/128876848 shutdown_connections 2024-04-18T04:58:15.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:15.757+0000 7fbf3eb88640 1 -- 172.21.15.96:0/128876848 wait complete. 2024-04-18T04:58:17.937 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:58:17.939 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:58:18.774 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:58:18.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.901+0000 7f126ab08640 1 Processor -- start 2024-04-18T04:58:18.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f126ab08640 1 -- start start 2024-04-18T04:58:18.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f126ab08640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f12640cacc0 0x7f1264158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f126ab08640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12640c3fd0 0x7f12640ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f126ab08640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12641536b0 con 0x7f12641532d0 2024-04-18T04:58:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f126ab08640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12640c5970 con 0x7f12640cacc0 2024-04-18T04:58:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f126ab08640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12641594a0 con 0x7f12640c3fd0 2024-04-18T04:58:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f1263fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f12640cacc0 0x7f1264158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f12688a4640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f12641532d0 0x7f126415ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46370/0 (socket says 172.21.15.96:46370) 2024-04-18T04:58:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f12688a4640 1 -- 172.21.15.96:0/1416493896 learned_addr learned my addr 172.21.15.96:0/1416493896 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:58:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f12690a5640 1 --2- 172.21.15.96:0/1416493896 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12640c3fd0 0x7f12640ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f1263fff640 1 -- 172.21.15.96:0/1416493896 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12640c3fd0 msgr2=0x7f12640ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f1263fff640 1 --2- 172.21.15.96:0/1416493896 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12640c3fd0 0x7f12640ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f1263fff640 1 -- 172.21.15.96:0/1416493896 >> v1:172.21.15.96:6789/0 conn(0x7f12641532d0 legacy=0x7f126415ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:18.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f1263fff640 1 -- 172.21.15.96:0/1416493896 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1264159680 con 0x7f12640cacc0 2024-04-18T04:58:18.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f1263fff640 1 --2- 172.21.15.96:0/1416493896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12640cacc0 0x7f1264158f60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f12500097c0 tx=0x7f125001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf8778bfafff348 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:18.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f12637fe640 1 -- 172.21.15.96:0/1416493896 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12500a8990 con 0x7f12640cacc0 2024-04-18T04:58:18.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f12637fe640 1 -- 172.21.15.96:0/1416493896 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12500a8af0 con 0x7f12640cacc0 2024-04-18T04:58:18.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.905+0000 7f12637fe640 1 -- 172.21.15.96:0/1416493896 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12500a8e80 con 0x7f12640cacc0 2024-04-18T04:58:18.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 -- 172.21.15.96:0/1416493896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12640cacc0 msgr2=0x7f1264158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:18.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 --2- 172.21.15.96:0/1416493896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12640cacc0 0x7f1264158f60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f12500097c0 tx=0x7f125001ec90 comp rx=0 tx=0).stop 2024-04-18T04:58:18.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 -- 172.21.15.96:0/1416493896 shutdown_connections 2024-04-18T04:58:18.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 --2- 172.21.15.96:0/1416493896 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12640c3fd0 0x7f12640ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:18.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 --2- 172.21.15.96:0/1416493896 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12640cacc0 0x7f1264158f60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:18.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 -- 172.21.15.96:0/1416493896 >> 172.21.15.96:0/1416493896 conn(0x7f1264071760 msgr2=0x7f126406b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:18.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 -- 172.21.15.96:0/1416493896 shutdown_connections 2024-04-18T04:58:18.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 -- 172.21.15.96:0/1416493896 wait complete. 2024-04-18T04:58:18.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 Processor -- start 2024-04-18T04:58:18.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 -- start start 2024-04-18T04:58:18.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12640c3fd0 0x7f1264143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:18.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12640cacc0 0x7f126415b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:18.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12641532d0 0x7f126415bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:18.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1264159f20 con 0x7f12641532d0 2024-04-18T04:58:18.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1264147470 con 0x7f12640c3fd0 2024-04-18T04:58:18.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1264157460 con 0x7f12640cacc0 2024-04-18T04:58:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f12688a4640 1 -- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12640c3fd0 msgr2=0x7f1264143b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:58:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f12688a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12640c3fd0 0x7f1264143b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:58:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f12690a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12641532d0 0x7f126415bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f12690a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12641532d0 0x7f126415bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47542/0 (socket says 172.21.15.96:47542) 2024-04-18T04:58:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f12690a5640 1 -- 172.21.15.96:0/254100300 learned_addr learned my addr 172.21.15.96:0/254100300 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f1263fff640 1 --2- 172.21.15.96:0/254100300 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12640cacc0 0x7f126415b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f12690a5640 1 -- 172.21.15.96:0/254100300 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12640cacc0 msgr2=0x7f126415b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f12690a5640 1 --2- 172.21.15.96:0/254100300 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12640cacc0 0x7f126415b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f12690a5640 1 -- 172.21.15.96:0/254100300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12640c3fd0 msgr2=0x7f1264143b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:58:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f12690a5640 1 --2- 172.21.15.96:0/254100300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12640c3fd0 0x7f1264143b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f12690a5640 1 -- 172.21.15.96:0/254100300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1250009420 con 0x7f12641532d0 2024-04-18T04:58:18.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f12690a5640 1 --2- 172.21.15.96:0/254100300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12641532d0 0x7f126415bd70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f125c007e60 tx=0x7f125c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:18.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f12617fa640 1 -- 172.21.15.96:0/254100300 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c014620 con 0x7f12641532d0 2024-04-18T04:58:18.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f12617fa640 1 -- 172.21.15.96:0/254100300 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c014780 con 0x7f12641532d0 2024-04-18T04:58:18.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 -- 172.21.15.96:0/254100300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1264144090 con 0x7f12641532d0 2024-04-18T04:58:18.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f12617fa640 1 -- 172.21.15.96:0/254100300 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c014b30 con 0x7f12641532d0 2024-04-18T04:58:18.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.909+0000 7f126ab08640 1 -- 172.21.15.96:0/254100300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1264146ad0 con 0x7f12641532d0 2024-04-18T04:58:18.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.913+0000 7f126ab08640 1 -- 172.21.15.96:0/254100300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126415c640 con 0x7f12641532d0 2024-04-18T04:58:18.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.913+0000 7f12617fa640 1 -- 172.21.15.96:0/254100300 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f125c014c90 con 0x7f12641532d0 2024-04-18T04:58:18.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.913+0000 7f12617fa640 1 --2- 172.21.15.96:0/254100300 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1248066670 0x7f1248068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:18.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.913+0000 7f12617fa640 1 -- 172.21.15.96:0/254100300 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f125c084ad0 con 0x7f12641532d0 2024-04-18T04:58:18.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.913+0000 7f12688a4640 1 --2- 172.21.15.96:0/254100300 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1248066670 0x7f1248068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:18.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.913+0000 7f12688a4640 1 --2- 172.21.15.96:0/254100300 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1248066670 0x7f1248068b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1258004820 tx=0x7f1258007af0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:18.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:18.917+0000 7f12617fa640 1 -- 172.21.15.96:0/254100300 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f125c051eb0 con 0x7f12641532d0 2024-04-18T04:58:19.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:19.141+0000 7f126ab08640 1 -- 172.21.15.96:0/254100300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1264147790 con 0x7f12641532d0 2024-04-18T04:58:19.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:19.141+0000 7f12617fa640 1 -- 172.21.15.96:0/254100300 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f125c0554d0 con 0x7f12641532d0 2024-04-18T04:58:19.144 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:58:19.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:19.145+0000 7f126ab08640 1 -- 172.21.15.96:0/254100300 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1248066670 msgr2=0x7f1248068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:19.145+0000 7f126ab08640 1 --2- 172.21.15.96:0/254100300 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1248066670 0x7f1248068b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1258004820 tx=0x7f1258007af0 comp rx=0 tx=0).stop 2024-04-18T04:58:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:19.145+0000 7f126ab08640 1 -- 172.21.15.96:0/254100300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12641532d0 msgr2=0x7f126415bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:19.145+0000 7f126ab08640 1 --2- 172.21.15.96:0/254100300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12641532d0 0x7f126415bd70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f125c007e60 tx=0x7f125c00e4b0 comp rx=0 tx=0).stop 2024-04-18T04:58:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:19.145+0000 7f126ab08640 1 -- 172.21.15.96:0/254100300 shutdown_connections 2024-04-18T04:58:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:19.145+0000 7f126ab08640 1 --2- 172.21.15.96:0/254100300 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1248066670 0x7f1248068b30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:19.145+0000 7f126ab08640 1 --2- 172.21.15.96:0/254100300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12641532d0 0x7f126415bd70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:19.145+0000 7f126ab08640 1 --2- 172.21.15.96:0/254100300 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12640cacc0 0x7f126415b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:19.145+0000 7f126ab08640 1 --2- 172.21.15.96:0/254100300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12640c3fd0 0x7f1264143b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:19.145+0000 7f126ab08640 1 -- 172.21.15.96:0/254100300 >> 172.21.15.96:0/254100300 conn(0x7f1264071760 msgr2=0x7f12640cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:19.145+0000 7f126ab08640 1 -- 172.21.15.96:0/254100300 shutdown_connections 2024-04-18T04:58:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:19.145+0000 7f126ab08640 1 -- 172.21.15.96:0/254100300 wait complete. 2024-04-18T04:58:22.164 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:58:22.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb64a4ee640 1 Processor -- start 2024-04-18T04:58:22.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb64a4ee640 1 -- start start 2024-04-18T04:58:22.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb64a4ee640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb644150f70 0x7fb64406e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:22.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb64a4ee640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 0x7fb6440c7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:22.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb64a4ee640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64415a200 con 0x7fb64406eed0 2024-04-18T04:58:22.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb64a4ee640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64406f360 con 0x7fb6440c89e0 2024-04-18T04:58:22.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb64a4ee640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6440c7b40 con 0x7fb644150f70 2024-04-18T04:58:22.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb648a8b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 0x7fb6440c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:22.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb643fff640 1 -- >> v2:172.21.15.139:3300/0 conn(0x7fb644150f70 msgr2=0x7fb64406e990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:58:22.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb6437fe640 1 -- >> v1:172.21.15.139:6789/0 conn(0x7fb64406eed0 legacy=0x7fb6440c7fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:58:22.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb643fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb644150f70 0x7fb64406e990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:58:22.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb648a8b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 0x7fb6440c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43706/0 (socket says 172.21.15.96:43706) 2024-04-18T04:58:22.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb648a8b640 1 -- 172.21.15.96:0/552116437 learned_addr learned my addr 172.21.15.96:0/552116437 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:22.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb648a8b640 1 -- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 msgr2=0x7fb6440c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T04:58:22.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb648a8b640 1 -- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 msgr2=0x7fb6440c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:22.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb648a8b640 1 --2- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 0x7fb6440c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:22.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.305+0000 7fb648a8b640 1 --2- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 0x7fb6440c7020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:58:22.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.509+0000 7fb6437fe640 1 -- 172.21.15.96:0/552116437 >> v1:172.21.15.139:6789/0 conn(0x7fb64406eed0 legacy=0x7fb6440c7fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:58:22.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.509+0000 7fb648a8b640 1 --2- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 0x7fb6440c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:22.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.509+0000 7fb643fff640 1 -- 172.21.15.96:0/552116437 >> v2:172.21.15.139:3300/0 conn(0x7fb644150f70 msgr2=0x7fb64406e990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:58:22.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.509+0000 7fb643fff640 1 --2- 172.21.15.96:0/552116437 >> v2:172.21.15.139:3300/0 conn(0x7fb644150f70 0x7fb64406e990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:58:22.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.509+0000 7fb648a8b640 1 -- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 msgr2=0x7fb6440c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:58:22.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.509+0000 7fb648a8b640 1 -- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 msgr2=0x7fb6440c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:22.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.509+0000 7fb648a8b640 1 --2- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 0x7fb6440c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:22.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.509+0000 7fb648a8b640 1 --2- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 0x7fb6440c7020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:58:22.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.913+0000 7fb643fff640 1 -- 172.21.15.96:0/552116437 >> v2:172.21.15.139:3300/0 conn(0x7fb644150f70 msgr2=0x7fb64406e990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:58:22.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.913+0000 7fb643fff640 1 --2- 172.21.15.96:0/552116437 >> v2:172.21.15.139:3300/0 conn(0x7fb644150f70 0x7fb64406e990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:58:22.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.913+0000 7fb6437fe640 1 -- 172.21.15.96:0/552116437 >> v1:172.21.15.139:6789/0 conn(0x7fb64406eed0 legacy=0x7fb6440c7fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:58:22.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.913+0000 7fb648a8b640 1 --2- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 0x7fb6440c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:22.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.913+0000 7fb648a8b640 1 -- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 msgr2=0x7fb6440c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:58:22.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.913+0000 7fb648a8b640 1 -- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 msgr2=0x7fb6440c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:22.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.913+0000 7fb648a8b640 1 --2- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 0x7fb6440c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:22.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:22.913+0000 7fb648a8b640 1 --2- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 0x7fb6440c7020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:58:23.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:23.717+0000 7fb643fff640 1 -- 172.21.15.96:0/552116437 >> v2:172.21.15.139:3300/0 conn(0x7fb644150f70 msgr2=0x7fb64406e990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:58:23.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:23.717+0000 7fb6437fe640 1 -- 172.21.15.96:0/552116437 >> v1:172.21.15.139:6789/0 conn(0x7fb64406eed0 legacy=0x7fb6440c7fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.139:6789/0 2024-04-18T04:58:23.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:23.717+0000 7fb643fff640 1 --2- 172.21.15.96:0/552116437 >> v2:172.21.15.139:3300/0 conn(0x7fb644150f70 0x7fb64406e990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:58:23.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:23.717+0000 7fb648a8b640 1 --2- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 0x7fb6440c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:23.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:23.717+0000 7fb648a8b640 1 -- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 msgr2=0x7fb6440c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:58:23.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:23.717+0000 7fb648a8b640 1 -- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 msgr2=0x7fb6440c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:23.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:23.717+0000 7fb648a8b640 1 --2- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 0x7fb6440c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:23.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:23.717+0000 7fb648a8b640 1 --2- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 0x7fb6440c7020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:58:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.305+0000 7fb641ffb640 1 -- 172.21.15.96:0/552116437 >> v2:172.21.15.139:3300/0 conn(0x7fb644150f70 msgr2=0x7fb64406e990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:58:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.305+0000 7fb641ffb640 1 --2- 172.21.15.96:0/552116437 >> v2:172.21.15.139:3300/0 conn(0x7fb644150f70 0x7fb64406e990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.305+0000 7fb641ffb640 1 -- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 msgr2=0x7fb6440c7020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:58:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.305+0000 7fb641ffb640 1 --2- 172.21.15.96:0/552116437 >> v2:172.21.15.96:3300/0 conn(0x7fb6440c89e0 0x7fb6440c7020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.305+0000 7fb641ffb640 1 -- 172.21.15.96:0/552116437 >> v1:172.21.15.139:6789/0 conn(0x7fb64406eed0 legacy=0x7fb6440c7fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:58:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.305+0000 7fb641ffb640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb6300097c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.305+0000 7fb641ffb640 1 -- 172.21.15.96:0/552116437 --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6440b1bb0 con 0x7fb6300036d0 2024-04-18T04:58:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.305+0000 7fb641ffb640 1 -- 172.21.15.96:0/552116437 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64406f360 con 0x7fb630007300 2024-04-18T04:58:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.305+0000 7fb6437fe640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb6300097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.305+0000 7fb6437fe640 1 -- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 msgr2=0x7fb6300097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:58:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.305+0000 7fb6437fe640 1 -- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 msgr2=0x7fb6300097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.305+0000 7fb6437fe640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb6300097c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.305+0000 7fb6437fe640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb6300097c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:58:25.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.509+0000 7fb6437fe640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb6300097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:25.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.509+0000 7fb6437fe640 1 -- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 msgr2=0x7fb6300097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:58:25.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.509+0000 7fb6437fe640 1 -- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 msgr2=0x7fb6300097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:25.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.509+0000 7fb6437fe640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb6300097c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:25.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.509+0000 7fb6437fe640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb6300097c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:58:25.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.913+0000 7fb6437fe640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb6300097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:25.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.913+0000 7fb6437fe640 1 -- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 msgr2=0x7fb6300097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:58:25.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.913+0000 7fb6437fe640 1 -- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 msgr2=0x7fb6300097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:25.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.913+0000 7fb6437fe640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb6300097c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:25.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:25.913+0000 7fb6437fe640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb6300097c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:58:26.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.717+0000 7fb6437fe640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb6300097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:26.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.717+0000 7fb6437fe640 1 -- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 msgr2=0x7fb6300097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:58:26.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.717+0000 7fb6437fe640 1 -- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 msgr2=0x7fb6300097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:26.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.717+0000 7fb6437fe640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb6300097c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:26.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.717+0000 7fb6437fe640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb6300097c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:58:26.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.757+0000 7fb642ffd640 1 -- 172.21.15.96:0/552116437 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549036308 0 0) 0x7fb6440b1bb0 con 0x7fb6300036d0 2024-04-18T04:58:26.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.757+0000 7fb642ffd640 1 -- 172.21.15.96:0/552116437 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb62c003530 con 0x7fb6300036d0 2024-04-18T04:58:26.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb642ffd640 1 -- 172.21.15.96:0/552116437 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3446487416 0 0) 0x7fb62c003530 con 0x7fb6300036d0 2024-04-18T04:58:26.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb642ffd640 1 -- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 msgr2=0x7fb6300097c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:58:26.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb642ffd640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb6300097c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:26.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb642ffd640 1 -- 172.21.15.96:0/552116437 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64415a200 con 0x7fb6300036d0 2024-04-18T04:58:26.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb642ffd640 1 -- 172.21.15.96:0/552116437 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fb634004140 con 0x7fb6300036d0 2024-04-18T04:58:26.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb642ffd640 1 -- 172.21.15.96:0/552116437 >> v1:172.21.15.96:6789/0 conn(0x7fb6300036d0 legacy=0x7fb630005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:26.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb642ffd640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb62c003980 0x7fb62c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:26.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb642ffd640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb62c0047d0 0x7fb62c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb642ffd640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb62c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb642ffd640 1 -- 172.21.15.96:0/552116437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64406f360 con 0x7fb62c0047d0 2024-04-18T04:58:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb642ffd640 1 -- 172.21.15.96:0/552116437 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c00bb20 con 0x7fb62c003980 2024-04-18T04:58:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb642ffd640 1 -- 172.21.15.96:0/552116437 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c00bce0 con 0x7fb630007300 2024-04-18T04:58:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb648a8b640 1 -- 172.21.15.96:0/552116437 reap_dead start 2024-04-18T04:58:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb648a8b640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb62c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb643fff640 1 -- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb62c003980 msgr2=0x7fb62c003d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:58:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb6437fe640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb62c0047d0 0x7fb62c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb643fff640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb62c003980 0x7fb62c003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:58:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb648a8b640 1 -- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb62c003980 msgr2=0x7fb62c003d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:58:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb648a8b640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb62c003980 0x7fb62c003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb648a8b640 1 -- 172.21.15.96:0/552116437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb62c0047d0 msgr2=0x7fb62c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb648a8b640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb62c0047d0 0x7fb62c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.761+0000 7fb648a8b640 1 -- 172.21.15.96:0/552116437 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c003530 con 0x7fb630007300 2024-04-18T04:58:26.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.765+0000 7fb648a8b640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb62c005220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb6440ca150 tx=0x7fb63c01d1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=851c1e8dddc5917b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:26.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.769+0000 7fb642ffd640 1 -- 172.21.15.96:0/552116437 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0ae410 con 0x7fb630007300 2024-04-18T04:58:26.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.769+0000 7fb642ffd640 1 -- 172.21.15.96:0/552116437 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c0a8030 con 0x7fb630007300 2024-04-18T04:58:26.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.769+0000 7fb642ffd640 1 -- 172.21.15.96:0/552116437 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0ae5b0 con 0x7fb630007300 2024-04-18T04:58:26.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.769+0000 7fb64a4ee640 1 -- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 msgr2=0x7fb62c005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:26.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.769+0000 7fb64a4ee640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb62c005220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb6440ca150 tx=0x7fb63c01d1b0 comp rx=0 tx=0).stop 2024-04-18T04:58:26.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.769+0000 7fb64a4ee640 1 -- 172.21.15.96:0/552116437 shutdown_connections 2024-04-18T04:58:26.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.769+0000 7fb64a4ee640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb62c003980 0x7fb62c003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:26.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.769+0000 7fb64a4ee640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb62c0047d0 0x7fb62c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:26.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.769+0000 7fb64a4ee640 1 --2- 172.21.15.96:0/552116437 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb630007300 0x7fb62c005220 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:26.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.769+0000 7fb64a4ee640 1 -- 172.21.15.96:0/552116437 >> 172.21.15.96:0/552116437 conn(0x7fb64406a460 msgr2=0x7fb644065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:26.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.773+0000 7fb64a4ee640 1 -- 172.21.15.96:0/552116437 shutdown_connections 2024-04-18T04:58:26.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.773+0000 7fb64a4ee640 1 -- 172.21.15.96:0/552116437 wait complete. 2024-04-18T04:58:26.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.773+0000 7fb64a4ee640 1 Processor -- start 2024-04-18T04:58:26.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.773+0000 7fb64a4ee640 1 -- start start 2024-04-18T04:58:26.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb64a4ee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb62c003980 0x7fb6441eed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:26.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb64a4ee640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb62c0047d0 0x7fb6440ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:26.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb64a4ee640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb630007300 0x7fb64414b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:26.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb64a4ee640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64406b4f0 con 0x7fb630007300 2024-04-18T04:58:26.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb64a4ee640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440cbcf0 con 0x7fb62c003980 2024-04-18T04:58:26.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb64a4ee640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440cbf90 con 0x7fb62c0047d0 2024-04-18T04:58:26.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb643fff640 1 -- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb62c003980 msgr2=0x7fb6441eed60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:58:26.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb643fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb62c003980 0x7fb6441eed60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:58:26.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb648a8b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb630007300 0x7fb64414b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:26.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb648a8b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb630007300 0x7fb64414b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43738/0 (socket says 172.21.15.96:43738) 2024-04-18T04:58:26.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb648a8b640 1 -- 172.21.15.96:0/3152744090 learned_addr learned my addr 172.21.15.96:0/3152744090 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:26.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb6437fe640 1 --2- 172.21.15.96:0/3152744090 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb62c0047d0 0x7fb6440ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:26.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb648a8b640 1 -- 172.21.15.96:0/3152744090 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb62c0047d0 msgr2=0x7fb6440ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:26.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb648a8b640 1 --2- 172.21.15.96:0/3152744090 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb62c0047d0 0x7fb6440ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:26.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb648a8b640 1 -- 172.21.15.96:0/3152744090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb62c003980 msgr2=0x7fb6441eed60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:58:26.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb648a8b640 1 --2- 172.21.15.96:0/3152744090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb62c003980 0x7fb6441eed60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:26.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb648a8b640 1 -- 172.21.15.96:0/3152744090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6441ee280 con 0x7fb630007300 2024-04-18T04:58:26.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb648a8b640 1 --2- 172.21.15.96:0/3152744090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb630007300 0x7fb64414b0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb63c01cfe0 tx=0x7fb63c019f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:26.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb640ff9640 1 -- 172.21.15.96:0/3152744090 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0130b0 con 0x7fb630007300 2024-04-18T04:58:26.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb640ff9640 1 -- 172.21.15.96:0/3152744090 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c00f040 con 0x7fb630007300 2024-04-18T04:58:26.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb640ff9640 1 -- 172.21.15.96:0/3152744090 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0b9670 con 0x7fb630007300 2024-04-18T04:58:26.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb64a4ee640 1 -- 172.21.15.96:0/3152744090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6441ee560 con 0x7fb630007300 2024-04-18T04:58:26.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb64a4ee640 1 -- 172.21.15.96:0/3152744090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6440cc270 con 0x7fb630007300 2024-04-18T04:58:26.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb64a4ee640 1 -- 172.21.15.96:0/3152744090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb644067050 con 0x7fb630007300 2024-04-18T04:58:26.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.777+0000 7fb640ff9640 1 -- 172.21.15.96:0/3152744090 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb63c0b5070 con 0x7fb630007300 2024-04-18T04:58:26.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.781+0000 7fb640ff9640 1 --2- 172.21.15.96:0/3152744090 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb6300698e0 0x7fb63006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:26.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.781+0000 7fb640ff9640 1 -- 172.21.15.96:0/3152744090 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb63c11f470 con 0x7fb630007300 2024-04-18T04:58:26.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.781+0000 7fb643fff640 1 --2- 172.21.15.96:0/3152744090 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb6300698e0 0x7fb63006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:26.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.781+0000 7fb643fff640 1 --2- 172.21.15.96:0/3152744090 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb6300698e0 0x7fb63006bda0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb634000eb0 tx=0x7fb634003ff0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:26.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:26.785+0000 7fb640ff9640 1 -- 172.21.15.96:0/3152744090 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb63c0ec730 con 0x7fb630007300 2024-04-18T04:58:27.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.021+0000 7fb64a4ee640 1 -- 172.21.15.96:0/3152744090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb6441eea10 con 0x7fb630007300 2024-04-18T04:58:27.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.021+0000 7fb640ff9640 1 -- 172.21.15.96:0/3152744090 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7fb63c0b3080 con 0x7fb630007300 2024-04-18T04:58:27.024 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":40,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:58:27.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.025+0000 7fb64a4ee640 1 -- 172.21.15.96:0/3152744090 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb6300698e0 msgr2=0x7fb63006bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:27.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.025+0000 7fb64a4ee640 1 --2- 172.21.15.96:0/3152744090 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb6300698e0 0x7fb63006bda0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb634000eb0 tx=0x7fb634003ff0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.025+0000 7fb64a4ee640 1 -- 172.21.15.96:0/3152744090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb630007300 msgr2=0x7fb64414b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:27.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.025+0000 7fb64a4ee640 1 --2- 172.21.15.96:0/3152744090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb630007300 0x7fb64414b0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb63c01cfe0 tx=0x7fb63c019f50 comp rx=0 tx=0).stop 2024-04-18T04:58:27.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.025+0000 7fb64a4ee640 1 -- 172.21.15.96:0/3152744090 shutdown_connections 2024-04-18T04:58:27.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.025+0000 7fb64a4ee640 1 --2- 172.21.15.96:0/3152744090 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb6300698e0 0x7fb63006bda0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.025+0000 7fb64a4ee640 1 --2- 172.21.15.96:0/3152744090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb630007300 0x7fb64414b0c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.025+0000 7fb64a4ee640 1 --2- 172.21.15.96:0/3152744090 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb62c0047d0 0x7fb6440ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.025+0000 7fb64a4ee640 1 --2- 172.21.15.96:0/3152744090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb62c003980 0x7fb6441eed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.025+0000 7fb64a4ee640 1 -- 172.21.15.96:0/3152744090 >> 172.21.15.96:0/3152744090 conn(0x7fb64406a460 msgr2=0x7fb644065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:27.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.025+0000 7fb64a4ee640 1 -- 172.21.15.96:0/3152744090 shutdown_connections 2024-04-18T04:58:27.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.025+0000 7fb64a4ee640 1 -- 172.21.15.96:0/3152744090 wait complete. 2024-04-18T04:58:27.042 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-18T04:58:27.042 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-04-18T04:58:27.043 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T04:58:27.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f3805b90640 1 Processor -- start 2024-04-18T04:58:27.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f3805b90640 1 -- start start 2024-04-18T04:58:27.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f3805b90640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3800153230 0x7f38000b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f3805b90640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f38000c38c0 0x7f38000ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f3805b90640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38000ceb50 0x7f3800159410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f3805b90640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38000c9d40 con 0x7f3800153230 2024-04-18T04:58:27.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f3805b90640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f380015d0b0 con 0x7f38000c38c0 2024-04-18T04:58:27.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f3805b90640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38000c9780 con 0x7f38000ceb50 2024-04-18T04:58:27.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f37ff7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3800153230 0x7f38000b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:27.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f37feffd640 1 -- >> v2:172.21.15.139:3300/0 conn(0x7f38000c38c0 msgr2=0x7f38000ce610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:58:27.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f37ff7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3800153230 0x7f38000b14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43748/0 (socket says 172.21.15.96:43748) 2024-04-18T04:58:27.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f37feffd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f38000c38c0 0x7f38000ce610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:58:27.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f37ff7fe640 1 -- 172.21.15.96:0/3600428580 learned_addr learned my addr 172.21.15.96:0/3600428580 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:27.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f37fffff640 1 --2- 172.21.15.96:0/3600428580 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38000ceb50 0x7f3800159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:27.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f37ff7fe640 1 -- 172.21.15.96:0/3600428580 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38000ceb50 msgr2=0x7f3800159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:27.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f37ff7fe640 1 --2- 172.21.15.96:0/3600428580 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38000ceb50 0x7f3800159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f37ff7fe640 1 -- 172.21.15.96:0/3600428580 >> v2:172.21.15.139:3300/0 conn(0x7f38000c38c0 msgr2=0x7f38000ce610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:58:27.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f37ff7fe640 1 --2- 172.21.15.96:0/3600428580 >> v2:172.21.15.139:3300/0 conn(0x7f38000c38c0 0x7f38000ce610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.157+0000 7f37ff7fe640 1 -- 172.21.15.96:0/3600428580 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38000c9a60 con 0x7f3800153230 2024-04-18T04:58:27.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f37ff7fe640 1 --2- 172.21.15.96:0/3600428580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3800153230 0x7f38000b14e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f38000cf450 tx=0x7f37f401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899805ba10e22e72 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:27.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f37fe7fc640 1 -- 172.21.15.96:0/3600428580 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f40ad680 con 0x7f3800153230 2024-04-18T04:58:27.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f37fe7fc640 1 -- 172.21.15.96:0/3600428580 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f40ad7e0 con 0x7f3800153230 2024-04-18T04:58:27.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f37fe7fc640 1 -- 172.21.15.96:0/3600428580 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f40adb70 con 0x7f3800153230 2024-04-18T04:58:27.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 -- 172.21.15.96:0/3600428580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3800153230 msgr2=0x7f38000b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:27.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 --2- 172.21.15.96:0/3600428580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3800153230 0x7f38000b14e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f38000cf450 tx=0x7f37f401c4b0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 -- 172.21.15.96:0/3600428580 shutdown_connections 2024-04-18T04:58:27.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 --2- 172.21.15.96:0/3600428580 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38000ceb50 0x7f3800159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 --2- 172.21.15.96:0/3600428580 >> v2:172.21.15.139:3300/0 conn(0x7f38000c38c0 0x7f38000ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 --2- 172.21.15.96:0/3600428580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3800153230 0x7f38000b14e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 -- 172.21.15.96:0/3600428580 >> 172.21.15.96:0/3600428580 conn(0x7f3800071b90 msgr2=0x7f380006aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:27.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 -- 172.21.15.96:0/3600428580 shutdown_connections 2024-04-18T04:58:27.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 -- 172.21.15.96:0/3600428580 wait complete. 2024-04-18T04:58:27.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 Processor -- start 2024-04-18T04:58:27.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 -- start start 2024-04-18T04:58:27.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38000c38c0 0x7f38001588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38000ceb50 0x7f3800149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3800153230 0x7f38001f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38001f4960 con 0x7f38000c38c0 2024-04-18T04:58:27.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000cc6c0 con 0x7f3800153230 2024-04-18T04:58:27.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f3805b90640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38000cd2b0 con 0x7f38000ceb50 2024-04-18T04:58:27.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f37ff7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38000c38c0 0x7f38001588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:27.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f37ff7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38000c38c0 0x7f38001588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43760/0 (socket says 172.21.15.96:43760) 2024-04-18T04:58:27.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f37ff7fe640 1 -- 172.21.15.96:0/1926348964 learned_addr learned my addr 172.21.15.96:0/1926348964 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:27.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f37fffff640 1 -- 172.21.15.96:0/1926348964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3800153230 msgr2=0x7f38001f4df0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:58:27.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.161+0000 7f37fffff640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3800153230 0x7f38001f4df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:58:27.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37feffd640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38000ceb50 0x7f3800149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37ff7fe640 1 -- 172.21.15.96:0/1926348964 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38000ceb50 msgr2=0x7f3800149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37ff7fe640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38000ceb50 0x7f3800149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37ff7fe640 1 -- 172.21.15.96:0/1926348964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3800153230 msgr2=0x7f38001f4df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:58:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37ff7fe640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3800153230 0x7f38001f4df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37ff7fe640 1 -- 172.21.15.96:0/1926348964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f40094d0 con 0x7f38000c38c0 2024-04-18T04:58:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37feffd640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38000ceb50 0x7f3800149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:58:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37ff7fe640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38000c38c0 0x7f38001588a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f37f401ab60 tx=0x7f37f401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37e7fff640 1 -- 172.21.15.96:0/1926348964 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f40ade20 con 0x7f38000c38c0 2024-04-18T04:58:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37e7fff640 1 -- 172.21.15.96:0/1926348964 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f40b8420 con 0x7f38000c38c0 2024-04-18T04:58:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f3805b90640 1 -- 172.21.15.96:0/1926348964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38000cd590 con 0x7f38000c38c0 2024-04-18T04:58:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37e7fff640 1 -- 172.21.15.96:0/1926348964 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f40b8790 con 0x7f38000c38c0 2024-04-18T04:58:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f3805b90640 1 -- 172.21.15.96:0/1926348964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38001495d0 con 0x7f38000c38c0 2024-04-18T04:58:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f3805b90640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38000cc9a0 0x7f38001f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f3805b90640 1 -- 172.21.15.96:0/1926348964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3800072300 con 0x7f38000cc9a0 2024-04-18T04:58:27.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37feffd640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38000cc9a0 0x7f38001f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:27.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37feffd640 1 -- 172.21.15.96:0/1926348964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3800159d60 con 0x7f38000cc9a0 2024-04-18T04:58:27.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37feffd640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38000cc9a0 0x7f38001f5330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f37f000dbc0 tx=0x7f37f000b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:27.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37e7fff640 1 -- 172.21.15.96:0/1926348964 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f000bea0 con 0x7f38000cc9a0 2024-04-18T04:58:27.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37e7fff640 1 -- 172.21.15.96:0/1926348964 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f37f40b4040 con 0x7f38000c38c0 2024-04-18T04:58:27.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37e7fff640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f37ec066760 0x7f37ec068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37e7fff640 1 -- 172.21.15.96:0/1926348964 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f37f411e180 con 0x7f38000c38c0 2024-04-18T04:58:27.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37fffff640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f37ec066760 0x7f37ec068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:27.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37e7fff640 1 -- 172.21.15.96:0/1926348964 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f37f000dec0 con 0x7f38000cc9a0 2024-04-18T04:58:27.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37e7fff640 1 -- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38000cc9a0 msgr2=0x7f38001f5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:27.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37e7fff640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38000cc9a0 0x7f38001f5330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f37f000dbc0 tx=0x7f37f000b600 comp rx=0 tx=0).stop 2024-04-18T04:58:27.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37e7fff640 1 -- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38000cc9a0 msgr2=0x7f38001f5330 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:27.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37e7fff640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38000cc9a0 0x7f38001f5330 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.165+0000 7f37fffff640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f37ec066760 0x7f37ec068c20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3800153700 tx=0x7f37f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:27.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f3805b90640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3800146100 0x7f3800146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f3805b90640 1 -- 172.21.15.96:0/1926348964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000b4850 con 0x7f3800146100 2024-04-18T04:58:27.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f37feffd640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3800146100 0x7f3800146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:27.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f37feffd640 1 -- 172.21.15.96:0/1926348964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f38001f4aa0 con 0x7f3800146100 2024-04-18T04:58:27.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f37feffd640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3800146100 0x7f3800146510 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f37f000dbc0 tx=0x7f37f0005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:27.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f37e7fff640 1 -- 172.21.15.96:0/1926348964 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0019e60 con 0x7f3800146100 2024-04-18T04:58:27.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f37e7fff640 1 -- 172.21.15.96:0/1926348964 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4966 (secure 0 0 0) 0x7f37f00233a0 con 0x7f3800146100 2024-04-18T04:58:27.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f37e7fff640 1 -- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3800146100 msgr2=0x7f3800146510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:27.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f37e7fff640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3800146100 0x7f3800146510 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f37f000dbc0 tx=0x7f37f0005d60 comp rx=0 tx=0).stop 2024-04-18T04:58:27.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f37e7fff640 1 -- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3800146100 msgr2=0x7f3800146510 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:27.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f37e7fff640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3800146100 0x7f3800146510 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.175 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:58:27.175 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:58:27.175 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:58:27.175 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T04:58:27.175 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 40, 2024-04-18T04:58:27.175 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:58:27.175 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:58:27.175 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:58:27.175 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:27.175 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 0, 2024-04-18T04:58:27.175 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:27.176 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:58:27.176 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:58:27.176 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:27.176 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:27.176 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:27.176 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:27.176 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:27.176 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:27.176 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:27.176 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:27.176 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:27.176 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:27.176 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:27.176 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:58:27.176 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:58:27.177 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:27.177 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:27.177 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:27.177 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:27.177 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:27.177 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:27.177 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:27.177 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:27.177 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:27.177 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:27.177 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:27.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.177 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:58:27.177 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:58:27.178 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:58:27.178 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:58:27.178 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:58:27.178 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:58:27.178 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:27.178 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:27.178 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:58:27.178 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:58:27.178 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:58:27.178 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:58:27.178 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:58:27.178 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:58:27.178 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:58:27.179 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:27.179 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:58:27.179 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:27.179 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:27.179 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:27.179 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:27.179 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:27.179 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:27.179 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:27.179 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:27.179 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:27.179 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:27.179 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:27.179 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:58:27.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.180 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:58:27.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.180 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:58:27.180 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:58:27.180 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:27.180 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:27.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.180 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:27.180 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:58:27.180 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:27.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.180 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:27.181 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:58:27.181 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:27.181 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.181 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:27.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.181 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:58:27.181 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:58:27.181 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:27.181 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:27.181 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:27.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.181 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:58:27.181 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:58:27.182 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:27.182 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:27.182 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.182 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:27.182 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:58:27.182 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:27.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.182 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.182 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:27.182 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:58:27.182 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:27.182 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.182 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:27.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.183 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:58:27.183 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:58:27.183 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:27.183 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:27.183 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:27.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.183 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:58:27.183 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:58:27.183 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:27.183 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:27.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.183 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:27.183 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:58:27.183 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:27.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.184 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:27.184 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:58:27.184 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:27.184 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.184 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:27.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.184 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:58:27.184 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:58:27.184 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:27.184 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:27.184 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:27.184 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.184 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:58:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:58:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:58:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:27.185 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:58:27.186 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.186 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:27.186 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:58:27.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.186 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:27.186 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:27.186 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:58:27.186 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.186 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:27.186 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:58:27.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.186 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:27.186 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:27.186 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5 2024-04-18T04:58:27.187 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.187 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:27.187 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:58:27.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.187 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:27.187 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:27.187 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:27.187 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.187 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:27.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.187 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:58:27.187 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:58:27.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f3805b90640 1 -- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f37ec066760 msgr2=0x7f37ec068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:27.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f3805b90640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f37ec066760 0x7f37ec068c20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3800153700 tx=0x7f37f8008040 comp rx=0 tx=0).stop 2024-04-18T04:58:27.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f3805b90640 1 -- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38000c38c0 msgr2=0x7f38001588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:27.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f3805b90640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38000c38c0 0x7f38001588a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f37f401ab60 tx=0x7f37f401acf0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f37fffff640 1 -- 172.21.15.96:0/1926348964 reap_dead start 2024-04-18T04:58:27.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f3805b90640 1 -- 172.21.15.96:0/1926348964 shutdown_connections 2024-04-18T04:58:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f3805b90640 1 --2- 172.21.15.96:0/1926348964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38000c38c0 0x7f38001588a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f3805b90640 1 -- 172.21.15.96:0/1926348964 >> 172.21.15.96:0/1926348964 conn(0x7f3800071b90 msgr2=0x7f38000c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f3805b90640 1 -- 172.21.15.96:0/1926348964 shutdown_connections 2024-04-18T04:58:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.173+0000 7f3805b90640 1 -- 172.21.15.96:0/1926348964 wait complete. 2024-04-18T04:58:27.190 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-18T04:58:27.191 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-18T04:58:27.191 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-18T04:58:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f503c713640 1 Processor -- start 2024-04-18T04:58:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f503c713640 1 -- start start 2024-04-18T04:58:27.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f503c713640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f50340c97d0 0x7f50340cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f503c713640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f50340c9bb0 0x7f503415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f503c713640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503415c720 con 0x7f5034159010 2024-04-18T04:58:27.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f503c713640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50340cf400 con 0x7f50340c97d0 2024-04-18T04:58:27.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f503c713640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50340cc020 con 0x7f50340c9bb0 2024-04-18T04:58:27.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f5039cae640 1 -- >> v2:172.21.15.139:3300/0 conn(0x7f50340c9bb0 msgr2=0x7f503415cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:58:27.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f503a4af640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f50340c97d0 0x7f50340cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:27.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f5039cae640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f50340c9bb0 0x7f503415cee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:58:27.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f503a4af640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f50340c97d0 0x7f50340cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43784/0 (socket says 172.21.15.96:43784) 2024-04-18T04:58:27.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f503a4af640 1 -- 172.21.15.96:0/888607418 learned_addr learned my addr 172.21.15.96:0/888607418 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:27.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f503acb0640 1 --1- 172.21.15.96:0/888607418 >> v1:172.21.15.96:6789/0 conn(0x7f5034159010 0x7f50340c5b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:57810/0 (socket says 172.21.15.96:57810) 2024-04-18T04:58:27.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f503a4af640 1 -- 172.21.15.96:0/888607418 >> v2:172.21.15.139:3300/0 conn(0x7f50340c9bb0 msgr2=0x7f503415cee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:58:27.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f503a4af640 1 --2- 172.21.15.96:0/888607418 >> v2:172.21.15.139:3300/0 conn(0x7f50340c9bb0 0x7f503415cee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f503a4af640 1 -- 172.21.15.96:0/888607418 >> v1:172.21.15.96:6789/0 conn(0x7f5034159010 legacy=0x7f50340c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:27.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f503a4af640 1 -- 172.21.15.96:0/888607418 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340c6220 con 0x7f50340c97d0 2024-04-18T04:58:27.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.305+0000 7f50394ad640 1 -- 172.21.15.96:0/888607418 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239637708 0 0) 0x7f503415c720 con 0x7f5034159010 2024-04-18T04:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.309+0000 7f503a4af640 1 --2- 172.21.15.96:0/888607418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50340c97d0 0x7f50340cb0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f503406c860 tx=0x7f503001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddba816f0828ab03 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.309+0000 7f50394ad640 1 -- 172.21.15.96:0/888607418 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50300a8a30 con 0x7f50340c97d0 2024-04-18T04:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.309+0000 7f50394ad640 1 -- 172.21.15.96:0/888607418 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50300a8b90 con 0x7f50340c97d0 2024-04-18T04:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.309+0000 7f50394ad640 1 -- 172.21.15.96:0/888607418 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50300b0440 con 0x7f50340c97d0 2024-04-18T04:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.309+0000 7f503c713640 1 -- 172.21.15.96:0/888607418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50340c97d0 msgr2=0x7f50340cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.309+0000 7f503c713640 1 --2- 172.21.15.96:0/888607418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50340c97d0 0x7f50340cb0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f503406c860 tx=0x7f503001ed30 comp rx=0 tx=0).stop 2024-04-18T04:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.309+0000 7f503c713640 1 -- 172.21.15.96:0/888607418 shutdown_connections 2024-04-18T04:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.309+0000 7f503c713640 1 --2- 172.21.15.96:0/888607418 >> v2:172.21.15.139:3300/0 conn(0x7f50340c9bb0 0x7f503415cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.309+0000 7f503c713640 1 --2- 172.21.15.96:0/888607418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50340c97d0 0x7f50340cb0d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.309+0000 7f503c713640 1 -- 172.21.15.96:0/888607418 >> 172.21.15.96:0/888607418 conn(0x7f5034071990 msgr2=0x7f503406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.309+0000 7f503c713640 1 -- 172.21.15.96:0/888607418 shutdown_connections 2024-04-18T04:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.309+0000 7f503c713640 1 -- 172.21.15.96:0/888607418 wait complete. 2024-04-18T04:58:27.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.309+0000 7f503c713640 1 Processor -- start 2024-04-18T04:58:27.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.309+0000 7f503c713640 1 -- start start 2024-04-18T04:58:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503c713640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50340c97d0 0x7f5034150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503c713640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50340c9bb0 0x7f5034147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503c713640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5034159010 0x7f503415c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503c713640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5034148110 con 0x7f50340c9bb0 2024-04-18T04:58:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503c713640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503415b100 con 0x7f5034159010 2024-04-18T04:58:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503c713640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503415bc60 con 0x7f50340c97d0 2024-04-18T04:58:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f5039cae640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50340c9bb0 0x7f5034147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f5039cae640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50340c9bb0 0x7f5034147230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43790/0 (socket says 172.21.15.96:43790) 2024-04-18T04:58:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503acb0640 1 -- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5034159010 msgr2=0x7f503415c0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3300/0 2024-04-18T04:58:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f5039cae640 1 -- 172.21.15.96:0/1202413427 learned_addr learned my addr 172.21.15.96:0/1202413427 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503acb0640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5034159010 0x7f503415c0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:58:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503a4af640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50340c97d0 0x7f5034150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f5039cae640 1 -- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50340c97d0 msgr2=0x7f5034150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f5039cae640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50340c97d0 0x7f5034150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f5039cae640 1 -- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5034159010 msgr2=0x7f503415c0f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:58:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f5039cae640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5034159010 0x7f503415c0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f5039cae640 1 -- 172.21.15.96:0/1202413427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50300094d0 con 0x7f50340c9bb0 2024-04-18T04:58:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503a4af640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50340c97d0 0x7f5034150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:58:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f5039cae640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50340c9bb0 0x7f5034147230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f502400b530 tx=0x7f502400b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f502affd640 1 -- 172.21.15.96:0/1202413427 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024003dd0 con 0x7f50340c9bb0 2024-04-18T04:58:27.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f502affd640 1 -- 172.21.15.96:0/1202413427 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5024005070 con 0x7f50340c9bb0 2024-04-18T04:58:27.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503c713640 1 -- 172.21.15.96:0/1202413427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5034147870 con 0x7f50340c9bb0 2024-04-18T04:58:27.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f502affd640 1 -- 172.21.15.96:0/1202413427 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024005420 con 0x7f50340c9bb0 2024-04-18T04:58:27.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503c713640 1 -- 172.21.15.96:0/1202413427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503415b610 con 0x7f50340c9bb0 2024-04-18T04:58:27.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503c713640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f503415a170 0x7f50341f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503c713640 1 -- 172.21.15.96:0/1202413427 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5034072300 con 0x7f503415a170 2024-04-18T04:58:27.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503a4af640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f503415a170 0x7f50341f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:27.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503a4af640 1 -- 172.21.15.96:0/1202413427 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50340cbd40 con 0x7f503415a170 2024-04-18T04:58:27.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f502affd640 1 -- 172.21.15.96:0/1202413427 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5024005580 con 0x7f50340c9bb0 2024-04-18T04:58:27.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503a4af640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f503415a170 0x7f50341f1e50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f50340c9240 tx=0x7f503001d570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:27.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f502affd640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5018066670 0x7f5018068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f502affd640 1 -- 172.21.15.96:0/1202413427 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f50240840d0 con 0x7f50340c9bb0 2024-04-18T04:58:27.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f503acb0640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5018066670 0x7f5018068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:27.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.313+0000 7f502affd640 1 -- 172.21.15.96:0/1202413427 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50300b0e00 con 0x7f503415a170 2024-04-18T04:58:27.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.317+0000 7f503acb0640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5018066670 0x7f5018068b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5034159460 tx=0x7f502c007d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:27.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.317+0000 7f502affd640 1 -- 172.21.15.96:0/1202413427 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f50300b9400 con 0x7f503415a170 2024-04-18T04:58:27.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.317+0000 7f502affd640 1 -- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f503415a170 msgr2=0x7f50341f1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:27.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.317+0000 7f502affd640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f503415a170 0x7f50341f1e50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f50340c9240 tx=0x7f503001d570 comp rx=0 tx=0).stop 2024-04-18T04:58:27.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.317+0000 7f502affd640 1 -- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f503415a170 msgr2=0x7f50341f1e50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:27.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.317+0000 7f502affd640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f503415a170 0x7f50341f1e50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.321+0000 7f503c713640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50340c6750 0x7f5034145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:27.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.321+0000 7f503c713640 1 -- 172.21.15.96:0/1202413427 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50340cba60 con 0x7f50340c6750 2024-04-18T04:58:27.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.321+0000 7f503a4af640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50340c6750 0x7f5034145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:27.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.321+0000 7f503a4af640 1 -- 172.21.15.96:0/1202413427 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f503415c9c0 con 0x7f50340c6750 2024-04-18T04:58:27.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.321+0000 7f503a4af640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50340c6750 0x7f5034145520 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f50300097f0 tx=0x7f503001bad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:27.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.321+0000 7f502affd640 1 -- 172.21.15.96:0/1202413427 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50300c3cf0 con 0x7f50340c6750 2024-04-18T04:58:27.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.325+0000 7f502affd640 1 -- 172.21.15.96:0/1202413427 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4964 (secure 0 0 0) 0x7f50300c9070 con 0x7f50340c6750 2024-04-18T04:58:27.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.325+0000 7f502affd640 1 -- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50340c6750 msgr2=0x7f5034145520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:27.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.325+0000 7f502affd640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50340c6750 0x7f5034145520 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f50300097f0 tx=0x7f503001bad0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.325+0000 7f502affd640 1 -- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50340c6750 msgr2=0x7f5034145520 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:27.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.325+0000 7f502affd640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f50340c6750 0x7f5034145520 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.325 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:58:27.326 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:58:27.326 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:58:27.326 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:58:27.326 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 40, 2024-04-18T04:58:27.326 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:58:27.326 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:58:27.326 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:58:27.326 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:27.326 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 0, 2024-04-18T04:58:27.326 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:27.326 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:58:27.326 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:58:27.326 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:27.327 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:27.327 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:27.327 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:27.327 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:27.327 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:27.327 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:27.327 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:27.327 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:27.327 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:27.327 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:27.327 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:58:27.327 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:58:27.327 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:27.327 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:27.328 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:27.328 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:27.328 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:27.328 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:27.328 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:27.328 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:27.328 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:27.328 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:27.328 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:27.328 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.328 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:58:27.328 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:58:27.328 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:58:27.328 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:58:27.328 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:58:27.329 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:58:27.329 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:27.329 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:27.329 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:58:27.329 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:58:27.329 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:58:27.329 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:58:27.329 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:58:27.329 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:58:27.329 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:58:27.329 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:27.329 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:58:27.329 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:27.329 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:27.330 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:27.330 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:27.330 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:27.330 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:27.330 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:27.330 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:27.330 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:27.330 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:27.330 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:27.330 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:58:27.330 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.330 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:58:27.331 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.331 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:58:27.331 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:58:27.331 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:27.331 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:27.331 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.331 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:27.331 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:58:27.331 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:27.331 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.331 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.331 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:27.331 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:58:27.331 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:27.332 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.332 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:27.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.332 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:58:27.332 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:58:27.332 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:27.332 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:27.332 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:27.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.332 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.332 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:58:27.332 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:58:27.332 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:27.332 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:27.332 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.333 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:27.333 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:58:27.333 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:27.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.333 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.333 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:27.333 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:58:27.333 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:27.333 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.333 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:27.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.333 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:58:27.333 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:58:27.333 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:27.334 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:27.334 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:27.334 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.334 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.334 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:58:27.334 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:58:27.334 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:27.334 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:27.334 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.334 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:27.334 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:58:27.334 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:27.334 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.335 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.335 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:27.335 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:58:27.335 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:27.335 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.335 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:27.335 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.335 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:58:27.335 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:58:27.335 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:27.335 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:27.335 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:27.335 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.336 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:27.336 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.336 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:58:27.336 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:58:27.336 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.336 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:27.336 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:27.336 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:27.336 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.336 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:27.336 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:58:27.336 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.336 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:27.337 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:27.337 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:58:27.337 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.337 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:27.337 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:58:27.337 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.337 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:27.337 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:27.337 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:58:27.337 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.337 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:27.338 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:58:27.338 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.338 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:27.338 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:27.338 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:58:27.338 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.338 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:27.338 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:58:27.338 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:27.338 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:27.338 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:27.339 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:27.339 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:27.339 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:27.339 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:27.339 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:58:27.339 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:58:27.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.325+0000 7f503c713640 1 -- 172.21.15.96:0/1202413427 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5018066670 msgr2=0x7f5018068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:27.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.325+0000 7f503c713640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5018066670 0x7f5018068b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5034159460 tx=0x7f502c007d10 comp rx=0 tx=0).stop 2024-04-18T04:58:27.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.325+0000 7f503c713640 1 -- 172.21.15.96:0/1202413427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50340c9bb0 msgr2=0x7f5034147230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:27.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.325+0000 7f503c713640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50340c9bb0 0x7f5034147230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f502400b530 tx=0x7f502400b9f0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.325+0000 7f503acb0640 1 -- 172.21.15.96:0/1202413427 reap_dead start 2024-04-18T04:58:27.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.325+0000 7f503c713640 1 -- 172.21.15.96:0/1202413427 shutdown_connections 2024-04-18T04:58:27.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.325+0000 7f503c713640 1 --2- 172.21.15.96:0/1202413427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50340c9bb0 0x7f5034147230 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:27.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.325+0000 7f503c713640 1 -- 172.21.15.96:0/1202413427 >> 172.21.15.96:0/1202413427 conn(0x7f5034071990 msgr2=0x7f503414de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:27.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.325+0000 7f503c713640 1 -- 172.21.15.96:0/1202413427 shutdown_connections 2024-04-18T04:58:27.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:27.325+0000 7f503c713640 1 -- 172.21.15.96:0/1202413427 wait complete. 2024-04-18T04:58:27.341 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-18T04:58:27.341 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-18T04:58:36.143 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-18T04:58:36.144 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-18T04:58:47.342 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-18T04:58:47.342 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-04-18T04:58:47.342 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-18T04:58:47.343 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-18T04:58:47.345 INFO:tasks.ceph.mon.b:Started 2024-04-18T04:58:47.345 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-18T04:58:47.346 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:58:47.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.477+0000 7f75299ee640 1 Processor -- start 2024-04-18T04:58:47.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.477+0000 7f75299ee640 1 -- start start 2024-04-18T04:58:47.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.477+0000 7f75299ee640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 0x7f7524156550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.477+0000 7f75299ee640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7524150330 con 0x7f752414ff50 2024-04-18T04:58:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.477+0000 7f75299ee640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75240c8830 con 0x7f75240ca1a0 2024-04-18T04:58:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.477+0000 7f75299ee640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75240c7f90 con 0x7f75240ca7a0 2024-04-18T04:58:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.477+0000 7f751a7fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 0x7f7524156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.477+0000 7f7522ffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f752414ff50 0x7f75240c9a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:49842/0 (socket says 172.21.15.96:49842) 2024-04-18T04:58:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.477+0000 7f7522ffd640 1 -- 172.21.15.96:0/1841033407 learned_addr learned my addr 172.21.15.96:0/1841033407 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:58:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.477+0000 7f751a7fc640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 msgr2=0x7f7524156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:58:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.477+0000 7f751a7fc640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 msgr2=0x7f7524156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.477+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 0x7f7524156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.477+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 0x7f7524156550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:58:47.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.681+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 0x7f7524156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:47.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.681+0000 7f751a7fc640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 msgr2=0x7f7524156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:58:47.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.681+0000 7f751a7fc640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 msgr2=0x7f7524156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:47.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.681+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 0x7f7524156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:47.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:47.681+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 0x7f7524156550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:58:47.984 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:58:47.986 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:58:48.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:48.085+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 0x7f7524156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:48.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:48.085+0000 7f751a7fc640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 msgr2=0x7f7524156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:58:48.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:48.085+0000 7f751a7fc640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 msgr2=0x7f7524156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:48.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:48.085+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 0x7f7524156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:48.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:48.085+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 0x7f7524156550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:58:48.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:48.889+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 0x7f7524156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:48.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:48.889+0000 7f751a7fc640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 msgr2=0x7f7524156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:58:48.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:48.889+0000 7f751a7fc640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 msgr2=0x7f7524156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:48.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:48.889+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 0x7f7524156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:48.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:48.889+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 0x7f7524156550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:58:50.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f75217fa640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 msgr2=0x7f7524156550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:58:50.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f75217fa640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.96:3300/0 conn(0x7f75240ca7a0 0x7f7524156550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:50.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f75217fa640 1 -- 172.21.15.96:0/1841033407 >> v1:172.21.15.139:6789/0 conn(0x7f75240ca1a0 legacy=0x7f75240c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:50.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f75217fa640 1 -- 172.21.15.96:0/1841033407 >> v1:172.21.15.96:6789/0 conn(0x7f752414ff50 legacy=0x7f75240c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:50.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f75217fa640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 0x7f7504005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:50.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f75217fa640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:50.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f75217fa640 1 -- 172.21.15.96:0/1841033407 --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75240c7f90 con 0x7f75040036f0 2024-04-18T04:58:50.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f75217fa640 1 -- 172.21.15.96:0/1841033407 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7504008e00 con 0x7f7504006220 2024-04-18T04:58:50.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f7522ffd640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 0x7f7504005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:50.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:50.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f7522ffd640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 msgr2=0x7f7504005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:58:50.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f7522ffd640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 msgr2=0x7f7504005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:50.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f7522ffd640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 0x7f7504005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:50.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f7522ffd640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 0x7f7504005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:58:50.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f751a7fc640 1 -- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 msgr2=0x7f75040086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:58:50.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f751a7fc640 1 -- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 msgr2=0x7f75040086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:50.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:50.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.477+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.681+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.681+0000 7f7522ffd640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 0x7f7504005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.681+0000 7f751a7fc640 1 -- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 msgr2=0x7f75040086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.681+0000 7f751a7fc640 1 -- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 msgr2=0x7f75040086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.681+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.681+0000 7f7522ffd640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 msgr2=0x7f7504005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:58:50.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.681+0000 7f7522ffd640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 msgr2=0x7f7504005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:50.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.681+0000 7f7522ffd640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 0x7f7504005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:50.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.681+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:58:50.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:50.681+0000 7f7522ffd640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 0x7f7504005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:58:51.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.085+0000 7f7522ffd640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 0x7f7504005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:51.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.085+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:51.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.085+0000 7f7522ffd640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 msgr2=0x7f7504005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:58:51.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.085+0000 7f7522ffd640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 msgr2=0x7f7504005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:51.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.085+0000 7f7522ffd640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 0x7f7504005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:51.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.085+0000 7f7522ffd640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 0x7f7504005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:58:51.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.085+0000 7f751a7fc640 1 -- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 msgr2=0x7f75040086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:58:51.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.085+0000 7f751a7fc640 1 -- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 msgr2=0x7f75040086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:51.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.085+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:51.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.085+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:58:51.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.889+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:51.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.889+0000 7f7522ffd640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 0x7f7504005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:51.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.889+0000 7f751a7fc640 1 -- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 msgr2=0x7f75040086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:58:51.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.889+0000 7f751a7fc640 1 -- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 msgr2=0x7f75040086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:51.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.889+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:51.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.889+0000 7f751a7fc640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:58:51.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.889+0000 7f7522ffd640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 msgr2=0x7f7504005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:58:51.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.889+0000 7f7522ffd640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 msgr2=0x7f7504005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:58:51.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.889+0000 7f7522ffd640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 0x7f7504005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:58:51.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:51.889+0000 7f7522ffd640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 0x7f7504005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:58:53.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.477+0000 7f75217fa640 1 -- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 msgr2=0x7f75040086e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:58:53.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.477+0000 7f75217fa640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.477+0000 7f75217fa640 1 -- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 msgr2=0x7f7504005b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:58:53.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.477+0000 7f75217fa640 1 --2- 172.21.15.96:0/1841033407 >> v2:172.21.15.139:3300/0 conn(0x7f75040036f0 0x7f7504005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.477+0000 7f75217fa640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:53.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.477+0000 7f75237fe640 1 -- 172.21.15.96:0/1841033407 reap_dead start 2024-04-18T04:58:53.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.477+0000 7f75217fa640 1 -- 172.21.15.96:0/1841033407 --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75240c8270 con 0x7f752414ff50 2024-04-18T04:58:53.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.477+0000 7f75217fa640 1 -- 172.21.15.96:0/1841033407 --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7504004b10 con 0x7f75240ca1a0 2024-04-18T04:58:53.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.477+0000 7f75217fa640 1 -- 172.21.15.96:0/1841033407 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75240c7f90 con 0x7f7504006220 2024-04-18T04:58:53.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.477+0000 7f7522ffd640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:53.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.477+0000 7f75227fc640 1 -- 172.21.15.96:0/1841033407 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452560096 0 0) 0x7f75240c8270 con 0x7f752414ff50 2024-04-18T04:58:53.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.477+0000 7f75227fc640 1 -- 172.21.15.96:0/1841033407 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7510003530 con 0x7f752414ff50 2024-04-18T04:58:53.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.481+0000 7f7522ffd640 1 -- 172.21.15.96:0/1841033407 >> v1:172.21.15.139:6789/0 conn(0x7f75240ca1a0 legacy=0x7f750400ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:53.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.481+0000 7f7522ffd640 1 -- 172.21.15.96:0/1841033407 >> v1:172.21.15.96:6789/0 conn(0x7f752414ff50 legacy=0x7f750400b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:53.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.481+0000 7f7522ffd640 1 -- 172.21.15.96:0/1841033407 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7504005d00 con 0x7f7504006220 2024-04-18T04:58:53.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.485+0000 7f7522ffd640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7514007d30 tx=0x7f751401ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1db25273d5bd91a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:53.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.489+0000 7f75227fc640 1 -- 172.21.15.96:0/1841033407 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75140ae600 con 0x7f7504006220 2024-04-18T04:58:53.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.489+0000 7f75227fc640 1 -- 172.21.15.96:0/1841033407 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75140aa050 con 0x7f7504006220 2024-04-18T04:58:53.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.489+0000 7f75227fc640 1 -- 172.21.15.96:0/1841033407 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75140ae9c0 con 0x7f7504006220 2024-04-18T04:58:53.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.493+0000 7f75299ee640 1 -- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 msgr2=0x7f75040086e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:53.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.493+0000 7f75299ee640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7514007d30 tx=0x7f751401ef90 comp rx=0 tx=0).stop 2024-04-18T04:58:53.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.493+0000 7f75299ee640 1 -- 172.21.15.96:0/1841033407 shutdown_connections 2024-04-18T04:58:53.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.493+0000 7f75299ee640 1 --2- 172.21.15.96:0/1841033407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7504006220 0x7f75040086e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.493+0000 7f75299ee640 1 -- 172.21.15.96:0/1841033407 >> 172.21.15.96:0/1841033407 conn(0x7f7524066250 msgr2=0x7f752406eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:53.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.493+0000 7f75299ee640 1 -- 172.21.15.96:0/1841033407 shutdown_connections 2024-04-18T04:58:53.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.493+0000 7f75299ee640 1 -- 172.21.15.96:0/1841033407 wait complete. 2024-04-18T04:58:53.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.493+0000 7f75299ee640 1 Processor -- start 2024-04-18T04:58:53.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.493+0000 7f75299ee640 1 -- start start 2024-04-18T04:58:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f75299ee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7504006220 0x7f75241dc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f75299ee640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240ca1a0 0x7f7524153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f75299ee640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f752414ff50 0x7f7524153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f75299ee640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75241dc5f0 con 0x7f75240ca1a0 2024-04-18T04:58:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f75299ee640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7524153570 con 0x7f7504006220 2024-04-18T04:58:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f75299ee640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7524152750 con 0x7f752414ff50 2024-04-18T04:58:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f751a7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240ca1a0 0x7f7524153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f751a7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240ca1a0 0x7f7524153980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54316/0 (socket says 172.21.15.96:54316) 2024-04-18T04:58:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f751a7fc640 1 -- 172.21.15.96:0/240521443 learned_addr learned my addr 172.21.15.96:0/240521443 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:53.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f75237fe640 1 --2- 172.21.15.96:0/240521443 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f752414ff50 0x7f7524153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f7522ffd640 1 --2- 172.21.15.96:0/240521443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7504006220 0x7f75241dc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f751a7fc640 1 -- 172.21.15.96:0/240521443 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f752414ff50 msgr2=0x7f7524153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f751a7fc640 1 --2- 172.21.15.96:0/240521443 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f752414ff50 0x7f7524153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f751a7fc640 1 -- 172.21.15.96:0/240521443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7504006220 msgr2=0x7f75241dc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f751a7fc640 1 --2- 172.21.15.96:0/240521443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7504006220 0x7f75241dc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f751a7fc640 1 -- 172.21.15.96:0/240521443 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7524150330 con 0x7f75240ca1a0 2024-04-18T04:58:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f751a7fc640 1 --2- 172.21.15.96:0/240521443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240ca1a0 0x7f7524153980 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f750c016990 tx=0x7f750c016e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f7520ff9640 1 -- 172.21.15.96:0/240521443 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c01e070 con 0x7f75240ca1a0 2024-04-18T04:58:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f7520ff9640 1 -- 172.21.15.96:0/240521443 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c00c040 con 0x7f75240ca1a0 2024-04-18T04:58:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f75299ee640 1 -- 172.21.15.96:0/240521443 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75241529f0 con 0x7f75240ca1a0 2024-04-18T04:58:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f7520ff9640 1 -- 172.21.15.96:0/240521443 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c014d60 con 0x7f75240ca1a0 2024-04-18T04:58:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f75299ee640 1 -- 172.21.15.96:0/240521443 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7524152fb0 con 0x7f75240ca1a0 2024-04-18T04:58:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f75299ee640 1 -- 172.21.15.96:0/240521443 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7524067050 con 0x7f75240ca1a0 2024-04-18T04:58:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.497+0000 7f7520ff9640 1 -- 172.21.15.96:0/240521443 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f750c0173e0 con 0x7f75240ca1a0 2024-04-18T04:58:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.501+0000 7f7520ff9640 1 --2- 172.21.15.96:0/240521443 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f750406a100 0x7f750406c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.501+0000 7f7520ff9640 1 -- 172.21.15.96:0/240521443 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f750c084cf0 con 0x7f75240ca1a0 2024-04-18T04:58:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.501+0000 7f7522ffd640 1 --2- 172.21.15.96:0/240521443 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f750406a100 0x7f750406c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.501+0000 7f7522ffd640 1 --2- 172.21.15.96:0/240521443 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f750406a100 0x7f750406c5c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f75140b0000 tx=0x7f75140a9000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:53.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.505+0000 7f7520ff9640 1 -- 172.21.15.96:0/240521443 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f750c051fb0 con 0x7f75240ca1a0 2024-04-18T04:58:53.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.745+0000 7f75299ee640 1 -- 172.21.15.96:0/240521443 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f752414f760 con 0x7f75240ca1a0 2024-04-18T04:58:53.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.745+0000 7f7520ff9640 1 -- 172.21.15.96:0/240521443 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f750c027620 con 0x7f75240ca1a0 2024-04-18T04:58:53.746 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:58:53.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.749+0000 7f75299ee640 1 -- 172.21.15.96:0/240521443 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f750406a100 msgr2=0x7f750406c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:53.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.749+0000 7f75299ee640 1 --2- 172.21.15.96:0/240521443 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f750406a100 0x7f750406c5c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f75140b0000 tx=0x7f75140a9000 comp rx=0 tx=0).stop 2024-04-18T04:58:53.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.749+0000 7f75299ee640 1 -- 172.21.15.96:0/240521443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240ca1a0 msgr2=0x7f7524153980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:53.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.749+0000 7f75299ee640 1 --2- 172.21.15.96:0/240521443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240ca1a0 0x7f7524153980 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f750c016990 tx=0x7f750c016e50 comp rx=0 tx=0).stop 2024-04-18T04:58:53.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.749+0000 7f75299ee640 1 -- 172.21.15.96:0/240521443 shutdown_connections 2024-04-18T04:58:53.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.749+0000 7f75299ee640 1 --2- 172.21.15.96:0/240521443 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f750406a100 0x7f750406c5c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.749+0000 7f75299ee640 1 --2- 172.21.15.96:0/240521443 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f752414ff50 0x7f7524153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.749+0000 7f75299ee640 1 --2- 172.21.15.96:0/240521443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240ca1a0 0x7f7524153980 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.749+0000 7f75299ee640 1 --2- 172.21.15.96:0/240521443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7504006220 0x7f75241dc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.749+0000 7f75299ee640 1 -- 172.21.15.96:0/240521443 >> 172.21.15.96:0/240521443 conn(0x7f7524066250 msgr2=0x7f75240c9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:53.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.749+0000 7f75299ee640 1 -- 172.21.15.96:0/240521443 shutdown_connections 2024-04-18T04:58:53.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.749+0000 7f75299ee640 1 -- 172.21.15.96:0/240521443 wait complete. 2024-04-18T04:58:53.766 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-18T04:58:53.766 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-18T04:58:53.766 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T04:58:53.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.880+0000 7fd6f839d640 1 Processor -- start 2024-04-18T04:58:53.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.880+0000 7fd6f839d640 1 -- start start 2024-04-18T04:58:53.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.884+0000 7fd6f839d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd6f0070f50 0x7fd6f00c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:53.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.884+0000 7fd6f839d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd6f00c2370 0x7fd6f014f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:53.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.884+0000 7fd6f839d640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f00c42c0 con 0x7fd6f00c1f90 2024-04-18T04:58:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.884+0000 7fd6f839d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f00c3330 con 0x7fd6f0070f50 2024-04-18T04:58:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.884+0000 7fd6f839d640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f0070950 con 0x7fd6f00c2370 2024-04-18T04:58:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.884+0000 7fd6f5938640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd6f0070f50 0x7fd6f00c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.884+0000 7fd6f5938640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd6f0070f50 0x7fd6f00c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54328/0 (socket says 172.21.15.96:54328) 2024-04-18T04:58:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.884+0000 7fd6f5938640 1 -- 172.21.15.96:0/3468618143 learned_addr learned my addr 172.21.15.96:0/3468618143 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.884+0000 7fd6f5938640 1 -- 172.21.15.96:0/3468618143 >> v2:172.21.15.139:3300/0 conn(0x7fd6f00c2370 msgr2=0x7fd6f014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.884+0000 7fd6f5938640 1 --2- 172.21.15.96:0/3468618143 >> v2:172.21.15.139:3300/0 conn(0x7fd6f00c2370 0x7fd6f014f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.884+0000 7fd6f5938640 1 -- 172.21.15.96:0/3468618143 >> v1:172.21.15.139:6789/0 conn(0x7fd6f00c1f90 legacy=0x7fd6f0159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.884+0000 7fd6f5938640 1 -- 172.21.15.96:0/3468618143 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00c3cb0 con 0x7fd6f0070f50 2024-04-18T04:58:53.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.884+0000 7fd6f5938640 1 --2- 172.21.15.96:0/3468618143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f0070f50 0x7fd6f00c4750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd6f006d310 tx=0x7fd6e00213a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7facecf3653ee418 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:53.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f5137640 1 -- 172.21.15.96:0/3468618143 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00aaea0 con 0x7fd6f0070f50 2024-04-18T04:58:53.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f5137640 1 -- 172.21.15.96:0/3468618143 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e00ad050 con 0x7fd6f0070f50 2024-04-18T04:58:53.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f5137640 1 -- 172.21.15.96:0/3468618143 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00b1820 con 0x7fd6f0070f50 2024-04-18T04:58:53.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f839d640 1 -- 172.21.15.96:0/3468618143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f0070f50 msgr2=0x7fd6f00c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:53.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f839d640 1 --2- 172.21.15.96:0/3468618143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f0070f50 0x7fd6f00c4750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd6f006d310 tx=0x7fd6e00213a0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f839d640 1 -- 172.21.15.96:0/3468618143 shutdown_connections 2024-04-18T04:58:53.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f839d640 1 --2- 172.21.15.96:0/3468618143 >> v2:172.21.15.139:3300/0 conn(0x7fd6f00c2370 0x7fd6f014f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f839d640 1 --2- 172.21.15.96:0/3468618143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f0070f50 0x7fd6f00c4750 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f839d640 1 -- 172.21.15.96:0/3468618143 >> 172.21.15.96:0/3468618143 conn(0x7fd6f0069e60 msgr2=0x7fd6f006a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:53.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f839d640 1 -- 172.21.15.96:0/3468618143 shutdown_connections 2024-04-18T04:58:53.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f839d640 1 -- 172.21.15.96:0/3468618143 wait complete. 2024-04-18T04:58:53.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f839d640 1 Processor -- start 2024-04-18T04:58:53.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f839d640 1 -- start start 2024-04-18T04:58:53.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f839d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6f0070f50 0x7fd6f00c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:53.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f839d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6f00c1f90 0x7fd6f00c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:53.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f839d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f00c2370 0x7fd6f00c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f839d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01ea580 con 0x7fd6f00c2370 2024-04-18T04:58:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f839d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f0147d80 con 0x7fd6f00c1f90 2024-04-18T04:58:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f839d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01ea840 con 0x7fd6f0070f50 2024-04-18T04:58:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f693a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f00c2370 0x7fd6f00c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f693a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f00c2370 0x7fd6f00c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54332/0 (socket says 172.21.15.96:54332) 2024-04-18T04:58:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f693a640 1 -- 172.21.15.96:0/3056658825 learned_addr learned my addr 172.21.15.96:0/3056658825 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f6139640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6f0070f50 0x7fd6f00c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f693a640 1 -- 172.21.15.96:0/3056658825 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6f0070f50 msgr2=0x7fd6f00c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f693a640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6f0070f50 0x7fd6f00c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f693a640 1 -- 172.21.15.96:0/3056658825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6f00c1f90 msgr2=0x7fd6f00c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f693a640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6f00c1f90 0x7fd6f00c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f693a640 1 -- 172.21.15.96:0/3056658825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e000b770 con 0x7fd6f00c2370 2024-04-18T04:58:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.888+0000 7fd6f6139640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6f0070f50 0x7fd6f00c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:58:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6f693a640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f00c2370 0x7fd6f00c9010 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800b9e0 tx=0x7fd6e800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:53.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6e6ffd640 1 -- 172.21.15.96:0/3056658825 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e800caa0 con 0x7fd6f00c2370 2024-04-18T04:58:53.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6e6ffd640 1 -- 172.21.15.96:0/3056658825 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e800cc20 con 0x7fd6f00c2370 2024-04-18T04:58:53.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6f839d640 1 -- 172.21.15.96:0/3056658825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f01eab20 con 0x7fd6f00c2370 2024-04-18T04:58:53.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6e6ffd640 1 -- 172.21.15.96:0/3056658825 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8014440 con 0x7fd6f00c2370 2024-04-18T04:58:53.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6f839d640 1 -- 172.21.15.96:0/3056658825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f01eb0e0 con 0x7fd6f00c2370 2024-04-18T04:58:53.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6f839d640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f00c7d80 0x7fd6f01400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:53.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6f839d640 1 -- 172.21.15.96:0/3056658825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00738a0 con 0x7fd6f00c7d80 2024-04-18T04:58:53.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6f6139640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f00c7d80 0x7fd6f01400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:53.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6f6139640 1 -- 172.21.15.96:0/3056658825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6f00c3f50 con 0x7fd6f00c7d80 2024-04-18T04:58:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6e6ffd640 1 -- 172.21.15.96:0/3056658825 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd6e8007370 con 0x7fd6f00c2370 2024-04-18T04:58:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6f6139640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f00c7d80 0x7fd6f01400c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00d480 tx=0x7fd6ec00d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6e6ffd640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd6d4066690 0x7fd6d4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6e6ffd640 1 -- 172.21.15.96:0/3056658825 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd6e8084000 con 0x7fd6f00c2370 2024-04-18T04:58:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6f5938640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd6d4066690 0x7fd6d4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6e6ffd640 1 -- 172.21.15.96:0/3056658825 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec007230 con 0x7fd6f00c7d80 2024-04-18T04:58:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6e6ffd640 1 -- 172.21.15.96:0/3056658825 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fd6ec007390 con 0x7fd6f00c7d80 2024-04-18T04:58:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6e6ffd640 1 -- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f00c7d80 msgr2=0x7fd6f01400c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6e6ffd640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f00c7d80 0x7fd6f01400c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00d480 tx=0x7fd6ec00d940 comp rx=0 tx=0).stop 2024-04-18T04:58:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6e6ffd640 1 -- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f00c7d80 msgr2=0x7fd6f01400c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6e6ffd640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f00c7d80 0x7fd6f01400c0 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00d480 tx=0x7fd6ec00d940 comp rx=0 tx=0).stop 2024-04-18T04:58:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.892+0000 7fd6f5938640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd6d4066690 0x7fd6d4068b50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00b3000 tx=0x7fd6e0004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:53.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6f839d640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f01453d0 0x7fd6f0140600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:53.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6f839d640 1 -- 172.21.15.96:0/3056658825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f0070670 con 0x7fd6f01453d0 2024-04-18T04:58:53.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6f6139640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f01453d0 0x7fd6f0140600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:53.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6f6139640 1 -- 172.21.15.96:0/3056658825 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd6f00c4c90 con 0x7fd6f01453d0 2024-04-18T04:58:53.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6f6139640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f01453d0 0x7fd6f0140600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec017000 tx=0x7fd6ec003770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:53.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6e6ffd640 1 -- 172.21.15.96:0/3056658825 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec028070 con 0x7fd6f01453d0 2024-04-18T04:58:53.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6e6ffd640 1 -- 172.21.15.96:0/3056658825 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7fd6ec020040 con 0x7fd6f01453d0 2024-04-18T04:58:53.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6e6ffd640 1 -- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f01453d0 msgr2=0x7fd6f0140600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:53.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6e6ffd640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f01453d0 0x7fd6f0140600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec017000 tx=0x7fd6ec003770 comp rx=0 tx=0).stop 2024-04-18T04:58:53.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6e6ffd640 1 -- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f01453d0 msgr2=0x7fd6f0140600 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:53.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6e6ffd640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f01453d0 0x7fd6f0140600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.906 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:58:53.906 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:58:53.907 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:58:53.907 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T04:58:53.907 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 46, 2024-04-18T04:58:53.907 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:58:53.907 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:58:53.907 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:58:53.907 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:58:53.907 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:53.907 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 1, 2024-04-18T04:58:53.907 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:53.907 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:58:53.907 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:58:53.907 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:53.907 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:53.907 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:53.908 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:53.908 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:53.908 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:53.908 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:53.908 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:53.908 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:53.908 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:53.908 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:53.908 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:58:53.908 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:58:53.908 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:53.908 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:53.908 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:53.908 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:53.908 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:53.909 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:53.909 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:53.910 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:53.910 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:53.910 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:53.910 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:53.910 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:53.910 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:58:53.910 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:58:53.910 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:58:53.910 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:58:53.910 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:58:53.910 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:58:53.910 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:53.910 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:53.911 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:58:53.911 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:58:53.911 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:58:53.911 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:58:53.911 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:58:53.911 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:58:53.911 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:58:53.911 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:53.911 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:58:53.911 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:53.911 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:53.911 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:53.911 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:53.911 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:53.911 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:53.912 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:53.912 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:53.912 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:53.912 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:53.912 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:53.912 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:58:53.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:53.912 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:58:53.912 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:53.912 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:58:53.912 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:58:53.912 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:53.912 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:53.912 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:53.913 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:53.913 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:58:53.913 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:53.913 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:53.913 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:53.913 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:53.913 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:58:53.913 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:53.913 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:53.913 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:53.913 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:53.913 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:58:53.913 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:58:53.913 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:53.913 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:53.914 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:53.914 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:53.914 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:53.914 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:58:53.914 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:58:53.914 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:53.914 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:53.914 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:53.914 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:53.914 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:58:53.914 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:53.914 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:53.914 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:53.914 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:53.915 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:58:53.915 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:53.915 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:53.915 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:53.915 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:53.915 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:58:53.915 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:58:53.915 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:53.915 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:53.915 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:53.915 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:53.915 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:53.915 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:58:53.915 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:58:53.915 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:53.916 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:53.916 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:53.916 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:53.916 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:58:53.916 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:53.916 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:53.916 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:53.916 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:53.916 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:58:53.916 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:53.916 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:53.916 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:53.916 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:53.916 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:58:53.916 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:58:53.917 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:53.917 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:53.917 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:53.917 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:53.917 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:53.917 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:53.917 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:58:53.917 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:58:53.917 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:53.917 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:53.918 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:53.918 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:53.918 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:53.918 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:53.918 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:58:53.918 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:53.919 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:53.919 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:53.919 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:58:53.919 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:53.919 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:53.919 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:58:53.919 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:53.919 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:53.919 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:53.919 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:58:53.919 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:53.920 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:53.920 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:58:53.920 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:53.920 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:53.920 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:53.920 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5 2024-04-18T04:58:53.920 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:53.920 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:53.920 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:58:53.920 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:53.920 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:53.920 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:53.920 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:53.920 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:53.921 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:53.921 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:53.921 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:58:53.921 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:58:53.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6f839d640 1 -- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd6d4066690 msgr2=0x7fd6d4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6f839d640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd6d4066690 0x7fd6d4068b50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00b3000 tx=0x7fd6e0004740 comp rx=0 tx=0).stop 2024-04-18T04:58:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6f839d640 1 -- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f00c2370 msgr2=0x7fd6f00c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6f839d640 1 --2- 172.21.15.96:0/3056658825 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f00c2370 0x7fd6f00c9010 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800b9e0 tx=0x7fd6e800bea0 comp rx=0 tx=0).stop 2024-04-18T04:58:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6f693a640 1 -- 172.21.15.96:0/3056658825 reap_dead start 2024-04-18T04:58:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6f693a640 1 -- 172.21.15.96:0/3056658825 reap_dead start 2024-04-18T04:58:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6f839d640 1 -- 172.21.15.96:0/3056658825 shutdown_connections 2024-04-18T04:58:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6f839d640 1 -- 172.21.15.96:0/3056658825 >> 172.21.15.96:0/3056658825 conn(0x7fd6f0069e60 msgr2=0x7fd6f014e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6f839d640 1 -- 172.21.15.96:0/3056658825 shutdown_connections 2024-04-18T04:58:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:53.904+0000 7fd6f839d640 1 -- 172.21.15.96:0/3056658825 wait complete. 2024-04-18T04:58:53.923 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:58:53.924 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-18T04:58:53.924 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-18T04:58:54.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.036+0000 7f12da2ec640 1 Processor -- start 2024-04-18T04:58:54.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.036+0000 7f12da2ec640 1 -- start start 2024-04-18T04:58:54.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.036+0000 7f12da2ec640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f12d40c4b50 0x7f12d4065ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.036+0000 7f12da2ec640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12d4156e30 0x7f12d40b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.036+0000 7f12da2ec640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d4070870 con 0x7f12d40c4770 2024-04-18T04:58:54.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.036+0000 7f12da2ec640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d40c19f0 con 0x7f12d40c4b50 2024-04-18T04:58:54.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.036+0000 7f12da2ec640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d40c5d60 con 0x7f12d4156e30 2024-04-18T04:58:54.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.036+0000 7f12d8889640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12d4156e30 0x7f12d40b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.036+0000 7f12cbfff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f12d40c4b50 0x7f12d4065ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.036+0000 7f12d8889640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12d4156e30 0x7f12d40b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:32804/0 (socket says 172.21.15.96:32804) 2024-04-18T04:58:54.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.036+0000 7f12d8889640 1 -- 172.21.15.96:0/2962326622 learned_addr learned my addr 172.21.15.96:0/2962326622 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:54.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.036+0000 7f12cbfff640 1 -- 172.21.15.96:0/2962326622 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12d4156e30 msgr2=0x7f12d40b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:54.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.036+0000 7f12cbfff640 1 --2- 172.21.15.96:0/2962326622 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12d4156e30 0x7f12d40b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.036+0000 7f12cbfff640 1 -- 172.21.15.96:0/2962326622 >> v1:172.21.15.139:6789/0 conn(0x7f12d40c4770 legacy=0x7f12d4070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.036+0000 7f12cbfff640 1 -- 172.21.15.96:0/2962326622 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d4066220 con 0x7f12d40c4b50 2024-04-18T04:58:54.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12cbfff640 1 --2- 172.21.15.96:0/2962326622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d40c4b50 0x7f12d4065ce0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f12c40097c0 tx=0x7f12c401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b286836270202649 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:54.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12d37fe640 1 -- 172.21.15.96:0/2962326622 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c40a8990 con 0x7f12d40c4b50 2024-04-18T04:58:54.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12d37fe640 1 -- 172.21.15.96:0/2962326622 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c40a8af0 con 0x7f12d40c4b50 2024-04-18T04:58:54.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12d37fe640 1 -- 172.21.15.96:0/2962326622 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c40a8e80 con 0x7f12d40c4b50 2024-04-18T04:58:54.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12da2ec640 1 -- 172.21.15.96:0/2962326622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d40c4b50 msgr2=0x7f12d4065ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12da2ec640 1 --2- 172.21.15.96:0/2962326622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d40c4b50 0x7f12d4065ce0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f12c40097c0 tx=0x7f12c401ec90 comp rx=0 tx=0).stop 2024-04-18T04:58:54.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12da2ec640 1 -- 172.21.15.96:0/2962326622 shutdown_connections 2024-04-18T04:58:54.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12da2ec640 1 --2- 172.21.15.96:0/2962326622 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12d4156e30 0x7f12d40b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12da2ec640 1 --2- 172.21.15.96:0/2962326622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d40c4b50 0x7f12d4065ce0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12da2ec640 1 -- 172.21.15.96:0/2962326622 >> 172.21.15.96:0/2962326622 conn(0x7f12d406e020 msgr2=0x7f12d406e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:54.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12da2ec640 1 -- 172.21.15.96:0/2962326622 shutdown_connections 2024-04-18T04:58:54.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12da2ec640 1 -- 172.21.15.96:0/2962326622 wait complete. 2024-04-18T04:58:54.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12da2ec640 1 Processor -- start 2024-04-18T04:58:54.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12da2ec640 1 -- start start 2024-04-18T04:58:54.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12da2ec640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12d40c4770 0x7f12d414f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12da2ec640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d40c4b50 0x7f12d41ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12da2ec640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12d4156e30 0x7f12d41ef240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12da2ec640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d41ddf20 con 0x7f12d40c4770 2024-04-18T04:58:54.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12da2ec640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d414fde0 con 0x7f12d40c4b50 2024-04-18T04:58:54.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12da2ec640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d40c0d10 con 0x7f12d4156e30 2024-04-18T04:58:54.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12d3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12d40c4770 0x7f12d414f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12d3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12d40c4770 0x7f12d414f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54376/0 (socket says 172.21.15.96:54376) 2024-04-18T04:58:54.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12d3fff640 1 -- 172.21.15.96:0/230169844 learned_addr learned my addr 172.21.15.96:0/230169844 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:54.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.040+0000 7f12cbfff640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d40c4b50 0x7f12d41ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d8889640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12d4156e30 0x7f12d41ef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d3fff640 1 -- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12d4156e30 msgr2=0x7f12d41ef240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d3fff640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12d4156e30 0x7f12d41ef240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d3fff640 1 -- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d40c4b50 msgr2=0x7f12d41ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d3fff640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d40c4b50 0x7f12d41ed140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d3fff640 1 -- 172.21.15.96:0/230169844 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c4009420 con 0x7f12d40c4770 2024-04-18T04:58:54.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d3fff640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12d40c4770 0x7f12d414f8a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00c370 tx=0x7f12bc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:54.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d17fa640 1 -- 172.21.15.96:0/230169844 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0052d0 con 0x7f12d40c4770 2024-04-18T04:58:54.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d17fa640 1 -- 172.21.15.96:0/230169844 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc005430 con 0x7f12d40c4770 2024-04-18T04:58:54.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12da2ec640 1 -- 172.21.15.96:0/230169844 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d4155ef0 con 0x7f12d40c4770 2024-04-18T04:58:54.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d17fa640 1 -- 172.21.15.96:0/230169844 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc007260 con 0x7f12d40c4770 2024-04-18T04:58:54.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12da2ec640 1 -- 172.21.15.96:0/230169844 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d41dd960 con 0x7f12d40c4770 2024-04-18T04:58:54.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12da2ec640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d41ed680 0x7f12d41ef780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12da2ec640 1 -- 172.21.15.96:0/230169844 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d40c57a0 con 0x7f12d41ed680 2024-04-18T04:58:54.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12cbfff640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d41ed680 0x7f12d41ef780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d17fa640 1 -- 172.21.15.96:0/230169844 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f12bc0073c0 con 0x7f12d40c4770 2024-04-18T04:58:54.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12cbfff640 1 -- 172.21.15.96:0/230169844 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12d40c1f90 con 0x7f12d41ed680 2024-04-18T04:58:54.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d17fa640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f12b8066690 0x7f12b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d17fa640 1 -- 172.21.15.96:0/230169844 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f12bc083560 con 0x7f12d40c4770 2024-04-18T04:58:54.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12cbfff640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d41ed680 0x7f12d41ef780 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f12d40c54a0 tx=0x7f12c401ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:54.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d8889640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f12b8066690 0x7f12b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d17fa640 1 -- 172.21.15.96:0/230169844 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c40b0d50 con 0x7f12d41ed680 2024-04-18T04:58:54.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d8889640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f12b8066690 0x7f12b8068b50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f12d41572c0 tx=0x7f12cc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:54.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d17fa640 1 -- 172.21.15.96:0/230169844 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f12c40c2400 con 0x7f12d41ed680 2024-04-18T04:58:54.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d17fa640 1 -- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d41ed680 msgr2=0x7f12d41ef780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d17fa640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d41ed680 0x7f12d41ef780 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f12d40c54a0 tx=0x7f12c401ba30 comp rx=0 tx=0).stop 2024-04-18T04:58:54.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d17fa640 1 -- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d41ed680 msgr2=0x7f12d41ef780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:54.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.044+0000 7f12d17fa640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d41ed680 0x7f12d41ef780 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.052+0000 7f12da2ec640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d40bec00 0x7f12d41efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.052+0000 7f12da2ec640 1 -- 172.21.15.96:0/230169844 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d40c5a80 con 0x7f12d40bec00 2024-04-18T04:58:54.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.052+0000 7f12cbfff640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d40bec00 0x7f12d41efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.052+0000 7f12cbfff640 1 -- 172.21.15.96:0/230169844 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f12d406ed70 con 0x7f12d40bec00 2024-04-18T04:58:54.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.052+0000 7f12cbfff640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d40bec00 0x7f12d41efcc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f12c401ecd0 tx=0x7f12c40aa000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:54.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.052+0000 7f12d17fa640 1 -- 172.21.15.96:0/230169844 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c40c2980 con 0x7f12d40bec00 2024-04-18T04:58:54.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.052+0000 7f12d17fa640 1 -- 172.21.15.96:0/230169844 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7f12c4003ed0 con 0x7f12d40bec00 2024-04-18T04:58:54.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.052+0000 7f12d17fa640 1 -- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d40bec00 msgr2=0x7f12d41efcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.052+0000 7f12d17fa640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d40bec00 0x7f12d41efcc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f12c401ecd0 tx=0x7f12c40aa000 comp rx=0 tx=0).stop 2024-04-18T04:58:54.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.052+0000 7f12d17fa640 1 -- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d40bec00 msgr2=0x7f12d41efcc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:54.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.052+0000 7f12d17fa640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d40bec00 0x7f12d41efcc0 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f12c401ecd0 tx=0x7f12c40aa000 comp rx=0 tx=0).stop 2024-04-18T04:58:54.056 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:58:54.056 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:58:54.057 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:58:54.057 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:58:54.057 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 46, 2024-04-18T04:58:54.057 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:58:54.057 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:58:54.057 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:58:54.057 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:58:54.057 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:54.057 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 1, 2024-04-18T04:58:54.057 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:54.057 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:58:54.058 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:58:54.058 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:54.058 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:54.058 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:54.058 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:54.058 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:54.058 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:54.058 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:54.058 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:54.058 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:54.058 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:54.058 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:54.058 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:58:54.058 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:58:54.059 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:54.059 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:54.059 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:54.059 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:54.059 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:54.059 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:54.059 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:54.059 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:54.059 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:54.059 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:54.059 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:54.059 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.059 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:58:54.059 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:58:54.059 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:58:54.060 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:58:54.060 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:58:54.060 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:58:54.060 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:54.060 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:54.060 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:58:54.060 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:58:54.060 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:58:54.060 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:58:54.060 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:58:54.060 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:58:54.060 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:58:54.060 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:54.060 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:58:54.060 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:54.061 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:54.061 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:54.061 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:54.061 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:54.061 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:54.061 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:54.061 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:54.061 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:54.061 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:54.061 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:54.061 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:58:54.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.061 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:58:54.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.061 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:58:54.062 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:58:54.062 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:54.062 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:54.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.062 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:54.062 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:58:54.062 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:54.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.063 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.063 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:54.063 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:58:54.063 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:54.063 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:54.064 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:54.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.064 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:58:54.064 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:58:54.064 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:54.064 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:54.064 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:54.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.064 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:58:54.064 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:58:54.064 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:54.064 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:54.065 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.065 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:54.065 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:58:54.065 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:54.065 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.065 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.065 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:54.065 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:58:54.065 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:54.065 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:54.065 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:54.065 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.066 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:58:54.066 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:58:54.066 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:54.066 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:54.066 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:54.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.066 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:58:54.066 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:58:54.066 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:54.066 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:54.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.066 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:54.066 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:58:54.067 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:54.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.067 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:54.067 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:58:54.067 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:54.067 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:54.067 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:54.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.067 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:58:54.067 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:58:54.067 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:54.067 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:54.067 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:54.067 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:54.068 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:54.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.068 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:58:54.068 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:58:54.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.068 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:54.068 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:54.068 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:54.068 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:54.068 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:54.068 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:58:54.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.068 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:54.068 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:54.069 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:54.069 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:54.069 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:54.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.069 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:58:54.069 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:58:54.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.056+0000 7f12da2ec640 1 -- 172.21.15.96:0/230169844 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f12b8066690 msgr2=0x7f12b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.056+0000 7f12da2ec640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f12b8066690 0x7f12b8068b50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f12d41572c0 tx=0x7f12cc00b040 comp rx=0 tx=0).stop 2024-04-18T04:58:54.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.056+0000 7f12da2ec640 1 -- 172.21.15.96:0/230169844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12d40c4770 msgr2=0x7f12d414f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.056+0000 7f12da2ec640 1 --2- 172.21.15.96:0/230169844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12d40c4770 0x7f12d414f8a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00c370 tx=0x7f12bc00c830 comp rx=0 tx=0).stop 2024-04-18T04:58:54.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.056+0000 7f12d8889640 1 -- 172.21.15.96:0/230169844 reap_dead start 2024-04-18T04:58:54.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.056+0000 7f12d8889640 1 -- 172.21.15.96:0/230169844 reap_dead start 2024-04-18T04:58:54.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.056+0000 7f12da2ec640 1 -- 172.21.15.96:0/230169844 shutdown_connections 2024-04-18T04:58:54.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.056+0000 7f12da2ec640 1 -- 172.21.15.96:0/230169844 >> 172.21.15.96:0/230169844 conn(0x7f12d406e020 msgr2=0x7f12d40bdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:54.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.056+0000 7f12da2ec640 1 -- 172.21.15.96:0/230169844 shutdown_connections 2024-04-18T04:58:54.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.056+0000 7f12da2ec640 1 -- 172.21.15.96:0/230169844 wait complete. 2024-04-18T04:58:54.073 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:58:54.073 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-18T04:58:54.073 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-18T04:58:54.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.180+0000 7fa0488d4640 1 Processor -- start 2024-04-18T04:58:54.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.180+0000 7fa0488d4640 1 -- start start 2024-04-18T04:58:54.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa0488d4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa0440c6450 0x7fa0440c1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa0488d4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa0440c6830 0x7fa044156220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa0488d4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa044070d60 con 0x7fa0440c1d40 2024-04-18T04:58:54.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa0488d4640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0440c2cc0 con 0x7fa0440c6450 2024-04-18T04:58:54.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa0488d4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa044155d90 con 0x7fa0440c6830 2024-04-18T04:58:54.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa04259c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa0440c6450 0x7fa0440c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa042d9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa0440c1d40 0x7fa04414f990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:35452/0 (socket says 172.21.15.96:35452) 2024-04-18T04:58:54.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa042d9d640 1 -- 172.21.15.96:0/1683725901 learned_addr learned my addr 172.21.15.96:0/1683725901 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:58:54.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa04259c640 1 -- 172.21.15.96:0/1683725901 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa0440c6830 msgr2=0x7fa044156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:54.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa041d9b640 1 --2- 172.21.15.96:0/1683725901 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa0440c6830 0x7fa044156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa04259c640 1 --2- 172.21.15.96:0/1683725901 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa0440c6830 0x7fa044156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa04259c640 1 -- 172.21.15.96:0/1683725901 >> v1:172.21.15.96:6789/0 conn(0x7fa0440c1d40 legacy=0x7fa04414f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa04159a640 1 -- 172.21.15.96:0/1683725901 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2867069562 0 0) 0x7fa044070d60 con 0x7fa0440c1d40 2024-04-18T04:58:54.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa04259c640 1 -- 172.21.15.96:0/1683725901 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa044071750 con 0x7fa0440c6450 2024-04-18T04:58:54.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa04259c640 1 --2- 172.21.15.96:0/1683725901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0440c6450 0x7fa0440c1800 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa0340097c0 tx=0x7fa03401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf344117a2752f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:54.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa04159a640 1 -- 172.21.15.96:0/1683725901 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0340a8990 con 0x7fa0440c6450 2024-04-18T04:58:54.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa04159a640 1 -- 172.21.15.96:0/1683725901 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0340a8af0 con 0x7fa0440c6450 2024-04-18T04:58:54.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa04159a640 1 -- 172.21.15.96:0/1683725901 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0340a8e80 con 0x7fa0440c6450 2024-04-18T04:58:54.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa0488d4640 1 -- 172.21.15.96:0/1683725901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0440c6450 msgr2=0x7fa0440c1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.184+0000 7fa0488d4640 1 --2- 172.21.15.96:0/1683725901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0440c6450 0x7fa0440c1800 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa0340097c0 tx=0x7fa03401ec90 comp rx=0 tx=0).stop 2024-04-18T04:58:54.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 -- 172.21.15.96:0/1683725901 shutdown_connections 2024-04-18T04:58:54.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 --2- 172.21.15.96:0/1683725901 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa0440c6830 0x7fa044156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 --2- 172.21.15.96:0/1683725901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0440c6450 0x7fa0440c1800 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 -- 172.21.15.96:0/1683725901 >> 172.21.15.96:0/1683725901 conn(0x7fa04406a8e0 msgr2=0x7fa0440c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:54.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 -- 172.21.15.96:0/1683725901 shutdown_connections 2024-04-18T04:58:54.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 -- 172.21.15.96:0/1683725901 wait complete. 2024-04-18T04:58:54.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 Processor -- start 2024-04-18T04:58:54.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 -- start start 2024-04-18T04:58:54.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0440c1d40 0x7fa0441f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa0440c6450 0x7fa0441f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0440c6830 0x7fa044157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa044144d10 con 0x7fa0440c6830 2024-04-18T04:58:54.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0441f14c0 con 0x7fa0440c1d40 2024-04-18T04:58:54.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0441f19b0 con 0x7fa0440c6450 2024-04-18T04:58:54.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa042d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0440c6830 0x7fa044157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa042d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0440c6830 0x7fa044157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54396/0 (socket says 172.21.15.96:54396) 2024-04-18T04:58:54.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa042d9d640 1 -- 172.21.15.96:0/2955676676 learned_addr learned my addr 172.21.15.96:0/2955676676 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:54.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa04259c640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0440c1d40 0x7fa0441f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa041d9b640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa0440c6450 0x7fa0441f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa042d9d640 1 -- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa0440c6450 msgr2=0x7fa0441f20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa042d9d640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa0440c6450 0x7fa0441f20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa042d9d640 1 -- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0440c1d40 msgr2=0x7fa0441f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa042d9d640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0440c1d40 0x7fa0441f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa042d9d640 1 -- 172.21.15.96:0/2955676676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa034009420 con 0x7fa0440c6830 2024-04-18T04:58:54.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa04259c640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0440c1d40 0x7fa0441f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:58:54.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa042d9d640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0440c6830 0x7fa044157d50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00c7d0 tx=0x7fa03c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:54.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa032ffd640 1 -- 172.21.15.96:0/2955676676 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00a640 con 0x7fa0440c6830 2024-04-18T04:58:54.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa032ffd640 1 -- 172.21.15.96:0/2955676676 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c00a7a0 con 0x7fa0440c6830 2024-04-18T04:58:54.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa032ffd640 1 -- 172.21.15.96:0/2955676676 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00ab90 con 0x7fa0440c6830 2024-04-18T04:58:54.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 -- 172.21.15.96:0/2955676676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa044150a80 con 0x7fa0440c6830 2024-04-18T04:58:54.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 -- 172.21.15.96:0/2955676676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0441578c0 con 0x7fa0440c6830 2024-04-18T04:58:54.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa044156db0 0x7fa044158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.188+0000 7fa0488d4640 1 -- 172.21.15.96:0/2955676676 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa044066b90 con 0x7fa044156db0 2024-04-18T04:58:54.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.192+0000 7fa04259c640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa044156db0 0x7fa044158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.192+0000 7fa032ffd640 1 -- 172.21.15.96:0/2955676676 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa03c00acf0 con 0x7fa0440c6830 2024-04-18T04:58:54.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.192+0000 7fa032ffd640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa0240666c0 0x7fa024068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.192+0000 7fa04259c640 1 -- 172.21.15.96:0/2955676676 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa044071fd0 con 0x7fa044156db0 2024-04-18T04:58:54.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.192+0000 7fa032ffd640 1 -- 172.21.15.96:0/2955676676 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa03c083410 con 0x7fa0440c6830 2024-04-18T04:58:54.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.192+0000 7fa041d9b640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa0240666c0 0x7fa024068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.192+0000 7fa04259c640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa044156db0 0x7fa044158290 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa04406c610 tx=0x7fa03401ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:54.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.192+0000 7fa041d9b640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa0240666c0 0x7fa024068b80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa0440c1620 tx=0x7fa038008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:54.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.192+0000 7fa032ffd640 1 -- 172.21.15.96:0/2955676676 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0340b0da0 con 0x7fa044156db0 2024-04-18T04:58:54.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.192+0000 7fa032ffd640 1 -- 172.21.15.96:0/2955676676 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fa0340b9400 con 0x7fa044156db0 2024-04-18T04:58:54.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.192+0000 7fa032ffd640 1 -- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa044156db0 msgr2=0x7fa044158290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.192+0000 7fa032ffd640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa044156db0 0x7fa044158290 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa04406c610 tx=0x7fa03401ba30 comp rx=0 tx=0).stop 2024-04-18T04:58:54.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.192+0000 7fa032ffd640 1 -- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa044156db0 msgr2=0x7fa044158290 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:54.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.192+0000 7fa032ffd640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa044156db0 0x7fa044158290 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa0488d4640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa044144f70 0x7fa044158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa0488d4640 1 -- 172.21.15.96:0/2955676676 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa044071cf0 con 0x7fa044144f70 2024-04-18T04:58:54.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa04259c640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa044144f70 0x7fa044158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa04259c640 1 -- 172.21.15.96:0/2955676676 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa0440722b0 con 0x7fa044144f70 2024-04-18T04:58:54.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa04259c640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa044144f70 0x7fa044158b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa03401d340 tx=0x7fa0340aa000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:54.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa032ffd640 1 -- 172.21.15.96:0/2955676676 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0340c2c50 con 0x7fa044144f70 2024-04-18T04:58:54.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa032ffd640 1 -- 172.21.15.96:0/2955676676 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4975 (secure 0 0 0) 0x7fa0340cc410 con 0x7fa044144f70 2024-04-18T04:58:54.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa032ffd640 1 -- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa044144f70 msgr2=0x7fa044158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa032ffd640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa044144f70 0x7fa044158b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa03401d340 tx=0x7fa0340aa000 comp rx=0 tx=0).stop 2024-04-18T04:58:54.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa032ffd640 1 -- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa044144f70 msgr2=0x7fa044158b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:58:54.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa032ffd640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa044144f70 0x7fa044158b20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.204 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:58:54.204 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:58:54.204 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:58:54.204 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:58:54.204 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 46, 2024-04-18T04:58:54.204 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:58:54.204 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:58:54.204 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:58:54.204 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:58:54.204 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:54.204 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 1, 2024-04-18T04:58:54.204 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:54.204 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:58:54.204 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:58:54.205 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:54.205 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:54.205 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:54.205 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:54.205 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:54.205 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:54.205 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:54.205 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:54.205 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:54.205 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:54.205 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:54.205 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:58:54.205 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:58:54.205 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:54.205 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:54.206 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:54.206 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:54.206 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:54.206 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:54.206 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:54.206 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:54.206 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:54.206 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:54.206 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:54.206 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.206 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:58:54.206 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:58:54.206 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:58:54.206 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:58:54.207 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:58:54.207 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:58:54.207 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:54.207 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:58:54.207 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:58:54.207 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:58:54.207 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:58:54.207 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:58:54.207 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:58:54.207 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:58:54.207 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:58:54.207 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:58:54.207 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:58:54.207 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:58:54.207 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:58:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:58:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:58:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:58:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:58:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:58:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:58:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:58:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:58:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:58:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:58:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:58:54.208 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:58:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:58:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:58:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:58:54.209 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:58:54.210 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:54.210 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:54.210 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:54.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.210 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:58:54.210 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:58:54.210 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:54.210 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:54.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.211 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:54.211 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:58:54.211 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:54.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.211 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.211 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:54.211 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:58:54.211 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:54.211 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:54.211 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:54.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.211 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:58:54.211 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:58:54.211 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:54.212 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:54.212 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:54.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.212 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:58:54.212 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:58:54.212 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:58:54.212 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:58:54.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.212 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:58:54.212 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:58:54.212 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:54.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.213 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:58:54.213 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:58:54.213 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:58:54.213 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:54.213 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:54.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.213 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:58:54.213 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:58:54.213 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:58:54.213 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:58:54.213 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:58:54.213 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:54.213 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:54.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.213 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:58:54.214 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:58:54.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.214 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:54.214 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:54.214 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:54.214 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:54.214 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:54.214 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:58:54.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.214 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:54.214 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:54.214 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:58:54.214 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:54.214 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:54.215 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:58:54.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.215 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:54.215 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:54.215 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:58:54.215 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:54.215 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:54.215 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:58:54.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.215 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:54.215 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:54.215 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:58:54.215 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:54.215 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:58:54.216 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:58:54.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:58:54.216 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:58:54.216 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:58:54.216 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:58:54.216 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:58:54.216 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:58:54.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:58:54.216 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:58:54.216 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:58:54.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa0488d4640 1 -- 172.21.15.96:0/2955676676 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa0240666c0 msgr2=0x7fa024068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa0488d4640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa0240666c0 0x7fa024068b80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa0440c1620 tx=0x7fa038008040 comp rx=0 tx=0).stop 2024-04-18T04:58:54.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa0488d4640 1 -- 172.21.15.96:0/2955676676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0440c6830 msgr2=0x7fa044157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa0488d4640 1 --2- 172.21.15.96:0/2955676676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0440c6830 0x7fa044157d50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00c7d0 tx=0x7fa03c00cc90 comp rx=0 tx=0).stop 2024-04-18T04:58:54.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa042d9d640 1 -- 172.21.15.96:0/2955676676 reap_dead start 2024-04-18T04:58:54.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa042d9d640 1 -- 172.21.15.96:0/2955676676 reap_dead start 2024-04-18T04:58:54.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa0488d4640 1 -- 172.21.15.96:0/2955676676 shutdown_connections 2024-04-18T04:58:54.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa0488d4640 1 -- 172.21.15.96:0/2955676676 >> 172.21.15.96:0/2955676676 conn(0x7fa04406a8e0 msgr2=0x7fa044156220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:54.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa0488d4640 1 -- 172.21.15.96:0/2955676676 shutdown_connections 2024-04-18T04:58:54.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.200+0000 7fa0488d4640 1 -- 172.21.15.96:0/2955676676 wait complete. 2024-04-18T04:58:54.220 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:58:54.220 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-18T04:58:54.220 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-18T04:58:54.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.332+0000 7f639e404640 1 Processor -- start 2024-04-18T04:58:54.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.332+0000 7f639e404640 1 -- start start 2024-04-18T04:58:54.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f639e404640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f63980c9210 0x7f63980c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f639e404640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f63980c8780 0x7f6398152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f639e404640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f63980c95f0 0x7f63981531e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f639e404640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639806af70 con 0x7f63980c9210 2024-04-18T04:58:54.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f639e404640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63980c70b0 con 0x7f63980c8780 2024-04-18T04:58:54.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f639e404640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639806bb40 con 0x7f63980c95f0 2024-04-18T04:58:54.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f6397fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f63980c9210 0x7f63980c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f6397fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f63980c9210 0x7f63980c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54410/0 (socket says 172.21.15.96:54410) 2024-04-18T04:58:54.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f6397fff640 1 -- 172.21.15.96:0/215534167 learned_addr learned my addr 172.21.15.96:0/215534167 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:54.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f638ffff640 1 --2- 172.21.15.96:0/215534167 >> v2:172.21.15.139:3300/0 conn(0x7f63980c8780 0x7f6398152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f639c9a1640 1 --2- 172.21.15.96:0/215534167 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f63980c95f0 0x7f63981531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f6397fff640 1 -- 172.21.15.96:0/215534167 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f63980c95f0 msgr2=0x7f63981531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:54.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f6397fff640 1 --2- 172.21.15.96:0/215534167 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f63980c95f0 0x7f63981531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f6397fff640 1 -- 172.21.15.96:0/215534167 >> v2:172.21.15.139:3300/0 conn(0x7f63980c8780 msgr2=0x7f6398152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:58:54.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f6397fff640 1 --2- 172.21.15.96:0/215534167 >> v2:172.21.15.139:3300/0 conn(0x7f63980c8780 0x7f6398152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f6397fff640 1 -- 172.21.15.96:0/215534167 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63980c8c10 con 0x7f63980c9210 2024-04-18T04:58:54.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f639c9a1640 1 --2- 172.21.15.96:0/215534167 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f63980c95f0 0x7f63981531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:58:54.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f638ffff640 1 --2- 172.21.15.96:0/215534167 >> v2:172.21.15.139:3300/0 conn(0x7f63980c8780 0x7f6398152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:58:54.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f6397fff640 1 --2- 172.21.15.96:0/215534167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63980c9210 0x7f63980c8240 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f63980c9b70 tx=0x7f638801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a062b6b9600c2e2e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:54.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f63977fe640 1 -- 172.21.15.96:0/215534167 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63880a89d0 con 0x7f63980c9210 2024-04-18T04:58:54.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f63977fe640 1 -- 172.21.15.96:0/215534167 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63880a8b30 con 0x7f63980c9210 2024-04-18T04:58:54.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.336+0000 7f63977fe640 1 -- 172.21.15.96:0/215534167 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63880b0440 con 0x7f63980c9210 2024-04-18T04:58:54.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 -- 172.21.15.96:0/215534167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63980c9210 msgr2=0x7f63980c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 --2- 172.21.15.96:0/215534167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63980c9210 0x7f63980c8240 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f63980c9b70 tx=0x7f638801ed10 comp rx=0 tx=0).stop 2024-04-18T04:58:54.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 -- 172.21.15.96:0/215534167 shutdown_connections 2024-04-18T04:58:54.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 --2- 172.21.15.96:0/215534167 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f63980c95f0 0x7f63981531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 --2- 172.21.15.96:0/215534167 >> v2:172.21.15.139:3300/0 conn(0x7f63980c8780 0x7f6398152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 --2- 172.21.15.96:0/215534167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63980c9210 0x7f63980c8240 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 -- 172.21.15.96:0/215534167 >> 172.21.15.96:0/215534167 conn(0x7f63980661c0 msgr2=0x7f639806fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:54.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 -- 172.21.15.96:0/215534167 shutdown_connections 2024-04-18T04:58:54.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 -- 172.21.15.96:0/215534167 wait complete. 2024-04-18T04:58:54.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 Processor -- start 2024-04-18T04:58:54.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 -- start start 2024-04-18T04:58:54.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f63980c9210 0x7f63980c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63980c95f0 0x7f63980c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63980c30f0 0x7f63981f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63980c1980 con 0x7f63980c95f0 2024-04-18T04:58:54.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639815bbf0 con 0x7f63980c30f0 2024-04-18T04:58:54.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63980c15e0 con 0x7f63980c9210 2024-04-18T04:58:54.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f638ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63980c95f0 0x7f63980c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f638ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63980c95f0 0x7f63980c22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54412/0 (socket says 172.21.15.96:54412) 2024-04-18T04:58:54.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f638ffff640 1 -- 172.21.15.96:0/1980079767 learned_addr learned my addr 172.21.15.96:0/1980079767 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:58:54.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f6397fff640 1 --2- 172.21.15.96:0/1980079767 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f63980c9210 0x7f63980c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639c9a1640 1 --2- 172.21.15.96:0/1980079767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63980c30f0 0x7f63981f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f638ffff640 1 -- 172.21.15.96:0/1980079767 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f63980c9210 msgr2=0x7f63980c1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f638ffff640 1 --2- 172.21.15.96:0/1980079767 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f63980c9210 0x7f63980c1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f638ffff640 1 -- 172.21.15.96:0/1980079767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63980c30f0 msgr2=0x7f63981f1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f638ffff640 1 --2- 172.21.15.96:0/1980079767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63980c30f0 0x7f63981f1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f638ffff640 1 -- 172.21.15.96:0/1980079767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63880094d0 con 0x7f63980c95f0 2024-04-18T04:58:54.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f6397fff640 1 --2- 172.21.15.96:0/1980079767 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f63980c9210 0x7f63980c1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:58:54.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639c9a1640 1 --2- 172.21.15.96:0/1980079767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63980c30f0 0x7f63981f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:58:54.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f638ffff640 1 --2- 172.21.15.96:0/1980079767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63980c95f0 0x7f63980c22e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f638000e810 tx=0x7f638000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:54.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f63957fa640 1 -- 172.21.15.96:0/1980079767 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380004030 con 0x7f63980c95f0 2024-04-18T04:58:54.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f63957fa640 1 -- 172.21.15.96:0/1980079767 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6380004190 con 0x7f63980c95f0 2024-04-18T04:58:54.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f63957fa640 1 -- 172.21.15.96:0/1980079767 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380004520 con 0x7f63980c95f0 2024-04-18T04:58:54.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 -- 172.21.15.96:0/1980079767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63981f2610 con 0x7f63980c95f0 2024-04-18T04:58:54.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.340+0000 7f639e404640 1 -- 172.21.15.96:0/1980079767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639815c170 con 0x7f63980c95f0 2024-04-18T04:58:54.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.344+0000 7f639e404640 1 -- 172.21.15.96:0/1980079767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63980c1ac0 con 0x7f63980c95f0 2024-04-18T04:58:54.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.344+0000 7f63957fa640 1 -- 172.21.15.96:0/1980079767 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f638000c670 con 0x7f63980c95f0 2024-04-18T04:58:54.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.344+0000 7f63957fa640 1 --2- 172.21.15.96:0/1980079767 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f63780666c0 0x7f6378068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:58:54.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.344+0000 7f63957fa640 1 -- 172.21.15.96:0/1980079767 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6380083ff0 con 0x7f63980c95f0 2024-04-18T04:58:54.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.344+0000 7f6397fff640 1 --2- 172.21.15.96:0/1980079767 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f63780666c0 0x7f6378068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:58:54.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.344+0000 7f6397fff640 1 --2- 172.21.15.96:0/1980079767 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f63780666c0 0x7f6378068b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f63880b2000 tx=0x7f6388008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:58:54.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.348+0000 7f63957fa640 1 -- 172.21.15.96:0/1980079767 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f63980c1ac0 con 0x7f63980c95f0 2024-04-18T04:58:54.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.568+0000 7f639e404640 1 -- 172.21.15.96:0/1980079767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f63980c1ac0 con 0x7f63980c95f0 2024-04-18T04:58:54.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.572+0000 7f63957fa640 1 -- 172.21.15.96:0/1980079767 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f63980c1ac0 con 0x7f63980c95f0 2024-04-18T04:58:54.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.572+0000 7f639e404640 1 -- 172.21.15.96:0/1980079767 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f63780666c0 msgr2=0x7f6378068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.572+0000 7f639e404640 1 --2- 172.21.15.96:0/1980079767 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f63780666c0 0x7f6378068b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f63880b2000 tx=0x7f6388008040 comp rx=0 tx=0).stop 2024-04-18T04:58:54.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.572+0000 7f639e404640 1 -- 172.21.15.96:0/1980079767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63980c95f0 msgr2=0x7f63980c22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:58:54.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.572+0000 7f639e404640 1 --2- 172.21.15.96:0/1980079767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63980c95f0 0x7f63980c22e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f638000e810 tx=0x7f638000ecd0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.572+0000 7f639e404640 1 -- 172.21.15.96:0/1980079767 shutdown_connections 2024-04-18T04:58:54.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.572+0000 7f639e404640 1 --2- 172.21.15.96:0/1980079767 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f63780666c0 0x7f6378068b80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.572+0000 7f639e404640 1 --2- 172.21.15.96:0/1980079767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63980c30f0 0x7f63981f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.572+0000 7f639e404640 1 --2- 172.21.15.96:0/1980079767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63980c95f0 0x7f63980c22e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.572+0000 7f639e404640 1 --2- 172.21.15.96:0/1980079767 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f63980c9210 0x7f63980c1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:58:54.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.572+0000 7f639e404640 1 -- 172.21.15.96:0/1980079767 >> 172.21.15.96:0/1980079767 conn(0x7f63980661c0 msgr2=0x7f639814e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:58:54.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.572+0000 7f639e404640 1 -- 172.21.15.96:0/1980079767 shutdown_connections 2024-04-18T04:58:54.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:58:54.572+0000 7f639e404640 1 -- 172.21.15.96:0/1980079767 wait complete. 2024-04-18T04:58:54.591 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-18T04:59:04.592 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-18T04:59:04.592 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:59:04.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.724+0000 7f9b00eb5640 1 Processor -- start 2024-04-18T04:59:04.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.724+0000 7f9b00eb5640 1 -- start start 2024-04-18T04:59:04.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9b00eb5640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9afc0c59a0 0x7f9afc0c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:04.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9b00eb5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9afc0cb4f0 0x7f9afc0bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:04.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9b00eb5640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9afc0cbac0 con 0x7f9afc1575f0 2024-04-18T04:59:04.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9b00eb5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9afc0c62c0 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9b00eb5640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc0c03f0 con 0x7f9afc0c59a0 2024-04-18T04:59:04.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9af9d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9afc0cb4f0 0x7f9afc0bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:04.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9af9d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9afc0cb4f0 0x7f9afc0bfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59722/0 (socket says 172.21.15.96:59722) 2024-04-18T04:59:04.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9af9d9b640 1 -- 172.21.15.96:0/2697037377 learned_addr learned my addr 172.21.15.96:0/2697037377 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:04.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9afa59c640 1 --2- 172.21.15.96:0/2697037377 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9afc0c59a0 0x7f9afc0c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:04.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9af9d9b640 1 -- 172.21.15.96:0/2697037377 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9afc0c59a0 msgr2=0x7f9afc0c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:04.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9af9d9b640 1 --2- 172.21.15.96:0/2697037377 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9afc0c59a0 0x7f9afc0c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:04.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9af9d9b640 1 -- 172.21.15.96:0/2697037377 >> v1:172.21.15.139:6789/0 conn(0x7f9afc1575f0 legacy=0x7f9afc0c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:04.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9af9d9b640 1 -- 172.21.15.96:0/2697037377 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc156e30 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9af9d9b640 1 --2- 172.21.15.96:0/2697037377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9afc0cb4f0 0x7f9afc0bfeb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009870 tx=0x7f9af001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101fe832fd0b89ef server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:04.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9af959a640 1 -- 172.21.15.96:0/2697037377 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af00ac630 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9af959a640 1 -- 172.21.15.96:0/2697037377 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af00ac790 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9af959a640 1 -- 172.21.15.96:0/2697037377 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af00acb20 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9b00eb5640 1 -- 172.21.15.96:0/2697037377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9afc0cb4f0 msgr2=0x7f9afc0bfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:04.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.728+0000 7f9b00eb5640 1 --2- 172.21.15.96:0/2697037377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9afc0cb4f0 0x7f9afc0bfeb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009870 tx=0x7f9af001c520 comp rx=0 tx=0).stop 2024-04-18T04:59:04.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9b00eb5640 1 -- 172.21.15.96:0/2697037377 shutdown_connections 2024-04-18T04:59:04.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9b00eb5640 1 --2- 172.21.15.96:0/2697037377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9afc0cb4f0 0x7f9afc0bfeb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:04.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9b00eb5640 1 --2- 172.21.15.96:0/2697037377 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9afc0c59a0 0x7f9afc0c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:04.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9b00eb5640 1 -- 172.21.15.96:0/2697037377 >> 172.21.15.96:0/2697037377 conn(0x7f9afc0c7d90 msgr2=0x7f9afc0cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:04.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9b00eb5640 1 -- 172.21.15.96:0/2697037377 shutdown_connections 2024-04-18T04:59:04.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9b00eb5640 1 -- 172.21.15.96:0/2697037377 wait complete. 2024-04-18T04:59:04.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9b00eb5640 1 Processor -- start 2024-04-18T04:59:04.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9b00eb5640 1 -- start start 2024-04-18T04:59:04.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9b00eb5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9afc0c59a0 0x7f9afc1efcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:04.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9b00eb5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9afc0cb4f0 0x7f9afc0c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:04.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9b00eb5640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9afc1575f0 0x7f9afc14b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:04.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9b00eb5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc1f01f0 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9b00eb5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc149140 con 0x7f9afc0c59a0 2024-04-18T04:59:04.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9b00eb5640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc14b090 con 0x7f9afc1575f0 2024-04-18T04:59:04.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9af9d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9afc0cb4f0 0x7f9afc0c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:04.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9af9d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9afc0cb4f0 0x7f9afc0c95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59734/0 (socket says 172.21.15.96:59734) 2024-04-18T04:59:04.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9af9d9b640 1 -- 172.21.15.96:0/280133111 learned_addr learned my addr 172.21.15.96:0/280133111 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:04.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9afa59c640 1 --2- 172.21.15.96:0/280133111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9afc0c59a0 0x7f9afc1efcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:04.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9afad9d640 1 --2- 172.21.15.96:0/280133111 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9afc1575f0 0x7f9afc14b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:04.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9af9d9b640 1 -- 172.21.15.96:0/280133111 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9afc1575f0 msgr2=0x7f9afc14b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:04.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9af9d9b640 1 --2- 172.21.15.96:0/280133111 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9afc1575f0 0x7f9afc14b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:04.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9af9d9b640 1 -- 172.21.15.96:0/280133111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9afc0c59a0 msgr2=0x7f9afc1efcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:04.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9af9d9b640 1 --2- 172.21.15.96:0/280133111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9afc0c59a0 0x7f9afc1efcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:04.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9af9d9b640 1 -- 172.21.15.96:0/280133111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af00094d0 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9afa59c640 1 --2- 172.21.15.96:0/280133111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9afc0c59a0 0x7f9afc1efcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:59:04.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9afad9d640 1 --2- 172.21.15.96:0/280133111 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9afc1575f0 0x7f9afc14b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:59:04.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9af9d9b640 1 --2- 172.21.15.96:0/280133111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9afc0cb4f0 0x7f9afc0c95c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9af00af040 tx=0x7f9af00192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:04.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9aeaffd640 1 -- 172.21.15.96:0/280133111 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af00b5850 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9aeaffd640 1 -- 172.21.15.96:0/280133111 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af00b59d0 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9aeaffd640 1 -- 172.21.15.96:0/280133111 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af00b5d80 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9b00eb5640 1 -- 172.21.15.96:0/280133111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9afc0c65c0 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.732+0000 7f9b00eb5640 1 -- 172.21.15.96:0/280133111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9afc0ca3e0 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.736+0000 7f9b00eb5640 1 -- 172.21.15.96:0/280133111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9afc067050 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.736+0000 7f9aeaffd640 1 -- 172.21.15.96:0/280133111 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9af00b3070 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.736+0000 7f9aeaffd640 1 --2- 172.21.15.96:0/280133111 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9adc066690 0x7f9adc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:04.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.736+0000 7f9aeaffd640 1 -- 172.21.15.96:0/280133111 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f9af011d7b0 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.736+0000 7f9afa59c640 1 --2- 172.21.15.96:0/280133111 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9adc066690 0x7f9adc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:04.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.736+0000 7f9afa59c640 1 --2- 172.21.15.96:0/280133111 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9adc066690 0x7f9adc068b50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9aec006fd0 tx=0x7f9aec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:04.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.740+0000 7f9aeaffd640 1 -- 172.21.15.96:0/280133111 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9af00eaa70 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.968+0000 7f9b00eb5640 1 -- 172.21.15.96:0/280133111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9afc0724c0 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.972+0000 7f9aeaffd640 1 -- 172.21.15.96:0/280133111 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f9af00b1620 con 0x7f9afc0cb4f0 2024-04-18T04:59:04.974 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:59:04.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.972+0000 7f9b00eb5640 1 -- 172.21.15.96:0/280133111 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9adc066690 msgr2=0x7f9adc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:04.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.972+0000 7f9b00eb5640 1 --2- 172.21.15.96:0/280133111 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9adc066690 0x7f9adc068b50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9aec006fd0 tx=0x7f9aec008040 comp rx=0 tx=0).stop 2024-04-18T04:59:04.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.972+0000 7f9b00eb5640 1 -- 172.21.15.96:0/280133111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9afc0cb4f0 msgr2=0x7f9afc0c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:04.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.972+0000 7f9b00eb5640 1 --2- 172.21.15.96:0/280133111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9afc0cb4f0 0x7f9afc0c95c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9af00af040 tx=0x7f9af00192c0 comp rx=0 tx=0).stop 2024-04-18T04:59:04.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.972+0000 7f9b00eb5640 1 -- 172.21.15.96:0/280133111 shutdown_connections 2024-04-18T04:59:04.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.972+0000 7f9b00eb5640 1 --2- 172.21.15.96:0/280133111 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9adc066690 0x7f9adc068b50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:04.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.972+0000 7f9b00eb5640 1 --2- 172.21.15.96:0/280133111 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9afc1575f0 0x7f9afc14b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:04.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.972+0000 7f9b00eb5640 1 --2- 172.21.15.96:0/280133111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9afc0cb4f0 0x7f9afc0c95c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:04.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.972+0000 7f9b00eb5640 1 --2- 172.21.15.96:0/280133111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9afc0c59a0 0x7f9afc1efcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:04.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.972+0000 7f9b00eb5640 1 -- 172.21.15.96:0/280133111 >> 172.21.15.96:0/280133111 conn(0x7f9afc0c7d90 msgr2=0x7f9afc150960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:04.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.972+0000 7f9b00eb5640 1 -- 172.21.15.96:0/280133111 shutdown_connections 2024-04-18T04:59:04.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:04.972+0000 7f9b00eb5640 1 -- 172.21.15.96:0/280133111 wait complete. 2024-04-18T04:59:04.991 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-18T04:59:04.991 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-18T04:59:04.991 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-18T04:59:04.991 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T04:59:05.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.120+0000 7f80c8dc7640 1 Processor -- start 2024-04-18T04:59:05.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.120+0000 7f80c8dc7640 1 -- start start 2024-04-18T04:59:05.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.124+0000 7f80c8dc7640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f80c40ccb40 0x7f80c4156c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.124+0000 7f80c8dc7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f80c40c7950 0x7f80c41509e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.124+0000 7f80c8dc7640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c40c7de0 con 0x7f80c40cc760 2024-04-18T04:59:05.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.124+0000 7f80c8dc7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c40c74c0 con 0x7f80c40c7950 2024-04-18T04:59:05.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.124+0000 7f80c8dc7640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c40c21b0 con 0x7f80c40ccb40 2024-04-18T04:59:05.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.124+0000 7f80c1d9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f80c40ccb40 0x7f80c4156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.124+0000 7f80c1d9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f80c40ccb40 0x7f80c4156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:49158/0 (socket says 172.21.15.96:49158) 2024-04-18T04:59:05.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.124+0000 7f80c1d9b640 1 -- 172.21.15.96:0/3156594041 learned_addr learned my addr 172.21.15.96:0/3156594041 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:05.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.124+0000 7f80c2d9d640 1 --2- 172.21.15.96:0/3156594041 >> v2:172.21.15.96:3300/0 conn(0x7f80c40c7950 0x7f80c41509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.124+0000 7f80c1d9b640 1 -- 172.21.15.96:0/3156594041 >> v2:172.21.15.96:3300/0 conn(0x7f80c40c7950 msgr2=0x7f80c41509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:05.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.124+0000 7f80c1d9b640 1 --2- 172.21.15.96:0/3156594041 >> v2:172.21.15.96:3300/0 conn(0x7f80c40c7950 0x7f80c41509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.124+0000 7f80c1d9b640 1 -- 172.21.15.96:0/3156594041 >> v1:172.21.15.96:6789/0 conn(0x7f80c40cc760 legacy=0x7f80c40c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.124+0000 7f80c1d9b640 1 -- 172.21.15.96:0/3156594041 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c40c1910 con 0x7f80c40ccb40 2024-04-18T04:59:05.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.128+0000 7f80c1d9b640 1 --2- 172.21.15.96:0/3156594041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c40ccb40 0x7f80c4156c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f80c4066880 tx=0x7f80b801ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=540fc85f601a26ee server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.128+0000 7f80c159a640 1 -- 172.21.15.96:0/3156594041 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80a8a10 con 0x7f80c40ccb40 2024-04-18T04:59:05.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.128+0000 7f80c159a640 1 -- 172.21.15.96:0/3156594041 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b80a8b70 con 0x7f80c40ccb40 2024-04-18T04:59:05.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.128+0000 7f80c159a640 1 -- 172.21.15.96:0/3156594041 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80b0440 con 0x7f80c40ccb40 2024-04-18T04:59:05.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.128+0000 7f80c8dc7640 1 -- 172.21.15.96:0/3156594041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c40ccb40 msgr2=0x7f80c4156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.128+0000 7f80c8dc7640 1 --2- 172.21.15.96:0/3156594041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c40ccb40 0x7f80c4156c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f80c4066880 tx=0x7f80b801ed10 comp rx=0 tx=0).stop 2024-04-18T04:59:05.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.128+0000 7f80c8dc7640 1 -- 172.21.15.96:0/3156594041 shutdown_connections 2024-04-18T04:59:05.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.128+0000 7f80c8dc7640 1 --2- 172.21.15.96:0/3156594041 >> v2:172.21.15.96:3300/0 conn(0x7f80c40c7950 0x7f80c41509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.128+0000 7f80c8dc7640 1 --2- 172.21.15.96:0/3156594041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c40ccb40 0x7f80c4156c60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.128+0000 7f80c8dc7640 1 -- 172.21.15.96:0/3156594041 >> 172.21.15.96:0/3156594041 conn(0x7f80c406a510 msgr2=0x7f80c4065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:05.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c8dc7640 1 -- 172.21.15.96:0/3156594041 shutdown_connections 2024-04-18T04:59:05.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c8dc7640 1 -- 172.21.15.96:0/3156594041 wait complete. 2024-04-18T04:59:05.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c8dc7640 1 Processor -- start 2024-04-18T04:59:05.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c8dc7640 1 -- start start 2024-04-18T04:59:05.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c8dc7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c40c7950 0x7f80c4148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c8dc7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c40cc760 0x7f80c414dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c8dc7640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80c40ccb40 0x7f80c414e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c8dc7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c414f0f0 con 0x7f80c40cc760 2024-04-18T04:59:05.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c8dc7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c414eb30 con 0x7f80c40c7950 2024-04-18T04:59:05.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c8dc7640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c414ee10 con 0x7f80c40ccb40 2024-04-18T04:59:05.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c1d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c40cc760 0x7f80c414dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c1d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c40cc760 0x7f80c414dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59750/0 (socket says 172.21.15.96:59750) 2024-04-18T04:59:05.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c1d9b640 1 -- 172.21.15.96:0/2312986741 learned_addr learned my addr 172.21.15.96:0/2312986741 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:05.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c2d9d640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80c40ccb40 0x7f80c414e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c259c640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c40c7950 0x7f80c4148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c1d9b640 1 -- 172.21.15.96:0/2312986741 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80c40ccb40 msgr2=0x7f80c414e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c1d9b640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80c40ccb40 0x7f80c414e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c1d9b640 1 -- 172.21.15.96:0/2312986741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c40c7950 msgr2=0x7f80c4148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c1d9b640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c40c7950 0x7f80c4148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.132+0000 7f80c1d9b640 1 -- 172.21.15.96:0/2312986741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b80094d0 con 0x7f80c40cc760 2024-04-18T04:59:05.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80c1d9b640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c40cc760 0x7f80c414dbf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f80b801b920 tx=0x7f80b801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80b2ffd640 1 -- 172.21.15.96:0/2312986741 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80b1e00 con 0x7f80c40cc760 2024-04-18T04:59:05.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80b2ffd640 1 -- 172.21.15.96:0/2312986741 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b80b9410 con 0x7f80c40cc760 2024-04-18T04:59:05.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80c8dc7640 1 -- 172.21.15.96:0/2312986741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c4149dd0 con 0x7f80c40cc760 2024-04-18T04:59:05.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80b2ffd640 1 -- 172.21.15.96:0/2312986741 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80b97a0 con 0x7f80c40cc760 2024-04-18T04:59:05.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80c8dc7640 1 -- 172.21.15.96:0/2312986741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c414a390 con 0x7f80c40cc760 2024-04-18T04:59:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80c8dc7640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c414a8b0 0x7f80c414ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80c8dc7640 1 -- 172.21.15.96:0/2312986741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c406ac40 con 0x7f80c414a8b0 2024-04-18T04:59:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80c259c640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c414a8b0 0x7f80c414ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80c259c640 1 -- 172.21.15.96:0/2312986741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80c40c7150 con 0x7f80c414a8b0 2024-04-18T04:59:05.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80c259c640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c414a8b0 0x7f80c414ac90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f80b4000f70 tx=0x7f80b400fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80b2ffd640 1 -- 172.21.15.96:0/2312986741 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b40050d0 con 0x7f80c414a8b0 2024-04-18T04:59:05.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80b2ffd640 1 -- 172.21.15.96:0/2312986741 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f80b4005230 con 0x7f80c414a8b0 2024-04-18T04:59:05.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80b2ffd640 1 -- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c414a8b0 msgr2=0x7f80c414ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80b2ffd640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c414a8b0 0x7f80c414ac90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f80b4000f70 tx=0x7f80b400fc00 comp rx=0 tx=0).stop 2024-04-18T04:59:05.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80b2ffd640 1 -- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c414a8b0 msgr2=0x7f80c414ac90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:59:05.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.136+0000 7f80b2ffd640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c414a8b0 0x7f80c414ac90 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f80b4000f70 tx=0x7f80b400fc00 comp rx=0 tx=0).stop 2024-04-18T04:59:05.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.140+0000 7f80b2ffd640 1 -- 172.21.15.96:0/2312986741 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f80b80b7040 con 0x7f80c40cc760 2024-04-18T04:59:05.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.140+0000 7f80b2ffd640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f80a4066410 0x7f80a40688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.140+0000 7f80b2ffd640 1 -- 172.21.15.96:0/2312986741 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f80b8121b90 con 0x7f80c40cc760 2024-04-18T04:59:05.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.140+0000 7f80c259c640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f80a4066410 0x7f80a40688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.140+0000 7f80c259c640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f80a4066410 0x7f80a40688d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f80b400d570 tx=0x7f80b4005000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.144+0000 7f80c8dc7640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c41f19d0 0x7f80c41f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.144+0000 7f80c8dc7640 1 -- 172.21.15.96:0/2312986741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c4149f60 con 0x7f80c41f19d0 2024-04-18T04:59:05.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.144+0000 7f80c2d9d640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c41f19d0 0x7f80c41f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80c2d9d640 1 -- 172.21.15.96:0/2312986741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f80c40c15d0 con 0x7f80c41f19d0 2024-04-18T04:59:05.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80c2d9d640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c41f19d0 0x7f80c41f1de0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009e30 tx=0x7f80bc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80b2ffd640 1 -- 172.21.15.96:0/2312986741 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc00e040 con 0x7f80c41f19d0 2024-04-18T04:59:05.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80b2ffd640 1 -- 172.21.15.96:0/2312986741 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7f80bc00f040 con 0x7f80c41f19d0 2024-04-18T04:59:05.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80b2ffd640 1 -- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c41f19d0 msgr2=0x7f80c41f1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80b2ffd640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c41f19d0 0x7f80c41f1de0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009e30 tx=0x7f80bc00f580 comp rx=0 tx=0).stop 2024-04-18T04:59:05.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80b2ffd640 1 -- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c41f19d0 msgr2=0x7f80c41f1de0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:59:05.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80b2ffd640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c41f19d0 0x7f80c41f1de0 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009e30 tx=0x7f80bc00f580 comp rx=0 tx=0).stop 2024-04-18T04:59:05.150 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:59:05.150 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:59:05.150 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:59:05.150 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T04:59:05.150 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 46, 2024-04-18T04:59:05.150 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:59:05.151 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:59:05.151 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:59:05.151 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:59:05.151 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.151 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 12, 2024-04-18T04:59:05.151 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:59:05.151 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:59:05.151 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:59:05.151 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:05.151 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:05.151 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:05.151 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:05.151 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:05.151 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:05.152 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:05.152 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:05.152 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:05.152 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:05.152 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.152 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:59:05.152 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:59:05.152 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:05.152 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:05.152 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:05.152 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:05.152 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:05.152 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:05.152 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:05.152 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:05.152 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:05.153 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:05.153 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.153 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:59:05.153 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:59:05.153 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:59:05.153 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:59:05.153 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:59:05.153 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:59:05.153 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:59:05.153 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:59:05.153 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:59:05.153 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:59:05.153 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:59:05.154 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:59:05.154 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:59:05.154 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:59:05.154 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:59:05.154 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:59:05.154 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:59:05.154 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:05.154 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:05.154 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:05.154 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:05.154 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:05.154 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:05.154 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:05.155 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:05.155 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:05.155 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:05.155 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.155 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:59:05.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.155 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:59:05.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.155 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:59:05.155 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:59:05.155 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:05.155 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:05.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.155 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:05.156 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:59:05.156 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.156 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:05.156 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:59:05.156 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.156 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.156 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.156 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:59:05.156 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:59:05.156 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:05.156 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:05.156 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:05.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.157 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:59:05.157 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:59:05.157 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:05.157 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:05.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.157 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:05.158 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:59:05.158 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.158 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:05.158 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:59:05.158 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.158 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.158 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.158 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:59:05.158 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:59:05.158 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:05.158 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:05.159 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:05.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.159 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:59:05.159 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:59:05.159 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:05.159 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:05.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.159 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:05.159 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:59:05.159 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.159 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:05.159 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:59:05.160 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.160 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.160 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.160 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:59:05.160 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:59:05.160 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:05.160 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:05.160 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:05.160 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.160 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.160 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:59:05.160 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:59:05.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.160 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:05.161 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:05.161 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:59:05.161 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.161 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.161 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:59:05.161 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.161 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:05.161 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:05.161 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:59:05.161 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.161 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.161 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:59:05.161 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.161 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:05.161 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:05.161 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:59:05.162 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.162 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.162 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:59:05.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.162 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:05.162 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:05.162 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5 2024-04-18T04:59:05.162 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.162 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.162 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:59:05.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.162 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:05.162 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:05.163 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:59:05.163 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.163 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.163 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:59:05.163 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:59:05.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80c8dc7640 1 -- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f80a4066410 msgr2=0x7f80a40688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80c8dc7640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f80a4066410 0x7f80a40688d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f80b400d570 tx=0x7f80b4005000 comp rx=0 tx=0).stop 2024-04-18T04:59:05.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80c8dc7640 1 -- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c40cc760 msgr2=0x7f80c414dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80c8dc7640 1 --2- 172.21.15.96:0/2312986741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80c40cc760 0x7f80c414dbf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f80b801b920 tx=0x7f80b801bab0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80c2d9d640 1 -- 172.21.15.96:0/2312986741 reap_dead start 2024-04-18T04:59:05.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80c8dc7640 1 -- 172.21.15.96:0/2312986741 shutdown_connections 2024-04-18T04:59:05.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80c8dc7640 1 -- 172.21.15.96:0/2312986741 >> 172.21.15.96:0/2312986741 conn(0x7f80c406a510 msgr2=0x7f80c406af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:05.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80c8dc7640 1 -- 172.21.15.96:0/2312986741 shutdown_connections 2024-04-18T04:59:05.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.148+0000 7f80c8dc7640 1 -- 172.21.15.96:0/2312986741 wait complete. 2024-04-18T04:59:05.167 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:59:05.167 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-18T04:59:05.167 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-18T04:59:05.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.280+0000 7f1017a07640 1 Processor -- start 2024-04-18T04:59:05.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.280+0000 7f1017a07640 1 -- start start 2024-04-18T04:59:05.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.280+0000 7f1017a07640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f10100cbea0 0x7f10100cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.280+0000 7f1017a07640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1010159aa0 0x7f10100c9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.280+0000 7f1017a07640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101006f2f0 con 0x7f1010156590 2024-04-18T04:59:05.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.280+0000 7f1017a07640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1010159680 con 0x7f1010159aa0 2024-04-18T04:59:05.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.280+0000 7f1017a07640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1010159020 con 0x7f10100cbea0 2024-04-18T04:59:05.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.280+0000 7f1015fa4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1010159aa0 0x7f10100c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.280+0000 7f1015fa4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1010159aa0 0x7f10100c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59782/0 (socket says 172.21.15.96:59782) 2024-04-18T04:59:05.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.280+0000 7f1015fa4640 1 -- 172.21.15.96:0/1740939860 learned_addr learned my addr 172.21.15.96:0/1740939860 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:05.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.280+0000 7f1014fa2640 1 --2- 172.21.15.96:0/1740939860 >> v2:172.21.15.139:3300/0 conn(0x7f10100cbea0 0x7f10100cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.280+0000 7f1015fa4640 1 -- 172.21.15.96:0/1740939860 >> v2:172.21.15.139:3300/0 conn(0x7f10100cbea0 msgr2=0x7f10100cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:05.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.284+0000 7f1015fa4640 1 --2- 172.21.15.96:0/1740939860 >> v2:172.21.15.139:3300/0 conn(0x7f10100cbea0 0x7f10100cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.284+0000 7f1015fa4640 1 -- 172.21.15.96:0/1740939860 >> v1:172.21.15.139:6789/0 conn(0x7f1010156590 legacy=0x7f101006ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:05.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.284+0000 7f1015fa4640 1 -- 172.21.15.96:0/1740939860 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10100cb1e0 con 0x7f1010159aa0 2024-04-18T04:59:05.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.284+0000 7f1015fa4640 1 --2- 172.21.15.96:0/1740939860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1010159aa0 0x7f10100c9000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f101006f4a0 tx=0x7f100801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe4abe59416651 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.284+0000 7f1007fff640 1 -- 172.21.15.96:0/1740939860 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10080a5780 con 0x7f1010159aa0 2024-04-18T04:59:05.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.284+0000 7f1007fff640 1 -- 172.21.15.96:0/1740939860 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10080a58e0 con 0x7f1010159aa0 2024-04-18T04:59:05.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.284+0000 7f1007fff640 1 -- 172.21.15.96:0/1740939860 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10080a5c70 con 0x7f1010159aa0 2024-04-18T04:59:05.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.284+0000 7f1017a07640 1 -- 172.21.15.96:0/1740939860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1010159aa0 msgr2=0x7f10100c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.284+0000 7f1017a07640 1 --2- 172.21.15.96:0/1740939860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1010159aa0 0x7f10100c9000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f101006f4a0 tx=0x7f100801c9b0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.284+0000 7f1017a07640 1 -- 172.21.15.96:0/1740939860 shutdown_connections 2024-04-18T04:59:05.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.284+0000 7f1017a07640 1 --2- 172.21.15.96:0/1740939860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1010159aa0 0x7f10100c9000 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.284+0000 7f1017a07640 1 --2- 172.21.15.96:0/1740939860 >> v2:172.21.15.139:3300/0 conn(0x7f10100cbea0 0x7f10100cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.284+0000 7f1017a07640 1 -- 172.21.15.96:0/1740939860 >> 172.21.15.96:0/1740939860 conn(0x7f101006a6b0 msgr2=0x7f1010065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:05.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.284+0000 7f1017a07640 1 -- 172.21.15.96:0/1740939860 shutdown_connections 2024-04-18T04:59:05.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.284+0000 7f1017a07640 1 -- 172.21.15.96:0/1740939860 wait complete. 2024-04-18T04:59:05.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1017a07640 1 Processor -- start 2024-04-18T04:59:05.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1017a07640 1 -- start start 2024-04-18T04:59:05.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1017a07640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f10100cbea0 0x7f10101f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1017a07640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1010156590 0x7f1010140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1017a07640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1010159aa0 0x7f1010141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1017a07640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10101f2a10 con 0x7f1010156590 2024-04-18T04:59:05.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1017a07640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10101f15a0 con 0x7f1010159aa0 2024-04-18T04:59:05.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1017a07640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10101f4f50 con 0x7f10100cbea0 2024-04-18T04:59:05.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1014fa2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1010156590 0x7f1010140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1014fa2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1010156590 0x7f1010140d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59788/0 (socket says 172.21.15.96:59788) 2024-04-18T04:59:05.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1014fa2640 1 -- 172.21.15.96:0/1225483181 learned_addr learned my addr 172.21.15.96:0/1225483181 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:05.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1015fa4640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1010159aa0 0x7f1010141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f10157a3640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f10100cbea0 0x7f10101f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1014fa2640 1 -- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f10100cbea0 msgr2=0x7f10101f1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1014fa2640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f10100cbea0 0x7f10101f1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1014fa2640 1 -- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1010159aa0 msgr2=0x7f1010141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1014fa2640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1010159aa0 0x7f1010141260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1014fa2640 1 -- 172.21.15.96:0/1225483181 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1008009b30 con 0x7f1010156590 2024-04-18T04:59:05.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1014fa2640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1010156590 0x7f1010140d20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f100c00c7f0 tx=0x7f100c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1005ffb640 1 -- 172.21.15.96:0/1225483181 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c004220 con 0x7f1010156590 2024-04-18T04:59:05.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1005ffb640 1 -- 172.21.15.96:0/1225483181 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c0043a0 con 0x7f1010156590 2024-04-18T04:59:05.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1017a07640 1 -- 172.21.15.96:0/1225483181 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10101f5230 con 0x7f1010156590 2024-04-18T04:59:05.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1005ffb640 1 -- 172.21.15.96:0/1225483181 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c004510 con 0x7f1010156590 2024-04-18T04:59:05.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1017a07640 1 -- 172.21.15.96:0/1225483181 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10101f57f0 con 0x7f1010156590 2024-04-18T04:59:05.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1017a07640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10101f1710 0x7f10100c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1017a07640 1 -- 172.21.15.96:0/1225483181 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101006abd0 con 0x7f10101f1710 2024-04-18T04:59:05.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f10157a3640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10101f1710 0x7f10100c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1005ffb640 1 -- 172.21.15.96:0/1225483181 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f100c003a70 con 0x7f1010156590 2024-04-18T04:59:05.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f10157a3640 1 -- 172.21.15.96:0/1225483181 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1010159ef0 con 0x7f10101f1710 2024-04-18T04:59:05.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1005ffb640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0ff4066690 0x7f0ff4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1015fa4640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0ff4066690 0x7f0ff4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f1005ffb640 1 -- 172.21.15.96:0/1225483181 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f100c084230 con 0x7f1010156590 2024-04-18T04:59:05.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.288+0000 7f10157a3640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10101f1710 0x7f10100c6f00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f100000e450 tx=0x7f100000e910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.292+0000 7f1005ffb640 1 -- 172.21.15.96:0/1225483181 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000007240 con 0x7f10101f1710 2024-04-18T04:59:05.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.292+0000 7f1015fa4640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0ff4066690 0x7f0ff4068b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f10080ae000 tx=0x7f10080a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.292+0000 7f1005ffb640 1 -- 172.21.15.96:0/1225483181 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f10000073a0 con 0x7f10101f1710 2024-04-18T04:59:05.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.292+0000 7f1005ffb640 1 -- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10101f1710 msgr2=0x7f10100c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.292+0000 7f1005ffb640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10101f1710 0x7f10100c6f00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f100000e450 tx=0x7f100000e910 comp rx=0 tx=0).stop 2024-04-18T04:59:05.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.292+0000 7f1005ffb640 1 -- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10101f1710 msgr2=0x7f10100c6f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:59:05.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.292+0000 7f1005ffb640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10101f1710 0x7f10100c6f00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.296+0000 7f1017a07640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1010147c20 0x7f10100c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.296+0000 7f1017a07640 1 -- 172.21.15.96:0/1225483181 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100c89c0 con 0x7f1010147c20 2024-04-18T04:59:05.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.296+0000 7f10157a3640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1010147c20 0x7f10100c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.296+0000 7f10157a3640 1 -- 172.21.15.96:0/1225483181 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f101006cb00 con 0x7f1010147c20 2024-04-18T04:59:05.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.296+0000 7f10157a3640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1010147c20 0x7f10100c7440 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f100000e450 tx=0x7f1000003770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.296+0000 7f1005ffb640 1 -- 172.21.15.96:0/1225483181 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100001f700 con 0x7f1010147c20 2024-04-18T04:59:05.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.300+0000 7f1005ffb640 1 -- 172.21.15.96:0/1225483181 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f1000029420 con 0x7f1010147c20 2024-04-18T04:59:05.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.300+0000 7f1005ffb640 1 -- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1010147c20 msgr2=0x7f10100c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.300+0000 7f1005ffb640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1010147c20 0x7f10100c7440 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f100000e450 tx=0x7f1000003770 comp rx=0 tx=0).stop 2024-04-18T04:59:05.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.300+0000 7f1005ffb640 1 -- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1010147c20 msgr2=0x7f10100c7440 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:59:05.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.300+0000 7f1005ffb640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1010147c20 0x7f10100c7440 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f100000e450 tx=0x7f1000003770 comp rx=0 tx=0).stop 2024-04-18T04:59:05.301 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:59:05.301 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:59:05.301 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:59:05.301 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:59:05.301 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 46, 2024-04-18T04:59:05.301 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:59:05.301 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:59:05.301 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:59:05.301 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:59:05.301 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.301 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 12, 2024-04-18T04:59:05.302 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:59:05.302 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:59:05.302 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:59:05.302 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:05.302 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:05.302 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:05.302 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:05.302 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:05.302 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:05.302 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:05.302 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:05.302 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:05.302 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:05.302 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.303 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:59:05.303 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:59:05.303 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:05.303 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:05.303 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:05.303 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:05.303 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:05.303 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:05.303 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:05.303 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:05.303 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:05.303 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:05.303 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.303 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:59:05.304 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:59:05.304 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:59:05.304 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:59:05.304 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:59:05.304 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:59:05.304 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:59:05.304 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:59:05.304 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:59:05.304 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:59:05.304 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:59:05.304 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:59:05.304 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:59:05.304 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:59:05.304 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:59:05.304 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:59:05.305 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:59:05.305 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:05.305 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:05.305 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:05.305 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:05.305 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:05.305 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:05.305 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:05.305 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:05.305 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:05.305 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:05.305 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.305 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:59:05.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.306 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:59:05.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.306 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:59:05.306 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:59:05.306 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:05.306 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:05.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.306 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:05.306 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:59:05.306 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.306 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:05.306 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:59:05.306 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.307 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.307 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.307 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.307 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:59:05.307 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:59:05.307 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:05.307 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:05.307 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:05.307 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.307 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.307 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:59:05.307 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:59:05.307 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:05.307 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:05.308 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.308 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:05.308 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:59:05.308 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.308 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.308 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.308 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:05.308 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:59:05.308 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.308 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.308 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.308 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.308 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:59:05.308 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:59:05.308 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:05.309 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:05.309 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:05.309 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.309 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.309 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:59:05.309 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:59:05.309 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:05.309 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:05.309 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.309 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:05.309 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:59:05.309 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.309 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.309 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.309 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:05.310 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:59:05.310 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.310 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.310 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.310 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.310 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:59:05.310 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:59:05.310 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:05.310 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:05.310 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:05.310 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.310 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.310 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.310 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:59:05.311 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:59:05.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.311 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:05.311 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:05.311 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:59:05.311 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.311 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.311 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:59:05.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.311 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:05.311 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:05.311 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:59:05.311 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.311 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.311 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.312 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:59:05.312 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:59:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.300+0000 7f1017a07640 1 -- 172.21.15.96:0/1225483181 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0ff4066690 msgr2=0x7f0ff4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.300+0000 7f1017a07640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0ff4066690 0x7f0ff4068b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f10080ae000 tx=0x7f10080a7070 comp rx=0 tx=0).stop 2024-04-18T04:59:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.300+0000 7f1017a07640 1 -- 172.21.15.96:0/1225483181 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1010156590 msgr2=0x7f1010140d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.300+0000 7f1017a07640 1 --2- 172.21.15.96:0/1225483181 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1010156590 0x7f1010140d20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f100c00c7f0 tx=0x7f100c00ccb0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.300+0000 7f1015fa4640 1 -- 172.21.15.96:0/1225483181 reap_dead start 2024-04-18T04:59:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.300+0000 7f1015fa4640 1 -- 172.21.15.96:0/1225483181 reap_dead start 2024-04-18T04:59:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.300+0000 7f1017a07640 1 -- 172.21.15.96:0/1225483181 shutdown_connections 2024-04-18T04:59:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.300+0000 7f1017a07640 1 -- 172.21.15.96:0/1225483181 >> 172.21.15.96:0/1225483181 conn(0x7f101006a6b0 msgr2=0x7f101006ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.300+0000 7f1017a07640 1 -- 172.21.15.96:0/1225483181 shutdown_connections 2024-04-18T04:59:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.300+0000 7f1017a07640 1 -- 172.21.15.96:0/1225483181 wait complete. 2024-04-18T04:59:05.317 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:59:05.317 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-18T04:59:05.318 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-18T04:59:05.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4ed85640 1 Processor -- start 2024-04-18T04:59:05.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4ed85640 1 -- start start 2024-04-18T04:59:05.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4ed85640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c481510e0 0x7f7c48069e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4ed85640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7c48157560 0x7f7c481579c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4ed85640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7c480c4510 0x7f7c480c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4ed85640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c48156e10 con 0x7f7c480c4510 2024-04-18T04:59:05.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4ed85640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4806d940 con 0x7f7c48157560 2024-04-18T04:59:05.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4ed85640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4815a400 con 0x7f7c481510e0 2024-04-18T04:59:05.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4d322640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7c480c4510 0x7f7c480c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4d322640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7c480c4510 0x7f7c480c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59796/0 (socket says 172.21.15.96:59796) 2024-04-18T04:59:05.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4d322640 1 -- 172.21.15.96:0/772845479 learned_addr learned my addr 172.21.15.96:0/772845479 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:05.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c3ffff640 1 --2- 172.21.15.96:0/772845479 >> v2:172.21.15.139:3300/0 conn(0x7f7c48157560 0x7f7c481579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4cb21640 1 --2- 172.21.15.96:0/772845479 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c481510e0 0x7f7c48069e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4d322640 1 -- 172.21.15.96:0/772845479 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c481510e0 msgr2=0x7f7c48069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:05.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4d322640 1 --2- 172.21.15.96:0/772845479 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c481510e0 0x7f7c48069e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4d322640 1 -- 172.21.15.96:0/772845479 >> v2:172.21.15.139:3300/0 conn(0x7f7c48157560 msgr2=0x7f7c481579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:05.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4d322640 1 --2- 172.21.15.96:0/772845479 >> v2:172.21.15.139:3300/0 conn(0x7f7c48157560 0x7f7c481579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.428+0000 7f7c4d322640 1 -- 172.21.15.96:0/772845479 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c48071a40 con 0x7f7c480c4510 2024-04-18T04:59:05.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4d322640 1 --2- 172.21.15.96:0/772845479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c480c4510 0x7f7c480c49a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7c480c5060 tx=0x7f7c4001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444a342b36266213 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c3f7fe640 1 -- 172.21.15.96:0/772845479 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c400a5840 con 0x7f7c480c4510 2024-04-18T04:59:05.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c3f7fe640 1 -- 172.21.15.96:0/772845479 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c400a59a0 con 0x7f7c480c4510 2024-04-18T04:59:05.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c3f7fe640 1 -- 172.21.15.96:0/772845479 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c400a5d30 con 0x7f7c480c4510 2024-04-18T04:59:05.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 -- 172.21.15.96:0/772845479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c480c4510 msgr2=0x7f7c480c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 --2- 172.21.15.96:0/772845479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c480c4510 0x7f7c480c49a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7c480c5060 tx=0x7f7c4001c9c0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 -- 172.21.15.96:0/772845479 shutdown_connections 2024-04-18T04:59:05.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 --2- 172.21.15.96:0/772845479 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c480c4510 0x7f7c480c49a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 --2- 172.21.15.96:0/772845479 >> v2:172.21.15.139:3300/0 conn(0x7f7c48157560 0x7f7c481579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 --2- 172.21.15.96:0/772845479 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c481510e0 0x7f7c48069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 -- 172.21.15.96:0/772845479 >> 172.21.15.96:0/772845479 conn(0x7f7c480c7d00 msgr2=0x7f7c480c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:05.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 -- 172.21.15.96:0/772845479 shutdown_connections 2024-04-18T04:59:05.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 -- 172.21.15.96:0/772845479 wait complete. 2024-04-18T04:59:05.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 Processor -- start 2024-04-18T04:59:05.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 -- start start 2024-04-18T04:59:05.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c480c4510 0x7f7c4814d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c481510e0 0x7f7c480c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c48157560 0x7f7c480be860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4814a0a0 con 0x7f7c481510e0 2024-04-18T04:59:05.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4814b7f0 con 0x7f7c480c4510 2024-04-18T04:59:05.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4814d9e0 con 0x7f7c48157560 2024-04-18T04:59:05.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c3ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c481510e0 0x7f7c480c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c3ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c481510e0 0x7f7c480c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59798/0 (socket says 172.21.15.96:59798) 2024-04-18T04:59:05.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c3ffff640 1 -- 172.21.15.96:0/1788188058 learned_addr learned my addr 172.21.15.96:0/1788188058 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:05.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4cb21640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c480c4510 0x7f7c4814d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4d322640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c48157560 0x7f7c480be860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c3ffff640 1 -- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c48157560 msgr2=0x7f7c480be860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c3ffff640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c48157560 0x7f7c480be860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c3ffff640 1 -- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c480c4510 msgr2=0x7f7c4814d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c3ffff640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c480c4510 0x7f7c4814d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c3ffff640 1 -- 172.21.15.96:0/1788188058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c40009b30 con 0x7f7c481510e0 2024-04-18T04:59:05.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c3ffff640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c481510e0 0x7f7c480c5c60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800d5f0 tx=0x7f7c3800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c3d7fa640 1 -- 172.21.15.96:0/1788188058 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c380125f0 con 0x7f7c481510e0 2024-04-18T04:59:05.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c3d7fa640 1 -- 172.21.15.96:0/1788188058 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c38012750 con 0x7f7c481510e0 2024-04-18T04:59:05.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 -- 172.21.15.96:0/1788188058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4814d700 con 0x7f7c481510e0 2024-04-18T04:59:05.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c3d7fa640 1 -- 172.21.15.96:0/1788188058 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38012ae0 con 0x7f7c481510e0 2024-04-18T04:59:05.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.432+0000 7f7c4ed85640 1 -- 172.21.15.96:0/1788188058 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4814b1a0 con 0x7f7c481510e0 2024-04-18T04:59:05.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.436+0000 7f7c4ed85640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c4814b390 0x7f7c481f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.436+0000 7f7c4ed85640 1 -- 172.21.15.96:0/1788188058 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c48157040 con 0x7f7c4814b390 2024-04-18T04:59:05.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.436+0000 7f7c4cb21640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c4814b390 0x7f7c481f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.436+0000 7f7c3d7fa640 1 -- 172.21.15.96:0/1788188058 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c38012c40 con 0x7f7c481510e0 2024-04-18T04:59:05.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.436+0000 7f7c3d7fa640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7c34066690 0x7f7c34068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.436+0000 7f7c3d7fa640 1 -- 172.21.15.96:0/1788188058 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7c38084670 con 0x7f7c481510e0 2024-04-18T04:59:05.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.436+0000 7f7c4d322640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7c34066690 0x7f7c34068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.436+0000 7f7c4cb21640 1 -- 172.21.15.96:0/1788188058 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c480722a0 con 0x7f7c4814b390 2024-04-18T04:59:05.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.436+0000 7f7c4d322640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7c34066690 0x7f7c34068b50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7c400ae000 tx=0x7f7c400a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.436+0000 7f7c4cb21640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c4814b390 0x7f7c481f2a20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400e7a0 tx=0x7f7c4400ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.436+0000 7f7c3d7fa640 1 -- 172.21.15.96:0/1788188058 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4400ee50 con 0x7f7c4814b390 2024-04-18T04:59:05.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.436+0000 7f7c3d7fa640 1 -- 172.21.15.96:0/1788188058 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f7c4400c020 con 0x7f7c4814b390 2024-04-18T04:59:05.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.436+0000 7f7c3d7fa640 1 -- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c4814b390 msgr2=0x7f7c481f2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.436+0000 7f7c3d7fa640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c4814b390 0x7f7c481f2a20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400e7a0 tx=0x7f7c4400ec60 comp rx=0 tx=0).stop 2024-04-18T04:59:05.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.436+0000 7f7c3d7fa640 1 -- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c4814b390 msgr2=0x7f7c481f2a20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:59:05.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.436+0000 7f7c3d7fa640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c4814b390 0x7f7c481f2a20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c4ed85640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c4814c9d0 0x7f7c481f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c4ed85640 1 -- 172.21.15.96:0/1788188058 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c48071700 con 0x7f7c4814c9d0 2024-04-18T04:59:05.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c4cb21640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c4814c9d0 0x7f7c481f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c4cb21640 1 -- 172.21.15.96:0/1788188058 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7c480670f0 con 0x7f7c4814c9d0 2024-04-18T04:59:05.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c4cb21640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c4814c9d0 0x7f7c481f2f60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7c44019000 tx=0x7f7c440046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c3d7fa640 1 -- 172.21.15.96:0/1788188058 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440038f0 con 0x7f7c4814c9d0 2024-04-18T04:59:05.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c3d7fa640 1 -- 172.21.15.96:0/1788188058 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7f7c44003a50 con 0x7f7c4814c9d0 2024-04-18T04:59:05.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c3d7fa640 1 -- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c4814c9d0 msgr2=0x7f7c481f2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c3d7fa640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c4814c9d0 0x7f7c481f2f60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7c44019000 tx=0x7f7c440046d0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c3d7fa640 1 -- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c4814c9d0 msgr2=0x7f7c481f2f60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:59:05.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c3d7fa640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7c4814c9d0 0x7f7c481f2f60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.448 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:59:05.449 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:59:05.449 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:59:05.449 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:59:05.449 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 46, 2024-04-18T04:59:05.449 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:59:05.449 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:59:05.449 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:59:05.449 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:59:05.449 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.449 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 12, 2024-04-18T04:59:05.449 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:59:05.449 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:59:05.450 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:59:05.450 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:05.450 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:05.450 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:05.450 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:05.450 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:05.450 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:05.450 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:05.450 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:05.450 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:05.450 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:05.450 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.450 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:59:05.450 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:59:05.450 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:05.451 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:05.451 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:05.451 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:05.451 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:05.451 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:05.451 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:05.451 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:05.451 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:05.451 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:05.451 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.451 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:59:05.451 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:59:05.451 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:59:05.451 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:59:05.452 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:59:05.452 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:59:05.452 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:59:05.452 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:59:05.452 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:59:05.452 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:59:05.452 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:59:05.452 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:59:05.452 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:59:05.452 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:59:05.452 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:59:05.452 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:59:05.452 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:59:05.452 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:05.452 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:59:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:59:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:59:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:59:05.453 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:05.454 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:05.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.454 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:05.454 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:59:05.454 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.454 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:05.454 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:59:05.454 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.454 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.454 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.454 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:59:05.455 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:59:05.455 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:05.455 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:05.455 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:05.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.455 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:59:05.455 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:59:05.455 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:05.455 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:05.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.455 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:05.455 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:59:05.455 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.456 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:05.456 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:59:05.456 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.456 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.456 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.456 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:59:05.456 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:59:05.456 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:05.456 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:05.456 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:05.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.456 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:59:05.457 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:59:05.457 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:05.457 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:05.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.457 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:05.457 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:59:05.457 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.457 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:05.457 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:59:05.457 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:05.457 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.458 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.458 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:59:05.458 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:59:05.458 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:05.458 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:05.458 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:05.458 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.458 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.458 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:59:05.458 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:59:05.458 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.458 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:05.459 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:05.459 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:59:05.459 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.459 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.459 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:59:05.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.459 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:05.459 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:05.459 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:59:05.459 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.459 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.459 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:59:05.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.459 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:05.459 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:05.460 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4 2024-04-18T04:59:05.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.460 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.460 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:59:05.460 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.460 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:05.460 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:05.460 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 3 2024-04-18T04:59:05.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.460 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:05.460 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:59:05.460 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:05.460 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:05.460 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:05.460 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:59:05.461 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:05.461 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:05.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:05.461 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:59:05.461 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:59:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c4ed85640 1 -- 172.21.15.96:0/1788188058 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7c34066690 msgr2=0x7f7c34068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c4ed85640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7c34066690 0x7f7c34068b50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7c400ae000 tx=0x7f7c400a7070 comp rx=0 tx=0).stop 2024-04-18T04:59:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c4ed85640 1 -- 172.21.15.96:0/1788188058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c481510e0 msgr2=0x7f7c480c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c4ed85640 1 --2- 172.21.15.96:0/1788188058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c481510e0 0x7f7c480c5c60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800d5f0 tx=0x7f7c3800dab0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c4d322640 1 -- 172.21.15.96:0/1788188058 reap_dead start 2024-04-18T04:59:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c4d322640 1 -- 172.21.15.96:0/1788188058 reap_dead start 2024-04-18T04:59:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c4ed85640 1 -- 172.21.15.96:0/1788188058 shutdown_connections 2024-04-18T04:59:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c4ed85640 1 -- 172.21.15.96:0/1788188058 >> 172.21.15.96:0/1788188058 conn(0x7f7c480c7d00 msgr2=0x7f7c48156350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c4ed85640 1 -- 172.21.15.96:0/1788188058 shutdown_connections 2024-04-18T04:59:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.444+0000 7f7c4ed85640 1 -- 172.21.15.96:0/1788188058 wait complete. 2024-04-18T04:59:05.463 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:59:05.463 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-04-18T04:59:05.464 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-18T04:59:05.464 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-04-18T04:59:05.464 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-18T04:59:05.464 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-18T04:59:05.464 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:59:05.488 INFO:tasks.ceph.mon.c:Stopped 2024-04-18T04:59:05.488 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-18T04:59:05.489 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:59:05.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.592+0000 7f1f20678640 1 Processor -- start 2024-04-18T04:59:05.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.592+0000 7f1f20678640 1 -- start start 2024-04-18T04:59:05.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.592+0000 7f1f20678640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1f18150dd0 0x7f1f18156db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.592+0000 7f1f20678640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f181572f0 0x7f1f1806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.592+0000 7f1f20678640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f181511b0 con 0x7f1f180cbd30 2024-04-18T04:59:05.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.592+0000 7f1f20678640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f180c9ac0 con 0x7f1f18150dd0 2024-04-18T04:59:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.592+0000 7f1f20678640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f180722f0 con 0x7f1f181572f0 2024-04-18T04:59:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.592+0000 7f1f1dc13640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1f180cbd30 0x7f1f1806e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:58856/0 (socket says 172.21.15.96:58856) 2024-04-18T04:59:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.592+0000 7f1f1dc13640 1 -- 172.21.15.96:0/2879889692 learned_addr learned my addr 172.21.15.96:0/2879889692 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:59:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.592+0000 7f1f1ec15640 1 -- 172.21.15.96:0/2879889692 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f181572f0 msgr2=0x7f1f1806f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T04:59:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.592+0000 7f1f1ec15640 1 --2- 172.21.15.96:0/2879889692 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f181572f0 0x7f1f1806f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.592+0000 7f1f1e414640 1 --2- 172.21.15.96:0/2879889692 >> v2:172.21.15.139:3300/0 conn(0x7f1f18150dd0 0x7f1f18156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.592+0000 7f1f1d412640 1 -- 172.21.15.96:0/2879889692 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244846346 0 0) 0x7f1f181511b0 con 0x7f1f180cbd30 2024-04-18T04:59:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.592+0000 7f1f1d412640 1 -- 172.21.15.96:0/2879889692 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f04003530 con 0x7f1f180cbd30 2024-04-18T04:59:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 -- 172.21.15.96:0/2879889692 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1178704537 0 0) 0x7f1f04003530 con 0x7f1f180cbd30 2024-04-18T04:59:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 -- 172.21.15.96:0/2879889692 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f181572f0 msgr2=0x7f1f1806f070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:59:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 --2- 172.21.15.96:0/2879889692 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f181572f0 0x7f1f1806f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 -- 172.21.15.96:0/2879889692 >> v2:172.21.15.139:3300/0 conn(0x7f1f18150dd0 msgr2=0x7f1f18156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 --2- 172.21.15.96:0/2879889692 >> v2:172.21.15.139:3300/0 conn(0x7f1f18150dd0 0x7f1f18156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 -- 172.21.15.96:0/2879889692 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1806f5b0 con 0x7f1f180cbd30 2024-04-18T04:59:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 -- 172.21.15.96:0/2879889692 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f1f08001680 con 0x7f1f180cbd30 2024-04-18T04:59:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 -- 172.21.15.96:0/2879889692 >> v1:172.21.15.96:6789/0 conn(0x7f1f180cbd30 legacy=0x7f1f1806e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 --2- 172.21.15.96:0/2879889692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f04003980 0x7f1f04003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 --2- 172.21.15.96:0/2879889692 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f181572f0 0x7f1f040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 --2- 172.21.15.96:0/2879889692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f04004d10 0x7f1f04005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 -- 172.21.15.96:0/2879889692 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f180c9ac0 con 0x7f1f04004d10 2024-04-18T04:59:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 -- 172.21.15.96:0/2879889692 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f180722f0 con 0x7f1f04003980 2024-04-18T04:59:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 -- 172.21.15.96:0/2879889692 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0400bac0 con 0x7f1f181572f0 2024-04-18T04:59:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1dc13640 1 -- 172.21.15.96:0/2879889692 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f181572f0 msgr2=0x7f1f040047d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T04:59:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1dc13640 1 --2- 172.21.15.96:0/2879889692 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f181572f0 0x7f1f040047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1ec15640 1 --2- 172.21.15.96:0/2879889692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f04004d10 0x7f1f04005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1ec15640 1 -- 172.21.15.96:0/2879889692 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f181572f0 msgr2=0x7f1f040047d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:59:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1ec15640 1 --2- 172.21.15.96:0/2879889692 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f181572f0 0x7f1f040047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1e414640 1 --2- 172.21.15.96:0/2879889692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f04003980 0x7f1f04003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1ec15640 1 -- 172.21.15.96:0/2879889692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f04003980 msgr2=0x7f1f04003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:05.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1ec15640 1 --2- 172.21.15.96:0/2879889692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f04003980 0x7f1f04003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1ec15640 1 -- 172.21.15.96:0/2879889692 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f04003530 con 0x7f1f04004d10 2024-04-18T04:59:05.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1ec15640 1 --2- 172.21.15.96:0/2879889692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f04004d10 0x7f1f04005190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009e30 tx=0x7f1f1401cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae5d96684b0fa6e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 -- 172.21.15.96:0/2879889692 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f140a5a10 con 0x7f1f04004d10 2024-04-18T04:59:05.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 -- 172.21.15.96:0/2879889692 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f140a5b70 con 0x7f1f04004d10 2024-04-18T04:59:05.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1d412640 1 -- 172.21.15.96:0/2879889692 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f140ae470 con 0x7f1f04004d10 2024-04-18T04:59:05.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f20678640 1 -- 172.21.15.96:0/2879889692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f04004d10 msgr2=0x7f1f04005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f20678640 1 --2- 172.21.15.96:0/2879889692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f04004d10 0x7f1f04005190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009e30 tx=0x7f1f1401cb10 comp rx=0 tx=0).stop 2024-04-18T04:59:05.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f1ec15640 1 -- 172.21.15.96:0/2879889692 reap_dead start 2024-04-18T04:59:05.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f20678640 1 -- 172.21.15.96:0/2879889692 shutdown_connections 2024-04-18T04:59:05.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f20678640 1 -- 172.21.15.96:0/2879889692 >> 172.21.15.96:0/2879889692 conn(0x7f1f1806af70 msgr2=0x7f1f1806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:05.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f20678640 1 -- 172.21.15.96:0/2879889692 shutdown_connections 2024-04-18T04:59:05.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.596+0000 7f1f20678640 1 -- 172.21.15.96:0/2879889692 wait complete. 2024-04-18T04:59:05.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f20678640 1 Processor -- start 2024-04-18T04:59:05.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f20678640 1 -- start start 2024-04-18T04:59:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f20678640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f1815a2f0 0x7f1f181529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f20678640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f1815a6d0 0x7f1f1814a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f20678640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f18153150 0x7f1f180c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f20678640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f18153600 con 0x7f1f1815a6d0 2024-04-18T04:59:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f20678640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f18151390 con 0x7f1f1815a2f0 2024-04-18T04:59:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f20678640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f18149ee0 con 0x7f1f18153150 2024-04-18T04:59:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f1dc13640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f1815a6d0 0x7f1f1814a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f1ec15640 1 -- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f18153150 msgr2=0x7f1f180c42c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T04:59:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f1dc13640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f1815a6d0 0x7f1f1814a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59868/0 (socket says 172.21.15.96:59868) 2024-04-18T04:59:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f1dc13640 1 -- 172.21.15.96:0/2739620422 learned_addr learned my addr 172.21.15.96:0/2739620422 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f1ec15640 1 --2- 172.21.15.96:0/2739620422 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f18153150 0x7f1f180c42c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f1e414640 1 --2- 172.21.15.96:0/2739620422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f1815a2f0 0x7f1f181529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f1dc13640 1 -- 172.21.15.96:0/2739620422 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f18153150 msgr2=0x7f1f180c42c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:59:05.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f1dc13640 1 --2- 172.21.15.96:0/2739620422 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f18153150 0x7f1f180c42c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f1dc13640 1 -- 172.21.15.96:0/2739620422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f1815a2f0 msgr2=0x7f1f181529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f1dc13640 1 --2- 172.21.15.96:0/2739620422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f1815a2f0 0x7f1f181529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f1dc13640 1 -- 172.21.15.96:0/2739620422 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f181515a0 con 0x7f1f1815a6d0 2024-04-18T04:59:05.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f1e414640 1 --2- 172.21.15.96:0/2739620422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f1815a2f0 0x7f1f181529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:59:05.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f1dc13640 1 --2- 172.21.15.96:0/2739620422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f1815a6d0 0x7f1f1814a6a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1f08004850 tx=0x7f1f0800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f0effd640 1 -- 172.21.15.96:0/2739620422 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08004cc0 con 0x7f1f1815a6d0 2024-04-18T04:59:05.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f0effd640 1 -- 172.21.15.96:0/2739620422 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f08004e20 con 0x7f1f1815a6d0 2024-04-18T04:59:05.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f0effd640 1 -- 172.21.15.96:0/2739620422 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f080072d0 con 0x7f1f1815a6d0 2024-04-18T04:59:05.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f20678640 1 -- 172.21.15.96:0/2739620422 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f18151880 con 0x7f1f1815a6d0 2024-04-18T04:59:05.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f20678640 1 -- 172.21.15.96:0/2739620422 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f180c4800 con 0x7f1f1815a6d0 2024-04-18T04:59:05.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.600+0000 7f1f20678640 1 -- 172.21.15.96:0/2739620422 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1814a3c0 con 0x7f1f1815a6d0 2024-04-18T04:59:05.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.604+0000 7f1f0effd640 1 -- 172.21.15.96:0/2739620422 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1f08007430 con 0x7f1f1815a6d0 2024-04-18T04:59:05.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.604+0000 7f1f0effd640 1 --2- 172.21.15.96:0/2739620422 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1efc066640 0x7f1efc068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:05.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.604+0000 7f1f0effd640 1 -- 172.21.15.96:0/2739620422 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1f080836c0 con 0x7f1f1815a6d0 2024-04-18T04:59:05.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.604+0000 7f1f1e414640 1 --2- 172.21.15.96:0/2739620422 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1efc066640 0x7f1efc068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:05.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.604+0000 7f1f1e414640 1 --2- 172.21.15.96:0/2739620422 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1efc066640 0x7f1efc068b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009a80 tx=0x7f1f10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:05.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.608+0000 7f1f0effd640 1 -- 172.21.15.96:0/2739620422 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1f1814a3c0 con 0x7f1f1815a6d0 2024-04-18T04:59:05.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.824+0000 7f1f20678640 1 -- 172.21.15.96:0/2739620422 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1f1814a3c0 con 0x7f1f1815a6d0 2024-04-18T04:59:05.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.824+0000 7f1f0effd640 1 -- 172.21.15.96:0/2739620422 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f1f1814a3c0 con 0x7f1f1815a6d0 2024-04-18T04:59:05.825 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:59:05.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.824+0000 7f1f20678640 1 -- 172.21.15.96:0/2739620422 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1efc066640 msgr2=0x7f1efc068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.824+0000 7f1f20678640 1 --2- 172.21.15.96:0/2739620422 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1efc066640 0x7f1efc068b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009a80 tx=0x7f1f10008040 comp rx=0 tx=0).stop 2024-04-18T04:59:05.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.824+0000 7f1f20678640 1 -- 172.21.15.96:0/2739620422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f1815a6d0 msgr2=0x7f1f1814a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:05.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.824+0000 7f1f20678640 1 --2- 172.21.15.96:0/2739620422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f1815a6d0 0x7f1f1814a6a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1f08004850 tx=0x7f1f0800cf50 comp rx=0 tx=0).stop 2024-04-18T04:59:05.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.824+0000 7f1f20678640 1 -- 172.21.15.96:0/2739620422 shutdown_connections 2024-04-18T04:59:05.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.824+0000 7f1f20678640 1 --2- 172.21.15.96:0/2739620422 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1efc066640 0x7f1efc068b00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.824+0000 7f1f20678640 1 --2- 172.21.15.96:0/2739620422 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f18153150 0x7f1f180c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.824+0000 7f1f20678640 1 --2- 172.21.15.96:0/2739620422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f1815a6d0 0x7f1f1814a6a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.824+0000 7f1f20678640 1 --2- 172.21.15.96:0/2739620422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f1815a2f0 0x7f1f181529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:05.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.824+0000 7f1f20678640 1 -- 172.21.15.96:0/2739620422 >> 172.21.15.96:0/2739620422 conn(0x7f1f1806af70 msgr2=0x7f1f181555c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:05.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.824+0000 7f1f20678640 1 -- 172.21.15.96:0/2739620422 shutdown_connections 2024-04-18T04:59:05.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:05.824+0000 7f1f20678640 1 -- 172.21.15.96:0/2739620422 wait complete. 2024-04-18T04:59:08.844 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:59:08.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.972+0000 7f0b16580640 1 Processor -- start 2024-04-18T04:59:08.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.972+0000 7f0b16580640 1 -- start start 2024-04-18T04:59:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.972+0000 7f0b16580640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0b10150e40 0x7f0b100c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.972+0000 7f0b16580640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b10151220 0x7f0b100c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b16580640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b10157c40 con 0x7f0b10071b40 2024-04-18T04:59:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b16580640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1006a740 con 0x7f0b10150e40 2024-04-18T04:59:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b16580640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b10156de0 con 0x7f0b10151220 2024-04-18T04:59:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b07fff640 1 -- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b10151220 msgr2=0x7f0b100c50d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T04:59:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b07fff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b10151220 0x7f0b100c50d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b14b1d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f0b10071b40 0x7f0b1015a5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39226/0 (socket says 172.21.15.96:39226) 2024-04-18T04:59:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b14b1d640 1 -- 172.21.15.96:0/3507683634 learned_addr learned my addr 172.21.15.96:0/3507683634 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:59:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b0ffff640 1 --2- 172.21.15.96:0/3507683634 >> v2:172.21.15.139:3300/0 conn(0x7f0b10150e40 0x7f0b100c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b0f7fe640 1 -- 172.21.15.96:0/3507683634 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336370077 0 0) 0x7f0b10157c40 con 0x7f0b10071b40 2024-04-18T04:59:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b0f7fe640 1 -- 172.21.15.96:0/3507683634 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0afc003530 con 0x7f0b10071b40 2024-04-18T04:59:08.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b0ffff640 1 -- 172.21.15.96:0/3507683634 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b10151220 msgr2=0x7f0b100c50d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:59:08.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b0ffff640 1 --2- 172.21.15.96:0/3507683634 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b10151220 0x7f0b100c50d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:08.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b0ffff640 1 -- 172.21.15.96:0/3507683634 >> v1:172.21.15.96:6789/0 conn(0x7f0b10071b40 legacy=0x7f0b1015a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:08.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b0ffff640 1 -- 172.21.15.96:0/3507683634 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b101570c0 con 0x7f0b10150e40 2024-04-18T04:59:08.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b0ffff640 1 --2- 172.21.15.96:0/3507683634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b10150e40 0x7f0b100c4b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0b000097c0 tx=0x7f0b0001c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16686c456997353a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:08.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b0f7fe640 1 -- 172.21.15.96:0/3507683634 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b000ab600 con 0x7f0b10150e40 2024-04-18T04:59:08.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b0f7fe640 1 -- 172.21.15.96:0/3507683634 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b000a7050 con 0x7f0b10150e40 2024-04-18T04:59:08.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.976+0000 7f0b0f7fe640 1 -- 172.21.15.96:0/3507683634 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b000ab960 con 0x7f0b10150e40 2024-04-18T04:59:08.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 -- 172.21.15.96:0/3507683634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b10150e40 msgr2=0x7f0b100c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:08.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 --2- 172.21.15.96:0/3507683634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b10150e40 0x7f0b100c4b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0b000097c0 tx=0x7f0b0001c4c0 comp rx=0 tx=0).stop 2024-04-18T04:59:08.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 -- 172.21.15.96:0/3507683634 shutdown_connections 2024-04-18T04:59:08.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 --2- 172.21.15.96:0/3507683634 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b10151220 0x7f0b100c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:08.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 --2- 172.21.15.96:0/3507683634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b10150e40 0x7f0b100c4b90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:08.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 -- 172.21.15.96:0/3507683634 >> 172.21.15.96:0/3507683634 conn(0x7f0b10066250 msgr2=0x7f0b1006eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:08.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 -- 172.21.15.96:0/3507683634 shutdown_connections 2024-04-18T04:59:08.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 -- 172.21.15.96:0/3507683634 wait complete. 2024-04-18T04:59:08.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 Processor -- start 2024-04-18T04:59:08.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 -- start start 2024-04-18T04:59:08.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b10071b40 0x7f0b1014b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:08.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b10150e40 0x7f0b10143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:08.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b10151220 0x7f0b10144200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:08.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b10144740 con 0x7f0b10071b40 2024-04-18T04:59:08.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b10147ff0 con 0x7f0b10150e40 2024-04-18T04:59:08.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b101482d0 con 0x7f0b10151220 2024-04-18T04:59:08.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b0ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b10071b40 0x7f0b1014b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:08.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b0ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b10071b40 0x7f0b1014b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37818/0 (socket says 172.21.15.96:37818) 2024-04-18T04:59:08.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b0ffff640 1 -- 172.21.15.96:0/723980849 learned_addr learned my addr 172.21.15.96:0/723980849 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:08.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b14b1d640 1 -- 172.21.15.96:0/723980849 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b10151220 msgr2=0x7f0b10144200 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T04:59:08.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b14b1d640 1 --2- 172.21.15.96:0/723980849 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b10151220 0x7f0b10144200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:08.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b07fff640 1 --2- 172.21.15.96:0/723980849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b10150e40 0x7f0b10143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:08.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b0ffff640 1 -- 172.21.15.96:0/723980849 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b10151220 msgr2=0x7f0b10144200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:59:08.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b0ffff640 1 --2- 172.21.15.96:0/723980849 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b10151220 0x7f0b10144200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:08.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b0ffff640 1 -- 172.21.15.96:0/723980849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b10150e40 msgr2=0x7f0b10143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:08.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b0ffff640 1 --2- 172.21.15.96:0/723980849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b10150e40 0x7f0b10143cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:08.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b0ffff640 1 -- 172.21.15.96:0/723980849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b00009420 con 0x7f0b10071b40 2024-04-18T04:59:08.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b0ffff640 1 --2- 172.21.15.96:0/723980849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b10071b40 0x7f0b1014b910 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b0001c9a0 tx=0x7f0b00019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:08.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b0d7fa640 1 -- 172.21.15.96:0/723980849 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b000bc070 con 0x7f0b10071b40 2024-04-18T04:59:08.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b0d7fa640 1 -- 172.21.15.96:0/723980849 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b000038f0 con 0x7f0b10071b40 2024-04-18T04:59:08.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 -- 172.21.15.96:0/723980849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b101593a0 con 0x7f0b10071b40 2024-04-18T04:59:08.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b0d7fa640 1 -- 172.21.15.96:0/723980849 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b00003c60 con 0x7f0b10071b40 2024-04-18T04:59:08.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.980+0000 7f0b16580640 1 -- 172.21.15.96:0/723980849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b10159960 con 0x7f0b10071b40 2024-04-18T04:59:08.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.984+0000 7f0b16580640 1 -- 172.21.15.96:0/723980849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b10067050 con 0x7f0b10071b40 2024-04-18T04:59:08.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.984+0000 7f0b0d7fa640 1 -- 172.21.15.96:0/723980849 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0b000b2050 con 0x7f0b10071b40 2024-04-18T04:59:08.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.984+0000 7f0b0d7fa640 1 --2- 172.21.15.96:0/723980849 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0af0066640 0x7f0af0068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:08.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.984+0000 7f0b0d7fa640 1 -- 172.21.15.96:0/723980849 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0b0011dd00 con 0x7f0b10071b40 2024-04-18T04:59:08.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.984+0000 7f0b07fff640 1 --2- 172.21.15.96:0/723980849 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0af0066640 0x7f0af0068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:08.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.984+0000 7f0b07fff640 1 --2- 172.21.15.96:0/723980849 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0af0066640 0x7f0af0068b00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0af8006fd0 tx=0x7f0af8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:08.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:08.988+0000 7f0b0d7fa640 1 -- 172.21.15.96:0/723980849 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0b000eb200 con 0x7f0b10071b40 2024-04-18T04:59:09.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:09.252+0000 7f0b16580640 1 -- 172.21.15.96:0/723980849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0b1014aca0 con 0x7f0b10071b40 2024-04-18T04:59:09.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:09.252+0000 7f0b0d7fa640 1 -- 172.21.15.96:0/723980849 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f0b000ee820 con 0x7f0b10071b40 2024-04-18T04:59:09.255 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:59:09.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:09.256+0000 7f0b16580640 1 -- 172.21.15.96:0/723980849 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0af0066640 msgr2=0x7f0af0068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:09.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:09.256+0000 7f0b16580640 1 --2- 172.21.15.96:0/723980849 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0af0066640 0x7f0af0068b00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0af8006fd0 tx=0x7f0af8008040 comp rx=0 tx=0).stop 2024-04-18T04:59:09.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:09.256+0000 7f0b16580640 1 -- 172.21.15.96:0/723980849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b10071b40 msgr2=0x7f0b1014b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:09.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:09.256+0000 7f0b16580640 1 --2- 172.21.15.96:0/723980849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b10071b40 0x7f0b1014b910 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b0001c9a0 tx=0x7f0b00019260 comp rx=0 tx=0).stop 2024-04-18T04:59:09.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:09.256+0000 7f0b16580640 1 -- 172.21.15.96:0/723980849 shutdown_connections 2024-04-18T04:59:09.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:09.256+0000 7f0b16580640 1 --2- 172.21.15.96:0/723980849 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0af0066640 0x7f0af0068b00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:09.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:09.256+0000 7f0b16580640 1 --2- 172.21.15.96:0/723980849 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b10151220 0x7f0b10144200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:09.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:09.256+0000 7f0b16580640 1 --2- 172.21.15.96:0/723980849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b10150e40 0x7f0b10143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:09.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:09.256+0000 7f0b16580640 1 --2- 172.21.15.96:0/723980849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b10071b40 0x7f0b1014b910 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b0001c9a0 tx=0x7f0b00019260 comp rx=0 tx=0).stop 2024-04-18T04:59:09.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:09.256+0000 7f0b16580640 1 -- 172.21.15.96:0/723980849 >> 172.21.15.96:0/723980849 conn(0x7f0b10066250 msgr2=0x7f0b1014aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:09.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:09.256+0000 7f0b16580640 1 -- 172.21.15.96:0/723980849 shutdown_connections 2024-04-18T04:59:09.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:09.256+0000 7f0b16580640 1 -- 172.21.15.96:0/723980849 wait complete. 2024-04-18T04:59:12.278 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:59:12.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.416+0000 7f9bd5c91640 1 Processor -- start 2024-04-18T04:59:12.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.416+0000 7f9bd5c91640 1 -- start start 2024-04-18T04:59:12.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bd5c91640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9bd00c9210 0x7f9bd01509f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:12.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bd5c91640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9bd00c95f0 0x7f9bd0150f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:12.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bd5c91640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd00c2160 con 0x7f9bd00c8aa0 2024-04-18T04:59:12.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bd5c91640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd00c2b10 con 0x7f9bd00c9210 2024-04-18T04:59:12.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bd5c91640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd00c8690 con 0x7f9bd00c95f0 2024-04-18T04:59:12.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bcf7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9bd00c9210 0x7f9bd01509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:12.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bcf7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9bd00c9210 0x7f9bd01509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37832/0 (socket says 172.21.15.96:37832) 2024-04-18T04:59:12.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bcf7fe640 1 -- 172.21.15.96:0/1775168140 learned_addr learned my addr 172.21.15.96:0/1775168140 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:12.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bceffd640 1 --2- 172.21.15.96:0/1775168140 >> v2:172.21.15.139:3300/0 conn(0x7f9bd00c95f0 0x7f9bd0150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:12.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bcf7fe640 1 -- 172.21.15.96:0/1775168140 >> v2:172.21.15.139:3300/0 conn(0x7f9bd00c95f0 msgr2=0x7f9bd0150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:12.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bcf7fe640 1 --2- 172.21.15.96:0/1775168140 >> v2:172.21.15.139:3300/0 conn(0x7f9bd00c95f0 0x7f9bd0150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:12.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bcf7fe640 1 -- 172.21.15.96:0/1775168140 >> v1:172.21.15.139:6789/0 conn(0x7f9bd00c8aa0 legacy=0x7f9bd00c1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:12.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bcf7fe640 1 -- 172.21.15.96:0/1775168140 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd00c7a10 con 0x7f9bd00c9210 2024-04-18T04:59:12.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bcf7fe640 1 --2- 172.21.15.96:0/1775168140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bd00c9210 0x7f9bd01509f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00c38f0 tx=0x7f9bc001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ca98e5cccfa79b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:12.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bce7fc640 1 -- 172.21.15.96:0/1775168140 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc00ab620 con 0x7f9bd00c9210 2024-04-18T04:59:12.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bce7fc640 1 -- 172.21.15.96:0/1775168140 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc00ab780 con 0x7f9bd00c9210 2024-04-18T04:59:12.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.420+0000 7f9bce7fc640 1 -- 172.21.15.96:0/1775168140 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc00abb10 con 0x7f9bd00c9210 2024-04-18T04:59:12.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 -- 172.21.15.96:0/1775168140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bd00c9210 msgr2=0x7f9bd01509f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:12.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 --2- 172.21.15.96:0/1775168140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bd00c9210 0x7f9bd01509f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00c38f0 tx=0x7f9bc001c420 comp rx=0 tx=0).stop 2024-04-18T04:59:12.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 -- 172.21.15.96:0/1775168140 shutdown_connections 2024-04-18T04:59:12.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 --2- 172.21.15.96:0/1775168140 >> v2:172.21.15.139:3300/0 conn(0x7f9bd00c95f0 0x7f9bd0150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:12.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 --2- 172.21.15.96:0/1775168140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bd00c9210 0x7f9bd01509f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:12.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 -- 172.21.15.96:0/1775168140 >> 172.21.15.96:0/1775168140 conn(0x7f9bd00661c0 msgr2=0x7f9bd006fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:12.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 -- 172.21.15.96:0/1775168140 shutdown_connections 2024-04-18T04:59:12.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 -- 172.21.15.96:0/1775168140 wait complete. 2024-04-18T04:59:12.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 Processor -- start 2024-04-18T04:59:12.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 -- start start 2024-04-18T04:59:12.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bd00c8aa0 0x7f9bd0153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:12.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bd00c9210 0x7f9bd00c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:12.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bd00c95f0 0x7f9bd00c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:12.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd01521d0 con 0x7f9bd00c9210 2024-04-18T04:59:12.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd015be90 con 0x7f9bd00c95f0 2024-04-18T04:59:12.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd015b860 con 0x7f9bd00c8aa0 2024-04-18T04:59:12.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bceffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bd00c9210 0x7f9bd00c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:12.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bcf7fe640 1 -- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bd00c8aa0 msgr2=0x7f9bd0153010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T04:59:12.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bcf7fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bd00c8aa0 0x7f9bd0153010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:12.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bceffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bd00c9210 0x7f9bd00c4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37838/0 (socket says 172.21.15.96:37838) 2024-04-18T04:59:12.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bceffd640 1 -- 172.21.15.96:0/2585266565 learned_addr learned my addr 172.21.15.96:0/2585266565 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:12.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bcffff640 1 --2- 172.21.15.96:0/2585266565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bd00c95f0 0x7f9bd00c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:12.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bceffd640 1 -- 172.21.15.96:0/2585266565 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bd00c8aa0 msgr2=0x7f9bd0153010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:59:12.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bceffd640 1 --2- 172.21.15.96:0/2585266565 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bd00c8aa0 0x7f9bd0153010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:12.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bceffd640 1 -- 172.21.15.96:0/2585266565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bd00c95f0 msgr2=0x7f9bd00c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:12.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bceffd640 1 --2- 172.21.15.96:0/2585266565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bd00c95f0 0x7f9bd00c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:12.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bceffd640 1 -- 172.21.15.96:0/2585266565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc00094d0 con 0x7f9bd00c9210 2024-04-18T04:59:12.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bceffd640 1 --2- 172.21.15.96:0/2585266565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bd00c9210 0x7f9bd00c4ab0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400d5d0 tx=0x7f9bc400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:12.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bb7fff640 1 -- 172.21.15.96:0/2585266565 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4004240 con 0x7f9bd00c9210 2024-04-18T04:59:12.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bb7fff640 1 -- 172.21.15.96:0/2585266565 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc40043a0 con 0x7f9bd00c9210 2024-04-18T04:59:12.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 -- 172.21.15.96:0/2585266565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd015ca10 con 0x7f9bd00c9210 2024-04-18T04:59:12.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bb7fff640 1 -- 172.21.15.96:0/2585266565 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4003840 con 0x7f9bd00c9210 2024-04-18T04:59:12.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.424+0000 7f9bd5c91640 1 -- 172.21.15.96:0/2585266565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd015b2d0 con 0x7f9bd00c9210 2024-04-18T04:59:12.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.428+0000 7f9bd5c91640 1 -- 172.21.15.96:0/2585266565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd00c4900 con 0x7f9bd00c9210 2024-04-18T04:59:12.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.428+0000 7f9bb7fff640 1 -- 172.21.15.96:0/2585266565 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9bc40039a0 con 0x7f9bd00c9210 2024-04-18T04:59:12.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.428+0000 7f9bb7fff640 1 --2- 172.21.15.96:0/2585266565 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9bbc066640 0x7f9bbc068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:12.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.428+0000 7f9bb7fff640 1 -- 172.21.15.96:0/2585266565 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f9bc4084330 con 0x7f9bd00c9210 2024-04-18T04:59:12.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.428+0000 7f9bcf7fe640 1 --2- 172.21.15.96:0/2585266565 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9bbc066640 0x7f9bbc068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:12.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.428+0000 7f9bcf7fe640 1 --2- 172.21.15.96:0/2585266565 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9bbc066640 0x7f9bbc068b00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00af000 tx=0x7f9bc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:12.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.432+0000 7f9bb7fff640 1 -- 172.21.15.96:0/2585266565 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9bc4051680 con 0x7f9bd00c9210 2024-04-18T04:59:12.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.660+0000 7f9bd5c91640 1 -- 172.21.15.96:0/2585266565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9bd0067050 con 0x7f9bd00c9210 2024-04-18T04:59:12.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.660+0000 7f9bb7fff640 1 -- 172.21.15.96:0/2585266565 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f9bc4054ca0 con 0x7f9bd00c9210 2024-04-18T04:59:12.661 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:59:12.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.660+0000 7f9bd5c91640 1 -- 172.21.15.96:0/2585266565 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9bbc066640 msgr2=0x7f9bbc068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:12.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.660+0000 7f9bd5c91640 1 --2- 172.21.15.96:0/2585266565 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9bbc066640 0x7f9bbc068b00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00af000 tx=0x7f9bc0008040 comp rx=0 tx=0).stop 2024-04-18T04:59:12.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.660+0000 7f9bd5c91640 1 -- 172.21.15.96:0/2585266565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bd00c9210 msgr2=0x7f9bd00c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:12.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.660+0000 7f9bd5c91640 1 --2- 172.21.15.96:0/2585266565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bd00c9210 0x7f9bd00c4ab0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400d5d0 tx=0x7f9bc400da90 comp rx=0 tx=0).stop 2024-04-18T04:59:12.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.660+0000 7f9bd5c91640 1 -- 172.21.15.96:0/2585266565 shutdown_connections 2024-04-18T04:59:12.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.660+0000 7f9bd5c91640 1 --2- 172.21.15.96:0/2585266565 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9bbc066640 0x7f9bbc068b00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:12.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.660+0000 7f9bd5c91640 1 --2- 172.21.15.96:0/2585266565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bd00c95f0 0x7f9bd00c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:12.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.660+0000 7f9bd5c91640 1 --2- 172.21.15.96:0/2585266565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bd00c9210 0x7f9bd00c4ab0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:12.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.660+0000 7f9bd5c91640 1 --2- 172.21.15.96:0/2585266565 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bd00c8aa0 0x7f9bd0153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:12.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.660+0000 7f9bd5c91640 1 -- 172.21.15.96:0/2585266565 >> 172.21.15.96:0/2585266565 conn(0x7f9bd00661c0 msgr2=0x7f9bd01564a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:12.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.660+0000 7f9bd5c91640 1 -- 172.21.15.96:0/2585266565 shutdown_connections 2024-04-18T04:59:12.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:12.660+0000 7f9bd5c91640 1 -- 172.21.15.96:0/2585266565 wait complete. 2024-04-18T04:59:15.680 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:59:15.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:15.808+0000 7fc0d3a68640 1 Processor -- start 2024-04-18T04:59:15.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:15.808+0000 7fc0d3a68640 1 -- start start 2024-04-18T04:59:15.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:15.808+0000 7fc0d3a68640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 0x7fc0cc0ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:15.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:15.808+0000 7fc0d3a68640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0cc15d2a0 con 0x7fc0cc1531a0 2024-04-18T04:59:15.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:15.808+0000 7fc0d3a68640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0cc15c440 con 0x7fc0cc0c3b00 2024-04-18T04:59:15.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:15.808+0000 7fc0d3a68640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0cc153580 con 0x7fc0cc0c3620 2024-04-18T04:59:15.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:15.808+0000 7fc0d1003640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 0x7fc0cc0ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:15.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:15.808+0000 7fc0d1804640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc0cc1531a0 0x7fc0cc0cb4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39242/0 (socket says 172.21.15.96:39242) 2024-04-18T04:59:15.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:15.808+0000 7fc0d1804640 1 -- 172.21.15.96:0/4000629498 learned_addr learned my addr 172.21.15.96:0/4000629498 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:59:15.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:15.808+0000 7fc0d1003640 1 -- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 msgr2=0x7fc0cc0ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:59:15.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:15.808+0000 7fc0d1003640 1 -- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 msgr2=0x7fc0cc0ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:59:15.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:15.808+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 0x7fc0cc0ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:59:15.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:15.808+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 0x7fc0cc0ca640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:16.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:16.012+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 0x7fc0cc0ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:16.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:16.012+0000 7fc0d1003640 1 -- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 msgr2=0x7fc0cc0ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:59:16.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:16.012+0000 7fc0d1003640 1 -- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 msgr2=0x7fc0cc0ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:59:16.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:16.012+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 0x7fc0cc0ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:59:16.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:16.012+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 0x7fc0cc0ca640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:59:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:16.416+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 0x7fc0cc0ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:16.416+0000 7fc0d1003640 1 -- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 msgr2=0x7fc0cc0ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:59:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:16.416+0000 7fc0d1003640 1 -- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 msgr2=0x7fc0cc0ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:59:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:16.416+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 0x7fc0cc0ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:59:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:16.416+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 0x7fc0cc0ca640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:59:17.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:17.220+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 0x7fc0cc0ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:17.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:17.220+0000 7fc0d1003640 1 -- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 msgr2=0x7fc0cc0ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:59:17.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:17.220+0000 7fc0d1003640 1 -- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 msgr2=0x7fc0cc0ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:59:17.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:17.220+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 0x7fc0cc0ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:59:17.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:17.220+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 0x7fc0cc0ca640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:59:18.118 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:59:18.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:59:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:18.808+0000 7fc0c37fe640 1 -- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 msgr2=0x7fc0cc0ca640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:59:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:18.808+0000 7fc0c37fe640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.96:3300/0 conn(0x7fc0cc0c3620 0x7fc0cc0ca640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:18.808+0000 7fc0c37fe640 1 -- 172.21.15.96:0/4000629498 >> v1:172.21.15.139:6789/0 conn(0x7fc0cc0c3b00 legacy=0x7fc0cc159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:18.808+0000 7fc0c37fe640 1 -- 172.21.15.96:0/4000629498 >> v1:172.21.15.96:6789/0 conn(0x7fc0cc1531a0 legacy=0x7fc0cc0cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:18.808+0000 7fc0c37fe640 1 --2- 172.21.15.96:0/4000629498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0003720 0x7fc0b0005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:18.808+0000 7fc0c37fe640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 0x7fc0b00086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:18.808+0000 7fc0c37fe640 1 -- 172.21.15.96:0/4000629498 --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0cc153580 con 0x7fc0b0006200 2024-04-18T04:59:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:18.808+0000 7fc0c37fe640 1 -- 172.21.15.96:0/4000629498 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b0008d30 con 0x7fc0b0003720 2024-04-18T04:59:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:18.808+0000 7fc0d1804640 1 -- 172.21.15.96:0/4000629498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0003720 msgr2=0x7fc0b0005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T04:59:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:18.808+0000 7fc0d1804640 1 --2- 172.21.15.96:0/4000629498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0003720 0x7fc0b0005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:18.808+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 0x7fc0b00086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:18.808+0000 7fc0d1003640 1 -- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 msgr2=0x7fc0b00086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:59:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:18.812+0000 7fc0d1003640 1 -- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 msgr2=0x7fc0b00086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:59:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:18.812+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 0x7fc0b00086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:59:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:18.812+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 0x7fc0b00086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:19.012+0000 7fc0d1804640 1 -- 172.21.15.96:0/4000629498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0003720 msgr2=0x7fc0b0005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T04:59:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:19.012+0000 7fc0d1804640 1 --2- 172.21.15.96:0/4000629498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0003720 0x7fc0b0005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:59:19.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:19.016+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 0x7fc0b00086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:19.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:19.016+0000 7fc0d1003640 1 -- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 msgr2=0x7fc0b00086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:59:19.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:19.016+0000 7fc0d1003640 1 -- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 msgr2=0x7fc0b00086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:59:19.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:19.016+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 0x7fc0b00086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:59:19.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:19.016+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 0x7fc0b00086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:59:19.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:19.416+0000 7fc0d1804640 1 -- 172.21.15.96:0/4000629498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0003720 msgr2=0x7fc0b0005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T04:59:19.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:19.416+0000 7fc0d1804640 1 --2- 172.21.15.96:0/4000629498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0003720 0x7fc0b0005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:59:19.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:19.420+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 0x7fc0b00086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:19.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:19.420+0000 7fc0d1003640 1 -- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 msgr2=0x7fc0b00086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:59:19.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:19.420+0000 7fc0d1003640 1 -- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 msgr2=0x7fc0b00086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:59:19.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:19.420+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 0x7fc0b00086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:59:19.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:19.420+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 0x7fc0b00086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:59:20.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.220+0000 7fc0d1804640 1 -- 172.21.15.96:0/4000629498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0003720 msgr2=0x7fc0b0005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T04:59:20.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.220+0000 7fc0d1804640 1 --2- 172.21.15.96:0/4000629498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0003720 0x7fc0b0005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:59:20.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.224+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> v2:172.21.15.139:3300/0 conn(0x7fc0b0006200 0x7fc0b00086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.224+0000 7fc0d1003640 1 -- 172.21.15.96:0/4000629498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0003720 msgr2=0x7fc0b0005b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:59:20.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.224+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0003720 0x7fc0b0005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.224+0000 7fc0d1003640 1 -- 172.21.15.96:0/4000629498 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc15c720 con 0x7fc0b0006200 2024-04-18T04:59:20.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.228+0000 7fc0d1003640 1 --2- 172.21.15.96:0/4000629498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0b0006200 0x7fc0b00086a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8000ee0 tx=0x7fc0c801de00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48eecac946ccca82 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:20.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.228+0000 7fc0d0802640 1 -- 172.21.15.96:0/4000629498 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c80a6d20 con 0x7fc0b0006200 2024-04-18T04:59:20.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.228+0000 7fc0d0802640 1 -- 172.21.15.96:0/4000629498 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c80aa070 con 0x7fc0b0006200 2024-04-18T04:59:20.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.228+0000 7fc0d0802640 1 -- 172.21.15.96:0/4000629498 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c8004220 con 0x7fc0b0006200 2024-04-18T04:59:20.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.232+0000 7fc0d3a68640 1 -- 172.21.15.96:0/4000629498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0b0006200 msgr2=0x7fc0b00086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:20.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.232+0000 7fc0d3a68640 1 --2- 172.21.15.96:0/4000629498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0b0006200 0x7fc0b00086a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8000ee0 tx=0x7fc0c801de00 comp rx=0 tx=0).stop 2024-04-18T04:59:20.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.232+0000 7fc0d2005640 1 -- 172.21.15.96:0/4000629498 reap_dead start 2024-04-18T04:59:20.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.232+0000 7fc0d3a68640 1 -- 172.21.15.96:0/4000629498 shutdown_connections 2024-04-18T04:59:20.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.232+0000 7fc0d3a68640 1 --2- 172.21.15.96:0/4000629498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0b0006200 0x7fc0b00086a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.232+0000 7fc0d3a68640 1 -- 172.21.15.96:0/4000629498 >> 172.21.15.96:0/4000629498 conn(0x7fc0cc065d90 msgr2=0x7fc0cc0661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:20.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.232+0000 7fc0d3a68640 1 -- 172.21.15.96:0/4000629498 shutdown_connections 2024-04-18T04:59:20.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.232+0000 7fc0d3a68640 1 -- 172.21.15.96:0/4000629498 wait complete. 2024-04-18T04:59:20.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.232+0000 7fc0d3a68640 1 Processor -- start 2024-04-18T04:59:20.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.232+0000 7fc0d3a68640 1 -- start start 2024-04-18T04:59:20.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d3a68640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0006200 0x7fc0cc0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d3a68640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0cc0b2870 0x7fc0cc13f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d3a68640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0cc0b4010 0x7fc0cc1ee870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d3a68640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc1f1de0 con 0x7fc0cc0b4010 2024-04-18T04:59:20.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d3a68640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc1f2640 con 0x7fc0cc0b2870 2024-04-18T04:59:20.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d3a68640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc13f880 con 0x7fc0b0006200 2024-04-18T04:59:20.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d1804640 1 -- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0006200 msgr2=0x7fc0cc0c7d40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T04:59:20.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d1804640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0006200 0x7fc0cc0c7d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:20.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d2005640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0cc0b4010 0x7fc0cc1ee870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d2005640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0cc0b4010 0x7fc0cc1ee870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42924/0 (socket says 172.21.15.96:42924) 2024-04-18T04:59:20.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d2005640 1 -- 172.21.15.96:0/919175446 learned_addr learned my addr 172.21.15.96:0/919175446 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:20.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d1003640 1 --2- 172.21.15.96:0/919175446 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0cc0b2870 0x7fc0cc13f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d2005640 1 -- 172.21.15.96:0/919175446 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0006200 msgr2=0x7fc0cc0c7d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:59:20.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d2005640 1 --2- 172.21.15.96:0/919175446 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0006200 0x7fc0cc0c7d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d2005640 1 -- 172.21.15.96:0/919175446 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0cc0b2870 msgr2=0x7fc0cc13f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:20.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d2005640 1 --2- 172.21.15.96:0/919175446 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0cc0b2870 0x7fc0cc13f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d2005640 1 -- 172.21.15.96:0/919175446 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c800e040 con 0x7fc0cc0b4010 2024-04-18T04:59:20.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d2005640 1 --2- 172.21.15.96:0/919175446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0cc0b4010 0x7fc0cc1ee870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc159f40 tx=0x7fc0c400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:20.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0c27fc640 1 -- 172.21.15.96:0/919175446 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4005d50 con 0x7fc0cc0b4010 2024-04-18T04:59:20.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0c27fc640 1 -- 172.21.15.96:0/919175446 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c400a610 con 0x7fc0cc0b4010 2024-04-18T04:59:20.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d3a68640 1 -- 172.21.15.96:0/919175446 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0cc0b3050 con 0x7fc0cc0b4010 2024-04-18T04:59:20.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0c27fc640 1 -- 172.21.15.96:0/919175446 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c400a9c0 con 0x7fc0cc0b4010 2024-04-18T04:59:20.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d3a68640 1 -- 172.21.15.96:0/919175446 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0cc1f22d0 con 0x7fc0cc0b4010 2024-04-18T04:59:20.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0d3a68640 1 -- 172.21.15.96:0/919175446 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0cc067050 con 0x7fc0cc0b4010 2024-04-18T04:59:20.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.236+0000 7fc0c27fc640 1 -- 172.21.15.96:0/919175446 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc0c400ab20 con 0x7fc0cc0b4010 2024-04-18T04:59:20.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.240+0000 7fc0c27fc640 1 --2- 172.21.15.96:0/919175446 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc0b0069c90 0x7fc0b006c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.240+0000 7fc0c27fc640 1 -- 172.21.15.96:0/919175446 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc0c4083000 con 0x7fc0cc0b4010 2024-04-18T04:59:20.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.240+0000 7fc0d1804640 1 --2- 172.21.15.96:0/919175446 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc0b0069c90 0x7fc0b006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.240+0000 7fc0d1804640 1 --2- 172.21.15.96:0/919175446 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc0b0069c90 0x7fc0b006c150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc007fd0 tx=0x7fc0bc0079a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:20.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.244+0000 7fc0c27fc640 1 -- 172.21.15.96:0/919175446 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc0c4050380 con 0x7fc0cc0b4010 2024-04-18T04:59:20.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.496+0000 7fc0d3a68640 1 -- 172.21.15.96:0/919175446 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc0cc0b12f0 con 0x7fc0cc0b4010 2024-04-18T04:59:20.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.496+0000 7fc0c27fc640 1 -- 172.21.15.96:0/919175446 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7fc0c40539a0 con 0x7fc0cc0b4010 2024-04-18T04:59:20.501 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":50,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:59:20.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.496+0000 7fc0d3a68640 1 -- 172.21.15.96:0/919175446 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc0b0069c90 msgr2=0x7fc0b006c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:20.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.496+0000 7fc0d3a68640 1 --2- 172.21.15.96:0/919175446 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc0b0069c90 0x7fc0b006c150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc007fd0 tx=0x7fc0bc0079a0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.496+0000 7fc0d3a68640 1 -- 172.21.15.96:0/919175446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0cc0b4010 msgr2=0x7fc0cc1ee870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:20.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.496+0000 7fc0d3a68640 1 --2- 172.21.15.96:0/919175446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0cc0b4010 0x7fc0cc1ee870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc159f40 tx=0x7fc0c400cb90 comp rx=0 tx=0).stop 2024-04-18T04:59:20.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.500+0000 7fc0d3a68640 1 -- 172.21.15.96:0/919175446 shutdown_connections 2024-04-18T04:59:20.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.500+0000 7fc0d3a68640 1 --2- 172.21.15.96:0/919175446 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc0b0069c90 0x7fc0b006c150 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.500+0000 7fc0d3a68640 1 --2- 172.21.15.96:0/919175446 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0cc0b4010 0x7fc0cc1ee870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.500+0000 7fc0d3a68640 1 --2- 172.21.15.96:0/919175446 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0cc0b2870 0x7fc0cc13f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.500+0000 7fc0d3a68640 1 --2- 172.21.15.96:0/919175446 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0b0006200 0x7fc0cc0c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.500+0000 7fc0d3a68640 1 -- 172.21.15.96:0/919175446 >> 172.21.15.96:0/919175446 conn(0x7fc0cc065d90 msgr2=0x7fc0cc1508c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:20.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.500+0000 7fc0d3a68640 1 -- 172.21.15.96:0/919175446 shutdown_connections 2024-04-18T04:59:20.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.500+0000 7fc0d3a68640 1 -- 172.21.15.96:0/919175446 wait complete. 2024-04-18T04:59:20.517 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-18T04:59:20.518 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-04-18T04:59:20.518 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T04:59:20.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.636+0000 7f77e639b640 1 Processor -- start 2024-04-18T04:59:20.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.636+0000 7f77e639b640 1 -- start start 2024-04-18T04:59:20.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.636+0000 7f77e639b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f77e00c4770 0x7f77e0070d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.636+0000 7f77e639b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f77e00c4b50 0x7f77e0065ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.636+0000 7f77e639b640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e0070870 con 0x7f77e0156e30 2024-04-18T04:59:20.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.636+0000 7f77e639b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e0071240 con 0x7f77e00c4770 2024-04-18T04:59:20.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.636+0000 7f77e639b640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e00c19f0 con 0x7f77e00c4b50 2024-04-18T04:59:20.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.636+0000 7f77dffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f77e00c4770 0x7f77e0070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.636+0000 7f77dffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f77e00c4770 0x7f77e0070d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42938/0 (socket says 172.21.15.96:42938) 2024-04-18T04:59:20.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.636+0000 7f77dffff640 1 -- 172.21.15.96:0/3854337569 learned_addr learned my addr 172.21.15.96:0/3854337569 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:20.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.636+0000 7f77dffff640 1 -- 172.21.15.96:0/3854337569 >> v2:172.21.15.139:3300/0 conn(0x7f77e00c4b50 msgr2=0x7f77e0065ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:20.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.636+0000 7f77df7fe640 1 --2- 172.21.15.96:0/3854337569 >> v2:172.21.15.139:3300/0 conn(0x7f77e00c4b50 0x7f77e0065ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.636+0000 7f77dffff640 1 --2- 172.21.15.96:0/3854337569 >> v2:172.21.15.139:3300/0 conn(0x7f77e00c4b50 0x7f77e0065ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.636+0000 7f77dffff640 1 -- 172.21.15.96:0/3854337569 >> v1:172.21.15.139:6789/0 conn(0x7f77e0156e30 legacy=0x7f77e00b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:20.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.636+0000 7f77dffff640 1 -- 172.21.15.96:0/3854337569 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00c5d60 con 0x7f77e00c4770 2024-04-18T04:59:20.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.640+0000 7f77dffff640 1 --2- 172.21.15.96:0/3854337569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00c4770 0x7f77e0070d00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f77e00be7a0 tx=0x7f77d801f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480440cefe65f94e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:20.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.640+0000 7f77deffd640 1 -- 172.21.15.96:0/3854337569 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d80af400 con 0x7f77e00c4770 2024-04-18T04:59:20.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.640+0000 7f77deffd640 1 -- 172.21.15.96:0/3854337569 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d80ab050 con 0x7f77e00c4770 2024-04-18T04:59:20.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.640+0000 7f77deffd640 1 -- 172.21.15.96:0/3854337569 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d80af780 con 0x7f77e00c4770 2024-04-18T04:59:20.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.640+0000 7f77e639b640 1 -- 172.21.15.96:0/3854337569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00c4770 msgr2=0x7f77e0070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:20.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.640+0000 7f77e639b640 1 --2- 172.21.15.96:0/3854337569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00c4770 0x7f77e0070d00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f77e00be7a0 tx=0x7f77d801f1a0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.640+0000 7f77e639b640 1 -- 172.21.15.96:0/3854337569 shutdown_connections 2024-04-18T04:59:20.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.640+0000 7f77e639b640 1 --2- 172.21.15.96:0/3854337569 >> v2:172.21.15.139:3300/0 conn(0x7f77e00c4b50 0x7f77e0065ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.640+0000 7f77e639b640 1 --2- 172.21.15.96:0/3854337569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00c4770 0x7f77e0070d00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.640+0000 7f77e639b640 1 -- 172.21.15.96:0/3854337569 >> 172.21.15.96:0/3854337569 conn(0x7f77e006e020 msgr2=0x7f77e006e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:20.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.640+0000 7f77e639b640 1 -- 172.21.15.96:0/3854337569 shutdown_connections 2024-04-18T04:59:20.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.640+0000 7f77e639b640 1 -- 172.21.15.96:0/3854337569 wait complete. 2024-04-18T04:59:20.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.640+0000 7f77e639b640 1 Processor -- start 2024-04-18T04:59:20.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.640+0000 7f77e639b640 1 -- start start 2024-04-18T04:59:20.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e639b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77e00c4770 0x7f77e01e29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e639b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77e00c4b50 0x7f77e01ef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e639b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e0156e30 0x7f77e01e3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e639b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00c3c60 con 0x7f77e0156e30 2024-04-18T04:59:20.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e639b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e01e3160 con 0x7f77e00c4770 2024-04-18T04:59:20.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e639b640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00c3070 con 0x7f77e00c4b50 2024-04-18T04:59:20.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77df7fe640 1 -- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77e00c4b50 msgr2=0x7f77e01ef7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T04:59:20.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77df7fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77e00c4b50 0x7f77e01ef7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:20.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e4938640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e0156e30 0x7f77e01e3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e4938640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e0156e30 0x7f77e01e3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42946/0 (socket says 172.21.15.96:42946) 2024-04-18T04:59:20.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e4938640 1 -- 172.21.15.96:0/3066452613 learned_addr learned my addr 172.21.15.96:0/3066452613 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:20.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77dffff640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77e00c4770 0x7f77e01e29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e4938640 1 -- 172.21.15.96:0/3066452613 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77e00c4b50 msgr2=0x7f77e01ef7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:59:20.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e4938640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77e00c4b50 0x7f77e01ef7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e4938640 1 -- 172.21.15.96:0/3066452613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77e00c4770 msgr2=0x7f77e01e29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:20.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e4938640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77e00c4770 0x7f77e01e29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e4938640 1 -- 172.21.15.96:0/3066452613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8009b30 con 0x7f77e0156e30 2024-04-18T04:59:20.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e4938640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e0156e30 0x7f77e01e3610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f77d000b410 tx=0x7f77d000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:20.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77dcff9640 1 -- 172.21.15.96:0/3066452613 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0011830 con 0x7f77e0156e30 2024-04-18T04:59:20.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77dcff9640 1 -- 172.21.15.96:0/3066452613 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d0011990 con 0x7f77e0156e30 2024-04-18T04:59:20.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e639b640 1 -- 172.21.15.96:0/3066452613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e006af80 con 0x7f77e0156e30 2024-04-18T04:59:20.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77dcff9640 1 -- 172.21.15.96:0/3066452613 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0011d40 con 0x7f77e0156e30 2024-04-18T04:59:20.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e639b640 1 -- 172.21.15.96:0/3066452613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e00c35a0 con 0x7f77e0156e30 2024-04-18T04:59:20.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e639b640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e01e1cd0 0x7f77e014e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77e639b640 1 -- 172.21.15.96:0/3066452613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00c1f90 con 0x7f77e01e1cd0 2024-04-18T04:59:20.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77dffff640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e01e1cd0 0x7f77e014e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77dffff640 1 -- 172.21.15.96:0/3066452613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77e00c1cb0 con 0x7f77e01e1cd0 2024-04-18T04:59:20.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77dffff640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e01e1cd0 0x7f77e014e980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f77e00c8c90 tx=0x7f77d801bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:20.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77dcff9640 1 -- 172.21.15.96:0/3066452613 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f77d001a400 con 0x7f77e0156e30 2024-04-18T04:59:20.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77dcff9640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f77cc066640 0x7f77cc068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77df7fe640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f77cc066640 0x7f77cc068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77dcff9640 1 -- 172.21.15.96:0/3066452613 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f77d0084200 con 0x7f77e0156e30 2024-04-18T04:59:20.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77dcff9640 1 -- 172.21.15.96:0/3066452613 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d80afdc0 con 0x7f77e01e1cd0 2024-04-18T04:59:20.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77dcff9640 1 -- 172.21.15.96:0/3066452613 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f77d80b9470 con 0x7f77e01e1cd0 2024-04-18T04:59:20.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77dcff9640 1 -- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e01e1cd0 msgr2=0x7f77e014e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:20.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77dcff9640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e01e1cd0 0x7f77e014e980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f77e00c8c90 tx=0x7f77d801bf40 comp rx=0 tx=0).stop 2024-04-18T04:59:20.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77dcff9640 1 -- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e01e1cd0 msgr2=0x7f77e014e980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:59:20.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77dcff9640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e01e1cd0 0x7f77e014e980 secure :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f77e00c8c90 tx=0x7f77d801bf40 comp rx=0 tx=0).stop 2024-04-18T04:59:20.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.644+0000 7f77df7fe640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f77cc066640 0x7f77cc068b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f77d4006fd0 tx=0x7f77d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:20.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77e639b640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00c2300 0x7f77e014eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77e639b640 1 -- 172.21.15.96:0/3066452613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00c57a0 con 0x7f77e00c2300 2024-04-18T04:59:20.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77dffff640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00c2300 0x7f77e014eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77dffff640 1 -- 172.21.15.96:0/3066452613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f77e006ed70 con 0x7f77e00c2300 2024-04-18T04:59:20.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77dffff640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00c2300 0x7f77e014eec0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f77d801f1e0 tx=0x7f77d80ac000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:20.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77dcff9640 1 -- 172.21.15.96:0/3066452613 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d80b95e0 con 0x7f77e00c2300 2024-04-18T04:59:20.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77dcff9640 1 -- 172.21.15.96:0/3066452613 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4966 (secure 0 0 0) 0x7f77d80b9740 con 0x7f77e00c2300 2024-04-18T04:59:20.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77dcff9640 1 -- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00c2300 msgr2=0x7f77e014eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:20.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77dcff9640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00c2300 0x7f77e014eec0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f77d801f1e0 tx=0x7f77d80ac000 comp rx=0 tx=0).stop 2024-04-18T04:59:20.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77dcff9640 1 -- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00c2300 msgr2=0x7f77e014eec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:59:20.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77dcff9640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e00c2300 0x7f77e014eec0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.656 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:59:20.656 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:59:20.656 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:59:20.656 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T04:59:20.657 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 50, 2024-04-18T04:59:20.657 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:59:20.657 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:59:20.657 INFO:teuthology.orchestra.run.smithi096.stdout: 1 2024-04-18T04:59:20.657 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:20.657 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 0, 2024-04-18T04:59:20.657 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:59:20.657 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:59:20.657 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:59:20.657 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:20.657 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:20.657 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:20.657 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:20.658 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:20.658 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:20.658 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:20.658 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:20.658 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:20.658 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:20.658 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:20.658 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:59:20.658 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:59:20.658 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:20.658 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:20.658 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:20.659 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:20.659 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:20.659 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:20.659 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:20.659 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:20.659 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:20.659 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:20.659 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:20.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.659 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:59:20.659 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:59:20.659 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:59:20.659 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:59:20.660 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:59:20.660 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:59:20.660 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:59:20.660 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:59:20.660 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:59:20.660 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:59:20.660 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:59:20.660 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:59:20.660 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:59:20.660 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:59:20.660 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:59:20.660 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:59:20.660 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:59:20.660 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:59:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:59:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:59:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:59:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:59:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:59:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:59:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:59:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:59:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:59:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:59:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:59:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:59:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:59:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:59:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:59:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:59:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:59:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:59:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:59:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:59:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:59:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:59:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:59:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5 2024-04-18T04:59:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:59:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 8 2024-04-18T04:59:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:59:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 7 2024-04-18T04:59:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:59:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:59:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.671 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:59:20.671 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:59:20.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77e639b640 1 -- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f77cc066640 msgr2=0x7f77cc068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:20.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77e639b640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f77cc066640 0x7f77cc068b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f77d4006fd0 tx=0x7f77d4008040 comp rx=0 tx=0).stop 2024-04-18T04:59:20.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77e639b640 1 -- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e0156e30 msgr2=0x7f77e01e3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:20.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77e639b640 1 --2- 172.21.15.96:0/3066452613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77e0156e30 0x7f77e01e3610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f77d000b410 tx=0x7f77d000b8d0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77e4938640 1 -- 172.21.15.96:0/3066452613 reap_dead start 2024-04-18T04:59:20.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77e4938640 1 -- 172.21.15.96:0/3066452613 reap_dead start 2024-04-18T04:59:20.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77e639b640 1 -- 172.21.15.96:0/3066452613 shutdown_connections 2024-04-18T04:59:20.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77e639b640 1 -- 172.21.15.96:0/3066452613 >> 172.21.15.96:0/3066452613 conn(0x7f77e006e020 msgr2=0x7f77e006a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:20.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77e639b640 1 -- 172.21.15.96:0/3066452613 shutdown_connections 2024-04-18T04:59:20.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.652+0000 7f77e639b640 1 -- 172.21.15.96:0/3066452613 wait complete. 2024-04-18T04:59:20.676 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-18T04:59:20.676 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-04-18T04:59:20.676 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-18T04:59:20.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.788+0000 7f8076cb8640 1 Processor -- start 2024-04-18T04:59:20.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.788+0000 7f8076cb8640 1 -- start start 2024-04-18T04:59:20.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.788+0000 7f8076cb8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f80700c16b0 0x7f80700c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.788+0000 7f8076cb8640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f80700c7090 0x7f80700c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.788+0000 7f8076cb8640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80700c8e10 con 0x7f8070150e50 2024-04-18T04:59:20.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.788+0000 7f8076cb8640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80701571e0 con 0x7f80700c7090 2024-04-18T04:59:20.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.788+0000 7f8076cb8640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80701574c0 con 0x7f80700c16b0 2024-04-18T04:59:20.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.788+0000 7f8075255640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f80700c7090 0x7f80700c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.788+0000 7f8075255640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f80700c7090 0x7f80700c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42962/0 (socket says 172.21.15.96:42962) 2024-04-18T04:59:20.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.788+0000 7f8075255640 1 -- 172.21.15.96:0/2934198050 learned_addr learned my addr 172.21.15.96:0/2934198050 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:20.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.788+0000 7f8075255640 1 -- 172.21.15.96:0/2934198050 >> v2:172.21.15.139:3300/0 conn(0x7f80700c16b0 msgr2=0x7f80700c9120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:59:20.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.788+0000 7f8075255640 1 --2- 172.21.15.96:0/2934198050 >> v2:172.21.15.139:3300/0 conn(0x7f80700c16b0 0x7f80700c9120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.788+0000 7f8075255640 1 -- 172.21.15.96:0/2934198050 >> v1:172.21.15.139:6789/0 conn(0x7f8070150e50 legacy=0x7f807015aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:20.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.788+0000 7f8075255640 1 -- 172.21.15.96:0/2934198050 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80701577a0 con 0x7f80700c7090 2024-04-18T04:59:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.788+0000 7f8075255640 1 --2- 172.21.15.96:0/2934198050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80700c7090 0x7f80700c9660 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f80700c9ce0 tx=0x7f806801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f56c218b468b117 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.788+0000 7f80677fe640 1 -- 172.21.15.96:0/2934198050 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80680af400 con 0x7f80700c7090 2024-04-18T04:59:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f80677fe640 1 -- 172.21.15.96:0/2934198050 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80680ab050 con 0x7f80700c7090 2024-04-18T04:59:20.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f80677fe640 1 -- 172.21.15.96:0/2934198050 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80680af780 con 0x7f80700c7090 2024-04-18T04:59:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 -- 172.21.15.96:0/2934198050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80700c7090 msgr2=0x7f80700c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 --2- 172.21.15.96:0/2934198050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80700c7090 0x7f80700c9660 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f80700c9ce0 tx=0x7f806801f1c0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 -- 172.21.15.96:0/2934198050 shutdown_connections 2024-04-18T04:59:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 --2- 172.21.15.96:0/2934198050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80700c7090 0x7f80700c9660 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 --2- 172.21.15.96:0/2934198050 >> v2:172.21.15.139:3300/0 conn(0x7f80700c16b0 0x7f80700c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 -- 172.21.15.96:0/2934198050 >> 172.21.15.96:0/2934198050 conn(0x7f807006fd10 msgr2=0x7f8070070120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:20.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 -- 172.21.15.96:0/2934198050 shutdown_connections 2024-04-18T04:59:20.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 -- 172.21.15.96:0/2934198050 wait complete. 2024-04-18T04:59:20.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 Processor -- start 2024-04-18T04:59:20.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 -- start start 2024-04-18T04:59:20.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80700c16b0 0x7f807014db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80700c7090 0x7f8070155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8070150e50 0x7f807006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80701eea40 con 0x7f8070150e50 2024-04-18T04:59:20.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807014e080 con 0x7f80700c7090 2024-04-18T04:59:20.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80701ee780 con 0x7f80700c16b0 2024-04-18T04:59:20.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8074a54640 1 -- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80700c16b0 msgr2=0x7f807014db40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T04:59:20.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8075255640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8070150e50 0x7f807006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8074a54640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80700c16b0 0x7f807014db40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:20.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8075255640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8070150e50 0x7f807006bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42968/0 (socket says 172.21.15.96:42968) 2024-04-18T04:59:20.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8075255640 1 -- 172.21.15.96:0/3264974571 learned_addr learned my addr 172.21.15.96:0/3264974571 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:20.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8067fff640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80700c7090 0x7f8070155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8075255640 1 -- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80700c16b0 msgr2=0x7f807014db40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:59:20.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8075255640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80700c16b0 0x7f807014db40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8075255640 1 -- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80700c7090 msgr2=0x7f8070155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:20.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8075255640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80700c7090 0x7f8070155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8075255640 1 -- 172.21.15.96:0/3264974571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8068009b30 con 0x7f8070150e50 2024-04-18T04:59:20.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8075255640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8070150e50 0x7f807006bed0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f806801d870 tx=0x7f806801bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:20.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f80657fa640 1 -- 172.21.15.96:0/3264974571 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80680c1070 con 0x7f8070150e50 2024-04-18T04:59:20.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f80657fa640 1 -- 172.21.15.96:0/3264974571 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8068009510 con 0x7f8070150e50 2024-04-18T04:59:20.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 -- 172.21.15.96:0/3264974571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807006b110 con 0x7f8070150e50 2024-04-18T04:59:20.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f80657fa640 1 -- 172.21.15.96:0/3264974571 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80680afe60 con 0x7f8070150e50 2024-04-18T04:59:20.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 -- 172.21.15.96:0/3264974571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807006b6d0 con 0x7f8070150e50 2024-04-18T04:59:20.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f807006b8f0 0x7f807006c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.792+0000 7f8076cb8640 1 -- 172.21.15.96:0/3264974571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807006acb0 con 0x7f807006b8f0 2024-04-18T04:59:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.796+0000 7f8074a54640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f807006b8f0 0x7f807006c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.796+0000 7f80657fa640 1 -- 172.21.15.96:0/3264974571 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f80680b6050 con 0x7f8070150e50 2024-04-18T04:59:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.796+0000 7f8074a54640 1 -- 172.21.15.96:0/3264974571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f807015a580 con 0x7f807006b8f0 2024-04-18T04:59:20.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.796+0000 7f80657fa640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f805c066640 0x7f805c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.796+0000 7f80657fa640 1 -- 172.21.15.96:0/3264974571 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8068121830 con 0x7f8070150e50 2024-04-18T04:59:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.796+0000 7f8067fff640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f805c066640 0x7f805c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.796+0000 7f8074a54640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f807006b8f0 0x7f807006c410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f806c000f50 tx=0x7f806c00c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.796+0000 7f8067fff640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f805c066640 0x7f805c068b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f80700c3260 tx=0x7f8060008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.796+0000 7f80657fa640 1 -- 172.21.15.96:0/3264974571 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c0074e0 con 0x7f807006b8f0 2024-04-18T04:59:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.796+0000 7f80657fa640 1 -- 172.21.15.96:0/3264974571 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f806c007640 con 0x7f807006b8f0 2024-04-18T04:59:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.796+0000 7f80657fa640 1 -- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f807006b8f0 msgr2=0x7f807006c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.796+0000 7f80657fa640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f807006b8f0 0x7f807006c410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f806c000f50 tx=0x7f806c00c7a0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.796+0000 7f80657fa640 1 -- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f807006b8f0 msgr2=0x7f807006c410 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:59:20.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.796+0000 7f80657fa640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f807006b8f0 0x7f807006c410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:20.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f8076cb8640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80701f1b70 0x7f80701f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:20.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f8076cb8640 1 -- 172.21.15.96:0/3264974571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807015a2a0 con 0x7f80701f1b70 2024-04-18T04:59:20.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f8074a54640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80701f1b70 0x7f80701f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:20.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f8074a54640 1 -- 172.21.15.96:0/3264974571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8070151230 con 0x7f80701f1b70 2024-04-18T04:59:20.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f8074a54640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80701f1b70 0x7f80701f1f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f806c013000 tx=0x7f806c001010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:20.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f80657fa640 1 -- 172.21.15.96:0/3264974571 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c01c670 con 0x7f80701f1b70 2024-04-18T04:59:20.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f80657fa640 1 -- 172.21.15.96:0/3264974571 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4624 (secure 0 0 0) 0x7f806c023070 con 0x7f80701f1b70 2024-04-18T04:59:20.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f80657fa640 1 -- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80701f1b70 msgr2=0x7f80701f1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:20.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f80657fa640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80701f1b70 0x7f80701f1f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f806c013000 tx=0x7f806c001010 comp rx=0 tx=0).stop 2024-04-18T04:59:20.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f80657fa640 1 -- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80701f1b70 msgr2=0x7f80701f1f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:59:20.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f80657fa640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80701f1b70 0x7f80701f1f80 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f806c013000 tx=0x7f806c001010 comp rx=0 tx=0).stop 2024-04-18T04:59:20.808 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:59:20.808 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:59:20.808 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:59:20.808 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:59:20.808 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 50, 2024-04-18T04:59:20.808 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:59:20.808 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:59:20.808 INFO:teuthology.orchestra.run.smithi096.stdout: 1 2024-04-18T04:59:20.809 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:20.809 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 1, 2024-04-18T04:59:20.809 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:59:20.809 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:59:20.809 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:59:20.809 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:20.809 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:20.809 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:20.809 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:20.809 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:20.809 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:20.809 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:20.809 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:20.810 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:20.810 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:20.810 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:20.810 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:59:20.810 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:59:20.810 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:20.810 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:20.810 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:20.810 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:20.810 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:20.810 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:20.810 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:20.810 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:20.810 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:20.811 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:20.811 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:20.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.811 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:59:20.811 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:59:20.811 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:59:20.811 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:59:20.811 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:59:20.811 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:59:20.811 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:59:20.811 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:59:20.811 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:59:20.811 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:59:20.811 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:59:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:59:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:59:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:59:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:59:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:59:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:59:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:59:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:59:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:59:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:59:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:59:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:59:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:59:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:59:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:59:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:59:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:59:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:59:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:59:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:59:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:59:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:59:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:59:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:59:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:59:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:59:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:59:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:59:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:59:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:59:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:59:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:59:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:59:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:20.820 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:20.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:20.820 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:59:20.820 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:59:20.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f8076cb8640 1 -- 172.21.15.96:0/3264974571 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f805c066640 msgr2=0x7f805c068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:20.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f8076cb8640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f805c066640 0x7f805c068b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f80700c3260 tx=0x7f8060008040 comp rx=0 tx=0).stop 2024-04-18T04:59:20.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f8076cb8640 1 -- 172.21.15.96:0/3264974571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8070150e50 msgr2=0x7f807006bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:20.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f8076cb8640 1 --2- 172.21.15.96:0/3264974571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8070150e50 0x7f807006bed0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f806801d870 tx=0x7f806801bf60 comp rx=0 tx=0).stop 2024-04-18T04:59:20.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f8075255640 1 -- 172.21.15.96:0/3264974571 reap_dead start 2024-04-18T04:59:20.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f8075255640 1 -- 172.21.15.96:0/3264974571 reap_dead start 2024-04-18T04:59:20.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f8076cb8640 1 -- 172.21.15.96:0/3264974571 shutdown_connections 2024-04-18T04:59:20.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f8076cb8640 1 -- 172.21.15.96:0/3264974571 >> 172.21.15.96:0/3264974571 conn(0x7f807006fd10 msgr2=0x7f807015aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:20.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f8076cb8640 1 -- 172.21.15.96:0/3264974571 shutdown_connections 2024-04-18T04:59:20.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:20.804+0000 7f8076cb8640 1 -- 172.21.15.96:0/3264974571 wait complete. 2024-04-18T04:59:20.824 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-18T04:59:20.824 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-18T04:59:40.825 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-18T04:59:40.825 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-04-18T04:59:40.826 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-18T04:59:40.826 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-18T04:59:40.829 INFO:tasks.ceph.mon.c:Started 2024-04-18T04:59:40.829 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-18T04:59:40.829 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:59:40.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.963+0000 7f76b5f6c640 1 Processor -- start 2024-04-18T04:59:40.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.963+0000 7f76b5f6c640 1 -- start start 2024-04-18T04:59:40.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76b5f6c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f76b006eb10 0x7f76b00c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:40.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76b5f6c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b006f050 con 0x7f76b00af0b0 2024-04-18T04:59:40.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76b5f6c640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b006b110 con 0x7f76b00c7020 2024-04-18T04:59:40.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76b5f6c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b006b9b0 con 0x7f76b006eb10 2024-04-18T04:59:40.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76af7fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f76b00af0b0 0x7f76b00cc570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51366/0 (socket says 172.21.15.96:51366) 2024-04-18T04:59:40.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76af7fe640 1 -- 172.21.15.96:0/330792241 learned_addr learned my addr 172.21.15.96:0/330792241 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:59:40.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76a7fff640 1 --2- 172.21.15.96:0/330792241 >> v2:172.21.15.96:3300/0 conn(0x7f76b006eb10 0x7f76b00c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:40.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76aeffd640 1 -- 172.21.15.96:0/330792241 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260205194 0 0) 0x7f76b006f050 con 0x7f76b00af0b0 2024-04-18T04:59:40.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76aeffd640 1 -- 172.21.15.96:0/330792241 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f769c003530 con 0x7f76b00af0b0 2024-04-18T04:59:40.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76a7fff640 1 -- 172.21.15.96:0/330792241 >> v1:172.21.15.139:6789/0 conn(0x7f76b00c7020 legacy=0x7f76b0159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:40.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76a7fff640 1 -- 172.21.15.96:0/330792241 >> v1:172.21.15.96:6789/0 conn(0x7f76b00af0b0 legacy=0x7f76b00cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:40.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76a7fff640 1 -- 172.21.15.96:0/330792241 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b006b3f0 con 0x7f76b006eb10 2024-04-18T04:59:40.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76a7fff640 1 --2- 172.21.15.96:0/330792241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76b006eb10 0x7f76b00c34b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f76980097c0 tx=0x7f769801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f0d82a943ce914 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:40.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76aeffd640 1 -- 172.21.15.96:0/330792241 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76980ab600 con 0x7f76b006eb10 2024-04-18T04:59:40.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76aeffd640 1 -- 172.21.15.96:0/330792241 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76980a7050 con 0x7f76b006eb10 2024-04-18T04:59:40.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76aeffd640 1 -- 172.21.15.96:0/330792241 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76980ab980 con 0x7f76b006eb10 2024-04-18T04:59:40.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76b5f6c640 1 -- 172.21.15.96:0/330792241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76b006eb10 msgr2=0x7f76b00c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:40.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76b5f6c640 1 --2- 172.21.15.96:0/330792241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76b006eb10 0x7f76b00c34b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f76980097c0 tx=0x7f769801c410 comp rx=0 tx=0).stop 2024-04-18T04:59:40.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76b5f6c640 1 -- 172.21.15.96:0/330792241 shutdown_connections 2024-04-18T04:59:40.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76b5f6c640 1 --2- 172.21.15.96:0/330792241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76b006eb10 0x7f76b00c34b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:40.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76b5f6c640 1 -- 172.21.15.96:0/330792241 >> 172.21.15.96:0/330792241 conn(0x7f76b006a5c0 msgr2=0x7f76b0065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:40.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76b5f6c640 1 -- 172.21.15.96:0/330792241 shutdown_connections 2024-04-18T04:59:40.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.967+0000 7f76b5f6c640 1 -- 172.21.15.96:0/330792241 wait complete. 2024-04-18T04:59:40.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76b5f6c640 1 Processor -- start 2024-04-18T04:59:40.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76b5f6c640 1 -- start start 2024-04-18T04:59:40.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76b5f6c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b006eb10 0x7f76b00c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76b5f6c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76b00af0b0 0x7f76b0154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76b5f6c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f76b00c7020 0x7f76b0155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76b5f6c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b0158990 con 0x7f76b00af0b0 2024-04-18T04:59:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76b5f6c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b00c34b0 con 0x7f76b006eb10 2024-04-18T04:59:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76b5f6c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b0154760 con 0x7f76b00c7020 2024-04-18T04:59:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76a7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76b00af0b0 0x7f76b0154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76a7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76b00af0b0 0x7f76b0154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55070/0 (socket says 172.21.15.96:55070) 2024-04-18T04:59:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76a7fff640 1 -- 172.21.15.96:0/2573430757 learned_addr learned my addr 172.21.15.96:0/2573430757 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76af7fe640 1 --2- 172.21.15.96:0/2573430757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b006eb10 0x7f76b00c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76affff640 1 --2- 172.21.15.96:0/2573430757 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f76b00c7020 0x7f76b0155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76affff640 1 -- 172.21.15.96:0/2573430757 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f76b00c7020 msgr2=0x7f76b0155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-18T04:59:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76affff640 1 -- 172.21.15.96:0/2573430757 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f76b00c7020 msgr2=0x7f76b0155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T04:59:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76affff640 1 --2- 172.21.15.96:0/2573430757 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f76b00c7020 0x7f76b0155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:59:40.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76affff640 1 --2- 172.21.15.96:0/2573430757 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f76b00c7020 0x7f76b0155130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:40.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76a7fff640 1 -- 172.21.15.96:0/2573430757 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f76b00c7020 msgr2=0x7f76b0155130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:59:40.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76a7fff640 1 --2- 172.21.15.96:0/2573430757 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f76b00c7020 0x7f76b0155130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:40.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76a7fff640 1 -- 172.21.15.96:0/2573430757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b006eb10 msgr2=0x7f76b00c1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:40.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76a7fff640 1 --2- 172.21.15.96:0/2573430757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b006eb10 0x7f76b00c1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:40.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76a7fff640 1 -- 172.21.15.96:0/2573430757 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7698009420 con 0x7f76b00af0b0 2024-04-18T04:59:40.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76a7fff640 1 --2- 172.21.15.96:0/2573430757 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76b00af0b0 0x7f76b0154bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f76980ae040 tx=0x7f76980191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:40.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76acff9640 1 -- 172.21.15.96:0/2573430757 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76980b4430 con 0x7f76b00af0b0 2024-04-18T04:59:40.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76acff9640 1 -- 172.21.15.96:0/2573430757 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76980b4590 con 0x7f76b00af0b0 2024-04-18T04:59:40.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76b5f6c640 1 -- 172.21.15.96:0/2573430757 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b00c3700 con 0x7f76b00af0b0 2024-04-18T04:59:40.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76acff9640 1 -- 172.21.15.96:0/2573430757 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76980b4940 con 0x7f76b00af0b0 2024-04-18T04:59:40.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76b5f6c640 1 -- 172.21.15.96:0/2573430757 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b00c3cc0 con 0x7f76b00af0b0 2024-04-18T04:59:40.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.971+0000 7f76b5f6c640 1 -- 172.21.15.96:0/2573430757 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b01548d0 con 0x7f76b00af0b0 2024-04-18T04:59:40.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.975+0000 7f76acff9640 1 -- 172.21.15.96:0/2573430757 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f76980b2040 con 0x7f76b00af0b0 2024-04-18T04:59:40.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.975+0000 7f76acff9640 1 --2- 172.21.15.96:0/2573430757 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7690066690 0x7f7690068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:40.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.975+0000 7f76acff9640 1 -- 172.21.15.96:0/2573430757 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f769811de00 con 0x7f76b00af0b0 2024-04-18T04:59:40.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.975+0000 7f76af7fe640 1 --2- 172.21.15.96:0/2573430757 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7690066690 0x7f7690068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:40.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.975+0000 7f76af7fe640 1 --2- 172.21.15.96:0/2573430757 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7690066690 0x7f7690068b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f76a00011f0 tx=0x7f76a0007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:40.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:40.979+0000 7f76acff9640 1 -- 172.21.15.96:0/2573430757 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f76980eb1e0 con 0x7f76b00af0b0 2024-04-18T04:59:41.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:41.211+0000 7f76b5f6c640 1 -- 172.21.15.96:0/2573430757 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f76b0067050 con 0x7f76b00af0b0 2024-04-18T04:59:41.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:41.211+0000 7f76acff9640 1 -- 172.21.15.96:0/2573430757 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7f76980ee800 con 0x7f76b00af0b0 2024-04-18T04:59:41.215 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":50,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:59:41.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:41.215+0000 7f76b5f6c640 1 -- 172.21.15.96:0/2573430757 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7690066690 msgr2=0x7f7690068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:41.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:41.215+0000 7f76b5f6c640 1 --2- 172.21.15.96:0/2573430757 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7690066690 0x7f7690068b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f76a00011f0 tx=0x7f76a0007d40 comp rx=0 tx=0).stop 2024-04-18T04:59:41.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:41.215+0000 7f76b5f6c640 1 -- 172.21.15.96:0/2573430757 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76b00af0b0 msgr2=0x7f76b0154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:41.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:41.215+0000 7f76b5f6c640 1 --2- 172.21.15.96:0/2573430757 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76b00af0b0 0x7f76b0154bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f76980ae040 tx=0x7f76980191b0 comp rx=0 tx=0).stop 2024-04-18T04:59:41.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:41.215+0000 7f76b5f6c640 1 -- 172.21.15.96:0/2573430757 shutdown_connections 2024-04-18T04:59:41.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:41.215+0000 7f76b5f6c640 1 --2- 172.21.15.96:0/2573430757 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7690066690 0x7f7690068b50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:41.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:41.215+0000 7f76b5f6c640 1 --2- 172.21.15.96:0/2573430757 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f76b00c7020 0x7f76b0155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:41.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:41.215+0000 7f76b5f6c640 1 --2- 172.21.15.96:0/2573430757 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76b00af0b0 0x7f76b0154bf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:41.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:41.215+0000 7f76b5f6c640 1 --2- 172.21.15.96:0/2573430757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76b006eb10 0x7f76b00c1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:41.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:41.215+0000 7f76b5f6c640 1 -- 172.21.15.96:0/2573430757 >> 172.21.15.96:0/2573430757 conn(0x7f76b006a5c0 msgr2=0x7f76b00c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:41.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:41.215+0000 7f76b5f6c640 1 -- 172.21.15.96:0/2573430757 shutdown_connections 2024-04-18T04:59:41.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:41.215+0000 7f76b5f6c640 1 -- 172.21.15.96:0/2573430757 wait complete. 2024-04-18T04:59:44.235 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:59:44.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2fbb4640 1 Processor -- start 2024-04-18T04:59:44.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2fbb4640 1 -- start start 2024-04-18T04:59:44.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2fbb4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e28070a40 0x7f9e28156130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:44.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2fbb4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e28159380 con 0x7f9e280c60e0 2024-04-18T04:59:44.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2fbb4640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e28159620 con 0x7f9e28150260 2024-04-18T04:59:44.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2fbb4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2815a1a0 con 0x7f9e28070a40 2024-04-18T04:59:44.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2d950640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f9e280c60e0 0x7f9e2814fb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51372/0 (socket says 172.21.15.96:51372) 2024-04-18T04:59:44.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2d950640 1 -- 172.21.15.96:0/886881887 learned_addr learned my addr 172.21.15.96:0/886881887 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:59:44.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2d14f640 1 --2- 172.21.15.96:0/886881887 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e28070a40 0x7f9e28156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:44.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2c94e640 1 -- 172.21.15.96:0/886881887 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489612511 0 0) 0x7f9e28159380 con 0x7f9e280c60e0 2024-04-18T04:59:44.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2c94e640 1 -- 172.21.15.96:0/886881887 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e14003530 con 0x7f9e280c60e0 2024-04-18T04:59:44.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2d14f640 1 -- 172.21.15.96:0/886881887 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e28070a40 msgr2=0x7f9e28156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T04:59:44.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2d14f640 1 -- 172.21.15.96:0/886881887 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e28070a40 msgr2=0x7f9e28156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:59:44.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2d14f640 1 --2- 172.21.15.96:0/886881887 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e28070a40 0x7f9e28156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:59:44.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2d14f640 1 --2- 172.21.15.96:0/886881887 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e28070a40 0x7f9e28156130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:44.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2c94e640 1 -- 172.21.15.96:0/886881887 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 518026194 0 0) 0x7f9e14003530 con 0x7f9e280c60e0 2024-04-18T04:59:44.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2c94e640 1 -- 172.21.15.96:0/886881887 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e28070a40 msgr2=0x7f9e28156130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:59:44.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2c94e640 1 --2- 172.21.15.96:0/886881887 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e28070a40 0x7f9e28156130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:44.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2c94e640 1 -- 172.21.15.96:0/886881887 >> v1:172.21.15.139:6789/0 conn(0x7f9e28150260 legacy=0x7f9e28160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:44.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2c94e640 1 -- 172.21.15.96:0/886881887 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e28159900 con 0x7f9e280c60e0 2024-04-18T04:59:44.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2c94e640 1 -- 172.21.15.96:0/886881887 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f9e18001680 con 0x7f9e280c60e0 2024-04-18T04:59:44.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2c94e640 1 -- 172.21.15.96:0/886881887 >> v1:172.21.15.96:6789/0 conn(0x7f9e280c60e0 legacy=0x7f9e2814fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:44.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2c94e640 1 --2- 172.21.15.96:0/886881887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e140039b0 0x7f9e14003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:44.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2c94e640 1 --2- 172.21.15.96:0/886881887 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e140047d0 0x7f9e14004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:44.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2c94e640 1 --2- 172.21.15.96:0/886881887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e14005150 0x7f9e1400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:44.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2c94e640 1 -- 172.21.15.96:0/886881887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2815a1a0 con 0x7f9e14005150 2024-04-18T04:59:44.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2c94e640 1 -- 172.21.15.96:0/886881887 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1400bed0 con 0x7f9e140039b0 2024-04-18T04:59:44.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2c94e640 1 -- 172.21.15.96:0/886881887 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1400c090 con 0x7f9e140047d0 2024-04-18T04:59:44.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2e151640 1 --2- 172.21.15.96:0/886881887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e14005150 0x7f9e1400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:44.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2d950640 1 --2- 172.21.15.96:0/886881887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e140039b0 0x7f9e14003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:44.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2d14f640 1 --2- 172.21.15.96:0/886881887 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e140047d0 0x7f9e14004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:44.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2e151640 1 -- 172.21.15.96:0/886881887 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e140047d0 msgr2=0x7f9e14004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:44.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2e151640 1 --2- 172.21.15.96:0/886881887 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e140047d0 0x7f9e14004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:44.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2e151640 1 -- 172.21.15.96:0/886881887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e140039b0 msgr2=0x7f9e14003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:44.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2e151640 1 --2- 172.21.15.96:0/886881887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e140039b0 0x7f9e14003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:44.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.359+0000 7f9e2e151640 1 -- 172.21.15.96:0/886881887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e14003530 con 0x7f9e14005150 2024-04-18T04:59:44.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.363+0000 7f9e2e151640 1 --2- 172.21.15.96:0/886881887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e14005150 0x7f9e1400b990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9e20001e70 tx=0x7f9e2001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e48681fce38e727 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:44.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.363+0000 7f9e2c94e640 1 -- 172.21.15.96:0/886881887 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e20003b80 con 0x7f9e14005150 2024-04-18T04:59:44.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.363+0000 7f9e2c94e640 1 -- 172.21.15.96:0/886881887 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e20003ce0 con 0x7f9e14005150 2024-04-18T04:59:44.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.363+0000 7f9e2c94e640 1 -- 172.21.15.96:0/886881887 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e200052c0 con 0x7f9e14005150 2024-04-18T04:59:44.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.363+0000 7f9e2fbb4640 1 -- 172.21.15.96:0/886881887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e14005150 msgr2=0x7f9e1400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:44.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.363+0000 7f9e2fbb4640 1 --2- 172.21.15.96:0/886881887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e14005150 0x7f9e1400b990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9e20001e70 tx=0x7f9e2001c780 comp rx=0 tx=0).stop 2024-04-18T04:59:44.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.363+0000 7f9e2e151640 1 -- 172.21.15.96:0/886881887 reap_dead start 2024-04-18T04:59:44.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.363+0000 7f9e2fbb4640 1 -- 172.21.15.96:0/886881887 shutdown_connections 2024-04-18T04:59:44.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.363+0000 7f9e2fbb4640 1 -- 172.21.15.96:0/886881887 >> 172.21.15.96:0/886881887 conn(0x7f9e2806c750 msgr2=0x7f9e280c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:44.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.363+0000 7f9e2fbb4640 1 -- 172.21.15.96:0/886881887 shutdown_connections 2024-04-18T04:59:44.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.363+0000 7f9e2fbb4640 1 -- 172.21.15.96:0/886881887 wait complete. 2024-04-18T04:59:44.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2fbb4640 1 Processor -- start 2024-04-18T04:59:44.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2fbb4640 1 -- start start 2024-04-18T04:59:44.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2fbb4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e14005150 0x7f9e281f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:44.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2fbb4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e2814ece0 0x7f9e281542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:44.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2fbb4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2813a130 0x7f9e28145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:44.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2fbb4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e281590f0 con 0x7f9e2813a130 2024-04-18T04:59:44.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2fbb4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e28153ea0 con 0x7f9e2814ece0 2024-04-18T04:59:44.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2fbb4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e28154800 con 0x7f9e14005150 2024-04-18T04:59:44.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2e151640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2813a130 0x7f9e28145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:44.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2e151640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2813a130 0x7f9e28145d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55098/0 (socket says 172.21.15.96:55098) 2024-04-18T04:59:44.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2e151640 1 -- 172.21.15.96:0/2049664987 learned_addr learned my addr 172.21.15.96:0/2049664987 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:44.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2d950640 1 --2- 172.21.15.96:0/2049664987 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e14005150 0x7f9e281f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:44.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2d14f640 1 --2- 172.21.15.96:0/2049664987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e2814ece0 0x7f9e281542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:44.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2d950640 1 -- 172.21.15.96:0/2049664987 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e14005150 msgr2=0x7f9e281f1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-18T04:59:44.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2d950640 1 -- 172.21.15.96:0/2049664987 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e14005150 msgr2=0x7f9e281f1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T04:59:44.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2d950640 1 --2- 172.21.15.96:0/2049664987 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e14005150 0x7f9e281f1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:59:44.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2e151640 1 -- 172.21.15.96:0/2049664987 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e14005150 msgr2=0x7f9e281f1370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:59:44.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2d950640 1 --2- 172.21.15.96:0/2049664987 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e14005150 0x7f9e281f1370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:44.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2e151640 1 --2- 172.21.15.96:0/2049664987 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e14005150 0x7f9e281f1370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:44.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2e151640 1 -- 172.21.15.96:0/2049664987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e2814ece0 msgr2=0x7f9e281542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:44.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2e151640 1 --2- 172.21.15.96:0/2049664987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e2814ece0 0x7f9e281542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:44.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2e151640 1 -- 172.21.15.96:0/2049664987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e281575a0 con 0x7f9e2813a130 2024-04-18T04:59:44.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2e151640 1 --2- 172.21.15.96:0/2049664987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2813a130 0x7f9e28145d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9e2001ccf0 tx=0x7f9e14005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:44.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e1e7fc640 1 -- 172.21.15.96:0/2049664987 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e20006d60 con 0x7f9e2813a130 2024-04-18T04:59:44.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e1e7fc640 1 -- 172.21.15.96:0/2049664987 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e20005850 con 0x7f9e2813a130 2024-04-18T04:59:44.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2fbb4640 1 -- 172.21.15.96:0/2049664987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e28153b50 con 0x7f9e2813a130 2024-04-18T04:59:44.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e1e7fc640 1 -- 172.21.15.96:0/2049664987 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e200a6680 con 0x7f9e2813a130 2024-04-18T04:59:44.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2fbb4640 1 -- 172.21.15.96:0/2049664987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e28156fe0 con 0x7f9e2813a130 2024-04-18T04:59:44.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e2fbb4640 1 -- 172.21.15.96:0/2049664987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e28153fe0 con 0x7f9e2813a130 2024-04-18T04:59:44.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e1e7fc640 1 -- 172.21.15.96:0/2049664987 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9e200a67e0 con 0x7f9e2813a130 2024-04-18T04:59:44.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.367+0000 7f9e1e7fc640 1 --2- 172.21.15.96:0/2049664987 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9e0c066690 0x7f9e0c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:44.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.371+0000 7f9e2d950640 1 --2- 172.21.15.96:0/2049664987 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9e0c066690 0x7f9e0c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:44.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.371+0000 7f9e1e7fc640 1 -- 172.21.15.96:0/2049664987 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f9e2011d8f0 con 0x7f9e2813a130 2024-04-18T04:59:44.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.371+0000 7f9e2d950640 1 --2- 172.21.15.96:0/2049664987 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9e0c066690 0x7f9e0c068b50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9e18000f40 tx=0x7f9e18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:44.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.375+0000 7f9e1e7fc640 1 -- 172.21.15.96:0/2049664987 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9e28153fe0 con 0x7f9e2813a130 2024-04-18T04:59:44.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.607+0000 7f9e2fbb4640 1 -- 172.21.15.96:0/2049664987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9e28153fe0 con 0x7f9e2813a130 2024-04-18T04:59:44.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.611+0000 7f9e1e7fc640 1 -- 172.21.15.96:0/2049664987 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7f9e200ba020 con 0x7f9e2813a130 2024-04-18T04:59:44.613 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":50,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:59:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.611+0000 7f9e2fbb4640 1 -- 172.21.15.96:0/2049664987 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9e0c066690 msgr2=0x7f9e0c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.611+0000 7f9e2fbb4640 1 --2- 172.21.15.96:0/2049664987 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9e0c066690 0x7f9e0c068b50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9e18000f40 tx=0x7f9e18009040 comp rx=0 tx=0).stop 2024-04-18T04:59:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.611+0000 7f9e2fbb4640 1 -- 172.21.15.96:0/2049664987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2813a130 msgr2=0x7f9e28145d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.611+0000 7f9e2fbb4640 1 --2- 172.21.15.96:0/2049664987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2813a130 0x7f9e28145d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9e2001ccf0 tx=0x7f9e14005800 comp rx=0 tx=0).stop 2024-04-18T04:59:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.611+0000 7f9e2fbb4640 1 -- 172.21.15.96:0/2049664987 shutdown_connections 2024-04-18T04:59:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.611+0000 7f9e2fbb4640 1 --2- 172.21.15.96:0/2049664987 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9e0c066690 0x7f9e0c068b50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.611+0000 7f9e2fbb4640 1 --2- 172.21.15.96:0/2049664987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e2813a130 0x7f9e28145d90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.611+0000 7f9e2fbb4640 1 --2- 172.21.15.96:0/2049664987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e2814ece0 0x7f9e281542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.611+0000 7f9e2fbb4640 1 --2- 172.21.15.96:0/2049664987 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9e14005150 0x7f9e281f1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.611+0000 7f9e2fbb4640 1 -- 172.21.15.96:0/2049664987 >> 172.21.15.96:0/2049664987 conn(0x7f9e2806c750 msgr2=0x7f9e280c5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.611+0000 7f9e2fbb4640 1 -- 172.21.15.96:0/2049664987 shutdown_connections 2024-04-18T04:59:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:44.611+0000 7f9e2fbb4640 1 -- 172.21.15.96:0/2049664987 wait complete. 2024-04-18T04:59:47.632 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T04:59:47.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.759+0000 7f23ac336640 1 Processor -- start 2024-04-18T04:59:47.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.759+0000 7f23ac336640 1 -- start start 2024-04-18T04:59:47.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.759+0000 7f23ac336640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f23a40c60e0 0x7f23a414fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:47.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.759+0000 7f23ac336640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23a40701b0 0x7f23a4150090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:47.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.759+0000 7f23ac336640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a4159380 con 0x7f23a4070a40 2024-04-18T04:59:47.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.759+0000 7f23ac336640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a415a1a0 con 0x7f23a40c60e0 2024-04-18T04:59:47.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.759+0000 7f23ac336640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a4155ce0 con 0x7f23a40701b0 2024-04-18T04:59:47.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.759+0000 7f23aa8d3640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23a40701b0 0x7f23a4150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:47.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.759+0000 7f23aa0d2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f23a40c60e0 0x7f23a414fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:47.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.759+0000 7f23aa0d2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f23a40c60e0 0x7f23a414fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:52172/0 (socket says 172.21.15.96:52172) 2024-04-18T04:59:47.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.759+0000 7f23aa8d3640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23a40701b0 0x7f23a4150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:37160/0 (socket says 172.21.15.96:37160) 2024-04-18T04:59:47.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.759+0000 7f23aa0d2640 1 -- 172.21.15.96:0/2474509880 learned_addr learned my addr 172.21.15.96:0/2474509880 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:47.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.763+0000 7f23aa8d3640 1 -- 172.21.15.96:0/2474509880 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23a40701b0 msgr2=0x7f23a4150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T04:59:47.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.763+0000 7f23aa8d3640 1 -- 172.21.15.96:0/2474509880 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23a40701b0 msgr2=0x7f23a4150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:59:47.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.763+0000 7f23aa8d3640 1 --2- 172.21.15.96:0/2474509880 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23a40701b0 0x7f23a4150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:59:47.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.763+0000 7f23aa8d3640 1 --2- 172.21.15.96:0/2474509880 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23a40701b0 0x7f23a4150090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:47.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.763+0000 7f23aa0d2640 1 -- 172.21.15.96:0/2474509880 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23a40701b0 msgr2=0x7f23a4150090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:59:47.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.763+0000 7f23aa0d2640 1 --2- 172.21.15.96:0/2474509880 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23a40701b0 0x7f23a4150090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:47.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.763+0000 7f23aa0d2640 1 -- 172.21.15.96:0/2474509880 >> v1:172.21.15.139:6789/0 conn(0x7f23a4070a40 legacy=0x7f23a4156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:47.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.763+0000 7f23aa0d2640 1 -- 172.21.15.96:0/2474509880 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a4159620 con 0x7f23a40c60e0 2024-04-18T04:59:47.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.763+0000 7f23aa0d2640 1 --2- 172.21.15.96:0/2474509880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23a40c60e0 0x7f23a414fb50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009870 tx=0x7f23a001c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22d263acb9d2bc61 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:47.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.763+0000 7f23a90d0640 1 -- 172.21.15.96:0/2474509880 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a00a95f0 con 0x7f23a40c60e0 2024-04-18T04:59:47.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.763+0000 7f23a90d0640 1 -- 172.21.15.96:0/2474509880 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a00a9750 con 0x7f23a40c60e0 2024-04-18T04:59:47.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.763+0000 7f23a90d0640 1 -- 172.21.15.96:0/2474509880 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a00a9ae0 con 0x7f23a40c60e0 2024-04-18T04:59:47.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.763+0000 7f23ac336640 1 -- 172.21.15.96:0/2474509880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23a40c60e0 msgr2=0x7f23a414fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:47.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.763+0000 7f23ac336640 1 --2- 172.21.15.96:0/2474509880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23a40c60e0 0x7f23a414fb50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009870 tx=0x7f23a001c530 comp rx=0 tx=0).stop 2024-04-18T04:59:47.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 -- 172.21.15.96:0/2474509880 shutdown_connections 2024-04-18T04:59:47.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 --2- 172.21.15.96:0/2474509880 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23a40701b0 0x7f23a4150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:47.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 --2- 172.21.15.96:0/2474509880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23a40c60e0 0x7f23a414fb50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:47.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 -- 172.21.15.96:0/2474509880 >> 172.21.15.96:0/2474509880 conn(0x7f23a406c750 msgr2=0x7f23a40c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:47.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 -- 172.21.15.96:0/2474509880 shutdown_connections 2024-04-18T04:59:47.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 -- 172.21.15.96:0/2474509880 wait complete. 2024-04-18T04:59:47.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 Processor -- start 2024-04-18T04:59:47.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 -- start start 2024-04-18T04:59:47.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23a40701b0 0x7f23a4155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a40c60e0 0x7f23a4141030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23a4154ba0 0x7f23a41434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a414e3c0 con 0x7f23a40c60e0 2024-04-18T04:59:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a4142a90 con 0x7f23a40701b0 2024-04-18T04:59:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a4143050 con 0x7f23a4154ba0 2024-04-18T04:59:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23a98d1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a40c60e0 0x7f23a4141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23a98d1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a40c60e0 0x7f23a4141030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55114/0 (socket says 172.21.15.96:55114) 2024-04-18T04:59:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23a98d1640 1 -- 172.21.15.96:0/1901332728 learned_addr learned my addr 172.21.15.96:0/1901332728 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23aa0d2640 1 --2- 172.21.15.96:0/1901332728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23a40701b0 0x7f23a4155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23aa8d3640 1 --2- 172.21.15.96:0/1901332728 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23a4154ba0 0x7f23a41434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23a98d1640 1 -- 172.21.15.96:0/1901332728 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23a4154ba0 msgr2=0x7f23a41434e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23a98d1640 1 --2- 172.21.15.96:0/1901332728 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23a4154ba0 0x7f23a41434e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23a98d1640 1 -- 172.21.15.96:0/1901332728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23a40701b0 msgr2=0x7f23a4155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23a98d1640 1 --2- 172.21.15.96:0/1901332728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23a40701b0 0x7f23a4155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:47.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23a98d1640 1 -- 172.21.15.96:0/1901332728 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a00094d0 con 0x7f23a40c60e0 2024-04-18T04:59:47.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23a98d1640 1 --2- 172.21.15.96:0/1901332728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a40c60e0 0x7f23a4141030 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f239400c450 tx=0x7f239400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:47.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f239affd640 1 -- 172.21.15.96:0/1901332728 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940052d0 con 0x7f23a40c60e0 2024-04-18T04:59:47.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f239affd640 1 -- 172.21.15.96:0/1901332728 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2394005430 con 0x7f23a40c60e0 2024-04-18T04:59:47.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 -- 172.21.15.96:0/1901332728 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a414f5f0 con 0x7f23a40c60e0 2024-04-18T04:59:47.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f239affd640 1 -- 172.21.15.96:0/1901332728 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2394007260 con 0x7f23a40c60e0 2024-04-18T04:59:47.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 -- 172.21.15.96:0/1901332728 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a414e8f0 con 0x7f23a40c60e0 2024-04-18T04:59:47.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.767+0000 7f23ac336640 1 -- 172.21.15.96:0/1901332728 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a41431e0 con 0x7f23a40c60e0 2024-04-18T04:59:47.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.771+0000 7f239affd640 1 -- 172.21.15.96:0/1901332728 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f23940073c0 con 0x7f23a40c60e0 2024-04-18T04:59:47.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.771+0000 7f239affd640 1 --2- 172.21.15.96:0/1901332728 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2388066690 0x7f2388068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:47.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.771+0000 7f239affd640 1 -- 172.21.15.96:0/1901332728 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2394083a30 con 0x7f23a40c60e0 2024-04-18T04:59:47.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.771+0000 7f23aa0d2640 1 --2- 172.21.15.96:0/1901332728 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2388066690 0x7f2388068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:47.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.771+0000 7f23aa0d2640 1 --2- 172.21.15.96:0/1901332728 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2388066690 0x7f2388068b50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f23a00ae000 tx=0x7f23a00b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:47.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:47.775+0000 7f239affd640 1 -- 172.21.15.96:0/1901332728 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2394050e10 con 0x7f23a40c60e0 2024-04-18T04:59:48.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.019+0000 7f23ac336640 1 -- 172.21.15.96:0/1901332728 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f23a4067050 con 0x7f23a40c60e0 2024-04-18T04:59:48.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.019+0000 7f239affd640 1 -- 172.21.15.96:0/1901332728 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f2394054430 con 0x7f23a40c60e0 2024-04-18T04:59:48.024 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T04:59:48.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.023+0000 7f23ac336640 1 -- 172.21.15.96:0/1901332728 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2388066690 msgr2=0x7f2388068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.023+0000 7f23ac336640 1 --2- 172.21.15.96:0/1901332728 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2388066690 0x7f2388068b50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f23a00ae000 tx=0x7f23a00b3040 comp rx=0 tx=0).stop 2024-04-18T04:59:48.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.023+0000 7f23ac336640 1 -- 172.21.15.96:0/1901332728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a40c60e0 msgr2=0x7f23a4141030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.023+0000 7f23ac336640 1 --2- 172.21.15.96:0/1901332728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a40c60e0 0x7f23a4141030 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f239400c450 tx=0x7f239400c910 comp rx=0 tx=0).stop 2024-04-18T04:59:48.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.023+0000 7f23ac336640 1 -- 172.21.15.96:0/1901332728 shutdown_connections 2024-04-18T04:59:48.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.023+0000 7f23ac336640 1 --2- 172.21.15.96:0/1901332728 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2388066690 0x7f2388068b50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.023+0000 7f23ac336640 1 --2- 172.21.15.96:0/1901332728 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23a4154ba0 0x7f23a41434e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.023+0000 7f23ac336640 1 --2- 172.21.15.96:0/1901332728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23a40c60e0 0x7f23a4141030 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.023+0000 7f23ac336640 1 --2- 172.21.15.96:0/1901332728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23a40701b0 0x7f23a4155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.023+0000 7f23ac336640 1 -- 172.21.15.96:0/1901332728 >> 172.21.15.96:0/1901332728 conn(0x7f23a406c750 msgr2=0x7f23a4071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:48.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.023+0000 7f23ac336640 1 -- 172.21.15.96:0/1901332728 shutdown_connections 2024-04-18T04:59:48.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.023+0000 7f23ac336640 1 -- 172.21.15.96:0/1901332728 wait complete. 2024-04-18T04:59:48.043 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-18T04:59:48.043 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-18T04:59:48.043 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T04:59:48.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.155+0000 7f8fe78e5640 1 Processor -- start 2024-04-18T04:59:48.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.155+0000 7f8fe78e5640 1 -- start start 2024-04-18T04:59:48.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe78e5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8fe0153060 0x7f8fe00c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe78e5640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fe0158cd0 0x7f8fe00c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe78e5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe00c9610 con 0x7f8fe01590f0 2024-04-18T04:59:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe78e5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe0153440 con 0x7f8fe0153060 2024-04-18T04:59:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe78e5640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe01595f0 con 0x7f8fe0158cd0 2024-04-18T04:59:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe5681640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8fe0153060 0x7f8fe00c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe5e82640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f8fe01590f0 0x7f8fe00c4480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51388/0 (socket says 172.21.15.96:51388) 2024-04-18T04:59:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe5e82640 1 -- 172.21.15.96:0/4204480220 learned_addr learned my addr 172.21.15.96:0/4204480220 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:59:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe4e80640 1 --2- 172.21.15.96:0/4204480220 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fe0158cd0 0x7f8fe00c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe5681640 1 -- 172.21.15.96:0/4204480220 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fe0158cd0 msgr2=0x7f8fe00c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe5681640 1 --2- 172.21.15.96:0/4204480220 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fe0158cd0 0x7f8fe00c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe5681640 1 -- 172.21.15.96:0/4204480220 >> v1:172.21.15.96:6789/0 conn(0x7f8fe01590f0 legacy=0x7f8fe00c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe5681640 1 -- 172.21.15.96:0/4204480220 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe01598d0 con 0x7f8fe0153060 2024-04-18T04:59:48.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fd7fff640 1 -- 172.21.15.96:0/4204480220 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765852667 0 0) 0x7f8fe00c9610 con 0x7f8fe01590f0 2024-04-18T04:59:48.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe5681640 1 --2- 172.21.15.96:0/4204480220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0153060 0x7f8fe00c90d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0097c0 tx=0x7f8fdc01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be02793430d4ffa server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:48.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fd7fff640 1 -- 172.21.15.96:0/4204480220 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0a8990 con 0x7f8fe0153060 2024-04-18T04:59:48.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fd7fff640 1 -- 172.21.15.96:0/4204480220 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc0a8af0 con 0x7f8fe0153060 2024-04-18T04:59:48.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fd7fff640 1 -- 172.21.15.96:0/4204480220 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0a8e80 con 0x7f8fe0153060 2024-04-18T04:59:48.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe78e5640 1 -- 172.21.15.96:0/4204480220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0153060 msgr2=0x7f8fe00c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe78e5640 1 --2- 172.21.15.96:0/4204480220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0153060 0x7f8fe00c90d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0097c0 tx=0x7f8fdc01ec90 comp rx=0 tx=0).stop 2024-04-18T04:59:48.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe78e5640 1 -- 172.21.15.96:0/4204480220 shutdown_connections 2024-04-18T04:59:48.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe78e5640 1 --2- 172.21.15.96:0/4204480220 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fe0158cd0 0x7f8fe00c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe78e5640 1 --2- 172.21.15.96:0/4204480220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0153060 0x7f8fe00c90d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.159+0000 7f8fe78e5640 1 -- 172.21.15.96:0/4204480220 >> 172.21.15.96:0/4204480220 conn(0x7f8fe006b470 msgr2=0x7f8fe006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:48.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe78e5640 1 -- 172.21.15.96:0/4204480220 shutdown_connections 2024-04-18T04:59:48.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe78e5640 1 -- 172.21.15.96:0/4204480220 wait complete. 2024-04-18T04:59:48.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe78e5640 1 Processor -- start 2024-04-18T04:59:48.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe78e5640 1 -- start start 2024-04-18T04:59:48.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe78e5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fe0153060 0x7f8fe01ee700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe78e5640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fe0158cd0 0x7f8fe013f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe78e5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe01590f0 0x7f8fe00cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe78e5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe01528a0 con 0x7f8fe01590f0 2024-04-18T04:59:48.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe78e5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe01f23f0 con 0x7f8fe0153060 2024-04-18T04:59:48.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe78e5640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe0152320 con 0x7f8fe0158cd0 2024-04-18T04:59:48.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe5e82640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe01590f0 0x7f8fe00cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe5e82640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe01590f0 0x7f8fe00cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55130/0 (socket says 172.21.15.96:55130) 2024-04-18T04:59:48.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe5e82640 1 -- 172.21.15.96:0/1684772966 learned_addr learned my addr 172.21.15.96:0/1684772966 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:48.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe5681640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fe0153060 0x7f8fe01ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe4e80640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fe0158cd0 0x7f8fe013f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe5e82640 1 -- 172.21.15.96:0/1684772966 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fe0158cd0 msgr2=0x7f8fe013f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe5e82640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fe0158cd0 0x7f8fe013f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe5e82640 1 -- 172.21.15.96:0/1684772966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fe0153060 msgr2=0x7f8fe01ee700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe5e82640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fe0153060 0x7f8fe01ee700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe5e82640 1 -- 172.21.15.96:0/1684772966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc009420 con 0x7f8fe01590f0 2024-04-18T04:59:48.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe5e82640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe01590f0 0x7f8fe00cb440 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800c780 tx=0x7f8fd800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:48.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fd5ffb640 1 -- 172.21.15.96:0/1684772966 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd800ce30 con 0x7f8fe01590f0 2024-04-18T04:59:48.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fd5ffb640 1 -- 172.21.15.96:0/1684772966 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd800a5e0 con 0x7f8fe01590f0 2024-04-18T04:59:48.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe78e5640 1 -- 172.21.15.96:0/1684772966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe0145200 con 0x7f8fe01590f0 2024-04-18T04:59:48.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fd5ffb640 1 -- 172.21.15.96:0/1684772966 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd800a990 con 0x7f8fe01590f0 2024-04-18T04:59:48.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe78e5640 1 -- 172.21.15.96:0/1684772966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe01f1da0 con 0x7f8fe01590f0 2024-04-18T04:59:48.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.163+0000 7f8fe78e5640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0150d90 0x7f8fe00cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.167+0000 7f8fe78e5640 1 -- 172.21.15.96:0/1684772966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe0072290 con 0x7f8fe0150d90 2024-04-18T04:59:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.167+0000 7f8fe5681640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0150d90 0x7f8fe00cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.167+0000 7f8fe5681640 1 -- 172.21.15.96:0/1684772966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8fe01f1c20 con 0x7f8fe0150d90 2024-04-18T04:59:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.167+0000 7f8fd5ffb640 1 -- 172.21.15.96:0/1684772966 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8fd800aaf0 con 0x7f8fe01590f0 2024-04-18T04:59:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.167+0000 7f8fe5681640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0150d90 0x7f8fe00cb980 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8fe008c650 tx=0x7f8fdc01d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.167+0000 7f8fd5ffb640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8fc4066690 0x7f8fc4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.167+0000 7f8fd5ffb640 1 -- 172.21.15.96:0/1684772966 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8fd80834f0 con 0x7f8fe01590f0 2024-04-18T04:59:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.167+0000 7f8fe4e80640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8fc4066690 0x7f8fc4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.167+0000 7f8fd5ffb640 1 -- 172.21.15.96:0/1684772966 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0b0e70 con 0x7f8fe0150d90 2024-04-18T04:59:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.167+0000 7f8fd5ffb640 1 -- 172.21.15.96:0/1684772966 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f8fdc0ba410 con 0x7f8fe0150d90 2024-04-18T04:59:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.167+0000 7f8fd5ffb640 1 -- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0150d90 msgr2=0x7f8fe00cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.167+0000 7f8fd5ffb640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0150d90 0x7f8fe00cb980 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8fe008c650 tx=0x7f8fdc01d4d0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.167+0000 7f8fd5ffb640 1 -- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0150d90 msgr2=0x7f8fe00cb980 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:59:48.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.167+0000 7f8fd5ffb640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0150d90 0x7f8fe00cb980 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.167+0000 7f8fe4e80640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8fc4066690 0x7f8fc4068b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00ce770 tx=0x7f8fd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:48.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.171+0000 7f8fe78e5640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0150850 0x7f8fe00b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.171+0000 7f8fe78e5640 1 -- 172.21.15.96:0/1684772966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00c3c80 con 0x7f8fe0150850 2024-04-18T04:59:48.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.171+0000 7f8fe5681640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0150850 0x7f8fe00b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fe5681640 1 -- 172.21.15.96:0/1684772966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8fe00c39a0 con 0x7f8fe0150850 2024-04-18T04:59:48.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fe5681640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0150850 0x7f8fe00b3250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc01ecd0 tx=0x7f8fdc01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:48.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fd5ffb640 1 -- 172.21.15.96:0/1684772966 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0ba990 con 0x7f8fe0150850 2024-04-18T04:59:48.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fd5ffb640 1 -- 172.21.15.96:0/1684772966 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7f8fdc003e50 con 0x7f8fe0150850 2024-04-18T04:59:48.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fd5ffb640 1 -- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0150850 msgr2=0x7f8fe00b3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fd5ffb640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0150850 0x7f8fe00b3250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc01ecd0 tx=0x7f8fdc01ba30 comp rx=0 tx=0).stop 2024-04-18T04:59:48.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fd5ffb640 1 -- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0150850 msgr2=0x7f8fe00b3250 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:59:48.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fd5ffb640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe0150850 0x7f8fe00b3250 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc01ecd0 tx=0x7f8fdc01ba30 comp rx=0 tx=0).stop 2024-04-18T04:59:48.177 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:59:48.178 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:59:48.178 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:59:48.178 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T04:59:48.178 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 52, 2024-04-18T04:59:48.178 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:59:48.178 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:59:48.178 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:59:48.178 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:59:48.178 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:48.178 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 1, 2024-04-18T04:59:48.178 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:59:48.178 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:59:48.178 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:59:48.178 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:48.179 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:48.179 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:48.179 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:48.179 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:48.179 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:48.179 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:48.179 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:48.179 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:48.179 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:48.179 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:48.179 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:59:48.179 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:59:48.179 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:48.179 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:48.180 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:48.180 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:48.180 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:48.180 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:48.180 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:48.180 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:48.180 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:48.180 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:48.180 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:48.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.180 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:59:48.180 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:59:48.180 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:59:48.180 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:59:48.180 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:59:48.181 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:59:48.181 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:59:48.181 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:59:48.181 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:59:48.181 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:59:48.181 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:59:48.181 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:59:48.181 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:59:48.181 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:59:48.181 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:59:48.181 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:59:48.181 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:59:48.181 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:48.181 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:48.181 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:48.182 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:48.182 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:48.182 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:48.182 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:48.182 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:48.182 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:48.182 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:48.182 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:48.182 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:59:48.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.182 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:59:48.182 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.182 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:59:48.182 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:59:48.183 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:48.183 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:48.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.183 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:48.183 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:59:48.183 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:48.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.183 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:48.183 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:59:48.183 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:48.183 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:48.183 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:48.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.183 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:59:48.184 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:59:48.184 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:48.184 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:48.184 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:48.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.184 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:59:48.184 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:59:48.184 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:48.184 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:48.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.184 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:48.185 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:59:48.185 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:48.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.185 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:48.185 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:59:48.185 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:48.185 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:48.185 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:48.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.185 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:59:48.185 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:59:48.185 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:48.185 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:48.186 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:48.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.186 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:59:48.186 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:59:48.186 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:48.186 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:48.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.186 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:48.186 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:59:48.186 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:48.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.186 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:48.186 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:59:48.187 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:48.187 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:48.187 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:48.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.187 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:59:48.187 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:59:48.187 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:48.187 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:48.187 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:48.187 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:48.187 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:48.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.187 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:59:48.187 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:59:48.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.188 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:48.188 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:48.188 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:59:48.188 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:48.188 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:48.188 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:59:48.188 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.188 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:48.188 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:48.188 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5 2024-04-18T04:59:48.188 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:48.188 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:48.188 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T04:59:48.188 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.188 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:48.189 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:48.189 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 8 2024-04-18T04:59:48.189 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:48.189 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:48.189 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:59:48.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.189 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:48.189 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:48.189 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 7 2024-04-18T04:59:48.189 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:48.189 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:48.189 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T04:59:48.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.189 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:48.189 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:48.190 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T04:59:48.190 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:48.190 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:48.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.190 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:59:48.190 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:59:48.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fe78e5640 1 -- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8fc4066690 msgr2=0x7f8fc4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fe78e5640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8fc4066690 0x7f8fc4068b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00ce770 tx=0x7f8fd0008040 comp rx=0 tx=0).stop 2024-04-18T04:59:48.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fe78e5640 1 -- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe01590f0 msgr2=0x7f8fe00cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fe78e5640 1 --2- 172.21.15.96:0/1684772966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe01590f0 0x7f8fe00cb440 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800c780 tx=0x7f8fd800cc40 comp rx=0 tx=0).stop 2024-04-18T04:59:48.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fe5e82640 1 -- 172.21.15.96:0/1684772966 reap_dead start 2024-04-18T04:59:48.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fe5e82640 1 -- 172.21.15.96:0/1684772966 reap_dead start 2024-04-18T04:59:48.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fe78e5640 1 -- 172.21.15.96:0/1684772966 shutdown_connections 2024-04-18T04:59:48.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fe78e5640 1 -- 172.21.15.96:0/1684772966 >> 172.21.15.96:0/1684772966 conn(0x7f8fe006b470 msgr2=0x7f8fe00717e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:48.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fe78e5640 1 -- 172.21.15.96:0/1684772966 shutdown_connections 2024-04-18T04:59:48.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.175+0000 7f8fe78e5640 1 -- 172.21.15.96:0/1684772966 wait complete. 2024-04-18T04:59:48.193 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:59:48.193 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-18T04:59:48.194 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-18T04:59:48.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.303+0000 7f9c1a997640 1 Processor -- start 2024-04-18T04:59:48.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.303+0000 7f9c1a997640 1 -- start start 2024-04-18T04:59:48.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c1a997640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9c14159120 0x7f9c140c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c1a997640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c141595f0 con 0x7f9c14153060 2024-04-18T04:59:48.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c1a997640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c141598d0 con 0x7f9c14158cd0 2024-04-18T04:59:48.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c1a997640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c14153440 con 0x7f9c14159120 2024-04-18T04:59:48.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c13fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f9c14153060 0x7f9c140c90d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51396/0 (socket says 172.21.15.96:51396) 2024-04-18T04:59:48.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c13fff640 1 -- 172.21.15.96:0/1316591074 learned_addr learned my addr 172.21.15.96:0/1316591074 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:59:48.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c18f34640 1 --2- 172.21.15.96:0/1316591074 >> v2:172.21.15.96:3300/0 conn(0x7f9c14159120 0x7f9c140c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c137fe640 1 -- 172.21.15.96:0/1316591074 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670985822 0 0) 0x7f9c141595f0 con 0x7f9c14153060 2024-04-18T04:59:48.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c137fe640 1 -- 172.21.15.96:0/1316591074 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c00003530 con 0x7f9c14153060 2024-04-18T04:59:48.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c18f34640 1 -- 172.21.15.96:0/1316591074 >> v1:172.21.15.139:6789/0 conn(0x7f9c14158cd0 legacy=0x7f9c140c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:48.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c18f34640 1 -- 172.21.15.96:0/1316591074 >> v1:172.21.15.96:6789/0 conn(0x7f9c14153060 legacy=0x7f9c140c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c18f34640 1 -- 172.21.15.96:0/1316591074 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c14159bb0 con 0x7f9c14159120 2024-04-18T04:59:48.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c18f34640 1 --2- 172.21.15.96:0/1316591074 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c14159120 0x7f9c140c4480 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c009d90 tx=0x7f9c0c01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bb9ed60284b5e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:48.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c137fe640 1 -- 172.21.15.96:0/1316591074 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c0af600 con 0x7f9c14159120 2024-04-18T04:59:48.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c137fe640 1 -- 172.21.15.96:0/1316591074 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0c0ab050 con 0x7f9c14159120 2024-04-18T04:59:48.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c137fe640 1 -- 172.21.15.96:0/1316591074 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c0af980 con 0x7f9c14159120 2024-04-18T04:59:48.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c1a997640 1 -- 172.21.15.96:0/1316591074 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c14159120 msgr2=0x7f9c140c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.307+0000 7f9c1a997640 1 --2- 172.21.15.96:0/1316591074 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c14159120 0x7f9c140c4480 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c009d90 tx=0x7f9c0c01f150 comp rx=0 tx=0).stop 2024-04-18T04:59:48.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 -- 172.21.15.96:0/1316591074 shutdown_connections 2024-04-18T04:59:48.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 --2- 172.21.15.96:0/1316591074 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c14159120 0x7f9c140c4480 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 -- 172.21.15.96:0/1316591074 >> 172.21.15.96:0/1316591074 conn(0x7f9c1406b470 msgr2=0x7f9c1406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:48.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 -- 172.21.15.96:0/1316591074 shutdown_connections 2024-04-18T04:59:48.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 -- 172.21.15.96:0/1316591074 wait complete. 2024-04-18T04:59:48.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 Processor -- start 2024-04-18T04:59:48.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 -- start start 2024-04-18T04:59:48.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9c14153060 0x7f9c140b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c14158cd0 0x7f9c1413c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c14159120 0x7f9c14141430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c141f2b40 con 0x7f9c14158cd0 2024-04-18T04:59:48.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c140b27b0 con 0x7f9c14159120 2024-04-18T04:59:48.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c141f1c70 con 0x7f9c14153060 2024-04-18T04:59:48.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c0bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c14158cd0 0x7f9c1413c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c0bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c14158cd0 0x7f9c1413c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55164/0 (socket says 172.21.15.96:55164) 2024-04-18T04:59:48.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c0bfff640 1 -- 172.21.15.96:0/3010898498 learned_addr learned my addr 172.21.15.96:0/3010898498 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:48.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c18f34640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c14159120 0x7f9c14141430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c13fff640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9c14153060 0x7f9c140b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c0bfff640 1 -- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9c14153060 msgr2=0x7f9c140b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c0bfff640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9c14153060 0x7f9c140b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c0bfff640 1 -- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c14159120 msgr2=0x7f9c14141430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c0bfff640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c14159120 0x7f9c14141430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c0bfff640 1 -- 172.21.15.96:0/3010898498 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c009a70 con 0x7f9c14158cd0 2024-04-18T04:59:48.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c18f34640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c14159120 0x7f9c14141430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:59:48.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c0bfff640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c14158cd0 0x7f9c1413c4f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00c530 tx=0x7f9bfc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:48.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c117fa640 1 -- 172.21.15.96:0/3010898498 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc005220 con 0x7f9c14158cd0 2024-04-18T04:59:48.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c117fa640 1 -- 172.21.15.96:0/3010898498 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc005380 con 0x7f9c14158cd0 2024-04-18T04:59:48.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 -- 172.21.15.96:0/3010898498 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c140b3ec0 con 0x7f9c14158cd0 2024-04-18T04:59:48.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c117fa640 1 -- 172.21.15.96:0/3010898498 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc007270 con 0x7f9c14158cd0 2024-04-18T04:59:48.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 -- 172.21.15.96:0/3010898498 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c141f1ec0 con 0x7f9c14158cd0 2024-04-18T04:59:48.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c140c9870 0x7f9c14141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c1a997640 1 -- 172.21.15.96:0/3010898498 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c14072290 con 0x7f9c140c9870 2024-04-18T04:59:48.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.311+0000 7f9c13fff640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c140c9870 0x7f9c14141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.315+0000 7f9c117fa640 1 -- 172.21.15.96:0/3010898498 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9bfc0073d0 con 0x7f9c14158cd0 2024-04-18T04:59:48.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.315+0000 7f9c13fff640 1 -- 172.21.15.96:0/3010898498 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c140c3f60 con 0x7f9c140c9870 2024-04-18T04:59:48.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.315+0000 7f9c13fff640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c140c9870 0x7f9c14141970 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9c04000f70 tx=0x7f9c0400d8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:48.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.315+0000 7f9c117fa640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9bf4066690 0x7f9bf4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.315+0000 7f9c117fa640 1 -- 172.21.15.96:0/3010898498 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f9bfc083a40 con 0x7f9c14158cd0 2024-04-18T04:59:48.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.315+0000 7f9c18f34640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9bf4066690 0x7f9bf4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.315+0000 7f9c117fa640 1 -- 172.21.15.96:0/3010898498 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04005db0 con 0x7f9c140c9870 2024-04-18T04:59:48.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.315+0000 7f9c18f34640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9bf4066690 0x7f9bf4068b50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0b1000 tx=0x7f9c0c0aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:48.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.315+0000 7f9c117fa640 1 -- 172.21.15.96:0/3010898498 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f9c04007070 con 0x7f9c140c9870 2024-04-18T04:59:48.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.315+0000 7f9c117fa640 1 -- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c140c9870 msgr2=0x7f9c14141970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.315+0000 7f9c117fa640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c140c9870 0x7f9c14141970 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9c04000f70 tx=0x7f9c0400d8e0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.315+0000 7f9c117fa640 1 -- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c140c9870 msgr2=0x7f9c14141970 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:59:48.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.315+0000 7f9c117fa640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c140c9870 0x7f9c14141970 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9c04000f70 tx=0x7f9c0400d8e0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.319+0000 7f9c1a997640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c141562a0 0x7f9c141f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.319+0000 7f9c1a997640 1 -- 172.21.15.96:0/3010898498 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c140c3c80 con 0x7f9c141562a0 2024-04-18T04:59:48.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.319+0000 7f9c13fff640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c141562a0 0x7f9c141f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c13fff640 1 -- 172.21.15.96:0/3010898498 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9c140ca3c0 con 0x7f9c141562a0 2024-04-18T04:59:48.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c13fff640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c141562a0 0x7f9c141f21a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9c04016000 tx=0x7f9c04001160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:48.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c117fa640 1 -- 172.21.15.96:0/3010898498 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04022070 con 0x7f9c141562a0 2024-04-18T04:59:48.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c117fa640 1 -- 172.21.15.96:0/3010898498 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4635 (secure 0 0 0) 0x7f9c04012410 con 0x7f9c141562a0 2024-04-18T04:59:48.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c117fa640 1 -- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c141562a0 msgr2=0x7f9c141f21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c117fa640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c141562a0 0x7f9c141f21a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9c04016000 tx=0x7f9c04001160 comp rx=0 tx=0).stop 2024-04-18T04:59:48.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c117fa640 1 -- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c141562a0 msgr2=0x7f9c141f21a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:59:48.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c117fa640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c141562a0 0x7f9c141f21a0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9c04016000 tx=0x7f9c04001160 comp rx=0 tx=0).stop 2024-04-18T04:59:48.326 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:59:48.326 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:59:48.327 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:59:48.327 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:59:48.327 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 52, 2024-04-18T04:59:48.327 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:59:48.327 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:59:48.327 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:59:48.327 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:59:48.327 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:48.327 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 2, 2024-04-18T04:59:48.327 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:59:48.327 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:59:48.327 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:59:48.327 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:48.327 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:48.328 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:48.328 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:48.328 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:48.328 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:48.328 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:48.328 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:48.328 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:48.328 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:48.328 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:48.328 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:59:48.328 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:59:48.328 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:48.328 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:48.328 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:48.328 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:48.329 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:48.329 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:48.329 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:48.329 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:48.329 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:48.329 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:48.329 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:48.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.329 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:59:48.329 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:59:48.329 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:59:48.329 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:59:48.329 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:59:48.330 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:59:48.330 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:59:48.330 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:59:48.330 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:59:48.330 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:59:48.330 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:59:48.330 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:59:48.330 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:59:48.330 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:59:48.330 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:59:48.330 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:59:48.330 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:59:48.330 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:48.330 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:48.331 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:48.331 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:48.331 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:48.331 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:48.331 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:48.331 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:48.331 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:48.331 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:48.331 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:48.331 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:59:48.331 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.331 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:59:48.331 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.331 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:59:48.332 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:59:48.332 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:48.332 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:48.332 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.332 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:48.332 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:59:48.332 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:48.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.332 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.332 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:48.332 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:59:48.332 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:48.333 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:48.333 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:48.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.333 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:59:48.333 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:59:48.333 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:48.333 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:48.333 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:48.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.333 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.333 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:59:48.333 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:59:48.333 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:48.333 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:48.334 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.334 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:48.334 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:59:48.334 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:48.334 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.334 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.334 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:48.334 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:59:48.334 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:48.334 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:48.334 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:48.334 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.334 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:59:48.334 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:59:48.334 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:48.335 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:48.335 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:48.335 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.335 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.335 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:59:48.335 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:59:48.335 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:48.335 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:48.335 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.335 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:48.335 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:59:48.335 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:48.335 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.335 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.335 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:48.336 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:59:48.336 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:48.336 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:48.336 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:48.336 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.336 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:59:48.336 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:59:48.336 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:48.336 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:48.336 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:48.336 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:48.336 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:48.336 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.336 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:59:48.337 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:59:48.337 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.337 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:48.337 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:48.337 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:59:48.337 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:48.337 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:48.337 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T04:59:48.337 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.337 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:48.337 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:48.337 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:59:48.337 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:48.337 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:48.337 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:59:48.338 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:48.338 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:48.338 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:48.338 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:59:48.338 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:48.338 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:48.338 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:48.338 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:59:48.338 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:59:48.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c1a997640 1 -- 172.21.15.96:0/3010898498 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9bf4066690 msgr2=0x7f9bf4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c1a997640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9bf4066690 0x7f9bf4068b50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0b1000 tx=0x7f9c0c0aa000 comp rx=0 tx=0).stop 2024-04-18T04:59:48.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c1a997640 1 -- 172.21.15.96:0/3010898498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c14158cd0 msgr2=0x7f9c1413c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c1a997640 1 --2- 172.21.15.96:0/3010898498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c14158cd0 0x7f9c1413c4f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00c530 tx=0x7f9bfc00c9f0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c18f34640 1 -- 172.21.15.96:0/3010898498 reap_dead start 2024-04-18T04:59:48.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c18f34640 1 -- 172.21.15.96:0/3010898498 reap_dead start 2024-04-18T04:59:48.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c1a997640 1 -- 172.21.15.96:0/3010898498 shutdown_connections 2024-04-18T04:59:48.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c1a997640 1 -- 172.21.15.96:0/3010898498 >> 172.21.15.96:0/3010898498 conn(0x7f9c1406b470 msgr2=0x7f9c140c4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:48.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c1a997640 1 -- 172.21.15.96:0/3010898498 shutdown_connections 2024-04-18T04:59:48.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.323+0000 7f9c1a997640 1 -- 172.21.15.96:0/3010898498 wait complete. 2024-04-18T04:59:48.343 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:59:48.343 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-18T04:59:48.343 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-18T04:59:48.437 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:59:48.439 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:59:48.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.455+0000 7f31acfc1640 1 Processor -- start 2024-04-18T04:59:48.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.455+0000 7f31acfc1640 1 -- start start 2024-04-18T04:59:48.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.455+0000 7f31acfc1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f31a806a120 0x7f31a806f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.455+0000 7f31acfc1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f31a806a500 0x7f31a8070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.455+0000 7f31acfc1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a8071a00 con 0x7f31a8071490 2024-04-18T04:59:48.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.455+0000 7f31acfc1640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a80c54e0 con 0x7f31a806a500 2024-04-18T04:59:48.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.455+0000 7f31acfc1640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a8159b90 con 0x7f31a806a120 2024-04-18T04:59:48.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.455+0000 7f319ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f31a806a500 0x7f31a8070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.455+0000 7f31a6d9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f31a8071490 0x7f31a8152b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51404/0 (socket says 172.21.15.96:51404) 2024-04-18T04:59:48.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.455+0000 7f31a6d9d640 1 -- 172.21.15.96:0/445477854 learned_addr learned my addr 172.21.15.96:0/445477854 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T04:59:48.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.455+0000 7f31a659c640 1 --2- 172.21.15.96:0/445477854 >> v2:172.21.15.139:3300/0 conn(0x7f31a806a120 0x7f31a806f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.455+0000 7f319ffff640 1 -- 172.21.15.96:0/445477854 >> v2:172.21.15.139:3300/0 conn(0x7f31a806a120 msgr2=0x7f31a806f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:48.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.455+0000 7f319ffff640 1 --2- 172.21.15.96:0/445477854 >> v2:172.21.15.139:3300/0 conn(0x7f31a806a120 0x7f31a806f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.455+0000 7f319ffff640 1 -- 172.21.15.96:0/445477854 >> v1:172.21.15.96:6789/0 conn(0x7f31a8071490 legacy=0x7f31a8152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.455+0000 7f319ffff640 1 -- 172.21.15.96:0/445477854 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a8158f10 con 0x7f31a806a500 2024-04-18T04:59:48.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f319ffff640 1 --2- 172.21.15.96:0/445477854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a806a500 0x7f31a8070f50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f31a806ad50 tx=0x7f319001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c1f2d15152d823 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:48.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31a5d9b640 1 -- 172.21.15.96:0/445477854 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31900ab680 con 0x7f31a806a500 2024-04-18T04:59:48.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31a5d9b640 1 -- 172.21.15.96:0/445477854 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31900ab7e0 con 0x7f31a806a500 2024-04-18T04:59:48.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31a5d9b640 1 -- 172.21.15.96:0/445477854 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31900abb70 con 0x7f31a806a500 2024-04-18T04:59:48.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31acfc1640 1 -- 172.21.15.96:0/445477854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a806a500 msgr2=0x7f31a8070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31acfc1640 1 --2- 172.21.15.96:0/445477854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a806a500 0x7f31a8070f50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f31a806ad50 tx=0x7f319001c480 comp rx=0 tx=0).stop 2024-04-18T04:59:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31acfc1640 1 -- 172.21.15.96:0/445477854 shutdown_connections 2024-04-18T04:59:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31acfc1640 1 --2- 172.21.15.96:0/445477854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a806a500 0x7f31a8070f50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31acfc1640 1 --2- 172.21.15.96:0/445477854 >> v2:172.21.15.139:3300/0 conn(0x7f31a806a120 0x7f31a806f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31acfc1640 1 -- 172.21.15.96:0/445477854 >> 172.21.15.96:0/445477854 conn(0x7f31a806d2a0 msgr2=0x7f31a806afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31acfc1640 1 -- 172.21.15.96:0/445477854 shutdown_connections 2024-04-18T04:59:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31acfc1640 1 -- 172.21.15.96:0/445477854 wait complete. 2024-04-18T04:59:48.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31acfc1640 1 Processor -- start 2024-04-18T04:59:48.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31acfc1640 1 -- start start 2024-04-18T04:59:48.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31acfc1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a120 0x7f31a81f4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31acfc1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31a8071490 0x7f31a81f5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31acfc1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a8152c90 0x7f31a8148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31acfc1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8072270 con 0x7f31a8152c90 2024-04-18T04:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31acfc1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8155600 con 0x7f31a8071490 2024-04-18T04:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31acfc1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a81562b0 con 0x7f31a806a120 2024-04-18T04:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31a6d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a8152c90 0x7f31a8148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31a6d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a8152c90 0x7f31a8148350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55192/0 (socket says 172.21.15.96:55192) 2024-04-18T04:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31a6d9d640 1 -- 172.21.15.96:0/1244580125 learned_addr learned my addr 172.21.15.96:0/1244580125 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f319ffff640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31a8071490 0x7f31a81f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31a6d9d640 1 -- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a120 msgr2=0x7f31a81f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31a6d9d640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a120 0x7f31a81f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31a6d9d640 1 -- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31a8071490 msgr2=0x7f31a81f5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31a6d9d640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31a8071490 0x7f31a81f5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31a6d9d640 1 -- 172.21.15.96:0/1244580125 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3190009420 con 0x7f31a8152c90 2024-04-18T04:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.459+0000 7f31a6d9d640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a8152c90 0x7f31a8148350 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f31a000ca80 tx=0x7f31a000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f319effd640 1 -- 172.21.15.96:0/1244580125 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a000ac30 con 0x7f31a8152c90 2024-04-18T04:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f319effd640 1 -- 172.21.15.96:0/1244580125 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a000ad90 con 0x7f31a8152c90 2024-04-18T04:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f31acfc1640 1 -- 172.21.15.96:0/1244580125 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a81526b0 con 0x7f31a8152c90 2024-04-18T04:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f319effd640 1 -- 172.21.15.96:0/1244580125 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0012600 con 0x7f31a8152c90 2024-04-18T04:59:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f31acfc1640 1 -- 172.21.15.96:0/1244580125 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a8155c60 con 0x7f31a8152c90 2024-04-18T04:59:48.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f31acfc1640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f31acfc1640 1 -- 172.21.15.96:0/1244580125 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8148dd0 con 0x7f31a806a500 2024-04-18T04:59:48.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f319effd640 1 -- 172.21.15.96:0/1244580125 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f31a0007070 con 0x7f31a8152c90 2024-04-18T04:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f31a659c640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f31a659c640 1 -- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 msgr2=0x7f31a8148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-04-18T04:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f31a659c640 1 -- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 msgr2=0x7f31a8148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T04:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f31a659c640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f31a659c640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f319effd640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f31880666c0 0x7f3188068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f319effd640 1 -- 172.21.15.96:0/1244580125 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f31a0083e90 con 0x7f31a8152c90 2024-04-18T04:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f319ffff640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f31880666c0 0x7f3188068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.463+0000 7f319ffff640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f31880666c0 0x7f3188068b80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f31900af000 tx=0x7f31900a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:48.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.667+0000 7f31a659c640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:48.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.667+0000 7f31a659c640 1 -- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 msgr2=0x7f31a8148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-04-18T04:59:48.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.667+0000 7f31a659c640 1 -- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 msgr2=0x7f31a8148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T04:59:48.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.667+0000 7f31a659c640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:59:48.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:48.667+0000 7f31a659c640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:59:49.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:49.071+0000 7f31a659c640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:49.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:49.071+0000 7f31a659c640 1 -- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 msgr2=0x7f31a8148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-04-18T04:59:49.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:49.071+0000 7f31a659c640 1 -- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 msgr2=0x7f31a8148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T04:59:49.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:49.071+0000 7f31a659c640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:59:49.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:49.071+0000 7f31a659c640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T04:59:49.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:49.875+0000 7f31a659c640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:49.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:49.875+0000 7f31a659c640 1 -- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 msgr2=0x7f31a8148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-04-18T04:59:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:49.875+0000 7f31a659c640 1 -- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 msgr2=0x7f31a8148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T04:59:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:49.875+0000 7f31a659c640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:59:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:49.875+0000 7f31a659c640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T04:59:51.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.479+0000 7f31a659c640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:51.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.479+0000 7f31a659c640 1 -- 172.21.15.96:0/1244580125 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31a8165700 con 0x7f31a806a500 2024-04-18T04:59:51.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.479+0000 7f31a659c640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3198015570 tx=0x7f3198015a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:51.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.479+0000 7f319effd640 1 -- 172.21.15.96:0/1244580125 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198017910 con 0x7f31a806a500 2024-04-18T04:59:51.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.479+0000 7f319effd640 1 -- 172.21.15.96:0/1244580125 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f3198017a70 con 0x7f31a806a500 2024-04-18T04:59:51.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.479+0000 7f319effd640 1 -- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 msgr2=0x7f31a8148890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:51.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.479+0000 7f319effd640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3198015570 tx=0x7f3198015a30 comp rx=0 tx=0).stop 2024-04-18T04:59:51.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.479+0000 7f319effd640 1 -- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 msgr2=0x7f31a8148890 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:59:51.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.479+0000 7f319effd640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a806a500 0x7f31a8148890 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3198015570 tx=0x7f3198015a30 comp rx=0 tx=0).stop 2024-04-18T04:59:51.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.487+0000 7f31acfc1640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a8155e50 0x7f31a81538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:51.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.487+0000 7f31acfc1640 1 -- 172.21.15.96:0/1244580125 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8066b20 con 0x7f31a8155e50 2024-04-18T04:59:51.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.487+0000 7f31a659c640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a8155e50 0x7f31a81538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:51.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.487+0000 7f31a659c640 1 -- 172.21.15.96:0/1244580125 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f31a80670f0 con 0x7f31a8155e50 2024-04-18T04:59:51.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f31a659c640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a8155e50 0x7f31a81538c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3198020000 tx=0x7f31980046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:51.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f319effd640 1 -- 172.21.15.96:0/1244580125 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198016e60 con 0x7f31a8155e50 2024-04-18T04:59:51.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f319effd640 1 -- 172.21.15.96:0/1244580125 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7f319802a470 con 0x7f31a8155e50 2024-04-18T04:59:51.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f319effd640 1 -- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a8155e50 msgr2=0x7f31a81538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:51.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f319effd640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a8155e50 0x7f31a81538c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3198020000 tx=0x7f31980046d0 comp rx=0 tx=0).stop 2024-04-18T04:59:51.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f319effd640 1 -- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a8155e50 msgr2=0x7f31a81538c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T04:59:51.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f319effd640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f31a8155e50 0x7f31a81538c0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3198020000 tx=0x7f31980046d0 comp rx=0 tx=0).stop 2024-04-18T04:59:51.494 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T04:59:51.494 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:59:51.494 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:59:51.494 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T04:59:51.494 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 52, 2024-04-18T04:59:51.494 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T04:59:51.494 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T04:59:51.494 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T04:59:51.494 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T04:59:51.494 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:51.494 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 5, 2024-04-18T04:59:51.495 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:59:51.495 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T04:59:51.495 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T04:59:51.495 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:51.495 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:51.495 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:51.495 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:51.495 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:51.495 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:51.495 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:51.495 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:51.495 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:51.495 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:51.495 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:51.495 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T04:59:51.496 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T04:59:51.496 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:51.496 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:51.496 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:51.496 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:51.496 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:51.496 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:51.496 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:51.496 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:51.496 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:51.496 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:51.496 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:51.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:51.496 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T04:59:51.497 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T04:59:51.497 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T04:59:51.497 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T04:59:51.497 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T04:59:51.497 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T04:59:51.497 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:59:51.497 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T04:59:51.497 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T04:59:51.497 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T04:59:51.497 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T04:59:51.497 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T04:59:51.497 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T04:59:51.497 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T04:59:51.497 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T04:59:51.498 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T04:59:51.498 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T04:59:51.498 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T04:59:51.498 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T04:59:51.498 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T04:59:51.498 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T04:59:51.498 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T04:59:51.498 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T04:59:51.498 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T04:59:51.498 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T04:59:51.498 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T04:59:51.498 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T04:59:51.498 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:51.498 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T04:59:51.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:51.499 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T04:59:51.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:51.499 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T04:59:51.499 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T04:59:51.499 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:51.499 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:51.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:51.499 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:51.499 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T04:59:51.499 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:51.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:51.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:51.500 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:51.500 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T04:59:51.500 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:51.500 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:51.500 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:51.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:51.500 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T04:59:51.500 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T04:59:51.500 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:51.500 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:51.500 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:51.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:51.500 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:51.500 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T04:59:51.501 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T04:59:51.501 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:51.501 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:51.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:51.501 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:51.501 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T04:59:51.501 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:51.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:51.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:51.501 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:51.501 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T04:59:51.501 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:51.501 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:51.501 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:51.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:51.502 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T04:59:51.502 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T04:59:51.502 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:51.502 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:51.502 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:51.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:51.502 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:51.502 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T04:59:51.502 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T04:59:51.502 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T04:59:51.502 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T04:59:51.502 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:51.502 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T04:59:51.503 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T04:59:51.503 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:51.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:51.503 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:51.503 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T04:59:51.503 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T04:59:51.503 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T04:59:51.503 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:51.503 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:51.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:51.503 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T04:59:51.503 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T04:59:51.503 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T04:59:51.503 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T04:59:51.503 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T04:59:51.504 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:51.504 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:51.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:51.504 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T04:59:51.504 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T04:59:51.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:51.504 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:51.504 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:51.504 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:59:51.504 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:51.504 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T04:59:51.504 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T04:59:51.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T04:59:51.504 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T04:59:51.504 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T04:59:51.505 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T04:59:51.505 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T04:59:51.505 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T04:59:51.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T04:59:51.505 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T04:59:51.505 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T04:59:51.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f31acfc1640 1 -- 172.21.15.96:0/1244580125 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f31880666c0 msgr2=0x7f3188068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:51.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f31acfc1640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f31880666c0 0x7f3188068b80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f31900af000 tx=0x7f31900a7000 comp rx=0 tx=0).stop 2024-04-18T04:59:51.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f31acfc1640 1 -- 172.21.15.96:0/1244580125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a8152c90 msgr2=0x7f31a8148350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:51.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f31a6d9d640 1 -- 172.21.15.96:0/1244580125 reap_dead start 2024-04-18T04:59:51.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f31acfc1640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a8152c90 0x7f31a8148350 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f31a000ca80 tx=0x7f31a000cf40 comp rx=0 tx=0).stop 2024-04-18T04:59:51.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f31acfc1640 1 -- 172.21.15.96:0/1244580125 shutdown_connections 2024-04-18T04:59:51.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f31acfc1640 1 --2- 172.21.15.96:0/1244580125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a8152c90 0x7f31a8148350 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:51.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f31acfc1640 1 -- 172.21.15.96:0/1244580125 >> 172.21.15.96:0/1244580125 conn(0x7f31a806d2a0 msgr2=0x7f31a80c3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:51.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f31acfc1640 1 -- 172.21.15.96:0/1244580125 shutdown_connections 2024-04-18T04:59:51.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.491+0000 7f31acfc1640 1 -- 172.21.15.96:0/1244580125 wait complete. 2024-04-18T04:59:51.520 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T04:59:51.520 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-18T04:59:51.520 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-18T04:59:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.647+0000 7fa5c7526640 1 Processor -- start 2024-04-18T04:59:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.647+0000 7fa5c7526640 1 -- start start 2024-04-18T04:59:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.647+0000 7fa5c7526640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa5c0151070 0x7fa5c015ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.647+0000 7fa5c7526640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5c006eb10 0x7fa5c0156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.647+0000 7fa5c7526640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c006f200 con 0x7fa5c00c3610 2024-04-18T04:59:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.647+0000 7fa5c7526640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c0151450 con 0x7fa5c0151070 2024-04-18T04:59:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.647+0000 7fa5c7526640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c00c7680 con 0x7fa5c006eb10 2024-04-18T04:59:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.647+0000 7fa5c52c2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa5c0151070 0x7fa5c015ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.651+0000 7fa5c5ac3640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5c006eb10 0x7fa5c0156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.651+0000 7fa5c52c2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa5c0151070 0x7fa5c015ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:39632/0 (socket says 172.21.15.96:39632) 2024-04-18T04:59:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.651+0000 7fa5c52c2640 1 -- 172.21.15.96:0/376582125 learned_addr learned my addr 172.21.15.96:0/376582125 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.651+0000 7fa5c5ac3640 1 -- 172.21.15.96:0/376582125 >> v2:172.21.15.139:3300/0 conn(0x7fa5c0151070 msgr2=0x7fa5c015ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:59:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.651+0000 7fa5c5ac3640 1 --2- 172.21.15.96:0/376582125 >> v2:172.21.15.139:3300/0 conn(0x7fa5c0151070 0x7fa5c015ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.651+0000 7fa5c5ac3640 1 -- 172.21.15.96:0/376582125 >> v1:172.21.15.139:6789/0 conn(0x7fa5c00c3610 legacy=0x7fa5c00cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.651+0000 7fa5c5ac3640 1 -- 172.21.15.96:0/376582125 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c01571d0 con 0x7fa5c006eb10 2024-04-18T04:59:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.651+0000 7fa5c52c2640 1 --2- 172.21.15.96:0/376582125 >> v2:172.21.15.139:3300/0 conn(0x7fa5c0151070 0x7fa5c015ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:59:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.651+0000 7fa5c5ac3640 1 --2- 172.21.15.96:0/376582125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5c006eb10 0x7fa5c0156c90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009d90 tx=0x7fa5b801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f61735db035377c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.651+0000 7fa5b7fff640 1 -- 172.21.15.96:0/376582125 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b80a5a00 con 0x7fa5c006eb10 2024-04-18T04:59:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.651+0000 7fa5b7fff640 1 -- 172.21.15.96:0/376582125 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b80a5b60 con 0x7fa5c006eb10 2024-04-18T04:59:51.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.651+0000 7fa5b7fff640 1 -- 172.21.15.96:0/376582125 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b80ad440 con 0x7fa5c006eb10 2024-04-18T04:59:51.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 -- 172.21.15.96:0/376582125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5c006eb10 msgr2=0x7fa5c0156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 --2- 172.21.15.96:0/376582125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5c006eb10 0x7fa5c0156c90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009d90 tx=0x7fa5b801c940 comp rx=0 tx=0).stop 2024-04-18T04:59:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 -- 172.21.15.96:0/376582125 shutdown_connections 2024-04-18T04:59:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 --2- 172.21.15.96:0/376582125 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5c006eb10 0x7fa5c0156c90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 --2- 172.21.15.96:0/376582125 >> v2:172.21.15.139:3300/0 conn(0x7fa5c0151070 0x7fa5c015ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 -- 172.21.15.96:0/376582125 >> 172.21.15.96:0/376582125 conn(0x7fa5c006a5c0 msgr2=0x7fa5c0065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 -- 172.21.15.96:0/376582125 shutdown_connections 2024-04-18T04:59:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 -- 172.21.15.96:0/376582125 wait complete. 2024-04-18T04:59:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 Processor -- start 2024-04-18T04:59:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 -- start start 2024-04-18T04:59:51.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c006eb10 0x7fa5c01515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:51.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5c00c3610 0x7fa5c01f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:51.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5c0151070 0x7fa5c014f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:51.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c01f2460 con 0x7fa5c006eb10 2024-04-18T04:59:51.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c0155080 con 0x7fa5c0151070 2024-04-18T04:59:51.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c0155360 con 0x7fa5c00c3610 2024-04-18T04:59:51.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c52c2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c006eb10 0x7fa5c01515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:51.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c52c2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c006eb10 0x7fa5c01515e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45114/0 (socket says 172.21.15.96:45114) 2024-04-18T04:59:51.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c52c2640 1 -- 172.21.15.96:0/676544895 learned_addr learned my addr 172.21.15.96:0/676544895 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T04:59:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c5ac3640 1 --2- 172.21.15.96:0/676544895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5c0151070 0x7fa5c014f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c4ac1640 1 --2- 172.21.15.96:0/676544895 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5c00c3610 0x7fa5c01f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c52c2640 1 -- 172.21.15.96:0/676544895 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5c00c3610 msgr2=0x7fa5c01f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c52c2640 1 --2- 172.21.15.96:0/676544895 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5c00c3610 0x7fa5c01f2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c52c2640 1 -- 172.21.15.96:0/676544895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5c0151070 msgr2=0x7fa5c014f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c52c2640 1 --2- 172.21.15.96:0/676544895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5c0151070 0x7fa5c014f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c52c2640 1 -- 172.21.15.96:0/676544895 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0094d0 con 0x7fa5c006eb10 2024-04-18T04:59:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c5ac3640 1 --2- 172.21.15.96:0/676544895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5c0151070 0x7fa5c014f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:59:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c52c2640 1 --2- 172.21.15.96:0/676544895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c006eb10 0x7fa5c01515e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00e9d0 tx=0x7fa5bc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5b5ffb640 1 -- 172.21.15.96:0/676544895 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc00ca60 con 0x7fa5c006eb10 2024-04-18T04:59:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5b5ffb640 1 -- 172.21.15.96:0/676544895 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc00cbc0 con 0x7fa5c006eb10 2024-04-18T04:59:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 -- 172.21.15.96:0/676544895 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b8009a70 con 0x7fa5c006eb10 2024-04-18T04:59:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5b5ffb640 1 -- 172.21.15.96:0/676544895 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc013470 con 0x7fa5c006eb10 2024-04-18T04:59:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.655+0000 7fa5c7526640 1 -- 172.21.15.96:0/676544895 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c0155920 con 0x7fa5c006eb10 2024-04-18T04:59:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.659+0000 7fa5c7526640 1 -- 172.21.15.96:0/676544895 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c00b1a80 con 0x7fa5c006eb10 2024-04-18T04:59:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.659+0000 7fa5b5ffb640 1 -- 172.21.15.96:0/676544895 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa5bc0135d0 con 0x7fa5c006eb10 2024-04-18T04:59:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.659+0000 7fa5b5ffb640 1 --2- 172.21.15.96:0/676544895 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa5a4066690 0x7fa5a4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:59:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.659+0000 7fa5b5ffb640 1 -- 172.21.15.96:0/676544895 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa5bc084910 con 0x7fa5c006eb10 2024-04-18T04:59:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.659+0000 7fa5c4ac1640 1 --2- 172.21.15.96:0/676544895 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa5a4066690 0x7fa5a4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:59:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.659+0000 7fa5c4ac1640 1 --2- 172.21.15.96:0/676544895 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa5a4066690 0x7fa5a4068b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0154800 tx=0x7fa5b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:59:51.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.663+0000 7fa5b5ffb640 1 -- 172.21.15.96:0/676544895 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa5bc051bd0 con 0x7fa5c006eb10 2024-04-18T04:59:51.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.899+0000 7fa5c7526640 1 -- 172.21.15.96:0/676544895 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fa5c0067050 con 0x7fa5c006eb10 2024-04-18T04:59:51.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.899+0000 7fa5b5ffb640 1 -- 172.21.15.96:0/676544895 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fa5bc021080 con 0x7fa5c006eb10 2024-04-18T04:59:51.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.903+0000 7fa5c7526640 1 -- 172.21.15.96:0/676544895 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa5a4066690 msgr2=0x7fa5a4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:51.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.903+0000 7fa5c7526640 1 --2- 172.21.15.96:0/676544895 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa5a4066690 0x7fa5a4068b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0154800 tx=0x7fa5b0009040 comp rx=0 tx=0).stop 2024-04-18T04:59:51.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.903+0000 7fa5c7526640 1 -- 172.21.15.96:0/676544895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c006eb10 msgr2=0x7fa5c01515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:59:51.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.903+0000 7fa5c7526640 1 --2- 172.21.15.96:0/676544895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c006eb10 0x7fa5c01515e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00e9d0 tx=0x7fa5bc00ee90 comp rx=0 tx=0).stop 2024-04-18T04:59:51.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.903+0000 7fa5c7526640 1 -- 172.21.15.96:0/676544895 shutdown_connections 2024-04-18T04:59:51.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.903+0000 7fa5c7526640 1 --2- 172.21.15.96:0/676544895 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa5a4066690 0x7fa5a4068b50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:51.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.903+0000 7fa5c7526640 1 --2- 172.21.15.96:0/676544895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5c0151070 0x7fa5c014f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:51.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.903+0000 7fa5c7526640 1 --2- 172.21.15.96:0/676544895 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5c00c3610 0x7fa5c01f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:51.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.903+0000 7fa5c7526640 1 --2- 172.21.15.96:0/676544895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c006eb10 0x7fa5c01515e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:59:51.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.903+0000 7fa5c7526640 1 -- 172.21.15.96:0/676544895 >> 172.21.15.96:0/676544895 conn(0x7fa5c006a5c0 msgr2=0x7fa5c00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:59:51.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.903+0000 7fa5c7526640 1 -- 172.21.15.96:0/676544895 shutdown_connections 2024-04-18T04:59:51.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T04:59:51.903+0000 7fa5c7526640 1 -- 172.21.15.96:0/676544895 wait complete. 2024-04-18T04:59:51.930 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-18T05:00:01.931 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-18T05:00:01.931 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T05:00:02.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb46984d640 1 Processor -- start 2024-04-18T05:00:02.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb46984d640 1 -- start start 2024-04-18T05:00:02.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb46984d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb46415cf90 0x7fb46406ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb46984d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4640c7890 con 0x7fb464156510 2024-04-18T05:00:02.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb46984d640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4640c7b70 con 0x7fb46406e8e0 2024-04-18T05:00:02.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb46984d640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46406f790 con 0x7fb46415cf90 2024-04-18T05:00:02.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb462ffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fb464156510 0x7fb4640cc540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:41606/0 (socket says 172.21.15.96:41606) 2024-04-18T05:00:02.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb462ffd640 1 -- 172.21.15.96:0/3495322633 learned_addr learned my addr 172.21.15.96:0/3495322633 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:00:02.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4637fe640 1 --2- 172.21.15.96:0/3495322633 >> v2:172.21.15.139:3300/0 conn(0x7fb46415cf90 0x7fb46406ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4627fc640 1 -- 172.21.15.96:0/3495322633 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40677576 0 0) 0x7fb4640c7890 con 0x7fb464156510 2024-04-18T05:00:02.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4627fc640 1 -- 172.21.15.96:0/3495322633 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb450003530 con 0x7fb464156510 2024-04-18T05:00:02.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4627fc640 1 -- 172.21.15.96:0/3495322633 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1148155844 0 0) 0x7fb450003530 con 0x7fb464156510 2024-04-18T05:00:02.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4627fc640 1 -- 172.21.15.96:0/3495322633 >> v2:172.21.15.139:3300/0 conn(0x7fb46415cf90 msgr2=0x7fb46406ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:02.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4627fc640 1 --2- 172.21.15.96:0/3495322633 >> v2:172.21.15.139:3300/0 conn(0x7fb46415cf90 0x7fb46406ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4627fc640 1 -- 172.21.15.96:0/3495322633 >> v1:172.21.15.139:6789/0 conn(0x7fb46406e8e0 legacy=0x7fb46415c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4627fc640 1 -- 172.21.15.96:0/3495322633 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4640c7e50 con 0x7fb464156510 2024-04-18T05:00:02.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4627fc640 1 -- 172.21.15.96:0/3495322633 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fb454001680 con 0x7fb464156510 2024-04-18T05:00:02.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4627fc640 1 -- 172.21.15.96:0/3495322633 >> v1:172.21.15.96:6789/0 conn(0x7fb464156510 legacy=0x7fb4640cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4627fc640 1 --2- 172.21.15.96:0/3495322633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb450003980 0x7fb450003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4627fc640 1 --2- 172.21.15.96:0/3495322633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4500047d0 0x7fb450004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4627fc640 1 --2- 172.21.15.96:0/3495322633 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb450005190 0x7fb45000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4627fc640 1 -- 172.21.15.96:0/3495322633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46406f790 con 0x7fb450003980 2024-04-18T05:00:02.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4627fc640 1 -- 172.21.15.96:0/3495322633 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45000c030 con 0x7fb4500047d0 2024-04-18T05:00:02.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4627fc640 1 -- 172.21.15.96:0/3495322633 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45000c1f0 con 0x7fb450005190 2024-04-18T05:00:02.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb45bfff640 1 --2- 172.21.15.96:0/3495322633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4500047d0 0x7fb450004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb462ffd640 1 --2- 172.21.15.96:0/3495322633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb450003980 0x7fb450003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4637fe640 1 --2- 172.21.15.96:0/3495322633 >> v2:172.21.15.139:3300/0 conn(0x7fb46415cf90 0x7fb46406ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T05:00:02.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb462ffd640 1 -- 172.21.15.96:0/3495322633 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb450005190 msgr2=0x7fb45000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:02.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb462ffd640 1 --2- 172.21.15.96:0/3495322633 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb450005190 0x7fb45000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb462ffd640 1 -- 172.21.15.96:0/3495322633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4500047d0 msgr2=0x7fb450004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:02.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb462ffd640 1 --2- 172.21.15.96:0/3495322633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4500047d0 0x7fb450004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb462ffd640 1 -- 172.21.15.96:0/3495322633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb450003530 con 0x7fb450003980 2024-04-18T05:00:02.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb4637fe640 1 -- 172.21.15.96:0/3495322633 reap_dead start 2024-04-18T05:00:02.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.075+0000 7fb45bfff640 1 --2- 172.21.15.96:0/3495322633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4500047d0 0x7fb450004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T05:00:02.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb462ffd640 1 --2- 172.21.15.96:0/3495322633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb450003980 0x7fb450003da0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb45400c1c0 tx=0x7fb45401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1668bc8c168fad server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb4627fc640 1 -- 172.21.15.96:0/3495322633 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454005ae0 con 0x7fb450003980 2024-04-18T05:00:02.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb4627fc640 1 -- 172.21.15.96:0/3495322633 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb454005c40 con 0x7fb450003980 2024-04-18T05:00:02.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb4627fc640 1 -- 172.21.15.96:0/3495322633 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4540a57f0 con 0x7fb450003980 2024-04-18T05:00:02.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb46984d640 1 -- 172.21.15.96:0/3495322633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb450003980 msgr2=0x7fb450003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb46984d640 1 --2- 172.21.15.96:0/3495322633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb450003980 0x7fb450003da0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb45400c1c0 tx=0x7fb45401cc00 comp rx=0 tx=0).stop 2024-04-18T05:00:02.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb46984d640 1 -- 172.21.15.96:0/3495322633 shutdown_connections 2024-04-18T05:00:02.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb46984d640 1 --2- 172.21.15.96:0/3495322633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb450003980 0x7fb450003da0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb46984d640 1 -- 172.21.15.96:0/3495322633 >> 172.21.15.96:0/3495322633 conn(0x7fb46406a460 msgr2=0x7fb464065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:02.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb46984d640 1 -- 172.21.15.96:0/3495322633 shutdown_connections 2024-04-18T05:00:02.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb46984d640 1 -- 172.21.15.96:0/3495322633 wait complete. 2024-04-18T05:00:02.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb46984d640 1 Processor -- start 2024-04-18T05:00:02.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb46984d640 1 -- start start 2024-04-18T05:00:02.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb46984d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb450003980 0x7fb46415b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb46984d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4641f5df0 0x7fb4640c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb46984d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4641f1c70 0x7fb4641553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb46984d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46415be80 con 0x7fb4641f1c70 2024-04-18T05:00:02.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb46984d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4641f5960 con 0x7fb4641f5df0 2024-04-18T05:00:02.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb46984d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640c4ac0 con 0x7fb450003980 2024-04-18T05:00:02.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb4637fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4641f1c70 0x7fb4641553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb4637fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4641f1c70 0x7fb4641553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56730/0 (socket says 172.21.15.96:56730) 2024-04-18T05:00:02.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb4637fe640 1 -- 172.21.15.96:0/2135285142 learned_addr learned my addr 172.21.15.96:0/2135285142 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:02.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.079+0000 7fb45bfff640 1 --2- 172.21.15.96:0/2135285142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4641f5df0 0x7fb4640c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb462ffd640 1 --2- 172.21.15.96:0/2135285142 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb450003980 0x7fb46415b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb4637fe640 1 -- 172.21.15.96:0/2135285142 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb450003980 msgr2=0x7fb46415b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb4637fe640 1 --2- 172.21.15.96:0/2135285142 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb450003980 0x7fb46415b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb4637fe640 1 -- 172.21.15.96:0/2135285142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4641f5df0 msgr2=0x7fb4640c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb4637fe640 1 --2- 172.21.15.96:0/2135285142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4641f5df0 0x7fb4640c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb4637fe640 1 -- 172.21.15.96:0/2135285142 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46415b8c0 con 0x7fb4641f1c70 2024-04-18T05:00:02.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb4637fe640 1 --2- 172.21.15.96:0/2135285142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4641f1c70 0x7fb4641553f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb46406e580 tx=0x7fb45c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb460ff9640 1 -- 172.21.15.96:0/2135285142 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c010040 con 0x7fb4641f1c70 2024-04-18T05:00:02.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb460ff9640 1 -- 172.21.15.96:0/2135285142 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c00bce0 con 0x7fb4641f1c70 2024-04-18T05:00:02.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb460ff9640 1 -- 172.21.15.96:0/2135285142 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c003be0 con 0x7fb4641f1c70 2024-04-18T05:00:02.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb46984d640 1 -- 172.21.15.96:0/2135285142 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46415bba0 con 0x7fb4641f1c70 2024-04-18T05:00:02.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb46984d640 1 -- 172.21.15.96:0/2135285142 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4641f55f0 con 0x7fb4641f1c70 2024-04-18T05:00:02.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb46984d640 1 -- 172.21.15.96:0/2135285142 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4641f5b10 con 0x7fb4641f1c70 2024-04-18T05:00:02.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb460ff9640 1 -- 172.21.15.96:0/2135285142 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb45c004030 con 0x7fb4641f1c70 2024-04-18T05:00:02.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb460ff9640 1 --2- 172.21.15.96:0/2135285142 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb444066690 0x7fb444068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb460ff9640 1 -- 172.21.15.96:0/2135285142 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb45c0849c0 con 0x7fb4641f1c70 2024-04-18T05:00:02.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb462ffd640 1 --2- 172.21.15.96:0/2135285142 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb444066690 0x7fb444068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.083+0000 7fb462ffd640 1 --2- 172.21.15.96:0/2135285142 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb444066690 0x7fb444068b50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb4540ab000 tx=0x7fb4540b1040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.087+0000 7fb460ff9640 1 -- 172.21.15.96:0/2135285142 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb4641f5b10 con 0x7fb4641f1c70 2024-04-18T05:00:02.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.315+0000 7fb46984d640 1 -- 172.21.15.96:0/2135285142 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb4641f5ad0 con 0x7fb4641f1c70 2024-04-18T05:00:02.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.315+0000 7fb460ff9640 1 -- 172.21.15.96:0/2135285142 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fb45c051db0 con 0x7fb4641f1c70 2024-04-18T05:00:02.318 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T05:00:02.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.315+0000 7fb46984d640 1 -- 172.21.15.96:0/2135285142 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb444066690 msgr2=0x7fb444068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.315+0000 7fb46984d640 1 --2- 172.21.15.96:0/2135285142 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb444066690 0x7fb444068b50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb4540ab000 tx=0x7fb4540b1040 comp rx=0 tx=0).stop 2024-04-18T05:00:02.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.315+0000 7fb46984d640 1 -- 172.21.15.96:0/2135285142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4641f1c70 msgr2=0x7fb4641553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.315+0000 7fb46984d640 1 --2- 172.21.15.96:0/2135285142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4641f1c70 0x7fb4641553f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb46406e580 tx=0x7fb45c00b480 comp rx=0 tx=0).stop 2024-04-18T05:00:02.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.315+0000 7fb46984d640 1 -- 172.21.15.96:0/2135285142 shutdown_connections 2024-04-18T05:00:02.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.315+0000 7fb46984d640 1 --2- 172.21.15.96:0/2135285142 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb444066690 0x7fb444068b50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.315+0000 7fb46984d640 1 --2- 172.21.15.96:0/2135285142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4641f1c70 0x7fb4641553f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.315+0000 7fb46984d640 1 --2- 172.21.15.96:0/2135285142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4641f5df0 0x7fb4640c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.315+0000 7fb46984d640 1 --2- 172.21.15.96:0/2135285142 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb450003980 0x7fb46415b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.315+0000 7fb46984d640 1 -- 172.21.15.96:0/2135285142 >> 172.21.15.96:0/2135285142 conn(0x7fb46406a460 msgr2=0x7fb464158140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:02.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.315+0000 7fb46984d640 1 -- 172.21.15.96:0/2135285142 shutdown_connections 2024-04-18T05:00:02.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.315+0000 7fb46984d640 1 -- 172.21.15.96:0/2135285142 wait complete. 2024-04-18T05:00:02.336 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-18T05:00:02.336 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-18T05:00:02.336 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-18T05:00:02.336 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T05:00:02.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe689cac640 1 Processor -- start 2024-04-18T05:00:02.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe689cac640 1 -- start start 2024-04-18T05:00:02.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe689cac640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe684156680 0x7fe684070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe689cac640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe684159240 con 0x7fe6840c5700 2024-04-18T05:00:02.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe689cac640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe684156a60 con 0x7fe6840711a0 2024-04-18T05:00:02.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe689cac640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe684069e60 con 0x7fe684156680 2024-04-18T05:00:02.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe683fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe6840c5700 0x7fe684163860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:41610/0 (socket says 172.21.15.96:41610) 2024-04-18T05:00:02.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe683fff640 1 -- 172.21.15.96:0/961475301 learned_addr learned my addr 172.21.15.96:0/961475301 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:00:02.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6837fe640 1 --2- 172.21.15.96:0/961475301 >> v2:172.21.15.139:3300/0 conn(0x7fe684156680 0x7fe684070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6827fc640 1 -- 172.21.15.96:0/961475301 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003730760 0 0) 0x7fe684159240 con 0x7fe6840c5700 2024-04-18T05:00:02.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6827fc640 1 -- 172.21.15.96:0/961475301 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe66c003530 con 0x7fe6840c5700 2024-04-18T05:00:02.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6827fc640 1 -- 172.21.15.96:0/961475301 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2477806038 0 0) 0x7fe66c003530 con 0x7fe6840c5700 2024-04-18T05:00:02.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6827fc640 1 -- 172.21.15.96:0/961475301 >> v2:172.21.15.139:3300/0 conn(0x7fe684156680 msgr2=0x7fe684070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:02.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6827fc640 1 --2- 172.21.15.96:0/961475301 >> v2:172.21.15.139:3300/0 conn(0x7fe684156680 0x7fe684070740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6827fc640 1 -- 172.21.15.96:0/961475301 >> v1:172.21.15.139:6789/0 conn(0x7fe6840711a0 legacy=0x7fe6841596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6827fc640 1 -- 172.21.15.96:0/961475301 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6840c6290 con 0x7fe6840c5700 2024-04-18T05:00:02.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6827fc640 1 -- 172.21.15.96:0/961475301 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fe67c001a00 con 0x7fe6840c5700 2024-04-18T05:00:02.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6827fc640 1 -- 172.21.15.96:0/961475301 >> v1:172.21.15.96:6789/0 conn(0x7fe6840c5700 legacy=0x7fe684163860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6827fc640 1 --2- 172.21.15.96:0/961475301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003980 0x7fe66c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6827fc640 1 --2- 172.21.15.96:0/961475301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe66c0047d0 0x7fe66c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6827fc640 1 --2- 172.21.15.96:0/961475301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe66c005190 0x7fe66c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6827fc640 1 -- 172.21.15.96:0/961475301 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c00c010 con 0x7fe66c003980 2024-04-18T05:00:02.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6827fc640 1 -- 172.21.15.96:0/961475301 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c00c180 con 0x7fe66c0047d0 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6827fc640 1 -- 172.21.15.96:0/961475301 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c00c340 con 0x7fe66c005190 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6837fe640 1 --2- 172.21.15.96:0/961475301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003980 0x7fe66c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6837fe640 1 -- 172.21.15.96:0/961475301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe66c005190 msgr2=0x7fe66c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6837fe640 1 --2- 172.21.15.96:0/961475301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe66c005190 0x7fe66c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6837fe640 1 -- 172.21.15.96:0/961475301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe66c0047d0 msgr2=0x7fe66c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6837fe640 1 --2- 172.21.15.96:0/961475301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe66c0047d0 0x7fe66c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe683fff640 1 -- 172.21.15.96:0/961475301 reap_dead start 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.455+0000 7fe6837fe640 1 -- 172.21.15.96:0/961475301 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c003530 con 0x7fe66c003980 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe6837fe640 1 --2- 172.21.15.96:0/961475301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003980 0x7fe66c003da0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe674009ae0 tx=0x7fe67401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fa060e8b60ecf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe6827fc640 1 -- 172.21.15.96:0/961475301 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6740a5680 con 0x7fe66c003980 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe6827fc640 1 -- 172.21.15.96:0/961475301 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6740a57e0 con 0x7fe66c003980 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe6827fc640 1 -- 172.21.15.96:0/961475301 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6740a5b90 con 0x7fe66c003980 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe689cac640 1 -- 172.21.15.96:0/961475301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003980 msgr2=0x7fe66c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe689cac640 1 --2- 172.21.15.96:0/961475301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003980 0x7fe66c003da0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe674009ae0 tx=0x7fe67401ca90 comp rx=0 tx=0).stop 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe689cac640 1 -- 172.21.15.96:0/961475301 shutdown_connections 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe689cac640 1 --2- 172.21.15.96:0/961475301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003980 0x7fe66c003da0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe689cac640 1 -- 172.21.15.96:0/961475301 >> 172.21.15.96:0/961475301 conn(0x7fe68406e020 msgr2=0x7fe68406e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe689cac640 1 -- 172.21.15.96:0/961475301 shutdown_connections 2024-04-18T05:00:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe689cac640 1 -- 172.21.15.96:0/961475301 wait complete. 2024-04-18T05:00:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe689cac640 1 Processor -- start 2024-04-18T05:00:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe689cac640 1 -- start start 2024-04-18T05:00:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe689cac640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003980 0x7fe6840c0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe689cac640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe6841efbc0 0x7fe684152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe689cac640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6841ee750 0x7fe6840c0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe689cac640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6840bed00 con 0x7fe66c003980 2024-04-18T05:00:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe689cac640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6840c0560 con 0x7fe6841ee750 2024-04-18T05:00:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe689cac640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6840bef80 con 0x7fe6841efbc0 2024-04-18T05:00:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.459+0000 7fe6837fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003980 0x7fe6840c0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe6837fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003980 0x7fe6840c0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56746/0 (socket says 172.21.15.96:56746) 2024-04-18T05:00:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe6837fe640 1 -- 172.21.15.96:0/2851548169 learned_addr learned my addr 172.21.15.96:0/2851548169 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe683fff640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6841ee750 0x7fe6840c0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe682ffd640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe6841efbc0 0x7fe684152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe6837fe640 1 -- 172.21.15.96:0/2851548169 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe6841efbc0 msgr2=0x7fe684152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe6837fe640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe6841efbc0 0x7fe684152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe6837fe640 1 -- 172.21.15.96:0/2851548169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6841ee750 msgr2=0x7fe6840c0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe6837fe640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6841ee750 0x7fe6840c0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe6837fe640 1 -- 172.21.15.96:0/2851548169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6840bf260 con 0x7fe66c003980 2024-04-18T05:00:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe6837fe640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003980 0x7fe6840c0020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe67401c8c0 tx=0x7fe674019830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe66bfff640 1 -- 172.21.15.96:0/2851548169 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe674004020 con 0x7fe66c003980 2024-04-18T05:00:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe66bfff640 1 -- 172.21.15.96:0/2851548169 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6740041c0 con 0x7fe66c003980 2024-04-18T05:00:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe689cac640 1 -- 172.21.15.96:0/2851548169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6840bf540 con 0x7fe66c003980 2024-04-18T05:00:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe66bfff640 1 -- 172.21.15.96:0/2851548169 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe674003620 con 0x7fe66c003980 2024-04-18T05:00:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe689cac640 1 -- 172.21.15.96:0/2851548169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6840bfb00 con 0x7fe66c003980 2024-04-18T05:00:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe689cac640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6840c1470 0x7fe6841f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe689cac640 1 -- 172.21.15.96:0/2851548169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6840bf3f0 con 0x7fe6840c1470 2024-04-18T05:00:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe682ffd640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6840c1470 0x7fe6841f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe682ffd640 1 -- 172.21.15.96:0/2851548169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6840c6b30 con 0x7fe6840c1470 2024-04-18T05:00:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe682ffd640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6840c1470 0x7fe6841f1cc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe684155c20 tx=0x7fe67800d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe66bfff640 1 -- 172.21.15.96:0/2851548169 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe6740b4070 con 0x7fe66c003980 2024-04-18T05:00:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe66bfff640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe6700666c0 0x7fe670068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe66bfff640 1 -- 172.21.15.96:0/2851548169 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe67411e530 con 0x7fe66c003980 2024-04-18T05:00:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe683fff640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe6700666c0 0x7fe670068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe66bfff640 1 -- 172.21.15.96:0/2851548169 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6780052d0 con 0x7fe6840c1470 2024-04-18T05:00:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe66bfff640 1 -- 172.21.15.96:0/2851548169 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fe678005430 con 0x7fe6840c1470 2024-04-18T05:00:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe66bfff640 1 -- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6840c1470 msgr2=0x7fe6841f1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe66bfff640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6840c1470 0x7fe6841f1cc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe684155c20 tx=0x7fe67800d880 comp rx=0 tx=0).stop 2024-04-18T05:00:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe66bfff640 1 -- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6840c1470 msgr2=0x7fe6841f1cc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T05:00:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe66bfff640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6840c1470 0x7fe6841f1cc0 secure :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe684155c20 tx=0x7fe67800d880 comp rx=0 tx=0).stop 2024-04-18T05:00:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.463+0000 7fe683fff640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe6700666c0 0x7fe670068b80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe6840c5ae0 tx=0x7fe67c001800 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe689cac640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6840c1850 0x7fe6841f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe689cac640 1 -- 172.21.15.96:0/2851548169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6840bf6d0 con 0x7fe6840c1850 2024-04-18T05:00:02.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe682ffd640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6840c1850 0x7fe6841f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe682ffd640 1 -- 172.21.15.96:0/2851548169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe6840c6850 con 0x7fe6840c1850 2024-04-18T05:00:02.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe682ffd640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6840c1850 0x7fe6841f2200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe684155c20 tx=0x7fe678000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe66bfff640 1 -- 172.21.15.96:0/2851548169 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678021070 con 0x7fe6840c1850 2024-04-18T05:00:02.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe66bfff640 1 -- 172.21.15.96:0/2851548169 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7fe678003e10 con 0x7fe6840c1850 2024-04-18T05:00:02.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe66bfff640 1 -- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6840c1850 msgr2=0x7fe6841f2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe66bfff640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6840c1850 0x7fe6841f2200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe684155c20 tx=0x7fe678000bd0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe66bfff640 1 -- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6840c1850 msgr2=0x7fe6841f2200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T05:00:02.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe66bfff640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6840c1850 0x7fe6841f2200 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.475 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T05:00:02.475 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T05:00:02.475 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T05:00:02.475 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T05:00:02.475 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 52, 2024-04-18T05:00:02.475 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T05:00:02.476 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T05:00:02.476 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T05:00:02.476 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T05:00:02.476 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:02.476 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 16, 2024-04-18T05:00:02.476 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T05:00:02.476 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T05:00:02.476 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T05:00:02.476 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:02.476 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:02.476 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:02.476 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:02.477 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:02.477 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:02.477 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:02.477 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:02.477 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:02.477 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:02.477 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:02.477 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T05:00:02.477 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T05:00:02.477 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:02.477 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:02.477 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:02.477 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:02.478 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:02.478 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:02.478 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:02.478 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:02.478 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:02.478 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:02.478 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.478 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T05:00:02.478 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T05:00:02.478 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T05:00:02.478 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T05:00:02.478 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T05:00:02.478 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T05:00:02.479 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T05:00:02.479 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T05:00:02.479 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T05:00:02.479 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T05:00:02.479 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T05:00:02.479 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T05:00:02.479 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T05:00:02.479 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T05:00:02.479 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T05:00:02.479 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T05:00:02.479 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T05:00:02.479 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:02.479 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:02.479 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:02.480 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:02.480 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:02.480 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:02.480 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:02.480 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:02.480 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:02.480 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:02.480 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:02.480 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T05:00:02.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.480 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T05:00:02.480 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.480 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T05:00:02.481 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T05:00:02.481 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:02.481 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:02.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.481 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:02.481 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T05:00:02.481 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.481 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:02.481 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T05:00:02.481 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.481 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.482 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.482 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T05:00:02.482 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T05:00:02.482 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:02.482 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:02.482 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:02.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.482 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.482 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T05:00:02.482 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T05:00:02.482 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:02.482 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:02.483 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.483 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:02.483 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T05:00:02.483 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.483 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.483 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.483 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:02.483 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T05:00:02.483 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.483 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.483 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.483 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.483 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T05:00:02.483 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T05:00:02.483 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:02.484 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:02.484 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:02.484 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.484 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.484 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T05:00:02.484 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T05:00:02.484 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:02.484 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:02.484 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.484 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:02.484 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T05:00:02.484 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.484 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.484 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.485 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:02.485 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T05:00:02.485 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.485 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.485 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.485 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.485 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T05:00:02.485 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T05:00:02.485 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:02.485 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:02.485 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:02.485 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.485 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.485 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.485 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T05:00:02.485 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T05:00:02.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.486 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:02.486 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:02.486 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T05:00:02.486 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.486 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:02.486 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T05:00:02.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.486 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:02.486 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:02.486 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5 2024-04-18T05:00:02.486 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.486 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:02.486 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T05:00:02.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.487 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:02.487 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:02.487 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 8 2024-04-18T05:00:02.487 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.487 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:02.487 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T05:00:02.487 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.487 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:02.487 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:02.487 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 7 2024-04-18T05:00:02.487 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.487 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:02.487 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T05:00:02.487 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.487 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:02.488 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:02.488 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T05:00:02.488 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.488 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.488 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.488 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T05:00:02.488 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T05:00:02.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe689cac640 1 -- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe6700666c0 msgr2=0x7fe670068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe689cac640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe6700666c0 0x7fe670068b80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe6840c5ae0 tx=0x7fe67c001800 comp rx=0 tx=0).stop 2024-04-18T05:00:02.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe689cac640 1 -- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003980 msgr2=0x7fe6840c0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe689cac640 1 --2- 172.21.15.96:0/2851548169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003980 0x7fe6840c0020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe67401c8c0 tx=0x7fe674019830 comp rx=0 tx=0).stop 2024-04-18T05:00:02.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe683fff640 1 -- 172.21.15.96:0/2851548169 reap_dead start 2024-04-18T05:00:02.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe683fff640 1 -- 172.21.15.96:0/2851548169 reap_dead start 2024-04-18T05:00:02.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe689cac640 1 -- 172.21.15.96:0/2851548169 shutdown_connections 2024-04-18T05:00:02.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe689cac640 1 -- 172.21.15.96:0/2851548169 >> 172.21.15.96:0/2851548169 conn(0x7fe68406e020 msgr2=0x7fe684069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:02.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe689cac640 1 -- 172.21.15.96:0/2851548169 shutdown_connections 2024-04-18T05:00:02.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.471+0000 7fe689cac640 1 -- 172.21.15.96:0/2851548169 wait complete. 2024-04-18T05:00:02.491 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T05:00:02.491 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-18T05:00:02.491 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-18T05:00:02.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.603+0000 7f5b398c1640 1 Processor -- start 2024-04-18T05:00:02.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.603+0000 7f5b398c1640 1 -- start start 2024-04-18T05:00:02.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.603+0000 7f5b398c1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5b34150e50 0x7f5b3415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.603+0000 7f5b398c1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b340c8e10 con 0x7f5b340c16b0 2024-04-18T05:00:02.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.603+0000 7f5b398c1640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b341571e0 con 0x7f5b340c7090 2024-04-18T05:00:02.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.603+0000 7f5b398c1640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b341574c0 con 0x7f5b34150e50 2024-04-18T05:00:02.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.603+0000 7f5b32ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5b34150e50 0x7f5b3415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.603+0000 7f5b2a7fc640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5b340c16b0 0x7f5b340c9120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:41624/0 (socket says 172.21.15.96:41624) 2024-04-18T05:00:02.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.603+0000 7f5b2a7fc640 1 -- 172.21.15.96:0/1420944530 learned_addr learned my addr 172.21.15.96:0/1420944530 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:00:02.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.603+0000 7f5b32ffd640 1 -- 172.21.15.96:0/1420944530 >> v1:172.21.15.139:6789/0 conn(0x7f5b340c7090 legacy=0x7f5b34161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:02.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.603+0000 7f5b32ffd640 1 -- 172.21.15.96:0/1420944530 >> v1:172.21.15.96:6789/0 conn(0x7f5b340c16b0 legacy=0x7f5b340c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.603+0000 7f5b32ffd640 1 -- 172.21.15.96:0/1420944530 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b341577a0 con 0x7f5b34150e50 2024-04-18T05:00:02.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.603+0000 7f5b327fc640 1 -- 172.21.15.96:0/1420944530 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654556658 0 0) 0x7f5b340c8e10 con 0x7f5b340c16b0 2024-04-18T05:00:02.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.603+0000 7f5b32ffd640 1 --2- 172.21.15.96:0/1420944530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b34150e50 0x7f5b3415aaa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5b240097c0 tx=0x7f5b2401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88de5fa7db3cb4da server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b327fc640 1 -- 172.21.15.96:0/1420944530 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b240a8950 con 0x7f5b34150e50 2024-04-18T05:00:02.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b327fc640 1 -- 172.21.15.96:0/1420944530 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b240a8ab0 con 0x7f5b34150e50 2024-04-18T05:00:02.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b327fc640 1 -- 172.21.15.96:0/1420944530 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b240a8e40 con 0x7f5b34150e50 2024-04-18T05:00:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b398c1640 1 -- 172.21.15.96:0/1420944530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b34150e50 msgr2=0x7f5b3415aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b398c1640 1 --2- 172.21.15.96:0/1420944530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b34150e50 0x7f5b3415aaa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5b240097c0 tx=0x7f5b2401ec50 comp rx=0 tx=0).stop 2024-04-18T05:00:02.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b398c1640 1 -- 172.21.15.96:0/1420944530 shutdown_connections 2024-04-18T05:00:02.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b398c1640 1 --2- 172.21.15.96:0/1420944530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b34150e50 0x7f5b3415aaa0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b398c1640 1 -- 172.21.15.96:0/1420944530 >> 172.21.15.96:0/1420944530 conn(0x7f5b3406fd10 msgr2=0x7f5b34070120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:02.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b398c1640 1 -- 172.21.15.96:0/1420944530 shutdown_connections 2024-04-18T05:00:02.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b398c1640 1 -- 172.21.15.96:0/1420944530 wait complete. 2024-04-18T05:00:02.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b398c1640 1 Processor -- start 2024-04-18T05:00:02.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b398c1640 1 -- start start 2024-04-18T05:00:02.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b398c1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5b340c16b0 0x7f5b340aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b398c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b340c7090 0x7f5b3414c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b398c1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b34150e50 0x7f5b3414c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b398c1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b340b1a90 con 0x7f5b34150e50 2024-04-18T05:00:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b398c1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3414a090 con 0x7f5b340c7090 2024-04-18T05:00:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b398c1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3414b6e0 con 0x7f5b340c16b0 2024-04-18T05:00:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b337fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b34150e50 0x7f5b3414c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b337fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b34150e50 0x7f5b3414c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56798/0 (socket says 172.21.15.96:56798) 2024-04-18T05:00:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b337fe640 1 -- 172.21.15.96:0/2503389334 learned_addr learned my addr 172.21.15.96:0/2503389334 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b2a7fc640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b340c7090 0x7f5b3414c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b32ffd640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5b340c16b0 0x7f5b340aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b337fe640 1 -- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5b340c16b0 msgr2=0x7f5b340aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b337fe640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5b340c16b0 0x7f5b340aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b337fe640 1 -- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b340c7090 msgr2=0x7f5b3414c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b337fe640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b340c7090 0x7f5b3414c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b337fe640 1 -- 172.21.15.96:0/2503389334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b24009420 con 0x7f5b34150e50 2024-04-18T05:00:02.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b32ffd640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5b340c16b0 0x7f5b340aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:00:02.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b337fe640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b34150e50 0x7f5b3414c750 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00c780 tx=0x7f5b2c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.607+0000 7f5b30ff9640 1 -- 172.21.15.96:0/2503389334 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c004b70 con 0x7f5b34150e50 2024-04-18T05:00:02.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b30ff9640 1 -- 172.21.15.96:0/2503389334 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c00ce90 con 0x7f5b34150e50 2024-04-18T05:00:02.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b398c1640 1 -- 172.21.15.96:0/2503389334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3414b980 con 0x7f5b34150e50 2024-04-18T05:00:02.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b30ff9640 1 -- 172.21.15.96:0/2503389334 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c00a850 con 0x7f5b34150e50 2024-04-18T05:00:02.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b398c1640 1 -- 172.21.15.96:0/2503389334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b340b0fc0 con 0x7f5b34150e50 2024-04-18T05:00:02.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b398c1640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b340b1180 0x7f5b341f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b398c1640 1 -- 172.21.15.96:0/2503389334 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3406acb0 con 0x7f5b340b1180 2024-04-18T05:00:02.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b32ffd640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b340b1180 0x7f5b341f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b30ff9640 1 -- 172.21.15.96:0/2503389334 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b2c00a9b0 con 0x7f5b34150e50 2024-04-18T05:00:02.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b32ffd640 1 -- 172.21.15.96:0/2503389334 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b3415a580 con 0x7f5b340b1180 2024-04-18T05:00:02.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b30ff9640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5b14066690 0x7f5b14068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b30ff9640 1 -- 172.21.15.96:0/2503389334 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5b2c084310 con 0x7f5b34150e50 2024-04-18T05:00:02.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b2a7fc640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5b14066690 0x7f5b14068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b32ffd640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b340b1180 0x7f5b341f1a60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5b340c9ce0 tx=0x7f5b2401d490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b30ff9640 1 -- 172.21.15.96:0/2503389334 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b240b0dc0 con 0x7f5b340b1180 2024-04-18T05:00:02.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b2a7fc640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5b14066690 0x7f5b14068b50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5b340c6c80 tx=0x7f5b1c007b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b30ff9640 1 -- 172.21.15.96:0/2503389334 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f5b240bc450 con 0x7f5b340b1180 2024-04-18T05:00:02.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b30ff9640 1 -- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b340b1180 msgr2=0x7f5b341f1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b30ff9640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b340b1180 0x7f5b341f1a60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5b340c9ce0 tx=0x7f5b2401d490 comp rx=0 tx=0).stop 2024-04-18T05:00:02.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b30ff9640 1 -- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b340b1180 msgr2=0x7f5b341f1a60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T05:00:02.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.611+0000 7f5b30ff9640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b340b1180 0x7f5b341f1a60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.619+0000 7f5b398c1640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b34159a80 0x7f5b341f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.619+0000 7f5b398c1640 1 -- 172.21.15.96:0/2503389334 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3415a2a0 con 0x7f5b34159a80 2024-04-18T05:00:02.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.619+0000 7f5b32ffd640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b34159a80 0x7f5b341f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.619+0000 7f5b32ffd640 1 -- 172.21.15.96:0/2503389334 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5b3415afe0 con 0x7f5b34159a80 2024-04-18T05:00:02.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.619+0000 7f5b32ffd640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b34159a80 0x7f5b341f1fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b2401c880 tx=0x7f5b2401b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.619+0000 7f5b30ff9640 1 -- 172.21.15.96:0/2503389334 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b240bc9d0 con 0x7f5b34159a80 2024-04-18T05:00:02.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.619+0000 7f5b30ff9640 1 -- 172.21.15.96:0/2503389334 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4636 (secure 0 0 0) 0x7f5b24003ed0 con 0x7f5b34159a80 2024-04-18T05:00:02.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.619+0000 7f5b30ff9640 1 -- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b34159a80 msgr2=0x7f5b341f1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.619+0000 7f5b30ff9640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b34159a80 0x7f5b341f1fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b2401c880 tx=0x7f5b2401b9f0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.619+0000 7f5b30ff9640 1 -- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b34159a80 msgr2=0x7f5b341f1fa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T05:00:02.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.619+0000 7f5b30ff9640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b34159a80 0x7f5b341f1fa0 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b2401c880 tx=0x7f5b2401b9f0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.624 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T05:00:02.624 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T05:00:02.625 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T05:00:02.625 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T05:00:02.625 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 52, 2024-04-18T05:00:02.625 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T05:00:02.625 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T05:00:02.625 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T05:00:02.625 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T05:00:02.625 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:02.625 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 16, 2024-04-18T05:00:02.625 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T05:00:02.625 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T05:00:02.625 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T05:00:02.625 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:02.625 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:02.625 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:02.626 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:02.626 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:02.626 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:02.626 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:02.626 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:02.626 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:02.626 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:02.626 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:02.626 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T05:00:02.626 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T05:00:02.626 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:02.626 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:02.627 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:02.627 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:02.627 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:02.627 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:02.627 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:02.627 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:02.627 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:02.627 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:02.627 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.627 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T05:00:02.627 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T05:00:02.627 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T05:00:02.628 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T05:00:02.628 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T05:00:02.628 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T05:00:02.628 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T05:00:02.628 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T05:00:02.628 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T05:00:02.628 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T05:00:02.628 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T05:00:02.628 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T05:00:02.628 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T05:00:02.628 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T05:00:02.628 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T05:00:02.628 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T05:00:02.628 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T05:00:02.628 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:02.629 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:02.629 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:02.629 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:02.629 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:02.629 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:02.629 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:02.629 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:02.629 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:02.629 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:02.629 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:02.629 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T05:00:02.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.629 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T05:00:02.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.630 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T05:00:02.630 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T05:00:02.630 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:02.630 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:02.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.630 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:02.630 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T05:00:02.630 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.630 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:02.630 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T05:00:02.630 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.631 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.631 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.631 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T05:00:02.631 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T05:00:02.631 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:02.631 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:02.631 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:02.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.631 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T05:00:02.631 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T05:00:02.631 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:02.631 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:02.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.632 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:02.632 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T05:00:02.632 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.632 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:02.632 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T05:00:02.632 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.632 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.632 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.632 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T05:00:02.632 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T05:00:02.632 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:02.633 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:02.633 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:02.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.633 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T05:00:02.633 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T05:00:02.633 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:02.633 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:02.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.633 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:02.633 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T05:00:02.633 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.634 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:02.634 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T05:00:02.634 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.634 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.634 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.634 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T05:00:02.634 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T05:00:02.634 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:02.634 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:02.634 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:02.634 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.634 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.635 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T05:00:02.635 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T05:00:02.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.635 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:02.635 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:02.635 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T05:00:02.635 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.635 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:02.635 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T05:00:02.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.635 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:02.635 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:02.635 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T05:00:02.635 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.635 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:02.636 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T05:00:02.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.636 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:02.636 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:02.636 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T05:00:02.636 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.636 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.636 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T05:00:02.636 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T05:00:02.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.623+0000 7f5b398c1640 1 -- 172.21.15.96:0/2503389334 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5b14066690 msgr2=0x7f5b14068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.623+0000 7f5b398c1640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5b14066690 0x7f5b14068b50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5b340c6c80 tx=0x7f5b1c007b80 comp rx=0 tx=0).stop 2024-04-18T05:00:02.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.623+0000 7f5b398c1640 1 -- 172.21.15.96:0/2503389334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b34150e50 msgr2=0x7f5b3414c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.623+0000 7f5b337fe640 1 -- 172.21.15.96:0/2503389334 reap_dead start 2024-04-18T05:00:02.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.623+0000 7f5b398c1640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b34150e50 0x7f5b3414c750 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00c780 tx=0x7f5b2c00cc40 comp rx=0 tx=0).stop 2024-04-18T05:00:02.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.623+0000 7f5b398c1640 1 -- 172.21.15.96:0/2503389334 shutdown_connections 2024-04-18T05:00:02.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.623+0000 7f5b398c1640 1 --2- 172.21.15.96:0/2503389334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b34150e50 0x7f5b3414c750 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.623+0000 7f5b398c1640 1 -- 172.21.15.96:0/2503389334 >> 172.21.15.96:0/2503389334 conn(0x7f5b3406fd10 msgr2=0x7f5b340c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:02.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.623+0000 7f5b398c1640 1 -- 172.21.15.96:0/2503389334 shutdown_connections 2024-04-18T05:00:02.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.623+0000 7f5b398c1640 1 -- 172.21.15.96:0/2503389334 wait complete. 2024-04-18T05:00:02.640 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T05:00:02.640 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-18T05:00:02.640 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-18T05:00:02.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.747+0000 7f4eb7307640 1 Processor -- start 2024-04-18T05:00:02.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.747+0000 7f4eb7307640 1 -- start start 2024-04-18T05:00:02.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb7307640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb00c4770 0x7f4eb0070d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb7307640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4eb00c4b50 0x7f4eb0065ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb7307640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4eb0156e30 0x7f4eb00b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb7307640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb0070870 con 0x7f4eb00c4b50 2024-04-18T05:00:02.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb7307640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb0071240 con 0x7f4eb0156e30 2024-04-18T05:00:02.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb7307640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb00c19f0 con 0x7f4eb00c4770 2024-04-18T05:00:02.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb48a2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4eb00c4b50 0x7f4eb0065ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb48a2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4eb00c4b50 0x7f4eb0065ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56814/0 (socket says 172.21.15.96:56814) 2024-04-18T05:00:02.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb48a2640 1 -- 172.21.15.96:0/125007092 learned_addr learned my addr 172.21.15.96:0/125007092 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:02.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb58a4640 1 --2- 172.21.15.96:0/125007092 >> v2:172.21.15.139:3300/0 conn(0x7f4eb0156e30 0x7f4eb00b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb50a3640 1 --2- 172.21.15.96:0/125007092 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb00c4770 0x7f4eb0070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb48a2640 1 -- 172.21.15.96:0/125007092 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb00c4770 msgr2=0x7f4eb0070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:02.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb48a2640 1 --2- 172.21.15.96:0/125007092 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb00c4770 0x7f4eb0070d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb48a2640 1 -- 172.21.15.96:0/125007092 >> v2:172.21.15.139:3300/0 conn(0x7f4eb0156e30 msgr2=0x7f4eb00b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:02.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb48a2640 1 --2- 172.21.15.96:0/125007092 >> v2:172.21.15.139:3300/0 conn(0x7f4eb0156e30 0x7f4eb00b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb48a2640 1 -- 172.21.15.96:0/125007092 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb00c5d60 con 0x7f4eb00c4b50 2024-04-18T05:00:02.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb50a3640 1 --2- 172.21.15.96:0/125007092 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb00c4770 0x7f4eb0070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:00:02.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb48a2640 1 --2- 172.21.15.96:0/125007092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eb00c4b50 0x7f4eb0065ce0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4eb00c6a60 tx=0x7f4ea001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5325fbb27ab597 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4ea7fff640 1 -- 172.21.15.96:0/125007092 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00a89d0 con 0x7f4eb00c4b50 2024-04-18T05:00:02.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4ea7fff640 1 -- 172.21.15.96:0/125007092 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea00a8b30 con 0x7f4eb00c4b50 2024-04-18T05:00:02.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4ea7fff640 1 -- 172.21.15.96:0/125007092 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00b0440 con 0x7f4eb00c4b50 2024-04-18T05:00:02.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb7307640 1 -- 172.21.15.96:0/125007092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eb00c4b50 msgr2=0x7f4eb0065ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.751+0000 7f4eb7307640 1 --2- 172.21.15.96:0/125007092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eb00c4b50 0x7f4eb0065ce0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4eb00c6a60 tx=0x7f4ea001ed10 comp rx=0 tx=0).stop 2024-04-18T05:00:02.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 -- 172.21.15.96:0/125007092 shutdown_connections 2024-04-18T05:00:02.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 --2- 172.21.15.96:0/125007092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eb00c4b50 0x7f4eb0065ce0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 --2- 172.21.15.96:0/125007092 >> v2:172.21.15.139:3300/0 conn(0x7f4eb0156e30 0x7f4eb00b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 --2- 172.21.15.96:0/125007092 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb00c4770 0x7f4eb0070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 -- 172.21.15.96:0/125007092 >> 172.21.15.96:0/125007092 conn(0x7f4eb006e020 msgr2=0x7f4eb006e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:02.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 -- 172.21.15.96:0/125007092 shutdown_connections 2024-04-18T05:00:02.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 -- 172.21.15.96:0/125007092 wait complete. 2024-04-18T05:00:02.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 Processor -- start 2024-04-18T05:00:02.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 -- start start 2024-04-18T05:00:02.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4eb00c4770 0x7f4eb01e1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eb00c4b50 0x7f4eb00bca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb0156e30 0x7f4eb00bcf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb01e2c60 con 0x7f4eb00c4b50 2024-04-18T05:00:02.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb00c7200 con 0x7f4eb00c4770 2024-04-18T05:00:02.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb00c7710 con 0x7f4eb0156e30 2024-04-18T05:00:02.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb48a2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eb00c4b50 0x7f4eb00bca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb48a2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eb00c4b50 0x7f4eb00bca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56824/0 (socket says 172.21.15.96:56824) 2024-04-18T05:00:02.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb48a2640 1 -- 172.21.15.96:0/1857928669 learned_addr learned my addr 172.21.15.96:0/1857928669 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:02.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb58a4640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb0156e30 0x7f4eb00bcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb50a3640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4eb00c4770 0x7f4eb01e1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb48a2640 1 -- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb0156e30 msgr2=0x7f4eb00bcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb48a2640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb0156e30 0x7f4eb00bcf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb48a2640 1 -- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4eb00c4770 msgr2=0x7f4eb01e1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb48a2640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4eb00c4770 0x7f4eb01e1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb48a2640 1 -- 172.21.15.96:0/1857928669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea00094d0 con 0x7f4eb00c4b50 2024-04-18T05:00:02.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb48a2640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eb00c4b50 0x7f4eb00bca40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ea001d3c0 tx=0x7f4ea001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4ea5ffb640 1 -- 172.21.15.96:0/1857928669 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00ba600 con 0x7f4eb00c4b50 2024-04-18T05:00:02.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4ea5ffb640 1 -- 172.21.15.96:0/1857928669 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea00ba780 con 0x7f4eb00c4b50 2024-04-18T05:00:02.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 -- 172.21.15.96:0/1857928669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb0154b10 con 0x7f4eb00c4b50 2024-04-18T05:00:02.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4ea5ffb640 1 -- 172.21.15.96:0/1857928669 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00bab30 con 0x7f4eb00c4b50 2024-04-18T05:00:02.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 -- 172.21.15.96:0/1857928669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb00c7430 con 0x7f4eb00c4b50 2024-04-18T05:00:02.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb0154ca0 0x7f4eb01ef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb7307640 1 -- 172.21.15.96:0/1857928669 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb00c1f90 con 0x7f4eb0154ca0 2024-04-18T05:00:02.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.755+0000 7f4eb50a3640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb0154ca0 0x7f4eb01ef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.759+0000 7f4ea5ffb640 1 -- 172.21.15.96:0/1857928669 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4ea00bac90 con 0x7f4eb00c4b50 2024-04-18T05:00:02.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.759+0000 7f4eb50a3640 1 -- 172.21.15.96:0/1857928669 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4eb00c1cb0 con 0x7f4eb0154ca0 2024-04-18T05:00:02.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.759+0000 7f4ea5ffb640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4e94066690 0x7f4e94068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.759+0000 7f4eb58a4640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4e94066690 0x7f4e94068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.759+0000 7f4ea5ffb640 1 -- 172.21.15.96:0/1857928669 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4ea0122870 con 0x7f4eb00c4b50 2024-04-18T05:00:02.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.759+0000 7f4eb50a3640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb0154ca0 0x7f4eb01ef9f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00e7a0 tx=0x7f4eac00ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.759+0000 7f4ea5ffb640 1 -- 172.21.15.96:0/1857928669 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac00ee50 con 0x7f4eb0154ca0 2024-04-18T05:00:02.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.759+0000 7f4eb58a4640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4e94066690 0x7f4e94068b50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0158170 tx=0x7f4ea80074b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.759+0000 7f4ea5ffb640 1 -- 172.21.15.96:0/1857928669 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f4eac004020 con 0x7f4eb0154ca0 2024-04-18T05:00:02.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.759+0000 7f4ea5ffb640 1 -- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb0154ca0 msgr2=0x7f4eb01ef9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.759+0000 7f4ea5ffb640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb0154ca0 0x7f4eb01ef9f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00e7a0 tx=0x7f4eac00ec60 comp rx=0 tx=0).stop 2024-04-18T05:00:02.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.759+0000 7f4ea5ffb640 1 -- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb0154ca0 msgr2=0x7f4eb01ef9f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T05:00:02.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.759+0000 7f4ea5ffb640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb0154ca0 0x7f4eb01ef9f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4eb7307640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb01e3af0 0x7f4eb01eba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4eb7307640 1 -- 172.21.15.96:0/1857928669 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb00c57a0 con 0x7f4eb01e3af0 2024-04-18T05:00:02.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4eb50a3640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb01e3af0 0x7f4eb01eba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4eb50a3640 1 -- 172.21.15.96:0/1857928669 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4eb006ed70 con 0x7f4eb01e3af0 2024-04-18T05:00:02.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4eb50a3640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb01e3af0 0x7f4eb01eba60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00e7a0 tx=0x7f4eac0046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4ea5ffb640 1 -- 172.21.15.96:0/1857928669 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac00aee0 con 0x7f4eb01e3af0 2024-04-18T05:00:02.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4ea5ffb640 1 -- 172.21.15.96:0/1857928669 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f4eac01f4c0 con 0x7f4eb01e3af0 2024-04-18T05:00:02.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4ea5ffb640 1 -- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb01e3af0 msgr2=0x7f4eb01eba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4ea5ffb640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb01e3af0 0x7f4eb01eba60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00e7a0 tx=0x7f4eac0046d0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4ea5ffb640 1 -- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb01e3af0 msgr2=0x7f4eb01eba60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T05:00:02.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4ea5ffb640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4eb01e3af0 0x7f4eb01eba60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.772 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T05:00:02.772 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T05:00:02.772 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T05:00:02.772 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T05:00:02.772 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 52, 2024-04-18T05:00:02.772 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T05:00:02.772 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T05:00:02.772 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T05:00:02.772 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T05:00:02.772 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:02.772 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 16, 2024-04-18T05:00:02.772 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T05:00:02.773 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T05:00:02.773 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T05:00:02.773 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:02.773 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:02.773 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:02.773 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:02.773 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:02.773 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:02.773 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:02.773 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:02.773 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:02.773 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:02.773 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:02.773 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T05:00:02.773 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T05:00:02.774 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:02.774 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:02.774 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:02.774 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:02.774 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:02.774 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:02.774 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:02.774 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:02.774 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:02.774 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:02.774 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.774 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T05:00:02.774 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T05:00:02.775 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T05:00:02.775 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T05:00:02.775 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T05:00:02.775 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T05:00:02.775 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T05:00:02.775 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T05:00:02.775 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T05:00:02.775 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T05:00:02.775 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T05:00:02.775 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T05:00:02.775 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T05:00:02.775 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T05:00:02.775 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T05:00:02.775 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T05:00:02.776 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T05:00:02.776 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:02.776 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:02.776 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:02.776 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:02.776 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:02.776 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:02.776 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:02.776 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:02.776 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:02.776 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:02.776 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:02.776 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T05:00:02.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.777 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T05:00:02.777 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.777 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T05:00:02.777 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T05:00:02.777 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:02.777 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:02.777 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.777 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:02.777 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T05:00:02.777 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.777 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.777 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:02.777 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T05:00:02.778 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.778 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.778 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.778 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T05:00:02.778 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T05:00:02.778 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:02.778 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:02.778 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:02.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.778 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.778 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T05:00:02.778 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T05:00:02.779 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:02.779 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:02.779 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.779 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:02.779 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T05:00:02.779 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.779 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.779 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:02.779 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T05:00:02.779 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.779 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.779 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.779 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T05:00:02.779 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T05:00:02.780 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:02.780 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:02.780 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:02.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.780 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T05:00:02.780 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T05:00:02.780 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:02.780 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:02.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.780 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:02.780 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T05:00:02.780 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.781 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.781 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:02.781 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T05:00:02.781 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:02.781 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.781 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.781 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T05:00:02.781 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T05:00:02.781 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:02.781 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:02.781 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:02.781 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.781 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.782 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T05:00:02.782 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T05:00:02.782 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.782 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:02.782 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:02.782 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T05:00:02.782 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.782 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:02.782 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T05:00:02.782 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:02.782 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:02.782 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:02.782 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T05:00:02.783 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:02.783 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:02.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:02.783 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T05:00:02.783 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T05:00:02.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4eb7307640 1 -- 172.21.15.96:0/1857928669 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4e94066690 msgr2=0x7f4e94068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4eb7307640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4e94066690 0x7f4e94068b50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0158170 tx=0x7f4ea80074b0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4eb7307640 1 -- 172.21.15.96:0/1857928669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eb00c4b50 msgr2=0x7f4eb00bca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4eb7307640 1 --2- 172.21.15.96:0/1857928669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4eb00c4b50 0x7f4eb00bca40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ea001d3c0 tx=0x7f4ea001bab0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4eb58a4640 1 -- 172.21.15.96:0/1857928669 reap_dead start 2024-04-18T05:00:02.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4eb58a4640 1 -- 172.21.15.96:0/1857928669 reap_dead start 2024-04-18T05:00:02.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4eb7307640 1 -- 172.21.15.96:0/1857928669 shutdown_connections 2024-04-18T05:00:02.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4eb7307640 1 -- 172.21.15.96:0/1857928669 >> 172.21.15.96:0/1857928669 conn(0x7f4eb006e020 msgr2=0x7f4eb006acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:02.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4eb7307640 1 -- 172.21.15.96:0/1857928669 shutdown_connections 2024-04-18T05:00:02.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.767+0000 7f4eb7307640 1 -- 172.21.15.96:0/1857928669 wait complete. 2024-04-18T05:00:02.788 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T05:00:02.788 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-04-18T05:00:02.788 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-18T05:00:02.788 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-04-18T05:00:02.788 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-18T05:00:02.788 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-18T05:00:02.789 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:00:02.809 INFO:tasks.ceph.mon.c:Stopped 2024-04-18T05:00:02.809 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-18T05:00:02.809 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T05:00:02.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25e08cd640 1 Processor -- start 2024-04-18T05:00:02.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25e08cd640 1 -- start start 2024-04-18T05:00:02.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25e08cd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f25dc1590f0 0x7f25dc159500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25e08cd640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25dc0c9e50 con 0x7f25dc070f70 2024-04-18T05:00:02.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25e08cd640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25dc0ca130 con 0x7f25dc1530f0 2024-04-18T05:00:02.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25e08cd640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25dc0713e0 con 0x7f25dc1590f0 2024-04-18T05:00:02.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d3fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f25dc070f70 0x7f25dc06f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:41636/0 (socket says 172.21.15.96:41636) 2024-04-18T05:00:02.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d3fff640 1 -- 172.21.15.96:0/1174663842 learned_addr learned my addr 172.21.15.96:0/1174663842 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:00:02.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25dad9d640 1 --2- 172.21.15.96:0/1174663842 >> v2:172.21.15.139:3300/0 conn(0x7f25dc1590f0 0x7f25dc159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d9d9b640 1 -- 172.21.15.96:0/1174663842 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046985932 0 0) 0x7f25dc0c9e50 con 0x7f25dc070f70 2024-04-18T05:00:02.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d9d9b640 1 -- 172.21.15.96:0/1174663842 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25c8003530 con 0x7f25dc070f70 2024-04-18T05:00:02.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d9d9b640 1 -- 172.21.15.96:0/1174663842 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3616489338 0 0) 0x7f25c8003530 con 0x7f25dc070f70 2024-04-18T05:00:02.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d9d9b640 1 -- 172.21.15.96:0/1174663842 >> v2:172.21.15.139:3300/0 conn(0x7f25dc1590f0 msgr2=0x7f25dc159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:02.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d9d9b640 1 --2- 172.21.15.96:0/1174663842 >> v2:172.21.15.139:3300/0 conn(0x7f25dc1590f0 0x7f25dc159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d9d9b640 1 -- 172.21.15.96:0/1174663842 >> v1:172.21.15.139:6789/0 conn(0x7f25dc1530f0 legacy=0x7f25dc071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d9d9b640 1 -- 172.21.15.96:0/1174663842 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc0ca410 con 0x7f25dc070f70 2024-04-18T05:00:02.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d9d9b640 1 -- 172.21.15.96:0/1174663842 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f25c4001680 con 0x7f25dc070f70 2024-04-18T05:00:02.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d9d9b640 1 -- 172.21.15.96:0/1174663842 >> v1:172.21.15.96:6789/0 conn(0x7f25dc070f70 legacy=0x7f25dc06f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d9d9b640 1 --2- 172.21.15.96:0/1174663842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c8003980 0x7f25c8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d9d9b640 1 --2- 172.21.15.96:0/1174663842 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25c80047d0 0x7f25c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d9d9b640 1 --2- 172.21.15.96:0/1174663842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25c8005190 0x7f25c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d9d9b640 1 -- 172.21.15.96:0/1174663842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc0713e0 con 0x7f25c8003980 2024-04-18T05:00:02.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d9d9b640 1 -- 172.21.15.96:0/1174663842 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c800c130 con 0x7f25c8005190 2024-04-18T05:00:02.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.919+0000 7f25d9d9b640 1 -- 172.21.15.96:0/1174663842 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c800c2f0 con 0x7f25c80047d0 2024-04-18T05:00:02.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25d3fff640 1 -- 172.21.15.96:0/1174663842 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25c80047d0 msgr2=0x7f25c8004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T05:00:02.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25da59c640 1 --2- 172.21.15.96:0/1174663842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c8003980 0x7f25c8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25d3fff640 1 --2- 172.21.15.96:0/1174663842 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25c80047d0 0x7f25c8004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:02.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25dad9d640 1 --2- 172.21.15.96:0/1174663842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25c8005190 0x7f25c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25da59c640 1 -- 172.21.15.96:0/1174663842 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25c80047d0 msgr2=0x7f25c8004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T05:00:02.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25da59c640 1 --2- 172.21.15.96:0/1174663842 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25c80047d0 0x7f25c8004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25da59c640 1 -- 172.21.15.96:0/1174663842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25c8005190 msgr2=0x7f25c800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:02.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25da59c640 1 --2- 172.21.15.96:0/1174663842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25c8005190 0x7f25c800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25da59c640 1 -- 172.21.15.96:0/1174663842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c8003530 con 0x7f25c8003980 2024-04-18T05:00:02.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25dad9d640 1 -- 172.21.15.96:0/1174663842 reap_dead start 2024-04-18T05:00:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25da59c640 1 --2- 172.21.15.96:0/1174663842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c8003980 0x7f25c8003da0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f25cc001780 tx=0x7f25cc01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7390232aa9aaa891 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25d9d9b640 1 -- 172.21.15.96:0/1174663842 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0052d0 con 0x7f25c8003980 2024-04-18T05:00:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25d9d9b640 1 -- 172.21.15.96:0/1174663842 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25cc0a7050 con 0x7f25c8003980 2024-04-18T05:00:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25d9d9b640 1 -- 172.21.15.96:0/1174663842 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc003600 con 0x7f25c8003980 2024-04-18T05:00:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25e08cd640 1 -- 172.21.15.96:0/1174663842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c8003980 msgr2=0x7f25c8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25e08cd640 1 --2- 172.21.15.96:0/1174663842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c8003980 0x7f25c8003da0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f25cc001780 tx=0x7f25cc01c3d0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25e08cd640 1 -- 172.21.15.96:0/1174663842 shutdown_connections 2024-04-18T05:00:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25e08cd640 1 --2- 172.21.15.96:0/1174663842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c8003980 0x7f25c8003da0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25e08cd640 1 -- 172.21.15.96:0/1174663842 >> 172.21.15.96:0/1174663842 conn(0x7f25dc06af70 msgr2=0x7f25dc06b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25e08cd640 1 -- 172.21.15.96:0/1174663842 shutdown_connections 2024-04-18T05:00:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.923+0000 7f25e08cd640 1 -- 172.21.15.96:0/1174663842 wait complete. 2024-04-18T05:00:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25e08cd640 1 Processor -- start 2024-04-18T05:00:02.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25e08cd640 1 -- start start 2024-04-18T05:00:02.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25e08cd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c8003980 0x7f25dc0c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25e08cd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25dc143a20 0x7f25dc143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25e08cd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25dc157700 0x7f25dc157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25e08cd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc14a4c0 con 0x7f25c8003980 2024-04-18T05:00:02.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25e08cd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc142810 con 0x7f25dc157700 2024-04-18T05:00:02.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25e08cd640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc1580c0 con 0x7f25dc143a20 2024-04-18T05:00:02.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25d3fff640 1 -- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25dc143a20 msgr2=0x7f25dc143e80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T05:00:02.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25d3fff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25dc143a20 0x7f25dc143e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:02.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25da59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c8003980 0x7f25dc0c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25da59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c8003980 0x7f25dc0c4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56848/0 (socket says 172.21.15.96:56848) 2024-04-18T05:00:02.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25da59c640 1 -- 172.21.15.96:0/1060013090 learned_addr learned my addr 172.21.15.96:0/1060013090 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:02.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25dad9d640 1 --2- 172.21.15.96:0/1060013090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25dc157700 0x7f25dc157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25da59c640 1 -- 172.21.15.96:0/1060013090 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25dc143a20 msgr2=0x7f25dc143e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T05:00:02.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25da59c640 1 --2- 172.21.15.96:0/1060013090 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25dc143a20 0x7f25dc143e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25da59c640 1 -- 172.21.15.96:0/1060013090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25dc157700 msgr2=0x7f25dc157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:02.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25da59c640 1 --2- 172.21.15.96:0/1060013090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25dc157700 0x7f25dc157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:02.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25da59c640 1 -- 172.21.15.96:0/1060013090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc141f70 con 0x7f25c8003980 2024-04-18T05:00:02.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25da59c640 1 --2- 172.21.15.96:0/1060013090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c8003980 0x7f25dc0c4f50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f25cc005040 tx=0x7f25c8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25d2ffd640 1 -- 172.21.15.96:0/1060013090 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc007100 con 0x7f25c8003980 2024-04-18T05:00:02.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25d2ffd640 1 -- 172.21.15.96:0/1060013090 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25cc007260 con 0x7f25c8003980 2024-04-18T05:00:02.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25d2ffd640 1 -- 172.21.15.96:0/1060013090 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0075f0 con 0x7f25c8003980 2024-04-18T05:00:02.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25e08cd640 1 -- 172.21.15.96:0/1060013090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25dc142250 con 0x7f25c8003980 2024-04-18T05:00:02.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25e08cd640 1 -- 172.21.15.96:0/1060013090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25dc156f00 con 0x7f25c8003980 2024-04-18T05:00:02.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25e08cd640 1 -- 172.21.15.96:0/1060013090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25dc067050 con 0x7f25c8003980 2024-04-18T05:00:02.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.927+0000 7f25d2ffd640 1 -- 172.21.15.96:0/1060013090 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f25cc0067e0 con 0x7f25c8003980 2024-04-18T05:00:02.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.931+0000 7f25d2ffd640 1 --2- 172.21.15.96:0/1060013090 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f25bc066640 0x7f25bc068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:02.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.931+0000 7f25d3fff640 1 --2- 172.21.15.96:0/1060013090 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f25bc066640 0x7f25bc068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:02.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.931+0000 7f25d2ffd640 1 -- 172.21.15.96:0/1060013090 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f25cc11e440 con 0x7f25c8003980 2024-04-18T05:00:02.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.931+0000 7f25d3fff640 1 --2- 172.21.15.96:0/1060013090 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f25bc066640 0x7f25bc068b00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0c3260 tx=0x7f25c4001650 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:02.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:02.935+0000 7f25d2ffd640 1 -- 172.21.15.96:0/1060013090 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f25cc0eb8b0 con 0x7f25c8003980 2024-04-18T05:00:03.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:03.175+0000 7f25e08cd640 1 -- 172.21.15.96:0/1060013090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f25dc071ab0 con 0x7f25c8003980 2024-04-18T05:00:03.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:03.179+0000 7f25d2ffd640 1 -- 172.21.15.96:0/1060013090 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f25cc0eeed0 con 0x7f25c8003980 2024-04-18T05:00:03.180 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T05:00:03.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:03.179+0000 7f25e08cd640 1 -- 172.21.15.96:0/1060013090 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f25bc066640 msgr2=0x7f25bc068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:03.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:03.179+0000 7f25e08cd640 1 --2- 172.21.15.96:0/1060013090 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f25bc066640 0x7f25bc068b00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0c3260 tx=0x7f25c4001650 comp rx=0 tx=0).stop 2024-04-18T05:00:03.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:03.179+0000 7f25e08cd640 1 -- 172.21.15.96:0/1060013090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c8003980 msgr2=0x7f25dc0c4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:03.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:03.179+0000 7f25e08cd640 1 --2- 172.21.15.96:0/1060013090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c8003980 0x7f25dc0c4f50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f25cc005040 tx=0x7f25c8005800 comp rx=0 tx=0).stop 2024-04-18T05:00:03.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:03.179+0000 7f25e08cd640 1 -- 172.21.15.96:0/1060013090 shutdown_connections 2024-04-18T05:00:03.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:03.179+0000 7f25e08cd640 1 --2- 172.21.15.96:0/1060013090 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f25bc066640 0x7f25bc068b00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:03.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:03.179+0000 7f25e08cd640 1 --2- 172.21.15.96:0/1060013090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25dc157700 0x7f25dc157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:03.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:03.179+0000 7f25e08cd640 1 --2- 172.21.15.96:0/1060013090 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25dc143a20 0x7f25dc143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:03.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:03.179+0000 7f25e08cd640 1 --2- 172.21.15.96:0/1060013090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c8003980 0x7f25dc0c4f50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:03.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:03.179+0000 7f25e08cd640 1 -- 172.21.15.96:0/1060013090 >> 172.21.15.96:0/1060013090 conn(0x7f25dc06af70 msgr2=0x7f25dc14e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:03.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:03.179+0000 7f25e08cd640 1 -- 172.21.15.96:0/1060013090 shutdown_connections 2024-04-18T05:00:03.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:03.179+0000 7f25e08cd640 1 -- 172.21.15.96:0/1060013090 wait complete. 2024-04-18T05:00:03.567 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-18T05:00:03.567 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-18T05:00:03.878 DEBUG:teuthology.parallel:result is None 2024-04-18T05:00:03.879 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-18T05:00:03.909 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-18T05:00:03.909 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-04-18T05:00:03.919 INFO:tasks.mon_thrash:joining mon_thrasher 2024-04-18T05:00:06.198 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T05:00:06.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd46058e640 1 Processor -- start 2024-04-18T05:00:06.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd46058e640 1 -- start start 2024-04-18T05:00:06.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd46058e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd45815dee0 0x7fd4580ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:06.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd46058e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd4580ca840 0x7fd45815ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:06.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd46058e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4581609c0 con 0x7fd4581578e0 2024-04-18T05:00:06.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd46058e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45815e8c0 con 0x7fd4580ca840 2024-04-18T05:00:06.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd46058e640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd458160c20 con 0x7fd45815dee0 2024-04-18T05:00:06.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd45e32a640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd4581578e0 0x7fd4580c5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:41652/0 (socket says 172.21.15.96:41652) 2024-04-18T05:00:06.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd45e32a640 1 -- 172.21.15.96:0/3823583239 learned_addr learned my addr 172.21.15.96:0/3823583239 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:00:06.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd45eb2b640 1 --2- 172.21.15.96:0/3823583239 >> v2:172.21.15.96:3300/0 conn(0x7fd4580ca840 0x7fd45815ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:06.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd45d328640 1 -- 172.21.15.96:0/3823583239 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977148169 0 0) 0x7fd4581609c0 con 0x7fd4581578e0 2024-04-18T05:00:06.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd45d328640 1 -- 172.21.15.96:0/3823583239 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd444003530 con 0x7fd4581578e0 2024-04-18T05:00:06.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd45db29640 1 --2- 172.21.15.96:0/3823583239 >> v2:172.21.15.139:3300/0 conn(0x7fd45815dee0 0x7fd4580ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:06.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd45eb2b640 1 -- 172.21.15.96:0/3823583239 >> v2:172.21.15.139:3300/0 conn(0x7fd45815dee0 msgr2=0x7fd4580ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:06.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd45eb2b640 1 --2- 172.21.15.96:0/3823583239 >> v2:172.21.15.139:3300/0 conn(0x7fd45815dee0 0x7fd4580ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:06.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd45eb2b640 1 -- 172.21.15.96:0/3823583239 >> v1:172.21.15.96:6789/0 conn(0x7fd4581578e0 legacy=0x7fd4580c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:06.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.327+0000 7fd45eb2b640 1 -- 172.21.15.96:0/3823583239 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd458160ee0 con 0x7fd4580ca840 2024-04-18T05:00:06.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.331+0000 7fd45eb2b640 1 --2- 172.21.15.96:0/3823583239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4580ca840 0x7fd45815ed10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd4580723a0 tx=0x7fd45001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba673b08b50f77ff server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:06.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.331+0000 7fd45d328640 1 -- 172.21.15.96:0/3823583239 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4500a59c0 con 0x7fd4580ca840 2024-04-18T05:00:06.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.331+0000 7fd45d328640 1 -- 172.21.15.96:0/3823583239 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4500a5b20 con 0x7fd4580ca840 2024-04-18T05:00:06.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.331+0000 7fd45d328640 1 -- 172.21.15.96:0/3823583239 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4500ad440 con 0x7fd4580ca840 2024-04-18T05:00:06.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.331+0000 7fd46058e640 1 -- 172.21.15.96:0/3823583239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4580ca840 msgr2=0x7fd45815ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:06.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.331+0000 7fd46058e640 1 --2- 172.21.15.96:0/3823583239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4580ca840 0x7fd45815ed10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd4580723a0 tx=0x7fd45001c900 comp rx=0 tx=0).stop 2024-04-18T05:00:06.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.331+0000 7fd46058e640 1 -- 172.21.15.96:0/3823583239 shutdown_connections 2024-04-18T05:00:06.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.331+0000 7fd46058e640 1 --2- 172.21.15.96:0/3823583239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4580ca840 0x7fd45815ed10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:06.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.331+0000 7fd46058e640 1 --2- 172.21.15.96:0/3823583239 >> v2:172.21.15.139:3300/0 conn(0x7fd45815dee0 0x7fd4580ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:06.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.331+0000 7fd46058e640 1 -- 172.21.15.96:0/3823583239 >> 172.21.15.96:0/3823583239 conn(0x7fd45806c750 msgr2=0x7fd4580c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:06.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.331+0000 7fd46058e640 1 -- 172.21.15.96:0/3823583239 shutdown_connections 2024-04-18T05:00:06.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.331+0000 7fd46058e640 1 -- 172.21.15.96:0/3823583239 wait complete. 2024-04-18T05:00:06.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd46058e640 1 Processor -- start 2024-04-18T05:00:06.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd46058e640 1 -- start start 2024-04-18T05:00:06.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd46058e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4580ca840 0x7fd458151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:06.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd46058e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4581578e0 0x7fd45814db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:06.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd46058e640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd45815dee0 0x7fd4580c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:06.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd46058e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4581f9370 con 0x7fd4580ca840 2024-04-18T05:00:06.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd46058e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd458159e90 con 0x7fd4581578e0 2024-04-18T05:00:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd46058e640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd458151ff0 con 0x7fd45815dee0 2024-04-18T05:00:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd45e32a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4580ca840 0x7fd458151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd45e32a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4580ca840 0x7fd458151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56874/0 (socket says 172.21.15.96:56874) 2024-04-18T05:00:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd45e32a640 1 -- 172.21.15.96:0/2002453766 learned_addr learned my addr 172.21.15.96:0/2002453766 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd45eb2b640 1 -- 172.21.15.96:0/2002453766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd45815dee0 msgr2=0x7fd4580c3a00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T05:00:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd45eb2b640 1 --2- 172.21.15.96:0/2002453766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd45815dee0 0x7fd4580c3a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd45db29640 1 --2- 172.21.15.96:0/2002453766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4581578e0 0x7fd45814db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd45e32a640 1 -- 172.21.15.96:0/2002453766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd45815dee0 msgr2=0x7fd4580c3a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T05:00:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd45e32a640 1 --2- 172.21.15.96:0/2002453766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd45815dee0 0x7fd4580c3a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd45e32a640 1 -- 172.21.15.96:0/2002453766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4581578e0 msgr2=0x7fd45814db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd45e32a640 1 --2- 172.21.15.96:0/2002453766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4581578e0 0x7fd45814db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd45e32a640 1 -- 172.21.15.96:0/2002453766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd450009a70 con 0x7fd4580ca840 2024-04-18T05:00:06.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd45e32a640 1 --2- 172.21.15.96:0/2002453766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4580ca840 0x7fd458151960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd45400c420 tx=0x7fd45400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:06.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd44effd640 1 -- 172.21.15.96:0/2002453766 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454005cf0 con 0x7fd4580ca840 2024-04-18T05:00:06.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd44effd640 1 -- 172.21.15.96:0/2002453766 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd454005e50 con 0x7fd4580ca840 2024-04-18T05:00:06.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd44effd640 1 -- 172.21.15.96:0/2002453766 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540072d0 con 0x7fd4580ca840 2024-04-18T05:00:06.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd46058e640 1 -- 172.21.15.96:0/2002453766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4581f9580 con 0x7fd4580ca840 2024-04-18T05:00:06.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd46058e640 1 -- 172.21.15.96:0/2002453766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4581f9b40 con 0x7fd4580ca840 2024-04-18T05:00:06.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd46058e640 1 -- 172.21.15.96:0/2002453766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd458067050 con 0x7fd4580ca840 2024-04-18T05:00:06.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd44effd640 1 -- 172.21.15.96:0/2002453766 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd454007430 con 0x7fd4580ca840 2024-04-18T05:00:06.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd44effd640 1 --2- 172.21.15.96:0/2002453766 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd43c066670 0x7fd43c068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:06.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd44effd640 1 -- 172.21.15.96:0/2002453766 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd454083310 con 0x7fd4580ca840 2024-04-18T05:00:06.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.335+0000 7fd45db29640 1 --2- 172.21.15.96:0/2002453766 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd43c066670 0x7fd43c068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:06.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.339+0000 7fd45db29640 1 --2- 172.21.15.96:0/2002453766 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd43c066670 0x7fd43c068b30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd4580c62b0 tx=0x7fd448008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:06.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.343+0000 7fd44effd640 1 -- 172.21.15.96:0/2002453766 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd454054260 con 0x7fd4580ca840 2024-04-18T05:00:06.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.559+0000 7fd46058e640 1 -- 172.21.15.96:0/2002453766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd45815d670 con 0x7fd4580ca840 2024-04-18T05:00:06.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.563+0000 7fd44effd640 1 -- 172.21.15.96:0/2002453766 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fd454017620 con 0x7fd4580ca840 2024-04-18T05:00:06.565 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T05:00:06.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.563+0000 7fd46058e640 1 -- 172.21.15.96:0/2002453766 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd43c066670 msgr2=0x7fd43c068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:06.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.563+0000 7fd46058e640 1 --2- 172.21.15.96:0/2002453766 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd43c066670 0x7fd43c068b30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd4580c62b0 tx=0x7fd448008040 comp rx=0 tx=0).stop 2024-04-18T05:00:06.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.563+0000 7fd46058e640 1 -- 172.21.15.96:0/2002453766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4580ca840 msgr2=0x7fd458151960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:06.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.563+0000 7fd46058e640 1 --2- 172.21.15.96:0/2002453766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4580ca840 0x7fd458151960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd45400c420 tx=0x7fd45400c8e0 comp rx=0 tx=0).stop 2024-04-18T05:00:06.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.563+0000 7fd46058e640 1 -- 172.21.15.96:0/2002453766 shutdown_connections 2024-04-18T05:00:06.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.563+0000 7fd46058e640 1 --2- 172.21.15.96:0/2002453766 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd43c066670 0x7fd43c068b30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:06.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.563+0000 7fd46058e640 1 --2- 172.21.15.96:0/2002453766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd45815dee0 0x7fd4580c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:06.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.563+0000 7fd46058e640 1 --2- 172.21.15.96:0/2002453766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4581578e0 0x7fd45814db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:06.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.563+0000 7fd46058e640 1 --2- 172.21.15.96:0/2002453766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4580ca840 0x7fd458151960 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:06.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.563+0000 7fd46058e640 1 -- 172.21.15.96:0/2002453766 >> 172.21.15.96:0/2002453766 conn(0x7fd45806c750 msgr2=0x7fd4580c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:06.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.563+0000 7fd46058e640 1 -- 172.21.15.96:0/2002453766 shutdown_connections 2024-04-18T05:00:06.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:06.563+0000 7fd46058e640 1 -- 172.21.15.96:0/2002453766 wait complete. 2024-04-18T05:00:09.585 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T05:00:09.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.719+0000 7f8583229640 1 Processor -- start 2024-04-18T05:00:09.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.719+0000 7f8583229640 1 -- start start 2024-04-18T05:00:09.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f8583229640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f857c153180 0x7f857c159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:09.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f8583229640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f857c0700e0 0x7f857c0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:09.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f8583229640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857c159700 con 0x7f857c15c580 2024-04-18T05:00:09.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f8583229640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857c0c6390 con 0x7f857c0700e0 2024-04-18T05:00:09.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f8583229640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857c15cf80 con 0x7f857c153180 2024-04-18T05:00:09.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f857bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f857c0700e0 0x7f857c0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:09.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f857bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f857c0700e0 0x7f857c0707c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33364/0 (socket says 172.21.15.96:33364) 2024-04-18T05:00:09.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f857bfff640 1 -- 172.21.15.96:0/2001897773 learned_addr learned my addr 172.21.15.96:0/2001897773 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:09.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f8580fc5640 1 --2- 172.21.15.96:0/2001897773 >> v2:172.21.15.139:3300/0 conn(0x7f857c153180 0x7f857c159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:09.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f857bfff640 1 -- 172.21.15.96:0/2001897773 >> v2:172.21.15.139:3300/0 conn(0x7f857c153180 msgr2=0x7f857c159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:09.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f857bfff640 1 --2- 172.21.15.96:0/2001897773 >> v2:172.21.15.139:3300/0 conn(0x7f857c153180 0x7f857c159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:09.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f857bfff640 1 -- 172.21.15.96:0/2001897773 >> v1:172.21.15.139:6789/0 conn(0x7f857c15c580 legacy=0x7f857c0ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:09.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f857bfff640 1 -- 172.21.15.96:0/2001897773 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c15d220 con 0x7f857c0700e0 2024-04-18T05:00:09.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f857bfff640 1 --2- 172.21.15.96:0/2001897773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857c0700e0 0x7f857c0707c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f857c0c7cc0 tx=0x7f857001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd84f2967096d53 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:09.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f857b7fe640 1 -- 172.21.15.96:0/2001897773 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85700a89d0 con 0x7f857c0700e0 2024-04-18T05:00:09.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f857b7fe640 1 -- 172.21.15.96:0/2001897773 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85700a8b30 con 0x7f857c0700e0 2024-04-18T05:00:09.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f857b7fe640 1 -- 172.21.15.96:0/2001897773 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85700b0440 con 0x7f857c0700e0 2024-04-18T05:00:09.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f8583229640 1 -- 172.21.15.96:0/2001897773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857c0700e0 msgr2=0x7f857c0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:09.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f8583229640 1 --2- 172.21.15.96:0/2001897773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857c0700e0 0x7f857c0707c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f857c0c7cc0 tx=0x7f857001ecd0 comp rx=0 tx=0).stop 2024-04-18T05:00:09.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f8583229640 1 -- 172.21.15.96:0/2001897773 shutdown_connections 2024-04-18T05:00:09.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f8583229640 1 --2- 172.21.15.96:0/2001897773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857c0700e0 0x7f857c0707c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:09.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f8583229640 1 --2- 172.21.15.96:0/2001897773 >> v2:172.21.15.139:3300/0 conn(0x7f857c153180 0x7f857c159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:09.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f8583229640 1 -- 172.21.15.96:0/2001897773 >> 172.21.15.96:0/2001897773 conn(0x7f857c06c750 msgr2=0x7f857c0c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:09.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.723+0000 7f8583229640 1 -- 172.21.15.96:0/2001897773 shutdown_connections 2024-04-18T05:00:09.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f8583229640 1 -- 172.21.15.96:0/2001897773 wait complete. 2024-04-18T05:00:09.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f8583229640 1 Processor -- start 2024-04-18T05:00:09.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f8583229640 1 -- start start 2024-04-18T05:00:09.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f8583229640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f857c0700e0 0x7f857c0c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:09.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f8583229640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857c153180 0x7f857c15bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:09.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f8583229640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f857c15c580 0x7f857c15abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:09.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f8583229640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c1583d0 con 0x7f857c153180 2024-04-18T05:00:09.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f8583229640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c158060 con 0x7f857c0700e0 2024-04-18T05:00:09.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f8583229640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c158950 con 0x7f857c15c580 2024-04-18T05:00:09.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f857bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857c153180 0x7f857c15bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:09.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f857bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857c153180 0x7f857c15bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33366/0 (socket says 172.21.15.96:33366) 2024-04-18T05:00:09.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f857bfff640 1 -- 172.21.15.96:0/3130013144 learned_addr learned my addr 172.21.15.96:0/3130013144 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:09.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f85817c6640 1 -- 172.21.15.96:0/3130013144 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f857c15c580 msgr2=0x7f857c15abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T05:00:09.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f85817c6640 1 --2- 172.21.15.96:0/3130013144 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f857c15c580 0x7f857c15abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:09.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f8580fc5640 1 --2- 172.21.15.96:0/3130013144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f857c0700e0 0x7f857c0c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:09.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f857bfff640 1 -- 172.21.15.96:0/3130013144 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f857c15c580 msgr2=0x7f857c15abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T05:00:09.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f857bfff640 1 --2- 172.21.15.96:0/3130013144 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f857c15c580 0x7f857c15abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:09.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f857bfff640 1 -- 172.21.15.96:0/3130013144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f857c0700e0 msgr2=0x7f857c0c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:09.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f857bfff640 1 --2- 172.21.15.96:0/3130013144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f857c0700e0 0x7f857c0c3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:09.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f857bfff640 1 -- 172.21.15.96:0/3130013144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85700094d0 con 0x7f857c153180 2024-04-18T05:00:09.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f8580fc5640 1 --2- 172.21.15.96:0/3130013144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f857c0700e0 0x7f857c0c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:00:09.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f857bfff640 1 --2- 172.21.15.96:0/3130013144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857c153180 0x7f857c15bb70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f85700b3040 tx=0x7f857001ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:09.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f85797fa640 1 -- 172.21.15.96:0/3130013144 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85700ba600 con 0x7f857c153180 2024-04-18T05:00:09.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f85797fa640 1 -- 172.21.15.96:0/3130013144 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85700ba760 con 0x7f857c153180 2024-04-18T05:00:09.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f85797fa640 1 -- 172.21.15.96:0/3130013144 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85700bab10 con 0x7f857c153180 2024-04-18T05:00:09.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f8583229640 1 -- 172.21.15.96:0/3130013144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857c0c2f70 con 0x7f857c153180 2024-04-18T05:00:09.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f8583229640 1 -- 172.21.15.96:0/3130013144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857c0c29b0 con 0x7f857c153180 2024-04-18T05:00:09.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.727+0000 7f8583229640 1 -- 172.21.15.96:0/3130013144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857c067050 con 0x7f857c153180 2024-04-18T05:00:09.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.731+0000 7f85797fa640 1 -- 172.21.15.96:0/3130013144 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f85700bac70 con 0x7f857c153180 2024-04-18T05:00:09.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.731+0000 7f85797fa640 1 --2- 172.21.15.96:0/3130013144 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8568066670 0x7f8568068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:09.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.731+0000 7f85797fa640 1 -- 172.21.15.96:0/3130013144 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f85701226a0 con 0x7f857c153180 2024-04-18T05:00:09.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.731+0000 7f8580fc5640 1 --2- 172.21.15.96:0/3130013144 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8568066670 0x7f8568068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:09.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.731+0000 7f8580fc5640 1 --2- 172.21.15.96:0/3130013144 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8568066670 0x7f8568068b30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f856c009840 tx=0x7f856c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:09.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.735+0000 7f85797fa640 1 -- 172.21.15.96:0/3130013144 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f85700efa80 con 0x7f857c153180 2024-04-18T05:00:09.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.947+0000 7f8583229640 1 -- 172.21.15.96:0/3130013144 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f857c067050 con 0x7f857c153180 2024-04-18T05:00:09.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.947+0000 7f85797fa640 1 -- 172.21.15.96:0/3130013144 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f85700b5620 con 0x7f857c153180 2024-04-18T05:00:09.952 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T05:00:09.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.951+0000 7f8583229640 1 -- 172.21.15.96:0/3130013144 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8568066670 msgr2=0x7f8568068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:09.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.951+0000 7f8583229640 1 --2- 172.21.15.96:0/3130013144 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8568066670 0x7f8568068b30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f856c009840 tx=0x7f856c008040 comp rx=0 tx=0).stop 2024-04-18T05:00:09.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.951+0000 7f8583229640 1 -- 172.21.15.96:0/3130013144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857c153180 msgr2=0x7f857c15bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:09.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.951+0000 7f8583229640 1 --2- 172.21.15.96:0/3130013144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857c153180 0x7f857c15bb70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f85700b3040 tx=0x7f857001ba70 comp rx=0 tx=0).stop 2024-04-18T05:00:09.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.951+0000 7f8583229640 1 -- 172.21.15.96:0/3130013144 shutdown_connections 2024-04-18T05:00:09.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.951+0000 7f8583229640 1 --2- 172.21.15.96:0/3130013144 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8568066670 0x7f8568068b30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:09.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.951+0000 7f8583229640 1 --2- 172.21.15.96:0/3130013144 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f857c15c580 0x7f857c15abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:09.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.951+0000 7f8583229640 1 --2- 172.21.15.96:0/3130013144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857c153180 0x7f857c15bb70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:09.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.951+0000 7f8583229640 1 --2- 172.21.15.96:0/3130013144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f857c0700e0 0x7f857c0c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:09.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.951+0000 7f8583229640 1 -- 172.21.15.96:0/3130013144 >> 172.21.15.96:0/3130013144 conn(0x7f857c06c750 msgr2=0x7f857c06e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:09.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.951+0000 7f8583229640 1 -- 172.21.15.96:0/3130013144 shutdown_connections 2024-04-18T05:00:09.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:09.951+0000 7f8583229640 1 -- 172.21.15.96:0/3130013144 wait complete. 2024-04-18T05:00:12.971 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T05:00:13.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.099+0000 7f284c163640 1 Processor -- start 2024-04-18T05:00:13.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.099+0000 7f284c163640 1 -- start start 2024-04-18T05:00:13.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.099+0000 7f284c163640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 0x7f28440ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:13.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.099+0000 7f284c163640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 0x7f284415ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:13.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.099+0000 7f284c163640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284415b2c0 con 0x7f2844151210 2024-04-18T05:00:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.099+0000 7f284c163640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2844157150 con 0x7f284415a950 2024-04-18T05:00:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.099+0000 7f284c163640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2844157430 con 0x7f28440ca300 2024-04-18T05:00:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.099+0000 7f284a700640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 0x7f284415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.099+0000 7f2849eff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f2844151210 0x7f28440c1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54642/0 (socket says 172.21.15.96:54642) 2024-04-18T05:00:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.099+0000 7f2849eff640 1 -- 172.21.15.96:0/2390179146 learned_addr learned my addr 172.21.15.96:0/2390179146 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:00:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.099+0000 7f284a700640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 msgr2=0x7f284415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T05:00:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.099+0000 7f284a700640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 msgr2=0x7f284415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.099+0000 7f284a700640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 0x7f284415ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.099+0000 7f284a700640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 0x7f284415ad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.099+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 0x7f28440ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.103+0000 7f28496fe640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 msgr2=0x7f28440ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T05:00:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.103+0000 7f28496fe640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 msgr2=0x7f28440ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.103+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 0x7f28440ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:13.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.103+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 0x7f28440ca720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:13.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.303+0000 7f284a700640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 0x7f284415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:13.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.303+0000 7f284a700640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 msgr2=0x7f284415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T05:00:13.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.303+0000 7f284a700640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 msgr2=0x7f284415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:13.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.303+0000 7f284a700640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 0x7f284415ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:13.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.303+0000 7f284a700640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 0x7f284415ad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T05:00:13.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.307+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 0x7f28440ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:13.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.307+0000 7f28496fe640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 msgr2=0x7f28440ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T05:00:13.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.307+0000 7f28496fe640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 msgr2=0x7f28440ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:13.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.307+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 0x7f28440ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:13.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.307+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 0x7f28440ca720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T05:00:13.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.707+0000 7f284a700640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 0x7f284415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:13.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.707+0000 7f284a700640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 msgr2=0x7f284415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T05:00:13.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.707+0000 7f284a700640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 msgr2=0x7f284415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:13.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.707+0000 7f284a700640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 0x7f284415ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:13.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.707+0000 7f284a700640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 0x7f284415ad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T05:00:13.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.711+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 0x7f28440ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:13.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.711+0000 7f28496fe640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 msgr2=0x7f28440ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T05:00:13.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.711+0000 7f28496fe640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 msgr2=0x7f28440ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:13.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.711+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 0x7f28440ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:13.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:13.711+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 0x7f28440ca720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T05:00:14.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:14.511+0000 7f284a700640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 0x7f284415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:14.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:14.511+0000 7f284a700640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 msgr2=0x7f284415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T05:00:14.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:14.511+0000 7f284a700640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 msgr2=0x7f284415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:14.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:14.511+0000 7f284a700640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 0x7f284415ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:14.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:14.511+0000 7f284a700640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 0x7f284415ad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T05:00:14.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:14.515+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 0x7f28440ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:14.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:14.515+0000 7f28496fe640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 msgr2=0x7f28440ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T05:00:14.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:14.515+0000 7f28496fe640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 msgr2=0x7f28440ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:14.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:14.515+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 0x7f28440ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:14.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:14.515+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 0x7f28440ca720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T05:00:16.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:16.099+0000 7f283b7fe640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 msgr2=0x7f28440ca720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T05:00:16.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:16.099+0000 7f283b7fe640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.139:3300/0 conn(0x7f28440ca300 0x7f28440ca720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:16.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:16.099+0000 7f283b7fe640 1 -- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 msgr2=0x7f284415ad80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T05:00:16.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:16.099+0000 7f283b7fe640 1 --2- 172.21.15.96:0/2390179146 >> v2:172.21.15.96:3300/0 conn(0x7f284415a950 0x7f284415ad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:16.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:16.099+0000 7f283b7fe640 1 -- 172.21.15.96:0/2390179146 >> v1:172.21.15.96:6789/0 conn(0x7f2844151210 legacy=0x7f28440c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:16.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:16.099+0000 7f283b7fe640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2828007360 0x7f2828009820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:16.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:16.099+0000 7f283b7fe640 1 -- 172.21.15.96:0/2390179146 --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2844157710 con 0x7f28280036a0 2024-04-18T05:00:16.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:16.099+0000 7f283b7fe640 1 -- 172.21.15.96:0/2390179146 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2844157150 con 0x7f2828007360 2024-04-18T05:00:16.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:16.103+0000 7f28496fe640 1 -- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2828007360 msgr2=0x7f2828009820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T05:00:16.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:16.103+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2828007360 0x7f2828009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:16.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:16.307+0000 7f28496fe640 1 -- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2828007360 msgr2=0x7f2828009820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T05:00:16.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:16.307+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2828007360 0x7f2828009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T05:00:16.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:16.711+0000 7f28496fe640 1 -- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2828007360 msgr2=0x7f2828009820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T05:00:16.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:16.711+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2828007360 0x7f2828009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T05:00:17.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.027+0000 7f2848efd640 1 -- 172.21.15.96:0/2390179146 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364880908 0 0) 0x7f2844157710 con 0x7f28280036a0 2024-04-18T05:00:17.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.027+0000 7f2848efd640 1 -- 172.21.15.96:0/2390179146 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2830003530 con 0x7f28280036a0 2024-04-18T05:00:17.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f2848efd640 1 -- 172.21.15.96:0/2390179146 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1003133420 0 0) 0x7f2830003530 con 0x7f28280036a0 2024-04-18T05:00:17.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f2848efd640 1 -- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2828007360 msgr2=0x7f2828009820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T05:00:17.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f2848efd640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2828007360 0x7f2828009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f2848efd640 1 -- 172.21.15.96:0/2390179146 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282800b040 con 0x7f28280036a0 2024-04-18T05:00:17.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f2848efd640 1 -- 172.21.15.96:0/2390179146 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f28400016c0 con 0x7f28280036a0 2024-04-18T05:00:17.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f2848efd640 1 -- 172.21.15.96:0/2390179146 >> v1:172.21.15.139:6789/0 conn(0x7f28280036a0 legacy=0x7f2828005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f284a700640 1 -- 172.21.15.96:0/2390179146 reap_dead start 2024-04-18T05:00:17.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f2848efd640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2830003980 0x7f2830003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f2848efd640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28300047d0 0x7f2830004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f2848efd640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28300052b0 0x7f283000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f2848efd640 1 -- 172.21.15.96:0/2390179146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2844157150 con 0x7f28300047d0 2024-04-18T05:00:17.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f2848efd640 1 -- 172.21.15.96:0/2390179146 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283000c200 con 0x7f2830003980 2024-04-18T05:00:17.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f2848efd640 1 -- 172.21.15.96:0/2390179146 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283000c3c0 con 0x7f28300052b0 2024-04-18T05:00:17.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f284a700640 1 -- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28300052b0 msgr2=0x7f283000b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T05:00:17.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f284a700640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28300052b0 0x7f283000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:17.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28300047d0 0x7f2830004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.039+0000 7f2849eff640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2830003980 0x7f2830003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.043+0000 7f28496fe640 1 -- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28300052b0 msgr2=0x7f283000b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T05:00:17.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.043+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28300052b0 0x7f283000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.043+0000 7f28496fe640 1 -- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2830003980 msgr2=0x7f2830003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:17.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.043+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2830003980 0x7f2830003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.043+0000 7f28496fe640 1 -- 172.21.15.96:0/2390179146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2830003530 con 0x7f28300047d0 2024-04-18T05:00:17.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.043+0000 7f2849eff640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2830003980 0x7f2830003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T05:00:17.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.043+0000 7f28496fe640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28300047d0 0x7f2830004c50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2834000ee0 tx=0x7f283401d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bda8b8a8295ec69 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:17.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.043+0000 7f2848efd640 1 -- 172.21.15.96:0/2390179146 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28340af410 con 0x7f28300047d0 2024-04-18T05:00:17.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.043+0000 7f2848efd640 1 -- 172.21.15.96:0/2390179146 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28340a9030 con 0x7f28300047d0 2024-04-18T05:00:17.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.043+0000 7f2848efd640 1 -- 172.21.15.96:0/2390179146 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28340af7d0 con 0x7f28300047d0 2024-04-18T05:00:17.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.047+0000 7f284c163640 1 -- 172.21.15.96:0/2390179146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28300047d0 msgr2=0x7f2830004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.047+0000 7f284c163640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28300047d0 0x7f2830004c50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2834000ee0 tx=0x7f283401d3b0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.047+0000 7f284c163640 1 -- 172.21.15.96:0/2390179146 shutdown_connections 2024-04-18T05:00:17.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.047+0000 7f284c163640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28300052b0 0x7f283000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.047+0000 7f284c163640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28300047d0 0x7f2830004c50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.047+0000 7f284c163640 1 --2- 172.21.15.96:0/2390179146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2830003980 0x7f2830003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.047+0000 7f284c163640 1 -- 172.21.15.96:0/2390179146 >> 172.21.15.96:0/2390179146 conn(0x7f284406c750 msgr2=0x7f28440c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:17.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.047+0000 7f284c163640 1 -- 172.21.15.96:0/2390179146 shutdown_connections 2024-04-18T05:00:17.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.047+0000 7f284c163640 1 -- 172.21.15.96:0/2390179146 wait complete. 2024-04-18T05:00:17.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.047+0000 7f284c163640 1 Processor -- start 2024-04-18T05:00:17.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.047+0000 7f284c163640 1 -- start start 2024-04-18T05:00:17.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f284c163640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2830003980 0x7f284414c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f284c163640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28300047d0 0x7f284414cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f284c163640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28300052b0 0x7f28441efc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f284c163640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2844141c70 con 0x7f2830003980 2024-04-18T05:00:17.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f284c163640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2844150750 con 0x7f28300047d0 2024-04-18T05:00:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f284c163640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28441ef440 con 0x7f28300052b0 2024-04-18T05:00:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f284a700640 1 -- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28300052b0 msgr2=0x7f28441efc70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T05:00:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f284a700640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28300052b0 0x7f28441efc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f2849eff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2830003980 0x7f284414c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f2849eff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2830003980 0x7f284414c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33408/0 (socket says 172.21.15.96:33408) 2024-04-18T05:00:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f2849eff640 1 -- 172.21.15.96:0/2493499417 learned_addr learned my addr 172.21.15.96:0/2493499417 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f28496fe640 1 --2- 172.21.15.96:0/2493499417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28300047d0 0x7f284414cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f2849eff640 1 -- 172.21.15.96:0/2493499417 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28300052b0 msgr2=0x7f28441efc70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T05:00:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f2849eff640 1 --2- 172.21.15.96:0/2493499417 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28300052b0 0x7f28441efc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f2849eff640 1 -- 172.21.15.96:0/2493499417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28300047d0 msgr2=0x7f284414cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f2849eff640 1 --2- 172.21.15.96:0/2493499417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28300047d0 0x7f284414cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f2849eff640 1 -- 172.21.15.96:0/2493499417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844147960 con 0x7f2830003980 2024-04-18T05:00:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f2849eff640 1 --2- 172.21.15.96:0/2493499417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2830003980 0x7f284414c6e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2840007310 tx=0x7f28400077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:17.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f283a7fc640 1 -- 172.21.15.96:0/2493499417 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000f960 con 0x7f2830003980 2024-04-18T05:00:17.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f283a7fc640 1 -- 172.21.15.96:0/2493499417 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284000fac0 con 0x7f2830003980 2024-04-18T05:00:17.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f283a7fc640 1 -- 172.21.15.96:0/2493499417 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000fe30 con 0x7f2830003980 2024-04-18T05:00:17.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f284c163640 1 -- 172.21.15.96:0/2493499417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2844150a50 con 0x7f2830003980 2024-04-18T05:00:17.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f284c163640 1 -- 172.21.15.96:0/2493499417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2844150470 con 0x7f2830003980 2024-04-18T05:00:17.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.051+0000 7f284c163640 1 -- 172.21.15.96:0/2493499417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2844067050 con 0x7f2830003980 2024-04-18T05:00:17.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.055+0000 7f283a7fc640 1 -- 172.21.15.96:0/2493499417 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f284001c410 con 0x7f2830003980 2024-04-18T05:00:17.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.055+0000 7f283a7fc640 1 --2- 172.21.15.96:0/2493499417 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2828069610 0x7f282806bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.055+0000 7f283a7fc640 1 -- 172.21.15.96:0/2493499417 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2840083e70 con 0x7f2830003980 2024-04-18T05:00:17.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.055+0000 7f28496fe640 1 --2- 172.21.15.96:0/2493499417 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2828069610 0x7f282806bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.055+0000 7f28496fe640 1 --2- 172.21.15.96:0/2493499417 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2828069610 0x7f282806bad0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f28340b1000 tx=0x7f2834004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:17.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.059+0000 7f283a7fc640 1 -- 172.21.15.96:0/2493499417 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2840051120 con 0x7f2830003980 2024-04-18T05:00:17.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.283+0000 7f284c163640 1 -- 172.21.15.96:0/2493499417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f284415a3d0 con 0x7f2830003980 2024-04-18T05:00:17.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.283+0000 7f283a7fc640 1 -- 172.21.15.96:0/2493499417 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f2840007c70 con 0x7f2830003980 2024-04-18T05:00:17.287 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":56,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T05:00:17.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.287+0000 7f284c163640 1 -- 172.21.15.96:0/2493499417 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2828069610 msgr2=0x7f282806bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.287+0000 7f284c163640 1 --2- 172.21.15.96:0/2493499417 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2828069610 0x7f282806bad0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f28340b1000 tx=0x7f2834004740 comp rx=0 tx=0).stop 2024-04-18T05:00:17.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.287+0000 7f284c163640 1 -- 172.21.15.96:0/2493499417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2830003980 msgr2=0x7f284414c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.287+0000 7f284c163640 1 --2- 172.21.15.96:0/2493499417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2830003980 0x7f284414c6e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2840007310 tx=0x7f28400077d0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.287+0000 7f284c163640 1 -- 172.21.15.96:0/2493499417 shutdown_connections 2024-04-18T05:00:17.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.287+0000 7f284c163640 1 --2- 172.21.15.96:0/2493499417 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2828069610 0x7f282806bad0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.287+0000 7f284c163640 1 --2- 172.21.15.96:0/2493499417 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f28300052b0 0x7f28441efc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.287+0000 7f284c163640 1 --2- 172.21.15.96:0/2493499417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28300047d0 0x7f284414cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.287+0000 7f284c163640 1 --2- 172.21.15.96:0/2493499417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2830003980 0x7f284414c6e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.287+0000 7f284c163640 1 -- 172.21.15.96:0/2493499417 >> 172.21.15.96:0/2493499417 conn(0x7f284406c750 msgr2=0x7f28440c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:17.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.287+0000 7f284c163640 1 -- 172.21.15.96:0/2493499417 shutdown_connections 2024-04-18T05:00:17.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.287+0000 7f284c163640 1 -- 172.21.15.96:0/2493499417 wait complete. 2024-04-18T05:00:17.306 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-18T05:00:17.306 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-04-18T05:00:17.306 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T05:00:17.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.411+0000 7fcaa3278640 1 Processor -- start 2024-04-18T05:00:17.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.411+0000 7fcaa3278640 1 -- start start 2024-04-18T05:00:17.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.415+0000 7fcaa3278640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca9c1532d0 0x7fca9c15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.415+0000 7fcaa3278640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca9c0c3e10 0x7fca9c0c4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.415+0000 7fcaa3278640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9c15d280 con 0x7fca9c0c8fe0 2024-04-18T05:00:17.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.415+0000 7fcaa3278640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c0c5070 con 0x7fca9c0c3e10 2024-04-18T05:00:17.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.415+0000 7fcaa3278640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0c47c0 con 0x7fca9c1532d0 2024-04-18T05:00:17.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.415+0000 7fcaa1815640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca9c0c3e10 0x7fca9c0c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.415+0000 7fcaa1815640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca9c0c3e10 0x7fca9c0c4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33422/0 (socket says 172.21.15.96:33422) 2024-04-18T05:00:17.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.415+0000 7fcaa1815640 1 -- 172.21.15.96:0/851717082 learned_addr learned my addr 172.21.15.96:0/851717082 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:17.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.415+0000 7fcaa1014640 1 -- 172.21.15.96:0/851717082 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca9c1532d0 msgr2=0x7fca9c15cd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T05:00:17.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.415+0000 7fcaa1014640 1 --2- 172.21.15.96:0/851717082 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca9c1532d0 0x7fca9c15cd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:17.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.415+0000 7fcaa1815640 1 -- 172.21.15.96:0/851717082 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca9c1532d0 msgr2=0x7fca9c15cd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T05:00:17.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.415+0000 7fcaa1815640 1 --2- 172.21.15.96:0/851717082 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca9c1532d0 0x7fca9c15cd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.415+0000 7fcaa1815640 1 -- 172.21.15.96:0/851717082 >> v1:172.21.15.139:6789/0 conn(0x7fca9c0c8fe0 legacy=0x7fca9c0ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:17.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.415+0000 7fcaa1815640 1 -- 172.21.15.96:0/851717082 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c158e10 con 0x7fca9c0c3e10 2024-04-18T05:00:17.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.415+0000 7fcaa1815640 1 --2- 172.21.15.96:0/851717082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c0c3e10 0x7fca9c0c4280 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fca94009e50 tx=0x7fca9401f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e889250d659e5f10 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:17.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fca93fff640 1 -- 172.21.15.96:0/851717082 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca940af400 con 0x7fca9c0c3e10 2024-04-18T05:00:17.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fca93fff640 1 -- 172.21.15.96:0/851717082 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca940ab050 con 0x7fca9c0c3e10 2024-04-18T05:00:17.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fca93fff640 1 -- 172.21.15.96:0/851717082 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca940af780 con 0x7fca9c0c3e10 2024-04-18T05:00:17.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 -- 172.21.15.96:0/851717082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c0c3e10 msgr2=0x7fca9c0c4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 --2- 172.21.15.96:0/851717082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c0c3e10 0x7fca9c0c4280 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fca94009e50 tx=0x7fca9401f200 comp rx=0 tx=0).stop 2024-04-18T05:00:17.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 -- 172.21.15.96:0/851717082 shutdown_connections 2024-04-18T05:00:17.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 --2- 172.21.15.96:0/851717082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c0c3e10 0x7fca9c0c4280 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 --2- 172.21.15.96:0/851717082 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca9c1532d0 0x7fca9c15cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 -- 172.21.15.96:0/851717082 >> 172.21.15.96:0/851717082 conn(0x7fca9c071760 msgr2=0x7fca9c065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 -- 172.21.15.96:0/851717082 shutdown_connections 2024-04-18T05:00:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 -- 172.21.15.96:0/851717082 wait complete. 2024-04-18T05:00:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 Processor -- start 2024-04-18T05:00:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 -- start start 2024-04-18T05:00:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca9c0c3e10 0x7fca9c13ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca9c0c8fe0 0x7fca9c147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c1532d0 0x7fca9c14aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c1487c0 con 0x7fca9c1532d0 2024-04-18T05:00:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c148a60 con 0x7fca9c0c8fe0 2024-04-18T05:00:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c148d40 con 0x7fca9c0c3e10 2024-04-18T05:00:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa1815640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c1532d0 0x7fca9c14aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa1014640 1 -- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca9c0c3e10 msgr2=0x7fca9c13ea40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T05:00:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa1815640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c1532d0 0x7fca9c14aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33424/0 (socket says 172.21.15.96:33424) 2024-04-18T05:00:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa1815640 1 -- 172.21.15.96:0/779913739 learned_addr learned my addr 172.21.15.96:0/779913739 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa1014640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca9c0c3e10 0x7fca9c13ea40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa0813640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca9c0c8fe0 0x7fca9c147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa1815640 1 -- 172.21.15.96:0/779913739 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca9c0c3e10 msgr2=0x7fca9c13ea40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T05:00:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa1815640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca9c0c3e10 0x7fca9c13ea40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa1815640 1 -- 172.21.15.96:0/779913739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca9c0c8fe0 msgr2=0x7fca9c147290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa1815640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca9c0c8fe0 0x7fca9c147290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa1815640 1 -- 172.21.15.96:0/779913739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca94009b30 con 0x7fca9c1532d0 2024-04-18T05:00:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa0813640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca9c0c8fe0 0x7fca9c147290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:00:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa1815640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c1532d0 0x7fca9c14aef0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fca9401d8b0 tx=0x7fca9401bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fca91ffb640 1 -- 172.21.15.96:0/779913739 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca940b8400 con 0x7fca9c1532d0 2024-04-18T05:00:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fca91ffb640 1 -- 172.21.15.96:0/779913739 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca940b8560 con 0x7fca9c1532d0 2024-04-18T05:00:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 -- 172.21.15.96:0/779913739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c149020 con 0x7fca9c1532d0 2024-04-18T05:00:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fca91ffb640 1 -- 172.21.15.96:0/779913739 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca940b88f0 con 0x7fca9c1532d0 2024-04-18T05:00:17.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.419+0000 7fcaa3278640 1 -- 172.21.15.96:0/779913739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c1495e0 con 0x7fca9c1532d0 2024-04-18T05:00:17.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.423+0000 7fcaa3278640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c146cd0 0x7fca9c14b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.423+0000 7fcaa3278640 1 -- 172.21.15.96:0/779913739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c072290 con 0x7fca9c146cd0 2024-04-18T05:00:17.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.423+0000 7fcaa1014640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c146cd0 0x7fca9c14b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.423+0000 7fcaa1014640 1 -- 172.21.15.96:0/779913739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca9c148eb0 con 0x7fca9c146cd0 2024-04-18T05:00:17.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.423+0000 7fcaa1014640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c146cd0 0x7fca9c14b430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fca9800b450 tx=0x7fca9800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:17.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.423+0000 7fca91ffb640 1 -- 172.21.15.96:0/779913739 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fca940b6040 con 0x7fca9c1532d0 2024-04-18T05:00:17.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.423+0000 7fca91ffb640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca80066640 0x7fca80068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.423+0000 7fca91ffb640 1 -- 172.21.15.96:0/779913739 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fca94122540 con 0x7fca9c1532d0 2024-04-18T05:00:17.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.423+0000 7fcaa0813640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca80066640 0x7fca80068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.423+0000 7fca91ffb640 1 -- 172.21.15.96:0/779913739 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98003e20 con 0x7fca9c146cd0 2024-04-18T05:00:17.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.423+0000 7fca91ffb640 1 -- 172.21.15.96:0/779913739 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fca98005070 con 0x7fca9c146cd0 2024-04-18T05:00:17.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.423+0000 7fca91ffb640 1 -- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c146cd0 msgr2=0x7fca9c14b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.423+0000 7fca91ffb640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c146cd0 0x7fca9c14b430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fca9800b450 tx=0x7fca9800b910 comp rx=0 tx=0).stop 2024-04-18T05:00:17.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.423+0000 7fca91ffb640 1 -- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c146cd0 msgr2=0x7fca9c14b430 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T05:00:17.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.423+0000 7fca91ffb640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c146cd0 0x7fca9c14b430 secure :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fca9800b450 tx=0x7fca9800b910 comp rx=0 tx=0).stop 2024-04-18T05:00:17.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.423+0000 7fcaa0813640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca80066640 0x7fca80068b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0c9ca0 tx=0x7fca8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:17.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.427+0000 7fcaa3278640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c1e4b80 0x7fca9c1e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.427+0000 7fcaa3278640 1 -- 172.21.15.96:0/779913739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0742f0 con 0x7fca9c1e4b80 2024-04-18T05:00:17.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.427+0000 7fcaa1014640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c1e4b80 0x7fca9c1e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.427+0000 7fcaa1014640 1 -- 172.21.15.96:0/779913739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fca9c1590d0 con 0x7fca9c1e4b80 2024-04-18T05:00:17.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.427+0000 7fcaa1014640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c1e4b80 0x7fca9c1e34e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fca9800b450 tx=0x7fca98005a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:17.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.431+0000 7fca91ffb640 1 -- 172.21.15.96:0/779913739 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98020070 con 0x7fca9c1e4b80 2024-04-18T05:00:17.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.431+0000 7fca91ffb640 1 -- 172.21.15.96:0/779913739 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4966 (secure 0 0 0) 0x7fca9801bc10 con 0x7fca9c1e4b80 2024-04-18T05:00:17.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.431+0000 7fca91ffb640 1 -- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c1e4b80 msgr2=0x7fca9c1e34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.431+0000 7fca91ffb640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c1e4b80 0x7fca9c1e34e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fca9800b450 tx=0x7fca98005a30 comp rx=0 tx=0).stop 2024-04-18T05:00:17.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.431+0000 7fca91ffb640 1 -- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c1e4b80 msgr2=0x7fca9c1e34e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T05:00:17.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.431+0000 7fca91ffb640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c1e4b80 0x7fca9c1e34e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.433 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T05:00:17.433 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T05:00:17.433 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T05:00:17.434 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T05:00:17.434 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 56, 2024-04-18T05:00:17.434 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T05:00:17.434 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T05:00:17.434 INFO:teuthology.orchestra.run.smithi096.stdout: 1 2024-04-18T05:00:17.434 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:17.434 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 0, 2024-04-18T05:00:17.434 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T05:00:17.434 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T05:00:17.434 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T05:00:17.435 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:17.435 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:17.435 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:17.435 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:17.435 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:17.435 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:17.435 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:17.435 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:17.435 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:17.435 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:17.435 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:17.436 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T05:00:17.436 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T05:00:17.436 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:17.436 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:17.436 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:17.436 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:17.436 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:17.436 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:17.436 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:17.436 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:17.436 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:17.436 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:17.436 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:17.436 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.437 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T05:00:17.437 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T05:00:17.437 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T05:00:17.437 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T05:00:17.437 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T05:00:17.437 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T05:00:17.437 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T05:00:17.437 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T05:00:17.437 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T05:00:17.437 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T05:00:17.437 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T05:00:17.437 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T05:00:17.437 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T05:00:17.437 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T05:00:17.438 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T05:00:17.438 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T05:00:17.438 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T05:00:17.438 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:17.438 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:17.438 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:17.438 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:17.438 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:17.438 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:17.438 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:17.438 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:17.438 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:17.438 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:17.439 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:17.439 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T05:00:17.439 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.439 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T05:00:17.439 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.439 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T05:00:17.439 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T05:00:17.439 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:17.439 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:17.439 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.439 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:17.439 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T05:00:17.439 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:17.439 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.440 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.440 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:17.440 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T05:00:17.440 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:17.440 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:17.440 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:17.440 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.440 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T05:00:17.440 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T05:00:17.440 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:17.440 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:17.440 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:17.440 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.440 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.440 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T05:00:17.441 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T05:00:17.441 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:17.441 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:17.441 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.441 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:17.441 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T05:00:17.441 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:17.441 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.441 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.441 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:17.441 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T05:00:17.441 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:17.441 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:17.441 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:17.442 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.442 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T05:00:17.442 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T05:00:17.442 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:17.442 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:17.442 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:17.442 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.442 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.442 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T05:00:17.442 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T05:00:17.442 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:17.442 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:17.442 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.443 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:17.443 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T05:00:17.443 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:17.443 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.443 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.443 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:17.443 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T05:00:17.443 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:17.443 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:17.443 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:17.443 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.443 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T05:00:17.443 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T05:00:17.443 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:17.443 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:17.444 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:17.444 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:17.444 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:17.444 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.444 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T05:00:17.444 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T05:00:17.444 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.444 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:17.444 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:17.444 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T05:00:17.444 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:17.444 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:17.444 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T05:00:17.444 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.445 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:17.445 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:17.445 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5 2024-04-18T05:00:17.445 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:17.445 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:17.445 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T05:00:17.445 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.445 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:17.445 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:17.445 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 8 2024-04-18T05:00:17.445 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:17.445 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:17.445 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T05:00:17.445 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.445 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:17.446 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:17.446 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 7 2024-04-18T05:00:17.446 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:17.446 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:17.446 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T05:00:17.446 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.446 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:17.446 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:17.446 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T05:00:17.446 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:17.446 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:17.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.446 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T05:00:17.446 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T05:00:17.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.431+0000 7fcaa3278640 1 -- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca80066640 msgr2=0x7fca80068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.431+0000 7fcaa3278640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fca80066640 0x7fca80068b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0c9ca0 tx=0x7fca8c009040 comp rx=0 tx=0).stop 2024-04-18T05:00:17.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.431+0000 7fcaa3278640 1 -- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c1532d0 msgr2=0x7fca9c14aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.431+0000 7fcaa3278640 1 --2- 172.21.15.96:0/779913739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9c1532d0 0x7fca9c14aef0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fca9401d8b0 tx=0x7fca9401bfa0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.431+0000 7fcaa1815640 1 -- 172.21.15.96:0/779913739 reap_dead start 2024-04-18T05:00:17.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.431+0000 7fcaa1815640 1 -- 172.21.15.96:0/779913739 reap_dead start 2024-04-18T05:00:17.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.431+0000 7fcaa3278640 1 -- 172.21.15.96:0/779913739 shutdown_connections 2024-04-18T05:00:17.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.431+0000 7fcaa3278640 1 -- 172.21.15.96:0/779913739 >> 172.21.15.96:0/779913739 conn(0x7fca9c071760 msgr2=0x7fca9c0cb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:17.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.431+0000 7fcaa3278640 1 -- 172.21.15.96:0/779913739 shutdown_connections 2024-04-18T05:00:17.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.431+0000 7fcaa3278640 1 -- 172.21.15.96:0/779913739 wait complete. 2024-04-18T05:00:17.448 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-18T05:00:17.449 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-04-18T05:00:17.449 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-18T05:00:17.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.559+0000 7ff4229f2640 1 Processor -- start 2024-04-18T05:00:17.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.559+0000 7ff4229f2640 1 -- start start 2024-04-18T05:00:17.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.559+0000 7ff4229f2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff41c158cd0 0x7ff41c0c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.559+0000 7ff4229f2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff41c159120 0x7ff41c0ca270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.559+0000 7ff4229f2640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41c1595f0 con 0x7ff41c153060 2024-04-18T05:00:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.559+0000 7ff4229f2640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c153440 con 0x7ff41c158cd0 2024-04-18T05:00:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.559+0000 7ff4229f2640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c1598d0 con 0x7ff41c159120 2024-04-18T05:00:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.559+0000 7ff420f8f640 1 -- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff41c159120 msgr2=0x7ff41c0ca270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T05:00:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.559+0000 7ff420f8f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff41c159120 0x7ff41c0ca270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.559+0000 7ff41b7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff41c158cd0 0x7ff41c0c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.559+0000 7ff41b7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff41c158cd0 0x7ff41c0c9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:54914/0 (socket says 172.21.15.96:54914) 2024-04-18T05:00:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.559+0000 7ff41b7fe640 1 -- 172.21.15.96:0/165376709 learned_addr learned my addr 172.21.15.96:0/165376709 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.559+0000 7ff41b7fe640 1 -- 172.21.15.96:0/165376709 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff41c159120 msgr2=0x7ff41c0ca270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T05:00:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.559+0000 7ff41b7fe640 1 --2- 172.21.15.96:0/165376709 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff41c159120 0x7ff41c0ca270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.559+0000 7ff41b7fe640 1 -- 172.21.15.96:0/165376709 >> v1:172.21.15.139:6789/0 conn(0x7ff41c153060 legacy=0x7ff41c0c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.559+0000 7ff41b7fe640 1 -- 172.21.15.96:0/165376709 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c159bb0 con 0x7ff41c158cd0 2024-04-18T05:00:17.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.563+0000 7ff41b7fe640 1 --2- 172.21.15.96:0/165376709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c158cd0 0x7ff41c0c9d30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff40c009870 tx=0x7ff40c01ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5687728fd2c82cfb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:17.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.563+0000 7ff41affd640 1 -- 172.21.15.96:0/165376709 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c0a8a70 con 0x7ff41c158cd0 2024-04-18T05:00:17.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.563+0000 7ff41affd640 1 -- 172.21.15.96:0/165376709 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c0a8bd0 con 0x7ff41c158cd0 2024-04-18T05:00:17.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.563+0000 7ff41affd640 1 -- 172.21.15.96:0/165376709 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c0b0440 con 0x7ff41c158cd0 2024-04-18T05:00:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.563+0000 7ff4229f2640 1 -- 172.21.15.96:0/165376709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c158cd0 msgr2=0x7ff41c0c9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.563+0000 7ff4229f2640 1 --2- 172.21.15.96:0/165376709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c158cd0 0x7ff41c0c9d30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff40c009870 tx=0x7ff40c01ed70 comp rx=0 tx=0).stop 2024-04-18T05:00:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.563+0000 7ff4229f2640 1 -- 172.21.15.96:0/165376709 shutdown_connections 2024-04-18T05:00:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.563+0000 7ff4229f2640 1 --2- 172.21.15.96:0/165376709 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff41c159120 0x7ff41c0ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.563+0000 7ff4229f2640 1 --2- 172.21.15.96:0/165376709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c158cd0 0x7ff41c0c9d30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.563+0000 7ff4229f2640 1 -- 172.21.15.96:0/165376709 >> 172.21.15.96:0/165376709 conn(0x7ff41c06b470 msgr2=0x7ff41c06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.563+0000 7ff4229f2640 1 -- 172.21.15.96:0/165376709 shutdown_connections 2024-04-18T05:00:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.563+0000 7ff4229f2640 1 -- 172.21.15.96:0/165376709 wait complete. 2024-04-18T05:00:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff4229f2640 1 Processor -- start 2024-04-18T05:00:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff4229f2640 1 -- start start 2024-04-18T05:00:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff4229f2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff41c153060 0x7ff41c151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff4229f2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c158cd0 0x7ff41c1450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff4229f2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff41c159120 0x7ff41c142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff4229f2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c1528b0 con 0x7ff41c153060 2024-04-18T05:00:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff4229f2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c142590 con 0x7ff41c158cd0 2024-04-18T05:00:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff4229f2640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0b4100 con 0x7ff41c159120 2024-04-18T05:00:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff41bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff41c153060 0x7ff41c151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff41bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff41c153060 0x7ff41c151660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33456/0 (socket says 172.21.15.96:33456) 2024-04-18T05:00:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff41bfff640 1 -- 172.21.15.96:0/3719213895 learned_addr learned my addr 172.21.15.96:0/3719213895 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff420f8f640 1 -- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff41c159120 msgr2=0x7ff41c142a20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.139:3301/0 2024-04-18T05:00:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff420f8f640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff41c159120 0x7ff41c142a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff41b7fe640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c158cd0 0x7ff41c1450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff41bfff640 1 -- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff41c159120 msgr2=0x7ff41c142a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T05:00:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff41bfff640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff41c159120 0x7ff41c142a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff41bfff640 1 -- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c158cd0 msgr2=0x7ff41c1450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff41bfff640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c158cd0 0x7ff41c1450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff41bfff640 1 -- 172.21.15.96:0/3719213895 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c0094d0 con 0x7ff41c153060 2024-04-18T05:00:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff41bfff640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff41c153060 0x7ff41c151660 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff41000c480 tx=0x7ff41000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:17.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff418ff9640 1 -- 172.21.15.96:0/3719213895 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4100052d0 con 0x7ff41c153060 2024-04-18T05:00:17.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff418ff9640 1 -- 172.21.15.96:0/3719213895 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff410005430 con 0x7ff41c153060 2024-04-18T05:00:17.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff418ff9640 1 -- 172.21.15.96:0/3719213895 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410007260 con 0x7ff41c153060 2024-04-18T05:00:17.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff4229f2640 1 -- 172.21.15.96:0/3719213895 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c151d30 con 0x7ff41c153060 2024-04-18T05:00:17.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff4229f2640 1 -- 172.21.15.96:0/3719213895 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c1522f0 con 0x7ff41c153060 2024-04-18T05:00:17.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff4229f2640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c0ca030 0x7ff41c142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff4229f2640 1 -- 172.21.15.96:0/3719213895 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c072290 con 0x7ff41c0ca030 2024-04-18T05:00:17.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff41b7fe640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c0ca030 0x7ff41c142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff418ff9640 1 -- 172.21.15.96:0/3719213895 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff4100073c0 con 0x7ff41c153060 2024-04-18T05:00:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.567+0000 7ff41b7fe640 1 -- 172.21.15.96:0/3719213895 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff41c0c3f60 con 0x7ff41c0ca030 2024-04-18T05:00:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.571+0000 7ff418ff9640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff408066640 0x7ff408068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.571+0000 7ff41b7fe640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c0ca030 0x7ff41c142f60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0cf7d0 tx=0x7ff40c01d5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.571+0000 7ff418ff9640 1 -- 172.21.15.96:0/3719213895 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff410083b90 con 0x7ff41c153060 2024-04-18T05:00:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.571+0000 7ff420f8f640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff408066640 0x7ff408068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.571+0000 7ff418ff9640 1 -- 172.21.15.96:0/3719213895 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c0b0e00 con 0x7ff41c0ca030 2024-04-18T05:00:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.571+0000 7ff420f8f640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff408066640 0x7ff408068b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0b0ff0 tx=0x7ff4140091f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.571+0000 7ff418ff9640 1 -- 172.21.15.96:0/3719213895 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7ff40c0ba410 con 0x7ff41c0ca030 2024-04-18T05:00:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.571+0000 7ff418ff9640 1 -- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c0ca030 msgr2=0x7ff41c142f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.571+0000 7ff418ff9640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c0ca030 0x7ff41c142f60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0cf7d0 tx=0x7ff40c01d5b0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.571+0000 7ff418ff9640 1 -- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c0ca030 msgr2=0x7ff41c142f60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T05:00:17.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.571+0000 7ff418ff9640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c0ca030 0x7ff41c142f60 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0cf7d0 tx=0x7ff40c01d5b0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.575+0000 7ff4229f2640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c1f1b00 0x7ff41c140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:17.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.575+0000 7ff4229f2640 1 -- 172.21.15.96:0/3719213895 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0c3c80 con 0x7ff41c1f1b00 2024-04-18T05:00:17.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.575+0000 7ff41b7fe640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c1f1b00 0x7ff41c140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:17.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.575+0000 7ff41b7fe640 1 -- 172.21.15.96:0/3719213895 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff41c0c4480 con 0x7ff41c1f1b00 2024-04-18T05:00:17.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff41b7fe640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c1f1b00 0x7ff41c140820 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff40c000c10 tx=0x7ff40c01bb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff418ff9640 1 -- 172.21.15.96:0/3719213895 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c0c4be0 con 0x7ff41c1f1b00 2024-04-18T05:00:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff418ff9640 1 -- 172.21.15.96:0/3719213895 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4624 (secure 0 0 0) 0x7ff40c0c4d40 con 0x7ff41c1f1b00 2024-04-18T05:00:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff418ff9640 1 -- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c1f1b00 msgr2=0x7ff41c140820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff418ff9640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c1f1b00 0x7ff41c140820 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff40c000c10 tx=0x7ff40c01bb10 comp rx=0 tx=0).stop 2024-04-18T05:00:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff418ff9640 1 -- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c1f1b00 msgr2=0x7ff41c140820 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T05:00:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff418ff9640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff41c1f1b00 0x7ff41c140820 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff40c000c10 tx=0x7ff40c01bb10 comp rx=0 tx=0).stop 2024-04-18T05:00:17.581 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T05:00:17.581 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T05:00:17.582 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T05:00:17.582 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T05:00:17.582 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 56, 2024-04-18T05:00:17.582 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T05:00:17.582 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T05:00:17.582 INFO:teuthology.orchestra.run.smithi096.stdout: 1 2024-04-18T05:00:17.582 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:17.582 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 0, 2024-04-18T05:00:17.582 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T05:00:17.582 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T05:00:17.582 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T05:00:17.582 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:17.582 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:17.583 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:17.583 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:17.583 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:17.583 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:17.583 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:17.583 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:17.583 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:17.583 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:17.583 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:17.583 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T05:00:17.583 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T05:00:17.583 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:17.583 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:17.583 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:17.583 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:17.584 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:17.584 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:17.584 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:17.584 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:17.584 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:17.584 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:17.584 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:17.584 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.584 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T05:00:17.584 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T05:00:17.584 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T05:00:17.584 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T05:00:17.584 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T05:00:17.584 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T05:00:17.584 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T05:00:17.584 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T05:00:17.585 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T05:00:17.585 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T05:00:17.585 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T05:00:17.585 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T05:00:17.585 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T05:00:17.585 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T05:00:17.585 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T05:00:17.585 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T05:00:17.585 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T05:00:17.585 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:17.585 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:17.585 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:17.585 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:17.585 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:17.585 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:17.585 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:17.586 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:17.586 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:17.586 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:17.586 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:17.586 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T05:00:17.586 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.586 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T05:00:17.586 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.586 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T05:00:17.586 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T05:00:17.586 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:17.586 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:17.586 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.586 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:17.586 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T05:00:17.587 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:17.587 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.587 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.587 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:17.587 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T05:00:17.587 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:17.587 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:17.587 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:17.587 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.587 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T05:00:17.587 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T05:00:17.587 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:17.587 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:17.587 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:17.587 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.588 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.588 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T05:00:17.588 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T05:00:17.588 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:17.588 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:17.588 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.588 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:17.588 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T05:00:17.588 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:17.588 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.588 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.588 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:17.588 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T05:00:17.588 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:17.588 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:17.588 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:17.589 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.589 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T05:00:17.589 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T05:00:17.589 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:17.589 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:17.589 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:17.589 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.589 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.589 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T05:00:17.589 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T05:00:17.589 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:17.589 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:17.589 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.589 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:17.589 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T05:00:17.589 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:17.590 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.590 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.590 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:17.590 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T05:00:17.590 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:17.590 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:17.590 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:17.590 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.590 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T05:00:17.590 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T05:00:17.590 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:17.590 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:17.590 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:17.590 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:17.590 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:17.591 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.591 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T05:00:17.591 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T05:00:17.591 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.591 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:17.591 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:17.591 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T05:00:17.591 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:17.591 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:17.591 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T05:00:17.591 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.591 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:17.591 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:17.591 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T05:00:17.592 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:17.592 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:17.592 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T05:00:17.592 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:17.592 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:17.592 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:17.592 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T05:00:17.592 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:17.592 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:17.592 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:17.592 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T05:00:17.592 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T05:00:17.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff4229f2640 1 -- 172.21.15.96:0/3719213895 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff408066640 msgr2=0x7ff408068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff4229f2640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff408066640 0x7ff408068b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0b0ff0 tx=0x7ff4140091f0 comp rx=0 tx=0).stop 2024-04-18T05:00:17.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff4229f2640 1 -- 172.21.15.96:0/3719213895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff41c153060 msgr2=0x7ff41c151660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:17.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff4229f2640 1 --2- 172.21.15.96:0/3719213895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff41c153060 0x7ff41c151660 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff41000c480 tx=0x7ff41000c940 comp rx=0 tx=0).stop 2024-04-18T05:00:17.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff420f8f640 1 -- 172.21.15.96:0/3719213895 reap_dead start 2024-04-18T05:00:17.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff420f8f640 1 -- 172.21.15.96:0/3719213895 reap_dead start 2024-04-18T05:00:17.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff4229f2640 1 -- 172.21.15.96:0/3719213895 shutdown_connections 2024-04-18T05:00:17.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff4229f2640 1 -- 172.21.15.96:0/3719213895 >> 172.21.15.96:0/3719213895 conn(0x7ff41c06b470 msgr2=0x7ff41c0c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:17.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff4229f2640 1 -- 172.21.15.96:0/3719213895 shutdown_connections 2024-04-18T05:00:17.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:17.579+0000 7ff4229f2640 1 -- 172.21.15.96:0/3719213895 wait complete. 2024-04-18T05:00:17.597 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-18T05:00:17.597 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-18T05:00:18.482 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T05:00:18.485 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T05:00:37.598 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-18T05:00:37.598 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-04-18T05:00:37.599 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-18T05:00:37.599 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-18T05:00:37.603 INFO:tasks.ceph.mon.c:Started 2024-04-18T05:00:37.603 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-18T05:00:37.603 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T05:00:37.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.727+0000 7f8811b80640 1 Processor -- start 2024-04-18T05:00:37.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.727+0000 7f8811b80640 1 -- start start 2024-04-18T05:00:37.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.727+0000 7f8811b80640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f880c151210 0x7f880c0c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:37.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.727+0000 7f8811b80640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880c157150 con 0x7f880c15a950 2024-04-18T05:00:37.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.727+0000 7f8811b80640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880c157430 con 0x7f880c0c1db0 2024-04-18T05:00:37.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.727+0000 7f8811b80640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880c157710 con 0x7f880c151210 2024-04-18T05:00:37.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.727+0000 7f880b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f880c151210 0x7f880c0c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:37.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f880b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f880c151210 0x7f880c0c1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54822/0 (socket says 172.21.15.96:54822) 2024-04-18T05:00:37.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f880b7fe640 1 -- 172.21.15.96:0/2937260903 learned_addr learned my addr 172.21.15.96:0/2937260903 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:37.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f880b7fe640 1 -- 172.21.15.96:0/2937260903 >> v1:172.21.15.139:6789/0 conn(0x7f880c0c1db0 legacy=0x7f880c0ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:37.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f880a7fc640 1 -- 172.21.15.96:0/2937260903 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6597141 0 0) 0x7f880c157150 con 0x7f880c15a950 2024-04-18T05:00:37.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f880b7fe640 1 -- 172.21.15.96:0/2937260903 >> v1:172.21.15.96:6789/0 conn(0x7f880c15a950 legacy=0x7f880c15ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:37.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f880b7fe640 1 -- 172.21.15.96:0/2937260903 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c1579f0 con 0x7f880c151210 2024-04-18T05:00:37.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f880b7fe640 1 --2- 172.21.15.96:0/2937260903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f880c151210 0x7f880c0c1870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8800009870 tx=0x7f880001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b3aa3b420f21c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:37.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f880a7fc640 1 -- 172.21.15.96:0/2937260903 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88000a8a50 con 0x7f880c151210 2024-04-18T05:00:37.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f880a7fc640 1 -- 172.21.15.96:0/2937260903 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88000a8bb0 con 0x7f880c151210 2024-04-18T05:00:37.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f880a7fc640 1 -- 172.21.15.96:0/2937260903 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88000b0440 con 0x7f880c151210 2024-04-18T05:00:37.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f8811b80640 1 -- 172.21.15.96:0/2937260903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f880c151210 msgr2=0x7f880c0c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:37.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f8811b80640 1 --2- 172.21.15.96:0/2937260903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f880c151210 0x7f880c0c1870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8800009870 tx=0x7f880001ed50 comp rx=0 tx=0).stop 2024-04-18T05:00:37.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f8811b80640 1 -- 172.21.15.96:0/2937260903 shutdown_connections 2024-04-18T05:00:37.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f8811b80640 1 --2- 172.21.15.96:0/2937260903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f880c151210 0x7f880c0c1870 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:37.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f8811b80640 1 -- 172.21.15.96:0/2937260903 >> 172.21.15.96:0/2937260903 conn(0x7f880c06c750 msgr2=0x7f880c0c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:37.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f8811b80640 1 -- 172.21.15.96:0/2937260903 shutdown_connections 2024-04-18T05:00:37.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.731+0000 7f8811b80640 1 -- 172.21.15.96:0/2937260903 wait complete. 2024-04-18T05:00:37.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f8811b80640 1 Processor -- start 2024-04-18T05:00:37.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f8811b80640 1 -- start start 2024-04-18T05:00:37.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f8811b80640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f880c0c1db0 0x7f880c1453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:37.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f8811b80640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f880c151210 0x7f880c1458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:37.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f8811b80640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f880c15a950 0x7f880c13f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:37.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f8811b80640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c1e01f0 con 0x7f880c15a950 2024-04-18T05:00:37.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f8811b80640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c1e0d70 con 0x7f880c0c1db0 2024-04-18T05:00:37.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f8811b80640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880c0c9f30 con 0x7f880c151210 2024-04-18T05:00:37.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f880bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f880c15a950 0x7f880c13f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:37.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f880bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f880c15a950 0x7f880c13f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54838/0 (socket says 172.21.15.96:54838) 2024-04-18T05:00:37.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f880bfff640 1 -- 172.21.15.96:0/915120130 learned_addr learned my addr 172.21.15.96:0/915120130 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f880b7fe640 1 --2- 172.21.15.96:0/915120130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f880c0c1db0 0x7f880c1453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f880affd640 1 --2- 172.21.15.96:0/915120130 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f880c151210 0x7f880c1458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f880affd640 1 -- 172.21.15.96:0/915120130 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f880c151210 msgr2=0x7f880c1458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-18T05:00:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f880affd640 1 -- 172.21.15.96:0/915120130 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f880c151210 msgr2=0x7f880c1458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T05:00:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f880affd640 1 --2- 172.21.15.96:0/915120130 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f880c151210 0x7f880c1458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f880affd640 1 --2- 172.21.15.96:0/915120130 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f880c151210 0x7f880c1458e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f880bfff640 1 -- 172.21.15.96:0/915120130 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f880c151210 msgr2=0x7f880c1458e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T05:00:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f880bfff640 1 --2- 172.21.15.96:0/915120130 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f880c151210 0x7f880c1458e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f880bfff640 1 -- 172.21.15.96:0/915120130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f880c0c1db0 msgr2=0x7f880c1453a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f880bfff640 1 --2- 172.21.15.96:0/915120130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f880c0c1db0 0x7f880c1453a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f880bfff640 1 -- 172.21.15.96:0/915120130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88000094d0 con 0x7f880c15a950 2024-04-18T05:00:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f880bfff640 1 --2- 172.21.15.96:0/915120130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f880c15a950 0x7f880c13f6b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8804002240 tx=0x7f880400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f87f3fff640 1 -- 172.21.15.96:0/915120130 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804003db0 con 0x7f880c15a950 2024-04-18T05:00:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f87f3fff640 1 -- 172.21.15.96:0/915120130 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880400ce30 con 0x7f880c15a950 2024-04-18T05:00:37.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f8811b80640 1 -- 172.21.15.96:0/915120130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880c156f20 con 0x7f880c15a950 2024-04-18T05:00:37.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f87f3fff640 1 -- 172.21.15.96:0/915120130 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804005270 con 0x7f880c15a950 2024-04-18T05:00:37.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f8811b80640 1 -- 172.21.15.96:0/915120130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880c1e0720 con 0x7f880c15a950 2024-04-18T05:00:37.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.735+0000 7f8811b80640 1 -- 172.21.15.96:0/915120130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880c0c56d0 con 0x7f880c15a950 2024-04-18T05:00:37.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.739+0000 7f87f3fff640 1 -- 172.21.15.96:0/915120130 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f88040053d0 con 0x7f880c15a950 2024-04-18T05:00:37.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.739+0000 7f87f3fff640 1 --2- 172.21.15.96:0/915120130 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f87f8066690 0x7f87f8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:37.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.739+0000 7f87f3fff640 1 -- 172.21.15.96:0/915120130 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8804083910 con 0x7f880c15a950 2024-04-18T05:00:37.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.739+0000 7f880b7fe640 1 --2- 172.21.15.96:0/915120130 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f87f8066690 0x7f87f8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:37.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.739+0000 7f880b7fe640 1 --2- 172.21.15.96:0/915120130 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f87f8066690 0x7f87f8068b50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f88000b2000 tx=0x7f8800009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:37.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.743+0000 7f87f3fff640 1 -- 172.21.15.96:0/915120130 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8804050c80 con 0x7f880c15a950 2024-04-18T05:00:37.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.959+0000 7f8811b80640 1 -- 172.21.15.96:0/915120130 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f880c15a3d0 con 0x7f880c15a950 2024-04-18T05:00:37.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.959+0000 7f87f3fff640 1 -- 172.21.15.96:0/915120130 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7f8804017070 con 0x7f880c15a950 2024-04-18T05:00:37.963 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":56,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T05:00:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.963+0000 7f8811b80640 1 -- 172.21.15.96:0/915120130 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f87f8066690 msgr2=0x7f87f8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.963+0000 7f8811b80640 1 --2- 172.21.15.96:0/915120130 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f87f8066690 0x7f87f8068b50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f88000b2000 tx=0x7f8800009040 comp rx=0 tx=0).stop 2024-04-18T05:00:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.963+0000 7f8811b80640 1 -- 172.21.15.96:0/915120130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f880c15a950 msgr2=0x7f880c13f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.963+0000 7f8811b80640 1 --2- 172.21.15.96:0/915120130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f880c15a950 0x7f880c13f6b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8804002240 tx=0x7f880400cbe0 comp rx=0 tx=0).stop 2024-04-18T05:00:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.963+0000 7f8811b80640 1 -- 172.21.15.96:0/915120130 shutdown_connections 2024-04-18T05:00:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.963+0000 7f8811b80640 1 --2- 172.21.15.96:0/915120130 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f87f8066690 0x7f87f8068b50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.963+0000 7f8811b80640 1 --2- 172.21.15.96:0/915120130 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f880c15a950 0x7f880c13f6b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.963+0000 7f8811b80640 1 --2- 172.21.15.96:0/915120130 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f880c151210 0x7f880c1458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.963+0000 7f8811b80640 1 --2- 172.21.15.96:0/915120130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f880c0c1db0 0x7f880c1453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.963+0000 7f8811b80640 1 -- 172.21.15.96:0/915120130 >> 172.21.15.96:0/915120130 conn(0x7f880c06c750 msgr2=0x7f880c155890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:37.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.963+0000 7f8811b80640 1 -- 172.21.15.96:0/915120130 shutdown_connections 2024-04-18T05:00:37.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:37.963+0000 7f8811b80640 1 -- 172.21.15.96:0/915120130 wait complete. 2024-04-18T05:00:40.984 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T05:00:41.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.111+0000 7fa4bb682640 1 Processor -- start 2024-04-18T05:00:41.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.111+0000 7fa4bb682640 1 -- start start 2024-04-18T05:00:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4bb682640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4b4070a40 0x7fa4b4156130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4bb682640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa4b4150260 0x7fa4b4156670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4bb682640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b4159380 con 0x7fa4b40c60e0 2024-04-18T05:00:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4bb682640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b415a1a0 con 0x7fa4b4150260 2024-04-18T05:00:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4bb682640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b4155ce0 con 0x7fa4b4070a40 2024-04-18T05:00:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4b941e640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa4b40c60e0 0x7fa4b414fb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36954/0 (socket says 172.21.15.96:36954) 2024-04-18T05:00:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4b941e640 1 -- 172.21.15.96:0/156342269 learned_addr learned my addr 172.21.15.96:0/156342269 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:00:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4b9c1f640 1 --2- 172.21.15.96:0/156342269 >> v2:172.21.15.139:3300/0 conn(0x7fa4b4150260 0x7fa4b4156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4b8c1d640 1 --2- 172.21.15.96:0/156342269 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4b4070a40 0x7fa4b4156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4abfff640 1 -- 172.21.15.96:0/156342269 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285345211 0 0) 0x7fa4b4159380 con 0x7fa4b40c60e0 2024-04-18T05:00:41.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4abfff640 1 -- 172.21.15.96:0/156342269 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a0003530 con 0x7fa4b40c60e0 2024-04-18T05:00:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4abfff640 1 -- 172.21.15.96:0/156342269 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2506015764 0 0) 0x7fa4a0003530 con 0x7fa4b40c60e0 2024-04-18T05:00:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4abfff640 1 -- 172.21.15.96:0/156342269 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4b4070a40 msgr2=0x7fa4b4156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4abfff640 1 --2- 172.21.15.96:0/156342269 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4b4070a40 0x7fa4b4156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4abfff640 1 -- 172.21.15.96:0/156342269 >> v2:172.21.15.139:3300/0 conn(0x7fa4b4150260 msgr2=0x7fa4b4156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4abfff640 1 --2- 172.21.15.96:0/156342269 >> v2:172.21.15.139:3300/0 conn(0x7fa4b4150260 0x7fa4b4156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4abfff640 1 -- 172.21.15.96:0/156342269 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b4159620 con 0x7fa4b40c60e0 2024-04-18T05:00:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4abfff640 1 -- 172.21.15.96:0/156342269 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fa4b0001680 con 0x7fa4b40c60e0 2024-04-18T05:00:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4abfff640 1 -- 172.21.15.96:0/156342269 >> v1:172.21.15.96:6789/0 conn(0x7fa4b40c60e0 legacy=0x7fa4b414fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4abfff640 1 --2- 172.21.15.96:0/156342269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4a0003980 0x7fa4a0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4abfff640 1 --2- 172.21.15.96:0/156342269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a00047d0 0x7fa4a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4abfff640 1 --2- 172.21.15.96:0/156342269 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4a0005190 0x7fa4a000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4abfff640 1 -- 172.21.15.96:0/156342269 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b415a1a0 con 0x7fa4a00047d0 2024-04-18T05:00:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4abfff640 1 -- 172.21.15.96:0/156342269 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b4155ce0 con 0x7fa4a0003980 2024-04-18T05:00:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4abfff640 1 -- 172.21.15.96:0/156342269 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a000e0e0 con 0x7fa4a0005190 2024-04-18T05:00:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4b8c1d640 1 --2- 172.21.15.96:0/156342269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a00047d0 0x7fa4a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4b941e640 1 --2- 172.21.15.96:0/156342269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4a0003980 0x7fa4a0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4b9c1f640 1 --2- 172.21.15.96:0/156342269 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4a0005190 0x7fa4a000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4b8c1d640 1 -- 172.21.15.96:0/156342269 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4a0005190 msgr2=0x7fa4a000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4b8c1d640 1 --2- 172.21.15.96:0/156342269 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4a0005190 0x7fa4a000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4b8c1d640 1 -- 172.21.15.96:0/156342269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4a0003980 msgr2=0x7fa4a0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4b8c1d640 1 --2- 172.21.15.96:0/156342269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4a0003980 0x7fa4a0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4b8c1d640 1 -- 172.21.15.96:0/156342269 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a0003530 con 0x7fa4a00047d0 2024-04-18T05:00:41.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.115+0000 7fa4b8c1d640 1 --2- 172.21.15.96:0/156342269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a00047d0 0x7fa4a0004c50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400ba00 tx=0x7fa4a401c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645a861154c72318 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4abfff640 1 -- 172.21.15.96:0/156342269 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a40ad640 con 0x7fa4a00047d0 2024-04-18T05:00:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4abfff640 1 -- 172.21.15.96:0/156342269 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a40ad7a0 con 0x7fa4a00047d0 2024-04-18T05:00:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4abfff640 1 -- 172.21.15.96:0/156342269 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a40adb50 con 0x7fa4a00047d0 2024-04-18T05:00:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4bb682640 1 -- 172.21.15.96:0/156342269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a00047d0 msgr2=0x7fa4a0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4bb682640 1 --2- 172.21.15.96:0/156342269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a00047d0 0x7fa4a0004c50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400ba00 tx=0x7fa4a401c640 comp rx=0 tx=0).stop 2024-04-18T05:00:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4b9c1f640 1 -- 172.21.15.96:0/156342269 reap_dead start 2024-04-18T05:00:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4bb682640 1 -- 172.21.15.96:0/156342269 shutdown_connections 2024-04-18T05:00:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4bb682640 1 -- 172.21.15.96:0/156342269 >> 172.21.15.96:0/156342269 conn(0x7fa4b406c750 msgr2=0x7fa4b40c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4bb682640 1 -- 172.21.15.96:0/156342269 shutdown_connections 2024-04-18T05:00:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4bb682640 1 -- 172.21.15.96:0/156342269 wait complete. 2024-04-18T05:00:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4bb682640 1 Processor -- start 2024-04-18T05:00:41.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4bb682640 1 -- start start 2024-04-18T05:00:41.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4bb682640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4a00047d0 0x7fa4b4153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:41.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4bb682640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4b41eaa60 0x7fa4b406e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:41.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4bb682640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4b40ca8a0 0x7fa4b40cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4bb682640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b414f030 con 0x7fa4b41eaa60 2024-04-18T05:00:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4bb682640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b40cb260 con 0x7fa4a00047d0 2024-04-18T05:00:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4bb682640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b414e370 con 0x7fa4b40ca8a0 2024-04-18T05:00:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4b8c1d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4b41eaa60 0x7fa4b406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4b8c1d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4b41eaa60 0x7fa4b406e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57912/0 (socket says 172.21.15.96:57912) 2024-04-18T05:00:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4b8c1d640 1 -- 172.21.15.96:0/2590654971 learned_addr learned my addr 172.21.15.96:0/2590654971 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4b941e640 1 --2- 172.21.15.96:0/2590654971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4a00047d0 0x7fa4b4153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4b8c1d640 1 -- 172.21.15.96:0/2590654971 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4b40ca8a0 msgr2=0x7fa4b40cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4b9c1f640 1 --2- 172.21.15.96:0/2590654971 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4b40ca8a0 0x7fa4b40cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4b8c1d640 1 --2- 172.21.15.96:0/2590654971 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4b40ca8a0 0x7fa4b40cad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4b8c1d640 1 -- 172.21.15.96:0/2590654971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4a00047d0 msgr2=0x7fa4b4153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4b8c1d640 1 --2- 172.21.15.96:0/2590654971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4a00047d0 0x7fa4b4153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4b8c1d640 1 -- 172.21.15.96:0/2590654971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b414d760 con 0x7fa4b41eaa60 2024-04-18T05:00:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4b941e640 1 --2- 172.21.15.96:0/2590654971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4a00047d0 0x7fa4b4153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T05:00:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4b8c1d640 1 --2- 172.21.15.96:0/2590654971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4b41eaa60 0x7fa4b406e150 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa4a401c470 tx=0x7fa4a0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4a9ffb640 1 -- 172.21.15.96:0/2590654971 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a40bd070 con 0x7fa4b41eaa60 2024-04-18T05:00:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4a9ffb640 1 -- 172.21.15.96:0/2590654971 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a4004020 con 0x7fa4b41eaa60 2024-04-18T05:00:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4bb682640 1 -- 172.21.15.96:0/2590654971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b414da40 con 0x7fa4b41eaa60 2024-04-18T05:00:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4a9ffb640 1 -- 172.21.15.96:0/2590654971 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a40043d0 con 0x7fa4b41eaa60 2024-04-18T05:00:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.119+0000 7fa4bb682640 1 -- 172.21.15.96:0/2590654971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b414e000 con 0x7fa4b41eaa60 2024-04-18T05:00:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.123+0000 7fa4bb682640 1 -- 172.21.15.96:0/2590654971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b414e1c0 con 0x7fa4b41eaa60 2024-04-18T05:00:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.123+0000 7fa4a9ffb640 1 -- 172.21.15.96:0/2590654971 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa4a40b4040 con 0x7fa4b41eaa60 2024-04-18T05:00:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.123+0000 7fa4a9ffb640 1 --2- 172.21.15.96:0/2590654971 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa4980666c0 0x7fa498068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.123+0000 7fa4a9ffb640 1 -- 172.21.15.96:0/2590654971 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa4a411edd0 con 0x7fa4b41eaa60 2024-04-18T05:00:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.123+0000 7fa4b941e640 1 --2- 172.21.15.96:0/2590654971 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa4980666c0 0x7fa498068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:41.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.123+0000 7fa4b941e640 1 --2- 172.21.15.96:0/2590654971 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa4980666c0 0x7fa498068b80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00053e0 tx=0x7fa4b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:41.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.127+0000 7fa4a9ffb640 1 -- 172.21.15.96:0/2590654971 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa4a40ec320 con 0x7fa4b41eaa60 2024-04-18T05:00:41.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.335+0000 7fa4bb682640 1 -- 172.21.15.96:0/2590654971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa4b414e4e0 con 0x7fa4b41eaa60 2024-04-18T05:00:41.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.339+0000 7fa4a9ffb640 1 -- 172.21.15.96:0/2590654971 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7fa4a40ef940 con 0x7fa4b41eaa60 2024-04-18T05:00:41.340 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":56,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T05:00:41.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.339+0000 7fa4bb682640 1 -- 172.21.15.96:0/2590654971 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa4980666c0 msgr2=0x7fa498068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:41.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.339+0000 7fa4bb682640 1 --2- 172.21.15.96:0/2590654971 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa4980666c0 0x7fa498068b80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00053e0 tx=0x7fa4b0009040 comp rx=0 tx=0).stop 2024-04-18T05:00:41.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.339+0000 7fa4bb682640 1 -- 172.21.15.96:0/2590654971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4b41eaa60 msgr2=0x7fa4b406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.339+0000 7fa4bb682640 1 --2- 172.21.15.96:0/2590654971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4b41eaa60 0x7fa4b406e150 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa4a401c470 tx=0x7fa4a0005800 comp rx=0 tx=0).stop 2024-04-18T05:00:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.339+0000 7fa4bb682640 1 -- 172.21.15.96:0/2590654971 shutdown_connections 2024-04-18T05:00:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.339+0000 7fa4bb682640 1 --2- 172.21.15.96:0/2590654971 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa4980666c0 0x7fa498068b80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.339+0000 7fa4bb682640 1 --2- 172.21.15.96:0/2590654971 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4b40ca8a0 0x7fa4b40cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.339+0000 7fa4bb682640 1 --2- 172.21.15.96:0/2590654971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4b41eaa60 0x7fa4b406e150 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.339+0000 7fa4bb682640 1 --2- 172.21.15.96:0/2590654971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4a00047d0 0x7fa4b4153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.339+0000 7fa4bb682640 1 -- 172.21.15.96:0/2590654971 >> 172.21.15.96:0/2590654971 conn(0x7fa4b406c750 msgr2=0x7fa4b4146090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.339+0000 7fa4bb682640 1 -- 172.21.15.96:0/2590654971 shutdown_connections 2024-04-18T05:00:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:41.339+0000 7fa4bb682640 1 -- 172.21.15.96:0/2590654971 wait complete. 2024-04-18T05:00:44.358 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T05:00:44.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.487+0000 7f3676b3f640 1 Processor -- start 2024-04-18T05:00:44.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.487+0000 7f3676b3f640 1 -- start start 2024-04-18T05:00:44.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.487+0000 7f3676b3f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 0x7f3670070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:44.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.487+0000 7f3676b3f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 0x7f3670156050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:44.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.487+0000 7f3676b3f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36700721e0 con 0x7f367006dd10 2024-04-18T05:00:44.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.487+0000 7f3676b3f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36700c48a0 con 0x7f36700c1870 2024-04-18T05:00:44.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.487+0000 7f3676b3f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367006e1c0 con 0x7f367006d930 2024-04-18T05:00:44.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.487+0000 7f366ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 0x7f3670156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:44.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.491+0000 7f36750dc640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f367006dd10 0x7f36700c4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36970/0 (socket says 172.21.15.96:36970) 2024-04-18T05:00:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.491+0000 7f36750dc640 1 -- 172.21.15.96:0/870000379 learned_addr learned my addr 172.21.15.96:0/870000379 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:00:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.491+0000 7f366ffff640 1 -- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 msgr2=0x7f3670156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T05:00:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.491+0000 7f366ffff640 1 -- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 msgr2=0x7f3670156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.491+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 0x7f3670156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.491+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 0x7f3670156050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.491+0000 7f36748db640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 0x7f3670070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.491+0000 7f36748db640 1 -- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 msgr2=0x7f3670070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T05:00:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.491+0000 7f36748db640 1 -- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 msgr2=0x7f3670070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.491+0000 7f36748db640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 0x7f3670070fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:44.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.491+0000 7f36748db640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 0x7f3670070fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:44.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.695+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 0x7f3670156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:44.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.695+0000 7f36748db640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 0x7f3670070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:44.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.695+0000 7f366ffff640 1 -- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 msgr2=0x7f3670156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T05:00:44.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.695+0000 7f366ffff640 1 -- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 msgr2=0x7f3670156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:44.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.695+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 0x7f3670156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:44.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.695+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 0x7f3670156050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T05:00:44.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.695+0000 7f36748db640 1 -- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 msgr2=0x7f3670070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T05:00:44.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.695+0000 7f36748db640 1 -- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 msgr2=0x7f3670070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:44.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.695+0000 7f36748db640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 0x7f3670070fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:44.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:44.695+0000 7f36748db640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 0x7f3670070fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T05:00:45.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.099+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 0x7f3670156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:45.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.099+0000 7f366ffff640 1 -- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 msgr2=0x7f3670156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T05:00:45.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.099+0000 7f366ffff640 1 -- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 msgr2=0x7f3670156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:45.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.099+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 0x7f3670156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:45.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.099+0000 7f36748db640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 0x7f3670070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:45.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.099+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 0x7f3670156050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T05:00:45.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.099+0000 7f36748db640 1 -- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 msgr2=0x7f3670070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T05:00:45.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.099+0000 7f36748db640 1 -- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 msgr2=0x7f3670070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:45.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.099+0000 7f36748db640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 0x7f3670070fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:45.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.099+0000 7f36748db640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 0x7f3670070fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T05:00:45.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.903+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 0x7f3670156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:45.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.903+0000 7f366ffff640 1 -- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 msgr2=0x7f3670156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T05:00:45.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.903+0000 7f366ffff640 1 -- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 msgr2=0x7f3670156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:45.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.903+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 0x7f3670156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:45.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.903+0000 7f36748db640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 0x7f3670070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:45.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.903+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 0x7f3670156050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T05:00:45.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.903+0000 7f36748db640 1 -- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 msgr2=0x7f3670070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T05:00:45.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.903+0000 7f36748db640 1 -- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 msgr2=0x7f3670070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:45.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.903+0000 7f36748db640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 0x7f3670070fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:45.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:45.903+0000 7f36748db640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 0x7f3670070fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T05:00:47.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.487+0000 7f366e7fc640 1 -- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 msgr2=0x7f3670070fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T05:00:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.487+0000 7f366e7fc640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f367006d930 0x7f3670070fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.487+0000 7f366e7fc640 1 -- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 msgr2=0x7f3670156050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T05:00:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.487+0000 7f366e7fc640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.96:3300/0 conn(0x7f36700c1870 0x7f3670156050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.487+0000 7f366e7fc640 1 -- 172.21.15.96:0/870000379 >> v1:172.21.15.96:6789/0 conn(0x7f367006dd10 legacy=0x7f36700c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.491+0000 7f366e7fc640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 0x7f365c0098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.491+0000 7f366e7fc640 1 -- 172.21.15.96:0/870000379 --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3670070730 con 0x7f365c0036f0 2024-04-18T05:00:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.491+0000 7f366e7fc640 1 -- 172.21.15.96:0/870000379 --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367006e1c0 con 0x7f365c0073f0 2024-04-18T05:00:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.491+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 0x7f365c0098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.491+0000 7f366ffff640 1 -- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 msgr2=0x7f365c0098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T05:00:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.491+0000 7f366ffff640 1 -- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 msgr2=0x7f365c0098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.491+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 0x7f365c0098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:47.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.491+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 0x7f365c0098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:47.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.695+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 0x7f365c0098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:47.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.695+0000 7f366ffff640 1 -- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 msgr2=0x7f365c0098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T05:00:47.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.695+0000 7f366ffff640 1 -- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 msgr2=0x7f365c0098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:47.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.695+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 0x7f365c0098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:47.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:47.695+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 0x7f365c0098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T05:00:48.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.099+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 0x7f365c0098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:48.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.099+0000 7f366ffff640 1 -- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 msgr2=0x7f365c0098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T05:00:48.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.099+0000 7f366ffff640 1 -- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 msgr2=0x7f365c0098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T05:00:48.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.099+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 0x7f365c0098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:48.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.099+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 0x7f365c0098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T05:00:48.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.359+0000 7f366f7fe640 1 -- 172.21.15.96:0/870000379 <== mon.1 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152110040 0 0) 0x7f3670070730 con 0x7f365c0036f0 2024-04-18T05:00:48.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.359+0000 7f366f7fe640 1 -- 172.21.15.96:0/870000379 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3658003530 con 0x7f365c0036f0 2024-04-18T05:00:48.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.359+0000 7f366f7fe640 1 -- 172.21.15.96:0/870000379 <== mon.1 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1130604015 0 0) 0x7f3658003530 con 0x7f365c0036f0 2024-04-18T05:00:48.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.359+0000 7f366f7fe640 1 -- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 msgr2=0x7f365c0098b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T05:00:48.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.359+0000 7f366f7fe640 1 --2- 172.21.15.96:0/870000379 >> v2:172.21.15.139:3300/0 conn(0x7f365c0073f0 0x7f365c0098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:48.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.359+0000 7f366f7fe640 1 -- 172.21.15.96:0/870000379 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c00afb0 con 0x7f365c0036f0 2024-04-18T05:00:48.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f366f7fe640 1 -- 172.21.15.96:0/870000379 <== mon.1 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f366000c590 con 0x7f365c0036f0 2024-04-18T05:00:48.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f366f7fe640 1 -- 172.21.15.96:0/870000379 >> v1:172.21.15.139:6789/0 conn(0x7f365c0036f0 legacy=0x7f365c005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:48.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f36750dc640 1 -- 172.21.15.96:0/870000379 reap_dead start 2024-04-18T05:00:48.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f366f7fe640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36580039d0 0x7f3658003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:48.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f366f7fe640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36580047d0 0x7f3658004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:48.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f366f7fe640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3658005390 0x7f365800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:48.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f366f7fe640 1 -- 172.21.15.96:0/870000379 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367006e1c0 con 0x7f36580047d0 2024-04-18T05:00:48.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f366f7fe640 1 -- 172.21.15.96:0/870000379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365800c250 con 0x7f36580039d0 2024-04-18T05:00:48.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f366f7fe640 1 -- 172.21.15.96:0/870000379 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365800c410 con 0x7f3658005390 2024-04-18T05:00:48.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f36748db640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36580039d0 0x7f3658003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:48.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36580047d0 0x7f3658004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:48.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f36750dc640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3658005390 0x7f365800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:48.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f36748db640 1 -- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3658005390 msgr2=0x7f365800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:48.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f36748db640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3658005390 0x7f365800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:48.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f36748db640 1 -- 172.21.15.96:0/870000379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36580047d0 msgr2=0x7f3658004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:48.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f36748db640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36580047d0 0x7f3658004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:48.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f36748db640 1 -- 172.21.15.96:0/870000379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3658003530 con 0x7f36580039d0 2024-04-18T05:00:48.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.363+0000 7f366ffff640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36580047d0 0x7f3658004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T05:00:48.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.367+0000 7f36748db640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36580039d0 0x7f3658003dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3660000ee0 tx=0x7f366001db50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a2edd3c6cc33bae server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:48.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.375+0000 7f366f7fe640 1 -- 172.21.15.96:0/870000379 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36600a6af0 con 0x7f36580039d0 2024-04-18T05:00:48.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.375+0000 7f366f7fe640 1 -- 172.21.15.96:0/870000379 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36600aa070 con 0x7f36580039d0 2024-04-18T05:00:48.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.375+0000 7f366f7fe640 1 -- 172.21.15.96:0/870000379 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36600b0400 con 0x7f36580039d0 2024-04-18T05:00:48.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.375+0000 7f3676b3f640 1 -- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36580039d0 msgr2=0x7f3658003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:48.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.375+0000 7f3676b3f640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36580039d0 0x7f3658003dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3660000ee0 tx=0x7f366001db50 comp rx=0 tx=0).stop 2024-04-18T05:00:48.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.375+0000 7f3676b3f640 1 -- 172.21.15.96:0/870000379 shutdown_connections 2024-04-18T05:00:48.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.375+0000 7f3676b3f640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3658005390 0x7f365800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:48.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.375+0000 7f3676b3f640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36580047d0 0x7f3658004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:48.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.375+0000 7f3676b3f640 1 --2- 172.21.15.96:0/870000379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36580039d0 0x7f3658003dd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:48.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.375+0000 7f3676b3f640 1 -- 172.21.15.96:0/870000379 >> 172.21.15.96:0/870000379 conn(0x7f367006c750 msgr2=0x7f36700c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:48.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.375+0000 7f3676b3f640 1 -- 172.21.15.96:0/870000379 shutdown_connections 2024-04-18T05:00:48.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.375+0000 7f3676b3f640 1 -- 172.21.15.96:0/870000379 wait complete. 2024-04-18T05:00:48.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f3676b3f640 1 Processor -- start 2024-04-18T05:00:48.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f3676b3f640 1 -- start start 2024-04-18T05:00:48.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f3676b3f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f36580039d0 0x7f36701e0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:48.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f3676b3f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36580047d0 0x7f36701ed4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:48.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f3676b3f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3658005390 0x7f3670147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f3676b3f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36700ca160 con 0x7f36580047d0 2024-04-18T05:00:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f3676b3f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3670152920 con 0x7f3658005390 2024-04-18T05:00:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f3676b3f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3670152640 con 0x7f36580039d0 2024-04-18T05:00:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f366ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36580047d0 0x7f36701ed4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f366ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36580047d0 0x7f36701ed4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57962/0 (socket says 172.21.15.96:57962) 2024-04-18T05:00:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f366ffff640 1 -- 172.21.15.96:0/3043585744 learned_addr learned my addr 172.21.15.96:0/3043585744 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f36748db640 1 --2- 172.21.15.96:0/3043585744 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f36580039d0 0x7f36701e0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f36750dc640 1 --2- 172.21.15.96:0/3043585744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3658005390 0x7f3670147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f36748db640 1 -- 172.21.15.96:0/3043585744 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f36580039d0 msgr2=0x7f36701e0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-18T05:00:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f36748db640 1 -- 172.21.15.96:0/3043585744 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f36580039d0 msgr2=0x7f36701e0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T05:00:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f36748db640 1 --2- 172.21.15.96:0/3043585744 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f36580039d0 0x7f36701e0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f36748db640 1 --2- 172.21.15.96:0/3043585744 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f36580039d0 0x7f36701e0bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f366ffff640 1 -- 172.21.15.96:0/3043585744 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f36580039d0 msgr2=0x7f36701e0bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T05:00:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f366ffff640 1 --2- 172.21.15.96:0/3043585744 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f36580039d0 0x7f36701e0bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:48.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f366ffff640 1 -- 172.21.15.96:0/3043585744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3658005390 msgr2=0x7f3670147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:48.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f366ffff640 1 --2- 172.21.15.96:0/3043585744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3658005390 0x7f3670147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:48.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f366ffff640 1 -- 172.21.15.96:0/3043585744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36700c93a0 con 0x7f36580047d0 2024-04-18T05:00:48.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f366ffff640 1 --2- 172.21.15.96:0/3043585744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36580047d0 0x7f36701ed4e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3664010dc0 tx=0x7f366400f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:48.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f366d7fa640 1 -- 172.21.15.96:0/3043585744 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366401e870 con 0x7f36580047d0 2024-04-18T05:00:48.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f366d7fa640 1 -- 172.21.15.96:0/3043585744 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3664017040 con 0x7f36580047d0 2024-04-18T05:00:48.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f366d7fa640 1 -- 172.21.15.96:0/3043585744 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366401ec10 con 0x7f36580047d0 2024-04-18T05:00:48.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.379+0000 7f3676b3f640 1 -- 172.21.15.96:0/3043585744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36700c9680 con 0x7f36580047d0 2024-04-18T05:00:48.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.383+0000 7f3676b3f640 1 -- 172.21.15.96:0/3043585744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36700c9c40 con 0x7f36580047d0 2024-04-18T05:00:48.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.383+0000 7f3676b3f640 1 -- 172.21.15.96:0/3043585744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3670154320 con 0x7f36580047d0 2024-04-18T05:00:48.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.383+0000 7f366d7fa640 1 -- 172.21.15.96:0/3043585744 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3664027400 con 0x7f36580047d0 2024-04-18T05:00:48.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.383+0000 7f366d7fa640 1 --2- 172.21.15.96:0/3043585744 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f365c069e60 0x7f365c06c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.383+0000 7f366d7fa640 1 -- 172.21.15.96:0/3043585744 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f3664087b10 con 0x7f36580047d0 2024-04-18T05:00:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.383+0000 7f36748db640 1 --2- 172.21.15.96:0/3043585744 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f365c069e60 0x7f365c06c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.383+0000 7f36748db640 1 --2- 172.21.15.96:0/3043585744 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f365c069e60 0x7f365c06c320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f36600b1000 tx=0x7f3660004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:48.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.387+0000 7f366d7fa640 1 -- 172.21.15.96:0/3043585744 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f3664054ef0 con 0x7f36580047d0 2024-04-18T05:00:48.609 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T05:00:48.612 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T05:00:48.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.611+0000 7f3676b3f640 1 -- 172.21.15.96:0/3043585744 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3670067050 con 0x7f36580047d0 2024-04-18T05:00:48.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.611+0000 7f366d7fa640 1 -- 172.21.15.96:0/3043585744 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f3664011940 con 0x7f36580047d0 2024-04-18T05:00:48.614 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":60,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T05:00:48.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.615+0000 7f3676b3f640 1 -- 172.21.15.96:0/3043585744 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f365c069e60 msgr2=0x7f365c06c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:48.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.615+0000 7f3676b3f640 1 --2- 172.21.15.96:0/3043585744 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f365c069e60 0x7f365c06c320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f36600b1000 tx=0x7f3660004740 comp rx=0 tx=0).stop 2024-04-18T05:00:48.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.615+0000 7f3676b3f640 1 -- 172.21.15.96:0/3043585744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36580047d0 msgr2=0x7f36701ed4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:48.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.615+0000 7f3676b3f640 1 --2- 172.21.15.96:0/3043585744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36580047d0 0x7f36701ed4e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3664010dc0 tx=0x7f366400f7a0 comp rx=0 tx=0).stop 2024-04-18T05:00:48.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.615+0000 7f3676b3f640 1 -- 172.21.15.96:0/3043585744 shutdown_connections 2024-04-18T05:00:48.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.615+0000 7f3676b3f640 1 --2- 172.21.15.96:0/3043585744 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f365c069e60 0x7f365c06c320 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:48.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.615+0000 7f3676b3f640 1 --2- 172.21.15.96:0/3043585744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3658005390 0x7f3670147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:48.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.615+0000 7f3676b3f640 1 --2- 172.21.15.96:0/3043585744 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36580047d0 0x7f36701ed4e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:48.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.615+0000 7f3676b3f640 1 --2- 172.21.15.96:0/3043585744 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f36580039d0 0x7f36701e0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:48.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.615+0000 7f3676b3f640 1 -- 172.21.15.96:0/3043585744 >> 172.21.15.96:0/3043585744 conn(0x7f367006c750 msgr2=0x7f3670154820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:48.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.615+0000 7f3676b3f640 1 -- 172.21.15.96:0/3043585744 shutdown_connections 2024-04-18T05:00:48.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:48.615+0000 7f3676b3f640 1 -- 172.21.15.96:0/3043585744 wait complete. 2024-04-18T05:00:51.634 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T05:00:51.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.763+0000 7fd2d8ed3640 1 Processor -- start 2024-04-18T05:00:51.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.763+0000 7fd2d8ed3640 1 -- start start 2024-04-18T05:00:51.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.763+0000 7fd2d8ed3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd2d4151210 0x7fd2d40c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:51.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.763+0000 7fd2d8ed3640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2d40c1db0 0x7fd2d40ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:51.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.763+0000 7fd2d8ed3640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d4157150 con 0x7fd2d40ca840 2024-04-18T05:00:51.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.763+0000 7fd2d8ed3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d4157430 con 0x7fd2d4151210 2024-04-18T05:00:51.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.763+0000 7fd2d8ed3640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d4157710 con 0x7fd2d40c1db0 2024-04-18T05:00:51.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.763+0000 7fd2d259c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd2d4151210 0x7fd2d40c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.763+0000 7fd2d259c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd2d4151210 0x7fd2d40c1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58586/0 (socket says 172.21.15.96:58586) 2024-04-18T05:00:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.763+0000 7fd2d259c640 1 -- 172.21.15.96:0/3556562477 learned_addr learned my addr 172.21.15.96:0/3556562477 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.763+0000 7fd2d1d9b640 1 --2- 172.21.15.96:0/3556562477 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2d40c1db0 0x7fd2d40ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.763+0000 7fd2d259c640 1 -- 172.21.15.96:0/3556562477 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2d40c1db0 msgr2=0x7fd2d40ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.763+0000 7fd2d259c640 1 --2- 172.21.15.96:0/3556562477 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2d40c1db0 0x7fd2d40ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.763+0000 7fd2d259c640 1 -- 172.21.15.96:0/3556562477 >> v1:172.21.15.139:6789/0 conn(0x7fd2d40ca840 legacy=0x7fd2d415a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.763+0000 7fd2d259c640 1 -- 172.21.15.96:0/3556562477 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d41579f0 con 0x7fd2d4151210 2024-04-18T05:00:51.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.767+0000 7fd2d259c640 1 --2- 172.21.15.96:0/3556562477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2d4151210 0x7fd2d40c1870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009870 tx=0x7fd2bc01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c86d7c91f679032 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:51.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.767+0000 7fd2d159a640 1 -- 172.21.15.96:0/3556562477 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0a8a50 con 0x7fd2d4151210 2024-04-18T05:00:51.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.767+0000 7fd2d159a640 1 -- 172.21.15.96:0/3556562477 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc0a8bb0 con 0x7fd2d4151210 2024-04-18T05:00:51.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.767+0000 7fd2d159a640 1 -- 172.21.15.96:0/3556562477 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0b0440 con 0x7fd2d4151210 2024-04-18T05:00:51.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.767+0000 7fd2d8ed3640 1 -- 172.21.15.96:0/3556562477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2d4151210 msgr2=0x7fd2d40c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:51.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.767+0000 7fd2d8ed3640 1 --2- 172.21.15.96:0/3556562477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2d4151210 0x7fd2d40c1870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009870 tx=0x7fd2bc01ed50 comp rx=0 tx=0).stop 2024-04-18T05:00:51.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.767+0000 7fd2d8ed3640 1 -- 172.21.15.96:0/3556562477 shutdown_connections 2024-04-18T05:00:51.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.767+0000 7fd2d8ed3640 1 --2- 172.21.15.96:0/3556562477 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2d40c1db0 0x7fd2d40ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:51.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.767+0000 7fd2d8ed3640 1 --2- 172.21.15.96:0/3556562477 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2d4151210 0x7fd2d40c1870 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.767+0000 7fd2d8ed3640 1 -- 172.21.15.96:0/3556562477 >> 172.21.15.96:0/3556562477 conn(0x7fd2d406c750 msgr2=0x7fd2d40c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.767+0000 7fd2d8ed3640 1 -- 172.21.15.96:0/3556562477 shutdown_connections 2024-04-18T05:00:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.767+0000 7fd2d8ed3640 1 -- 172.21.15.96:0/3556562477 wait complete. 2024-04-18T05:00:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d8ed3640 1 Processor -- start 2024-04-18T05:00:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d8ed3640 1 -- start start 2024-04-18T05:00:51.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d8ed3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2d40c1db0 0x7fd2d41ecb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:51.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d8ed3640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2d40ca840 0x7fd2d40c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:51.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d8ed3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2d4151210 0x7fd2d414fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:51.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d8ed3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d40c9ca0 con 0x7fd2d4151210 2024-04-18T05:00:51.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d8ed3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d40c9f80 con 0x7fd2d40c1db0 2024-04-18T05:00:51.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d8ed3640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d40ca260 con 0x7fd2d40ca840 2024-04-18T05:00:51.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d2d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2d4151210 0x7fd2d414fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:51.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d2d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2d4151210 0x7fd2d414fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58596/0 (socket says 172.21.15.96:58596) 2024-04-18T05:00:51.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d2d9d640 1 -- 172.21.15.96:0/157914105 learned_addr learned my addr 172.21.15.96:0/157914105 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:51.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d1d9b640 1 --2- 172.21.15.96:0/157914105 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2d40ca840 0x7fd2d40c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:51.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d259c640 1 --2- 172.21.15.96:0/157914105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2d40c1db0 0x7fd2d41ecb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:51.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d2d9d640 1 -- 172.21.15.96:0/157914105 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2d40ca840 msgr2=0x7fd2d40c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:51.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d2d9d640 1 --2- 172.21.15.96:0/157914105 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2d40ca840 0x7fd2d40c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d2d9d640 1 -- 172.21.15.96:0/157914105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2d40c1db0 msgr2=0x7fd2d41ecb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d2d9d640 1 --2- 172.21.15.96:0/157914105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2d40c1db0 0x7fd2d41ecb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d2d9d640 1 -- 172.21.15.96:0/157914105 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc0094d0 con 0x7fd2d4151210 2024-04-18T05:00:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d1d9b640 1 --2- 172.21.15.96:0/157914105 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2d40ca840 0x7fd2d40c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:00:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d2d9d640 1 --2- 172.21.15.96:0/157914105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2d4151210 0x7fd2d414fef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00c770 tx=0x7fd2cc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2caffd640 1 -- 172.21.15.96:0/157914105 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc003b80 con 0x7fd2d4151210 2024-04-18T05:00:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2caffd640 1 -- 172.21.15.96:0/157914105 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc003ce0 con 0x7fd2d4151210 2024-04-18T05:00:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d8ed3640 1 -- 172.21.15.96:0/157914105 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d4156f20 con 0x7fd2d4151210 2024-04-18T05:00:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2caffd640 1 -- 172.21.15.96:0/157914105 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc00aa90 con 0x7fd2d4151210 2024-04-18T05:00:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d8ed3640 1 -- 172.21.15.96:0/157914105 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d40c84f0 con 0x7fd2d4151210 2024-04-18T05:00:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.771+0000 7fd2d8ed3640 1 -- 172.21.15.96:0/157914105 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d40c8710 con 0x7fd2d4151210 2024-04-18T05:00:51.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.775+0000 7fd2caffd640 1 -- 172.21.15.96:0/157914105 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd2cc00abf0 con 0x7fd2d4151210 2024-04-18T05:00:51.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.775+0000 7fd2caffd640 1 --2- 172.21.15.96:0/157914105 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd2b40666c0 0x7fd2b4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:51.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.775+0000 7fd2caffd640 1 -- 172.21.15.96:0/157914105 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd2cc084070 con 0x7fd2d4151210 2024-04-18T05:00:51.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.775+0000 7fd2d259c640 1 --2- 172.21.15.96:0/157914105 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd2b40666c0 0x7fd2b4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:51.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.775+0000 7fd2d259c640 1 --2- 172.21.15.96:0/157914105 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd2b40666c0 0x7fd2b4068b80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0b2000 tx=0x7fd2bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:51.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.779+0000 7fd2caffd640 1 -- 172.21.15.96:0/157914105 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd2cc0b5be0 con 0x7fd2d4151210 2024-04-18T05:00:51.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.991+0000 7fd2d8ed3640 1 -- 172.21.15.96:0/157914105 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd2d40c1500 con 0x7fd2d4151210 2024-04-18T05:00:51.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.991+0000 7fd2caffd640 1 -- 172.21.15.96:0/157914105 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7fd2cc051320 con 0x7fd2d4151210 2024-04-18T05:00:51.993 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T05:00:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.991+0000 7fd2d8ed3640 1 -- 172.21.15.96:0/157914105 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd2b40666c0 msgr2=0x7fd2b4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.991+0000 7fd2d8ed3640 1 --2- 172.21.15.96:0/157914105 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd2b40666c0 0x7fd2b4068b80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0b2000 tx=0x7fd2bc008040 comp rx=0 tx=0).stop 2024-04-18T05:00:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.991+0000 7fd2d8ed3640 1 -- 172.21.15.96:0/157914105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2d4151210 msgr2=0x7fd2d414fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.991+0000 7fd2d8ed3640 1 --2- 172.21.15.96:0/157914105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2d4151210 0x7fd2d414fef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00c770 tx=0x7fd2cc00cc30 comp rx=0 tx=0).stop 2024-04-18T05:00:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.991+0000 7fd2d8ed3640 1 -- 172.21.15.96:0/157914105 shutdown_connections 2024-04-18T05:00:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.991+0000 7fd2d8ed3640 1 --2- 172.21.15.96:0/157914105 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd2b40666c0 0x7fd2b4068b80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.991+0000 7fd2d8ed3640 1 --2- 172.21.15.96:0/157914105 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2d4151210 0x7fd2d414fef0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.991+0000 7fd2d8ed3640 1 --2- 172.21.15.96:0/157914105 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2d40ca840 0x7fd2d40c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.991+0000 7fd2d8ed3640 1 --2- 172.21.15.96:0/157914105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2d40c1db0 0x7fd2d41ecb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:51.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.991+0000 7fd2d8ed3640 1 -- 172.21.15.96:0/157914105 >> 172.21.15.96:0/157914105 conn(0x7fd2d406c750 msgr2=0x7fd2d40c2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:51.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.991+0000 7fd2d8ed3640 1 -- 172.21.15.96:0/157914105 shutdown_connections 2024-04-18T05:00:51.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:51.991+0000 7fd2d8ed3640 1 -- 172.21.15.96:0/157914105 wait complete. 2024-04-18T05:00:52.010 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-18T05:00:52.010 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-18T05:00:52.010 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-18T05:00:52.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.119+0000 7f49343a7640 1 Processor -- start 2024-04-18T05:00:52.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.119+0000 7f49343a7640 1 -- start start 2024-04-18T05:00:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.119+0000 7f49343a7640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f492c0c5b30 0x7f492c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.119+0000 7f49343a7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f492c15a270 0x7f492c0c1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.119+0000 7f49343a7640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492c06c650 con 0x7f492c0c6670 2024-04-18T05:00:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.119+0000 7f49343a7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492c157200 con 0x7f492c15a270 2024-04-18T05:00:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.119+0000 7f49343a7640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c0c6450 con 0x7f492c0c5b30 2024-04-18T05:00:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.119+0000 7f4931942640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f492c15a270 0x7f492c0c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.119+0000 7f4932944640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f492c0c6670 0x7f492c157620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45636/0 (socket says 172.21.15.96:45636) 2024-04-18T05:00:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.119+0000 7f4932944640 1 -- 172.21.15.96:0/3843340884 learned_addr learned my addr 172.21.15.96:0/3843340884 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:00:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.119+0000 7f4931942640 1 -- 172.21.15.96:0/3843340884 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f492c0c5b30 msgr2=0x7f492c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.119+0000 7f4932143640 1 --2- 172.21.15.96:0/3843340884 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f492c0c5b30 0x7f492c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.119+0000 7f4931141640 1 -- 172.21.15.96:0/3843340884 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136971178 0 0) 0x7f492c06c650 con 0x7f492c0c6670 2024-04-18T05:00:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.119+0000 7f4931942640 1 --2- 172.21.15.96:0/3843340884 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f492c0c5b30 0x7f492c0c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.119+0000 7f4931942640 1 -- 172.21.15.96:0/3843340884 >> v1:172.21.15.96:6789/0 conn(0x7f492c0c6670 legacy=0x7f492c157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.119+0000 7f4931942640 1 -- 172.21.15.96:0/3843340884 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c0c1d40 con 0x7f492c15a270 2024-04-18T05:00:52.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4931942640 1 --2- 172.21.15.96:0/3843340884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c15a270 0x7f492c0c1800 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f491c0097c0 tx=0x7f491c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4382aea6e326fb79 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:52.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4931141640 1 -- 172.21.15.96:0/3843340884 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0a8990 con 0x7f492c15a270 2024-04-18T05:00:52.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4931141640 1 -- 172.21.15.96:0/3843340884 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c0a8af0 con 0x7f492c15a270 2024-04-18T05:00:52.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4931141640 1 -- 172.21.15.96:0/3843340884 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0a8e80 con 0x7f492c15a270 2024-04-18T05:00:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 -- 172.21.15.96:0/3843340884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c15a270 msgr2=0x7f492c0c1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 --2- 172.21.15.96:0/3843340884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c15a270 0x7f492c0c1800 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f491c0097c0 tx=0x7f491c01ec90 comp rx=0 tx=0).stop 2024-04-18T05:00:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 -- 172.21.15.96:0/3843340884 shutdown_connections 2024-04-18T05:00:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 --2- 172.21.15.96:0/3843340884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c15a270 0x7f492c0c1800 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 --2- 172.21.15.96:0/3843340884 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f492c0c5b30 0x7f492c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 -- 172.21.15.96:0/3843340884 >> 172.21.15.96:0/3843340884 conn(0x7f492c06a8e0 msgr2=0x7f492c0c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 -- 172.21.15.96:0/3843340884 shutdown_connections 2024-04-18T05:00:52.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 -- 172.21.15.96:0/3843340884 wait complete. 2024-04-18T05:00:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 Processor -- start 2024-04-18T05:00:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 -- start start 2024-04-18T05:00:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f492c0c5b30 0x7f492c0bec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c0c6670 0x7f492c1ebbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f492c15a270 0x7f492c14be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1ef8b0 con 0x7f492c0c6670 2024-04-18T05:00:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c157e40 con 0x7f492c15a270 2024-04-18T05:00:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1ec120 con 0x7f492c0c5b30 2024-04-18T05:00:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4931942640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c0c6670 0x7f492c1ebbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4931942640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c0c6670 0x7f492c1ebbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58620/0 (socket says 172.21.15.96:58620) 2024-04-18T05:00:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4931942640 1 -- 172.21.15.96:0/1440803844 learned_addr learned my addr 172.21.15.96:0/1440803844 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4932143640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f492c0c5b30 0x7f492c0bec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4931942640 1 -- 172.21.15.96:0/1440803844 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f492c0c5b30 msgr2=0x7f492c0bec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4931942640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f492c0c5b30 0x7f492c0bec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4932944640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f492c15a270 0x7f492c14be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4931942640 1 -- 172.21.15.96:0/1440803844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f492c15a270 msgr2=0x7f492c14be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4931942640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f492c15a270 0x7f492c14be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4931942640 1 -- 172.21.15.96:0/1440803844 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c009420 con 0x7f492c0c6670 2024-04-18T05:00:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4931942640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c0c6670 0x7f492c1ebbe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f491c01d340 tx=0x7f491c01d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:52.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4922ffd640 1 -- 172.21.15.96:0/1440803844 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0a8990 con 0x7f492c0c6670 2024-04-18T05:00:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4922ffd640 1 -- 172.21.15.96:0/1440803844 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c004020 con 0x7f492c0c6670 2024-04-18T05:00:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f4922ffd640 1 -- 172.21.15.96:0/1440803844 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c004390 con 0x7f492c0c6670 2024-04-18T05:00:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 -- 172.21.15.96:0/1440803844 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492c158330 con 0x7f492c0c6670 2024-04-18T05:00:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.123+0000 7f49343a7640 1 -- 172.21.15.96:0/1440803844 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492c1ef1f0 con 0x7f492c0c6670 2024-04-18T05:00:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.127+0000 7f49343a7640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c1efbd0 0x7f492c146920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.127+0000 7f49343a7640 1 -- 172.21.15.96:0/1440803844 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c066b90 con 0x7f492c1efbd0 2024-04-18T05:00:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.127+0000 7f4932143640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c1efbd0 0x7f492c146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.127+0000 7f4932143640 1 -- 172.21.15.96:0/1440803844 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f492c06c090 con 0x7f492c1efbd0 2024-04-18T05:00:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.127+0000 7f4932143640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c1efbd0 0x7f492c146920 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f492800d540 tx=0x7f492800da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.127+0000 7f4922ffd640 1 -- 172.21.15.96:0/1440803844 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928012870 con 0x7f492c1efbd0 2024-04-18T05:00:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.127+0000 7f4922ffd640 1 -- 172.21.15.96:0/1440803844 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f491c003620 con 0x7f492c0c6670 2024-04-18T05:00:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.127+0000 7f4922ffd640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4910066760 0x7f4910068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.127+0000 7f4922ffd640 1 -- 172.21.15.96:0/1440803844 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f491c121c70 con 0x7f492c0c6670 2024-04-18T05:00:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.127+0000 7f4932944640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4910066760 0x7f4910068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.127+0000 7f4922ffd640 1 -- 172.21.15.96:0/1440803844 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f492800c040 con 0x7f492c1efbd0 2024-04-18T05:00:52.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.127+0000 7f4922ffd640 1 -- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c1efbd0 msgr2=0x7f492c146920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.127+0000 7f4922ffd640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c1efbd0 0x7f492c146920 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f492800d540 tx=0x7f492800da00 comp rx=0 tx=0).stop 2024-04-18T05:00:52.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.127+0000 7f4922ffd640 1 -- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c1efbd0 msgr2=0x7f492c146920 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T05:00:52.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.127+0000 7f4922ffd640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c1efbd0 0x7f492c146920 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.127+0000 7f4932944640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4910066760 0x7f4910068c20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f492c0c0440 tx=0x7f4924009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:52.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.131+0000 7f49343a7640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c146e60 0x7f492c148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.131+0000 7f49343a7640 1 -- 172.21.15.96:0/1440803844 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c0bf310 con 0x7f492c146e60 2024-04-18T05:00:52.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f4932143640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c146e60 0x7f492c148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f4932143640 1 -- 172.21.15.96:0/1440803844 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f492c0c1500 con 0x7f492c146e60 2024-04-18T05:00:52.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f4932143640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c146e60 0x7f492c148c30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f492800d540 tx=0x7f4928004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:52.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f4922ffd640 1 -- 172.21.15.96:0/1440803844 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928020040 con 0x7f492c146e60 2024-04-18T05:00:52.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f4922ffd640 1 -- 172.21.15.96:0/1440803844 <== mon.0 v2:172.21.15.96:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7f492801be70 con 0x7f492c146e60 2024-04-18T05:00:52.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f4922ffd640 1 -- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c146e60 msgr2=0x7f492c148c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f4922ffd640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c146e60 0x7f492c148c30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f492800d540 tx=0x7f4928004740 comp rx=0 tx=0).stop 2024-04-18T05:00:52.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f4922ffd640 1 -- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c146e60 msgr2=0x7f492c148c30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T05:00:52.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f4922ffd640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c146e60 0x7f492c148c30 secure :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f492800d540 tx=0x7f4928004740 comp rx=0 tx=0).stop 2024-04-18T05:00:52.137 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T05:00:52.137 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T05:00:52.137 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T05:00:52.137 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "leader", 2024-04-18T05:00:52.137 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 62, 2024-04-18T05:00:52.138 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T05:00:52.138 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T05:00:52.138 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T05:00:52.138 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T05:00:52.138 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:52.138 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 2, 2024-04-18T05:00:52.138 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T05:00:52.138 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T05:00:52.138 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T05:00:52.138 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:52.138 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:52.138 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:52.138 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:52.138 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:52.138 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:52.139 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:52.139 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:52.139 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:52.139 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:52.139 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:52.139 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T05:00:52.139 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T05:00:52.139 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:52.139 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:52.139 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:52.139 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:52.139 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:52.139 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:52.139 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:52.140 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:52.140 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:52.140 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:52.140 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:52.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.140 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T05:00:52.140 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T05:00:52.140 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T05:00:52.140 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T05:00:52.140 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T05:00:52.140 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T05:00:52.140 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T05:00:52.140 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T05:00:52.140 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T05:00:52.140 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T05:00:52.140 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T05:00:52.141 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T05:00:52.141 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T05:00:52.141 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T05:00:52.141 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T05:00:52.141 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T05:00:52.141 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T05:00:52.141 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:52.141 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:52.141 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:52.141 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:52.141 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:52.141 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:52.141 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:52.141 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:52.142 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:52.142 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:52.142 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:52.142 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T05:00:52.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.142 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T05:00:52.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.142 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T05:00:52.142 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T05:00:52.142 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:52.142 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:52.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.142 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:52.142 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T05:00:52.142 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:52.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.143 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:52.143 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T05:00:52.143 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:52.143 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:52.143 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:52.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.143 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T05:00:52.143 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T05:00:52.143 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:52.143 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:52.143 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:52.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.144 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T05:00:52.144 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T05:00:52.144 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:52.144 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:52.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.144 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:52.144 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T05:00:52.144 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:52.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.144 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:52.144 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T05:00:52.144 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:52.144 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:52.144 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:52.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.145 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T05:00:52.145 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T05:00:52.145 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:52.145 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:52.145 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:52.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.145 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T05:00:52.145 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T05:00:52.145 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:52.145 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:52.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.145 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:52.145 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T05:00:52.146 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:52.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.146 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:52.146 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T05:00:52.146 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:52.146 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:52.146 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:52.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.146 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T05:00:52.146 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T05:00:52.146 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:52.146 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:52.146 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:52.147 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:52.147 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:52.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.147 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T05:00:52.147 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T05:00:52.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.147 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:52.147 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:52.147 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T05:00:52.147 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:52.147 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:52.147 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T05:00:52.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.147 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:52.147 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:52.147 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5 2024-04-18T05:00:52.148 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:52.148 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:52.148 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": [ 2024-04-18T05:00:52.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.148 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:52.148 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:52.148 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 8 2024-04-18T05:00:52.148 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:52.148 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:52.148 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T05:00:52.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.148 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:52.148 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:52.148 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 7 2024-04-18T05:00:52.149 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:52.149 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:52.149 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": [ 2024-04-18T05:00:52.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.149 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:52.149 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:52.149 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 2 2024-04-18T05:00:52.149 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:52.149 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:52.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.149 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T05:00:52.149 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T05:00:52.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f49343a7640 1 -- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4910066760 msgr2=0x7f4910068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f49343a7640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4910066760 0x7f4910068c20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f492c0c0440 tx=0x7f4924009040 comp rx=0 tx=0).stop 2024-04-18T05:00:52.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f49343a7640 1 -- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c0c6670 msgr2=0x7f492c1ebbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f49343a7640 1 --2- 172.21.15.96:0/1440803844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f492c0c6670 0x7f492c1ebbe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f491c01d340 tx=0x7f491c01d4d0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f4932944640 1 -- 172.21.15.96:0/1440803844 reap_dead start 2024-04-18T05:00:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f4932944640 1 -- 172.21.15.96:0/1440803844 reap_dead start 2024-04-18T05:00:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f49343a7640 1 -- 172.21.15.96:0/1440803844 shutdown_connections 2024-04-18T05:00:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f49343a7640 1 -- 172.21.15.96:0/1440803844 >> 172.21.15.96:0/1440803844 conn(0x7f492c06a8e0 msgr2=0x7f492c14f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f49343a7640 1 -- 172.21.15.96:0/1440803844 shutdown_connections 2024-04-18T05:00:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.135+0000 7f49343a7640 1 -- 172.21.15.96:0/1440803844 wait complete. 2024-04-18T05:00:52.152 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T05:00:52.152 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-18T05:00:52.152 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-18T05:00:52.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a79a8640 1 Processor -- start 2024-04-18T05:00:52.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a79a8640 1 -- start start 2024-04-18T05:00:52.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a79a8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd4a0153060 0x7fd4a00c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a79a8640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4a0158cd0 0x7fd4a00c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a79a8640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a00c9610 con 0x7fd4a01590f0 2024-04-18T05:00:52.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a79a8640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a0153440 con 0x7fd4a0153060 2024-04-18T05:00:52.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a79a8640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a01595f0 con 0x7fd4a0158cd0 2024-04-18T05:00:52.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a5f45640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd4a01590f0 0x7fd4a00c4480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45640/0 (socket says 172.21.15.96:45640) 2024-04-18T05:00:52.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a5f45640 1 -- 172.21.15.96:0/801665509 learned_addr learned my addr 172.21.15.96:0/801665509 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:00:52.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a5744640 1 --2- 172.21.15.96:0/801665509 >> v2:172.21.15.139:3300/0 conn(0x7fd4a0153060 0x7fd4a00c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a4f43640 1 --2- 172.21.15.96:0/801665509 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4a0158cd0 0x7fd4a00c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd497fff640 1 -- 172.21.15.96:0/801665509 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951300185 0 0) 0x7fd4a00c9610 con 0x7fd4a01590f0 2024-04-18T05:00:52.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd497fff640 1 -- 172.21.15.96:0/801665509 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd48c003530 con 0x7fd4a01590f0 2024-04-18T05:00:52.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd497fff640 1 -- 172.21.15.96:0/801665509 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3539613009 0 0) 0x7fd48c003530 con 0x7fd4a01590f0 2024-04-18T05:00:52.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd497fff640 1 -- 172.21.15.96:0/801665509 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4a0158cd0 msgr2=0x7fd4a00c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:52.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd497fff640 1 --2- 172.21.15.96:0/801665509 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4a0158cd0 0x7fd4a00c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd497fff640 1 -- 172.21.15.96:0/801665509 >> v2:172.21.15.139:3300/0 conn(0x7fd4a0153060 msgr2=0x7fd4a00c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:52.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd497fff640 1 --2- 172.21.15.96:0/801665509 >> v2:172.21.15.139:3300/0 conn(0x7fd4a0153060 0x7fd4a00c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd497fff640 1 -- 172.21.15.96:0/801665509 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a01598d0 con 0x7fd4a01590f0 2024-04-18T05:00:52.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd497fff640 1 -- 172.21.15.96:0/801665509 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fd498001a00 con 0x7fd4a01590f0 2024-04-18T05:00:52.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd497fff640 1 -- 172.21.15.96:0/801665509 >> v1:172.21.15.96:6789/0 conn(0x7fd4a01590f0 legacy=0x7fd4a00c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd497fff640 1 --2- 172.21.15.96:0/801665509 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4a0158cd0 0x7fd48c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd497fff640 1 --2- 172.21.15.96:0/801665509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd48c003f00 0x7fd48c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd497fff640 1 --2- 172.21.15.96:0/801665509 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd48c004d10 0x7fd48c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd497fff640 1 -- 172.21.15.96:0/801665509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a0153440 con 0x7fd48c003f00 2024-04-18T05:00:52.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd497fff640 1 -- 172.21.15.96:0/801665509 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a01595f0 con 0x7fd48c004d10 2024-04-18T05:00:52.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd497fff640 1 -- 172.21.15.96:0/801665509 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c00ba70 con 0x7fd4a0158cd0 2024-04-18T05:00:52.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a4f43640 1 --2- 172.21.15.96:0/801665509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd48c003f00 0x7fd48c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a5744640 1 --2- 172.21.15.96:0/801665509 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4a0158cd0 0x7fd48c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a4f43640 1 -- 172.21.15.96:0/801665509 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4a0158cd0 msgr2=0x7fd48c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:52.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a4f43640 1 --2- 172.21.15.96:0/801665509 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4a0158cd0 0x7fd48c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a4f43640 1 -- 172.21.15.96:0/801665509 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd48c004d10 msgr2=0x7fd48c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:52.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a4f43640 1 --2- 172.21.15.96:0/801665509 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd48c004d10 0x7fd48c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a4f43640 1 -- 172.21.15.96:0/801665509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c003530 con 0x7fd48c003f00 2024-04-18T05:00:52.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.263+0000 7fd4a5744640 1 --2- 172.21.15.96:0/801665509 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4a0158cd0 0x7fd48c003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:00:52.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.267+0000 7fd4a4f43640 1 --2- 172.21.15.96:0/801665509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd48c003f00 0x7fd48c0047d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd49000ba30 tx=0x7fd49001c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6065b7a5ec5a17 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:52.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.267+0000 7fd497fff640 1 -- 172.21.15.96:0/801665509 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4900a9680 con 0x7fd48c003f00 2024-04-18T05:00:52.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.267+0000 7fd497fff640 1 -- 172.21.15.96:0/801665509 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4900a97e0 con 0x7fd48c003f00 2024-04-18T05:00:52.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.267+0000 7fd497fff640 1 -- 172.21.15.96:0/801665509 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4900a9b90 con 0x7fd48c003f00 2024-04-18T05:00:52.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.267+0000 7fd4a79a8640 1 -- 172.21.15.96:0/801665509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd48c003f00 msgr2=0x7fd48c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.267+0000 7fd4a79a8640 1 --2- 172.21.15.96:0/801665509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd48c003f00 0x7fd48c0047d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd49000ba30 tx=0x7fd49001c6a0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.267+0000 7fd4a5f45640 1 -- 172.21.15.96:0/801665509 reap_dead start 2024-04-18T05:00:52.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.267+0000 7fd4a79a8640 1 -- 172.21.15.96:0/801665509 shutdown_connections 2024-04-18T05:00:52.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.267+0000 7fd4a79a8640 1 -- 172.21.15.96:0/801665509 >> 172.21.15.96:0/801665509 conn(0x7fd4a006b470 msgr2=0x7fd4a006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:52.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.267+0000 7fd4a79a8640 1 -- 172.21.15.96:0/801665509 shutdown_connections 2024-04-18T05:00:52.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.267+0000 7fd4a79a8640 1 -- 172.21.15.96:0/801665509 wait complete. 2024-04-18T05:00:52.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.267+0000 7fd4a79a8640 1 Processor -- start 2024-04-18T05:00:52.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.267+0000 7fd4a79a8640 1 -- start start 2024-04-18T05:00:52.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a79a8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a00b2240 0x7fd4a00b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a79a8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4a00b2620 0x7fd4a014da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a79a8640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4a00c9e80 0x7fd4a00ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a79a8640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a01f2d60 con 0x7fd4a00b2620 2024-04-18T05:00:52.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a79a8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a01535c0 con 0x7fd4a00b2240 2024-04-18T05:00:52.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a79a8640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00ca840 con 0x7fd4a00c9e80 2024-04-18T05:00:52.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a4f43640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4a00b2620 0x7fd4a014da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a4f43640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4a00b2620 0x7fd4a014da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58666/0 (socket says 172.21.15.96:58666) 2024-04-18T05:00:52.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a4f43640 1 -- 172.21.15.96:0/1058743826 learned_addr learned my addr 172.21.15.96:0/1058743826 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:52.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a5744640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a00b2240 0x7fd4a00b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a5f45640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4a00c9e80 0x7fd4a00ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a4f43640 1 -- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4a00c9e80 msgr2=0x7fd4a00ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a4f43640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4a00c9e80 0x7fd4a00ca300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a4f43640 1 -- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a00b2240 msgr2=0x7fd4a00b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a4f43640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a00b2240 0x7fd4a00b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a4f43640 1 -- 172.21.15.96:0/1058743826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a01f2120 con 0x7fd4a00b2620 2024-04-18T05:00:52.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a5744640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a00b2240 0x7fd4a00b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:00:52.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a4f43640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4a00b2620 0x7fd4a014da10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd49001c4d0 tx=0x7fd48c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:52.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd495ffb640 1 -- 172.21.15.96:0/1058743826 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4900b3450 con 0x7fd4a00b2620 2024-04-18T05:00:52.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd495ffb640 1 -- 172.21.15.96:0/1058743826 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4900b35b0 con 0x7fd4a00b2620 2024-04-18T05:00:52.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a79a8640 1 -- 172.21.15.96:0/1058743826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a01f23c0 con 0x7fd4a00b2620 2024-04-18T05:00:52.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd495ffb640 1 -- 172.21.15.96:0/1058743826 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4900b3940 con 0x7fd4a00b2620 2024-04-18T05:00:52.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a79a8640 1 -- 172.21.15.96:0/1058743826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a01f2980 con 0x7fd4a00b2620 2024-04-18T05:00:52.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a79a8640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a00c9870 0x7fd4a0148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a79a8640 1 -- 172.21.15.96:0/1058743826 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a0072290 con 0x7fd4a00c9870 2024-04-18T05:00:52.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a5744640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a00c9870 0x7fd4a0148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd495ffb640 1 -- 172.21.15.96:0/1058743826 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd4900b3aa0 con 0x7fd4a00b2620 2024-04-18T05:00:52.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a5744640 1 -- 172.21.15.96:0/1058743826 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4a00c3c80 con 0x7fd4a00c9870 2024-04-18T05:00:52.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd495ffb640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd484066690 0x7fd484068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a5f45640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd484066690 0x7fd484068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd495ffb640 1 -- 172.21.15.96:0/1058743826 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd49011e1f0 con 0x7fd4a00b2620 2024-04-18T05:00:52.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a5744640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a00c9870 0x7fd4a0148cf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd49c011830 tx=0x7fd49c011cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:52.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd495ffb640 1 -- 172.21.15.96:0/1058743826 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c004230 con 0x7fd4a00c9870 2024-04-18T05:00:52.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.271+0000 7fd4a5f45640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd484066690 0x7fd484068b50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00c5a40 tx=0x7fd498009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:52.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.275+0000 7fd495ffb640 1 -- 172.21.15.96:0/1058743826 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fd49c004390 con 0x7fd4a00c9870 2024-04-18T05:00:52.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.275+0000 7fd495ffb640 1 -- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a00c9870 msgr2=0x7fd4a0148cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.275+0000 7fd495ffb640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a00c9870 0x7fd4a0148cf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd49c011830 tx=0x7fd49c011cf0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.275+0000 7fd495ffb640 1 -- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a00c9870 msgr2=0x7fd4a0148cf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T05:00:52.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.275+0000 7fd495ffb640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a00c9870 0x7fd4a0148cf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.279+0000 7fd4a79a8640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a0149230 0x7fd4a01e52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.279+0000 7fd4a79a8640 1 -- 172.21.15.96:0/1058743826 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00c39a0 con 0x7fd4a0149230 2024-04-18T05:00:52.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.279+0000 7fd4a5744640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a0149230 0x7fd4a01e52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.279+0000 7fd4a5744640 1 -- 172.21.15.96:0/1058743826 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd4a00c3f60 con 0x7fd4a0149230 2024-04-18T05:00:52.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.279+0000 7fd4a5744640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a0149230 0x7fd4a01e52c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd49c01b000 tx=0x7fd49c004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:52.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.279+0000 7fd495ffb640 1 -- 172.21.15.96:0/1058743826 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c02b070 con 0x7fd4a0149230 2024-04-18T05:00:52.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.283+0000 7fd495ffb640 1 -- 172.21.15.96:0/1058743826 <== mon.1 v2:172.21.15.139:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4635 (secure 0 0 0) 0x7fd49c023040 con 0x7fd4a0149230 2024-04-18T05:00:52.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.283+0000 7fd495ffb640 1 -- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a0149230 msgr2=0x7fd4a01e52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.283+0000 7fd495ffb640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a0149230 0x7fd4a01e52c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd49c01b000 tx=0x7fd49c004740 comp rx=0 tx=0).stop 2024-04-18T05:00:52.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.283+0000 7fd495ffb640 1 -- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a0149230 msgr2=0x7fd4a01e52c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T05:00:52.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.283+0000 7fd495ffb640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4a0149230 0x7fd4a01e52c0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd49c01b000 tx=0x7fd49c004740 comp rx=0 tx=0).stop 2024-04-18T05:00:52.284 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T05:00:52.284 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T05:00:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T05:00:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T05:00:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 62, 2024-04-18T05:00:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T05:00:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T05:00:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T05:00:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T05:00:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 2, 2024-04-18T05:00:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T05:00:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T05:00:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T05:00:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T05:00:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T05:00:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T05:00:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T05:00:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T05:00:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T05:00:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T05:00:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T05:00:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T05:00:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T05:00:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T05:00:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T05:00:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T05:00:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T05:00:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T05:00:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T05:00:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T05:00:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T05:00:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T05:00:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T05:00:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T05:00:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T05:00:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T05:00:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T05:00:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T05:00:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T05:00:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T05:00:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T05:00:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T05:00:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T05:00:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T05:00:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T05:00:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T05:00:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T05:00:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T05:00:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T05:00:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T05:00:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T05:00:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T05:00:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T05:00:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T05:00:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T05:00:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": [ 2024-04-18T05:00:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T05:00:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T05:00:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T05:00:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T05:00:52.296 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T05:00:52.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.283+0000 7fd4a79a8640 1 -- 172.21.15.96:0/1058743826 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd484066690 msgr2=0x7fd484068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.283+0000 7fd4a79a8640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd484066690 0x7fd484068b50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00c5a40 tx=0x7fd498009040 comp rx=0 tx=0).stop 2024-04-18T05:00:52.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.283+0000 7fd4a79a8640 1 -- 172.21.15.96:0/1058743826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4a00b2620 msgr2=0x7fd4a014da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.283+0000 7fd4a79a8640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4a00b2620 0x7fd4a014da10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd49001c4d0 tx=0x7fd48c005800 comp rx=0 tx=0).stop 2024-04-18T05:00:52.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.283+0000 7fd4a5f45640 1 -- 172.21.15.96:0/1058743826 reap_dead start 2024-04-18T05:00:52.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.283+0000 7fd4a79a8640 1 -- 172.21.15.96:0/1058743826 shutdown_connections 2024-04-18T05:00:52.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.283+0000 7fd4a79a8640 1 --2- 172.21.15.96:0/1058743826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4a00b2620 0x7fd4a014da10 secure :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd49001c4d0 tx=0x7fd48c005800 comp rx=0 tx=0).stop 2024-04-18T05:00:52.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.283+0000 7fd4a79a8640 1 -- 172.21.15.96:0/1058743826 >> 172.21.15.96:0/1058743826 conn(0x7fd4a006b470 msgr2=0x7fd4a0150890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:52.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.283+0000 7fd4a79a8640 1 -- 172.21.15.96:0/1058743826 shutdown_connections 2024-04-18T05:00:52.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.283+0000 7fd4a79a8640 1 -- 172.21.15.96:0/1058743826 wait complete. 2024-04-18T05:00:52.299 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T05:00:52.299 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-18T05:00:52.300 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-18T05:00:52.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.411+0000 7f17827f9640 1 Processor -- start 2024-04-18T05:00:52.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.411+0000 7f17827f9640 1 -- start start 2024-04-18T05:00:52.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.411+0000 7f17827f9640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c5b30 0x7f177c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.411+0000 7f17827f9640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f177c15a270 0x7f177c0c1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.411+0000 7f17827f9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177c06c650 con 0x7f177c0c6670 2024-04-18T05:00:52.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.411+0000 7f17827f9640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177c157200 con 0x7f177c15a270 2024-04-18T05:00:52.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.411+0000 7f17827f9640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0c6450 con 0x7f177c0c5b30 2024-04-18T05:00:52.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.411+0000 7f177b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f177c15a270 0x7f177c0c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.411+0000 7f1780d96640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f177c0c6670 0x7f177c157620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45654/0 (socket says 172.21.15.96:45654) 2024-04-18T05:00:52.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.411+0000 7f1780d96640 1 -- 172.21.15.96:0/3896300325 learned_addr learned my addr 172.21.15.96:0/3896300325 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:00:52.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.411+0000 7f177bfff640 1 --2- 172.21.15.96:0/3896300325 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c5b30 0x7f177c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.411+0000 7f177b7fe640 1 -- 172.21.15.96:0/3896300325 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c5b30 msgr2=0x7f177c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:52.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.411+0000 7f177affd640 1 -- 172.21.15.96:0/3896300325 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922646502 0 0) 0x7f177c06c650 con 0x7f177c0c6670 2024-04-18T05:00:52.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.411+0000 7f177b7fe640 1 --2- 172.21.15.96:0/3896300325 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c5b30 0x7f177c0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.411+0000 7f177b7fe640 1 -- 172.21.15.96:0/3896300325 >> v1:172.21.15.96:6789/0 conn(0x7f177c0c6670 legacy=0x7f177c157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.411+0000 7f177b7fe640 1 -- 172.21.15.96:0/3896300325 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c0c1d40 con 0x7f177c15a270 2024-04-18T05:00:52.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.415+0000 7f177b7fe640 1 --2- 172.21.15.96:0/3896300325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f177c15a270 0x7f177c0c1800 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f17700097c0 tx=0x7f177001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49bc3d03a3a3bfbe server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:52.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.415+0000 7f177affd640 1 -- 172.21.15.96:0/3896300325 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17700a8990 con 0x7f177c15a270 2024-04-18T05:00:52.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.415+0000 7f177affd640 1 -- 172.21.15.96:0/3896300325 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17700a8af0 con 0x7f177c15a270 2024-04-18T05:00:52.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.415+0000 7f177affd640 1 -- 172.21.15.96:0/3896300325 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17700a8e80 con 0x7f177c15a270 2024-04-18T05:00:52.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.415+0000 7f17827f9640 1 -- 172.21.15.96:0/3896300325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f177c15a270 msgr2=0x7f177c0c1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.415+0000 7f17827f9640 1 --2- 172.21.15.96:0/3896300325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f177c15a270 0x7f177c0c1800 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f17700097c0 tx=0x7f177001ec90 comp rx=0 tx=0).stop 2024-04-18T05:00:52.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.415+0000 7f17827f9640 1 -- 172.21.15.96:0/3896300325 shutdown_connections 2024-04-18T05:00:52.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.415+0000 7f17827f9640 1 --2- 172.21.15.96:0/3896300325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f177c15a270 0x7f177c0c1800 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.415+0000 7f17827f9640 1 --2- 172.21.15.96:0/3896300325 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c5b30 0x7f177c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.415+0000 7f17827f9640 1 -- 172.21.15.96:0/3896300325 >> 172.21.15.96:0/3896300325 conn(0x7f177c06a8e0 msgr2=0x7f177c0c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:52.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.415+0000 7f17827f9640 1 -- 172.21.15.96:0/3896300325 shutdown_connections 2024-04-18T05:00:52.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.415+0000 7f17827f9640 1 -- 172.21.15.96:0/3896300325 wait complete. 2024-04-18T05:00:52.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.415+0000 7f17827f9640 1 Processor -- start 2024-04-18T05:00:52.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.415+0000 7f17827f9640 1 -- start start 2024-04-18T05:00:52.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f17827f9640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c5b30 0x7f177c148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f17827f9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f177c0c6670 0x7f177c1ef830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f17827f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f177c15a270 0x7f177c1efd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f17827f9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0caa20 con 0x7f177c0c6670 2024-04-18T05:00:52.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f17827f9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c14ac40 con 0x7f177c15a270 2024-04-18T05:00:52.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f17827f9640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0bfe50 con 0x7f177c0c5b30 2024-04-18T05:00:52.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f177b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f177c0c6670 0x7f177c1ef830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f177b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f177c0c6670 0x7f177c1ef830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58676/0 (socket says 172.21.15.96:58676) 2024-04-18T05:00:52.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f177b7fe640 1 -- 172.21.15.96:0/897253861 learned_addr learned my addr 172.21.15.96:0/897253861 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:52.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f177bfff640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c5b30 0x7f177c148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f177b7fe640 1 -- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c5b30 msgr2=0x7f177c148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f1780d96640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f177c15a270 0x7f177c1efd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f177b7fe640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c5b30 0x7f177c148f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f177b7fe640 1 -- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f177c15a270 msgr2=0x7f177c1efd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:52.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f177b7fe640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f177c15a270 0x7f177c1efd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:52.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f177b7fe640 1 -- 172.21.15.96:0/897253861 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1770009420 con 0x7f177c0c6670 2024-04-18T05:00:52.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f177b7fe640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f177c0c6670 0x7f177c1ef830 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f177001c8c0 tx=0x7f177001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:52.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f1778ff9640 1 -- 172.21.15.96:0/897253861 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17700b9630 con 0x7f177c0c6670 2024-04-18T05:00:52.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f1778ff9640 1 -- 172.21.15.96:0/897253861 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17700b9790 con 0x7f177c0c6670 2024-04-18T05:00:52.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f17827f9640 1 -- 172.21.15.96:0/897253861 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177c0bf890 con 0x7f177c0c6670 2024-04-18T05:00:52.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f1778ff9640 1 -- 172.21.15.96:0/897253861 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17700b9b40 con 0x7f177c0c6670 2024-04-18T05:00:52.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f17827f9640 1 -- 172.21.15.96:0/897253861 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177c1ec440 con 0x7f177c0c6670 2024-04-18T05:00:52.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f17827f9640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 0x7f177c1f02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f17827f9640 1 -- 172.21.15.96:0/897253861 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c066b90 con 0x7f177c0c0780 2024-04-18T05:00:52.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f177bfff640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 0x7f177c1f02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f177bfff640 1 -- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 msgr2=0x7f177c1f02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-04-18T05:00:52.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f177bfff640 1 -- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 msgr2=0x7f177c1f02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T05:00:52.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f177bfff640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 0x7f177c1f02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:52.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f177bfff640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 0x7f177c1f02b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T05:00:52.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f1778ff9640 1 -- 172.21.15.96:0/897253861 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f17700b7040 con 0x7f177c0c6670 2024-04-18T05:00:52.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f1778ff9640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f17680666c0 0x7f1768068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:52.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f1778ff9640 1 -- 172.21.15.96:0/897253861 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f17701220d0 con 0x7f177c0c6670 2024-04-18T05:00:52.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f1780d96640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f17680666c0 0x7f1768068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.419+0000 7f1780d96640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f17680666c0 0x7f1768068b80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f17740012f0 tx=0x7f1774009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:52.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.623+0000 7f177bfff640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 0x7f177c1f02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:52.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.623+0000 7f177bfff640 1 -- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 msgr2=0x7f177c1f02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-04-18T05:00:52.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.623+0000 7f177bfff640 1 -- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 msgr2=0x7f177c1f02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T05:00:52.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.623+0000 7f177bfff640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 0x7f177c1f02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T05:00:52.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:52.623+0000 7f177bfff640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 0x7f177c1f02b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T05:00:53.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.027+0000 7f177bfff640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 0x7f177c1f02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:53.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.027+0000 7f177bfff640 1 -- 172.21.15.96:0/897253861 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f177c1ec2c0 con 0x7f177c0c0780 2024-04-18T05:00:53.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.027+0000 7f177bfff640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 0x7f177c1f02b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f176c012810 tx=0x7f176c012cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:53.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.027+0000 7f1778ff9640 1 -- 172.21.15.96:0/897253861 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c004220 con 0x7f177c0c0780 2024-04-18T05:00:53.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.027+0000 7f1778ff9640 1 -- 172.21.15.96:0/897253861 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f176c00c040 con 0x7f177c0c0780 2024-04-18T05:00:53.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.027+0000 7f1778ff9640 1 -- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 msgr2=0x7f177c1f02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:53.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.027+0000 7f1778ff9640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 0x7f177c1f02b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f176c012810 tx=0x7f176c012cd0 comp rx=0 tx=0).stop 2024-04-18T05:00:53.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.027+0000 7f1778ff9640 1 -- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 msgr2=0x7f177c1f02b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T05:00:53.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.027+0000 7f1778ff9640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c0780 0x7f177c1f02b0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f176c012810 tx=0x7f176c012cd0 comp rx=0 tx=0).stop 2024-04-18T05:00:53.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.035+0000 7f17827f9640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c8b10 0x7f177c1ec630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:53.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.035+0000 7f17827f9640 1 -- 172.21.15.96:0/897253861 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c06c090 con 0x7f177c0c8b10 2024-04-18T05:00:53.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.035+0000 7f177bfff640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c8b10 0x7f177c1ec630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:53.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.035+0000 7f177bfff640 1 -- 172.21.15.96:0/897253861 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f177c0c1500 con 0x7f177c0c8b10 2024-04-18T05:00:53.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.035+0000 7f177bfff640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c8b10 0x7f177c1ec630 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f176c011010 tx=0x7f176c004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:53.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.035+0000 7f1778ff9640 1 -- 172.21.15.96:0/897253861 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c003e00 con 0x7f177c0c8b10 2024-04-18T05:00:53.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.035+0000 7f1778ff9640 1 -- 172.21.15.96:0/897253861 <== mon.2 v2:172.21.15.139:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7f176c0153f0 con 0x7f177c0c8b10 2024-04-18T05:00:53.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.035+0000 7f1778ff9640 1 -- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c8b10 msgr2=0x7f177c1ec630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:53.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.035+0000 7f1778ff9640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c8b10 0x7f177c1ec630 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f176c011010 tx=0x7f176c004740 comp rx=0 tx=0).stop 2024-04-18T05:00:53.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.035+0000 7f1778ff9640 1 -- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c8b10 msgr2=0x7f177c1ec630 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-18T05:00:53.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.035+0000 7f1778ff9640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f177c0c8b10 0x7f177c1ec630 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:53.040 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T05:00:53.040 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T05:00:53.040 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T05:00:53.040 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "peon", 2024-04-18T05:00:53.040 INFO:teuthology.orchestra.run.smithi096.stdout: "election_epoch": 62, 2024-04-18T05:00:53.040 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum": [ 2024-04-18T05:00:53.040 INFO:teuthology.orchestra.run.smithi096.stdout: 0, 2024-04-18T05:00:53.040 INFO:teuthology.orchestra.run.smithi096.stdout: 1, 2024-04-18T05:00:53.041 INFO:teuthology.orchestra.run.smithi096.stdout: 2 2024-04-18T05:00:53.041 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:53.041 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_age": 3, 2024-04-18T05:00:53.041 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T05:00:53.041 INFO:teuthology.orchestra.run.smithi096.stdout: "required_con": "2449958758054445060", 2024-04-18T05:00:53.041 INFO:teuthology.orchestra.run.smithi096.stdout: "required_mon": [ 2024-04-18T05:00:53.041 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:53.041 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:53.041 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:53.041 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:53.041 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:53.041 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:53.041 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:53.041 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:53.041 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:53.042 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:53.042 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:53.042 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_con": "4540138322906710015", 2024-04-18T05:00:53.042 INFO:teuthology.orchestra.run.smithi096.stdout: "quorum_mon": [ 2024-04-18T05:00:53.042 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:53.042 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:53.042 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:53.042 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:53.042 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:53.042 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:53.042 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:53.042 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:53.042 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:53.042 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:53.042 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:53.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:53.043 INFO:teuthology.orchestra.run.smithi096.stdout: "outside_quorum": [], 2024-04-18T05:00:53.043 INFO:teuthology.orchestra.run.smithi096.stdout: "extra_probe_peers": [], 2024-04-18T05:00:53.043 INFO:teuthology.orchestra.run.smithi096.stdout: "sync_provider": [], 2024-04-18T05:00:53.043 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": { 2024-04-18T05:00:53.043 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 1, 2024-04-18T05:00:53.043 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "8d7e5b20-8020-4511-8581-fbe2b42a23db", 2024-04-18T05:00:53.043 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-18T04:53:48.921127Z", 2024-04-18T05:00:53.043 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-18T04:53:48.921127Z", 2024-04-18T05:00:53.043 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release": 18, 2024-04-18T05:00:53.043 INFO:teuthology.orchestra.run.smithi096.stdout: "min_mon_release_name": "reef", 2024-04-18T05:00:53.043 INFO:teuthology.orchestra.run.smithi096.stdout: "election_strategy": 1, 2024-04-18T05:00:53.043 INFO:teuthology.orchestra.run.smithi096.stdout: "disallowed_leaders: ": "", 2024-04-18T05:00:53.043 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false, 2024-04-18T05:00:53.043 INFO:teuthology.orchestra.run.smithi096.stdout: "tiebreaker_mon": "", 2024-04-18T05:00:53.044 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_ranks: ": "", 2024-04-18T05:00:53.044 INFO:teuthology.orchestra.run.smithi096.stdout: "features": { 2024-04-18T05:00:53.044 INFO:teuthology.orchestra.run.smithi096.stdout: "persistent": [ 2024-04-18T05:00:53.044 INFO:teuthology.orchestra.run.smithi096.stdout: "kraken", 2024-04-18T05:00:53.044 INFO:teuthology.orchestra.run.smithi096.stdout: "luminous", 2024-04-18T05:00:53.044 INFO:teuthology.orchestra.run.smithi096.stdout: "mimic", 2024-04-18T05:00:53.044 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap-prune", 2024-04-18T05:00:53.044 INFO:teuthology.orchestra.run.smithi096.stdout: "nautilus", 2024-04-18T05:00:53.044 INFO:teuthology.orchestra.run.smithi096.stdout: "octopus", 2024-04-18T05:00:53.044 INFO:teuthology.orchestra.run.smithi096.stdout: "pacific", 2024-04-18T05:00:53.044 INFO:teuthology.orchestra.run.smithi096.stdout: "elector-pinging", 2024-04-18T05:00:53.044 INFO:teuthology.orchestra.run.smithi096.stdout: "quincy", 2024-04-18T05:00:53.044 INFO:teuthology.orchestra.run.smithi096.stdout: "reef" 2024-04-18T05:00:53.044 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:53.044 INFO:teuthology.orchestra.run.smithi096.stdout: "optional": [] 2024-04-18T05:00:53.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:53.045 INFO:teuthology.orchestra.run.smithi096.stdout: "mons": [ 2024-04-18T05:00:53.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:53.045 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 0, 2024-04-18T05:00:53.045 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "a", 2024-04-18T05:00:53.045 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:53.045 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:53.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:53.045 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:53.045 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:3300", 2024-04-18T05:00:53.045 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:53.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:53.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:53.045 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:53.045 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789", 2024-04-18T05:00:53.045 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:53.046 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:53.046 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:53.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:53.046 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:6789/0", 2024-04-18T05:00:53.046 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.96:6789/0", 2024-04-18T05:00:53.046 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:53.046 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:53.046 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:53.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:53.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:53.046 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 1, 2024-04-18T05:00:53.046 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "b", 2024-04-18T05:00:53.046 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:53.046 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:53.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:53.047 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:53.047 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3300", 2024-04-18T05:00:53.047 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:53.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:53.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:53.047 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:53.047 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789", 2024-04-18T05:00:53.047 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:53.047 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:53.047 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:53.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:53.047 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6789/0", 2024-04-18T05:00:53.047 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6789/0", 2024-04-18T05:00:53.047 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: "rank": 2, 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "c", 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:3301", 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790", 2024-04-18T05:00:53.048 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 0 2024-04-18T05:00:53.049 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:53.049 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:53.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:53.049 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.139:6790/0", 2024-04-18T05:00:53.049 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.139:6790/0", 2024-04-18T05:00:53.049 INFO:teuthology.orchestra.run.smithi096.stdout: "priority": 0, 2024-04-18T05:00:53.049 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 0, 2024-04-18T05:00:53.049 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "{}" 2024-04-18T05:00:53.049 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:53.049 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:53.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:53.050 INFO:teuthology.orchestra.run.smithi096.stdout: "feature_map": { 2024-04-18T05:00:53.050 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": [ 2024-04-18T05:00:53.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:53.050 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:53.050 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:53.050 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T05:00:53.050 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:53.050 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-18T05:00:53.050 INFO:teuthology.orchestra.run.smithi096.stdout: "client": [ 2024-04-18T05:00:53.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-18T05:00:53.050 INFO:teuthology.orchestra.run.smithi096.stdout: "features": "0x3f01cfbffffdffff", 2024-04-18T05:00:53.050 INFO:teuthology.orchestra.run.smithi096.stdout: "release": "luminous", 2024-04-18T05:00:53.050 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 1 2024-04-18T05:00:53.050 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-18T05:00:53.051 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-18T05:00:53.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-18T05:00:53.051 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": false 2024-04-18T05:00:53.051 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T05:00:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.039+0000 7f17827f9640 1 -- 172.21.15.96:0/897253861 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f17680666c0 msgr2=0x7f1768068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.039+0000 7f17827f9640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f17680666c0 0x7f1768068b80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f17740012f0 tx=0x7f1774009040 comp rx=0 tx=0).stop 2024-04-18T05:00:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.039+0000 7f17827f9640 1 -- 172.21.15.96:0/897253861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f177c0c6670 msgr2=0x7f177c1ef830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.039+0000 7f17827f9640 1 --2- 172.21.15.96:0/897253861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f177c0c6670 0x7f177c1ef830 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f177001c8c0 tx=0x7f177001ba30 comp rx=0 tx=0).stop 2024-04-18T05:00:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.039+0000 7f1780d96640 1 -- 172.21.15.96:0/897253861 reap_dead start 2024-04-18T05:00:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.039+0000 7f1780d96640 1 -- 172.21.15.96:0/897253861 reap_dead start 2024-04-18T05:00:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.039+0000 7f17827f9640 1 -- 172.21.15.96:0/897253861 shutdown_connections 2024-04-18T05:00:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.039+0000 7f17827f9640 1 -- 172.21.15.96:0/897253861 >> 172.21.15.96:0/897253861 conn(0x7f177c06a8e0 msgr2=0x7f177c0c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.039+0000 7f17827f9640 1 -- 172.21.15.96:0/897253861 shutdown_connections 2024-04-18T05:00:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.039+0000 7f17827f9640 1 -- 172.21.15.96:0/897253861 wait complete. 2024-04-18T05:00:53.060 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-18T05:00:53.060 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-18T05:00:53.060 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-18T05:00:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.175+0000 7f602c95d640 1 Processor -- start 2024-04-18T05:00:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.175+0000 7f602c95d640 1 -- start start 2024-04-18T05:00:53.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.175+0000 7f602c95d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6028151210 0x7f60280c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:53.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.175+0000 7f602c95d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f602815a950 0x7f602815adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:53.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.175+0000 7f602c95d640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602815b300 con 0x7f60280c1db0 2024-04-18T05:00:53.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.175+0000 7f602c95d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6028157150 con 0x7f6028151210 2024-04-18T05:00:53.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.175+0000 7f602c95d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6028157430 con 0x7f602815a950 2024-04-18T05:00:53.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.175+0000 7f602659c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6028151210 0x7f60280c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:53.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.175+0000 7f602659c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6028151210 0x7f60280c1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58686/0 (socket says 172.21.15.96:58686) 2024-04-18T05:00:53.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.175+0000 7f602659c640 1 -- 172.21.15.96:0/1850656972 learned_addr learned my addr 172.21.15.96:0/1850656972 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:53.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.175+0000 7f6026d9d640 1 --2- 172.21.15.96:0/1850656972 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f602815a950 0x7f602815adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:53.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.175+0000 7f602659c640 1 -- 172.21.15.96:0/1850656972 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f602815a950 msgr2=0x7f602815adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:00:53.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.175+0000 7f602659c640 1 --2- 172.21.15.96:0/1850656972 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f602815a950 0x7f602815adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:53.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.175+0000 7f602659c640 1 -- 172.21.15.96:0/1850656972 >> v1:172.21.15.139:6789/0 conn(0x7f60280c1db0 legacy=0x7f60280ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:53.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.175+0000 7f602659c640 1 -- 172.21.15.96:0/1850656972 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6028157710 con 0x7f6028151210 2024-04-18T05:00:53.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.179+0000 7f602659c640 1 --2- 172.21.15.96:0/1850656972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6028151210 0x7f60280c1870 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6018009870 tx=0x7f601801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13682d67eb59ad9f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:53.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.179+0000 7f602559a640 1 -- 172.21.15.96:0/1850656972 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60180a8a50 con 0x7f6028151210 2024-04-18T05:00:53.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.179+0000 7f602559a640 1 -- 172.21.15.96:0/1850656972 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60180a8bb0 con 0x7f6028151210 2024-04-18T05:00:53.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.179+0000 7f602559a640 1 -- 172.21.15.96:0/1850656972 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60180b0440 con 0x7f6028151210 2024-04-18T05:00:53.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.179+0000 7f602c95d640 1 -- 172.21.15.96:0/1850656972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6028151210 msgr2=0x7f60280c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:53.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.179+0000 7f602c95d640 1 --2- 172.21.15.96:0/1850656972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6028151210 0x7f60280c1870 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6018009870 tx=0x7f601801ed50 comp rx=0 tx=0).stop 2024-04-18T05:00:53.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.179+0000 7f602c95d640 1 -- 172.21.15.96:0/1850656972 shutdown_connections 2024-04-18T05:00:53.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.179+0000 7f602c95d640 1 --2- 172.21.15.96:0/1850656972 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f602815a950 0x7f602815adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:53.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.179+0000 7f602c95d640 1 --2- 172.21.15.96:0/1850656972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6028151210 0x7f60280c1870 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:53.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.179+0000 7f602c95d640 1 -- 172.21.15.96:0/1850656972 >> 172.21.15.96:0/1850656972 conn(0x7f602806c750 msgr2=0x7f60280c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:53.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.179+0000 7f602c95d640 1 -- 172.21.15.96:0/1850656972 shutdown_connections 2024-04-18T05:00:53.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.179+0000 7f602c95d640 1 -- 172.21.15.96:0/1850656972 wait complete. 2024-04-18T05:00:53.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f602c95d640 1 Processor -- start 2024-04-18T05:00:53.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f602c95d640 1 -- start start 2024-04-18T05:00:53.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f602c95d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f60280c1db0 0x7f60281525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:53.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f602c95d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6028151210 0x7f60281502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:53.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f602c95d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f602815a950 0x7f60281534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:53.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f602c95d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6028152ae0 con 0x7f6028151210 2024-04-18T05:00:53.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f602c95d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60280ca080 con 0x7f602815a950 2024-04-18T05:00:53.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f602c95d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6028151a10 con 0x7f60280c1db0 2024-04-18T05:00:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f6025d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6028151210 0x7f60281502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f6025d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6028151210 0x7f60281502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58690/0 (socket says 172.21.15.96:58690) 2024-04-18T05:00:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f6025d9b640 1 -- 172.21.15.96:0/716676766 learned_addr learned my addr 172.21.15.96:0/716676766 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:00:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f6026d9d640 1 --2- 172.21.15.96:0/716676766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f602815a950 0x7f60281534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f602659c640 1 --2- 172.21.15.96:0/716676766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f60280c1db0 0x7f60281525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f6025d9b640 1 -- 172.21.15.96:0/716676766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f60280c1db0 msgr2=0x7f60281525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f6025d9b640 1 --2- 172.21.15.96:0/716676766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f60280c1db0 0x7f60281525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f6025d9b640 1 -- 172.21.15.96:0/716676766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f602815a950 msgr2=0x7f60281534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f6025d9b640 1 --2- 172.21.15.96:0/716676766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f602815a950 0x7f60281534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f6025d9b640 1 -- 172.21.15.96:0/716676766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60180094d0 con 0x7f6028151210 2024-04-18T05:00:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f6025d9b640 1 --2- 172.21.15.96:0/716676766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6028151210 0x7f60281502f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f601c00c3c0 tx=0x7f601c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f6016ffd640 1 -- 172.21.15.96:0/716676766 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c0052d0 con 0x7f6028151210 2024-04-18T05:00:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f6016ffd640 1 -- 172.21.15.96:0/716676766 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c005430 con 0x7f6028151210 2024-04-18T05:00:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f602c95d640 1 -- 172.21.15.96:0/716676766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602815a220 con 0x7f6028151210 2024-04-18T05:00:53.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f6016ffd640 1 -- 172.21.15.96:0/716676766 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c003840 con 0x7f6028151210 2024-04-18T05:00:53.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f602c95d640 1 -- 172.21.15.96:0/716676766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6028151750 con 0x7f6028151210 2024-04-18T05:00:53.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.183+0000 7f602c95d640 1 -- 172.21.15.96:0/716676766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6028067050 con 0x7f6028151210 2024-04-18T05:00:53.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.187+0000 7f6016ffd640 1 -- 172.21.15.96:0/716676766 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f601c0039a0 con 0x7f6028151210 2024-04-18T05:00:53.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.187+0000 7f6016ffd640 1 --2- 172.21.15.96:0/716676766 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f60080666c0 0x7f6008068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:00:53.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.187+0000 7f6016ffd640 1 -- 172.21.15.96:0/716676766 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f601c083600 con 0x7f6028151210 2024-04-18T05:00:53.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.187+0000 7f602659c640 1 --2- 172.21.15.96:0/716676766 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f60080666c0 0x7f6008068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:00:53.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.187+0000 7f602659c640 1 --2- 172.21.15.96:0/716676766 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f60080666c0 0x7f6008068b80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f60180b2000 tx=0x7f6018008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:00:53.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.191+0000 7f6016ffd640 1 -- 172.21.15.96:0/716676766 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f601c0509e0 con 0x7f6028151210 2024-04-18T05:00:53.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.391+0000 7f602c95d640 1 -- 172.21.15.96:0/716676766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f60280c6c50 con 0x7f6028151210 2024-04-18T05:00:53.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.391+0000 7f6016ffd640 1 -- 172.21.15.96:0/716676766 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f601c054000 con 0x7f6028151210 2024-04-18T05:00:53.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.391+0000 7f602c95d640 1 -- 172.21.15.96:0/716676766 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f60080666c0 msgr2=0x7f6008068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:53.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.391+0000 7f602c95d640 1 --2- 172.21.15.96:0/716676766 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f60080666c0 0x7f6008068b80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f60180b2000 tx=0x7f6018008040 comp rx=0 tx=0).stop 2024-04-18T05:00:53.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.391+0000 7f602c95d640 1 -- 172.21.15.96:0/716676766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6028151210 msgr2=0x7f60281502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:00:53.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.391+0000 7f602c95d640 1 --2- 172.21.15.96:0/716676766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6028151210 0x7f60281502f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f601c00c3c0 tx=0x7f601c00c880 comp rx=0 tx=0).stop 2024-04-18T05:00:53.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.391+0000 7f602c95d640 1 -- 172.21.15.96:0/716676766 shutdown_connections 2024-04-18T05:00:53.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.391+0000 7f602c95d640 1 --2- 172.21.15.96:0/716676766 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f60080666c0 0x7f6008068b80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:53.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.391+0000 7f602c95d640 1 --2- 172.21.15.96:0/716676766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f602815a950 0x7f60281534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:53.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.391+0000 7f602c95d640 1 --2- 172.21.15.96:0/716676766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6028151210 0x7f60281502f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:53.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.391+0000 7f602c95d640 1 --2- 172.21.15.96:0/716676766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f60280c1db0 0x7f60281525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:00:53.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.395+0000 7f602c95d640 1 -- 172.21.15.96:0/716676766 >> 172.21.15.96:0/716676766 conn(0x7f602806c750 msgr2=0x7f6028156640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:00:53.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.395+0000 7f602c95d640 1 -- 172.21.15.96:0/716676766 shutdown_connections 2024-04-18T05:00:53.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:00:53.395+0000 7f602c95d640 1 -- 172.21.15.96:0/716676766 wait complete. 2024-04-18T05:00:53.411 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-18T05:01:03.412 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T05:01:03.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.543+0000 7fe74e3cf640 1 Processor -- start 2024-04-18T05:01:03.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.543+0000 7fe74e3cf640 1 -- start start 2024-04-18T05:01:03.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe74e3cf640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe74815b060 0x7fe7480ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:03.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe74e3cf640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe748157150 con 0x7fe748151210 2024-04-18T05:01:03.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe74e3cf640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe748157430 con 0x7fe7480ca300 2024-04-18T05:01:03.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe74e3cf640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe748157710 con 0x7fe74815b060 2024-04-18T05:01:03.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe747fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe748151210 0x7fe7480c1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59914/0 (socket says 172.21.15.96:59914) 2024-04-18T05:01:03.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe747fff640 1 -- 172.21.15.96:0/1809227469 learned_addr learned my addr 172.21.15.96:0/1809227469 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:01:03.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe74c96c640 1 --2- 172.21.15.96:0/1809227469 >> v2:172.21.15.139:3300/0 conn(0x7fe74815b060 0x7fe7480ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:03.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe746ffd640 1 -- 172.21.15.96:0/1809227469 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940884881 0 0) 0x7fe748157150 con 0x7fe748151210 2024-04-18T05:01:03.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe746ffd640 1 -- 172.21.15.96:0/1809227469 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe730003530 con 0x7fe748151210 2024-04-18T05:01:03.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe746ffd640 1 -- 172.21.15.96:0/1809227469 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1939060811 0 0) 0x7fe730003530 con 0x7fe748151210 2024-04-18T05:01:03.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe746ffd640 1 -- 172.21.15.96:0/1809227469 >> v2:172.21.15.139:3300/0 conn(0x7fe74815b060 msgr2=0x7fe7480ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:03.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe746ffd640 1 --2- 172.21.15.96:0/1809227469 >> v2:172.21.15.139:3300/0 conn(0x7fe74815b060 0x7fe7480ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe746ffd640 1 -- 172.21.15.96:0/1809227469 >> v1:172.21.15.139:6789/0 conn(0x7fe7480ca300 legacy=0x7fe74815a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:03.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe746ffd640 1 -- 172.21.15.96:0/1809227469 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7481579f0 con 0x7fe748151210 2024-04-18T05:01:03.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe746ffd640 1 -- 172.21.15.96:0/1809227469 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7fe738001680 con 0x7fe748151210 2024-04-18T05:01:03.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe746ffd640 1 -- 172.21.15.96:0/1809227469 >> v1:172.21.15.96:6789/0 conn(0x7fe748151210 legacy=0x7fe7480c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:03.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe746ffd640 1 --2- 172.21.15.96:0/1809227469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe730003980 0x7fe730003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:03.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe746ffd640 1 --2- 172.21.15.96:0/1809227469 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe7300047d0 0x7fe730004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:03.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe746ffd640 1 --2- 172.21.15.96:0/1809227469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe730005190 0x7fe73000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:03.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe746ffd640 1 -- 172.21.15.96:0/1809227469 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe748157710 con 0x7fe730003980 2024-04-18T05:01:03.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe746ffd640 1 -- 172.21.15.96:0/1809227469 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73000c040 con 0x7fe730005190 2024-04-18T05:01:03.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe746ffd640 1 -- 172.21.15.96:0/1809227469 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73000c200 con 0x7fe7300047d0 2024-04-18T05:01:03.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe747fff640 1 --2- 172.21.15.96:0/1809227469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe730003980 0x7fe730003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:03.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe747fff640 1 -- 172.21.15.96:0/1809227469 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe7300047d0 msgr2=0x7fe730004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:03.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe747fff640 1 --2- 172.21.15.96:0/1809227469 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe7300047d0 0x7fe730004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe747fff640 1 -- 172.21.15.96:0/1809227469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe730005190 msgr2=0x7fe73000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:03.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe747fff640 1 --2- 172.21.15.96:0/1809227469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe730005190 0x7fe73000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe74c96c640 1 -- 172.21.15.96:0/1809227469 reap_dead start 2024-04-18T05:01:03.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe747fff640 1 -- 172.21.15.96:0/1809227469 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe730003530 con 0x7fe730003980 2024-04-18T05:01:03.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.547+0000 7fe747fff640 1 --2- 172.21.15.96:0/1809227469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe730003980 0x7fe730003da0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe73800c1c0 tx=0x7fe73801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19da7e56c7cf6652 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:03.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe746ffd640 1 -- 172.21.15.96:0/1809227469 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738005ae0 con 0x7fe730003980 2024-04-18T05:01:03.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe746ffd640 1 -- 172.21.15.96:0/1809227469 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7380ab070 con 0x7fe730003980 2024-04-18T05:01:03.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe746ffd640 1 -- 172.21.15.96:0/1809227469 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738005ea0 con 0x7fe730003980 2024-04-18T05:01:03.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 -- 172.21.15.96:0/1809227469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe730003980 msgr2=0x7fe730003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:03.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 --2- 172.21.15.96:0/1809227469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe730003980 0x7fe730003da0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe73800c1c0 tx=0x7fe73801f3b0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 -- 172.21.15.96:0/1809227469 shutdown_connections 2024-04-18T05:01:03.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 --2- 172.21.15.96:0/1809227469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe730003980 0x7fe730003da0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 -- 172.21.15.96:0/1809227469 >> 172.21.15.96:0/1809227469 conn(0x7fe74806c750 msgr2=0x7fe7480c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:03.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 -- 172.21.15.96:0/1809227469 shutdown_connections 2024-04-18T05:01:03.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 -- 172.21.15.96:0/1809227469 wait complete. 2024-04-18T05:01:03.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 Processor -- start 2024-04-18T05:01:03.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 -- start start 2024-04-18T05:01:03.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe730003980 0x7fe7481503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:03.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe74814b4c0 0x7fe7481f0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:03.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7481ec8f0 0x7fe7481558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:03.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74814cd80 con 0x7fe74814b4c0 2024-04-18T05:01:03.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74814dd70 con 0x7fe7481ec8f0 2024-04-18T05:01:03.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7481f0370 con 0x7fe730003980 2024-04-18T05:01:03.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe7477fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe74814b4c0 0x7fe7481f0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:03.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe7477fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe74814b4c0 0x7fe7481f0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33706/0 (socket says 172.21.15.96:33706) 2024-04-18T05:01:03.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe7477fe640 1 -- 172.21.15.96:0/2847973384 learned_addr learned my addr 172.21.15.96:0/2847973384 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:03.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe747fff640 1 --2- 172.21.15.96:0/2847973384 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe730003980 0x7fe7481503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:03.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74c96c640 1 --2- 172.21.15.96:0/2847973384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7481ec8f0 0x7fe7481558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:03.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe7477fe640 1 -- 172.21.15.96:0/2847973384 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe730003980 msgr2=0x7fe7481503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:03.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe7477fe640 1 --2- 172.21.15.96:0/2847973384 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe730003980 0x7fe7481503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe7477fe640 1 -- 172.21.15.96:0/2847973384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7481ec8f0 msgr2=0x7fe7481558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:03.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe7477fe640 1 --2- 172.21.15.96:0/2847973384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7481ec8f0 0x7fe7481558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe7477fe640 1 -- 172.21.15.96:0/2847973384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe748156f20 con 0x7fe74814b4c0 2024-04-18T05:01:03.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe7477fe640 1 --2- 172.21.15.96:0/2847973384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe74814b4c0 0x7fe7481f0800 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00c490 tx=0x7fe73c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:03.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe744ff9640 1 -- 172.21.15.96:0/2847973384 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c0052d0 con 0x7fe74814b4c0 2024-04-18T05:01:03.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe744ff9640 1 -- 172.21.15.96:0/2847973384 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c005450 con 0x7fe74814b4c0 2024-04-18T05:01:03.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 -- 172.21.15.96:0/2847973384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7481f0d40 con 0x7fe74814b4c0 2024-04-18T05:01:03.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe744ff9640 1 -- 172.21.15.96:0/2847973384 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c012870 con 0x7fe74814b4c0 2024-04-18T05:01:03.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.551+0000 7fe74e3cf640 1 -- 172.21.15.96:0/2847973384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74814d250 con 0x7fe74814b4c0 2024-04-18T05:01:03.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.555+0000 7fe74e3cf640 1 -- 172.21.15.96:0/2847973384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7480c6600 con 0x7fe74814b4c0 2024-04-18T05:01:03.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.555+0000 7fe744ff9640 1 -- 172.21.15.96:0/2847973384 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe73c0129d0 con 0x7fe74814b4c0 2024-04-18T05:01:03.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.555+0000 7fe744ff9640 1 --2- 172.21.15.96:0/2847973384 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe734066690 0x7fe734068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:03.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.555+0000 7fe744ff9640 1 -- 172.21.15.96:0/2847973384 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe73c083d60 con 0x7fe74814b4c0 2024-04-18T05:01:03.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.555+0000 7fe747fff640 1 --2- 172.21.15.96:0/2847973384 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe734066690 0x7fe734068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:03.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.555+0000 7fe747fff640 1 --2- 172.21.15.96:0/2847973384 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe734066690 0x7fe734068b50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe7380af000 tx=0x7fe7380aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:03.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.559+0000 7fe744ff9640 1 -- 172.21.15.96:0/2847973384 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe73c051020 con 0x7fe74814b4c0 2024-04-18T05:01:03.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.743+0000 7fe74e3cf640 1 -- 172.21.15.96:0/2847973384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe748067050 con 0x7fe74814b4c0 2024-04-18T05:01:03.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.747+0000 7fe744ff9640 1 -- 172.21.15.96:0/2847973384 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6313 (secure 0 0 0) 0x7fe73c054640 con 0x7fe74814b4c0 2024-04-18T05:01:03.748 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T05:01:03.748 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/4225147900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":4225147900},{"type":"v1","addr":"172.21.15.96:6839","nonce":4225147900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:54:41.158866+0000","modified":"2024-04-18T04:55:09.695142+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4273,"mds_1":4249,"mds_2":4239,"mds_3":4232,"mds_4":4229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4229":{"gid":4229,"name":"d","rank":4,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.139:6836/2054604275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2054604275},{"type":"v1","addr":"172.21.15.139:6836","nonce":2054604275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4232":{"gid":4232,"name":"b","rank":3,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.139:6837/2105821790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":2105821790},{"type":"v1","addr":"172.21.15.139:6837","nonce":2105821790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4239":{"gid":4239,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.96:6835/1188672263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1188672263},{"type":"v1","addr":"172.21.15.96:6835","nonce":1188672263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4249":{"gid":4249,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.96:6837/4278976485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":4278976485},{"type":"v1","addr":"172.21.15.96:6837","nonce":4278976485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4273":{"gid":4273,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6833/3935291095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":3935291095},{"type":"v1","addr":"172.21.15.139:6833","nonce":3935291095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T05:01:03.748 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2024-04-18T05:01:03.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.747+0000 7fe74e3cf640 1 -- 172.21.15.96:0/2847973384 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe734066690 msgr2=0x7fe734068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:03.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.747+0000 7fe74e3cf640 1 --2- 172.21.15.96:0/2847973384 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe734066690 0x7fe734068b50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe7380af000 tx=0x7fe7380aa000 comp rx=0 tx=0).stop 2024-04-18T05:01:03.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.747+0000 7fe74e3cf640 1 -- 172.21.15.96:0/2847973384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe74814b4c0 msgr2=0x7fe7481f0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:03.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.747+0000 7fe74e3cf640 1 --2- 172.21.15.96:0/2847973384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe74814b4c0 0x7fe7481f0800 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00c490 tx=0x7fe73c00c950 comp rx=0 tx=0).stop 2024-04-18T05:01:03.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.747+0000 7fe74e3cf640 1 -- 172.21.15.96:0/2847973384 shutdown_connections 2024-04-18T05:01:03.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.747+0000 7fe74e3cf640 1 --2- 172.21.15.96:0/2847973384 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fe734066690 0x7fe734068b50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.747+0000 7fe74e3cf640 1 --2- 172.21.15.96:0/2847973384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7481ec8f0 0x7fe7481558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.747+0000 7fe74e3cf640 1 --2- 172.21.15.96:0/2847973384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe74814b4c0 0x7fe7481f0800 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.747+0000 7fe74e3cf640 1 --2- 172.21.15.96:0/2847973384 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe730003980 0x7fe7481503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.747+0000 7fe74e3cf640 1 -- 172.21.15.96:0/2847973384 >> 172.21.15.96:0/2847973384 conn(0x7fe74806c750 msgr2=0x7fe7480c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:03.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.747+0000 7fe74e3cf640 1 -- 172.21.15.96:0/2847973384 shutdown_connections 2024-04-18T05:01:03.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.747+0000 7fe74e3cf640 1 -- 172.21.15.96:0/2847973384 wait complete. 2024-04-18T05:01:03.766 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-18T05:01:03.766 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-18T05:01:03.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.871+0000 7fac2ebee640 1 Processor -- start 2024-04-18T05:01:03.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.871+0000 7fac2ebee640 1 -- start start 2024-04-18T05:01:03.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.871+0000 7fac2ebee640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fac28151210 0x7fac280c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:03.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.871+0000 7fac2ebee640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fac2815a950 0x7fac2815ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:03.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.871+0000 7fac2ebee640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2815b2c0 con 0x7fac280c1db0 2024-04-18T05:01:03.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.871+0000 7fac2ebee640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac28157150 con 0x7fac28151210 2024-04-18T05:01:03.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.871+0000 7fac2ebee640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac28157430 con 0x7fac2815a950 2024-04-18T05:01:03.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.871+0000 7fac2c98a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fac28151210 0x7fac280c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:03.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.871+0000 7fac2c98a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fac28151210 0x7fac280c1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33720/0 (socket says 172.21.15.96:33720) 2024-04-18T05:01:03.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.871+0000 7fac2c98a640 1 -- 172.21.15.96:0/3364531987 learned_addr learned my addr 172.21.15.96:0/3364531987 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:03.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.871+0000 7fac2d18b640 1 --2- 172.21.15.96:0/3364531987 >> v2:172.21.15.139:3300/0 conn(0x7fac2815a950 0x7fac2815ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:03.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.871+0000 7fac2c98a640 1 -- 172.21.15.96:0/3364531987 >> v2:172.21.15.139:3300/0 conn(0x7fac2815a950 msgr2=0x7fac2815ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:03.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.871+0000 7fac2c98a640 1 --2- 172.21.15.96:0/3364531987 >> v2:172.21.15.139:3300/0 conn(0x7fac2815a950 0x7fac2815ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.871+0000 7fac2c98a640 1 -- 172.21.15.96:0/3364531987 >> v1:172.21.15.139:6789/0 conn(0x7fac280c1db0 legacy=0x7fac280ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:03.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.871+0000 7fac2c98a640 1 -- 172.21.15.96:0/3364531987 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac28157710 con 0x7fac28151210 2024-04-18T05:01:03.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.875+0000 7fac2c98a640 1 --2- 172.21.15.96:0/3364531987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac28151210 0x7fac280c1870 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fac28073de0 tx=0x7fac2401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2a3514c760ece4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:03.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.875+0000 7fac1f7fe640 1 -- 172.21.15.96:0/3364531987 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac240a89d0 con 0x7fac28151210 2024-04-18T05:01:03.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.875+0000 7fac1f7fe640 1 -- 172.21.15.96:0/3364531987 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac240a8b30 con 0x7fac28151210 2024-04-18T05:01:03.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.875+0000 7fac1f7fe640 1 -- 172.21.15.96:0/3364531987 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac240b0440 con 0x7fac28151210 2024-04-18T05:01:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.875+0000 7fac2ebee640 1 -- 172.21.15.96:0/3364531987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac28151210 msgr2=0x7fac280c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.875+0000 7fac2ebee640 1 --2- 172.21.15.96:0/3364531987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac28151210 0x7fac280c1870 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fac28073de0 tx=0x7fac2401ecd0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.875+0000 7fac2ebee640 1 -- 172.21.15.96:0/3364531987 shutdown_connections 2024-04-18T05:01:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.875+0000 7fac2ebee640 1 --2- 172.21.15.96:0/3364531987 >> v2:172.21.15.139:3300/0 conn(0x7fac2815a950 0x7fac2815ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.875+0000 7fac2ebee640 1 --2- 172.21.15.96:0/3364531987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac28151210 0x7fac280c1870 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.875+0000 7fac2ebee640 1 -- 172.21.15.96:0/3364531987 >> 172.21.15.96:0/3364531987 conn(0x7fac2806c750 msgr2=0x7fac280c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.875+0000 7fac2ebee640 1 -- 172.21.15.96:0/3364531987 shutdown_connections 2024-04-18T05:01:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.875+0000 7fac2ebee640 1 -- 172.21.15.96:0/3364531987 wait complete. 2024-04-18T05:01:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.875+0000 7fac2ebee640 1 Processor -- start 2024-04-18T05:01:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.875+0000 7fac2ebee640 1 -- start start 2024-04-18T05:01:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac2ebee640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fac280c1db0 0x7fac281e01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac2ebee640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac28151210 0x7fac2813f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac2ebee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac2815a950 0x7fac280c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac2ebee640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac281e0de0 con 0x7fac28151210 2024-04-18T05:01:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac2ebee640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2813e960 con 0x7fac2815a950 2024-04-18T05:01:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac2ebee640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2813f5d0 con 0x7fac280c1db0 2024-04-18T05:01:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac1ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac28151210 0x7fac2813f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac1ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac28151210 0x7fac2813f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33722/0 (socket says 172.21.15.96:33722) 2024-04-18T05:01:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac1ffff640 1 -- 172.21.15.96:0/1634174514 learned_addr learned my addr 172.21.15.96:0/1634174514 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac1ffff640 1 -- 172.21.15.96:0/1634174514 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fac280c1db0 msgr2=0x7fac281e01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac1ffff640 1 --2- 172.21.15.96:0/1634174514 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fac280c1db0 0x7fac281e01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac1ffff640 1 -- 172.21.15.96:0/1634174514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac2815a950 msgr2=0x7fac280c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac1ffff640 1 --2- 172.21.15.96:0/1634174514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac2815a950 0x7fac280c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac1ffff640 1 -- 172.21.15.96:0/1634174514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240094d0 con 0x7fac28151210 2024-04-18T05:01:03.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac1ffff640 1 --2- 172.21.15.96:0/1634174514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac28151210 0x7fac2813f090 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fac1800b410 tx=0x7fac1800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:03.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac1d7fa640 1 -- 172.21.15.96:0/1634174514 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac18011830 con 0x7fac28151210 2024-04-18T05:01:03.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac1d7fa640 1 -- 172.21.15.96:0/1634174514 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac18011990 con 0x7fac28151210 2024-04-18T05:01:03.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac1d7fa640 1 -- 172.21.15.96:0/1634174514 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac18011d40 con 0x7fac28151210 2024-04-18T05:01:03.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac2ebee640 1 -- 172.21.15.96:0/1634174514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac281e0880 con 0x7fac28151210 2024-04-18T05:01:03.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac2ebee640 1 -- 172.21.15.96:0/1634174514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac281404f0 con 0x7fac28151210 2024-04-18T05:01:03.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac2ebee640 1 -- 172.21.15.96:0/1634174514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac28067050 con 0x7fac28151210 2024-04-18T05:01:03.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac1d7fa640 1 -- 172.21.15.96:0/1634174514 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fac1801a400 con 0x7fac28151210 2024-04-18T05:01:03.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac1d7fa640 1 --2- 172.21.15.96:0/1634174514 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fac14066690 0x7fac14068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:03.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac1d7fa640 1 -- 172.21.15.96:0/1634174514 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fac18084940 con 0x7fac28151210 2024-04-18T05:01:03.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.879+0000 7fac2c98a640 1 --2- 172.21.15.96:0/1634174514 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fac14066690 0x7fac14068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:03.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.883+0000 7fac2c98a640 1 --2- 172.21.15.96:0/1634174514 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fac14066690 0x7fac14068b50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fac240b2000 tx=0x7fac24004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:03.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:03.883+0000 7fac1d7fa640 1 -- 172.21.15.96:0/1634174514 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fac18051ce0 con 0x7fac28151210 2024-04-18T05:01:04.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.087+0000 7fac2ebee640 1 -- 172.21.15.96:0/1634174514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fac280c50c0 con 0x7fac28151210 2024-04-18T05:01:04.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.087+0000 7fac1d7fa640 1 -- 172.21.15.96:0/1634174514 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fac18015020 con 0x7fac28151210 2024-04-18T05:01:04.088 INFO:teuthology.orchestra.run.smithi096.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","modified":"2024-04-18T04:53:48.921127Z","created":"2024-04-18T04:53:48.921127Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-18T05:01:04.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.087+0000 7fac2ebee640 1 -- 172.21.15.96:0/1634174514 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fac14066690 msgr2=0x7fac14068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.087+0000 7fac2ebee640 1 --2- 172.21.15.96:0/1634174514 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fac14066690 0x7fac14068b50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fac240b2000 tx=0x7fac24004740 comp rx=0 tx=0).stop 2024-04-18T05:01:04.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.087+0000 7fac2ebee640 1 -- 172.21.15.96:0/1634174514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac28151210 msgr2=0x7fac2813f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.087+0000 7fac2ebee640 1 --2- 172.21.15.96:0/1634174514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac28151210 0x7fac2813f090 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fac1800b410 tx=0x7fac1800b8d0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.087+0000 7fac2ebee640 1 -- 172.21.15.96:0/1634174514 shutdown_connections 2024-04-18T05:01:04.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.087+0000 7fac2ebee640 1 --2- 172.21.15.96:0/1634174514 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fac14066690 0x7fac14068b50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.087+0000 7fac2ebee640 1 --2- 172.21.15.96:0/1634174514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac2815a950 0x7fac280c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.087+0000 7fac2ebee640 1 --2- 172.21.15.96:0/1634174514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac28151210 0x7fac2813f090 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.087+0000 7fac2ebee640 1 --2- 172.21.15.96:0/1634174514 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fac280c1db0 0x7fac281e01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.087+0000 7fac2ebee640 1 -- 172.21.15.96:0/1634174514 >> 172.21.15.96:0/1634174514 conn(0x7fac2806c750 msgr2=0x7fac28146f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:04.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.087+0000 7fac2ebee640 1 -- 172.21.15.96:0/1634174514 shutdown_connections 2024-04-18T05:01:04.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.087+0000 7fac2ebee640 1 -- 172.21.15.96:0/1634174514 wait complete. 2024-04-18T05:01:04.105 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-18T05:01:04.106 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-18T05:01:04.116 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-18T05:01:04.116 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T05:01:04.116 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T05:01:04.122 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T05:01:04.122 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T05:01:04.168 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T05:01:04.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.323+0000 7f7527a53640 1 Processor -- start 2024-04-18T05:01:04.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.323+0000 7f7527a53640 1 -- start start 2024-04-18T05:01:04.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7527a53640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f752015b060 0x7f75200ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7527a53640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7520157150 con 0x7f7520151210 2024-04-18T05:01:04.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7527a53640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7520157430 con 0x7f75200ca300 2024-04-18T05:01:04.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7527a53640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7520157710 con 0x7f752015b060 2024-04-18T05:01:04.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f75257ef640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f7520151210 0x7f75200c1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59930/0 (socket says 172.21.15.96:59930) 2024-04-18T05:01:04.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f75257ef640 1 -- 172.21.15.96:0/226009869 learned_addr learned my addr 172.21.15.96:0/226009869 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:01:04.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7525ff0640 1 --2- 172.21.15.96:0/226009869 >> v2:172.21.15.139:3300/0 conn(0x7f752015b060 0x7f75200ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7517fff640 1 -- 172.21.15.96:0/226009869 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22906438 0 0) 0x7f7520157150 con 0x7f7520151210 2024-04-18T05:01:04.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7517fff640 1 -- 172.21.15.96:0/226009869 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f750c003530 con 0x7f7520151210 2024-04-18T05:01:04.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7517fff640 1 -- 172.21.15.96:0/226009869 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2239195325 0 0) 0x7f750c003530 con 0x7f7520151210 2024-04-18T05:01:04.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7517fff640 1 -- 172.21.15.96:0/226009869 >> v2:172.21.15.139:3300/0 conn(0x7f752015b060 msgr2=0x7f75200ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:04.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7517fff640 1 --2- 172.21.15.96:0/226009869 >> v2:172.21.15.139:3300/0 conn(0x7f752015b060 0x7f75200ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7517fff640 1 -- 172.21.15.96:0/226009869 >> v1:172.21.15.139:6789/0 conn(0x7f75200ca300 legacy=0x7f752015a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7517fff640 1 -- 172.21.15.96:0/226009869 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75201579f0 con 0x7f7520151210 2024-04-18T05:01:04.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7517fff640 1 -- 172.21.15.96:0/226009869 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f751c001680 con 0x7f7520151210 2024-04-18T05:01:04.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7525ff0640 1 --2- 172.21.15.96:0/226009869 >> v2:172.21.15.139:3300/0 conn(0x7f752015b060 0x7f75200ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T05:01:04.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7517fff640 1 -- 172.21.15.96:0/226009869 >> v1:172.21.15.96:6789/0 conn(0x7f7520151210 legacy=0x7f75200c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7517fff640 1 --2- 172.21.15.96:0/226009869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f750c003980 0x7f750c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7517fff640 1 --2- 172.21.15.96:0/226009869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f750c0047d0 0x7f750c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7517fff640 1 --2- 172.21.15.96:0/226009869 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f750c005190 0x7f750c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7517fff640 1 -- 172.21.15.96:0/226009869 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7520157710 con 0x7f750c003980 2024-04-18T05:01:04.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7517fff640 1 -- 172.21.15.96:0/226009869 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c00c040 con 0x7f750c0047d0 2024-04-18T05:01:04.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7517fff640 1 -- 172.21.15.96:0/226009869 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750c00c200 con 0x7f750c005190 2024-04-18T05:01:04.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f75257ef640 1 --2- 172.21.15.96:0/226009869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f750c003980 0x7f750c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7524fee640 1 --2- 172.21.15.96:0/226009869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f750c0047d0 0x7f750c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7525ff0640 1 --2- 172.21.15.96:0/226009869 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f750c005190 0x7f750c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f75257ef640 1 -- 172.21.15.96:0/226009869 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f750c005190 msgr2=0x7f750c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:04.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f75257ef640 1 --2- 172.21.15.96:0/226009869 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f750c005190 0x7f750c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f75257ef640 1 -- 172.21.15.96:0/226009869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f750c0047d0 msgr2=0x7f750c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:04.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f75257ef640 1 --2- 172.21.15.96:0/226009869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f750c0047d0 0x7f750c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f75257ef640 1 -- 172.21.15.96:0/226009869 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c003530 con 0x7f750c003980 2024-04-18T05:01:04.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7525ff0640 1 -- 172.21.15.96:0/226009869 reap_dead start 2024-04-18T05:01:04.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.327+0000 7f7524fee640 1 --2- 172.21.15.96:0/226009869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f750c0047d0 0x7f750c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T05:01:04.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f75257ef640 1 --2- 172.21.15.96:0/226009869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f750c003980 0x7f750c003da0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f751c00c1c0 tx=0x7f751c01f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff62f81577abb06 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:04.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7517fff640 1 -- 172.21.15.96:0/226009869 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c005ae0 con 0x7f750c003980 2024-04-18T05:01:04.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7517fff640 1 -- 172.21.15.96:0/226009869 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c0ab070 con 0x7f750c003980 2024-04-18T05:01:04.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7517fff640 1 -- 172.21.15.96:0/226009869 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c007070 con 0x7f750c003980 2024-04-18T05:01:04.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7527a53640 1 -- 172.21.15.96:0/226009869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f750c003980 msgr2=0x7f750c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7527a53640 1 --2- 172.21.15.96:0/226009869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f750c003980 0x7f750c003da0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f751c00c1c0 tx=0x7f751c01f330 comp rx=0 tx=0).stop 2024-04-18T05:01:04.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7527a53640 1 -- 172.21.15.96:0/226009869 shutdown_connections 2024-04-18T05:01:04.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7527a53640 1 --2- 172.21.15.96:0/226009869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f750c003980 0x7f750c003da0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7527a53640 1 -- 172.21.15.96:0/226009869 >> 172.21.15.96:0/226009869 conn(0x7f752006c750 msgr2=0x7f75200c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:04.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7527a53640 1 -- 172.21.15.96:0/226009869 shutdown_connections 2024-04-18T05:01:04.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7527a53640 1 -- 172.21.15.96:0/226009869 wait complete. 2024-04-18T05:01:04.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7527a53640 1 Processor -- start 2024-04-18T05:01:04.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7527a53640 1 -- start start 2024-04-18T05:01:04.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7527a53640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f750c003980 0x7f75200c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7527a53640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f75201f0b20 0x7f75201ec930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7527a53640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75200c2de0 0x7f75201467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7527a53640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752014ecf0 con 0x7f750c003980 2024-04-18T05:01:04.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7527a53640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75201f0690 con 0x7f75200c2de0 2024-04-18T05:01:04.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f7527a53640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75200c8280 con 0x7f75201f0b20 2024-04-18T05:01:04.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f75257ef640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f750c003980 0x7f75200c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f75257ef640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f750c003980 0x7f75200c11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33744/0 (socket says 172.21.15.96:33744) 2024-04-18T05:01:04.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.331+0000 7f75257ef640 1 -- 172.21.15.96:0/2377212093 learned_addr learned my addr 172.21.15.96:0/2377212093 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:04.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f7524fee640 1 --2- 172.21.15.96:0/2377212093 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f75201f0b20 0x7f75201ec930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f7525ff0640 1 --2- 172.21.15.96:0/2377212093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75200c2de0 0x7f75201467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f75257ef640 1 -- 172.21.15.96:0/2377212093 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f75201f0b20 msgr2=0x7f75201ec930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f75257ef640 1 --2- 172.21.15.96:0/2377212093 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f75201f0b20 0x7f75201ec930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f75257ef640 1 -- 172.21.15.96:0/2377212093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75200c2de0 msgr2=0x7f75201467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f75257ef640 1 --2- 172.21.15.96:0/2377212093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75200c2de0 0x7f75201467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f75257ef640 1 -- 172.21.15.96:0/2377212093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520156f20 con 0x7f750c003980 2024-04-18T05:01:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f75257ef640 1 --2- 172.21.15.96:0/2377212093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f750c003980 0x7f75200c11c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f751c025fa0 tx=0x7f750c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f7515ffb640 1 -- 172.21.15.96:0/2377212093 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c001680 con 0x7f750c003980 2024-04-18T05:01:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f7515ffb640 1 -- 172.21.15.96:0/2377212093 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c004e50 con 0x7f750c003980 2024-04-18T05:01:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f7527a53640 1 -- 172.21.15.96:0/2377212093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75200c8540 con 0x7f750c003980 2024-04-18T05:01:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f7515ffb640 1 -- 172.21.15.96:0/2377212093 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c0072b0 con 0x7f750c003980 2024-04-18T05:01:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f7527a53640 1 -- 172.21.15.96:0/2377212093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75201f0320 con 0x7f750c003980 2024-04-18T05:01:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f7527a53640 1 -- 172.21.15.96:0/2377212093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75201efea0 con 0x7f750c003980 2024-04-18T05:01:04.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f7515ffb640 1 -- 172.21.15.96:0/2377212093 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f751c007410 con 0x7f750c003980 2024-04-18T05:01:04.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f7515ffb640 1 --2- 172.21.15.96:0/2377212093 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f75040666c0 0x7f7504068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f7515ffb640 1 -- 172.21.15.96:0/2377212093 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f751c0b7070 con 0x7f750c003980 2024-04-18T05:01:04.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f7524fee640 1 --2- 172.21.15.96:0/2377212093 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f75040666c0 0x7f7504068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.335+0000 7f7524fee640 1 --2- 172.21.15.96:0/2377212093 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f75040666c0 0x7f7504068b80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7510000c10 tx=0x7f7510009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:04.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.339+0000 7f7515ffb640 1 -- 172.21.15.96:0/2377212093 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f75201efea0 con 0x7f750c003980 2024-04-18T05:01:04.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.487+0000 7f7527a53640 1 -- 172.21.15.96:0/2377212093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75201efea0 con 0x7f750c003980 2024-04-18T05:01:04.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.487+0000 7f7515ffb640 1 -- 172.21.15.96:0/2377212093 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16090 (secure 0 0 0) 0x7f75201efea0 con 0x7f750c003980 2024-04-18T05:01:04.490 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T05:01:04.490 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":23,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:55:39.795060+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:54:39.219441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:54:40.139557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.720340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.767224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.811511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.710188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.860525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.704784+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1b","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T05:01:04.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.491+0000 7f7527a53640 1 -- 172.21.15.96:0/2377212093 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f75040666c0 msgr2=0x7f7504068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.491+0000 7f7527a53640 1 --2- 172.21.15.96:0/2377212093 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f75040666c0 0x7f7504068b80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7510000c10 tx=0x7f7510009040 comp rx=0 tx=0).stop 2024-04-18T05:01:04.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.491+0000 7f7527a53640 1 -- 172.21.15.96:0/2377212093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f750c003980 msgr2=0x7f75200c11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.491+0000 7f7527a53640 1 --2- 172.21.15.96:0/2377212093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f750c003980 0x7f75200c11c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f751c025fa0 tx=0x7f750c005800 comp rx=0 tx=0).stop 2024-04-18T05:01:04.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.491+0000 7f7527a53640 1 -- 172.21.15.96:0/2377212093 shutdown_connections 2024-04-18T05:01:04.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.491+0000 7f7527a53640 1 --2- 172.21.15.96:0/2377212093 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f75040666c0 0x7f7504068b80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.491+0000 7f7527a53640 1 --2- 172.21.15.96:0/2377212093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75200c2de0 0x7f75201467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.491+0000 7f7527a53640 1 --2- 172.21.15.96:0/2377212093 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f75201f0b20 0x7f75201ec930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.491+0000 7f7527a53640 1 --2- 172.21.15.96:0/2377212093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f750c003980 0x7f75200c11c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.491+0000 7f7527a53640 1 -- 172.21.15.96:0/2377212093 >> 172.21.15.96:0/2377212093 conn(0x7f752006c750 msgr2=0x7f752014db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:04.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.491+0000 7f7527a53640 1 -- 172.21.15.96:0/2377212093 shutdown_connections 2024-04-18T05:01:04.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.491+0000 7f7527a53640 1 -- 172.21.15.96:0/2377212093 wait complete. 2024-04-18T05:01:04.508 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:54:32.641813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T04:54:39.219441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T04:54:40.139557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T05:01:04.509 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T05:01:04.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.619+0000 7fd176b56640 1 Processor -- start 2024-04-18T05:01:04.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.619+0000 7fd176b56640 1 -- start start 2024-04-18T05:01:04.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.619+0000 7fd176b56640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd17014fc60 0x7fd17006d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.619+0000 7fd176b56640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd170156410 0x7fd1700c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.619+0000 7fd176b56640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1700c8100 con 0x7fd17006dd50 2024-04-18T05:01:04.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.619+0000 7fd176b56640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1700c5660 con 0x7fd170156410 2024-04-18T05:01:04.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.619+0000 7fd176b56640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1700c8350 con 0x7fd17014fc60 2024-04-18T05:01:04.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.619+0000 7fd1748f2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd17014fc60 0x7fd17006d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.619+0000 7fd1750f3640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd170156410 0x7fd1700c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.619+0000 7fd1748f2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd17014fc60 0x7fd17006d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:56468/0 (socket says 172.21.15.96:56468) 2024-04-18T05:01:04.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.619+0000 7fd1748f2640 1 -- 172.21.15.96:0/282651159 learned_addr learned my addr 172.21.15.96:0/282651159 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:04.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.619+0000 7fd1748f2640 1 -- 172.21.15.96:0/282651159 >> v2:172.21.15.139:3300/0 conn(0x7fd170156410 msgr2=0x7fd1700c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:04.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.619+0000 7fd1748f2640 1 --2- 172.21.15.96:0/282651159 >> v2:172.21.15.139:3300/0 conn(0x7fd170156410 0x7fd1700c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.619+0000 7fd1748f2640 1 -- 172.21.15.96:0/282651159 >> v1:172.21.15.139:6789/0 conn(0x7fd17006dd50 legacy=0x7fd170155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.619+0000 7fd1748f2640 1 -- 172.21.15.96:0/282651159 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1700c8630 con 0x7fd17014fc60 2024-04-18T05:01:04.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.623+0000 7fd1748f2640 1 --2- 172.21.15.96:0/282651159 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd17014fc60 0x7fd17006d810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd164009870 tx=0x7fd16401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26d50f92c08f22fa server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:04.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.623+0000 7fd16f7fe640 1 -- 172.21.15.96:0/282651159 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1640ac620 con 0x7fd17014fc60 2024-04-18T05:01:04.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.623+0000 7fd16f7fe640 1 -- 172.21.15.96:0/282651159 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1640ac780 con 0x7fd17014fc60 2024-04-18T05:01:04.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.623+0000 7fd16f7fe640 1 -- 172.21.15.96:0/282651159 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1640acb10 con 0x7fd17014fc60 2024-04-18T05:01:04.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.623+0000 7fd176b56640 1 -- 172.21.15.96:0/282651159 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd17014fc60 msgr2=0x7fd17006d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.623+0000 7fd176b56640 1 --2- 172.21.15.96:0/282651159 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd17014fc60 0x7fd17006d810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd164009870 tx=0x7fd16401c4d0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.623+0000 7fd176b56640 1 -- 172.21.15.96:0/282651159 shutdown_connections 2024-04-18T05:01:04.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.623+0000 7fd176b56640 1 --2- 172.21.15.96:0/282651159 >> v2:172.21.15.139:3300/0 conn(0x7fd170156410 0x7fd1700c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.623+0000 7fd176b56640 1 --2- 172.21.15.96:0/282651159 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd17014fc60 0x7fd17006d810 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.623+0000 7fd176b56640 1 -- 172.21.15.96:0/282651159 >> 172.21.15.96:0/282651159 conn(0x7fd17006c610 msgr2=0x7fd1700ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:04.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.623+0000 7fd176b56640 1 -- 172.21.15.96:0/282651159 shutdown_connections 2024-04-18T05:01:04.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.623+0000 7fd176b56640 1 -- 172.21.15.96:0/282651159 wait complete. 2024-04-18T05:01:04.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.623+0000 7fd176b56640 1 Processor -- start 2024-04-18T05:01:04.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.623+0000 7fd176b56640 1 -- start start 2024-04-18T05:01:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd176b56640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd17006dd50 0x7fd17014ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd176b56640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd17014fc60 0x7fd1701f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd176b56640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd170156410 0x7fd1701f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd176b56640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd170150480 con 0x7fd170156410 2024-04-18T05:01:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd176b56640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1701f12f0 con 0x7fd17014fc60 2024-04-18T05:01:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd176b56640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd170149f10 con 0x7fd17006dd50 2024-04-18T05:01:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd1750f3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd170156410 0x7fd1701f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd1750f3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd170156410 0x7fd1701f4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33752/0 (socket says 172.21.15.96:33752) 2024-04-18T05:01:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd1750f3640 1 -- 172.21.15.96:0/4025099804 learned_addr learned my addr 172.21.15.96:0/4025099804 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd1748f2640 1 --2- 172.21.15.96:0/4025099804 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd17006dd50 0x7fd17014ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd16ffff640 1 --2- 172.21.15.96:0/4025099804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd17014fc60 0x7fd1701f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd1750f3640 1 -- 172.21.15.96:0/4025099804 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd17006dd50 msgr2=0x7fd17014ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd1750f3640 1 --2- 172.21.15.96:0/4025099804 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd17006dd50 0x7fd17014ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd1750f3640 1 -- 172.21.15.96:0/4025099804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd17014fc60 msgr2=0x7fd1701f1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd1750f3640 1 --2- 172.21.15.96:0/4025099804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd17014fc60 0x7fd1701f1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd1750f3640 1 -- 172.21.15.96:0/4025099804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1640094d0 con 0x7fd170156410 2024-04-18T05:01:04.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd16ffff640 1 --2- 172.21.15.96:0/4025099804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd17014fc60 0x7fd1701f1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:01:04.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd1750f3640 1 --2- 172.21.15.96:0/4025099804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd170156410 0x7fd1701f4860 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd16800efc0 tx=0x7fd16800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:04.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd16d7fa640 1 -- 172.21.15.96:0/4025099804 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd168009ba0 con 0x7fd170156410 2024-04-18T05:01:04.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd16d7fa640 1 -- 172.21.15.96:0/4025099804 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16800f040 con 0x7fd170156410 2024-04-18T05:01:04.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd176b56640 1 -- 172.21.15.96:0/4025099804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd170151830 con 0x7fd170156410 2024-04-18T05:01:04.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd16d7fa640 1 -- 172.21.15.96:0/4025099804 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1680146c0 con 0x7fd170156410 2024-04-18T05:01:04.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd176b56640 1 -- 172.21.15.96:0/4025099804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd170151df0 con 0x7fd170156410 2024-04-18T05:01:04.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd176b56640 1 -- 172.21.15.96:0/4025099804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd170152010 con 0x7fd170156410 2024-04-18T05:01:04.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd16d7fa640 1 -- 172.21.15.96:0/4025099804 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd168014820 con 0x7fd170156410 2024-04-18T05:01:04.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd16d7fa640 1 --2- 172.21.15.96:0/4025099804 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd154066690 0x7fd154068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd16d7fa640 1 -- 172.21.15.96:0/4025099804 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd168084f90 con 0x7fd170156410 2024-04-18T05:01:04.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd1748f2640 1 --2- 172.21.15.96:0/4025099804 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd154066690 0x7fd154068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.627+0000 7fd1748f2640 1 --2- 172.21.15.96:0/4025099804 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd154066690 0x7fd154068b50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd1640ae000 tx=0x7fd164008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:04.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.631+0000 7fd16d7fa640 1 -- 172.21.15.96:0/4025099804 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd1680b6be0 con 0x7fd170156410 2024-04-18T05:01:04.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.779+0000 7fd176b56640 1 -- 172.21.15.96:0/4025099804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd170067050 con 0x7fd170156410 2024-04-18T05:01:04.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.779+0000 7fd16d7fa640 1 -- 172.21.15.96:0/4025099804 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd168018020 con 0x7fd170156410 2024-04-18T05:01:04.782 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-18T05:01:04.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.783+0000 7fd176b56640 1 -- 172.21.15.96:0/4025099804 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd154066690 msgr2=0x7fd154068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.783+0000 7fd176b56640 1 --2- 172.21.15.96:0/4025099804 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd154066690 0x7fd154068b50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd1640ae000 tx=0x7fd164008040 comp rx=0 tx=0).stop 2024-04-18T05:01:04.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.783+0000 7fd176b56640 1 -- 172.21.15.96:0/4025099804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd170156410 msgr2=0x7fd1701f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.783+0000 7fd176b56640 1 --2- 172.21.15.96:0/4025099804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd170156410 0x7fd1701f4860 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd16800efc0 tx=0x7fd16800c490 comp rx=0 tx=0).stop 2024-04-18T05:01:04.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.783+0000 7fd176b56640 1 -- 172.21.15.96:0/4025099804 shutdown_connections 2024-04-18T05:01:04.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.783+0000 7fd176b56640 1 --2- 172.21.15.96:0/4025099804 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fd154066690 0x7fd154068b50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.783+0000 7fd176b56640 1 --2- 172.21.15.96:0/4025099804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd170156410 0x7fd1701f4860 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.783+0000 7fd176b56640 1 --2- 172.21.15.96:0/4025099804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd17014fc60 0x7fd1701f1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.783+0000 7fd176b56640 1 --2- 172.21.15.96:0/4025099804 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd17006dd50 0x7fd17014ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.783+0000 7fd176b56640 1 -- 172.21.15.96:0/4025099804 >> 172.21.15.96:0/4025099804 conn(0x7fd17006c610 msgr2=0x7fd170140e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:04.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.783+0000 7fd176b56640 1 -- 172.21.15.96:0/4025099804 shutdown_connections 2024-04-18T05:01:04.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.783+0000 7fd176b56640 1 -- 172.21.15.96:0/4025099804 wait complete. 2024-04-18T05:01:04.800 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T05:01:04.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.919+0000 7f89d3ea2640 1 Processor -- start 2024-04-18T05:01:04.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.919+0000 7f89d3ea2640 1 -- start start 2024-04-18T05:01:04.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d3ea2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f89cc1532d0 0x7f89cc158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d3ea2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f89cc0cacc0 0x7f89cc15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d3ea2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc15d3b0 con 0x7f89cc0c3fd0 2024-04-18T05:01:04.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d3ea2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc0c5970 con 0x7f89cc0cacc0 2024-04-18T05:01:04.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d3ea2640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc1594a0 con 0x7f89cc1532d0 2024-04-18T05:01:04.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d143d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f89cc0cacc0 0x7f89cc15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d243f640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f89cc0c3fd0 0x7f89cc0ce740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59936/0 (socket says 172.21.15.96:59936) 2024-04-18T05:01:04.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d243f640 1 -- 172.21.15.96:0/1026984198 learned_addr learned my addr 172.21.15.96:0/1026984198 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:01:04.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d143d640 1 -- 172.21.15.96:0/1026984198 >> v2:172.21.15.139:3300/0 conn(0x7f89cc1532d0 msgr2=0x7f89cc158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:04.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d143d640 1 --2- 172.21.15.96:0/1026984198 >> v2:172.21.15.139:3300/0 conn(0x7f89cc1532d0 0x7f89cc158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d143d640 1 -- 172.21.15.96:0/1026984198 >> v1:172.21.15.96:6789/0 conn(0x7f89cc0c3fd0 legacy=0x7f89cc0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d143d640 1 -- 172.21.15.96:0/1026984198 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc1536b0 con 0x7f89cc0cacc0 2024-04-18T05:01:04.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d143d640 1 --2- 172.21.15.96:0/1026984198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89cc0cacc0 0x7f89cc15ce70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0cc2d0 tx=0x7f89bc01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6d4252cc887169 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:04.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d0c3c640 1 -- 172.21.15.96:0/1026984198 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0a8950 con 0x7f89cc0cacc0 2024-04-18T05:01:04.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d0c3c640 1 -- 172.21.15.96:0/1026984198 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc0a8ab0 con 0x7f89cc0cacc0 2024-04-18T05:01:04.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d0c3c640 1 -- 172.21.15.96:0/1026984198 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0a8e40 con 0x7f89cc0cacc0 2024-04-18T05:01:04.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d3ea2640 1 -- 172.21.15.96:0/1026984198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89cc0cacc0 msgr2=0x7f89cc15ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d3ea2640 1 --2- 172.21.15.96:0/1026984198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89cc0cacc0 0x7f89cc15ce70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0cc2d0 tx=0x7f89bc01ec50 comp rx=0 tx=0).stop 2024-04-18T05:01:04.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d3ea2640 1 -- 172.21.15.96:0/1026984198 shutdown_connections 2024-04-18T05:01:04.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d3ea2640 1 --2- 172.21.15.96:0/1026984198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89cc0cacc0 0x7f89cc15ce70 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d3ea2640 1 --2- 172.21.15.96:0/1026984198 >> v2:172.21.15.139:3300/0 conn(0x7f89cc1532d0 0x7f89cc158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.923+0000 7f89d3ea2640 1 -- 172.21.15.96:0/1026984198 >> 172.21.15.96:0/1026984198 conn(0x7f89cc071760 msgr2=0x7f89cc06b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:04.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d3ea2640 1 -- 172.21.15.96:0/1026984198 shutdown_connections 2024-04-18T05:01:04.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d3ea2640 1 -- 172.21.15.96:0/1026984198 wait complete. 2024-04-18T05:01:04.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d3ea2640 1 Processor -- start 2024-04-18T05:01:04.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d3ea2640 1 -- start start 2024-04-18T05:01:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d3ea2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89cc0c3fd0 0x7f89cc1428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d3ea2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89cc0cacc0 0x7f89cc0c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d3ea2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89cc1532d0 0x7f89cc0c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d3ea2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc159f20 con 0x7f89cc0c3fd0 2024-04-18T05:01:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d3ea2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc157dd0 con 0x7f89cc0cacc0 2024-04-18T05:01:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d3ea2640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc156e70 con 0x7f89cc1532d0 2024-04-18T05:01:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d1c3e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89cc0c3fd0 0x7f89cc1428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d1c3e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89cc0c3fd0 0x7f89cc1428f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33774/0 (socket says 172.21.15.96:33774) 2024-04-18T05:01:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d1c3e640 1 -- 172.21.15.96:0/2664003489 learned_addr learned my addr 172.21.15.96:0/2664003489 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d1c3e640 1 -- 172.21.15.96:0/2664003489 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89cc1532d0 msgr2=0x7f89cc0c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d1c3e640 1 --2- 172.21.15.96:0/2664003489 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89cc1532d0 0x7f89cc0c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d1c3e640 1 -- 172.21.15.96:0/2664003489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89cc0cacc0 msgr2=0x7f89cc0c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d143d640 1 --2- 172.21.15.96:0/2664003489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89cc0cacc0 0x7f89cc0c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d1c3e640 1 --2- 172.21.15.96:0/2664003489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89cc0cacc0 0x7f89cc0c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d1c3e640 1 -- 172.21.15.96:0/2664003489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89bc009420 con 0x7f89cc0c3fd0 2024-04-18T05:01:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d1c3e640 1 --2- 172.21.15.96:0/2664003489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89cc0c3fd0 0x7f89cc1428f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f89c800b550 tx=0x7f89c800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89c27fc640 1 -- 172.21.15.96:0/2664003489 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c8010870 con 0x7f89cc0c3fd0 2024-04-18T05:01:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89c27fc640 1 -- 172.21.15.96:0/2664003489 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c80109f0 con 0x7f89cc0c3fd0 2024-04-18T05:01:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d3ea2640 1 -- 172.21.15.96:0/2664003489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc157150 con 0x7f89cc0c3fd0 2024-04-18T05:01:04.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89c27fc640 1 -- 172.21.15.96:0/2664003489 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c8010da0 con 0x7f89cc0c3fd0 2024-04-18T05:01:04.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d3ea2640 1 -- 172.21.15.96:0/2664003489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc157710 con 0x7f89cc0c3fd0 2024-04-18T05:01:04.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.927+0000 7f89d3ea2640 1 -- 172.21.15.96:0/2664003489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89cc067050 con 0x7f89cc0c3fd0 2024-04-18T05:01:04.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.931+0000 7f89c27fc640 1 -- 172.21.15.96:0/2664003489 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89c800f3c0 con 0x7f89cc0c3fd0 2024-04-18T05:01:04.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.931+0000 7f89c27fc640 1 --2- 172.21.15.96:0/2664003489 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f89b0066690 0x7f89b0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:04.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.931+0000 7f89c27fc640 1 -- 172.21.15.96:0/2664003489 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f89c80840d0 con 0x7f89cc0c3fd0 2024-04-18T05:01:04.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.931+0000 7f89d143d640 1 --2- 172.21.15.96:0/2664003489 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f89b0066690 0x7f89b0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:04.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.931+0000 7f89d143d640 1 --2- 172.21.15.96:0/2664003489 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f89b0066690 0x7f89b0068b50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0b2000 tx=0x7f89bc0aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:04.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:04.935+0000 7f89c27fc640 1 -- 172.21.15.96:0/2664003489 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f89c80514b0 con 0x7f89cc0c3fd0 2024-04-18T05:01:05.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.091+0000 7f89d3ea2640 1 -- 172.21.15.96:0/2664003489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f89cc146eb0 con 0x7f89cc0c3fd0 2024-04-18T05:01:05.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.091+0000 7f89c27fc640 1 -- 172.21.15.96:0/2664003489 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f89c8054ad0 con 0x7f89cc0c3fd0 2024-04-18T05:01:05.093 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-18T05:01:05.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.095+0000 7f89d3ea2640 1 -- 172.21.15.96:0/2664003489 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f89b0066690 msgr2=0x7f89b0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.095+0000 7f89d3ea2640 1 --2- 172.21.15.96:0/2664003489 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f89b0066690 0x7f89b0068b50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0b2000 tx=0x7f89bc0aa070 comp rx=0 tx=0).stop 2024-04-18T05:01:05.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.095+0000 7f89d3ea2640 1 -- 172.21.15.96:0/2664003489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89cc0c3fd0 msgr2=0x7f89cc1428f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.095+0000 7f89d3ea2640 1 --2- 172.21.15.96:0/2664003489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89cc0c3fd0 0x7f89cc1428f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f89c800b550 tx=0x7f89c800ba10 comp rx=0 tx=0).stop 2024-04-18T05:01:05.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.095+0000 7f89d3ea2640 1 -- 172.21.15.96:0/2664003489 shutdown_connections 2024-04-18T05:01:05.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.095+0000 7f89d3ea2640 1 --2- 172.21.15.96:0/2664003489 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f89b0066690 0x7f89b0068b50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.095+0000 7f89d3ea2640 1 --2- 172.21.15.96:0/2664003489 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89cc1532d0 0x7f89cc0c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.095+0000 7f89d3ea2640 1 --2- 172.21.15.96:0/2664003489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89cc0cacc0 0x7f89cc0c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.095+0000 7f89d3ea2640 1 --2- 172.21.15.96:0/2664003489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89cc0c3fd0 0x7f89cc1428f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.095+0000 7f89d3ea2640 1 -- 172.21.15.96:0/2664003489 >> 172.21.15.96:0/2664003489 conn(0x7f89cc071760 msgr2=0x7f89cc0cde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:05.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.095+0000 7f89d3ea2640 1 -- 172.21.15.96:0/2664003489 shutdown_connections 2024-04-18T05:01:05.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.095+0000 7f89d3ea2640 1 -- 172.21.15.96:0/2664003489 wait complete. 2024-04-18T05:01:05.113 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T05:01:05.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.239+0000 7f323272f640 1 Processor -- start 2024-04-18T05:01:05.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.239+0000 7f323272f640 1 -- start start 2024-04-18T05:01:05.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.239+0000 7f323272f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f322c150e20 0x7f322c0c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.239+0000 7f323272f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f322c0c8100 0x7f322c0c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.239+0000 7f323272f640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322c0c6c50 con 0x7f322c0c9020 2024-04-18T05:01:05.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.239+0000 7f323272f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322c0c9610 con 0x7f322c0c8100 2024-04-18T05:01:05.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.239+0000 7f323272f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322c151200 con 0x7f322c150e20 2024-04-18T05:01:05.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.239+0000 7f322b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f322c0c8100 0x7f322c0c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:05.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.239+0000 7f322b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f322c0c8100 0x7f322c0c9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33776/0 (socket says 172.21.15.96:33776) 2024-04-18T05:01:05.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.239+0000 7f322b7fe640 1 -- 172.21.15.96:0/547396512 learned_addr learned my addr 172.21.15.96:0/547396512 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:05.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.239+0000 7f322bfff640 1 --2- 172.21.15.96:0/547396512 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f322c150e20 0x7f322c0c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:05.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.239+0000 7f322b7fe640 1 -- 172.21.15.96:0/547396512 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f322c150e20 msgr2=0x7f322c0c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:05.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.239+0000 7f322b7fe640 1 --2- 172.21.15.96:0/547396512 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f322c150e20 0x7f322c0c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.239+0000 7f322b7fe640 1 -- 172.21.15.96:0/547396512 >> v1:172.21.15.139:6789/0 conn(0x7f322c0c9020 legacy=0x7f322c0c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:05.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.239+0000 7f322b7fe640 1 -- 172.21.15.96:0/547396512 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c0c85d0 con 0x7f322c0c8100 2024-04-18T05:01:05.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f322b7fe640 1 --2- 172.21.15.96:0/547396512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c0c8100 0x7f322c0c9af0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3220009870 tx=0x7f322001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84d5650b989e530 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:05.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f322affd640 1 -- 172.21.15.96:0/547396512 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32200ab620 con 0x7f322c0c8100 2024-04-18T05:01:05.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f322affd640 1 -- 172.21.15.96:0/547396512 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32200ab780 con 0x7f322c0c8100 2024-04-18T05:01:05.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f322affd640 1 -- 172.21.15.96:0/547396512 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32200abb10 con 0x7f322c0c8100 2024-04-18T05:01:05.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f323272f640 1 -- 172.21.15.96:0/547396512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c0c8100 msgr2=0x7f322c0c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f323272f640 1 --2- 172.21.15.96:0/547396512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c0c8100 0x7f322c0c9af0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3220009870 tx=0x7f322001c460 comp rx=0 tx=0).stop 2024-04-18T05:01:05.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f323272f640 1 -- 172.21.15.96:0/547396512 shutdown_connections 2024-04-18T05:01:05.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f323272f640 1 --2- 172.21.15.96:0/547396512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c0c8100 0x7f322c0c9af0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f323272f640 1 --2- 172.21.15.96:0/547396512 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f322c150e20 0x7f322c0c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f323272f640 1 -- 172.21.15.96:0/547396512 >> 172.21.15.96:0/547396512 conn(0x7f322c06c610 msgr2=0x7f322c0ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:05.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f323272f640 1 -- 172.21.15.96:0/547396512 shutdown_connections 2024-04-18T05:01:05.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f323272f640 1 -- 172.21.15.96:0/547396512 wait complete. 2024-04-18T05:01:05.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f323272f640 1 Processor -- start 2024-04-18T05:01:05.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f323272f640 1 -- start start 2024-04-18T05:01:05.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f323272f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f322c0c8100 0x7f322c0c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f323272f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f322c0c9020 0x7f322c148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f323272f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c150e20 0x7f322c160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f323272f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c157d10 con 0x7f322c150e20 2024-04-18T05:01:05.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f323272f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c157a50 con 0x7f322c0c8100 2024-04-18T05:01:05.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f323272f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322c14ebe0 con 0x7f322c0c9020 2024-04-18T05:01:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f3230ccc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c150e20 0x7f322c160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f3230ccc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c150e20 0x7f322c160ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33786/0 (socket says 172.21.15.96:33786) 2024-04-18T05:01:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f3230ccc640 1 -- 172.21.15.96:0/1039634506 learned_addr learned my addr 172.21.15.96:0/1039634506 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f322bfff640 1 --2- 172.21.15.96:0/1039634506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f322c0c8100 0x7f322c0c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f322b7fe640 1 --2- 172.21.15.96:0/1039634506 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f322c0c9020 0x7f322c148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f3230ccc640 1 -- 172.21.15.96:0/1039634506 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f322c0c9020 msgr2=0x7f322c148310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f3230ccc640 1 --2- 172.21.15.96:0/1039634506 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f322c0c9020 0x7f322c148310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f3230ccc640 1 -- 172.21.15.96:0/1039634506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f322c0c8100 msgr2=0x7f322c0c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f3230ccc640 1 --2- 172.21.15.96:0/1039634506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f322c0c8100 0x7f322c0c2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f3230ccc640 1 -- 172.21.15.96:0/1039634506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32200094d0 con 0x7f322c150e20 2024-04-18T05:01:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f3230ccc640 1 --2- 172.21.15.96:0/1039634506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c150e20 0x7f322c160ba0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f322400c780 tx=0x7f322400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.243+0000 7f3228ff9640 1 -- 172.21.15.96:0/1039634506 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3224004b70 con 0x7f322c150e20 2024-04-18T05:01:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.247+0000 7f3228ff9640 1 -- 172.21.15.96:0/1039634506 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322400ce90 con 0x7f322c150e20 2024-04-18T05:01:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.247+0000 7f323272f640 1 -- 172.21.15.96:0/1039634506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322c14eec0 con 0x7f322c150e20 2024-04-18T05:01:05.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.247+0000 7f3228ff9640 1 -- 172.21.15.96:0/1039634506 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322400a850 con 0x7f322c150e20 2024-04-18T05:01:05.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.247+0000 7f323272f640 1 -- 172.21.15.96:0/1039634506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322c0c1b80 con 0x7f322c150e20 2024-04-18T05:01:05.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.247+0000 7f323272f640 1 -- 172.21.15.96:0/1039634506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322c067050 con 0x7f322c150e20 2024-04-18T05:01:05.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.247+0000 7f3228ff9640 1 -- 172.21.15.96:0/1039634506 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f322400a9b0 con 0x7f322c150e20 2024-04-18T05:01:05.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.247+0000 7f3228ff9640 1 --2- 172.21.15.96:0/1039634506 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3218066690 0x7f3218068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.247+0000 7f3228ff9640 1 -- 172.21.15.96:0/1039634506 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f3224084410 con 0x7f322c150e20 2024-04-18T05:01:05.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.247+0000 7f322bfff640 1 --2- 172.21.15.96:0/1039634506 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3218066690 0x7f3218068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:05.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.247+0000 7f322bfff640 1 --2- 172.21.15.96:0/1039634506 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3218066690 0x7f3218068b50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f321c00b7c0 tx=0x7f321c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:05.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.251+0000 7f3228ff9640 1 -- 172.21.15.96:0/1039634506 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f3224051760 con 0x7f322c150e20 2024-04-18T05:01:05.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.403+0000 7f323272f640 1 -- 172.21.15.96:0/1039634506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f322c154550 con 0x7f322c150e20 2024-04-18T05:01:05.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.407+0000 7f3228ff9640 1 -- 172.21.15.96:0/1039634506 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f322405b030 con 0x7f322c150e20 2024-04-18T05:01:05.407 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-18T05:01:05.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.407+0000 7f323272f640 1 -- 172.21.15.96:0/1039634506 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3218066690 msgr2=0x7f3218068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.407+0000 7f323272f640 1 --2- 172.21.15.96:0/1039634506 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3218066690 0x7f3218068b50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f321c00b7c0 tx=0x7f321c008040 comp rx=0 tx=0).stop 2024-04-18T05:01:05.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.407+0000 7f323272f640 1 -- 172.21.15.96:0/1039634506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c150e20 msgr2=0x7f322c160ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.407+0000 7f323272f640 1 --2- 172.21.15.96:0/1039634506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c150e20 0x7f322c160ba0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f322400c780 tx=0x7f322400cc40 comp rx=0 tx=0).stop 2024-04-18T05:01:05.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.407+0000 7f323272f640 1 -- 172.21.15.96:0/1039634506 shutdown_connections 2024-04-18T05:01:05.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.407+0000 7f323272f640 1 --2- 172.21.15.96:0/1039634506 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3218066690 0x7f3218068b50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.407+0000 7f323272f640 1 --2- 172.21.15.96:0/1039634506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f322c150e20 0x7f322c160ba0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.407+0000 7f323272f640 1 --2- 172.21.15.96:0/1039634506 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f322c0c9020 0x7f322c148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.407+0000 7f323272f640 1 --2- 172.21.15.96:0/1039634506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f322c0c8100 0x7f322c0c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.407+0000 7f323272f640 1 -- 172.21.15.96:0/1039634506 >> 172.21.15.96:0/1039634506 conn(0x7f322c06c610 msgr2=0x7f322c0c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:05.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.407+0000 7f323272f640 1 -- 172.21.15.96:0/1039634506 shutdown_connections 2024-04-18T05:01:05.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.407+0000 7f323272f640 1 -- 172.21.15.96:0/1039634506 wait complete. 2024-04-18T05:01:05.427 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T05:01:05.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f3886648640 1 Processor -- start 2024-04-18T05:01:05.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f3886648640 1 -- start start 2024-04-18T05:01:05.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f3886648640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f388015a270 0x7f38800c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f3886648640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f38800c6670 0x7f3880157620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f3886648640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f388006c650 con 0x7f38800c5b30 2024-04-18T05:01:05.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f3886648640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3880157200 con 0x7f38800c6670 2024-04-18T05:01:05.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f3886648640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38800c6450 con 0x7f388015a270 2024-04-18T05:01:05.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f387f7fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f388015a270 0x7f38800c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:05.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f3884be5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f38800c6670 0x7f3880157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:05.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f3884be5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f38800c6670 0x7f3880157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:50606/0 (socket says 172.21.15.96:50606) 2024-04-18T05:01:05.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f387f7fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f388015a270 0x7f38800c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:56502/0 (socket says 172.21.15.96:56502) 2024-04-18T05:01:05.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f3884be5640 1 -- 172.21.15.96:0/119217886 learned_addr learned my addr 172.21.15.96:0/119217886 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:05.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f387f7fe640 1 -- 172.21.15.96:0/119217886 >> v2:172.21.15.139:3300/0 conn(0x7f38800c6670 msgr2=0x7f3880157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:05.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f387f7fe640 1 --2- 172.21.15.96:0/119217886 >> v2:172.21.15.139:3300/0 conn(0x7f38800c6670 0x7f3880157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f387f7fe640 1 -- 172.21.15.96:0/119217886 >> v1:172.21.15.139:6789/0 conn(0x7f38800c5b30 legacy=0x7f38800c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f387f7fe640 1 -- 172.21.15.96:0/119217886 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38800c1500 con 0x7f388015a270 2024-04-18T05:01:05.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.535+0000 7f3884be5640 1 --2- 172.21.15.96:0/119217886 >> v2:172.21.15.139:3300/0 conn(0x7f38800c6670 0x7f3880157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T05:01:05.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.539+0000 7f387f7fe640 1 --2- 172.21.15.96:0/119217886 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f388015a270 0x7f38800c5f10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f38740097c0 tx=0x7f387401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf7118c836629505 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:05.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.539+0000 7f387effd640 1 -- 172.21.15.96:0/119217886 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38740a8990 con 0x7f388015a270 2024-04-18T05:01:05.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.539+0000 7f387effd640 1 -- 172.21.15.96:0/119217886 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38740a8af0 con 0x7f388015a270 2024-04-18T05:01:05.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.539+0000 7f387effd640 1 -- 172.21.15.96:0/119217886 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38740a8e80 con 0x7f388015a270 2024-04-18T05:01:05.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.539+0000 7f3886648640 1 -- 172.21.15.96:0/119217886 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f388015a270 msgr2=0x7f38800c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.539+0000 7f3886648640 1 --2- 172.21.15.96:0/119217886 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f388015a270 0x7f38800c5f10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f38740097c0 tx=0x7f387401ec90 comp rx=0 tx=0).stop 2024-04-18T05:01:05.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.539+0000 7f3886648640 1 -- 172.21.15.96:0/119217886 shutdown_connections 2024-04-18T05:01:05.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.539+0000 7f3886648640 1 --2- 172.21.15.96:0/119217886 >> v2:172.21.15.139:3300/0 conn(0x7f38800c6670 0x7f3880157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.539+0000 7f3886648640 1 --2- 172.21.15.96:0/119217886 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f388015a270 0x7f38800c5f10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.539+0000 7f3886648640 1 -- 172.21.15.96:0/119217886 >> 172.21.15.96:0/119217886 conn(0x7f388006a8e0 msgr2=0x7f38800c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:05.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.539+0000 7f3886648640 1 -- 172.21.15.96:0/119217886 shutdown_connections 2024-04-18T05:01:05.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.539+0000 7f3886648640 1 -- 172.21.15.96:0/119217886 wait complete. 2024-04-18T05:01:05.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.539+0000 7f3886648640 1 Processor -- start 2024-04-18T05:01:05.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.539+0000 7f3886648640 1 -- start start 2024-04-18T05:01:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3886648640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38800c5b30 0x7f3880149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3886648640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38800c6670 0x7f38801ecf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3886648640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f388015a270 0x7f38800c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3886648640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38801ecab0 con 0x7f388015a270 2024-04-18T05:01:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3886648640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38801ec480 con 0x7f38800c5b30 2024-04-18T05:01:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3886648640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38800c0560 con 0x7f38800c6670 2024-04-18T05:01:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3884be5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f388015a270 0x7f38800c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3884be5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f388015a270 0x7f38800c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33800/0 (socket says 172.21.15.96:33800) 2024-04-18T05:01:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3884be5640 1 -- 172.21.15.96:0/3029035709 learned_addr learned my addr 172.21.15.96:0/3029035709 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f387f7fe640 1 --2- 172.21.15.96:0/3029035709 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38800c6670 0x7f38801ecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f387ffff640 1 --2- 172.21.15.96:0/3029035709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38800c5b30 0x7f3880149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3884be5640 1 -- 172.21.15.96:0/3029035709 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38800c6670 msgr2=0x7f38801ecf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3884be5640 1 --2- 172.21.15.96:0/3029035709 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38800c6670 0x7f38801ecf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3884be5640 1 -- 172.21.15.96:0/3029035709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38800c5b30 msgr2=0x7f3880149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3884be5640 1 --2- 172.21.15.96:0/3029035709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38800c5b30 0x7f3880149bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3884be5640 1 -- 172.21.15.96:0/3029035709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3878009b30 con 0x7f388015a270 2024-04-18T05:01:05.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f387ffff640 1 --2- 172.21.15.96:0/3029035709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38800c5b30 0x7f3880149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:01:05.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3884be5640 1 --2- 172.21.15.96:0/3029035709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f388015a270 0x7f38800c26e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f387800efc0 tx=0x7f387800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:05.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f387cff9640 1 -- 172.21.15.96:0/3029035709 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3878018070 con 0x7f388015a270 2024-04-18T05:01:05.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f387cff9640 1 -- 172.21.15.96:0/3029035709 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387800f040 con 0x7f388015a270 2024-04-18T05:01:05.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f387cff9640 1 -- 172.21.15.96:0/3029035709 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387800ce00 con 0x7f388015a270 2024-04-18T05:01:05.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3886648640 1 -- 172.21.15.96:0/3029035709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3874009420 con 0x7f388015a270 2024-04-18T05:01:05.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3886648640 1 -- 172.21.15.96:0/3029035709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38801ec740 con 0x7f388015a270 2024-04-18T05:01:05.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f3886648640 1 -- 172.21.15.96:0/3029035709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38801ecc20 con 0x7f388015a270 2024-04-18T05:01:05.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f387cff9640 1 -- 172.21.15.96:0/3029035709 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3878014480 con 0x7f388015a270 2024-04-18T05:01:05.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f387cff9640 1 --2- 172.21.15.96:0/3029035709 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f386c066690 0x7f386c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f387cff9640 1 -- 172.21.15.96:0/3029035709 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f38780844a0 con 0x7f388015a270 2024-04-18T05:01:05.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f387ffff640 1 --2- 172.21.15.96:0/3029035709 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f386c066690 0x7f386c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:05.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.543+0000 7f387ffff640 1 --2- 172.21.15.96:0/3029035709 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f386c066690 0x7f386c068b50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f38700016f0 tx=0x7f3870009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:05.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.547+0000 7f387cff9640 1 -- 172.21.15.96:0/3029035709 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f3878051860 con 0x7f388015a270 2024-04-18T05:01:05.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.707+0000 7f3886648640 1 -- 172.21.15.96:0/3029035709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f38800670f0 con 0x7f388015a270 2024-04-18T05:01:05.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.711+0000 7f387cff9640 1 -- 172.21.15.96:0/3029035709 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3878054e80 con 0x7f388015a270 2024-04-18T05:01:05.711 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-04-18T05:01:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.711+0000 7f3886648640 1 -- 172.21.15.96:0/3029035709 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f386c066690 msgr2=0x7f386c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.711+0000 7f3886648640 1 --2- 172.21.15.96:0/3029035709 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f386c066690 0x7f386c068b50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f38700016f0 tx=0x7f3870009040 comp rx=0 tx=0).stop 2024-04-18T05:01:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.711+0000 7f3886648640 1 -- 172.21.15.96:0/3029035709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f388015a270 msgr2=0x7f38800c26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.711+0000 7f3886648640 1 --2- 172.21.15.96:0/3029035709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f388015a270 0x7f38800c26e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f387800efc0 tx=0x7f387800c490 comp rx=0 tx=0).stop 2024-04-18T05:01:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.711+0000 7f3886648640 1 -- 172.21.15.96:0/3029035709 shutdown_connections 2024-04-18T05:01:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.711+0000 7f3886648640 1 --2- 172.21.15.96:0/3029035709 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f386c066690 0x7f386c068b50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.711+0000 7f3886648640 1 --2- 172.21.15.96:0/3029035709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f388015a270 0x7f38800c26e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.711+0000 7f3886648640 1 --2- 172.21.15.96:0/3029035709 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f38800c6670 0x7f38801ecf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.711+0000 7f3886648640 1 --2- 172.21.15.96:0/3029035709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38800c5b30 0x7f3880149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.711+0000 7f3886648640 1 -- 172.21.15.96:0/3029035709 >> 172.21.15.96:0/3029035709 conn(0x7f388006a8e0 msgr2=0x7f38800c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.711+0000 7f3886648640 1 -- 172.21.15.96:0/3029035709 shutdown_connections 2024-04-18T05:01:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.711+0000 7f3886648640 1 -- 172.21.15.96:0/3029035709 wait complete. 2024-04-18T05:01:05.729 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-18T05:01:05.729 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T05:01:05.735 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T05:01:05.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.899+0000 7f5128c07640 1 Processor -- start 2024-04-18T05:01:05.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.899+0000 7f5128c07640 1 -- start start 2024-04-18T05:01:05.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.899+0000 7f5128c07640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f51240ca300 0x7f51240ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.899+0000 7f5128c07640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f512415a950 0x7f512415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.899+0000 7f5128c07640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f512415b320 con 0x7f5124151210 2024-04-18T05:01:05.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.899+0000 7f5128c07640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5124157150 con 0x7f512415a950 2024-04-18T05:01:05.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.899+0000 7f5128c07640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5124157430 con 0x7f51240ca300 2024-04-18T05:01:05.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.903+0000 7f512259c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5124151210 0x7f51240c1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59944/0 (socket says 172.21.15.96:59944) 2024-04-18T05:01:05.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.903+0000 7f512259c640 1 -- 172.21.15.96:0/1652388459 learned_addr learned my addr 172.21.15.96:0/1652388459 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:01:05.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.903+0000 7f5122d9d640 1 --2- 172.21.15.96:0/1652388459 >> v2:172.21.15.96:3300/0 conn(0x7f512415a950 0x7f512415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:05.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.903+0000 7f512159a640 1 -- 172.21.15.96:0/1652388459 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584046334 0 0) 0x7f512415b320 con 0x7f5124151210 2024-04-18T05:01:05.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.903+0000 7f512159a640 1 -- 172.21.15.96:0/1652388459 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f510c003530 con 0x7f5124151210 2024-04-18T05:01:05.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.903+0000 7f5121d9b640 1 --2- 172.21.15.96:0/1652388459 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f51240ca300 0x7f51240ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:05.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.903+0000 7f5122d9d640 1 -- 172.21.15.96:0/1652388459 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f51240ca300 msgr2=0x7f51240ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:05.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.903+0000 7f5122d9d640 1 --2- 172.21.15.96:0/1652388459 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f51240ca300 0x7f51240ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.903+0000 7f5122d9d640 1 -- 172.21.15.96:0/1652388459 >> v1:172.21.15.96:6789/0 conn(0x7f5124151210 legacy=0x7f51240c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.903+0000 7f5122d9d640 1 -- 172.21.15.96:0/1652388459 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5124157710 con 0x7f512415a950 2024-04-18T05:01:05.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.907+0000 7f5122d9d640 1 --2- 172.21.15.96:0/1652388459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f512415a950 0x7f512415ade0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f511c009d90 tx=0x7f511c01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1eb2e4dc6b0103d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:05.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.907+0000 7f512159a640 1 -- 172.21.15.96:0/1652388459 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0af600 con 0x7f512415a950 2024-04-18T05:01:05.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.907+0000 7f512159a640 1 -- 172.21.15.96:0/1652388459 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c0ab050 con 0x7f512415a950 2024-04-18T05:01:05.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.907+0000 7f512159a640 1 -- 172.21.15.96:0/1652388459 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0af980 con 0x7f512415a950 2024-04-18T05:01:05.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.907+0000 7f5128c07640 1 -- 172.21.15.96:0/1652388459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f512415a950 msgr2=0x7f512415ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.907+0000 7f5128c07640 1 --2- 172.21.15.96:0/1652388459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f512415a950 0x7f512415ade0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f511c009d90 tx=0x7f511c01f150 comp rx=0 tx=0).stop 2024-04-18T05:01:05.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.907+0000 7f5128c07640 1 -- 172.21.15.96:0/1652388459 shutdown_connections 2024-04-18T05:01:05.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.907+0000 7f5128c07640 1 --2- 172.21.15.96:0/1652388459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f512415a950 0x7f512415ade0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.907+0000 7f5128c07640 1 --2- 172.21.15.96:0/1652388459 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f51240ca300 0x7f51240ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.907+0000 7f5128c07640 1 -- 172.21.15.96:0/1652388459 >> 172.21.15.96:0/1652388459 conn(0x7f512406c750 msgr2=0x7f51240c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:05.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.907+0000 7f5128c07640 1 -- 172.21.15.96:0/1652388459 shutdown_connections 2024-04-18T05:01:05.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.907+0000 7f5128c07640 1 -- 172.21.15.96:0/1652388459 wait complete. 2024-04-18T05:01:05.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.907+0000 7f5128c07640 1 Processor -- start 2024-04-18T05:01:05.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.907+0000 7f5128c07640 1 -- start start 2024-04-18T05:01:05.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5128c07640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240ca300 0x7f51240c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5128c07640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5124151210 0x7f51241efd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5128c07640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f512415a950 0x7f5124143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5128c07640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5124159010 con 0x7f51240ca300 2024-04-18T05:01:05.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5128c07640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512414d760 con 0x7f512415a950 2024-04-18T05:01:05.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5128c07640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51241592b0 con 0x7f5124151210 2024-04-18T05:01:05.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f512259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240ca300 0x7f51240c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:05.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f512259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240ca300 0x7f51240c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33818/0 (socket says 172.21.15.96:33818) 2024-04-18T05:01:05.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f512259c640 1 -- 172.21.15.96:0/1427673326 learned_addr learned my addr 172.21.15.96:0/1427673326 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:05.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f512259c640 1 -- 172.21.15.96:0/1427673326 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5124151210 msgr2=0x7f51241efd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f512259c640 1 --2- 172.21.15.96:0/1427673326 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5124151210 0x7f51241efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f512259c640 1 -- 172.21.15.96:0/1427673326 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f512415a950 msgr2=0x7f5124143ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:05.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f512259c640 1 --2- 172.21.15.96:0/1427673326 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f512415a950 0x7f5124143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:05.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f512259c640 1 -- 172.21.15.96:0/1427673326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c009a70 con 0x7f51240ca300 2024-04-18T05:01:05.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f512259c640 1 --2- 172.21.15.96:0/1427673326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240ca300 0x7f51240c9a60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f511800c420 tx=0x7f511800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:05.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5112ffd640 1 -- 172.21.15.96:0/1427673326 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5118005cf0 con 0x7f51240ca300 2024-04-18T05:01:05.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5112ffd640 1 -- 172.21.15.96:0/1427673326 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5118005e50 con 0x7f51240ca300 2024-04-18T05:01:05.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5128c07640 1 -- 172.21.15.96:0/1427673326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512414cc80 con 0x7f51240ca300 2024-04-18T05:01:05.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5112ffd640 1 -- 172.21.15.96:0/1427673326 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51180072d0 con 0x7f51240ca300 2024-04-18T05:01:05.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5128c07640 1 -- 172.21.15.96:0/1427673326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512414d240 con 0x7f51240ca300 2024-04-18T05:01:05.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5128c07640 1 -- 172.21.15.96:0/1427673326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512414cae0 con 0x7f51240ca300 2024-04-18T05:01:05.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5112ffd640 1 -- 172.21.15.96:0/1427673326 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5118007430 con 0x7f51240ca300 2024-04-18T05:01:05.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5112ffd640 1 --2- 172.21.15.96:0/1427673326 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f51040666c0 0x7f5104068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:05.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5112ffd640 1 -- 172.21.15.96:0/1427673326 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5118083750 con 0x7f51240ca300 2024-04-18T05:01:05.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5121d9b640 1 --2- 172.21.15.96:0/1427673326 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f51040666c0 0x7f5104068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:05.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.911+0000 7f5121d9b640 1 --2- 172.21.15.96:0/1427673326 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f51040666c0 0x7f5104068b80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f51241576e0 tx=0x7f5114008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:05.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:05.915+0000 7f5112ffd640 1 -- 172.21.15.96:0/1427673326 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f512414cae0 con 0x7f51240ca300 2024-04-18T05:01:06.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.063+0000 7f5128c07640 1 -- 172.21.15.96:0/1427673326 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f512414cae0 con 0x7f51240ca300 2024-04-18T05:01:06.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.063+0000 7f5112ffd640 1 -- 172.21.15.96:0/1427673326 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16090 (secure 0 0 0) 0x7f512414cae0 con 0x7f51240ca300 2024-04-18T05:01:06.067 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T05:01:06.067 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":23,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:55:39.795060+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:54:39.219441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:54:40.139557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.720340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.767224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.811511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.710188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.860525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.704784+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1b","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T05:01:06.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.067+0000 7f5128c07640 1 -- 172.21.15.96:0/1427673326 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f51040666c0 msgr2=0x7f5104068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.067+0000 7f5128c07640 1 --2- 172.21.15.96:0/1427673326 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f51040666c0 0x7f5104068b80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f51241576e0 tx=0x7f5114008040 comp rx=0 tx=0).stop 2024-04-18T05:01:06.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.067+0000 7f5128c07640 1 -- 172.21.15.96:0/1427673326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240ca300 msgr2=0x7f51240c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.067+0000 7f5128c07640 1 --2- 172.21.15.96:0/1427673326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240ca300 0x7f51240c9a60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f511800c420 tx=0x7f511800c8e0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.067+0000 7f5128c07640 1 -- 172.21.15.96:0/1427673326 shutdown_connections 2024-04-18T05:01:06.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.067+0000 7f5128c07640 1 --2- 172.21.15.96:0/1427673326 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f51040666c0 0x7f5104068b80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.067+0000 7f5128c07640 1 --2- 172.21.15.96:0/1427673326 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f512415a950 0x7f5124143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.067+0000 7f5128c07640 1 --2- 172.21.15.96:0/1427673326 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5124151210 0x7f51241efd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.067+0000 7f5128c07640 1 --2- 172.21.15.96:0/1427673326 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51240ca300 0x7f51240c9a60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.067+0000 7f5128c07640 1 -- 172.21.15.96:0/1427673326 >> 172.21.15.96:0/1427673326 conn(0x7f512406c750 msgr2=0x7f51240c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:06.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.067+0000 7f5128c07640 1 -- 172.21.15.96:0/1427673326 shutdown_connections 2024-04-18T05:01:06.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.067+0000 7f5128c07640 1 -- 172.21.15.96:0/1427673326 wait complete. 2024-04-18T05:01:06.085 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:54:32.641813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T04:54:39.219441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T04:54:40.139557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T05:01:06.085 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T05:01:06.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27ef0ad640 1 Processor -- start 2024-04-18T05:01:06.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27ef0ad640 1 -- start start 2024-04-18T05:01:06.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27ef0ad640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f27e80c3650 0x7f27e80c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27ef0ad640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e80c8100 con 0x7f27e8155d00 2024-04-18T05:01:06.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27ef0ad640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e80c5660 con 0x7f27e814fc60 2024-04-18T05:01:06.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27ef0ad640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e80c8350 con 0x7f27e80c3650 2024-04-18T05:01:06.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e7fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f27e8155d00 0x7f27e8156170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59946/0 (socket says 172.21.15.96:59946) 2024-04-18T05:01:06.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e7fff640 1 -- 172.21.15.96:0/4178754801 learned_addr learned my addr 172.21.15.96:0/4178754801 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:01:06.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27ed64a640 1 --2- 172.21.15.96:0/4178754801 >> v2:172.21.15.139:3300/0 conn(0x7f27e80c3650 0x7f27e80c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e77fe640 1 -- 172.21.15.96:0/4178754801 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951183946 0 0) 0x7f27e80c8100 con 0x7f27e8155d00 2024-04-18T05:01:06.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e77fe640 1 -- 172.21.15.96:0/4178754801 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d8003530 con 0x7f27e8155d00 2024-04-18T05:01:06.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e77fe640 1 -- 172.21.15.96:0/4178754801 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 323718197 0 0) 0x7f27d8003530 con 0x7f27e8155d00 2024-04-18T05:01:06.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e77fe640 1 -- 172.21.15.96:0/4178754801 >> v2:172.21.15.139:3300/0 conn(0x7f27e80c3650 msgr2=0x7f27e80c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:06.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e77fe640 1 --2- 172.21.15.96:0/4178754801 >> v2:172.21.15.139:3300/0 conn(0x7f27e80c3650 0x7f27e80c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e77fe640 1 -- 172.21.15.96:0/4178754801 >> v1:172.21.15.139:6789/0 conn(0x7f27e814fc60 legacy=0x7f27e806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e77fe640 1 -- 172.21.15.96:0/4178754801 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e80c8630 con 0x7f27e8155d00 2024-04-18T05:01:06.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e77fe640 1 -- 172.21.15.96:0/4178754801 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f27d4001680 con 0x7f27e8155d00 2024-04-18T05:01:06.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e77fe640 1 -- 172.21.15.96:0/4178754801 >> v1:172.21.15.96:6789/0 conn(0x7f27e8155d00 legacy=0x7f27e8156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e77fe640 1 --2- 172.21.15.96:0/4178754801 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f27d8003980 0x7f27d8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e77fe640 1 --2- 172.21.15.96:0/4178754801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27d80047d0 0x7f27d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e77fe640 1 --2- 172.21.15.96:0/4178754801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27d8005190 0x7f27d800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e77fe640 1 -- 172.21.15.96:0/4178754801 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e80c8350 con 0x7f27d80047d0 2024-04-18T05:01:06.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e77fe640 1 -- 172.21.15.96:0/4178754801 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d800c130 con 0x7f27d8005190 2024-04-18T05:01:06.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e77fe640 1 -- 172.21.15.96:0/4178754801 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d800c2f0 con 0x7f27d8003980 2024-04-18T05:01:06.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e7fff640 1 --2- 172.21.15.96:0/4178754801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27d80047d0 0x7f27d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27ece49640 1 --2- 172.21.15.96:0/4178754801 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f27d8003980 0x7f27d8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e7fff640 1 -- 172.21.15.96:0/4178754801 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f27d8003980 msgr2=0x7f27d8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:06.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e7fff640 1 --2- 172.21.15.96:0/4178754801 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f27d8003980 0x7f27d8003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e7fff640 1 -- 172.21.15.96:0/4178754801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27d8005190 msgr2=0x7f27d800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:06.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e7fff640 1 --2- 172.21.15.96:0/4178754801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27d8005190 0x7f27d800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27e7fff640 1 -- 172.21.15.96:0/4178754801 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d8003530 con 0x7f27d80047d0 2024-04-18T05:01:06.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.195+0000 7f27ed64a640 1 -- 172.21.15.96:0/4178754801 reap_dead start 2024-04-18T05:01:06.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27e7fff640 1 --2- 172.21.15.96:0/4178754801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27d80047d0 0x7f27d8004c50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f27d400c1c0 tx=0x7f27d401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4dff0b9e0ed8a7d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:06.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27e77fe640 1 -- 172.21.15.96:0/4178754801 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d40a5af0 con 0x7f27d80047d0 2024-04-18T05:01:06.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27e77fe640 1 -- 172.21.15.96:0/4178754801 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d40a5c50 con 0x7f27d80047d0 2024-04-18T05:01:06.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27e77fe640 1 -- 172.21.15.96:0/4178754801 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4005b20 con 0x7f27d80047d0 2024-04-18T05:01:06.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ef0ad640 1 -- 172.21.15.96:0/4178754801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27d80047d0 msgr2=0x7f27d8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ef0ad640 1 --2- 172.21.15.96:0/4178754801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27d80047d0 0x7f27d8004c50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f27d400c1c0 tx=0x7f27d401cc10 comp rx=0 tx=0).stop 2024-04-18T05:01:06.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ef0ad640 1 -- 172.21.15.96:0/4178754801 shutdown_connections 2024-04-18T05:01:06.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ef0ad640 1 --2- 172.21.15.96:0/4178754801 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27d80047d0 0x7f27d8004c50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ef0ad640 1 -- 172.21.15.96:0/4178754801 >> 172.21.15.96:0/4178754801 conn(0x7f27e806c610 msgr2=0x7f27e80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:06.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ef0ad640 1 -- 172.21.15.96:0/4178754801 shutdown_connections 2024-04-18T05:01:06.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ef0ad640 1 -- 172.21.15.96:0/4178754801 wait complete. 2024-04-18T05:01:06.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ef0ad640 1 Processor -- start 2024-04-18T05:01:06.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ef0ad640 1 -- start start 2024-04-18T05:01:06.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ef0ad640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27d80047d0 0x7f27e81f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ef0ad640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f27e8147670 0x7f27e80c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ef0ad640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27e81ee170 0x7f27e81ee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ef0ad640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e8159ff0 con 0x7f27e81ee170 2024-04-18T05:01:06.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ef0ad640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e8147490 con 0x7f27d80047d0 2024-04-18T05:01:06.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ef0ad640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e81f26b0 con 0x7f27e8147670 2024-04-18T05:01:06.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ed64a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27e81ee170 0x7f27e81ee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ed64a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27e81ee170 0x7f27e81ee5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33828/0 (socket says 172.21.15.96:33828) 2024-04-18T05:01:06.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ed64a640 1 -- 172.21.15.96:0/1586570328 learned_addr learned my addr 172.21.15.96:0/1586570328 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:06.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ece49640 1 --2- 172.21.15.96:0/1586570328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27d80047d0 0x7f27e81f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27e7fff640 1 --2- 172.21.15.96:0/1586570328 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f27e8147670 0x7f27e80c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ed64a640 1 -- 172.21.15.96:0/1586570328 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f27e8147670 msgr2=0x7f27e80c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ed64a640 1 --2- 172.21.15.96:0/1586570328 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f27e8147670 0x7f27e80c5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ed64a640 1 -- 172.21.15.96:0/1586570328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27d80047d0 msgr2=0x7f27e81f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ed64a640 1 --2- 172.21.15.96:0/1586570328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27d80047d0 0x7f27e81f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ed64a640 1 -- 172.21.15.96:0/1586570328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e80c6360 con 0x7f27e81ee170 2024-04-18T05:01:06.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27ed64a640 1 --2- 172.21.15.96:0/1586570328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27e81ee170 0x7f27e81ee5f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f27e80cb010 tx=0x7f27e000e620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:06.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27e57fa640 1 -- 172.21.15.96:0/1586570328 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0010ec0 con 0x7f27e81ee170 2024-04-18T05:01:06.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27e57fa640 1 -- 172.21.15.96:0/1586570328 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e0013450 con 0x7f27e81ee170 2024-04-18T05:01:06.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.199+0000 7f27e57fa640 1 -- 172.21.15.96:0/1586570328 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0013800 con 0x7f27e81ee170 2024-04-18T05:01:06.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.203+0000 7f27ef0ad640 1 -- 172.21.15.96:0/1586570328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e8146ef0 con 0x7f27e81ee170 2024-04-18T05:01:06.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.203+0000 7f27ef0ad640 1 -- 172.21.15.96:0/1586570328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e81591e0 con 0x7f27e81ee170 2024-04-18T05:01:06.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.203+0000 7f27ef0ad640 1 -- 172.21.15.96:0/1586570328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e8067050 con 0x7f27e81ee170 2024-04-18T05:01:06.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.203+0000 7f27e57fa640 1 -- 172.21.15.96:0/1586570328 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f27e0013960 con 0x7f27e81ee170 2024-04-18T05:01:06.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.203+0000 7f27e57fa640 1 --2- 172.21.15.96:0/1586570328 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f27cc066690 0x7f27cc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.203+0000 7f27e57fa640 1 -- 172.21.15.96:0/1586570328 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f27e0086990 con 0x7f27e81ee170 2024-04-18T05:01:06.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.203+0000 7f27ece49640 1 --2- 172.21.15.96:0/1586570328 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f27cc066690 0x7f27cc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.203+0000 7f27ece49640 1 --2- 172.21.15.96:0/1586570328 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f27cc066690 0x7f27cc068b50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f27dc000c10 tx=0x7f27dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:06.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.207+0000 7f27e57fa640 1 -- 172.21.15.96:0/1586570328 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f27e0053ce0 con 0x7f27e81ee170 2024-04-18T05:01:06.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.351+0000 7f27ef0ad640 1 -- 172.21.15.96:0/1586570328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27e815a160 con 0x7f27e81ee170 2024-04-18T05:01:06.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.351+0000 7f27e57fa640 1 -- 172.21.15.96:0/1586570328 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27e0057300 con 0x7f27e81ee170 2024-04-18T05:01:06.355 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-18T05:01:06.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.355+0000 7f27ef0ad640 1 -- 172.21.15.96:0/1586570328 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f27cc066690 msgr2=0x7f27cc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.355+0000 7f27ef0ad640 1 --2- 172.21.15.96:0/1586570328 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f27cc066690 0x7f27cc068b50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f27dc000c10 tx=0x7f27dc009040 comp rx=0 tx=0).stop 2024-04-18T05:01:06.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.355+0000 7f27ef0ad640 1 -- 172.21.15.96:0/1586570328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27e81ee170 msgr2=0x7f27e81ee5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.355+0000 7f27ef0ad640 1 --2- 172.21.15.96:0/1586570328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27e81ee170 0x7f27e81ee5f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f27e80cb010 tx=0x7f27e000e620 comp rx=0 tx=0).stop 2024-04-18T05:01:06.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.355+0000 7f27ef0ad640 1 -- 172.21.15.96:0/1586570328 shutdown_connections 2024-04-18T05:01:06.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.355+0000 7f27ef0ad640 1 --2- 172.21.15.96:0/1586570328 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f27cc066690 0x7f27cc068b50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.355+0000 7f27ef0ad640 1 --2- 172.21.15.96:0/1586570328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27e81ee170 0x7f27e81ee5f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.355+0000 7f27ef0ad640 1 --2- 172.21.15.96:0/1586570328 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f27e8147670 0x7f27e80c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.355+0000 7f27ef0ad640 1 --2- 172.21.15.96:0/1586570328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27d80047d0 0x7f27e81f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.355+0000 7f27ef0ad640 1 -- 172.21.15.96:0/1586570328 >> 172.21.15.96:0/1586570328 conn(0x7f27e806c610 msgr2=0x7f27e814e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:06.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.355+0000 7f27ef0ad640 1 -- 172.21.15.96:0/1586570328 shutdown_connections 2024-04-18T05:01:06.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.355+0000 7f27ef0ad640 1 -- 172.21.15.96:0/1586570328 wait complete. 2024-04-18T05:01:06.372 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T05:01:06.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.479+0000 7fadb1da4640 1 Processor -- start 2024-04-18T05:01:06.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.479+0000 7fadb1da4640 1 -- start start 2024-04-18T05:01:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadb1da4640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fadac1532d0 0x7fadac158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadb1da4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fadac0cacc0 0x7fadac15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadb1da4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadac15d3b0 con 0x7fadac0c3fd0 2024-04-18T05:01:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadb1da4640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadac0c5970 con 0x7fadac0cacc0 2024-04-18T05:01:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadb1da4640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadac1594a0 con 0x7fadac1532d0 2024-04-18T05:01:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fada3fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fadac0cacc0 0x7fadac15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadabfff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fadac0c3fd0 0x7fadac0ce740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59950/0 (socket says 172.21.15.96:59950) 2024-04-18T05:01:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadabfff640 1 -- 172.21.15.96:0/2326730615 learned_addr learned my addr 172.21.15.96:0/2326730615 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:01:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadab7fe640 1 --2- 172.21.15.96:0/2326730615 >> v2:172.21.15.139:3300/0 conn(0x7fadac1532d0 0x7fadac158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fada3fff640 1 -- 172.21.15.96:0/2326730615 >> v2:172.21.15.139:3300/0 conn(0x7fadac1532d0 msgr2=0x7fadac158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fada3fff640 1 --2- 172.21.15.96:0/2326730615 >> v2:172.21.15.139:3300/0 conn(0x7fadac1532d0 0x7fadac158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fada3fff640 1 -- 172.21.15.96:0/2326730615 >> v1:172.21.15.96:6789/0 conn(0x7fadac0c3fd0 legacy=0x7fadac0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fada3fff640 1 -- 172.21.15.96:0/2326730615 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac1536b0 con 0x7fadac0cacc0 2024-04-18T05:01:06.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fada3fff640 1 --2- 172.21.15.96:0/2326730615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac0cacc0 0x7fadac15ce70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fadac0cc2d0 tx=0x7fad9401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e1f55051db8322 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:06.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadaaffd640 1 -- 172.21.15.96:0/2326730615 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad940a8950 con 0x7fadac0cacc0 2024-04-18T05:01:06.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadaaffd640 1 -- 172.21.15.96:0/2326730615 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad940a8ab0 con 0x7fadac0cacc0 2024-04-18T05:01:06.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadaaffd640 1 -- 172.21.15.96:0/2326730615 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad940a8e40 con 0x7fadac0cacc0 2024-04-18T05:01:06.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadb1da4640 1 -- 172.21.15.96:0/2326730615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac0cacc0 msgr2=0x7fadac15ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadb1da4640 1 --2- 172.21.15.96:0/2326730615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac0cacc0 0x7fadac15ce70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fadac0cc2d0 tx=0x7fad9401ec50 comp rx=0 tx=0).stop 2024-04-18T05:01:06.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadb1da4640 1 -- 172.21.15.96:0/2326730615 shutdown_connections 2024-04-18T05:01:06.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadb1da4640 1 --2- 172.21.15.96:0/2326730615 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac0cacc0 0x7fadac15ce70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadb1da4640 1 --2- 172.21.15.96:0/2326730615 >> v2:172.21.15.139:3300/0 conn(0x7fadac1532d0 0x7fadac158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadb1da4640 1 -- 172.21.15.96:0/2326730615 >> 172.21.15.96:0/2326730615 conn(0x7fadac071760 msgr2=0x7fadac06b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:06.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadb1da4640 1 -- 172.21.15.96:0/2326730615 shutdown_connections 2024-04-18T05:01:06.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.483+0000 7fadb1da4640 1 -- 172.21.15.96:0/2326730615 wait complete. 2024-04-18T05:01:06.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadb1da4640 1 Processor -- start 2024-04-18T05:01:06.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadb1da4640 1 -- start start 2024-04-18T05:01:06.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadb1da4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fadac0c3fd0 0x7fadac0b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadb1da4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fadac0cacc0 0x7fadac157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadb1da4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac1532d0 0x7fadac158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadb1da4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac159f20 con 0x7fadac1532d0 2024-04-18T05:01:06.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadb1da4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac157bd0 con 0x7fadac0cacc0 2024-04-18T05:01:06.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadb1da4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadac156f50 con 0x7fadac0c3fd0 2024-04-18T05:01:06.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadabfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac1532d0 0x7fadac158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadabfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac1532d0 0x7fadac158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33854/0 (socket says 172.21.15.96:33854) 2024-04-18T05:01:06.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadabfff640 1 -- 172.21.15.96:0/3643129273 learned_addr learned my addr 172.21.15.96:0/3643129273 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:06.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fada3fff640 1 --2- 172.21.15.96:0/3643129273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fadac0cacc0 0x7fadac157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadab7fe640 1 --2- 172.21.15.96:0/3643129273 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fadac0c3fd0 0x7fadac0b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadabfff640 1 -- 172.21.15.96:0/3643129273 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fadac0c3fd0 msgr2=0x7fadac0b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadabfff640 1 --2- 172.21.15.96:0/3643129273 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fadac0c3fd0 0x7fadac0b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadabfff640 1 -- 172.21.15.96:0/3643129273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fadac0cacc0 msgr2=0x7fadac157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadabfff640 1 --2- 172.21.15.96:0/3643129273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fadac0cacc0 0x7fadac157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadabfff640 1 -- 172.21.15.96:0/3643129273 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad94009420 con 0x7fadac1532d0 2024-04-18T05:01:06.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadabfff640 1 --2- 172.21.15.96:0/3643129273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac1532d0 0x7fadac158530 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fada400ca80 tx=0x7fada400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:06.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fada8ff9640 1 -- 172.21.15.96:0/3643129273 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada400ac30 con 0x7fadac1532d0 2024-04-18T05:01:06.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fada8ff9640 1 -- 172.21.15.96:0/3643129273 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada400ad90 con 0x7fadac1532d0 2024-04-18T05:01:06.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadb1da4640 1 -- 172.21.15.96:0/3643129273 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadac157230 con 0x7fadac1532d0 2024-04-18T05:01:06.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fada8ff9640 1 -- 172.21.15.96:0/3643129273 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada4012600 con 0x7fadac1532d0 2024-04-18T05:01:06.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadb1da4640 1 -- 172.21.15.96:0/3643129273 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadac1577f0 con 0x7fadac1532d0 2024-04-18T05:01:06.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fadb1da4640 1 -- 172.21.15.96:0/3643129273 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadac157d10 con 0x7fadac1532d0 2024-04-18T05:01:06.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fada8ff9640 1 -- 172.21.15.96:0/3643129273 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fada4007070 con 0x7fadac1532d0 2024-04-18T05:01:06.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fada8ff9640 1 --2- 172.21.15.96:0/3643129273 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fad8c0666c0 0x7fad8c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.487+0000 7fada8ff9640 1 -- 172.21.15.96:0/3643129273 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fada4083f40 con 0x7fadac1532d0 2024-04-18T05:01:06.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.491+0000 7fadab7fe640 1 --2- 172.21.15.96:0/3643129273 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fad8c0666c0 0x7fad8c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.491+0000 7fadab7fe640 1 --2- 172.21.15.96:0/3643129273 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fad8c0666c0 0x7fad8c068b80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009790 tx=0x7fad9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:06.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.495+0000 7fada8ff9640 1 -- 172.21.15.96:0/3643129273 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fadac157d10 con 0x7fadac1532d0 2024-04-18T05:01:06.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.651+0000 7fadb1da4640 1 -- 172.21.15.96:0/3643129273 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fadac157d10 con 0x7fadac1532d0 2024-04-18T05:01:06.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.651+0000 7fada8ff9640 1 -- 172.21.15.96:0/3643129273 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fada4017020 con 0x7fadac1532d0 2024-04-18T05:01:06.654 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-18T05:01:06.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.655+0000 7fadb1da4640 1 -- 172.21.15.96:0/3643129273 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fad8c0666c0 msgr2=0x7fad8c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.655+0000 7fadb1da4640 1 --2- 172.21.15.96:0/3643129273 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fad8c0666c0 0x7fad8c068b80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009790 tx=0x7fad9c008040 comp rx=0 tx=0).stop 2024-04-18T05:01:06.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.655+0000 7fadb1da4640 1 -- 172.21.15.96:0/3643129273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac1532d0 msgr2=0x7fadac158530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.655+0000 7fadb1da4640 1 --2- 172.21.15.96:0/3643129273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac1532d0 0x7fadac158530 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fada400ca80 tx=0x7fada400cf40 comp rx=0 tx=0).stop 2024-04-18T05:01:06.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.655+0000 7fadb1da4640 1 -- 172.21.15.96:0/3643129273 shutdown_connections 2024-04-18T05:01:06.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.655+0000 7fadb1da4640 1 --2- 172.21.15.96:0/3643129273 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fad8c0666c0 0x7fad8c068b80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.655+0000 7fadb1da4640 1 --2- 172.21.15.96:0/3643129273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadac1532d0 0x7fadac158530 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.655+0000 7fadb1da4640 1 --2- 172.21.15.96:0/3643129273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fadac0cacc0 0x7fadac157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.655+0000 7fadb1da4640 1 --2- 172.21.15.96:0/3643129273 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fadac0c3fd0 0x7fadac0b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.655+0000 7fadb1da4640 1 -- 172.21.15.96:0/3643129273 >> 172.21.15.96:0/3643129273 conn(0x7fadac071760 msgr2=0x7fadac0c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:06.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.655+0000 7fadb1da4640 1 -- 172.21.15.96:0/3643129273 shutdown_connections 2024-04-18T05:01:06.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.655+0000 7fadb1da4640 1 -- 172.21.15.96:0/3643129273 wait complete. 2024-04-18T05:01:06.673 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T05:01:06.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.795+0000 7f5bff0c5640 1 Processor -- start 2024-04-18T05:01:06.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.795+0000 7f5bff0c5640 1 -- start start 2024-04-18T05:01:06.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.799+0000 7f5bff0c5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5bf806aa60 0x7f5bf815c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.799+0000 7f5bff0c5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf8159160 con 0x7f5bf806a5f0 2024-04-18T05:01:06.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.799+0000 7f5bff0c5640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf8159440 con 0x7f5bf8152e50 2024-04-18T05:01:06.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.799+0000 7f5bff0c5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf8159720 con 0x7f5bf806aa60 2024-04-18T05:01:06.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.799+0000 7f5bf7fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5bf806a5f0 0x7f5bf806ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59956/0 (socket says 172.21.15.96:59956) 2024-04-18T05:01:06.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.799+0000 7f5bf7fff640 1 -- 172.21.15.96:0/1906108906 learned_addr learned my addr 172.21.15.96:0/1906108906 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:01:06.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.799+0000 7f5bfd662640 1 --2- 172.21.15.96:0/1906108906 >> v2:172.21.15.96:3300/0 conn(0x7f5bf806aa60 0x7f5bf815c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.799+0000 7f5bfd662640 1 -- 172.21.15.96:0/1906108906 >> v1:172.21.15.139:6789/0 conn(0x7f5bf8152e50 legacy=0x7f5bf8071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.799+0000 7f5bfd662640 1 -- 172.21.15.96:0/1906108906 >> v1:172.21.15.96:6789/0 conn(0x7f5bf806a5f0 legacy=0x7f5bf806ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.799+0000 7f5bfd662640 1 -- 172.21.15.96:0/1906108906 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf8159a00 con 0x7f5bf806aa60 2024-04-18T05:01:06.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.799+0000 7f5bfd662640 1 --2- 172.21.15.96:0/1906108906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bf806aa60 0x7f5bf815c6e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009d90 tx=0x7f5bf001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bbcc940dfcaaed server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:06.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.799+0000 7f5bf77fe640 1 -- 172.21.15.96:0/1906108906 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf00a59e0 con 0x7f5bf806aa60 2024-04-18T05:01:06.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.799+0000 7f5bf77fe640 1 -- 172.21.15.96:0/1906108906 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf00a5b40 con 0x7f5bf806aa60 2024-04-18T05:01:06.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.799+0000 7f5bf77fe640 1 -- 172.21.15.96:0/1906108906 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf00ad440 con 0x7f5bf806aa60 2024-04-18T05:01:06.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 -- 172.21.15.96:0/1906108906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bf806aa60 msgr2=0x7f5bf815c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 --2- 172.21.15.96:0/1906108906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bf806aa60 0x7f5bf815c6e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009d90 tx=0x7f5bf001c940 comp rx=0 tx=0).stop 2024-04-18T05:01:06.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 -- 172.21.15.96:0/1906108906 shutdown_connections 2024-04-18T05:01:06.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 --2- 172.21.15.96:0/1906108906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bf806aa60 0x7f5bf815c6e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 -- 172.21.15.96:0/1906108906 >> 172.21.15.96:0/1906108906 conn(0x7f5bf80cb560 msgr2=0x7f5bf80cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:06.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 -- 172.21.15.96:0/1906108906 shutdown_connections 2024-04-18T05:01:06.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 -- 172.21.15.96:0/1906108906 wait complete. 2024-04-18T05:01:06.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 Processor -- start 2024-04-18T05:01:06.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 -- start start 2024-04-18T05:01:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bf806a5f0 0x7f5bf8146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5bf8152e50 0x7f5bf8145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5bf80caf80 0x7f5bf8145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8152740 con 0x7f5bf806a5f0 2024-04-18T05:01:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf81450b0 con 0x7f5bf8152e50 2024-04-18T05:01:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf80c96a0 con 0x7f5bf80caf80 2024-04-18T05:01:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bfce61640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bf806a5f0 0x7f5bf8146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bfce61640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bf806a5f0 0x7f5bf8146780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33872/0 (socket says 172.21.15.96:33872) 2024-04-18T05:01:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bfce61640 1 -- 172.21.15.96:0/3175006894 learned_addr learned my addr 172.21.15.96:0/3175006894 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bfd662640 1 --2- 172.21.15.96:0/3175006894 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5bf80caf80 0x7f5bf8145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bf7fff640 1 --2- 172.21.15.96:0/3175006894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5bf8152e50 0x7f5bf8145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bfce61640 1 -- 172.21.15.96:0/3175006894 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5bf80caf80 msgr2=0x7f5bf8145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bfce61640 1 --2- 172.21.15.96:0/3175006894 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5bf80caf80 0x7f5bf8145a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bfce61640 1 -- 172.21.15.96:0/3175006894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5bf8152e50 msgr2=0x7f5bf8145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bfce61640 1 --2- 172.21.15.96:0/3175006894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5bf8152e50 0x7f5bf8145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bfce61640 1 -- 172.21.15.96:0/3175006894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf0009a70 con 0x7f5bf806a5f0 2024-04-18T05:01:06.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bf7fff640 1 --2- 172.21.15.96:0/3175006894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5bf8152e50 0x7f5bf8145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:01:06.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bfce61640 1 --2- 172.21.15.96:0/3175006894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bf806a5f0 0x7f5bf8146780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00c3f0 tx=0x7f5bec00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:06.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bf57fa640 1 -- 172.21.15.96:0/3175006894 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0052d0 con 0x7f5bf806a5f0 2024-04-18T05:01:06.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bf57fa640 1 -- 172.21.15.96:0/3175006894 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec005430 con 0x7f5bf806a5f0 2024-04-18T05:01:06.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 -- 172.21.15.96:0/3175006894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf815b9c0 con 0x7f5bf806a5f0 2024-04-18T05:01:06.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bf57fa640 1 -- 172.21.15.96:0/3175006894 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec003840 con 0x7f5bf806a5f0 2024-04-18T05:01:06.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 -- 172.21.15.96:0/3175006894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf815bf80 con 0x7f5bf806a5f0 2024-04-18T05:01:06.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.803+0000 7f5bff0c5640 1 -- 172.21.15.96:0/3175006894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf80c27d0 con 0x7f5bf806a5f0 2024-04-18T05:01:06.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.807+0000 7f5bf57fa640 1 -- 172.21.15.96:0/3175006894 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5bec0039a0 con 0x7f5bf806a5f0 2024-04-18T05:01:06.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.807+0000 7f5bf57fa640 1 --2- 172.21.15.96:0/3175006894 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5bdc066690 0x7f5bdc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:06.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.807+0000 7f5bf57fa640 1 -- 172.21.15.96:0/3175006894 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5bec083830 con 0x7f5bf806a5f0 2024-04-18T05:01:06.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.807+0000 7f5bf7fff640 1 --2- 172.21.15.96:0/3175006894 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5bdc066690 0x7f5bdc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:06.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.807+0000 7f5bf7fff640 1 --2- 172.21.15.96:0/3175006894 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5bdc066690 0x7f5bdc068b50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5bf81587e0 tx=0x7f5be4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:06.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.811+0000 7f5bf57fa640 1 -- 172.21.15.96:0/3175006894 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f5bec050a50 con 0x7f5bf806a5f0 2024-04-18T05:01:06.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.963+0000 7f5bff0c5640 1 -- 172.21.15.96:0/3175006894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5bf8067050 con 0x7f5bf806a5f0 2024-04-18T05:01:06.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.963+0000 7f5bf57fa640 1 -- 172.21.15.96:0/3175006894 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5bec017020 con 0x7f5bf806a5f0 2024-04-18T05:01:06.966 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-18T05:01:06.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.967+0000 7f5bff0c5640 1 -- 172.21.15.96:0/3175006894 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5bdc066690 msgr2=0x7f5bdc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.967+0000 7f5bff0c5640 1 --2- 172.21.15.96:0/3175006894 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5bdc066690 0x7f5bdc068b50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5bf81587e0 tx=0x7f5be4009040 comp rx=0 tx=0).stop 2024-04-18T05:01:06.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.967+0000 7f5bff0c5640 1 -- 172.21.15.96:0/3175006894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bf806a5f0 msgr2=0x7f5bf8146780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:06.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.967+0000 7f5bff0c5640 1 --2- 172.21.15.96:0/3175006894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bf806a5f0 0x7f5bf8146780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00c3f0 tx=0x7f5bec00c8b0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.967+0000 7f5bff0c5640 1 -- 172.21.15.96:0/3175006894 shutdown_connections 2024-04-18T05:01:06.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.967+0000 7f5bff0c5640 1 --2- 172.21.15.96:0/3175006894 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5bdc066690 0x7f5bdc068b50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.967+0000 7f5bff0c5640 1 --2- 172.21.15.96:0/3175006894 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5bf80caf80 0x7f5bf8145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.967+0000 7f5bff0c5640 1 --2- 172.21.15.96:0/3175006894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5bf8152e50 0x7f5bf8145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.967+0000 7f5bff0c5640 1 --2- 172.21.15.96:0/3175006894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bf806a5f0 0x7f5bf8146780 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:06.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.967+0000 7f5bff0c5640 1 -- 172.21.15.96:0/3175006894 >> 172.21.15.96:0/3175006894 conn(0x7f5bf80cb560 msgr2=0x7f5bf80c6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:06.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.967+0000 7f5bff0c5640 1 -- 172.21.15.96:0/3175006894 shutdown_connections 2024-04-18T05:01:06.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:06.967+0000 7f5bff0c5640 1 -- 172.21.15.96:0/3175006894 wait complete. 2024-04-18T05:01:06.984 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T05:01:07.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.091+0000 7f2e69523640 1 Processor -- start 2024-04-18T05:01:07.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.091+0000 7f2e69523640 1 -- start start 2024-04-18T05:01:07.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e69523640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2e640c6100 0x7f2e64155350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:07.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e69523640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e6406fdf0 0x7f2e6406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:07.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e69523640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e640c4d80 con 0x7f2e6406d870 2024-04-18T05:01:07.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e69523640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e640c1890 con 0x7f2e640c6100 2024-04-18T05:01:07.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e69523640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6406e190 con 0x7f2e6406fdf0 2024-04-18T05:01:07.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e5bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2e640c6100 0x7f2e64155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:07.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e5bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2e640c6100 0x7f2e64155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33886/0 (socket says 172.21.15.96:33886) 2024-04-18T05:01:07.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e5bfff640 1 -- 172.21.15.96:0/933254995 learned_addr learned my addr 172.21.15.96:0/933254995 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:07.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e5bfff640 1 -- 172.21.15.96:0/933254995 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e6406fdf0 msgr2=0x7f2e6406dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:07.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e637fe640 1 --2- 172.21.15.96:0/933254995 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e6406fdf0 0x7f2e6406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:07.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e5bfff640 1 --2- 172.21.15.96:0/933254995 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e6406fdf0 0x7f2e6406dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:07.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e5bfff640 1 -- 172.21.15.96:0/933254995 >> v1:172.21.15.139:6789/0 conn(0x7f2e6406d870 legacy=0x7f2e64070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:07.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e5bfff640 1 -- 172.21.15.96:0/933254995 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e640c5060 con 0x7f2e640c6100 2024-04-18T05:01:07.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e5bfff640 1 --2- 172.21.15.96:0/933254995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e640c6100 0x7f2e64155350 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00bb20 tx=0x7f2e4c0211a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f10fd492c873bdc server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:07.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e627fc640 1 -- 172.21.15.96:0/933254995 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c004030 con 0x7f2e640c6100 2024-04-18T05:01:07.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e627fc640 1 -- 172.21.15.96:0/933254995 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c0ad030 con 0x7f2e640c6100 2024-04-18T05:01:07.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.095+0000 7f2e627fc640 1 -- 172.21.15.96:0/933254995 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c004410 con 0x7f2e640c6100 2024-04-18T05:01:07.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 -- 172.21.15.96:0/933254995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e640c6100 msgr2=0x7f2e64155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:07.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 --2- 172.21.15.96:0/933254995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e640c6100 0x7f2e64155350 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00bb20 tx=0x7f2e4c0211a0 comp rx=0 tx=0).stop 2024-04-18T05:01:07.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 -- 172.21.15.96:0/933254995 shutdown_connections 2024-04-18T05:01:07.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 --2- 172.21.15.96:0/933254995 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e6406fdf0 0x7f2e6406dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:07.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 --2- 172.21.15.96:0/933254995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e640c6100 0x7f2e64155350 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:07.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 -- 172.21.15.96:0/933254995 >> 172.21.15.96:0/933254995 conn(0x7f2e6406a8e0 msgr2=0x7f2e640c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:07.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 -- 172.21.15.96:0/933254995 shutdown_connections 2024-04-18T05:01:07.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 -- 172.21.15.96:0/933254995 wait complete. 2024-04-18T05:01:07.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 Processor -- start 2024-04-18T05:01:07.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 -- start start 2024-04-18T05:01:07.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e6406d870 0x7f2e640709b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:07.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6406fdf0 0x7f2e640c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:07.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e640c6100 0x7f2e640c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:07.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64071270 con 0x7f2e6406fdf0 2024-04-18T05:01:07.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e641eb4d0 con 0x7f2e640c6100 2024-04-18T05:01:07.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e641e0470 con 0x7f2e6406d870 2024-04-18T05:01:07.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e5bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6406fdf0 0x7f2e640c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:07.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e5bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6406fdf0 0x7f2e640c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33888/0 (socket says 172.21.15.96:33888) 2024-04-18T05:01:07.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e5bfff640 1 -- 172.21.15.96:0/3025960185 learned_addr learned my addr 172.21.15.96:0/3025960185 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:07.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e637fe640 1 --2- 172.21.15.96:0/3025960185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e640c6100 0x7f2e640c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:07.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e62ffd640 1 --2- 172.21.15.96:0/3025960185 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e6406d870 0x7f2e640709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:07.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e5bfff640 1 -- 172.21.15.96:0/3025960185 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e6406d870 msgr2=0x7f2e640709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:07.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e5bfff640 1 --2- 172.21.15.96:0/3025960185 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e6406d870 0x7f2e640709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:07.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e5bfff640 1 -- 172.21.15.96:0/3025960185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e640c6100 msgr2=0x7f2e640c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:07.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e5bfff640 1 --2- 172.21.15.96:0/3025960185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e640c6100 0x7f2e640c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:07.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e5bfff640 1 -- 172.21.15.96:0/3025960185 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c00b780 con 0x7f2e6406fdf0 2024-04-18T05:01:07.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e637fe640 1 --2- 172.21.15.96:0/3025960185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e640c6100 0x7f2e640c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:01:07.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e62ffd640 1 --2- 172.21.15.96:0/3025960185 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e6406d870 0x7f2e640709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:01:07.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e5bfff640 1 --2- 172.21.15.96:0/3025960185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6406fdf0 0x7f2e640c8a00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c01f850 tx=0x7f2e4c01df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:07.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e5b7fe640 1 -- 172.21.15.96:0/3025960185 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0c4070 con 0x7f2e6406fdf0 2024-04-18T05:01:07.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e5b7fe640 1 -- 172.21.15.96:0/3025960185 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c0044d0 con 0x7f2e6406fdf0 2024-04-18T05:01:07.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 -- 172.21.15.96:0/3025960185 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e641e0710 con 0x7f2e6406fdf0 2024-04-18T05:01:07.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e5b7fe640 1 -- 172.21.15.96:0/3025960185 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c003a70 con 0x7f2e6406fdf0 2024-04-18T05:01:07.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 -- 172.21.15.96:0/3025960185 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e641eae80 con 0x7f2e6406fdf0 2024-04-18T05:01:07.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.099+0000 7f2e69523640 1 -- 172.21.15.96:0/3025960185 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e640670f0 con 0x7f2e6406fdf0 2024-04-18T05:01:07.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.103+0000 7f2e5b7fe640 1 -- 172.21.15.96:0/3025960185 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2e4c003bd0 con 0x7f2e6406fdf0 2024-04-18T05:01:07.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.103+0000 7f2e5b7fe640 1 --2- 172.21.15.96:0/3025960185 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2e44066690 0x7f2e44068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:07.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.103+0000 7f2e5b7fe640 1 -- 172.21.15.96:0/3025960185 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2e4c124080 con 0x7f2e6406fdf0 2024-04-18T05:01:07.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.103+0000 7f2e62ffd640 1 --2- 172.21.15.96:0/3025960185 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2e44066690 0x7f2e44068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:07.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.103+0000 7f2e62ffd640 1 --2- 172.21.15.96:0/3025960185 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2e44066690 0x7f2e44068b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2e54003e40 tx=0x7f2e54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:07.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.107+0000 7f2e5b7fe640 1 -- 172.21.15.96:0/3025960185 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2e4c0f13d0 con 0x7f2e6406fdf0 2024-04-18T05:01:07.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.263+0000 7f2e69523640 1 -- 172.21.15.96:0/3025960185 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2e641eb610 con 0x7f2e6406fdf0 2024-04-18T05:01:07.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.263+0000 7f2e5b7fe640 1 -- 172.21.15.96:0/3025960185 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2e4c0f49f0 con 0x7f2e6406fdf0 2024-04-18T05:01:07.265 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-04-18T05:01:07.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.263+0000 7f2e69523640 1 -- 172.21.15.96:0/3025960185 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2e44066690 msgr2=0x7f2e44068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.267+0000 7f2e69523640 1 --2- 172.21.15.96:0/3025960185 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2e44066690 0x7f2e44068b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2e54003e40 tx=0x7f2e54009040 comp rx=0 tx=0).stop 2024-04-18T05:01:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.267+0000 7f2e69523640 1 -- 172.21.15.96:0/3025960185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6406fdf0 msgr2=0x7f2e640c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.267+0000 7f2e69523640 1 --2- 172.21.15.96:0/3025960185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6406fdf0 0x7f2e640c8a00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c01f850 tx=0x7f2e4c01df40 comp rx=0 tx=0).stop 2024-04-18T05:01:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.267+0000 7f2e69523640 1 -- 172.21.15.96:0/3025960185 shutdown_connections 2024-04-18T05:01:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.267+0000 7f2e69523640 1 --2- 172.21.15.96:0/3025960185 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2e44066690 0x7f2e44068b50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.267+0000 7f2e69523640 1 --2- 172.21.15.96:0/3025960185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e640c6100 0x7f2e640c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.267+0000 7f2e69523640 1 --2- 172.21.15.96:0/3025960185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6406fdf0 0x7f2e640c8a00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.267+0000 7f2e69523640 1 --2- 172.21.15.96:0/3025960185 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e6406d870 0x7f2e640709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.267+0000 7f2e69523640 1 -- 172.21.15.96:0/3025960185 >> 172.21.15.96:0/3025960185 conn(0x7f2e6406a8e0 msgr2=0x7f2e64147ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.267+0000 7f2e69523640 1 -- 172.21.15.96:0/3025960185 shutdown_connections 2024-04-18T05:01:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:07.267+0000 7f2e69523640 1 -- 172.21.15.96:0/3025960185 wait complete. 2024-04-18T05:01:07.283 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi096.front.sepia.ceph.com... 2024-04-18T05:01:07.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T05:01:07.283 DEBUG:teuthology.orchestra.run.smithi096:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-18T05:01:07.313 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:01:07.313 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[33640]: fuse finished with error 0 and tester_r 0 2024-04-18T05:01:13.415 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T05:01:13.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T05:01:13.416 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-18T05:01:13.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T05:01:13.448 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-04-18T05:01:13.497 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-18T05:01:13.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T05:01:13.497 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T05:01:13.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T05:01:13.553 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2024-04-18T05:01:13.730 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-18T05:01:13.740 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T05:01:13.740 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T05:01:13.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.862+0000 7fa89caa3640 1 Processor -- start 2024-04-18T05:01:13.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.862+0000 7fa89caa3640 1 -- start start 2024-04-18T05:01:13.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89caa3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa898151210 0x7fa8980c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:13.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89caa3640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa89815a950 0x7fa89815adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:13.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89caa3640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89815b300 con 0x7fa8980c1db0 2024-04-18T05:01:13.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89caa3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa898157150 con 0x7fa898151210 2024-04-18T05:01:13.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89caa3640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa898157430 con 0x7fa89815a950 2024-04-18T05:01:13.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89659c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa898151210 0x7fa8980c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:13.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89659c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa898151210 0x7fa8980c1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40088/0 (socket says 172.21.15.96:40088) 2024-04-18T05:01:13.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89659c640 1 -- 172.21.15.96:0/3288497546 learned_addr learned my addr 172.21.15.96:0/3288497546 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:13.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89659c640 1 -- 172.21.15.96:0/3288497546 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa89815a950 msgr2=0x7fa89815adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:13.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89659c640 1 --2- 172.21.15.96:0/3288497546 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa89815a950 0x7fa89815adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:13.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89659c640 1 -- 172.21.15.96:0/3288497546 >> v1:172.21.15.139:6789/0 conn(0x7fa8980c1db0 legacy=0x7fa8980ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:13.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89659c640 1 -- 172.21.15.96:0/3288497546 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa898157710 con 0x7fa898151210 2024-04-18T05:01:13.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89659c640 1 --2- 172.21.15.96:0/3288497546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa898151210 0x7fa8980c1870 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa888009870 tx=0x7fa88801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b49061a813c1345 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:13.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89559a640 1 -- 172.21.15.96:0/3288497546 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8880a89d0 con 0x7fa898151210 2024-04-18T05:01:13.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89559a640 1 -- 172.21.15.96:0/3288497546 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8880a8b30 con 0x7fa898151210 2024-04-18T05:01:13.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89559a640 1 -- 172.21.15.96:0/3288497546 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8880b0440 con 0x7fa898151210 2024-04-18T05:01:13.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89caa3640 1 -- 172.21.15.96:0/3288497546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa898151210 msgr2=0x7fa8980c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:13.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89caa3640 1 --2- 172.21.15.96:0/3288497546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa898151210 0x7fa8980c1870 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa888009870 tx=0x7fa88801ed10 comp rx=0 tx=0).stop 2024-04-18T05:01:13.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89caa3640 1 -- 172.21.15.96:0/3288497546 shutdown_connections 2024-04-18T05:01:13.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89caa3640 1 --2- 172.21.15.96:0/3288497546 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa89815a950 0x7fa89815adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:13.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89caa3640 1 --2- 172.21.15.96:0/3288497546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa898151210 0x7fa8980c1870 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:13.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89caa3640 1 -- 172.21.15.96:0/3288497546 >> 172.21.15.96:0/3288497546 conn(0x7fa89806c750 msgr2=0x7fa8980c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:13.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89caa3640 1 -- 172.21.15.96:0/3288497546 shutdown_connections 2024-04-18T05:01:13.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.866+0000 7fa89caa3640 1 -- 172.21.15.96:0/3288497546 wait complete. 2024-04-18T05:01:13.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa89caa3640 1 Processor -- start 2024-04-18T05:01:13.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa89caa3640 1 -- start start 2024-04-18T05:01:13.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa89caa3640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa8980c1db0 0x7fa8981edf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:13.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa89caa3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa898151210 0x7fa8981f0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:13.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa89caa3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa89815a950 0x7fa898146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:13.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa89caa3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8981f0ea0 con 0x7fa89815a950 2024-04-18T05:01:13.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa89caa3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa898153bd0 con 0x7fa898151210 2024-04-18T05:01:13.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa89caa3640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8981f0bc0 con 0x7fa8980c1db0 2024-04-18T05:01:13.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa896d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa89815a950 0x7fa898146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:13.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa896d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa89815a950 0x7fa898146c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40098/0 (socket says 172.21.15.96:40098) 2024-04-18T05:01:13.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa896d9d640 1 -- 172.21.15.96:0/1584979349 learned_addr learned my addr 172.21.15.96:0/1584979349 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:13.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa89659c640 1 --2- 172.21.15.96:0/1584979349 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa8980c1db0 0x7fa8981edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:13.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa895d9b640 1 --2- 172.21.15.96:0/1584979349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa898151210 0x7fa8981f0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:13.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa896d9d640 1 -- 172.21.15.96:0/1584979349 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa8980c1db0 msgr2=0x7fa8981edf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:13.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa896d9d640 1 --2- 172.21.15.96:0/1584979349 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa8980c1db0 0x7fa8981edf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:13.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa896d9d640 1 -- 172.21.15.96:0/1584979349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa898151210 msgr2=0x7fa8981f0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:13.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa896d9d640 1 --2- 172.21.15.96:0/1584979349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa898151210 0x7fa8981f0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:13.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa896d9d640 1 -- 172.21.15.96:0/1584979349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8880094d0 con 0x7fa89815a950 2024-04-18T05:01:13.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa896d9d640 1 --2- 172.21.15.96:0/1584979349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa89815a950 0x7fa898146c70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa89000b970 tx=0x7fa89000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:13.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa886ffd640 1 -- 172.21.15.96:0/1584979349 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89000cb40 con 0x7fa89815a950 2024-04-18T05:01:13.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa886ffd640 1 -- 172.21.15.96:0/1584979349 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89000ccc0 con 0x7fa89815a950 2024-04-18T05:01:13.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa89caa3640 1 -- 172.21.15.96:0/1584979349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa898153610 con 0x7fa89815a950 2024-04-18T05:01:13.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa886ffd640 1 -- 172.21.15.96:0/1584979349 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890014680 con 0x7fa89815a950 2024-04-18T05:01:13.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa89caa3640 1 -- 172.21.15.96:0/1584979349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa898151da0 con 0x7fa89815a950 2024-04-18T05:01:13.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.870+0000 7fa89caa3640 1 -- 172.21.15.96:0/1584979349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89815a3b0 con 0x7fa89815a950 2024-04-18T05:01:13.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.874+0000 7fa886ffd640 1 -- 172.21.15.96:0/1584979349 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa89001d3b0 con 0x7fa89815a950 2024-04-18T05:01:13.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.874+0000 7fa886ffd640 1 --2- 172.21.15.96:0/1584979349 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa878066690 0x7fa878068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:13.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.874+0000 7fa89659c640 1 --2- 172.21.15.96:0/1584979349 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa878066690 0x7fa878068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:13.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.874+0000 7fa886ffd640 1 -- 172.21.15.96:0/1584979349 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa890084130 con 0x7fa89815a950 2024-04-18T05:01:13.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.874+0000 7fa89659c640 1 --2- 172.21.15.96:0/1584979349 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa878066690 0x7fa878068b50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa8880b2000 tx=0x7fa888008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:13.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:13.878+0000 7fa886ffd640 1 -- 172.21.15.96:0/1584979349 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa890051480 con 0x7fa89815a950 2024-04-18T05:01:14.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.030+0000 7fa89caa3640 1 -- 172.21.15.96:0/1584979349 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa898157cd0 con 0x7fa878066690 2024-04-18T05:01:14.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.054+0000 7fa886ffd640 1 -- 172.21.15.96:0/1584979349 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290198 (secure 0 0 0) 0x7fa8880a87d0 con 0x7fa878066690 2024-04-18T05:01:14.060 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T05:01:14.062 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T05:01:14.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.058+0000 7fa89caa3640 1 -- 172.21.15.96:0/1584979349 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa878066690 msgr2=0x7fa878068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.058+0000 7fa89caa3640 1 --2- 172.21.15.96:0/1584979349 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa878066690 0x7fa878068b50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa8880b2000 tx=0x7fa888008040 comp rx=0 tx=0).stop 2024-04-18T05:01:14.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.058+0000 7fa89caa3640 1 -- 172.21.15.96:0/1584979349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa89815a950 msgr2=0x7fa898146c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.058+0000 7fa89caa3640 1 --2- 172.21.15.96:0/1584979349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa89815a950 0x7fa898146c70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa89000b970 tx=0x7fa89000be30 comp rx=0 tx=0).stop 2024-04-18T05:01:14.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.058+0000 7fa89caa3640 1 -- 172.21.15.96:0/1584979349 shutdown_connections 2024-04-18T05:01:14.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.058+0000 7fa89caa3640 1 --2- 172.21.15.96:0/1584979349 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa878066690 0x7fa878068b50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.058+0000 7fa89caa3640 1 --2- 172.21.15.96:0/1584979349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa89815a950 0x7fa898146c70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.058+0000 7fa89caa3640 1 --2- 172.21.15.96:0/1584979349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa898151210 0x7fa8981f0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.058+0000 7fa89caa3640 1 --2- 172.21.15.96:0/1584979349 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa8980c1db0 0x7fa8981edf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.058+0000 7fa89caa3640 1 -- 172.21.15.96:0/1584979349 >> 172.21.15.96:0/1584979349 conn(0x7fa89806c750 msgr2=0x7fa8980c9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:14.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.058+0000 7fa89caa3640 1 -- 172.21.15.96:0/1584979349 shutdown_connections 2024-04-18T05:01:14.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.058+0000 7fa89caa3640 1 -- 172.21.15.96:0/1584979349 wait complete. 2024-04-18T05:01:14.079 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-04-18T05:01:12.704812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":131506610,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":2961,"num_read_kb":1326719,"num_write":31940,"num_write_kb":4643491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35450,"ondisk_log_size":35450,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":454048,"kb_used_data":100192,"kb_used_omap":12,"kb_used_meta":353779,"kb_avail":754520672,"statfs":{"total":773094113280,"available":772629168128,"internally_reserved":0,"allocated":102596608,"data_stored":263693236,"data_compressed":36701930,"data_compressed_allocated":47693824,"data_compressed_original":210231296,"omap_allocated":12744,"internal_metadata":362270264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,0,0,14],"upper_bound":128},"perf_stat":{"commit_latency_ms":70,"apply_latency_ms":70,"commit_latency_ns":70000000,"apply_latency_ns":70000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004104"},"pg_stats":[{"pgid":"3.3f","version":"23'405","reported_seq":439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374066+0000","last_change":"2024-04-18T04:54:41.199306+0000","last_active":"2024-04-18T05:01:07.374066+0000","last_peered":"2024-04-18T05:01:07.374066+0000","last_clean":"2024-04-18T05:01:07.374066+0000","last_became_active":"2024-04-18T04:54:41.199046+0000","last_became_peered":"2024-04-18T04:54:41.199046+0000","last_unstale":"2024-04-18T05:01:07.374066+0000","last_undegraded":"2024-04-18T05:01:07.374066+0000","last_fullsized":"2024-04-18T05:01:07.374066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9249,"num_write":376,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"23'459","reported_seq":499,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.407426+0000","last_change":"2024-04-18T04:54:41.200447+0000","last_active":"2024-04-18T05:01:07.407426+0000","last_peered":"2024-04-18T05:01:07.407426+0000","last_clean":"2024-04-18T05:01:07.407426+0000","last_became_active":"2024-04-18T04:54:41.200136+0000","last_became_peered":"2024-04-18T04:54:41.200136+0000","last_unstale":"2024-04-18T05:01:07.407426+0000","last_undegraded":"2024-04-18T05:01:07.407426+0000","last_fullsized":"2024-04-18T05:01:07.407426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12666,"num_write":430,"num_write_kb":97067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"23'410","reported_seq":455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.396643+0000","last_change":"2024-04-18T04:54:41.185987+0000","last_active":"2024-04-18T05:01:07.396643+0000","last_peered":"2024-04-18T05:01:07.396643+0000","last_clean":"2024-04-18T05:01:07.396643+0000","last_became_active":"2024-04-18T04:54:41.185206+0000","last_became_peered":"2024-04-18T04:54:41.185206+0000","last_unstale":"2024-04-18T05:01:07.396643+0000","last_undegraded":"2024-04-18T05:01:07.396643+0000","last_fullsized":"2024-04-18T05:01:07.396643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":29819,"num_write":382,"num_write_kb":108666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"23'394","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.380955+0000","last_change":"2024-04-18T04:54:41.177487+0000","last_active":"2024-04-18T05:01:07.380955+0000","last_peered":"2024-04-18T05:01:07.380955+0000","last_clean":"2024-04-18T05:01:07.380955+0000","last_became_active":"2024-04-18T04:54:41.177217+0000","last_became_peered":"2024-04-18T04:54:41.177217+0000","last_unstale":"2024-04-18T05:01:07.380955+0000","last_undegraded":"2024-04-18T05:01:07.380955+0000","last_fullsized":"2024-04-18T05:01:07.380955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:08.067252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22571,"num_write":356,"num_write_kb":80073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"23'390","reported_seq":427,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.400041+0000","last_change":"2024-04-18T04:54:41.186573+0000","last_active":"2024-04-18T05:01:07.400041+0000","last_peered":"2024-04-18T05:01:07.400041+0000","last_clean":"2024-04-18T05:01:07.400041+0000","last_became_active":"2024-04-18T04:54:41.186027+0000","last_became_peered":"2024-04-18T04:54:41.186027+0000","last_unstale":"2024-04-18T05:01:07.400041+0000","last_undegraded":"2024-04-18T05:01:07.400041+0000","last_fullsized":"2024-04-18T05:01:07.400041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13089,"num_write":365,"num_write_kb":22615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"23'374","reported_seq":394,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.378663+0000","last_change":"2024-04-18T04:54:41.177550+0000","last_active":"2024-04-18T05:01:07.378663+0000","last_peered":"2024-04-18T05:01:07.378663+0000","last_clean":"2024-04-18T05:01:07.378663+0000","last_became_active":"2024-04-18T04:54:41.177215+0000","last_became_peered":"2024-04-18T04:54:41.177215+0000","last_unstale":"2024-04-18T05:01:07.378663+0000","last_undegraded":"2024-04-18T05:01:07.378663+0000","last_fullsized":"2024-04-18T05:01:07.378663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:26.266600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":350,"num_write_kb":36922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"23'405","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374455+0000","last_change":"2024-04-18T04:54:41.178605+0000","last_active":"2024-04-18T05:01:07.374455+0000","last_peered":"2024-04-18T05:01:07.374455+0000","last_clean":"2024-04-18T05:01:07.374455+0000","last_became_active":"2024-04-18T04:54:41.178094+0000","last_became_peered":"2024-04-18T04:54:41.178094+0000","last_unstale":"2024-04-18T05:01:07.374455+0000","last_undegraded":"2024-04-18T05:01:07.374455+0000","last_fullsized":"2024-04-18T05:01:07.374455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20531,"num_write":378,"num_write_kb":59118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"23'401","reported_seq":438,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.414199+0000","last_change":"2024-04-18T04:54:41.193174+0000","last_active":"2024-04-18T05:01:07.414199+0000","last_peered":"2024-04-18T05:01:07.414199+0000","last_clean":"2024-04-18T05:01:07.414199+0000","last_became_active":"2024-04-18T04:54:41.192678+0000","last_became_peered":"2024-04-18T04:54:41.192678+0000","last_unstale":"2024-04-18T05:01:07.414199+0000","last_undegraded":"2024-04-18T05:01:07.414199+0000","last_fullsized":"2024-04-18T05:01:07.414199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13567,"num_write":364,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"23'436","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.364148+0000","last_change":"2024-04-18T04:54:41.198121+0000","last_active":"2024-04-18T05:01:07.364148+0000","last_peered":"2024-04-18T05:01:07.364148+0000","last_clean":"2024-04-18T05:01:07.364148+0000","last_became_active":"2024-04-18T04:54:41.197832+0000","last_became_peered":"2024-04-18T04:54:41.197832+0000","last_unstale":"2024-04-18T05:01:07.364148+0000","last_undegraded":"2024-04-18T05:01:07.364148+0000","last_fullsized":"2024-04-18T05:01:07.364148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.835581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28521,"num_write":411,"num_write_kb":104022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"23'396","reported_seq":437,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.379998+0000","last_change":"2024-04-18T04:54:41.183032+0000","last_active":"2024-04-18T05:01:07.379998+0000","last_peered":"2024-04-18T05:01:07.379998+0000","last_clean":"2024-04-18T05:01:07.379998+0000","last_became_active":"2024-04-18T04:54:41.182698+0000","last_became_peered":"2024-04-18T04:54:41.182698+0000","last_unstale":"2024-04-18T05:01:07.379998+0000","last_undegraded":"2024-04-18T05:01:07.379998+0000","last_fullsized":"2024-04-18T05:01:07.379998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13914,"num_write":350,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"23'379","reported_seq":427,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377181+0000","last_change":"2024-04-18T04:54:41.187831+0000","last_active":"2024-04-18T05:01:07.377181+0000","last_peered":"2024-04-18T05:01:07.377181+0000","last_clean":"2024-04-18T05:01:07.377181+0000","last_became_active":"2024-04-18T04:54:41.187360+0000","last_became_peered":"2024-04-18T04:54:41.187360+0000","last_unstale":"2024-04-18T05:01:07.377181+0000","last_undegraded":"2024-04-18T05:01:07.377181+0000","last_fullsized":"2024-04-18T05:01:07.377181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18312,"num_write":357,"num_write_kb":34101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"23'361","reported_seq":410,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377628+0000","last_change":"2024-04-18T04:54:41.188641+0000","last_active":"2024-04-18T05:01:07.377628+0000","last_peered":"2024-04-18T05:01:07.377628+0000","last_clean":"2024-04-18T05:01:07.377628+0000","last_became_active":"2024-04-18T04:54:41.188281+0000","last_became_peered":"2024-04-18T04:54:41.188281+0000","last_unstale":"2024-04-18T05:01:07.377628+0000","last_undegraded":"2024-04-18T05:01:07.377628+0000","last_fullsized":"2024-04-18T05:01:07.377628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21304,"num_write":338,"num_write_kb":54980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"23'375","reported_seq":405,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394838+0000","last_change":"2024-04-18T04:54:41.194578+0000","last_active":"2024-04-18T05:01:07.394838+0000","last_peered":"2024-04-18T05:01:07.394838+0000","last_clean":"2024-04-18T05:01:07.394838+0000","last_became_active":"2024-04-18T04:54:41.190882+0000","last_became_peered":"2024-04-18T04:54:41.190882+0000","last_unstale":"2024-04-18T05:01:07.394838+0000","last_undegraded":"2024-04-18T05:01:07.394838+0000","last_fullsized":"2024-04-18T05:01:07.394838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:45:52.041196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7725,"num_write":337,"num_write_kb":21712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"23'417","reported_seq":490,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.393436+0000","last_change":"2024-04-18T04:54:41.190210+0000","last_active":"2024-04-18T05:01:07.393436+0000","last_peered":"2024-04-18T05:01:07.393436+0000","last_clean":"2024-04-18T05:01:07.393436+0000","last_became_active":"2024-04-18T04:54:41.189813+0000","last_became_peered":"2024-04-18T04:54:41.189813+0000","last_unstale":"2024-04-18T05:01:07.393436+0000","last_undegraded":"2024-04-18T05:01:07.393436+0000","last_fullsized":"2024-04-18T05:01:07.393436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:38:02.632458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":28320,"num_write":390,"num_write_kb":71764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"23'445","reported_seq":532,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.406236+0000","last_change":"2024-04-18T04:54:41.183027+0000","last_active":"2024-04-18T05:01:07.406236+0000","last_peered":"2024-04-18T05:01:07.406236+0000","last_clean":"2024-04-18T05:01:07.406236+0000","last_became_active":"2024-04-18T04:54:41.182713+0000","last_became_peered":"2024-04-18T04:54:41.182713+0000","last_unstale":"2024-04-18T05:01:07.406236+0000","last_undegraded":"2024-04-18T05:01:07.406236+0000","last_fullsized":"2024-04-18T05:01:07.406236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":36644,"num_write":412,"num_write_kb":104908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"23'442","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.364940+0000","last_change":"2024-04-18T04:54:41.186060+0000","last_active":"2024-04-18T05:01:07.364940+0000","last_peered":"2024-04-18T05:01:07.364940+0000","last_clean":"2024-04-18T05:01:07.364940+0000","last_became_active":"2024-04-18T04:54:41.185803+0000","last_became_peered":"2024-04-18T04:54:41.185803+0000","last_unstale":"2024-04-18T05:01:07.364940+0000","last_undegraded":"2024-04-18T05:01:07.364940+0000","last_fullsized":"2024-04-18T05:01:07.364940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:48:04.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21979,"num_write":411,"num_write_kb":59643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"23'407","reported_seq":466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.370476+0000","last_change":"2024-04-18T04:54:41.200802+0000","last_active":"2024-04-18T05:01:07.370476+0000","last_peered":"2024-04-18T05:01:07.370476+0000","last_clean":"2024-04-18T05:01:07.370476+0000","last_became_active":"2024-04-18T04:54:41.198404+0000","last_became_peered":"2024-04-18T04:54:41.198404+0000","last_unstale":"2024-04-18T05:01:07.370476+0000","last_undegraded":"2024-04-18T05:01:07.370476+0000","last_fullsized":"2024-04-18T05:01:07.370476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:56.686481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22314,"num_write":375,"num_write_kb":43056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"23'414","reported_seq":469,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.382501+0000","last_change":"2024-04-18T04:54:41.189568+0000","last_active":"2024-04-18T05:01:07.382501+0000","last_peered":"2024-04-18T05:01:07.382501+0000","last_clean":"2024-04-18T05:01:07.382501+0000","last_became_active":"2024-04-18T04:54:41.188139+0000","last_became_peered":"2024-04-18T04:54:41.188139+0000","last_unstale":"2024-04-18T05:01:07.382501+0000","last_undegraded":"2024-04-18T05:01:07.382501+0000","last_fullsized":"2024-04-18T05:01:07.382501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21874,"num_write":387,"num_write_kb":84204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"23'431","reported_seq":505,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.375011+0000","last_change":"2024-04-18T04:54:41.197901+0000","last_active":"2024-04-18T05:01:07.375011+0000","last_peered":"2024-04-18T05:01:07.375011+0000","last_clean":"2024-04-18T05:01:07.375011+0000","last_became_active":"2024-04-18T04:54:41.197235+0000","last_became_peered":"2024-04-18T04:54:41.197235+0000","last_unstale":"2024-04-18T05:01:07.375011+0000","last_undegraded":"2024-04-18T05:01:07.375011+0000","last_fullsized":"2024-04-18T05:01:07.375011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:41:20.213202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40070,"num_write":398,"num_write_kb":116642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"23'437","reported_seq":508,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377558+0000","last_change":"2024-04-18T04:54:41.188440+0000","last_active":"2024-04-18T05:01:07.377558+0000","last_peered":"2024-04-18T05:01:07.377558+0000","last_clean":"2024-04-18T05:01:07.377558+0000","last_became_active":"2024-04-18T04:54:41.187925+0000","last_became_peered":"2024-04-18T04:54:41.187925+0000","last_unstale":"2024-04-18T05:01:07.377558+0000","last_undegraded":"2024-04-18T05:01:07.377558+0000","last_fullsized":"2024-04-18T05:01:07.377558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27418,"num_write":411,"num_write_kb":67043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"23'413","reported_seq":488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.383040+0000","last_change":"2024-04-18T04:54:41.179672+0000","last_active":"2024-04-18T05:01:07.383040+0000","last_peered":"2024-04-18T05:01:07.383040+0000","last_clean":"2024-04-18T05:01:07.383040+0000","last_became_active":"2024-04-18T04:54:41.178963+0000","last_became_peered":"2024-04-18T04:54:41.178963+0000","last_unstale":"2024-04-18T05:01:07.383040+0000","last_undegraded":"2024-04-18T05:01:07.383040+0000","last_fullsized":"2024-04-18T05:01:07.383040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:56:31.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32437,"num_write":394,"num_write_kb":88243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"23'442","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.366521+0000","last_change":"2024-04-18T04:54:41.182902+0000","last_active":"2024-04-18T05:01:07.366521+0000","last_peered":"2024-04-18T05:01:07.366521+0000","last_clean":"2024-04-18T05:01:07.366521+0000","last_became_active":"2024-04-18T04:54:41.182664+0000","last_became_peered":"2024-04-18T04:54:41.182664+0000","last_unstale":"2024-04-18T05:01:07.366521+0000","last_undegraded":"2024-04-18T05:01:07.366521+0000","last_fullsized":"2024-04-18T05:01:07.366521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:56.408926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34086,"num_write":411,"num_write_kb":96499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"23'434","reported_seq":502,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.406363+0000","last_change":"2024-04-18T04:54:41.187578+0000","last_active":"2024-04-18T05:01:07.406363+0000","last_peered":"2024-04-18T05:01:07.406363+0000","last_clean":"2024-04-18T05:01:07.406363+0000","last_became_active":"2024-04-18T04:54:41.186881+0000","last_became_peered":"2024-04-18T04:54:41.186881+0000","last_unstale":"2024-04-18T05:01:07.406363+0000","last_undegraded":"2024-04-18T05:01:07.406363+0000","last_fullsized":"2024-04-18T05:01:07.406363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:27.817916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":24295,"num_write":395,"num_write_kb":96064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"23'465","reported_seq":582,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.408101+0000","last_change":"2024-04-18T04:54:41.193206+0000","last_active":"2024-04-18T05:01:07.408101+0000","last_peered":"2024-04-18T05:01:07.408101+0000","last_clean":"2024-04-18T05:01:07.408101+0000","last_became_active":"2024-04-18T04:54:41.192740+0000","last_became_peered":"2024-04-18T04:54:41.192740+0000","last_unstale":"2024-04-18T05:01:07.408101+0000","last_undegraded":"2024-04-18T05:01:07.408101+0000","last_fullsized":"2024-04-18T05:01:07.408101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:51:34.311826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61562,"num_write":441,"num_write_kb":100539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"23'390","reported_seq":438,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.411713+0000","last_change":"2024-04-18T04:54:41.192785+0000","last_active":"2024-04-18T05:01:07.411713+0000","last_peered":"2024-04-18T05:01:07.411713+0000","last_clean":"2024-04-18T05:01:07.411713+0000","last_became_active":"2024-04-18T04:54:41.192280+0000","last_became_peered":"2024-04-18T04:54:41.192280+0000","last_unstale":"2024-04-18T05:01:07.411713+0000","last_undegraded":"2024-04-18T05:01:07.411713+0000","last_fullsized":"2024-04-18T05:01:07.411713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18903,"num_write":377,"num_write_kb":34298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"23'490","reported_seq":558,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.378688+0000","last_change":"2024-04-18T04:54:41.193920+0000","last_active":"2024-04-18T05:01:07.378688+0000","last_peered":"2024-04-18T05:01:07.378688+0000","last_clean":"2024-04-18T05:01:07.378688+0000","last_became_active":"2024-04-18T04:54:41.193660+0000","last_became_peered":"2024-04-18T04:54:41.193660+0000","last_unstale":"2024-04-18T05:01:07.378688+0000","last_undegraded":"2024-04-18T05:01:07.378688+0000","last_fullsized":"2024-04-18T05:01:07.378688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:22.072498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26760,"num_write":458,"num_write_kb":125465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"23'432","reported_seq":525,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.392934+0000","last_change":"2024-04-18T04:54:41.190298+0000","last_active":"2024-04-18T05:01:07.392934+0000","last_peered":"2024-04-18T05:01:07.392934+0000","last_clean":"2024-04-18T05:01:07.392934+0000","last_became_active":"2024-04-18T04:54:41.189374+0000","last_became_peered":"2024-04-18T04:54:41.189374+0000","last_unstale":"2024-04-18T05:01:07.392934+0000","last_undegraded":"2024-04-18T05:01:07.392934+0000","last_fullsized":"2024-04-18T05:01:07.392934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43719,"num_write":406,"num_write_kb":145399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"23'384","reported_seq":437,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394954+0000","last_change":"2024-04-18T04:54:41.190403+0000","last_active":"2024-04-18T05:01:07.394954+0000","last_peered":"2024-04-18T05:01:07.394954+0000","last_clean":"2024-04-18T05:01:07.394954+0000","last_became_active":"2024-04-18T04:54:41.189660+0000","last_became_peered":"2024-04-18T04:54:41.189660+0000","last_unstale":"2024-04-18T05:01:07.394954+0000","last_undegraded":"2024-04-18T05:01:07.394954+0000","last_fullsized":"2024-04-18T05:01:07.394954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:34.259279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17737,"num_write":357,"num_write_kb":75727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"23'427","reported_seq":500,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.399293+0000","last_change":"2024-04-18T04:54:41.187370+0000","last_active":"2024-04-18T05:01:07.399293+0000","last_peered":"2024-04-18T05:01:07.399293+0000","last_clean":"2024-04-18T05:01:07.399293+0000","last_became_active":"2024-04-18T04:54:41.186901+0000","last_became_peered":"2024-04-18T04:54:41.186901+0000","last_unstale":"2024-04-18T05:01:07.399293+0000","last_undegraded":"2024-04-18T05:01:07.399293+0000","last_fullsized":"2024-04-18T05:01:07.399293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30499,"num_write":394,"num_write_kb":84601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"23'468","reported_seq":510,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.402883+0000","last_change":"2024-04-18T04:54:41.192719+0000","last_active":"2024-04-18T05:01:07.402883+0000","last_peered":"2024-04-18T05:01:07.402883+0000","last_clean":"2024-04-18T05:01:07.402883+0000","last_became_active":"2024-04-18T04:54:41.192114+0000","last_became_peered":"2024-04-18T04:54:41.192114+0000","last_unstale":"2024-04-18T05:01:07.402883+0000","last_undegraded":"2024-04-18T05:01:07.402883+0000","last_fullsized":"2024-04-18T05:01:07.402883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:33:21.965783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13784,"num_write":434,"num_write_kb":79847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"23'421","reported_seq":471,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.379914+0000","last_change":"2024-04-18T04:54:41.186276+0000","last_active":"2024-04-18T05:01:07.379914+0000","last_peered":"2024-04-18T05:01:07.379914+0000","last_clean":"2024-04-18T05:01:07.379914+0000","last_became_active":"2024-04-18T04:54:41.185915+0000","last_became_peered":"2024-04-18T04:54:41.185915+0000","last_unstale":"2024-04-18T05:01:07.379914+0000","last_undegraded":"2024-04-18T05:01:07.379914+0000","last_fullsized":"2024-04-18T05:01:07.379914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":22283,"num_write":389,"num_write_kb":42482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"23'415","reported_seq":485,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.395003+0000","last_change":"2024-04-18T04:54:41.190283+0000","last_active":"2024-04-18T05:01:07.395003+0000","last_peered":"2024-04-18T05:01:07.395003+0000","last_clean":"2024-04-18T05:01:07.395003+0000","last_became_active":"2024-04-18T04:54:41.189892+0000","last_became_peered":"2024-04-18T04:54:41.189892+0000","last_unstale":"2024-04-18T05:01:07.395003+0000","last_undegraded":"2024-04-18T05:01:07.395003+0000","last_fullsized":"2024-04-18T05:01:07.395003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:53.175178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36029,"num_write":387,"num_write_kb":59223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'420","reported_seq":479,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.410442+0000","last_change":"2024-04-18T04:54:41.187326+0000","last_active":"2024-04-18T05:01:07.410442+0000","last_peered":"2024-04-18T05:01:07.410442+0000","last_clean":"2024-04-18T05:01:07.410442+0000","last_became_active":"2024-04-18T04:54:41.187001+0000","last_became_peered":"2024-04-18T04:54:41.187001+0000","last_unstale":"2024-04-18T05:01:07.410442+0000","last_undegraded":"2024-04-18T05:01:07.410442+0000","last_fullsized":"2024-04-18T05:01:07.410442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19127,"num_write":391,"num_write_kb":83892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'97","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.985326+0000","last_change":"2024-04-18T04:54:40.824658+0000","last_active":"2024-04-18T05:00:02.985326+0000","last_peered":"2024-04-18T05:00:02.985326+0000","last_clean":"2024-04-18T05:00:02.985326+0000","last_became_active":"2024-04-18T04:54:40.823652+0000","last_became_peered":"2024-04-18T04:54:40.823652+0000","last_unstale":"2024-04-18T05:00:02.985326+0000","last_undegraded":"2024-04-18T05:00:02.985326+0000","last_fullsized":"2024-04-18T05:00:02.985326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195462,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"23'366","reported_seq":402,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.382420+0000","last_change":"2024-04-18T04:55:39.828560+0000","last_active":"2024-04-18T05:01:07.382420+0000","last_peered":"2024-04-18T05:01:07.382420+0000","last_clean":"2024-04-18T05:01:07.382420+0000","last_became_active":"2024-04-18T04:55:39.827671+0000","last_became_peered":"2024-04-18T04:55:39.827671+0000","last_unstale":"2024-04-18T05:01:07.382420+0000","last_undegraded":"2024-04-18T05:01:07.382420+0000","last_fullsized":"2024-04-18T05:01:07.382420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:24:21.418171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13158,"num_write":336,"num_write_kb":38014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'539","reported_seq":553,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:00.987547+0000","last_change":"2024-04-18T04:54:40.803244+0000","last_active":"2024-04-18T05:00:00.987547+0000","last_peered":"2024-04-18T05:00:00.987547+0000","last_clean":"2024-04-18T05:00:00.987547+0000","last_became_active":"2024-04-18T04:54:40.802672+0000","last_became_peered":"2024-04-18T04:54:40.802672+0000","last_unstale":"2024-04-18T05:00:00.987547+0000","last_undegraded":"2024-04-18T05:00:00.987547+0000","last_fullsized":"2024-04-18T05:00:00.987547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:56.851301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":487,"num_write_kb":12578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'415","reported_seq":430,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.042647+0000","last_change":"2024-04-18T04:54:40.823675+0000","last_active":"2024-04-18T05:00:02.042647+0000","last_peered":"2024-04-18T05:00:02.042647+0000","last_clean":"2024-04-18T05:00:02.042647+0000","last_became_active":"2024-04-18T04:54:40.823091+0000","last_became_peered":"2024-04-18T04:54:40.823091+0000","last_unstale":"2024-04-18T05:00:02.042647+0000","last_undegraded":"2024-04-18T05:00:02.042647+0000","last_fullsized":"2024-04-18T05:00:02.042647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":4340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"23'429","reported_seq":457,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.413269+0000","last_change":"2024-04-18T04:54:41.200326+0000","last_active":"2024-04-18T05:01:07.413269+0000","last_peered":"2024-04-18T05:01:07.413269+0000","last_clean":"2024-04-18T05:01:07.413269+0000","last_became_active":"2024-04-18T04:54:41.199690+0000","last_became_peered":"2024-04-18T04:54:41.199690+0000","last_unstale":"2024-04-18T05:01:07.413269+0000","last_undegraded":"2024-04-18T05:01:07.413269+0000","last_fullsized":"2024-04-18T05:01:07.413269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5535,"num_write":391,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'954","reported_seq":968,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.039751+0000","last_change":"2024-04-18T04:54:40.805264+0000","last_active":"2024-04-18T05:00:02.039751+0000","last_peered":"2024-04-18T05:00:02.039751+0000","last_clean":"2024-04-18T05:00:02.039751+0000","last_became_active":"2024-04-18T04:54:40.804605+0000","last_became_peered":"2024-04-18T04:54:40.804605+0000","last_unstale":"2024-04-18T05:00:02.039751+0000","last_undegraded":"2024-04-18T05:00:02.039751+0000","last_fullsized":"2024-04-18T05:00:02.039751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:48.991270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"23'422","reported_seq":469,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.372623+0000","last_change":"2024-04-18T04:54:41.175359+0000","last_active":"2024-04-18T05:01:07.372623+0000","last_peered":"2024-04-18T05:01:07.372623+0000","last_clean":"2024-04-18T05:01:07.372623+0000","last_became_active":"2024-04-18T04:54:41.175137+0000","last_became_peered":"2024-04-18T04:54:41.175137+0000","last_unstale":"2024-04-18T05:01:07.372623+0000","last_undegraded":"2024-04-18T05:01:07.372623+0000","last_fullsized":"2024-04-18T05:01:07.372623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:06:24.271204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21971,"num_write":395,"num_write_kb":63063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'67","reported_seq":82,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.319843+0000","last_change":"2024-04-18T04:54:40.798936+0000","last_active":"2024-04-18T05:01:07.319843+0000","last_peered":"2024-04-18T05:01:07.319843+0000","last_clean":"2024-04-18T05:01:07.319843+0000","last_became_active":"2024-04-18T04:54:40.798572+0000","last_became_peered":"2024-04-18T04:54:40.798572+0000","last_unstale":"2024-04-18T05:01:07.319843+0000","last_undegraded":"2024-04-18T05:01:07.319843+0000","last_fullsized":"2024-04-18T05:01:07.319843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'432","reported_seq":484,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.382097+0000","last_change":"2024-04-18T04:54:41.188280+0000","last_active":"2024-04-18T05:01:07.382097+0000","last_peered":"2024-04-18T05:01:07.382097+0000","last_clean":"2024-04-18T05:01:07.382097+0000","last_became_active":"2024-04-18T04:54:41.188012+0000","last_became_peered":"2024-04-18T04:54:41.188012+0000","last_unstale":"2024-04-18T05:01:07.382097+0000","last_undegraded":"2024-04-18T05:01:07.382097+0000","last_fullsized":"2024-04-18T05:01:07.382097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:11.319118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13773,"num_write":397,"num_write_kb":43173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'334","reported_seq":349,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.019065+0000","last_change":"2024-04-18T04:54:40.802894+0000","last_active":"2024-04-18T05:00:05.019065+0000","last_peered":"2024-04-18T05:00:05.019065+0000","last_clean":"2024-04-18T05:00:05.019065+0000","last_became_active":"2024-04-18T04:54:40.801406+0000","last_became_peered":"2024-04-18T04:54:40.801406+0000","last_unstale":"2024-04-18T05:00:05.019065+0000","last_undegraded":"2024-04-18T05:00:05.019065+0000","last_fullsized":"2024-04-18T05:00:05.019065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"23'397","reported_seq":432,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.409498+0000","last_change":"2024-04-18T04:54:41.203407+0000","last_active":"2024-04-18T05:01:07.409498+0000","last_peered":"2024-04-18T05:01:07.409498+0000","last_clean":"2024-04-18T05:01:07.409498+0000","last_became_active":"2024-04-18T04:54:41.203186+0000","last_became_peered":"2024-04-18T04:54:41.203186+0000","last_unstale":"2024-04-18T05:01:07.409498+0000","last_undegraded":"2024-04-18T05:01:07.409498+0000","last_fullsized":"2024-04-18T05:01:07.409498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:23:50.107054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14488,"num_write":364,"num_write_kb":75349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'188","reported_seq":203,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.064184+0000","last_change":"2024-04-18T04:54:40.822014+0000","last_active":"2024-04-18T05:00:06.064184+0000","last_peered":"2024-04-18T05:00:06.064184+0000","last_clean":"2024-04-18T05:00:06.064184+0000","last_became_active":"2024-04-18T04:54:40.820920+0000","last_became_peered":"2024-04-18T04:54:40.820920+0000","last_unstale":"2024-04-18T05:00:06.064184+0000","last_undegraded":"2024-04-18T05:00:06.064184+0000","last_fullsized":"2024-04-18T05:00:06.064184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"23'394","reported_seq":443,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.365245+0000","last_change":"2024-04-18T04:54:41.197254+0000","last_active":"2024-04-18T05:01:07.365245+0000","last_peered":"2024-04-18T05:01:07.365245+0000","last_clean":"2024-04-18T05:01:07.365245+0000","last_became_active":"2024-04-18T04:54:41.196927+0000","last_became_peered":"2024-04-18T04:54:41.196927+0000","last_unstale":"2024-04-18T05:01:07.365245+0000","last_undegraded":"2024-04-18T05:01:07.365245+0000","last_fullsized":"2024-04-18T05:01:07.365245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:01:45.182766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21129,"num_write":360,"num_write_kb":71528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'444","reported_seq":459,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.323010+0000","last_change":"2024-04-18T04:54:40.801789+0000","last_active":"2024-04-18T05:01:07.323010+0000","last_peered":"2024-04-18T05:01:07.323010+0000","last_clean":"2024-04-18T05:01:07.323010+0000","last_became_active":"2024-04-18T04:54:40.801403+0000","last_became_peered":"2024-04-18T04:54:40.801403+0000","last_unstale":"2024-04-18T05:01:07.323010+0000","last_undegraded":"2024-04-18T05:01:07.323010+0000","last_fullsized":"2024-04-18T05:01:07.323010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:15:11.220095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12011434,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":11980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'396","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394971+0000","last_change":"2024-04-18T04:54:41.195518+0000","last_active":"2024-04-18T05:01:07.394971+0000","last_peered":"2024-04-18T05:01:07.394971+0000","last_clean":"2024-04-18T05:01:07.394971+0000","last_became_active":"2024-04-18T04:54:41.195172+0000","last_became_peered":"2024-04-18T04:54:41.195172+0000","last_unstale":"2024-04-18T05:01:07.394971+0000","last_undegraded":"2024-04-18T05:01:07.394971+0000","last_fullsized":"2024-04-18T05:01:07.394971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19873,"num_write":365,"num_write_kb":71837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'583","reported_seq":598,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T04:59:57.951802+0000","last_change":"2024-04-18T04:54:40.818390+0000","last_active":"2024-04-18T04:59:57.951802+0000","last_peered":"2024-04-18T04:59:57.951802+0000","last_clean":"2024-04-18T04:59:57.951802+0000","last_became_active":"2024-04-18T04:54:40.817681+0000","last_became_peered":"2024-04-18T04:54:40.817681+0000","last_unstale":"2024-04-18T04:59:57.951802+0000","last_undegraded":"2024-04-18T04:59:57.951802+0000","last_fullsized":"2024-04-18T04:59:57.951802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"23'417","reported_seq":443,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.392565+0000","last_change":"2024-04-18T04:54:41.194807+0000","last_active":"2024-04-18T05:01:07.392565+0000","last_peered":"2024-04-18T05:01:07.392565+0000","last_clean":"2024-04-18T05:01:07.392565+0000","last_became_active":"2024-04-18T04:54:41.194499+0000","last_became_peered":"2024-04-18T04:54:41.194499+0000","last_unstale":"2024-04-18T05:01:07.392565+0000","last_undegraded":"2024-04-18T05:01:07.392565+0000","last_fullsized":"2024-04-18T05:01:07.392565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":380,"num_write_kb":59449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"23'70","reported_seq":84,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.004709+0000","last_change":"2024-04-18T04:54:40.817631+0000","last_active":"2024-04-18T05:00:06.004709+0000","last_peered":"2024-04-18T05:00:06.004709+0000","last_clean":"2024-04-18T05:00:06.004709+0000","last_became_active":"2024-04-18T04:54:40.817370+0000","last_became_peered":"2024-04-18T04:54:40.817370+0000","last_unstale":"2024-04-18T05:00:06.004709+0000","last_undegraded":"2024-04-18T05:00:06.004709+0000","last_fullsized":"2024-04-18T05:00:06.004709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'400","reported_seq":472,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377439+0000","last_change":"2024-04-18T04:54:41.193363+0000","last_active":"2024-04-18T05:01:07.377439+0000","last_peered":"2024-04-18T05:01:07.377439+0000","last_clean":"2024-04-18T05:01:07.377439+0000","last_became_active":"2024-04-18T04:54:41.192889+0000","last_became_peered":"2024-04-18T04:54:41.192889+0000","last_unstale":"2024-04-18T05:01:07.377439+0000","last_undegraded":"2024-04-18T05:01:07.377439+0000","last_fullsized":"2024-04-18T05:01:07.377439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30891,"num_write":363,"num_write_kb":81664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"23'67","reported_seq":82,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.985062+0000","last_change":"2024-04-18T04:54:40.806633+0000","last_active":"2024-04-18T05:00:03.985062+0000","last_peered":"2024-04-18T05:00:03.985062+0000","last_clean":"2024-04-18T05:00:03.985062+0000","last_became_active":"2024-04-18T04:54:40.805965+0000","last_became_peered":"2024-04-18T04:54:40.805965+0000","last_unstale":"2024-04-18T05:00:03.985062+0000","last_undegraded":"2024-04-18T05:00:03.985062+0000","last_fullsized":"2024-04-18T05:00:03.985062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1124,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'449","reported_seq":495,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.410877+0000","last_change":"2024-04-18T04:54:41.184321+0000","last_active":"2024-04-18T05:01:07.410877+0000","last_peered":"2024-04-18T05:01:07.410877+0000","last_clean":"2024-04-18T05:01:07.410877+0000","last_became_active":"2024-04-18T04:54:41.183838+0000","last_became_peered":"2024-04-18T04:54:41.183838+0000","last_unstale":"2024-04-18T05:01:07.410877+0000","last_undegraded":"2024-04-18T05:01:07.410877+0000","last_fullsized":"2024-04-18T05:01:07.410877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14210,"num_write":423,"num_write_kb":80124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'80","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.004824+0000","last_change":"2024-04-18T04:54:40.818954+0000","last_active":"2024-04-18T05:00:06.004824+0000","last_peered":"2024-04-18T05:00:06.004824+0000","last_clean":"2024-04-18T05:00:06.004824+0000","last_became_active":"2024-04-18T04:54:40.818227+0000","last_became_peered":"2024-04-18T04:54:40.818227+0000","last_unstale":"2024-04-18T05:00:06.004824+0000","last_undegraded":"2024-04-18T05:00:06.004824+0000","last_fullsized":"2024-04-18T05:00:06.004824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:25.263089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"23'493","reported_seq":553,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.364760+0000","last_change":"2024-04-18T04:54:41.192227+0000","last_active":"2024-04-18T05:01:07.364760+0000","last_peered":"2024-04-18T05:01:07.364760+0000","last_clean":"2024-04-18T05:01:07.364760+0000","last_became_active":"2024-04-18T04:54:41.187002+0000","last_became_peered":"2024-04-18T04:54:41.187002+0000","last_unstale":"2024-04-18T05:01:07.364760+0000","last_undegraded":"2024-04-18T05:01:07.364760+0000","last_fullsized":"2024-04-18T05:01:07.364760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":24156,"num_write":458,"num_write_kb":105037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'199","reported_seq":214,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.106627+0000","last_change":"2024-04-18T04:54:40.805795+0000","last_active":"2024-04-18T05:00:05.106627+0000","last_peered":"2024-04-18T05:00:05.106627+0000","last_clean":"2024-04-18T05:00:05.106627+0000","last_became_active":"2024-04-18T04:54:40.802550+0000","last_became_peered":"2024-04-18T04:54:40.802550+0000","last_unstale":"2024-04-18T05:00:05.106627+0000","last_undegraded":"2024-04-18T05:00:05.106627+0000","last_fullsized":"2024-04-18T05:00:05.106627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'364","reported_seq":403,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.373214+0000","last_change":"2024-04-18T04:54:41.180426+0000","last_active":"2024-04-18T05:01:07.373214+0000","last_peered":"2024-04-18T05:01:07.373214+0000","last_clean":"2024-04-18T05:01:07.373214+0000","last_became_active":"2024-04-18T04:54:41.179540+0000","last_became_peered":"2024-04-18T04:54:41.179540+0000","last_unstale":"2024-04-18T05:01:07.373214+0000","last_undegraded":"2024-04-18T05:01:07.373214+0000","last_fullsized":"2024-04-18T05:01:07.373214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:38:25.074053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16384,"num_write":332,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'304","reported_seq":319,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:01.025031+0000","last_change":"2024-04-18T04:54:40.804284+0000","last_active":"2024-04-18T05:00:01.025031+0000","last_peered":"2024-04-18T05:00:01.025031+0000","last_clean":"2024-04-18T05:00:01.025031+0000","last_became_active":"2024-04-18T04:54:40.803464+0000","last_became_peered":"2024-04-18T04:54:40.803464+0000","last_unstale":"2024-04-18T05:00:01.025031+0000","last_undegraded":"2024-04-18T05:00:01.025031+0000","last_fullsized":"2024-04-18T05:00:01.025031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:52.171667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"23'391","reported_seq":433,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377810+0000","last_change":"2024-04-18T04:54:41.188591+0000","last_active":"2024-04-18T05:01:07.377810+0000","last_peered":"2024-04-18T05:01:07.377810+0000","last_clean":"2024-04-18T05:01:07.377810+0000","last_became_active":"2024-04-18T04:54:41.188152+0000","last_became_peered":"2024-04-18T04:54:41.188152+0000","last_unstale":"2024-04-18T05:01:07.377810+0000","last_undegraded":"2024-04-18T05:01:07.377810+0000","last_fullsized":"2024-04-18T05:01:07.377810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15853,"num_write":356,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'535","reported_seq":549,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.991447+0000","last_change":"2024-04-18T04:54:40.814901+0000","last_active":"2024-04-18T05:00:02.991447+0000","last_peered":"2024-04-18T05:00:02.991447+0000","last_clean":"2024-04-18T05:00:02.991447+0000","last_became_active":"2024-04-18T04:54:40.814207+0000","last_became_peered":"2024-04-18T04:54:40.814207+0000","last_unstale":"2024-04-18T05:00:02.991447+0000","last_undegraded":"2024-04-18T05:00:02.991447+0000","last_fullsized":"2024-04-18T05:00:02.991447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"23'425","reported_seq":468,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.378034+0000","last_change":"2024-04-18T04:54:41.188664+0000","last_active":"2024-04-18T05:01:07.378034+0000","last_peered":"2024-04-18T05:01:07.378034+0000","last_clean":"2024-04-18T05:01:07.378034+0000","last_became_active":"2024-04-18T04:54:41.188249+0000","last_became_peered":"2024-04-18T04:54:41.188249+0000","last_unstale":"2024-04-18T05:01:07.378034+0000","last_undegraded":"2024-04-18T05:01:07.378034+0000","last_fullsized":"2024-04-18T05:01:07.378034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14420,"num_write":396,"num_write_kb":51045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'76","reported_seq":91,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.044489+0000","last_change":"2024-04-18T04:54:40.828447+0000","last_active":"2024-04-18T05:00:05.044489+0000","last_peered":"2024-04-18T05:00:05.044489+0000","last_clean":"2024-04-18T05:00:05.044489+0000","last_became_active":"2024-04-18T04:54:40.823755+0000","last_became_peered":"2024-04-18T04:54:40.823755+0000","last_unstale":"2024-04-18T05:00:05.044489+0000","last_undegraded":"2024-04-18T05:00:05.044489+0000","last_fullsized":"2024-04-18T05:00:05.044489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1706,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'402","reported_seq":434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.371709+0000","last_change":"2024-04-18T04:54:41.186523+0000","last_active":"2024-04-18T05:01:07.371709+0000","last_peered":"2024-04-18T05:01:07.371709+0000","last_clean":"2024-04-18T05:01:07.371709+0000","last_became_active":"2024-04-18T04:54:41.186149+0000","last_became_peered":"2024-04-18T04:54:41.186149+0000","last_unstale":"2024-04-18T05:01:07.371709+0000","last_undegraded":"2024-04-18T05:01:07.371709+0000","last_fullsized":"2024-04-18T05:01:07.371709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7713,"num_write":373,"num_write_kb":46594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T04:58:35.620748+0000","last_change":"2024-04-18T04:54:35.674328+0000","last_active":"2024-04-18T04:58:35.620748+0000","last_peered":"2024-04-18T04:58:35.620748+0000","last_clean":"2024-04-18T04:58:35.620748+0000","last_became_active":"2024-04-18T04:54:35.672457+0000","last_became_peered":"2024-04-18T04:54:35.672457+0000","last_unstale":"2024-04-18T04:58:35.620748+0000","last_undegraded":"2024-04-18T04:58:35.620748+0000","last_fullsized":"2024-04-18T04:58:35.620748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_clean_scrub_stamp":"2024-04-18T04:54:33.597974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:02:10.966568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'71","reported_seq":86,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.016000+0000","last_change":"2024-04-18T04:54:40.802422+0000","last_active":"2024-04-18T05:00:06.016000+0000","last_peered":"2024-04-18T05:00:06.016000+0000","last_clean":"2024-04-18T05:00:06.016000+0000","last_became_active":"2024-04-18T04:54:40.801083+0000","last_became_peered":"2024-04-18T04:54:40.801083+0000","last_unstale":"2024-04-18T05:00:06.016000+0000","last_undegraded":"2024-04-18T05:00:06.016000+0000","last_fullsized":"2024-04-18T05:00:06.016000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'362","reported_seq":382,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.383454+0000","last_change":"2024-04-18T04:54:41.174658+0000","last_active":"2024-04-18T05:01:07.383454+0000","last_peered":"2024-04-18T05:01:07.383454+0000","last_clean":"2024-04-18T05:01:07.383454+0000","last_became_active":"2024-04-18T04:54:41.174391+0000","last_became_peered":"2024-04-18T04:54:41.174391+0000","last_unstale":"2024-04-18T05:01:07.383454+0000","last_undegraded":"2024-04-18T05:01:07.383454+0000","last_fullsized":"2024-04-18T05:01:07.383454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:28:24.015964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1626,"num_write":331,"num_write_kb":26059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'438","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.117713+0000","last_change":"2024-04-18T04:54:40.813770+0000","last_active":"2024-04-18T05:00:05.117713+0000","last_peered":"2024-04-18T05:00:05.117713+0000","last_clean":"2024-04-18T05:00:05.117713+0000","last_became_active":"2024-04-18T04:54:40.813396+0000","last_became_peered":"2024-04-18T04:54:40.813396+0000","last_unstale":"2024-04-18T05:00:05.117713+0000","last_undegraded":"2024-04-18T05:00:05.117713+0000","last_fullsized":"2024-04-18T05:00:05.117713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":379,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'410","reported_seq":523,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394590+0000","last_change":"2024-04-18T04:54:41.195440+0000","last_active":"2024-04-18T05:01:07.394590+0000","last_peered":"2024-04-18T05:01:07.394590+0000","last_clean":"2024-04-18T05:01:07.394590+0000","last_became_active":"2024-04-18T04:54:41.195152+0000","last_became_peered":"2024-04-18T04:54:41.195152+0000","last_unstale":"2024-04-18T05:01:07.394590+0000","last_undegraded":"2024-04-18T05:01:07.394590+0000","last_fullsized":"2024-04-18T05:01:07.394590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":54989,"num_write":377,"num_write_kb":85155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'431","reported_seq":798,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:55.644395+0000","last_change":"2024-04-18T04:54:40.818806+0000","last_active":"2024-04-18T05:00:55.644395+0000","last_peered":"2024-04-18T05:00:55.644395+0000","last_clean":"2024-04-18T05:00:55.644395+0000","last_became_active":"2024-04-18T04:54:40.818113+0000","last_became_peered":"2024-04-18T04:54:40.818113+0000","last_unstale":"2024-04-18T05:00:55.644395+0000","last_undegraded":"2024-04-18T05:00:55.644395+0000","last_fullsized":"2024-04-18T05:00:55.644395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1456426,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":351,"num_read_kb":1645,"num_write":371,"num_write_kb":1672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'416","reported_seq":434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.412599+0000","last_change":"2024-04-18T04:54:41.192576+0000","last_active":"2024-04-18T05:01:07.412599+0000","last_peered":"2024-04-18T05:01:07.412599+0000","last_clean":"2024-04-18T05:01:07.412599+0000","last_became_active":"2024-04-18T04:54:41.192187+0000","last_became_peered":"2024-04-18T04:54:41.192187+0000","last_unstale":"2024-04-18T05:01:07.412599+0000","last_undegraded":"2024-04-18T05:01:07.412599+0000","last_fullsized":"2024-04-18T05:01:07.412599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":364,"num_write":388,"num_write_kb":58777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'517","reported_seq":532,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.991782+0000","last_change":"2024-04-18T04:54:40.820531+0000","last_active":"2024-04-18T05:00:03.991782+0000","last_peered":"2024-04-18T05:00:03.991782+0000","last_clean":"2024-04-18T05:00:03.991782+0000","last_became_active":"2024-04-18T04:54:40.820025+0000","last_became_peered":"2024-04-18T04:54:40.820025+0000","last_unstale":"2024-04-18T05:00:03.991782+0000","last_undegraded":"2024-04-18T05:00:03.991782+0000","last_fullsized":"2024-04-18T05:00:03.991782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:35.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":8474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'404","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374383+0000","last_change":"2024-04-18T04:54:41.186361+0000","last_active":"2024-04-18T05:01:07.374383+0000","last_peered":"2024-04-18T05:01:07.374383+0000","last_clean":"2024-04-18T05:01:07.374383+0000","last_became_active":"2024-04-18T04:54:41.185257+0000","last_became_peered":"2024-04-18T04:54:41.185257+0000","last_unstale":"2024-04-18T05:01:07.374383+0000","last_undegraded":"2024-04-18T05:01:07.374383+0000","last_fullsized":"2024-04-18T05:01:07.374383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14216,"num_write":374,"num_write_kb":63531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'63","reported_seq":78,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.961722+0000","last_change":"2024-04-18T04:54:40.824668+0000","last_active":"2024-04-18T05:00:02.961722+0000","last_peered":"2024-04-18T05:00:02.961722+0000","last_clean":"2024-04-18T05:00:02.961722+0000","last_became_active":"2024-04-18T04:54:40.824206+0000","last_became_peered":"2024-04-18T04:54:40.824206+0000","last_unstale":"2024-04-18T05:00:02.961722+0000","last_undegraded":"2024-04-18T05:00:02.961722+0000","last_fullsized":"2024-04-18T05:00:02.961722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'433","reported_seq":531,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.393697+0000","last_change":"2024-04-18T04:54:41.195487+0000","last_active":"2024-04-18T05:01:07.393697+0000","last_peered":"2024-04-18T05:01:07.393697+0000","last_clean":"2024-04-18T05:01:07.393697+0000","last_became_active":"2024-04-18T04:54:41.195177+0000","last_became_peered":"2024-04-18T04:54:41.195177+0000","last_unstale":"2024-04-18T05:01:07.393697+0000","last_undegraded":"2024-04-18T05:01:07.393697+0000","last_fullsized":"2024-04-18T05:01:07.393697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:25.853413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":41457,"num_write":394,"num_write_kb":79356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'328","reported_seq":343,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.057473+0000","last_change":"2024-04-18T04:54:40.803387+0000","last_active":"2024-04-18T05:00:05.057473+0000","last_peered":"2024-04-18T05:00:05.057473+0000","last_clean":"2024-04-18T05:00:05.057473+0000","last_became_active":"2024-04-18T04:54:40.802902+0000","last_became_peered":"2024-04-18T04:54:40.802902+0000","last_unstale":"2024-04-18T05:00:05.057473+0000","last_undegraded":"2024-04-18T05:00:05.057473+0000","last_fullsized":"2024-04-18T05:00:05.057473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'423","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.404089+0000","last_change":"2024-04-18T04:54:41.195382+0000","last_active":"2024-04-18T05:01:07.404089+0000","last_peered":"2024-04-18T05:01:07.404089+0000","last_clean":"2024-04-18T05:01:07.404089+0000","last_became_active":"2024-04-18T04:54:41.194965+0000","last_became_peered":"2024-04-18T04:54:41.194965+0000","last_unstale":"2024-04-18T05:01:07.404089+0000","last_undegraded":"2024-04-18T05:01:07.404089+0000","last_fullsized":"2024-04-18T05:01:07.404089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:39:50.932794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32152,"num_write":386,"num_write_kb":121188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'116","reported_seq":131,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:07.223800+0000","last_change":"2024-04-18T04:54:40.800651+0000","last_active":"2024-04-18T05:00:07.223800+0000","last_peered":"2024-04-18T05:00:07.223800+0000","last_clean":"2024-04-18T05:00:07.223800+0000","last_became_active":"2024-04-18T04:54:40.798574+0000","last_became_peered":"2024-04-18T04:54:40.798574+0000","last_unstale":"2024-04-18T05:00:07.223800+0000","last_undegraded":"2024-04-18T05:00:07.223800+0000","last_fullsized":"2024-04-18T05:00:07.223800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:55.712985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'326","reported_seq":341,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.386513+0000","last_change":"2024-04-18T04:54:41.191679+0000","last_active":"2024-04-18T05:01:07.386513+0000","last_peered":"2024-04-18T05:01:07.386513+0000","last_clean":"2024-04-18T05:01:07.386513+0000","last_became_active":"2024-04-18T04:54:41.191124+0000","last_became_peered":"2024-04-18T04:54:41.191124+0000","last_unstale":"2024-04-18T05:01:07.386513+0000","last_undegraded":"2024-04-18T05:01:07.386513+0000","last_fullsized":"2024-04-18T05:01:07.386513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.296860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":298,"num_write_kb":17144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'80","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.999053+0000","last_change":"2024-04-18T04:54:40.804085+0000","last_active":"2024-04-18T05:00:05.999053+0000","last_peered":"2024-04-18T05:00:05.999053+0000","last_clean":"2024-04-18T05:00:05.999053+0000","last_became_active":"2024-04-18T04:54:40.803616+0000","last_became_peered":"2024-04-18T04:54:40.803616+0000","last_unstale":"2024-04-18T05:00:05.999053+0000","last_undegraded":"2024-04-18T05:00:05.999053+0000","last_fullsized":"2024-04-18T05:00:05.999053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:55.405415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'465","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.383580+0000","last_change":"2024-04-18T04:54:41.185453+0000","last_active":"2024-04-18T05:01:07.383580+0000","last_peered":"2024-04-18T05:01:07.383580+0000","last_clean":"2024-04-18T05:01:07.383580+0000","last_became_active":"2024-04-18T04:54:41.185217+0000","last_became_peered":"2024-04-18T04:54:41.185217+0000","last_unstale":"2024-04-18T05:01:07.383580+0000","last_undegraded":"2024-04-18T05:01:07.383580+0000","last_fullsized":"2024-04-18T05:01:07.383580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:44:42.484978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8956,"num_write":434,"num_write_kb":97052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'601","reported_seq":617,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.068924+0000","last_change":"2024-04-18T04:54:40.801317+0000","last_active":"2024-04-18T05:00:05.068924+0000","last_peered":"2024-04-18T05:00:05.068924+0000","last_clean":"2024-04-18T05:00:05.068924+0000","last_became_active":"2024-04-18T04:54:40.800598+0000","last_became_peered":"2024-04-18T04:54:40.800598+0000","last_unstale":"2024-04-18T05:00:05.068924+0000","last_undegraded":"2024-04-18T05:00:05.068924+0000","last_fullsized":"2024-04-18T05:00:05.068924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":546,"num_write_kb":4388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'458","reported_seq":503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.330451+0000","last_change":"2024-04-18T04:54:41.197813+0000","last_active":"2024-04-18T05:01:07.330451+0000","last_peered":"2024-04-18T05:01:07.330451+0000","last_clean":"2024-04-18T05:01:07.330451+0000","last_became_active":"2024-04-18T04:54:41.197201+0000","last_became_peered":"2024-04-18T04:54:41.197201+0000","last_unstale":"2024-04-18T05:01:07.330451+0000","last_undegraded":"2024-04-18T05:01:07.330451+0000","last_fullsized":"2024-04-18T05:01:07.330451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21429,"num_write":433,"num_write_kb":71833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'55","reported_seq":70,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.004167+0000","last_change":"2024-04-18T04:54:40.800416+0000","last_active":"2024-04-18T05:00:03.004167+0000","last_peered":"2024-04-18T05:00:03.004167+0000","last_clean":"2024-04-18T05:00:03.004167+0000","last_became_active":"2024-04-18T04:54:40.797471+0000","last_became_peered":"2024-04-18T04:54:40.797471+0000","last_unstale":"2024-04-18T05:00:03.004167+0000","last_undegraded":"2024-04-18T05:00:03.004167+0000","last_fullsized":"2024-04-18T05:00:03.004167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:33.118670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"23'421","reported_seq":478,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.382482+0000","last_change":"2024-04-18T04:54:41.192024+0000","last_active":"2024-04-18T05:01:07.382482+0000","last_peered":"2024-04-18T05:01:07.382482+0000","last_clean":"2024-04-18T05:01:07.382482+0000","last_became_active":"2024-04-18T04:54:41.191488+0000","last_became_peered":"2024-04-18T04:54:41.191488+0000","last_unstale":"2024-04-18T05:01:07.382482+0000","last_undegraded":"2024-04-18T05:01:07.382482+0000","last_fullsized":"2024-04-18T05:01:07.382482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:39:31.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23403,"num_write":390,"num_write_kb":67848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'192","reported_seq":208,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.005322+0000","last_change":"2024-04-18T04:54:40.823863+0000","last_active":"2024-04-18T05:00:03.005322+0000","last_peered":"2024-04-18T05:00:03.005322+0000","last_clean":"2024-04-18T05:00:03.005322+0000","last_became_active":"2024-04-18T04:54:40.823277+0000","last_became_peered":"2024-04-18T04:54:40.823277+0000","last_unstale":"2024-04-18T05:00:03.005322+0000","last_undegraded":"2024-04-18T05:00:03.005322+0000","last_fullsized":"2024-04-18T05:00:03.005322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'448","reported_seq":498,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394105+0000","last_change":"2024-04-18T04:54:41.199981+0000","last_active":"2024-04-18T05:01:07.394105+0000","last_peered":"2024-04-18T05:01:07.394105+0000","last_clean":"2024-04-18T05:01:07.394105+0000","last_became_active":"2024-04-18T04:54:41.199700+0000","last_became_peered":"2024-04-18T04:54:41.199700+0000","last_unstale":"2024-04-18T05:01:07.394105+0000","last_undegraded":"2024-04-18T05:01:07.394105+0000","last_fullsized":"2024-04-18T05:01:07.394105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":10662,"num_write":420,"num_write_kb":96864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'127","reported_seq":141,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:01.015287+0000","last_change":"2024-04-18T04:54:40.800740+0000","last_active":"2024-04-18T05:00:01.015287+0000","last_peered":"2024-04-18T05:00:01.015287+0000","last_clean":"2024-04-18T05:00:01.015287+0000","last_became_active":"2024-04-18T04:54:40.800405+0000","last_became_peered":"2024-04-18T04:54:40.800405+0000","last_unstale":"2024-04-18T05:00:01.015287+0000","last_undegraded":"2024-04-18T05:00:01.015287+0000","last_fullsized":"2024-04-18T05:00:01.015287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":8237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'441","reported_seq":502,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.363689+0000","last_change":"2024-04-18T04:54:41.192487+0000","last_active":"2024-04-18T05:01:07.363689+0000","last_peered":"2024-04-18T05:01:07.363689+0000","last_clean":"2024-04-18T05:01:07.363689+0000","last_became_active":"2024-04-18T04:54:41.186301+0000","last_became_peered":"2024-04-18T04:54:41.186301+0000","last_unstale":"2024-04-18T05:01:07.363689+0000","last_undegraded":"2024-04-18T05:01:07.363689+0000","last_fullsized":"2024-04-18T05:01:07.363689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":27247,"num_write":409,"num_write_kb":76591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"23'382","reported_seq":407,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.378209+0000","last_change":"2024-04-18T04:54:41.193260+0000","last_active":"2024-04-18T05:01:07.378209+0000","last_peered":"2024-04-18T05:01:07.378209+0000","last_clean":"2024-04-18T05:01:07.378209+0000","last_became_active":"2024-04-18T04:54:41.192941+0000","last_became_peered":"2024-04-18T04:54:41.192941+0000","last_unstale":"2024-04-18T05:01:07.378209+0000","last_undegraded":"2024-04-18T05:01:07.378209+0000","last_fullsized":"2024-04-18T05:01:07.378209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4755,"num_write":342,"num_write_kb":72428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'357","reported_seq":372,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.067828+0000","last_change":"2024-04-18T04:54:40.800162+0000","last_active":"2024-04-18T05:00:05.067828+0000","last_peered":"2024-04-18T05:00:05.067828+0000","last_clean":"2024-04-18T05:00:05.067828+0000","last_became_active":"2024-04-18T04:54:40.799517+0000","last_became_peered":"2024-04-18T04:54:40.799517+0000","last_unstale":"2024-04-18T05:00:05.067828+0000","last_undegraded":"2024-04-18T05:00:05.067828+0000","last_fullsized":"2024-04-18T05:00:05.067828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"23'382","reported_seq":421,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374639+0000","last_change":"2024-04-18T04:54:41.179695+0000","last_active":"2024-04-18T05:01:07.374639+0000","last_peered":"2024-04-18T05:01:07.374639+0000","last_clean":"2024-04-18T05:01:07.374639+0000","last_became_active":"2024-04-18T04:54:41.179359+0000","last_became_peered":"2024-04-18T04:54:41.179359+0000","last_unstale":"2024-04-18T05:01:07.374639+0000","last_undegraded":"2024-04-18T05:01:07.374639+0000","last_fullsized":"2024-04-18T05:01:07.374639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14401,"num_write":356,"num_write_kb":79542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'289","reported_seq":304,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.057756+0000","last_change":"2024-04-18T04:54:40.801178+0000","last_active":"2024-04-18T05:00:05.057756+0000","last_peered":"2024-04-18T05:00:05.057756+0000","last_clean":"2024-04-18T05:00:05.057756+0000","last_became_active":"2024-04-18T04:54:40.800660+0000","last_became_peered":"2024-04-18T04:54:40.800660+0000","last_unstale":"2024-04-18T05:00:05.057756+0000","last_undegraded":"2024-04-18T05:00:05.057756+0000","last_fullsized":"2024-04-18T05:00:05.057756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":12441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'366","reported_seq":409,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.411914+0000","last_change":"2024-04-18T04:54:41.190055+0000","last_active":"2024-04-18T05:01:07.411914+0000","last_peered":"2024-04-18T05:01:07.411914+0000","last_clean":"2024-04-18T05:01:07.411914+0000","last_became_active":"2024-04-18T04:54:41.189344+0000","last_became_peered":"2024-04-18T04:54:41.189344+0000","last_unstale":"2024-04-18T05:01:07.411914+0000","last_undegraded":"2024-04-18T05:01:07.411914+0000","last_fullsized":"2024-04-18T05:01:07.411914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10936,"num_write":342,"num_write_kb":51086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'86","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.013938+0000","last_change":"2024-04-18T04:54:40.813931+0000","last_active":"2024-04-18T05:00:03.013938+0000","last_peered":"2024-04-18T05:00:03.013938+0000","last_clean":"2024-04-18T05:00:03.013938+0000","last_became_active":"2024-04-18T04:54:40.813290+0000","last_became_peered":"2024-04-18T04:54:40.813290+0000","last_unstale":"2024-04-18T05:00:03.013938+0000","last_undegraded":"2024-04-18T05:00:03.013938+0000","last_fullsized":"2024-04-18T05:00:03.013938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'407","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.385303+0000","last_change":"2024-04-18T04:54:41.192913+0000","last_active":"2024-04-18T05:01:07.385303+0000","last_peered":"2024-04-18T05:01:07.385303+0000","last_clean":"2024-04-18T05:01:07.385303+0000","last_became_active":"2024-04-18T04:54:41.192096+0000","last_became_peered":"2024-04-18T04:54:41.192096+0000","last_unstale":"2024-04-18T05:01:07.385303+0000","last_undegraded":"2024-04-18T05:01:07.385303+0000","last_fullsized":"2024-04-18T05:01:07.385303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:37:53.082409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17335,"num_write":380,"num_write_kb":68515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'130","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.040397+0000","last_change":"2024-04-18T04:54:40.805596+0000","last_active":"2024-04-18T05:00:06.040397+0000","last_peered":"2024-04-18T05:00:06.040397+0000","last_clean":"2024-04-18T05:00:06.040397+0000","last_became_active":"2024-04-18T04:54:40.804913+0000","last_became_peered":"2024-04-18T04:54:40.804913+0000","last_unstale":"2024-04-18T05:00:06.040397+0000","last_undegraded":"2024-04-18T05:00:06.040397+0000","last_fullsized":"2024-04-18T05:00:06.040397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:44.772589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2494,"num_read_kb":1324974,"num_write":24555,"num_write_kb":4507656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26500,"ondisk_log_size":26500,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":130916242,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":351,"num_read_kb":1645,"num_write":7226,"num_write_kb":133419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":100597760,"data_stored":261832484,"data_compressed":36635560,"data_compressed_allocated":47603712,"data_compressed_original":209084416,"omap_allocated":0,"internal_metadata":0},"log_size":8833,"ondisk_log_size":8833,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509522,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":5676,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":5812224,"data_stored":14125282,"data_compressed":1836351,"data_compressed_allocated":2379776,"data_compressed_original":10878976,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77800000000000002,"15min":0.83599999999999997},"min":{"1min":0.40100000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.1639999999999999,"5min":1.1910000000000001,"15min":1.2490000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.79100000000000004,"15min":0.83999999999999997},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1259999999999999,"5min":1.262,"15min":1.262},"last":1.194}]},{"osd":1,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0660000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.82899999999999996,"15min":0.84299999999999997},"min":{"1min":0.46500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.226,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.98099999999999998}]},{"osd":2,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.91600000000000004,"15min":0.89000000000000001},"min":{"1min":0.53700000000000003,"5min":0.438,"15min":0.438},"max":{"1min":1.2270000000000001,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86899999999999999,"15min":0.86499999999999999},"min":{"1min":0.48299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1890000000000001,"5min":1.379,"15min":1.4019999999999999},"last":1.123}]},{"osd":3,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1890000000000001,"5min":1.458,"15min":1.458},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.97899999999999998,"15min":0.95099999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.248,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0209999999999999}]},{"osd":4,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.91700000000000004,"15min":0.93100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.1479999999999999,"5min":1.605,"15min":1.605},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.91900000000000004,"15min":0.91100000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.175,"5min":1.546,"15min":1.546},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.98799999999999999,"15min":1.018},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2090000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.998,"15min":1.02},"min":{"1min":0.45000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.236,"5min":1.431,"15min":1.5640000000000001},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.0800000000000001,"15min":1.1120000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.28,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.0609999999999999,"15min":1.048},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.236,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.0760000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509522,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47056,"kb_used_data":7752,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94324784,"statfs":{"total":96636764160,"available":96588578816,"internally_reserved":0,"allocated":7938048,"data_stored":21059926,"data_compressed":3027129,"data_compressed_allocated":3776512,"data_compressed_original":17063936,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.76000000000000001,"15min":0.77600000000000002},"min":{"1min":0.61899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0800000000000001,"5min":1.125,"15min":1.125},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.81299999999999994,"15min":0.85099999999999998},"min":{"1min":0.58599999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0469999999999999,"5min":1.1870000000000001,"15min":1.353},"last":1.0349999999999999}]},{"osd":1,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.84999999999999998,"15min":0.93799999999999994},"min":{"1min":0.68700000000000006,"5min":0.312,"15min":0.312},"max":{"1min":1.1519999999999999,"5min":1.268,"15min":1.8560000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.82099999999999995,"15min":0.85099999999999998},"min":{"1min":0.74099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.038,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.94599999999999995,"15min":0.93600000000000005},"min":{"1min":0.92900000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1919999999999999,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.66000000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1910000000000001,"5min":1.325,"15min":1.325},"last":0.82199999999999995}]},{"osd":3,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.91600000000000004,"15min":0.90500000000000003},"min":{"1min":0.68200000000000005,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.159,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.93899999999999995,"15min":0.98899999999999999},"min":{"1min":0.80800000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1699999999999999,"5min":1.617,"15min":1.617},"last":0.95499999999999996}]},{"osd":4,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.88900000000000001,"15min":0.97899999999999998},"min":{"1min":0.64600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2789999999999999,"5min":1.4990000000000001,"15min":1.631},"last":0.999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97699999999999998,"15min":1.0589999999999999},"min":{"1min":0.71399999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.145,"5min":1.631,"15min":1.631},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.98799999999999999,"15min":1.008},"min":{"1min":0.77300000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.3320000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.0189999999999999,"15min":1.0449999999999999},"min":{"1min":0.73499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.163,"5min":1.673,"15min":1.6739999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0509999999999999,"15min":1.107},"min":{"1min":0.69799999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.248,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.05,"5min":1.0860000000000001,"15min":1.1120000000000001},"min":{"1min":0.78600000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2649999999999999,"5min":1.73,"15min":1.7769999999999999},"last":1.0649999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509521,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66536,"kb_used_data":13280,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94305304,"statfs":{"total":96636764160,"available":96568631296,"internally_reserved":0,"allocated":13598720,"data_stored":35687478,"data_compressed":4904028,"data_compressed_allocated":6356992,"data_compressed_original":28622848,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.76100000000000001,"15min":0.89100000000000001},"min":{"1min":0.57499999999999996,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1499999999999999,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.091},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.79000000000000004,"15min":0.82599999999999996},"min":{"1min":0.60599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.3340000000000001,"5min":1.542,"15min":1.542},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.91200000000000003,"15min":0.91800000000000004},"min":{"1min":0.58799999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.24,"5min":9.8819999999999997,"15min":9.8819999999999997},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.006,"5min":0.89100000000000001,"15min":0.92700000000000005},"min":{"1min":0.626,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.355,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":1.0169999999999999}]},{"osd":2,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.88400000000000001,"15min":0.89000000000000001},"min":{"1min":0.60899999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.177,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.97399999999999998,"15min":0.94799999999999995},"min":{"1min":0.68200000000000005,"5min":0.38,"15min":0.38},"max":{"1min":1.214,"5min":10.031000000000001,"15min":10.031000000000001},"last":0.95299999999999996}]},{"osd":3,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.91700000000000004,"15min":0.95999999999999996},"min":{"1min":0.72899999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.284,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.97599999999999998,"15min":1.014},"min":{"1min":0.72799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2789999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.0660000000000001}]},{"osd":4,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.006,"15min":0.91900000000000004},"min":{"1min":0.63700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.3759999999999999,"5min":9.968,"15min":9.968},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.96899999999999997,"15min":1.02},"min":{"1min":0.624,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.399,"5min":1.631,"15min":1.8440000000000001},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.006,"15min":0.96099999999999997},"min":{"1min":0.60899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4159999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.1020000000000001,"15min":1.036},"min":{"1min":0.752,"5min":0.371,"15min":0.371},"max":{"1min":1.4550000000000001,"5min":10.09,"15min":10.09},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0629999999999999,"15min":1.103},"min":{"1min":0.77800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.528,"5min":1.7050000000000001,"15min":1.944},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.129,"15min":1.151},"min":{"1min":0.72199999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.7070000000000001,"5min":1.97,"15min":1.97},"last":0.97899999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509522,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77376,"kb_used_data":20024,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94294464,"statfs":{"total":96636764160,"available":96557531136,"internally_reserved":0,"allocated":20504576,"data_stored":54614164,"data_compressed":7702565,"data_compressed_allocated":9973760,"data_compressed_original":44273664,"omap_allocated":1592,"internal_metadata":58718664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,0,0,14],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.628,"15min":0.67400000000000004},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.98099999999999998,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.222},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63100000000000001,"15min":0.61699999999999999},"min":{"1min":0.29499999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.91000000000000003,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.23799999999999999}]},{"osd":1,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61899999999999999,"15min":0.63500000000000001},"min":{"1min":0.31900000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.0920000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73699999999999999,"15min":0.69699999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.0720000000000001,"5min":2.601,"15min":2.601},"last":0.252}]},{"osd":2,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.73099999999999998,"15min":0.73399999999999999},"min":{"1min":0.34399999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.359,"5min":1.573,"15min":1.573},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1339999999999999,"5min":1.51,"15min":1.51},"last":0.27700000000000002}]},{"osd":4,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.86399999999999999,"15min":0.85799999999999998},"min":{"1min":0.46600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.202,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.91400000000000003,"15min":0.93600000000000005},"min":{"1min":0.59399999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4199999999999999,"5min":1.524,"15min":1.524},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.61499999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.252,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":21.260000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.008,"15min":1.028},"min":{"1min":0.47899999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.292,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":7.569}]},{"osd":6,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.98299999999999998,"15min":0.97199999999999998},"min":{"1min":0.72599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.282,"5min":1.512,"15min":1.512},"last":7.2729999999999997},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.02,"15min":1.0489999999999999},"min":{"1min":0.72699999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.327,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":4.2199999999999998}]},{"osd":7,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0600000000000001,"15min":1.1100000000000001},"min":{"1min":0.66700000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.371,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.046,"5min":1.0289999999999999,"15min":1.0580000000000001},"min":{"1min":0.60799999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.341,"5min":1.583,"15min":1.583},"last":0.66000000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509521,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59832,"kb_used_data":14768,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94312008,"statfs":{"total":96636764160,"available":96575496192,"internally_reserved":0,"allocated":15122432,"data_stored":34231216,"data_compressed":4539223,"data_compressed_allocated":6156288,"data_compressed_original":25436160,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63500000000000001,"15min":0.59099999999999997},"min":{"1min":0.38300000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.98699999999999999,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.73999999999999999},"min":{"1min":0.29899999999999999,"5min":0.214,"15min":0.214},"max":{"1min":1.1970000000000001,"5min":1.5920000000000001,"15min":1.9239999999999999},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66400000000000003,"15min":0.68400000000000005},"min":{"1min":0.432,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.88200000000000001,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.696,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.755,"15min":0.78200000000000003},"min":{"1min":0.46800000000000003,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.8400000000000001,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.78200000000000003,"15min":0.77700000000000002},"min":{"1min":0.49099999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.7989999999999999,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.92800000000000005,"15min":0.94799999999999995},"min":{"1min":0.56000000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.107,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.98499999999999999,"15min":0.98199999999999998},"min":{"1min":0.72299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.786,"5min":2.133,"15min":2.133},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.98099999999999998,"15min":1.0069999999999999},"min":{"1min":0.72399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":1.292,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.98099999999999998,"15min":0.98499999999999999},"min":{"1min":0.626,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.274,"5min":2.347,"15min":2.347},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":0.98799999999999999,"15min":1.02},"min":{"1min":0.65400000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.024,"5min":3.024,"15min":3.024},"last":1.089},{"interface":"front","average":{"1min":0.997,"5min":1.0409999999999999,"15min":1.0669999999999999},"min":{"1min":0.67800000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.288,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0600000000000001,"15min":1.0760000000000001},"min":{"1min":0.80200000000000005,"5min":0.497,"15min":0.497},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":1.048},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0860000000000001,"15min":1.109},"min":{"1min":0.76100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3680000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.77400000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509523,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78896,"kb_used_data":21544,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94292944,"statfs":{"total":96636764160,"available":96555974656,"internally_reserved":0,"allocated":22061056,"data_stored":54614568,"data_compressed":7565653,"data_compressed_allocated":10006528,"data_compressed_original":42741760,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.63400000000000001,"15min":0.58599999999999997},"min":{"1min":0.318,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":2.177,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.623,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.224,"15min":0.224},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69099999999999995,"15min":0.65900000000000003},"min":{"1min":0.433,"5min":0.22,"15min":0.22},"max":{"1min":1.4339999999999999,"5min":2.629,"15min":2.629},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.67500000000000004,"15min":0.64500000000000002},"min":{"1min":0.44600000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.70799999999999996,"15min":0.60699999999999998},"min":{"1min":0.38300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.575,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.81399999999999995,"15min":0.749},"min":{"1min":0.39500000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.3690000000000002,"5min":3.375,"15min":3.375},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6859999999999999,"5min":2.601,"15min":2.601},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.05,"5min":0.93899999999999995,"15min":0.92500000000000004},"min":{"1min":0.48699999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.2559999999999998,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.0049999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.92200000000000004,"15min":0.90500000000000003},"min":{"1min":0.76500000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.95999999999999996,"15min":0.94499999999999995},"min":{"1min":0.73299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.758,"5min":2.734,"15min":2.734},"last":0.95899999999999996}]},{"osd":6,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.016,"15min":0.98499999999999999},"min":{"1min":0.77100000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.3149999999999999,"5min":2.681,"15min":2.681},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":0.997,"15min":1.0149999999999999},"min":{"1min":0.81699999999999995,"5min":0.499,"15min":0.499},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.83199999999999996,"5min":0.496,"15min":0.496},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.026},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.03,"15min":0.97399999999999998},"min":{"1min":0.65900000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.831,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":1.0509999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47916,"kb_used_data":8612,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94323924,"statfs":{"total":96636764160,"available":96587698176,"internally_reserved":0,"allocated":8818688,"data_stored":24681186,"data_compressed":3524620,"data_compressed_allocated":4517888,"data_compressed_original":20582400,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.75,"15min":0.88900000000000001},"min":{"1min":0.48099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.05,"5min":1.1579999999999999,"15min":1.3080000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.74099999999999999,"15min":0.83199999999999996},"min":{"1min":0.57099999999999995,"5min":0.318,"15min":0.318},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81200000000000006,"15min":0.875},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.149,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.876,"5min":0.80500000000000005,"15min":0.86299999999999999},"min":{"1min":0.50600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.097,"5min":1.246,"15min":1.246},"last":0.73699999999999999}]},{"osd":2,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.57699999999999996,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92800000000000005,"15min":0.96899999999999997},"min":{"1min":0.53600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1379999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.2889999999999999}]},{"osd":3,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.80600000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.651,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.68600000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2130000000000001,"5min":3.6280000000000001,"15min":3.6280000000000001},"last":1.1839999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95199999999999996,"15min":0.93600000000000005},"min":{"1min":0.47899999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.228},{"interface":"front","average":{"1min":0.89000000000000001,"5min":1.008,"15min":1.054},"min":{"1min":0.58999999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":2.5299999999999998}]},{"osd":6,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.92000000000000004,"15min":1.006},"min":{"1min":0.61599999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.1890000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.88},{"interface":"front","average":{"1min":1.022,"5min":1.0329999999999999,"15min":1.0589999999999999},"min":{"1min":0.56399999999999995,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.5980000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.633}]},{"osd":7,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.101,"15min":1.141},"min":{"1min":0.72999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.246,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":2.4470000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.1180000000000001,"15min":1.1479999999999999},"min":{"1min":0.63300000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5409999999999999,"5min":3.9910000000000001,"15min":3.9910000000000001},"last":1.538}]}]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":8536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":8740864,"data_stored":24679416,"data_compressed":3602361,"data_compressed_allocated":4526080,"data_compressed_original":20631552,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.56499999999999995},"min":{"1min":0.42499999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.93799999999999994,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.64400000000000002,"15min":0.69699999999999995},"min":{"1min":0.45200000000000001,"5min":0.193,"15min":0.193},"max":{"1min":1.034,"5min":1.347,"15min":1.347},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67600000000000005,"15min":0.67200000000000004},"min":{"1min":0.53300000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.024,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.746},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68000000000000005,"15min":0.66600000000000004},"min":{"1min":0.433,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.022,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.67300000000000004,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1140000000000001,"5min":1.29,"15min":1.29},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.65800000000000003,"15min":0.64200000000000002},"min":{"1min":0.48799999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0149999999999999,"5min":1.034,"15min":1.034},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.91800000000000004,"15min":0.95299999999999996},"min":{"1min":0.79100000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.1930000000000001,"5min":2.456,"15min":2.456},"last":0.871},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.85099999999999998,"15min":0.873},"min":{"1min":0.57099999999999995,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2889999999999999,"5min":1.454,"15min":1.6950000000000001},"last":1.0029999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.96899999999999997,"15min":0.94399999999999995},"min":{"1min":0.78500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4279999999999999,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.93500000000000005,"15min":0.98699999999999999},"min":{"1min":0.81999999999999995,"5min":0.373,"15min":0.373},"max":{"1min":1.234,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.98199999999999998}]},{"osd":6,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.80500000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3440000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0329999999999999,"15min":0.98099999999999998},"min":{"1min":0.84799999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.506,"5min":3.391,"15min":3.391},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.99099999999999999,"15min":1.0289999999999999},"min":{"1min":0.84999999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.25,"5min":1.4259999999999999,"15min":1.4990000000000001},"last":1.024},{"interface":"front","average":{"1min":1.052,"5min":0.98899999999999999,"15min":0.97499999999999998},"min":{"1min":0.71199999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.3160000000000001,"5min":1.748,"15min":1.748},"last":0.82999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21827584,"data_stored":54529566,"data_compressed":7565653,"data_compressed_allocated":10006528,"data_compressed_original":42741760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14823424,"data_stored":33555846,"data_compressed":4506038,"data_compressed_allocated":6111232,"data_compressed_original":24862720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8507392,"data_stored":24594414,"data_compressed":3602361,"data_compressed_allocated":4526080,"data_compressed_original":20631552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20271104,"data_stored":54529162,"data_compressed":7702565,"data_compressed_allocated":9973760,"data_compressed_original":44273664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8585216,"data_stored":24596184,"data_compressed":3524620,"data_compressed_allocated":4517888,"data_compressed_original":20582400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13299712,"data_stored":35012108,"data_compressed":4870843,"data_compressed_allocated":6311936,"data_compressed_original":28049408,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7704576,"data_stored":20974924,"data_compressed":3027129,"data_compressed_allocated":3776512,"data_compressed_original":17063936,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5578752,"data_stored":14040280,"data_compressed":1836351,"data_compressed_allocated":2379776,"data_compressed_original":10878976,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T05:01:14.085 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T05:01:14.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.238+0000 7f1fd5be4640 1 Processor -- start 2024-04-18T05:01:14.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.238+0000 7f1fd5be4640 1 -- start start 2024-04-18T05:01:14.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fd5be4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1fd0151210 0x7f1fd00c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fd5be4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1fd00c1db0 0x7f1fd00ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fd5be4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd0157150 con 0x7f1fd00ca840 2024-04-18T05:01:14.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fd5be4640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd0157430 con 0x7f1fd0151210 2024-04-18T05:01:14.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fd5be4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd0157710 con 0x7f1fd00c1db0 2024-04-18T05:01:14.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fcf7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1fd0151210 0x7f1fd00c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fcf7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1fd0151210 0x7f1fd00c1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40106/0 (socket says 172.21.15.96:40106) 2024-04-18T05:01:14.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fcf7fe640 1 -- 172.21.15.96:0/844574734 learned_addr learned my addr 172.21.15.96:0/844574734 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:14.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fceffd640 1 --2- 172.21.15.96:0/844574734 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1fd00c1db0 0x7f1fd00ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fcf7fe640 1 -- 172.21.15.96:0/844574734 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1fd00c1db0 msgr2=0x7f1fd00ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:14.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fcf7fe640 1 --2- 172.21.15.96:0/844574734 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1fd00c1db0 0x7f1fd00ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fcf7fe640 1 -- 172.21.15.96:0/844574734 >> v1:172.21.15.96:6789/0 conn(0x7f1fd00ca840 legacy=0x7f1fd015a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fcf7fe640 1 -- 172.21.15.96:0/844574734 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd01579f0 con 0x7f1fd0151210 2024-04-18T05:01:14.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fceffd640 1 --2- 172.21.15.96:0/844574734 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1fd00c1db0 0x7f1fd00ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:01:14.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fcf7fe640 1 --2- 172.21.15.96:0/844574734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fd0151210 0x7f1fd00c1870 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009870 tx=0x7f1fc001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d524fb6689598a40 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:14.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fce7fc640 1 -- 172.21.15.96:0/844574734 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc00a8a50 con 0x7f1fd0151210 2024-04-18T05:01:14.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fce7fc640 1 -- 172.21.15.96:0/844574734 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc00a8bb0 con 0x7f1fd0151210 2024-04-18T05:01:14.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fce7fc640 1 -- 172.21.15.96:0/844574734 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc00b0440 con 0x7f1fd0151210 2024-04-18T05:01:14.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fd5be4640 1 -- 172.21.15.96:0/844574734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fd0151210 msgr2=0x7f1fd00c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fd5be4640 1 --2- 172.21.15.96:0/844574734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fd0151210 0x7f1fd00c1870 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009870 tx=0x7f1fc001ed50 comp rx=0 tx=0).stop 2024-04-18T05:01:14.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fd5be4640 1 -- 172.21.15.96:0/844574734 shutdown_connections 2024-04-18T05:01:14.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fd5be4640 1 --2- 172.21.15.96:0/844574734 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1fd00c1db0 0x7f1fd00ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fd5be4640 1 --2- 172.21.15.96:0/844574734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fd0151210 0x7f1fd00c1870 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fd5be4640 1 -- 172.21.15.96:0/844574734 >> 172.21.15.96:0/844574734 conn(0x7f1fd006c750 msgr2=0x7f1fd00c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:14.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fd5be4640 1 -- 172.21.15.96:0/844574734 shutdown_connections 2024-04-18T05:01:14.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.242+0000 7f1fd5be4640 1 -- 172.21.15.96:0/844574734 wait complete. 2024-04-18T05:01:14.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fd5be4640 1 Processor -- start 2024-04-18T05:01:14.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fd5be4640 1 -- start start 2024-04-18T05:01:14.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fd5be4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fd00c1db0 0x7f1fd01427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fd5be4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fd00ca840 0x7f1fd00c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fd5be4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1fd0151210 0x7f1fd01f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fd5be4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00ca6d0 con 0x7f1fd00ca840 2024-04-18T05:01:14.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fd5be4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd0143f60 con 0x7f1fd00c1db0 2024-04-18T05:01:14.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fd5be4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00c9b90 con 0x7f1fd0151210 2024-04-18T05:01:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fceffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fd00ca840 0x7f1fd00c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fceffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fd00ca840 0x7f1fd00c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40116/0 (socket says 172.21.15.96:40116) 2024-04-18T05:01:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fceffd640 1 -- 172.21.15.96:0/3629668149 learned_addr learned my addr 172.21.15.96:0/3629668149 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fcf7fe640 1 --2- 172.21.15.96:0/3629668149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fd00c1db0 0x7f1fd01427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fcffff640 1 --2- 172.21.15.96:0/3629668149 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1fd0151210 0x7f1fd01f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fceffd640 1 -- 172.21.15.96:0/3629668149 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1fd0151210 msgr2=0x7f1fd01f22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fceffd640 1 --2- 172.21.15.96:0/3629668149 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1fd0151210 0x7f1fd01f22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fceffd640 1 -- 172.21.15.96:0/3629668149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fd00c1db0 msgr2=0x7f1fd01427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fceffd640 1 --2- 172.21.15.96:0/3629668149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fd00c1db0 0x7f1fd01427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fceffd640 1 -- 172.21.15.96:0/3629668149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc00094d0 con 0x7f1fd00ca840 2024-04-18T05:01:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fceffd640 1 --2- 172.21.15.96:0/3629668149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fd00ca840 0x7f1fd00c8c90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400c7f0 tx=0x7f1fc400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fb7fff640 1 -- 172.21.15.96:0/3629668149 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc40077c0 con 0x7f1fd00ca840 2024-04-18T05:01:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fb7fff640 1 -- 172.21.15.96:0/3629668149 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc4007920 con 0x7f1fd00ca840 2024-04-18T05:01:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fd5be4640 1 -- 172.21.15.96:0/3629668149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd0156f20 con 0x7f1fd00ca840 2024-04-18T05:01:14.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fb7fff640 1 -- 172.21.15.96:0/3629668149 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4007cd0 con 0x7f1fd00ca840 2024-04-18T05:01:14.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fd5be4640 1 -- 172.21.15.96:0/3629668149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd00ca110 con 0x7f1fd00ca840 2024-04-18T05:01:14.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.246+0000 7f1fd5be4640 1 -- 172.21.15.96:0/3629668149 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd0067050 con 0x7f1fd00ca840 2024-04-18T05:01:14.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.250+0000 7f1fb7fff640 1 -- 172.21.15.96:0/3629668149 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1fc40113f0 con 0x7f1fd00ca840 2024-04-18T05:01:14.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.250+0000 7f1fb7fff640 1 --2- 172.21.15.96:0/3629668149 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1fbc066690 0x7f1fbc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.250+0000 7f1fcf7fe640 1 --2- 172.21.15.96:0/3629668149 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1fbc066690 0x7f1fbc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.250+0000 7f1fb7fff640 1 -- 172.21.15.96:0/3629668149 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1fc40844e0 con 0x7f1fd00ca840 2024-04-18T05:01:14.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.250+0000 7f1fcf7fe640 1 --2- 172.21.15.96:0/3629668149 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1fbc066690 0x7f1fbc068b50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00b2000 tx=0x7f1fc00aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:14.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.254+0000 7f1fb7fff640 1 -- 172.21.15.96:0/3629668149 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1fc4051830 con 0x7f1fd00ca840 2024-04-18T05:01:14.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.410+0000 7f1fd5be4640 1 -- 172.21.15.96:0/3629668149 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1fd0156da0 con 0x7f1fbc066690 2024-04-18T05:01:14.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.418+0000 7f1fb7fff640 1 -- 172.21.15.96:0/3629668149 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290198 (secure 0 0 0) 0x7f1fc00b9420 con 0x7f1fbc066690 2024-04-18T05:01:14.423 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T05:01:14.424 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T05:01:14.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.422+0000 7f1fd5be4640 1 -- 172.21.15.96:0/3629668149 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1fbc066690 msgr2=0x7f1fbc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.422+0000 7f1fd5be4640 1 --2- 172.21.15.96:0/3629668149 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1fbc066690 0x7f1fbc068b50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00b2000 tx=0x7f1fc00aa070 comp rx=0 tx=0).stop 2024-04-18T05:01:14.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.422+0000 7f1fd5be4640 1 -- 172.21.15.96:0/3629668149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fd00ca840 msgr2=0x7f1fd00c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.422+0000 7f1fd5be4640 1 --2- 172.21.15.96:0/3629668149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fd00ca840 0x7f1fd00c8c90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400c7f0 tx=0x7f1fc400ccb0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.422+0000 7f1fd5be4640 1 -- 172.21.15.96:0/3629668149 shutdown_connections 2024-04-18T05:01:14.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.422+0000 7f1fd5be4640 1 --2- 172.21.15.96:0/3629668149 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f1fbc066690 0x7f1fbc068b50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.422+0000 7f1fd5be4640 1 --2- 172.21.15.96:0/3629668149 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1fd0151210 0x7f1fd01f22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.422+0000 7f1fd5be4640 1 --2- 172.21.15.96:0/3629668149 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fd00ca840 0x7f1fd00c8c90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.422+0000 7f1fd5be4640 1 --2- 172.21.15.96:0/3629668149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fd00c1db0 0x7f1fd01427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.422+0000 7f1fd5be4640 1 -- 172.21.15.96:0/3629668149 >> 172.21.15.96:0/3629668149 conn(0x7f1fd006c750 msgr2=0x7f1fd00c5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:14.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.422+0000 7f1fd5be4640 1 -- 172.21.15.96:0/3629668149 shutdown_connections 2024-04-18T05:01:14.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.422+0000 7f1fd5be4640 1 -- 172.21.15.96:0/3629668149 wait complete. 2024-04-18T05:01:14.442 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-04-18T05:01:12.704812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":131506610,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":2961,"num_read_kb":1326719,"num_write":31940,"num_write_kb":4643491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35450,"ondisk_log_size":35450,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":454048,"kb_used_data":100192,"kb_used_omap":12,"kb_used_meta":353779,"kb_avail":754520672,"statfs":{"total":773094113280,"available":772629168128,"internally_reserved":0,"allocated":102596608,"data_stored":263693236,"data_compressed":36701930,"data_compressed_allocated":47693824,"data_compressed_original":210231296,"omap_allocated":12744,"internal_metadata":362270264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,0,0,14],"upper_bound":128},"perf_stat":{"commit_latency_ms":70,"apply_latency_ms":70,"commit_latency_ns":70000000,"apply_latency_ns":70000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004104"},"pg_stats":[{"pgid":"3.3f","version":"23'405","reported_seq":439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374066+0000","last_change":"2024-04-18T04:54:41.199306+0000","last_active":"2024-04-18T05:01:07.374066+0000","last_peered":"2024-04-18T05:01:07.374066+0000","last_clean":"2024-04-18T05:01:07.374066+0000","last_became_active":"2024-04-18T04:54:41.199046+0000","last_became_peered":"2024-04-18T04:54:41.199046+0000","last_unstale":"2024-04-18T05:01:07.374066+0000","last_undegraded":"2024-04-18T05:01:07.374066+0000","last_fullsized":"2024-04-18T05:01:07.374066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9249,"num_write":376,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"23'459","reported_seq":499,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.407426+0000","last_change":"2024-04-18T04:54:41.200447+0000","last_active":"2024-04-18T05:01:07.407426+0000","last_peered":"2024-04-18T05:01:07.407426+0000","last_clean":"2024-04-18T05:01:07.407426+0000","last_became_active":"2024-04-18T04:54:41.200136+0000","last_became_peered":"2024-04-18T04:54:41.200136+0000","last_unstale":"2024-04-18T05:01:07.407426+0000","last_undegraded":"2024-04-18T05:01:07.407426+0000","last_fullsized":"2024-04-18T05:01:07.407426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12666,"num_write":430,"num_write_kb":97067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"23'410","reported_seq":455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.396643+0000","last_change":"2024-04-18T04:54:41.185987+0000","last_active":"2024-04-18T05:01:07.396643+0000","last_peered":"2024-04-18T05:01:07.396643+0000","last_clean":"2024-04-18T05:01:07.396643+0000","last_became_active":"2024-04-18T04:54:41.185206+0000","last_became_peered":"2024-04-18T04:54:41.185206+0000","last_unstale":"2024-04-18T05:01:07.396643+0000","last_undegraded":"2024-04-18T05:01:07.396643+0000","last_fullsized":"2024-04-18T05:01:07.396643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":29819,"num_write":382,"num_write_kb":108666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"23'394","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.380955+0000","last_change":"2024-04-18T04:54:41.177487+0000","last_active":"2024-04-18T05:01:07.380955+0000","last_peered":"2024-04-18T05:01:07.380955+0000","last_clean":"2024-04-18T05:01:07.380955+0000","last_became_active":"2024-04-18T04:54:41.177217+0000","last_became_peered":"2024-04-18T04:54:41.177217+0000","last_unstale":"2024-04-18T05:01:07.380955+0000","last_undegraded":"2024-04-18T05:01:07.380955+0000","last_fullsized":"2024-04-18T05:01:07.380955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:08.067252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22571,"num_write":356,"num_write_kb":80073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"23'390","reported_seq":427,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.400041+0000","last_change":"2024-04-18T04:54:41.186573+0000","last_active":"2024-04-18T05:01:07.400041+0000","last_peered":"2024-04-18T05:01:07.400041+0000","last_clean":"2024-04-18T05:01:07.400041+0000","last_became_active":"2024-04-18T04:54:41.186027+0000","last_became_peered":"2024-04-18T04:54:41.186027+0000","last_unstale":"2024-04-18T05:01:07.400041+0000","last_undegraded":"2024-04-18T05:01:07.400041+0000","last_fullsized":"2024-04-18T05:01:07.400041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13089,"num_write":365,"num_write_kb":22615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"23'374","reported_seq":394,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.378663+0000","last_change":"2024-04-18T04:54:41.177550+0000","last_active":"2024-04-18T05:01:07.378663+0000","last_peered":"2024-04-18T05:01:07.378663+0000","last_clean":"2024-04-18T05:01:07.378663+0000","last_became_active":"2024-04-18T04:54:41.177215+0000","last_became_peered":"2024-04-18T04:54:41.177215+0000","last_unstale":"2024-04-18T05:01:07.378663+0000","last_undegraded":"2024-04-18T05:01:07.378663+0000","last_fullsized":"2024-04-18T05:01:07.378663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:26.266600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":350,"num_write_kb":36922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"23'405","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374455+0000","last_change":"2024-04-18T04:54:41.178605+0000","last_active":"2024-04-18T05:01:07.374455+0000","last_peered":"2024-04-18T05:01:07.374455+0000","last_clean":"2024-04-18T05:01:07.374455+0000","last_became_active":"2024-04-18T04:54:41.178094+0000","last_became_peered":"2024-04-18T04:54:41.178094+0000","last_unstale":"2024-04-18T05:01:07.374455+0000","last_undegraded":"2024-04-18T05:01:07.374455+0000","last_fullsized":"2024-04-18T05:01:07.374455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20531,"num_write":378,"num_write_kb":59118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"23'401","reported_seq":438,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.414199+0000","last_change":"2024-04-18T04:54:41.193174+0000","last_active":"2024-04-18T05:01:07.414199+0000","last_peered":"2024-04-18T05:01:07.414199+0000","last_clean":"2024-04-18T05:01:07.414199+0000","last_became_active":"2024-04-18T04:54:41.192678+0000","last_became_peered":"2024-04-18T04:54:41.192678+0000","last_unstale":"2024-04-18T05:01:07.414199+0000","last_undegraded":"2024-04-18T05:01:07.414199+0000","last_fullsized":"2024-04-18T05:01:07.414199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13567,"num_write":364,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"23'436","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.364148+0000","last_change":"2024-04-18T04:54:41.198121+0000","last_active":"2024-04-18T05:01:07.364148+0000","last_peered":"2024-04-18T05:01:07.364148+0000","last_clean":"2024-04-18T05:01:07.364148+0000","last_became_active":"2024-04-18T04:54:41.197832+0000","last_became_peered":"2024-04-18T04:54:41.197832+0000","last_unstale":"2024-04-18T05:01:07.364148+0000","last_undegraded":"2024-04-18T05:01:07.364148+0000","last_fullsized":"2024-04-18T05:01:07.364148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.835581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28521,"num_write":411,"num_write_kb":104022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"23'396","reported_seq":437,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.379998+0000","last_change":"2024-04-18T04:54:41.183032+0000","last_active":"2024-04-18T05:01:07.379998+0000","last_peered":"2024-04-18T05:01:07.379998+0000","last_clean":"2024-04-18T05:01:07.379998+0000","last_became_active":"2024-04-18T04:54:41.182698+0000","last_became_peered":"2024-04-18T04:54:41.182698+0000","last_unstale":"2024-04-18T05:01:07.379998+0000","last_undegraded":"2024-04-18T05:01:07.379998+0000","last_fullsized":"2024-04-18T05:01:07.379998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13914,"num_write":350,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"23'379","reported_seq":427,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377181+0000","last_change":"2024-04-18T04:54:41.187831+0000","last_active":"2024-04-18T05:01:07.377181+0000","last_peered":"2024-04-18T05:01:07.377181+0000","last_clean":"2024-04-18T05:01:07.377181+0000","last_became_active":"2024-04-18T04:54:41.187360+0000","last_became_peered":"2024-04-18T04:54:41.187360+0000","last_unstale":"2024-04-18T05:01:07.377181+0000","last_undegraded":"2024-04-18T05:01:07.377181+0000","last_fullsized":"2024-04-18T05:01:07.377181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18312,"num_write":357,"num_write_kb":34101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"23'361","reported_seq":410,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377628+0000","last_change":"2024-04-18T04:54:41.188641+0000","last_active":"2024-04-18T05:01:07.377628+0000","last_peered":"2024-04-18T05:01:07.377628+0000","last_clean":"2024-04-18T05:01:07.377628+0000","last_became_active":"2024-04-18T04:54:41.188281+0000","last_became_peered":"2024-04-18T04:54:41.188281+0000","last_unstale":"2024-04-18T05:01:07.377628+0000","last_undegraded":"2024-04-18T05:01:07.377628+0000","last_fullsized":"2024-04-18T05:01:07.377628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21304,"num_write":338,"num_write_kb":54980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"23'375","reported_seq":405,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394838+0000","last_change":"2024-04-18T04:54:41.194578+0000","last_active":"2024-04-18T05:01:07.394838+0000","last_peered":"2024-04-18T05:01:07.394838+0000","last_clean":"2024-04-18T05:01:07.394838+0000","last_became_active":"2024-04-18T04:54:41.190882+0000","last_became_peered":"2024-04-18T04:54:41.190882+0000","last_unstale":"2024-04-18T05:01:07.394838+0000","last_undegraded":"2024-04-18T05:01:07.394838+0000","last_fullsized":"2024-04-18T05:01:07.394838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:45:52.041196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7725,"num_write":337,"num_write_kb":21712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"23'417","reported_seq":490,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.393436+0000","last_change":"2024-04-18T04:54:41.190210+0000","last_active":"2024-04-18T05:01:07.393436+0000","last_peered":"2024-04-18T05:01:07.393436+0000","last_clean":"2024-04-18T05:01:07.393436+0000","last_became_active":"2024-04-18T04:54:41.189813+0000","last_became_peered":"2024-04-18T04:54:41.189813+0000","last_unstale":"2024-04-18T05:01:07.393436+0000","last_undegraded":"2024-04-18T05:01:07.393436+0000","last_fullsized":"2024-04-18T05:01:07.393436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:38:02.632458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":28320,"num_write":390,"num_write_kb":71764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"23'445","reported_seq":532,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.406236+0000","last_change":"2024-04-18T04:54:41.183027+0000","last_active":"2024-04-18T05:01:07.406236+0000","last_peered":"2024-04-18T05:01:07.406236+0000","last_clean":"2024-04-18T05:01:07.406236+0000","last_became_active":"2024-04-18T04:54:41.182713+0000","last_became_peered":"2024-04-18T04:54:41.182713+0000","last_unstale":"2024-04-18T05:01:07.406236+0000","last_undegraded":"2024-04-18T05:01:07.406236+0000","last_fullsized":"2024-04-18T05:01:07.406236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":36644,"num_write":412,"num_write_kb":104908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"23'442","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.364940+0000","last_change":"2024-04-18T04:54:41.186060+0000","last_active":"2024-04-18T05:01:07.364940+0000","last_peered":"2024-04-18T05:01:07.364940+0000","last_clean":"2024-04-18T05:01:07.364940+0000","last_became_active":"2024-04-18T04:54:41.185803+0000","last_became_peered":"2024-04-18T04:54:41.185803+0000","last_unstale":"2024-04-18T05:01:07.364940+0000","last_undegraded":"2024-04-18T05:01:07.364940+0000","last_fullsized":"2024-04-18T05:01:07.364940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:48:04.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21979,"num_write":411,"num_write_kb":59643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"23'407","reported_seq":466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.370476+0000","last_change":"2024-04-18T04:54:41.200802+0000","last_active":"2024-04-18T05:01:07.370476+0000","last_peered":"2024-04-18T05:01:07.370476+0000","last_clean":"2024-04-18T05:01:07.370476+0000","last_became_active":"2024-04-18T04:54:41.198404+0000","last_became_peered":"2024-04-18T04:54:41.198404+0000","last_unstale":"2024-04-18T05:01:07.370476+0000","last_undegraded":"2024-04-18T05:01:07.370476+0000","last_fullsized":"2024-04-18T05:01:07.370476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:56.686481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22314,"num_write":375,"num_write_kb":43056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"23'414","reported_seq":469,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.382501+0000","last_change":"2024-04-18T04:54:41.189568+0000","last_active":"2024-04-18T05:01:07.382501+0000","last_peered":"2024-04-18T05:01:07.382501+0000","last_clean":"2024-04-18T05:01:07.382501+0000","last_became_active":"2024-04-18T04:54:41.188139+0000","last_became_peered":"2024-04-18T04:54:41.188139+0000","last_unstale":"2024-04-18T05:01:07.382501+0000","last_undegraded":"2024-04-18T05:01:07.382501+0000","last_fullsized":"2024-04-18T05:01:07.382501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21874,"num_write":387,"num_write_kb":84204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"23'431","reported_seq":505,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.375011+0000","last_change":"2024-04-18T04:54:41.197901+0000","last_active":"2024-04-18T05:01:07.375011+0000","last_peered":"2024-04-18T05:01:07.375011+0000","last_clean":"2024-04-18T05:01:07.375011+0000","last_became_active":"2024-04-18T04:54:41.197235+0000","last_became_peered":"2024-04-18T04:54:41.197235+0000","last_unstale":"2024-04-18T05:01:07.375011+0000","last_undegraded":"2024-04-18T05:01:07.375011+0000","last_fullsized":"2024-04-18T05:01:07.375011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:41:20.213202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40070,"num_write":398,"num_write_kb":116642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"23'437","reported_seq":508,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377558+0000","last_change":"2024-04-18T04:54:41.188440+0000","last_active":"2024-04-18T05:01:07.377558+0000","last_peered":"2024-04-18T05:01:07.377558+0000","last_clean":"2024-04-18T05:01:07.377558+0000","last_became_active":"2024-04-18T04:54:41.187925+0000","last_became_peered":"2024-04-18T04:54:41.187925+0000","last_unstale":"2024-04-18T05:01:07.377558+0000","last_undegraded":"2024-04-18T05:01:07.377558+0000","last_fullsized":"2024-04-18T05:01:07.377558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27418,"num_write":411,"num_write_kb":67043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"23'413","reported_seq":488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.383040+0000","last_change":"2024-04-18T04:54:41.179672+0000","last_active":"2024-04-18T05:01:07.383040+0000","last_peered":"2024-04-18T05:01:07.383040+0000","last_clean":"2024-04-18T05:01:07.383040+0000","last_became_active":"2024-04-18T04:54:41.178963+0000","last_became_peered":"2024-04-18T04:54:41.178963+0000","last_unstale":"2024-04-18T05:01:07.383040+0000","last_undegraded":"2024-04-18T05:01:07.383040+0000","last_fullsized":"2024-04-18T05:01:07.383040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:56:31.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32437,"num_write":394,"num_write_kb":88243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"23'442","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.366521+0000","last_change":"2024-04-18T04:54:41.182902+0000","last_active":"2024-04-18T05:01:07.366521+0000","last_peered":"2024-04-18T05:01:07.366521+0000","last_clean":"2024-04-18T05:01:07.366521+0000","last_became_active":"2024-04-18T04:54:41.182664+0000","last_became_peered":"2024-04-18T04:54:41.182664+0000","last_unstale":"2024-04-18T05:01:07.366521+0000","last_undegraded":"2024-04-18T05:01:07.366521+0000","last_fullsized":"2024-04-18T05:01:07.366521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:56.408926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34086,"num_write":411,"num_write_kb":96499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"23'434","reported_seq":502,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.406363+0000","last_change":"2024-04-18T04:54:41.187578+0000","last_active":"2024-04-18T05:01:07.406363+0000","last_peered":"2024-04-18T05:01:07.406363+0000","last_clean":"2024-04-18T05:01:07.406363+0000","last_became_active":"2024-04-18T04:54:41.186881+0000","last_became_peered":"2024-04-18T04:54:41.186881+0000","last_unstale":"2024-04-18T05:01:07.406363+0000","last_undegraded":"2024-04-18T05:01:07.406363+0000","last_fullsized":"2024-04-18T05:01:07.406363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:27.817916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":24295,"num_write":395,"num_write_kb":96064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"23'465","reported_seq":582,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.408101+0000","last_change":"2024-04-18T04:54:41.193206+0000","last_active":"2024-04-18T05:01:07.408101+0000","last_peered":"2024-04-18T05:01:07.408101+0000","last_clean":"2024-04-18T05:01:07.408101+0000","last_became_active":"2024-04-18T04:54:41.192740+0000","last_became_peered":"2024-04-18T04:54:41.192740+0000","last_unstale":"2024-04-18T05:01:07.408101+0000","last_undegraded":"2024-04-18T05:01:07.408101+0000","last_fullsized":"2024-04-18T05:01:07.408101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:51:34.311826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61562,"num_write":441,"num_write_kb":100539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"23'390","reported_seq":438,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.411713+0000","last_change":"2024-04-18T04:54:41.192785+0000","last_active":"2024-04-18T05:01:07.411713+0000","last_peered":"2024-04-18T05:01:07.411713+0000","last_clean":"2024-04-18T05:01:07.411713+0000","last_became_active":"2024-04-18T04:54:41.192280+0000","last_became_peered":"2024-04-18T04:54:41.192280+0000","last_unstale":"2024-04-18T05:01:07.411713+0000","last_undegraded":"2024-04-18T05:01:07.411713+0000","last_fullsized":"2024-04-18T05:01:07.411713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18903,"num_write":377,"num_write_kb":34298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"23'490","reported_seq":558,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.378688+0000","last_change":"2024-04-18T04:54:41.193920+0000","last_active":"2024-04-18T05:01:07.378688+0000","last_peered":"2024-04-18T05:01:07.378688+0000","last_clean":"2024-04-18T05:01:07.378688+0000","last_became_active":"2024-04-18T04:54:41.193660+0000","last_became_peered":"2024-04-18T04:54:41.193660+0000","last_unstale":"2024-04-18T05:01:07.378688+0000","last_undegraded":"2024-04-18T05:01:07.378688+0000","last_fullsized":"2024-04-18T05:01:07.378688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:22.072498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26760,"num_write":458,"num_write_kb":125465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"23'432","reported_seq":525,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.392934+0000","last_change":"2024-04-18T04:54:41.190298+0000","last_active":"2024-04-18T05:01:07.392934+0000","last_peered":"2024-04-18T05:01:07.392934+0000","last_clean":"2024-04-18T05:01:07.392934+0000","last_became_active":"2024-04-18T04:54:41.189374+0000","last_became_peered":"2024-04-18T04:54:41.189374+0000","last_unstale":"2024-04-18T05:01:07.392934+0000","last_undegraded":"2024-04-18T05:01:07.392934+0000","last_fullsized":"2024-04-18T05:01:07.392934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43719,"num_write":406,"num_write_kb":145399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"23'384","reported_seq":437,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394954+0000","last_change":"2024-04-18T04:54:41.190403+0000","last_active":"2024-04-18T05:01:07.394954+0000","last_peered":"2024-04-18T05:01:07.394954+0000","last_clean":"2024-04-18T05:01:07.394954+0000","last_became_active":"2024-04-18T04:54:41.189660+0000","last_became_peered":"2024-04-18T04:54:41.189660+0000","last_unstale":"2024-04-18T05:01:07.394954+0000","last_undegraded":"2024-04-18T05:01:07.394954+0000","last_fullsized":"2024-04-18T05:01:07.394954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:34.259279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17737,"num_write":357,"num_write_kb":75727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"23'427","reported_seq":500,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.399293+0000","last_change":"2024-04-18T04:54:41.187370+0000","last_active":"2024-04-18T05:01:07.399293+0000","last_peered":"2024-04-18T05:01:07.399293+0000","last_clean":"2024-04-18T05:01:07.399293+0000","last_became_active":"2024-04-18T04:54:41.186901+0000","last_became_peered":"2024-04-18T04:54:41.186901+0000","last_unstale":"2024-04-18T05:01:07.399293+0000","last_undegraded":"2024-04-18T05:01:07.399293+0000","last_fullsized":"2024-04-18T05:01:07.399293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30499,"num_write":394,"num_write_kb":84601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"23'468","reported_seq":510,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.402883+0000","last_change":"2024-04-18T04:54:41.192719+0000","last_active":"2024-04-18T05:01:07.402883+0000","last_peered":"2024-04-18T05:01:07.402883+0000","last_clean":"2024-04-18T05:01:07.402883+0000","last_became_active":"2024-04-18T04:54:41.192114+0000","last_became_peered":"2024-04-18T04:54:41.192114+0000","last_unstale":"2024-04-18T05:01:07.402883+0000","last_undegraded":"2024-04-18T05:01:07.402883+0000","last_fullsized":"2024-04-18T05:01:07.402883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:33:21.965783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13784,"num_write":434,"num_write_kb":79847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"23'421","reported_seq":471,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.379914+0000","last_change":"2024-04-18T04:54:41.186276+0000","last_active":"2024-04-18T05:01:07.379914+0000","last_peered":"2024-04-18T05:01:07.379914+0000","last_clean":"2024-04-18T05:01:07.379914+0000","last_became_active":"2024-04-18T04:54:41.185915+0000","last_became_peered":"2024-04-18T04:54:41.185915+0000","last_unstale":"2024-04-18T05:01:07.379914+0000","last_undegraded":"2024-04-18T05:01:07.379914+0000","last_fullsized":"2024-04-18T05:01:07.379914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":22283,"num_write":389,"num_write_kb":42482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"23'415","reported_seq":485,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.395003+0000","last_change":"2024-04-18T04:54:41.190283+0000","last_active":"2024-04-18T05:01:07.395003+0000","last_peered":"2024-04-18T05:01:07.395003+0000","last_clean":"2024-04-18T05:01:07.395003+0000","last_became_active":"2024-04-18T04:54:41.189892+0000","last_became_peered":"2024-04-18T04:54:41.189892+0000","last_unstale":"2024-04-18T05:01:07.395003+0000","last_undegraded":"2024-04-18T05:01:07.395003+0000","last_fullsized":"2024-04-18T05:01:07.395003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:53.175178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36029,"num_write":387,"num_write_kb":59223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'420","reported_seq":479,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.410442+0000","last_change":"2024-04-18T04:54:41.187326+0000","last_active":"2024-04-18T05:01:07.410442+0000","last_peered":"2024-04-18T05:01:07.410442+0000","last_clean":"2024-04-18T05:01:07.410442+0000","last_became_active":"2024-04-18T04:54:41.187001+0000","last_became_peered":"2024-04-18T04:54:41.187001+0000","last_unstale":"2024-04-18T05:01:07.410442+0000","last_undegraded":"2024-04-18T05:01:07.410442+0000","last_fullsized":"2024-04-18T05:01:07.410442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19127,"num_write":391,"num_write_kb":83892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'97","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.985326+0000","last_change":"2024-04-18T04:54:40.824658+0000","last_active":"2024-04-18T05:00:02.985326+0000","last_peered":"2024-04-18T05:00:02.985326+0000","last_clean":"2024-04-18T05:00:02.985326+0000","last_became_active":"2024-04-18T04:54:40.823652+0000","last_became_peered":"2024-04-18T04:54:40.823652+0000","last_unstale":"2024-04-18T05:00:02.985326+0000","last_undegraded":"2024-04-18T05:00:02.985326+0000","last_fullsized":"2024-04-18T05:00:02.985326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195462,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"23'366","reported_seq":402,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.382420+0000","last_change":"2024-04-18T04:55:39.828560+0000","last_active":"2024-04-18T05:01:07.382420+0000","last_peered":"2024-04-18T05:01:07.382420+0000","last_clean":"2024-04-18T05:01:07.382420+0000","last_became_active":"2024-04-18T04:55:39.827671+0000","last_became_peered":"2024-04-18T04:55:39.827671+0000","last_unstale":"2024-04-18T05:01:07.382420+0000","last_undegraded":"2024-04-18T05:01:07.382420+0000","last_fullsized":"2024-04-18T05:01:07.382420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:24:21.418171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13158,"num_write":336,"num_write_kb":38014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'539","reported_seq":553,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:00.987547+0000","last_change":"2024-04-18T04:54:40.803244+0000","last_active":"2024-04-18T05:00:00.987547+0000","last_peered":"2024-04-18T05:00:00.987547+0000","last_clean":"2024-04-18T05:00:00.987547+0000","last_became_active":"2024-04-18T04:54:40.802672+0000","last_became_peered":"2024-04-18T04:54:40.802672+0000","last_unstale":"2024-04-18T05:00:00.987547+0000","last_undegraded":"2024-04-18T05:00:00.987547+0000","last_fullsized":"2024-04-18T05:00:00.987547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:56.851301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":487,"num_write_kb":12578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'415","reported_seq":430,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.042647+0000","last_change":"2024-04-18T04:54:40.823675+0000","last_active":"2024-04-18T05:00:02.042647+0000","last_peered":"2024-04-18T05:00:02.042647+0000","last_clean":"2024-04-18T05:00:02.042647+0000","last_became_active":"2024-04-18T04:54:40.823091+0000","last_became_peered":"2024-04-18T04:54:40.823091+0000","last_unstale":"2024-04-18T05:00:02.042647+0000","last_undegraded":"2024-04-18T05:00:02.042647+0000","last_fullsized":"2024-04-18T05:00:02.042647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":4340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"23'429","reported_seq":457,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.413269+0000","last_change":"2024-04-18T04:54:41.200326+0000","last_active":"2024-04-18T05:01:07.413269+0000","last_peered":"2024-04-18T05:01:07.413269+0000","last_clean":"2024-04-18T05:01:07.413269+0000","last_became_active":"2024-04-18T04:54:41.199690+0000","last_became_peered":"2024-04-18T04:54:41.199690+0000","last_unstale":"2024-04-18T05:01:07.413269+0000","last_undegraded":"2024-04-18T05:01:07.413269+0000","last_fullsized":"2024-04-18T05:01:07.413269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5535,"num_write":391,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'954","reported_seq":968,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.039751+0000","last_change":"2024-04-18T04:54:40.805264+0000","last_active":"2024-04-18T05:00:02.039751+0000","last_peered":"2024-04-18T05:00:02.039751+0000","last_clean":"2024-04-18T05:00:02.039751+0000","last_became_active":"2024-04-18T04:54:40.804605+0000","last_became_peered":"2024-04-18T04:54:40.804605+0000","last_unstale":"2024-04-18T05:00:02.039751+0000","last_undegraded":"2024-04-18T05:00:02.039751+0000","last_fullsized":"2024-04-18T05:00:02.039751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:48.991270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"23'422","reported_seq":469,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.372623+0000","last_change":"2024-04-18T04:54:41.175359+0000","last_active":"2024-04-18T05:01:07.372623+0000","last_peered":"2024-04-18T05:01:07.372623+0000","last_clean":"2024-04-18T05:01:07.372623+0000","last_became_active":"2024-04-18T04:54:41.175137+0000","last_became_peered":"2024-04-18T04:54:41.175137+0000","last_unstale":"2024-04-18T05:01:07.372623+0000","last_undegraded":"2024-04-18T05:01:07.372623+0000","last_fullsized":"2024-04-18T05:01:07.372623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:06:24.271204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21971,"num_write":395,"num_write_kb":63063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'67","reported_seq":82,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.319843+0000","last_change":"2024-04-18T04:54:40.798936+0000","last_active":"2024-04-18T05:01:07.319843+0000","last_peered":"2024-04-18T05:01:07.319843+0000","last_clean":"2024-04-18T05:01:07.319843+0000","last_became_active":"2024-04-18T04:54:40.798572+0000","last_became_peered":"2024-04-18T04:54:40.798572+0000","last_unstale":"2024-04-18T05:01:07.319843+0000","last_undegraded":"2024-04-18T05:01:07.319843+0000","last_fullsized":"2024-04-18T05:01:07.319843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'432","reported_seq":484,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.382097+0000","last_change":"2024-04-18T04:54:41.188280+0000","last_active":"2024-04-18T05:01:07.382097+0000","last_peered":"2024-04-18T05:01:07.382097+0000","last_clean":"2024-04-18T05:01:07.382097+0000","last_became_active":"2024-04-18T04:54:41.188012+0000","last_became_peered":"2024-04-18T04:54:41.188012+0000","last_unstale":"2024-04-18T05:01:07.382097+0000","last_undegraded":"2024-04-18T05:01:07.382097+0000","last_fullsized":"2024-04-18T05:01:07.382097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:11.319118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13773,"num_write":397,"num_write_kb":43173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'334","reported_seq":349,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.019065+0000","last_change":"2024-04-18T04:54:40.802894+0000","last_active":"2024-04-18T05:00:05.019065+0000","last_peered":"2024-04-18T05:00:05.019065+0000","last_clean":"2024-04-18T05:00:05.019065+0000","last_became_active":"2024-04-18T04:54:40.801406+0000","last_became_peered":"2024-04-18T04:54:40.801406+0000","last_unstale":"2024-04-18T05:00:05.019065+0000","last_undegraded":"2024-04-18T05:00:05.019065+0000","last_fullsized":"2024-04-18T05:00:05.019065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"23'397","reported_seq":432,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.409498+0000","last_change":"2024-04-18T04:54:41.203407+0000","last_active":"2024-04-18T05:01:07.409498+0000","last_peered":"2024-04-18T05:01:07.409498+0000","last_clean":"2024-04-18T05:01:07.409498+0000","last_became_active":"2024-04-18T04:54:41.203186+0000","last_became_peered":"2024-04-18T04:54:41.203186+0000","last_unstale":"2024-04-18T05:01:07.409498+0000","last_undegraded":"2024-04-18T05:01:07.409498+0000","last_fullsized":"2024-04-18T05:01:07.409498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:23:50.107054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14488,"num_write":364,"num_write_kb":75349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'188","reported_seq":203,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.064184+0000","last_change":"2024-04-18T04:54:40.822014+0000","last_active":"2024-04-18T05:00:06.064184+0000","last_peered":"2024-04-18T05:00:06.064184+0000","last_clean":"2024-04-18T05:00:06.064184+0000","last_became_active":"2024-04-18T04:54:40.820920+0000","last_became_peered":"2024-04-18T04:54:40.820920+0000","last_unstale":"2024-04-18T05:00:06.064184+0000","last_undegraded":"2024-04-18T05:00:06.064184+0000","last_fullsized":"2024-04-18T05:00:06.064184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"23'394","reported_seq":443,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.365245+0000","last_change":"2024-04-18T04:54:41.197254+0000","last_active":"2024-04-18T05:01:07.365245+0000","last_peered":"2024-04-18T05:01:07.365245+0000","last_clean":"2024-04-18T05:01:07.365245+0000","last_became_active":"2024-04-18T04:54:41.196927+0000","last_became_peered":"2024-04-18T04:54:41.196927+0000","last_unstale":"2024-04-18T05:01:07.365245+0000","last_undegraded":"2024-04-18T05:01:07.365245+0000","last_fullsized":"2024-04-18T05:01:07.365245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:01:45.182766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21129,"num_write":360,"num_write_kb":71528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'444","reported_seq":459,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.323010+0000","last_change":"2024-04-18T04:54:40.801789+0000","last_active":"2024-04-18T05:01:07.323010+0000","last_peered":"2024-04-18T05:01:07.323010+0000","last_clean":"2024-04-18T05:01:07.323010+0000","last_became_active":"2024-04-18T04:54:40.801403+0000","last_became_peered":"2024-04-18T04:54:40.801403+0000","last_unstale":"2024-04-18T05:01:07.323010+0000","last_undegraded":"2024-04-18T05:01:07.323010+0000","last_fullsized":"2024-04-18T05:01:07.323010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:15:11.220095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12011434,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":11980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'396","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394971+0000","last_change":"2024-04-18T04:54:41.195518+0000","last_active":"2024-04-18T05:01:07.394971+0000","last_peered":"2024-04-18T05:01:07.394971+0000","last_clean":"2024-04-18T05:01:07.394971+0000","last_became_active":"2024-04-18T04:54:41.195172+0000","last_became_peered":"2024-04-18T04:54:41.195172+0000","last_unstale":"2024-04-18T05:01:07.394971+0000","last_undegraded":"2024-04-18T05:01:07.394971+0000","last_fullsized":"2024-04-18T05:01:07.394971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19873,"num_write":365,"num_write_kb":71837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'583","reported_seq":598,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T04:59:57.951802+0000","last_change":"2024-04-18T04:54:40.818390+0000","last_active":"2024-04-18T04:59:57.951802+0000","last_peered":"2024-04-18T04:59:57.951802+0000","last_clean":"2024-04-18T04:59:57.951802+0000","last_became_active":"2024-04-18T04:54:40.817681+0000","last_became_peered":"2024-04-18T04:54:40.817681+0000","last_unstale":"2024-04-18T04:59:57.951802+0000","last_undegraded":"2024-04-18T04:59:57.951802+0000","last_fullsized":"2024-04-18T04:59:57.951802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"23'417","reported_seq":443,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.392565+0000","last_change":"2024-04-18T04:54:41.194807+0000","last_active":"2024-04-18T05:01:07.392565+0000","last_peered":"2024-04-18T05:01:07.392565+0000","last_clean":"2024-04-18T05:01:07.392565+0000","last_became_active":"2024-04-18T04:54:41.194499+0000","last_became_peered":"2024-04-18T04:54:41.194499+0000","last_unstale":"2024-04-18T05:01:07.392565+0000","last_undegraded":"2024-04-18T05:01:07.392565+0000","last_fullsized":"2024-04-18T05:01:07.392565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":380,"num_write_kb":59449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"23'70","reported_seq":84,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.004709+0000","last_change":"2024-04-18T04:54:40.817631+0000","last_active":"2024-04-18T05:00:06.004709+0000","last_peered":"2024-04-18T05:00:06.004709+0000","last_clean":"2024-04-18T05:00:06.004709+0000","last_became_active":"2024-04-18T04:54:40.817370+0000","last_became_peered":"2024-04-18T04:54:40.817370+0000","last_unstale":"2024-04-18T05:00:06.004709+0000","last_undegraded":"2024-04-18T05:00:06.004709+0000","last_fullsized":"2024-04-18T05:00:06.004709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'400","reported_seq":472,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377439+0000","last_change":"2024-04-18T04:54:41.193363+0000","last_active":"2024-04-18T05:01:07.377439+0000","last_peered":"2024-04-18T05:01:07.377439+0000","last_clean":"2024-04-18T05:01:07.377439+0000","last_became_active":"2024-04-18T04:54:41.192889+0000","last_became_peered":"2024-04-18T04:54:41.192889+0000","last_unstale":"2024-04-18T05:01:07.377439+0000","last_undegraded":"2024-04-18T05:01:07.377439+0000","last_fullsized":"2024-04-18T05:01:07.377439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30891,"num_write":363,"num_write_kb":81664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"23'67","reported_seq":82,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.985062+0000","last_change":"2024-04-18T04:54:40.806633+0000","last_active":"2024-04-18T05:00:03.985062+0000","last_peered":"2024-04-18T05:00:03.985062+0000","last_clean":"2024-04-18T05:00:03.985062+0000","last_became_active":"2024-04-18T04:54:40.805965+0000","last_became_peered":"2024-04-18T04:54:40.805965+0000","last_unstale":"2024-04-18T05:00:03.985062+0000","last_undegraded":"2024-04-18T05:00:03.985062+0000","last_fullsized":"2024-04-18T05:00:03.985062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1124,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'449","reported_seq":495,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.410877+0000","last_change":"2024-04-18T04:54:41.184321+0000","last_active":"2024-04-18T05:01:07.410877+0000","last_peered":"2024-04-18T05:01:07.410877+0000","last_clean":"2024-04-18T05:01:07.410877+0000","last_became_active":"2024-04-18T04:54:41.183838+0000","last_became_peered":"2024-04-18T04:54:41.183838+0000","last_unstale":"2024-04-18T05:01:07.410877+0000","last_undegraded":"2024-04-18T05:01:07.410877+0000","last_fullsized":"2024-04-18T05:01:07.410877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14210,"num_write":423,"num_write_kb":80124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'80","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.004824+0000","last_change":"2024-04-18T04:54:40.818954+0000","last_active":"2024-04-18T05:00:06.004824+0000","last_peered":"2024-04-18T05:00:06.004824+0000","last_clean":"2024-04-18T05:00:06.004824+0000","last_became_active":"2024-04-18T04:54:40.818227+0000","last_became_peered":"2024-04-18T04:54:40.818227+0000","last_unstale":"2024-04-18T05:00:06.004824+0000","last_undegraded":"2024-04-18T05:00:06.004824+0000","last_fullsized":"2024-04-18T05:00:06.004824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:25.263089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"23'493","reported_seq":553,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.364760+0000","last_change":"2024-04-18T04:54:41.192227+0000","last_active":"2024-04-18T05:01:07.364760+0000","last_peered":"2024-04-18T05:01:07.364760+0000","last_clean":"2024-04-18T05:01:07.364760+0000","last_became_active":"2024-04-18T04:54:41.187002+0000","last_became_peered":"2024-04-18T04:54:41.187002+0000","last_unstale":"2024-04-18T05:01:07.364760+0000","last_undegraded":"2024-04-18T05:01:07.364760+0000","last_fullsized":"2024-04-18T05:01:07.364760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":24156,"num_write":458,"num_write_kb":105037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'199","reported_seq":214,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.106627+0000","last_change":"2024-04-18T04:54:40.805795+0000","last_active":"2024-04-18T05:00:05.106627+0000","last_peered":"2024-04-18T05:00:05.106627+0000","last_clean":"2024-04-18T05:00:05.106627+0000","last_became_active":"2024-04-18T04:54:40.802550+0000","last_became_peered":"2024-04-18T04:54:40.802550+0000","last_unstale":"2024-04-18T05:00:05.106627+0000","last_undegraded":"2024-04-18T05:00:05.106627+0000","last_fullsized":"2024-04-18T05:00:05.106627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'364","reported_seq":403,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.373214+0000","last_change":"2024-04-18T04:54:41.180426+0000","last_active":"2024-04-18T05:01:07.373214+0000","last_peered":"2024-04-18T05:01:07.373214+0000","last_clean":"2024-04-18T05:01:07.373214+0000","last_became_active":"2024-04-18T04:54:41.179540+0000","last_became_peered":"2024-04-18T04:54:41.179540+0000","last_unstale":"2024-04-18T05:01:07.373214+0000","last_undegraded":"2024-04-18T05:01:07.373214+0000","last_fullsized":"2024-04-18T05:01:07.373214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:38:25.074053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16384,"num_write":332,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'304","reported_seq":319,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:01.025031+0000","last_change":"2024-04-18T04:54:40.804284+0000","last_active":"2024-04-18T05:00:01.025031+0000","last_peered":"2024-04-18T05:00:01.025031+0000","last_clean":"2024-04-18T05:00:01.025031+0000","last_became_active":"2024-04-18T04:54:40.803464+0000","last_became_peered":"2024-04-18T04:54:40.803464+0000","last_unstale":"2024-04-18T05:00:01.025031+0000","last_undegraded":"2024-04-18T05:00:01.025031+0000","last_fullsized":"2024-04-18T05:00:01.025031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:52.171667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"23'391","reported_seq":433,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377810+0000","last_change":"2024-04-18T04:54:41.188591+0000","last_active":"2024-04-18T05:01:07.377810+0000","last_peered":"2024-04-18T05:01:07.377810+0000","last_clean":"2024-04-18T05:01:07.377810+0000","last_became_active":"2024-04-18T04:54:41.188152+0000","last_became_peered":"2024-04-18T04:54:41.188152+0000","last_unstale":"2024-04-18T05:01:07.377810+0000","last_undegraded":"2024-04-18T05:01:07.377810+0000","last_fullsized":"2024-04-18T05:01:07.377810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15853,"num_write":356,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'535","reported_seq":549,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.991447+0000","last_change":"2024-04-18T04:54:40.814901+0000","last_active":"2024-04-18T05:00:02.991447+0000","last_peered":"2024-04-18T05:00:02.991447+0000","last_clean":"2024-04-18T05:00:02.991447+0000","last_became_active":"2024-04-18T04:54:40.814207+0000","last_became_peered":"2024-04-18T04:54:40.814207+0000","last_unstale":"2024-04-18T05:00:02.991447+0000","last_undegraded":"2024-04-18T05:00:02.991447+0000","last_fullsized":"2024-04-18T05:00:02.991447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"23'425","reported_seq":468,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.378034+0000","last_change":"2024-04-18T04:54:41.188664+0000","last_active":"2024-04-18T05:01:07.378034+0000","last_peered":"2024-04-18T05:01:07.378034+0000","last_clean":"2024-04-18T05:01:07.378034+0000","last_became_active":"2024-04-18T04:54:41.188249+0000","last_became_peered":"2024-04-18T04:54:41.188249+0000","last_unstale":"2024-04-18T05:01:07.378034+0000","last_undegraded":"2024-04-18T05:01:07.378034+0000","last_fullsized":"2024-04-18T05:01:07.378034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14420,"num_write":396,"num_write_kb":51045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'76","reported_seq":91,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.044489+0000","last_change":"2024-04-18T04:54:40.828447+0000","last_active":"2024-04-18T05:00:05.044489+0000","last_peered":"2024-04-18T05:00:05.044489+0000","last_clean":"2024-04-18T05:00:05.044489+0000","last_became_active":"2024-04-18T04:54:40.823755+0000","last_became_peered":"2024-04-18T04:54:40.823755+0000","last_unstale":"2024-04-18T05:00:05.044489+0000","last_undegraded":"2024-04-18T05:00:05.044489+0000","last_fullsized":"2024-04-18T05:00:05.044489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1706,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'402","reported_seq":434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.371709+0000","last_change":"2024-04-18T04:54:41.186523+0000","last_active":"2024-04-18T05:01:07.371709+0000","last_peered":"2024-04-18T05:01:07.371709+0000","last_clean":"2024-04-18T05:01:07.371709+0000","last_became_active":"2024-04-18T04:54:41.186149+0000","last_became_peered":"2024-04-18T04:54:41.186149+0000","last_unstale":"2024-04-18T05:01:07.371709+0000","last_undegraded":"2024-04-18T05:01:07.371709+0000","last_fullsized":"2024-04-18T05:01:07.371709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7713,"num_write":373,"num_write_kb":46594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T04:58:35.620748+0000","last_change":"2024-04-18T04:54:35.674328+0000","last_active":"2024-04-18T04:58:35.620748+0000","last_peered":"2024-04-18T04:58:35.620748+0000","last_clean":"2024-04-18T04:58:35.620748+0000","last_became_active":"2024-04-18T04:54:35.672457+0000","last_became_peered":"2024-04-18T04:54:35.672457+0000","last_unstale":"2024-04-18T04:58:35.620748+0000","last_undegraded":"2024-04-18T04:58:35.620748+0000","last_fullsized":"2024-04-18T04:58:35.620748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_clean_scrub_stamp":"2024-04-18T04:54:33.597974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:02:10.966568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'71","reported_seq":86,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.016000+0000","last_change":"2024-04-18T04:54:40.802422+0000","last_active":"2024-04-18T05:00:06.016000+0000","last_peered":"2024-04-18T05:00:06.016000+0000","last_clean":"2024-04-18T05:00:06.016000+0000","last_became_active":"2024-04-18T04:54:40.801083+0000","last_became_peered":"2024-04-18T04:54:40.801083+0000","last_unstale":"2024-04-18T05:00:06.016000+0000","last_undegraded":"2024-04-18T05:00:06.016000+0000","last_fullsized":"2024-04-18T05:00:06.016000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'362","reported_seq":382,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.383454+0000","last_change":"2024-04-18T04:54:41.174658+0000","last_active":"2024-04-18T05:01:07.383454+0000","last_peered":"2024-04-18T05:01:07.383454+0000","last_clean":"2024-04-18T05:01:07.383454+0000","last_became_active":"2024-04-18T04:54:41.174391+0000","last_became_peered":"2024-04-18T04:54:41.174391+0000","last_unstale":"2024-04-18T05:01:07.383454+0000","last_undegraded":"2024-04-18T05:01:07.383454+0000","last_fullsized":"2024-04-18T05:01:07.383454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:28:24.015964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1626,"num_write":331,"num_write_kb":26059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'438","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.117713+0000","last_change":"2024-04-18T04:54:40.813770+0000","last_active":"2024-04-18T05:00:05.117713+0000","last_peered":"2024-04-18T05:00:05.117713+0000","last_clean":"2024-04-18T05:00:05.117713+0000","last_became_active":"2024-04-18T04:54:40.813396+0000","last_became_peered":"2024-04-18T04:54:40.813396+0000","last_unstale":"2024-04-18T05:00:05.117713+0000","last_undegraded":"2024-04-18T05:00:05.117713+0000","last_fullsized":"2024-04-18T05:00:05.117713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":379,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'410","reported_seq":523,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394590+0000","last_change":"2024-04-18T04:54:41.195440+0000","last_active":"2024-04-18T05:01:07.394590+0000","last_peered":"2024-04-18T05:01:07.394590+0000","last_clean":"2024-04-18T05:01:07.394590+0000","last_became_active":"2024-04-18T04:54:41.195152+0000","last_became_peered":"2024-04-18T04:54:41.195152+0000","last_unstale":"2024-04-18T05:01:07.394590+0000","last_undegraded":"2024-04-18T05:01:07.394590+0000","last_fullsized":"2024-04-18T05:01:07.394590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":54989,"num_write":377,"num_write_kb":85155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'431","reported_seq":798,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:55.644395+0000","last_change":"2024-04-18T04:54:40.818806+0000","last_active":"2024-04-18T05:00:55.644395+0000","last_peered":"2024-04-18T05:00:55.644395+0000","last_clean":"2024-04-18T05:00:55.644395+0000","last_became_active":"2024-04-18T04:54:40.818113+0000","last_became_peered":"2024-04-18T04:54:40.818113+0000","last_unstale":"2024-04-18T05:00:55.644395+0000","last_undegraded":"2024-04-18T05:00:55.644395+0000","last_fullsized":"2024-04-18T05:00:55.644395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1456426,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":351,"num_read_kb":1645,"num_write":371,"num_write_kb":1672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'416","reported_seq":434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.412599+0000","last_change":"2024-04-18T04:54:41.192576+0000","last_active":"2024-04-18T05:01:07.412599+0000","last_peered":"2024-04-18T05:01:07.412599+0000","last_clean":"2024-04-18T05:01:07.412599+0000","last_became_active":"2024-04-18T04:54:41.192187+0000","last_became_peered":"2024-04-18T04:54:41.192187+0000","last_unstale":"2024-04-18T05:01:07.412599+0000","last_undegraded":"2024-04-18T05:01:07.412599+0000","last_fullsized":"2024-04-18T05:01:07.412599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":364,"num_write":388,"num_write_kb":58777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'517","reported_seq":532,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.991782+0000","last_change":"2024-04-18T04:54:40.820531+0000","last_active":"2024-04-18T05:00:03.991782+0000","last_peered":"2024-04-18T05:00:03.991782+0000","last_clean":"2024-04-18T05:00:03.991782+0000","last_became_active":"2024-04-18T04:54:40.820025+0000","last_became_peered":"2024-04-18T04:54:40.820025+0000","last_unstale":"2024-04-18T05:00:03.991782+0000","last_undegraded":"2024-04-18T05:00:03.991782+0000","last_fullsized":"2024-04-18T05:00:03.991782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:35.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":8474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'404","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374383+0000","last_change":"2024-04-18T04:54:41.186361+0000","last_active":"2024-04-18T05:01:07.374383+0000","last_peered":"2024-04-18T05:01:07.374383+0000","last_clean":"2024-04-18T05:01:07.374383+0000","last_became_active":"2024-04-18T04:54:41.185257+0000","last_became_peered":"2024-04-18T04:54:41.185257+0000","last_unstale":"2024-04-18T05:01:07.374383+0000","last_undegraded":"2024-04-18T05:01:07.374383+0000","last_fullsized":"2024-04-18T05:01:07.374383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14216,"num_write":374,"num_write_kb":63531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'63","reported_seq":78,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.961722+0000","last_change":"2024-04-18T04:54:40.824668+0000","last_active":"2024-04-18T05:00:02.961722+0000","last_peered":"2024-04-18T05:00:02.961722+0000","last_clean":"2024-04-18T05:00:02.961722+0000","last_became_active":"2024-04-18T04:54:40.824206+0000","last_became_peered":"2024-04-18T04:54:40.824206+0000","last_unstale":"2024-04-18T05:00:02.961722+0000","last_undegraded":"2024-04-18T05:00:02.961722+0000","last_fullsized":"2024-04-18T05:00:02.961722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'433","reported_seq":531,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.393697+0000","last_change":"2024-04-18T04:54:41.195487+0000","last_active":"2024-04-18T05:01:07.393697+0000","last_peered":"2024-04-18T05:01:07.393697+0000","last_clean":"2024-04-18T05:01:07.393697+0000","last_became_active":"2024-04-18T04:54:41.195177+0000","last_became_peered":"2024-04-18T04:54:41.195177+0000","last_unstale":"2024-04-18T05:01:07.393697+0000","last_undegraded":"2024-04-18T05:01:07.393697+0000","last_fullsized":"2024-04-18T05:01:07.393697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:25.853413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":41457,"num_write":394,"num_write_kb":79356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'328","reported_seq":343,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.057473+0000","last_change":"2024-04-18T04:54:40.803387+0000","last_active":"2024-04-18T05:00:05.057473+0000","last_peered":"2024-04-18T05:00:05.057473+0000","last_clean":"2024-04-18T05:00:05.057473+0000","last_became_active":"2024-04-18T04:54:40.802902+0000","last_became_peered":"2024-04-18T04:54:40.802902+0000","last_unstale":"2024-04-18T05:00:05.057473+0000","last_undegraded":"2024-04-18T05:00:05.057473+0000","last_fullsized":"2024-04-18T05:00:05.057473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'423","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.404089+0000","last_change":"2024-04-18T04:54:41.195382+0000","last_active":"2024-04-18T05:01:07.404089+0000","last_peered":"2024-04-18T05:01:07.404089+0000","last_clean":"2024-04-18T05:01:07.404089+0000","last_became_active":"2024-04-18T04:54:41.194965+0000","last_became_peered":"2024-04-18T04:54:41.194965+0000","last_unstale":"2024-04-18T05:01:07.404089+0000","last_undegraded":"2024-04-18T05:01:07.404089+0000","last_fullsized":"2024-04-18T05:01:07.404089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:39:50.932794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32152,"num_write":386,"num_write_kb":121188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'116","reported_seq":131,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:07.223800+0000","last_change":"2024-04-18T04:54:40.800651+0000","last_active":"2024-04-18T05:00:07.223800+0000","last_peered":"2024-04-18T05:00:07.223800+0000","last_clean":"2024-04-18T05:00:07.223800+0000","last_became_active":"2024-04-18T04:54:40.798574+0000","last_became_peered":"2024-04-18T04:54:40.798574+0000","last_unstale":"2024-04-18T05:00:07.223800+0000","last_undegraded":"2024-04-18T05:00:07.223800+0000","last_fullsized":"2024-04-18T05:00:07.223800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:55.712985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'326","reported_seq":341,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.386513+0000","last_change":"2024-04-18T04:54:41.191679+0000","last_active":"2024-04-18T05:01:07.386513+0000","last_peered":"2024-04-18T05:01:07.386513+0000","last_clean":"2024-04-18T05:01:07.386513+0000","last_became_active":"2024-04-18T04:54:41.191124+0000","last_became_peered":"2024-04-18T04:54:41.191124+0000","last_unstale":"2024-04-18T05:01:07.386513+0000","last_undegraded":"2024-04-18T05:01:07.386513+0000","last_fullsized":"2024-04-18T05:01:07.386513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.296860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":298,"num_write_kb":17144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'80","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.999053+0000","last_change":"2024-04-18T04:54:40.804085+0000","last_active":"2024-04-18T05:00:05.999053+0000","last_peered":"2024-04-18T05:00:05.999053+0000","last_clean":"2024-04-18T05:00:05.999053+0000","last_became_active":"2024-04-18T04:54:40.803616+0000","last_became_peered":"2024-04-18T04:54:40.803616+0000","last_unstale":"2024-04-18T05:00:05.999053+0000","last_undegraded":"2024-04-18T05:00:05.999053+0000","last_fullsized":"2024-04-18T05:00:05.999053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:55.405415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'465","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.383580+0000","last_change":"2024-04-18T04:54:41.185453+0000","last_active":"2024-04-18T05:01:07.383580+0000","last_peered":"2024-04-18T05:01:07.383580+0000","last_clean":"2024-04-18T05:01:07.383580+0000","last_became_active":"2024-04-18T04:54:41.185217+0000","last_became_peered":"2024-04-18T04:54:41.185217+0000","last_unstale":"2024-04-18T05:01:07.383580+0000","last_undegraded":"2024-04-18T05:01:07.383580+0000","last_fullsized":"2024-04-18T05:01:07.383580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:44:42.484978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8956,"num_write":434,"num_write_kb":97052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'601","reported_seq":617,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.068924+0000","last_change":"2024-04-18T04:54:40.801317+0000","last_active":"2024-04-18T05:00:05.068924+0000","last_peered":"2024-04-18T05:00:05.068924+0000","last_clean":"2024-04-18T05:00:05.068924+0000","last_became_active":"2024-04-18T04:54:40.800598+0000","last_became_peered":"2024-04-18T04:54:40.800598+0000","last_unstale":"2024-04-18T05:00:05.068924+0000","last_undegraded":"2024-04-18T05:00:05.068924+0000","last_fullsized":"2024-04-18T05:00:05.068924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":546,"num_write_kb":4388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'458","reported_seq":503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.330451+0000","last_change":"2024-04-18T04:54:41.197813+0000","last_active":"2024-04-18T05:01:07.330451+0000","last_peered":"2024-04-18T05:01:07.330451+0000","last_clean":"2024-04-18T05:01:07.330451+0000","last_became_active":"2024-04-18T04:54:41.197201+0000","last_became_peered":"2024-04-18T04:54:41.197201+0000","last_unstale":"2024-04-18T05:01:07.330451+0000","last_undegraded":"2024-04-18T05:01:07.330451+0000","last_fullsized":"2024-04-18T05:01:07.330451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21429,"num_write":433,"num_write_kb":71833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'55","reported_seq":70,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.004167+0000","last_change":"2024-04-18T04:54:40.800416+0000","last_active":"2024-04-18T05:00:03.004167+0000","last_peered":"2024-04-18T05:00:03.004167+0000","last_clean":"2024-04-18T05:00:03.004167+0000","last_became_active":"2024-04-18T04:54:40.797471+0000","last_became_peered":"2024-04-18T04:54:40.797471+0000","last_unstale":"2024-04-18T05:00:03.004167+0000","last_undegraded":"2024-04-18T05:00:03.004167+0000","last_fullsized":"2024-04-18T05:00:03.004167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:33.118670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"23'421","reported_seq":478,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.382482+0000","last_change":"2024-04-18T04:54:41.192024+0000","last_active":"2024-04-18T05:01:07.382482+0000","last_peered":"2024-04-18T05:01:07.382482+0000","last_clean":"2024-04-18T05:01:07.382482+0000","last_became_active":"2024-04-18T04:54:41.191488+0000","last_became_peered":"2024-04-18T04:54:41.191488+0000","last_unstale":"2024-04-18T05:01:07.382482+0000","last_undegraded":"2024-04-18T05:01:07.382482+0000","last_fullsized":"2024-04-18T05:01:07.382482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:39:31.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23403,"num_write":390,"num_write_kb":67848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'192","reported_seq":208,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.005322+0000","last_change":"2024-04-18T04:54:40.823863+0000","last_active":"2024-04-18T05:00:03.005322+0000","last_peered":"2024-04-18T05:00:03.005322+0000","last_clean":"2024-04-18T05:00:03.005322+0000","last_became_active":"2024-04-18T04:54:40.823277+0000","last_became_peered":"2024-04-18T04:54:40.823277+0000","last_unstale":"2024-04-18T05:00:03.005322+0000","last_undegraded":"2024-04-18T05:00:03.005322+0000","last_fullsized":"2024-04-18T05:00:03.005322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'448","reported_seq":498,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394105+0000","last_change":"2024-04-18T04:54:41.199981+0000","last_active":"2024-04-18T05:01:07.394105+0000","last_peered":"2024-04-18T05:01:07.394105+0000","last_clean":"2024-04-18T05:01:07.394105+0000","last_became_active":"2024-04-18T04:54:41.199700+0000","last_became_peered":"2024-04-18T04:54:41.199700+0000","last_unstale":"2024-04-18T05:01:07.394105+0000","last_undegraded":"2024-04-18T05:01:07.394105+0000","last_fullsized":"2024-04-18T05:01:07.394105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":10662,"num_write":420,"num_write_kb":96864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'127","reported_seq":141,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:01.015287+0000","last_change":"2024-04-18T04:54:40.800740+0000","last_active":"2024-04-18T05:00:01.015287+0000","last_peered":"2024-04-18T05:00:01.015287+0000","last_clean":"2024-04-18T05:00:01.015287+0000","last_became_active":"2024-04-18T04:54:40.800405+0000","last_became_peered":"2024-04-18T04:54:40.800405+0000","last_unstale":"2024-04-18T05:00:01.015287+0000","last_undegraded":"2024-04-18T05:00:01.015287+0000","last_fullsized":"2024-04-18T05:00:01.015287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":8237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'441","reported_seq":502,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.363689+0000","last_change":"2024-04-18T04:54:41.192487+0000","last_active":"2024-04-18T05:01:07.363689+0000","last_peered":"2024-04-18T05:01:07.363689+0000","last_clean":"2024-04-18T05:01:07.363689+0000","last_became_active":"2024-04-18T04:54:41.186301+0000","last_became_peered":"2024-04-18T04:54:41.186301+0000","last_unstale":"2024-04-18T05:01:07.363689+0000","last_undegraded":"2024-04-18T05:01:07.363689+0000","last_fullsized":"2024-04-18T05:01:07.363689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":27247,"num_write":409,"num_write_kb":76591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"23'382","reported_seq":407,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.378209+0000","last_change":"2024-04-18T04:54:41.193260+0000","last_active":"2024-04-18T05:01:07.378209+0000","last_peered":"2024-04-18T05:01:07.378209+0000","last_clean":"2024-04-18T05:01:07.378209+0000","last_became_active":"2024-04-18T04:54:41.192941+0000","last_became_peered":"2024-04-18T04:54:41.192941+0000","last_unstale":"2024-04-18T05:01:07.378209+0000","last_undegraded":"2024-04-18T05:01:07.378209+0000","last_fullsized":"2024-04-18T05:01:07.378209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4755,"num_write":342,"num_write_kb":72428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'357","reported_seq":372,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.067828+0000","last_change":"2024-04-18T04:54:40.800162+0000","last_active":"2024-04-18T05:00:05.067828+0000","last_peered":"2024-04-18T05:00:05.067828+0000","last_clean":"2024-04-18T05:00:05.067828+0000","last_became_active":"2024-04-18T04:54:40.799517+0000","last_became_peered":"2024-04-18T04:54:40.799517+0000","last_unstale":"2024-04-18T05:00:05.067828+0000","last_undegraded":"2024-04-18T05:00:05.067828+0000","last_fullsized":"2024-04-18T05:00:05.067828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"23'382","reported_seq":421,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374639+0000","last_change":"2024-04-18T04:54:41.179695+0000","last_active":"2024-04-18T05:01:07.374639+0000","last_peered":"2024-04-18T05:01:07.374639+0000","last_clean":"2024-04-18T05:01:07.374639+0000","last_became_active":"2024-04-18T04:54:41.179359+0000","last_became_peered":"2024-04-18T04:54:41.179359+0000","last_unstale":"2024-04-18T05:01:07.374639+0000","last_undegraded":"2024-04-18T05:01:07.374639+0000","last_fullsized":"2024-04-18T05:01:07.374639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14401,"num_write":356,"num_write_kb":79542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'289","reported_seq":304,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.057756+0000","last_change":"2024-04-18T04:54:40.801178+0000","last_active":"2024-04-18T05:00:05.057756+0000","last_peered":"2024-04-18T05:00:05.057756+0000","last_clean":"2024-04-18T05:00:05.057756+0000","last_became_active":"2024-04-18T04:54:40.800660+0000","last_became_peered":"2024-04-18T04:54:40.800660+0000","last_unstale":"2024-04-18T05:00:05.057756+0000","last_undegraded":"2024-04-18T05:00:05.057756+0000","last_fullsized":"2024-04-18T05:00:05.057756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":12441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'366","reported_seq":409,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.411914+0000","last_change":"2024-04-18T04:54:41.190055+0000","last_active":"2024-04-18T05:01:07.411914+0000","last_peered":"2024-04-18T05:01:07.411914+0000","last_clean":"2024-04-18T05:01:07.411914+0000","last_became_active":"2024-04-18T04:54:41.189344+0000","last_became_peered":"2024-04-18T04:54:41.189344+0000","last_unstale":"2024-04-18T05:01:07.411914+0000","last_undegraded":"2024-04-18T05:01:07.411914+0000","last_fullsized":"2024-04-18T05:01:07.411914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10936,"num_write":342,"num_write_kb":51086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'86","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.013938+0000","last_change":"2024-04-18T04:54:40.813931+0000","last_active":"2024-04-18T05:00:03.013938+0000","last_peered":"2024-04-18T05:00:03.013938+0000","last_clean":"2024-04-18T05:00:03.013938+0000","last_became_active":"2024-04-18T04:54:40.813290+0000","last_became_peered":"2024-04-18T04:54:40.813290+0000","last_unstale":"2024-04-18T05:00:03.013938+0000","last_undegraded":"2024-04-18T05:00:03.013938+0000","last_fullsized":"2024-04-18T05:00:03.013938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'407","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.385303+0000","last_change":"2024-04-18T04:54:41.192913+0000","last_active":"2024-04-18T05:01:07.385303+0000","last_peered":"2024-04-18T05:01:07.385303+0000","last_clean":"2024-04-18T05:01:07.385303+0000","last_became_active":"2024-04-18T04:54:41.192096+0000","last_became_peered":"2024-04-18T04:54:41.192096+0000","last_unstale":"2024-04-18T05:01:07.385303+0000","last_undegraded":"2024-04-18T05:01:07.385303+0000","last_fullsized":"2024-04-18T05:01:07.385303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:37:53.082409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17335,"num_write":380,"num_write_kb":68515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'130","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.040397+0000","last_change":"2024-04-18T04:54:40.805596+0000","last_active":"2024-04-18T05:00:06.040397+0000","last_peered":"2024-04-18T05:00:06.040397+0000","last_clean":"2024-04-18T05:00:06.040397+0000","last_became_active":"2024-04-18T04:54:40.804913+0000","last_became_peered":"2024-04-18T04:54:40.804913+0000","last_unstale":"2024-04-18T05:00:06.040397+0000","last_undegraded":"2024-04-18T05:00:06.040397+0000","last_fullsized":"2024-04-18T05:00:06.040397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:44.772589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2494,"num_read_kb":1324974,"num_write":24555,"num_write_kb":4507656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26500,"ondisk_log_size":26500,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":130916242,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":351,"num_read_kb":1645,"num_write":7226,"num_write_kb":133419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":100597760,"data_stored":261832484,"data_compressed":36635560,"data_compressed_allocated":47603712,"data_compressed_original":209084416,"omap_allocated":0,"internal_metadata":0},"log_size":8833,"ondisk_log_size":8833,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509522,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":5676,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":5812224,"data_stored":14125282,"data_compressed":1836351,"data_compressed_allocated":2379776,"data_compressed_original":10878976,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77800000000000002,"15min":0.83599999999999997},"min":{"1min":0.40100000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.1639999999999999,"5min":1.1910000000000001,"15min":1.2490000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.79100000000000004,"15min":0.83999999999999997},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1259999999999999,"5min":1.262,"15min":1.262},"last":1.194}]},{"osd":1,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0660000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.82899999999999996,"15min":0.84299999999999997},"min":{"1min":0.46500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.226,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.98099999999999998}]},{"osd":2,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.91600000000000004,"15min":0.89000000000000001},"min":{"1min":0.53700000000000003,"5min":0.438,"15min":0.438},"max":{"1min":1.2270000000000001,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86899999999999999,"15min":0.86499999999999999},"min":{"1min":0.48299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1890000000000001,"5min":1.379,"15min":1.4019999999999999},"last":1.123}]},{"osd":3,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1890000000000001,"5min":1.458,"15min":1.458},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.97899999999999998,"15min":0.95099999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.248,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0209999999999999}]},{"osd":4,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.91700000000000004,"15min":0.93100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.1479999999999999,"5min":1.605,"15min":1.605},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.91900000000000004,"15min":0.91100000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.175,"5min":1.546,"15min":1.546},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.98799999999999999,"15min":1.018},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2090000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.998,"15min":1.02},"min":{"1min":0.45000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.236,"5min":1.431,"15min":1.5640000000000001},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.0800000000000001,"15min":1.1120000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.28,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.0609999999999999,"15min":1.048},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.236,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.0760000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509522,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47056,"kb_used_data":7752,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94324784,"statfs":{"total":96636764160,"available":96588578816,"internally_reserved":0,"allocated":7938048,"data_stored":21059926,"data_compressed":3027129,"data_compressed_allocated":3776512,"data_compressed_original":17063936,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.76000000000000001,"15min":0.77600000000000002},"min":{"1min":0.61899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0800000000000001,"5min":1.125,"15min":1.125},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.81299999999999994,"15min":0.85099999999999998},"min":{"1min":0.58599999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0469999999999999,"5min":1.1870000000000001,"15min":1.353},"last":1.0349999999999999}]},{"osd":1,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.84999999999999998,"15min":0.93799999999999994},"min":{"1min":0.68700000000000006,"5min":0.312,"15min":0.312},"max":{"1min":1.1519999999999999,"5min":1.268,"15min":1.8560000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.82099999999999995,"15min":0.85099999999999998},"min":{"1min":0.74099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.038,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.94599999999999995,"15min":0.93600000000000005},"min":{"1min":0.92900000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1919999999999999,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.66000000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1910000000000001,"5min":1.325,"15min":1.325},"last":0.82199999999999995}]},{"osd":3,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.91600000000000004,"15min":0.90500000000000003},"min":{"1min":0.68200000000000005,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.159,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.93899999999999995,"15min":0.98899999999999999},"min":{"1min":0.80800000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1699999999999999,"5min":1.617,"15min":1.617},"last":0.95499999999999996}]},{"osd":4,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.88900000000000001,"15min":0.97899999999999998},"min":{"1min":0.64600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2789999999999999,"5min":1.4990000000000001,"15min":1.631},"last":0.999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97699999999999998,"15min":1.0589999999999999},"min":{"1min":0.71399999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.145,"5min":1.631,"15min":1.631},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.98799999999999999,"15min":1.008},"min":{"1min":0.77300000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.3320000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.0189999999999999,"15min":1.0449999999999999},"min":{"1min":0.73499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.163,"5min":1.673,"15min":1.6739999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0509999999999999,"15min":1.107},"min":{"1min":0.69799999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.248,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.05,"5min":1.0860000000000001,"15min":1.1120000000000001},"min":{"1min":0.78600000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2649999999999999,"5min":1.73,"15min":1.7769999999999999},"last":1.0649999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509521,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66536,"kb_used_data":13280,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94305304,"statfs":{"total":96636764160,"available":96568631296,"internally_reserved":0,"allocated":13598720,"data_stored":35687478,"data_compressed":4904028,"data_compressed_allocated":6356992,"data_compressed_original":28622848,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.76100000000000001,"15min":0.89100000000000001},"min":{"1min":0.57499999999999996,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1499999999999999,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.091},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.79000000000000004,"15min":0.82599999999999996},"min":{"1min":0.60599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.3340000000000001,"5min":1.542,"15min":1.542},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.91200000000000003,"15min":0.91800000000000004},"min":{"1min":0.58799999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.24,"5min":9.8819999999999997,"15min":9.8819999999999997},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.006,"5min":0.89100000000000001,"15min":0.92700000000000005},"min":{"1min":0.626,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.355,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":1.0169999999999999}]},{"osd":2,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.88400000000000001,"15min":0.89000000000000001},"min":{"1min":0.60899999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.177,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.97399999999999998,"15min":0.94799999999999995},"min":{"1min":0.68200000000000005,"5min":0.38,"15min":0.38},"max":{"1min":1.214,"5min":10.031000000000001,"15min":10.031000000000001},"last":0.95299999999999996}]},{"osd":3,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.91700000000000004,"15min":0.95999999999999996},"min":{"1min":0.72899999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.284,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.97599999999999998,"15min":1.014},"min":{"1min":0.72799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2789999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.0660000000000001}]},{"osd":4,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.006,"15min":0.91900000000000004},"min":{"1min":0.63700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.3759999999999999,"5min":9.968,"15min":9.968},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.96899999999999997,"15min":1.02},"min":{"1min":0.624,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.399,"5min":1.631,"15min":1.8440000000000001},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.006,"15min":0.96099999999999997},"min":{"1min":0.60899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4159999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.1020000000000001,"15min":1.036},"min":{"1min":0.752,"5min":0.371,"15min":0.371},"max":{"1min":1.4550000000000001,"5min":10.09,"15min":10.09},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0629999999999999,"15min":1.103},"min":{"1min":0.77800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.528,"5min":1.7050000000000001,"15min":1.944},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.129,"15min":1.151},"min":{"1min":0.72199999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.7070000000000001,"5min":1.97,"15min":1.97},"last":0.97899999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509522,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77376,"kb_used_data":20024,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94294464,"statfs":{"total":96636764160,"available":96557531136,"internally_reserved":0,"allocated":20504576,"data_stored":54614164,"data_compressed":7702565,"data_compressed_allocated":9973760,"data_compressed_original":44273664,"omap_allocated":1592,"internal_metadata":58718664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,0,0,14],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.628,"15min":0.67400000000000004},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.98099999999999998,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.222},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63100000000000001,"15min":0.61699999999999999},"min":{"1min":0.29499999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.91000000000000003,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.23799999999999999}]},{"osd":1,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61899999999999999,"15min":0.63500000000000001},"min":{"1min":0.31900000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.0920000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73699999999999999,"15min":0.69699999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.0720000000000001,"5min":2.601,"15min":2.601},"last":0.252}]},{"osd":2,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.73099999999999998,"15min":0.73399999999999999},"min":{"1min":0.34399999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.359,"5min":1.573,"15min":1.573},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1339999999999999,"5min":1.51,"15min":1.51},"last":0.27700000000000002}]},{"osd":4,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.86399999999999999,"15min":0.85799999999999998},"min":{"1min":0.46600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.202,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.91400000000000003,"15min":0.93600000000000005},"min":{"1min":0.59399999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4199999999999999,"5min":1.524,"15min":1.524},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.61499999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.252,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":21.260000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.008,"15min":1.028},"min":{"1min":0.47899999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.292,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":7.569}]},{"osd":6,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.98299999999999998,"15min":0.97199999999999998},"min":{"1min":0.72599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.282,"5min":1.512,"15min":1.512},"last":7.2729999999999997},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.02,"15min":1.0489999999999999},"min":{"1min":0.72699999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.327,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":4.2199999999999998}]},{"osd":7,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0600000000000001,"15min":1.1100000000000001},"min":{"1min":0.66700000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.371,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.046,"5min":1.0289999999999999,"15min":1.0580000000000001},"min":{"1min":0.60799999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.341,"5min":1.583,"15min":1.583},"last":0.66000000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509521,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59832,"kb_used_data":14768,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94312008,"statfs":{"total":96636764160,"available":96575496192,"internally_reserved":0,"allocated":15122432,"data_stored":34231216,"data_compressed":4539223,"data_compressed_allocated":6156288,"data_compressed_original":25436160,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63500000000000001,"15min":0.59099999999999997},"min":{"1min":0.38300000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.98699999999999999,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.73999999999999999},"min":{"1min":0.29899999999999999,"5min":0.214,"15min":0.214},"max":{"1min":1.1970000000000001,"5min":1.5920000000000001,"15min":1.9239999999999999},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66400000000000003,"15min":0.68400000000000005},"min":{"1min":0.432,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.88200000000000001,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.696,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.755,"15min":0.78200000000000003},"min":{"1min":0.46800000000000003,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.8400000000000001,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.78200000000000003,"15min":0.77700000000000002},"min":{"1min":0.49099999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.7989999999999999,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.92800000000000005,"15min":0.94799999999999995},"min":{"1min":0.56000000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.107,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.98499999999999999,"15min":0.98199999999999998},"min":{"1min":0.72299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.786,"5min":2.133,"15min":2.133},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.98099999999999998,"15min":1.0069999999999999},"min":{"1min":0.72399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":1.292,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.98099999999999998,"15min":0.98499999999999999},"min":{"1min":0.626,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.274,"5min":2.347,"15min":2.347},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":0.98799999999999999,"15min":1.02},"min":{"1min":0.65400000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.024,"5min":3.024,"15min":3.024},"last":1.089},{"interface":"front","average":{"1min":0.997,"5min":1.0409999999999999,"15min":1.0669999999999999},"min":{"1min":0.67800000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.288,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0600000000000001,"15min":1.0760000000000001},"min":{"1min":0.80200000000000005,"5min":0.497,"15min":0.497},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":1.048},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0860000000000001,"15min":1.109},"min":{"1min":0.76100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3680000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.77400000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509523,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78896,"kb_used_data":21544,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94292944,"statfs":{"total":96636764160,"available":96555974656,"internally_reserved":0,"allocated":22061056,"data_stored":54614568,"data_compressed":7565653,"data_compressed_allocated":10006528,"data_compressed_original":42741760,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.63400000000000001,"15min":0.58599999999999997},"min":{"1min":0.318,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":2.177,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.623,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.224,"15min":0.224},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69099999999999995,"15min":0.65900000000000003},"min":{"1min":0.433,"5min":0.22,"15min":0.22},"max":{"1min":1.4339999999999999,"5min":2.629,"15min":2.629},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.67500000000000004,"15min":0.64500000000000002},"min":{"1min":0.44600000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.70799999999999996,"15min":0.60699999999999998},"min":{"1min":0.38300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.575,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.81399999999999995,"15min":0.749},"min":{"1min":0.39500000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.3690000000000002,"5min":3.375,"15min":3.375},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6859999999999999,"5min":2.601,"15min":2.601},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.05,"5min":0.93899999999999995,"15min":0.92500000000000004},"min":{"1min":0.48699999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.2559999999999998,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.0049999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.92200000000000004,"15min":0.90500000000000003},"min":{"1min":0.76500000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.95999999999999996,"15min":0.94499999999999995},"min":{"1min":0.73299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.758,"5min":2.734,"15min":2.734},"last":0.95899999999999996}]},{"osd":6,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.016,"15min":0.98499999999999999},"min":{"1min":0.77100000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.3149999999999999,"5min":2.681,"15min":2.681},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":0.997,"15min":1.0149999999999999},"min":{"1min":0.81699999999999995,"5min":0.499,"15min":0.499},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.83199999999999996,"5min":0.496,"15min":0.496},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.026},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.03,"15min":0.97399999999999998},"min":{"1min":0.65900000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.831,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":1.0509999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47916,"kb_used_data":8612,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94323924,"statfs":{"total":96636764160,"available":96587698176,"internally_reserved":0,"allocated":8818688,"data_stored":24681186,"data_compressed":3524620,"data_compressed_allocated":4517888,"data_compressed_original":20582400,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.75,"15min":0.88900000000000001},"min":{"1min":0.48099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.05,"5min":1.1579999999999999,"15min":1.3080000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.74099999999999999,"15min":0.83199999999999996},"min":{"1min":0.57099999999999995,"5min":0.318,"15min":0.318},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81200000000000006,"15min":0.875},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.149,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.876,"5min":0.80500000000000005,"15min":0.86299999999999999},"min":{"1min":0.50600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.097,"5min":1.246,"15min":1.246},"last":0.73699999999999999}]},{"osd":2,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.57699999999999996,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92800000000000005,"15min":0.96899999999999997},"min":{"1min":0.53600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1379999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.2889999999999999}]},{"osd":3,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.80600000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.651,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.68600000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2130000000000001,"5min":3.6280000000000001,"15min":3.6280000000000001},"last":1.1839999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95199999999999996,"15min":0.93600000000000005},"min":{"1min":0.47899999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.228},{"interface":"front","average":{"1min":0.89000000000000001,"5min":1.008,"15min":1.054},"min":{"1min":0.58999999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":2.5299999999999998}]},{"osd":6,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.92000000000000004,"15min":1.006},"min":{"1min":0.61599999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.1890000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.88},{"interface":"front","average":{"1min":1.022,"5min":1.0329999999999999,"15min":1.0589999999999999},"min":{"1min":0.56399999999999995,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.5980000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.633}]},{"osd":7,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.101,"15min":1.141},"min":{"1min":0.72999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.246,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":2.4470000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.1180000000000001,"15min":1.1479999999999999},"min":{"1min":0.63300000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5409999999999999,"5min":3.9910000000000001,"15min":3.9910000000000001},"last":1.538}]}]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":8536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":8740864,"data_stored":24679416,"data_compressed":3602361,"data_compressed_allocated":4526080,"data_compressed_original":20631552,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.56499999999999995},"min":{"1min":0.42499999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.93799999999999994,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.64400000000000002,"15min":0.69699999999999995},"min":{"1min":0.45200000000000001,"5min":0.193,"15min":0.193},"max":{"1min":1.034,"5min":1.347,"15min":1.347},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67600000000000005,"15min":0.67200000000000004},"min":{"1min":0.53300000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.024,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.746},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68000000000000005,"15min":0.66600000000000004},"min":{"1min":0.433,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.022,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.67300000000000004,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1140000000000001,"5min":1.29,"15min":1.29},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.65800000000000003,"15min":0.64200000000000002},"min":{"1min":0.48799999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0149999999999999,"5min":1.034,"15min":1.034},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.91800000000000004,"15min":0.95299999999999996},"min":{"1min":0.79100000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.1930000000000001,"5min":2.456,"15min":2.456},"last":0.871},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.85099999999999998,"15min":0.873},"min":{"1min":0.57099999999999995,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2889999999999999,"5min":1.454,"15min":1.6950000000000001},"last":1.0029999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.96899999999999997,"15min":0.94399999999999995},"min":{"1min":0.78500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4279999999999999,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.93500000000000005,"15min":0.98699999999999999},"min":{"1min":0.81999999999999995,"5min":0.373,"15min":0.373},"max":{"1min":1.234,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.98199999999999998}]},{"osd":6,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.80500000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3440000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0329999999999999,"15min":0.98099999999999998},"min":{"1min":0.84799999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.506,"5min":3.391,"15min":3.391},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.99099999999999999,"15min":1.0289999999999999},"min":{"1min":0.84999999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.25,"5min":1.4259999999999999,"15min":1.4990000000000001},"last":1.024},{"interface":"front","average":{"1min":1.052,"5min":0.98899999999999999,"15min":0.97499999999999998},"min":{"1min":0.71199999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.3160000000000001,"5min":1.748,"15min":1.748},"last":0.82999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21827584,"data_stored":54529566,"data_compressed":7565653,"data_compressed_allocated":10006528,"data_compressed_original":42741760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14823424,"data_stored":33555846,"data_compressed":4506038,"data_compressed_allocated":6111232,"data_compressed_original":24862720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8507392,"data_stored":24594414,"data_compressed":3602361,"data_compressed_allocated":4526080,"data_compressed_original":20631552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20271104,"data_stored":54529162,"data_compressed":7702565,"data_compressed_allocated":9973760,"data_compressed_original":44273664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8585216,"data_stored":24596184,"data_compressed":3524620,"data_compressed_allocated":4517888,"data_compressed_original":20582400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13299712,"data_stored":35012108,"data_compressed":4870843,"data_compressed_allocated":6311936,"data_compressed_original":28049408,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7704576,"data_stored":20974924,"data_compressed":3027129,"data_compressed_allocated":3776512,"data_compressed_original":17063936,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5578752,"data_stored":14040280,"data_compressed":1836351,"data_compressed_allocated":2379776,"data_compressed_original":10878976,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T05:01:14.446 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T05:01:14.447 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T05:01:14.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.602+0000 7f029cf9c640 1 Processor -- start 2024-04-18T05:01:14.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.602+0000 7f029cf9c640 1 -- start start 2024-04-18T05:01:14.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029cf9c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0298070a40 0x7f0298156130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029cf9c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0298159380 con 0x7f02980c60e0 2024-04-18T05:01:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029cf9c640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0298159620 con 0x7f0298150260 2024-04-18T05:01:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029cf9c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029815a1a0 con 0x7f0298070a40 2024-04-18T05:01:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029659c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f02980c60e0 0x7f029814fb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33264/0 (socket says 172.21.15.96:33264) 2024-04-18T05:01:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029659c640 1 -- 172.21.15.96:0/1841498136 learned_addr learned my addr 172.21.15.96:0/1841498136 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:01:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029559a640 1 -- 172.21.15.96:0/1841498136 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015385742 0 0) 0x7f0298159380 con 0x7f02980c60e0 2024-04-18T05:01:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029559a640 1 -- 172.21.15.96:0/1841498136 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0280003530 con 0x7f02980c60e0 2024-04-18T05:01:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f0295d9b640 1 --2- 172.21.15.96:0/1841498136 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0298070a40 0x7f0298156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029559a640 1 -- 172.21.15.96:0/1841498136 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2479035214 0 0) 0x7f0280003530 con 0x7f02980c60e0 2024-04-18T05:01:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029559a640 1 -- 172.21.15.96:0/1841498136 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0298070a40 msgr2=0x7f0298156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029559a640 1 --2- 172.21.15.96:0/1841498136 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0298070a40 0x7f0298156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029559a640 1 -- 172.21.15.96:0/1841498136 >> v1:172.21.15.139:6789/0 conn(0x7f0298150260 legacy=0x7f0298160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029559a640 1 -- 172.21.15.96:0/1841498136 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0298159900 con 0x7f02980c60e0 2024-04-18T05:01:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029559a640 1 -- 172.21.15.96:0/1841498136 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f028c001680 con 0x7f02980c60e0 2024-04-18T05:01:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029559a640 1 -- 172.21.15.96:0/1841498136 >> v1:172.21.15.96:6789/0 conn(0x7f02980c60e0 legacy=0x7f029814fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029559a640 1 --2- 172.21.15.96:0/1841498136 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02800039b0 0x7f0280003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029559a640 1 --2- 172.21.15.96:0/1841498136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02800047d0 0x7f0280004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029559a640 1 --2- 172.21.15.96:0/1841498136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0280005190 0x7f028000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029559a640 1 -- 172.21.15.96:0/1841498136 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029815a1a0 con 0x7f0280005190 2024-04-18T05:01:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029559a640 1 -- 172.21.15.96:0/1841498136 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028000bf30 con 0x7f02800047d0 2024-04-18T05:01:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029559a640 1 -- 172.21.15.96:0/1841498136 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028000c0f0 con 0x7f02800039b0 2024-04-18T05:01:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f0296d9d640 1 --2- 172.21.15.96:0/1841498136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0280005190 0x7f028000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029659c640 1 --2- 172.21.15.96:0/1841498136 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02800039b0 0x7f0280003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f0295d9b640 1 --2- 172.21.15.96:0/1841498136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02800047d0 0x7f0280004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f0296d9d640 1 -- 172.21.15.96:0/1841498136 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02800039b0 msgr2=0x7f0280003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f0296d9d640 1 --2- 172.21.15.96:0/1841498136 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02800039b0 0x7f0280003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f0296d9d640 1 -- 172.21.15.96:0/1841498136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02800047d0 msgr2=0x7f0280004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f0296d9d640 1 --2- 172.21.15.96:0/1841498136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02800047d0 0x7f0280004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f0296d9d640 1 -- 172.21.15.96:0/1841498136 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0280003530 con 0x7f0280005190 2024-04-18T05:01:14.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029659c640 1 --2- 172.21.15.96:0/1841498136 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02800039b0 0x7f0280003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T05:01:14.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f0296d9d640 1 --2- 172.21.15.96:0/1841498136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0280005190 0x7f028000b990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0290001e70 tx=0x7f029001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f5be8d0f8f0929 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:14.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.606+0000 7f029559a640 1 -- 172.21.15.96:0/1841498136 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290003b80 con 0x7f0280005190 2024-04-18T05:01:14.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029559a640 1 -- 172.21.15.96:0/1841498136 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0290003ce0 con 0x7f0280005190 2024-04-18T05:01:14.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029559a640 1 -- 172.21.15.96:0/1841498136 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900052c0 con 0x7f0280005190 2024-04-18T05:01:14.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029cf9c640 1 -- 172.21.15.96:0/1841498136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0280005190 msgr2=0x7f028000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029cf9c640 1 --2- 172.21.15.96:0/1841498136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0280005190 0x7f028000b990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0290001e70 tx=0x7f029001c780 comp rx=0 tx=0).stop 2024-04-18T05:01:14.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f0296d9d640 1 -- 172.21.15.96:0/1841498136 reap_dead start 2024-04-18T05:01:14.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029cf9c640 1 -- 172.21.15.96:0/1841498136 shutdown_connections 2024-04-18T05:01:14.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029cf9c640 1 -- 172.21.15.96:0/1841498136 >> 172.21.15.96:0/1841498136 conn(0x7f029806c750 msgr2=0x7f02980c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:14.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029cf9c640 1 -- 172.21.15.96:0/1841498136 shutdown_connections 2024-04-18T05:01:14.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029cf9c640 1 -- 172.21.15.96:0/1841498136 wait complete. 2024-04-18T05:01:14.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029cf9c640 1 Processor -- start 2024-04-18T05:01:14.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029cf9c640 1 -- start start 2024-04-18T05:01:14.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029cf9c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0280005190 0x7f029814a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029cf9c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0298071ec0 0x7f0298152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029cf9c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02981f1ba0 0x7f02981f2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029cf9c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0298151c10 con 0x7f02981f1ba0 2024-04-18T05:01:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029cf9c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029814b710 con 0x7f0280005190 2024-04-18T05:01:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029cf9c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029814c250 con 0x7f0298071ec0 2024-04-18T05:01:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f0296d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02981f1ba0 0x7f02981f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f0296d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02981f1ba0 0x7f02981f2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40132/0 (socket says 172.21.15.96:40132) 2024-04-18T05:01:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f0296d9d640 1 -- 172.21.15.96:0/3903652605 learned_addr learned my addr 172.21.15.96:0/3903652605 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f0296d9d640 1 -- 172.21.15.96:0/3903652605 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0298071ec0 msgr2=0x7f0298152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f0296d9d640 1 --2- 172.21.15.96:0/3903652605 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0298071ec0 0x7f0298152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f0296d9d640 1 -- 172.21.15.96:0/3903652605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0280005190 msgr2=0x7f029814a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f0296d9d640 1 --2- 172.21.15.96:0/3903652605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0280005190 0x7f029814a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f0296d9d640 1 -- 172.21.15.96:0/3903652605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02981f2560 con 0x7f02981f1ba0 2024-04-18T05:01:14.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f0296d9d640 1 --2- 172.21.15.96:0/3903652605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02981f1ba0 0x7f02981f2020 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f029001c5b0 tx=0x7f0280005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:14.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f0286ffd640 1 -- 172.21.15.96:0/3903652605 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290006d60 con 0x7f02981f1ba0 2024-04-18T05:01:14.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f0286ffd640 1 -- 172.21.15.96:0/3903652605 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0290007dc0 con 0x7f02981f1ba0 2024-04-18T05:01:14.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029cf9c640 1 -- 172.21.15.96:0/3903652605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029814aa00 con 0x7f02981f1ba0 2024-04-18T05:01:14.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f0286ffd640 1 -- 172.21.15.96:0/3903652605 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900a66a0 con 0x7f02981f1ba0 2024-04-18T05:01:14.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.610+0000 7f029cf9c640 1 -- 172.21.15.96:0/3903652605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029814bc00 con 0x7f02981f1ba0 2024-04-18T05:01:14.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.614+0000 7f029cf9c640 1 -- 172.21.15.96:0/3903652605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0298067050 con 0x7f02981f1ba0 2024-04-18T05:01:14.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.614+0000 7f0286ffd640 1 -- 172.21.15.96:0/3903652605 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f02900a6800 con 0x7f02981f1ba0 2024-04-18T05:01:14.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.614+0000 7f0286ffd640 1 --2- 172.21.15.96:0/3903652605 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02780666c0 0x7f0278068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.614+0000 7f0286ffd640 1 -- 172.21.15.96:0/3903652605 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f029011e620 con 0x7f02981f1ba0 2024-04-18T05:01:14.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.614+0000 7f029659c640 1 --2- 172.21.15.96:0/3903652605 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02780666c0 0x7f0278068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.614+0000 7f029659c640 1 --2- 172.21.15.96:0/3903652605 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02780666c0 0x7f0278068b80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f028c000fc0 tx=0x7f028c001160 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:14.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.618+0000 7f0286ffd640 1 -- 172.21.15.96:0/3903652605 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f02900eb8e0 con 0x7f02981f1ba0 2024-04-18T05:01:14.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.770+0000 7f029cf9c640 1 -- 172.21.15.96:0/3903652605 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0298159ec0 con 0x7f02780666c0 2024-04-18T05:01:14.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.790+0000 7f0286ffd640 1 -- 172.21.15.96:0/3903652605 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290133 (secure 0 0 0) 0x7f028c0047f0 con 0x7f02780666c0 2024-04-18T05:01:14.797 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T05:01:14.799 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T05:01:14.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.794+0000 7f029cf9c640 1 -- 172.21.15.96:0/3903652605 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02780666c0 msgr2=0x7f0278068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.794+0000 7f029cf9c640 1 --2- 172.21.15.96:0/3903652605 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02780666c0 0x7f0278068b80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f028c000fc0 tx=0x7f028c001160 comp rx=0 tx=0).stop 2024-04-18T05:01:14.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.794+0000 7f029cf9c640 1 -- 172.21.15.96:0/3903652605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02981f1ba0 msgr2=0x7f02981f2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.794+0000 7f029cf9c640 1 --2- 172.21.15.96:0/3903652605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02981f1ba0 0x7f02981f2020 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f029001c5b0 tx=0x7f0280005800 comp rx=0 tx=0).stop 2024-04-18T05:01:14.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.794+0000 7f029cf9c640 1 -- 172.21.15.96:0/3903652605 shutdown_connections 2024-04-18T05:01:14.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.794+0000 7f029cf9c640 1 --2- 172.21.15.96:0/3903652605 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02780666c0 0x7f0278068b80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.794+0000 7f029cf9c640 1 --2- 172.21.15.96:0/3903652605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02981f1ba0 0x7f02981f2020 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.794+0000 7f029cf9c640 1 --2- 172.21.15.96:0/3903652605 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0298071ec0 0x7f0298152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.794+0000 7f029cf9c640 1 --2- 172.21.15.96:0/3903652605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0280005190 0x7f029814a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.794+0000 7f029cf9c640 1 -- 172.21.15.96:0/3903652605 >> 172.21.15.96:0/3903652605 conn(0x7f029806c750 msgr2=0x7f0298070fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:14.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.794+0000 7f029cf9c640 1 -- 172.21.15.96:0/3903652605 shutdown_connections 2024-04-18T05:01:14.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.794+0000 7f029cf9c640 1 -- 172.21.15.96:0/3903652605 wait complete. 2024-04-18T05:01:14.816 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-04-18T05:01:14.705364+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":131506610,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":2961,"num_read_kb":1326719,"num_write":31940,"num_write_kb":4643491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35450,"ondisk_log_size":35450,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":454048,"kb_used_data":100192,"kb_used_omap":12,"kb_used_meta":353779,"kb_avail":754520672,"statfs":{"total":773094113280,"available":772629168128,"internally_reserved":0,"allocated":102596608,"data_stored":263693236,"data_compressed":36701930,"data_compressed_allocated":47693824,"data_compressed_original":210231296,"omap_allocated":12744,"internal_metadata":362270264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,0,0,14],"upper_bound":128},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003826"},"pg_stats":[{"pgid":"3.3f","version":"23'405","reported_seq":439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374066+0000","last_change":"2024-04-18T04:54:41.199306+0000","last_active":"2024-04-18T05:01:07.374066+0000","last_peered":"2024-04-18T05:01:07.374066+0000","last_clean":"2024-04-18T05:01:07.374066+0000","last_became_active":"2024-04-18T04:54:41.199046+0000","last_became_peered":"2024-04-18T04:54:41.199046+0000","last_unstale":"2024-04-18T05:01:07.374066+0000","last_undegraded":"2024-04-18T05:01:07.374066+0000","last_fullsized":"2024-04-18T05:01:07.374066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9249,"num_write":376,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"23'459","reported_seq":499,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.407426+0000","last_change":"2024-04-18T04:54:41.200447+0000","last_active":"2024-04-18T05:01:07.407426+0000","last_peered":"2024-04-18T05:01:07.407426+0000","last_clean":"2024-04-18T05:01:07.407426+0000","last_became_active":"2024-04-18T04:54:41.200136+0000","last_became_peered":"2024-04-18T04:54:41.200136+0000","last_unstale":"2024-04-18T05:01:07.407426+0000","last_undegraded":"2024-04-18T05:01:07.407426+0000","last_fullsized":"2024-04-18T05:01:07.407426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12666,"num_write":430,"num_write_kb":97067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"23'410","reported_seq":455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.396643+0000","last_change":"2024-04-18T04:54:41.185987+0000","last_active":"2024-04-18T05:01:07.396643+0000","last_peered":"2024-04-18T05:01:07.396643+0000","last_clean":"2024-04-18T05:01:07.396643+0000","last_became_active":"2024-04-18T04:54:41.185206+0000","last_became_peered":"2024-04-18T04:54:41.185206+0000","last_unstale":"2024-04-18T05:01:07.396643+0000","last_undegraded":"2024-04-18T05:01:07.396643+0000","last_fullsized":"2024-04-18T05:01:07.396643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":29819,"num_write":382,"num_write_kb":108666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"23'394","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.380955+0000","last_change":"2024-04-18T04:54:41.177487+0000","last_active":"2024-04-18T05:01:07.380955+0000","last_peered":"2024-04-18T05:01:07.380955+0000","last_clean":"2024-04-18T05:01:07.380955+0000","last_became_active":"2024-04-18T04:54:41.177217+0000","last_became_peered":"2024-04-18T04:54:41.177217+0000","last_unstale":"2024-04-18T05:01:07.380955+0000","last_undegraded":"2024-04-18T05:01:07.380955+0000","last_fullsized":"2024-04-18T05:01:07.380955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:08.067252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22571,"num_write":356,"num_write_kb":80073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"23'390","reported_seq":427,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.400041+0000","last_change":"2024-04-18T04:54:41.186573+0000","last_active":"2024-04-18T05:01:07.400041+0000","last_peered":"2024-04-18T05:01:07.400041+0000","last_clean":"2024-04-18T05:01:07.400041+0000","last_became_active":"2024-04-18T04:54:41.186027+0000","last_became_peered":"2024-04-18T04:54:41.186027+0000","last_unstale":"2024-04-18T05:01:07.400041+0000","last_undegraded":"2024-04-18T05:01:07.400041+0000","last_fullsized":"2024-04-18T05:01:07.400041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13089,"num_write":365,"num_write_kb":22615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"23'374","reported_seq":394,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.378663+0000","last_change":"2024-04-18T04:54:41.177550+0000","last_active":"2024-04-18T05:01:07.378663+0000","last_peered":"2024-04-18T05:01:07.378663+0000","last_clean":"2024-04-18T05:01:07.378663+0000","last_became_active":"2024-04-18T04:54:41.177215+0000","last_became_peered":"2024-04-18T04:54:41.177215+0000","last_unstale":"2024-04-18T05:01:07.378663+0000","last_undegraded":"2024-04-18T05:01:07.378663+0000","last_fullsized":"2024-04-18T05:01:07.378663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:26.266600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":350,"num_write_kb":36922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"23'405","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374455+0000","last_change":"2024-04-18T04:54:41.178605+0000","last_active":"2024-04-18T05:01:07.374455+0000","last_peered":"2024-04-18T05:01:07.374455+0000","last_clean":"2024-04-18T05:01:07.374455+0000","last_became_active":"2024-04-18T04:54:41.178094+0000","last_became_peered":"2024-04-18T04:54:41.178094+0000","last_unstale":"2024-04-18T05:01:07.374455+0000","last_undegraded":"2024-04-18T05:01:07.374455+0000","last_fullsized":"2024-04-18T05:01:07.374455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20531,"num_write":378,"num_write_kb":59118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"23'401","reported_seq":438,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.414199+0000","last_change":"2024-04-18T04:54:41.193174+0000","last_active":"2024-04-18T05:01:07.414199+0000","last_peered":"2024-04-18T05:01:07.414199+0000","last_clean":"2024-04-18T05:01:07.414199+0000","last_became_active":"2024-04-18T04:54:41.192678+0000","last_became_peered":"2024-04-18T04:54:41.192678+0000","last_unstale":"2024-04-18T05:01:07.414199+0000","last_undegraded":"2024-04-18T05:01:07.414199+0000","last_fullsized":"2024-04-18T05:01:07.414199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13567,"num_write":364,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"23'436","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.364148+0000","last_change":"2024-04-18T04:54:41.198121+0000","last_active":"2024-04-18T05:01:07.364148+0000","last_peered":"2024-04-18T05:01:07.364148+0000","last_clean":"2024-04-18T05:01:07.364148+0000","last_became_active":"2024-04-18T04:54:41.197832+0000","last_became_peered":"2024-04-18T04:54:41.197832+0000","last_unstale":"2024-04-18T05:01:07.364148+0000","last_undegraded":"2024-04-18T05:01:07.364148+0000","last_fullsized":"2024-04-18T05:01:07.364148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.835581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28521,"num_write":411,"num_write_kb":104022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"23'396","reported_seq":437,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.379998+0000","last_change":"2024-04-18T04:54:41.183032+0000","last_active":"2024-04-18T05:01:07.379998+0000","last_peered":"2024-04-18T05:01:07.379998+0000","last_clean":"2024-04-18T05:01:07.379998+0000","last_became_active":"2024-04-18T04:54:41.182698+0000","last_became_peered":"2024-04-18T04:54:41.182698+0000","last_unstale":"2024-04-18T05:01:07.379998+0000","last_undegraded":"2024-04-18T05:01:07.379998+0000","last_fullsized":"2024-04-18T05:01:07.379998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13914,"num_write":350,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"23'379","reported_seq":427,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377181+0000","last_change":"2024-04-18T04:54:41.187831+0000","last_active":"2024-04-18T05:01:07.377181+0000","last_peered":"2024-04-18T05:01:07.377181+0000","last_clean":"2024-04-18T05:01:07.377181+0000","last_became_active":"2024-04-18T04:54:41.187360+0000","last_became_peered":"2024-04-18T04:54:41.187360+0000","last_unstale":"2024-04-18T05:01:07.377181+0000","last_undegraded":"2024-04-18T05:01:07.377181+0000","last_fullsized":"2024-04-18T05:01:07.377181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18312,"num_write":357,"num_write_kb":34101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"23'361","reported_seq":410,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377628+0000","last_change":"2024-04-18T04:54:41.188641+0000","last_active":"2024-04-18T05:01:07.377628+0000","last_peered":"2024-04-18T05:01:07.377628+0000","last_clean":"2024-04-18T05:01:07.377628+0000","last_became_active":"2024-04-18T04:54:41.188281+0000","last_became_peered":"2024-04-18T04:54:41.188281+0000","last_unstale":"2024-04-18T05:01:07.377628+0000","last_undegraded":"2024-04-18T05:01:07.377628+0000","last_fullsized":"2024-04-18T05:01:07.377628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21304,"num_write":338,"num_write_kb":54980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"23'375","reported_seq":405,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394838+0000","last_change":"2024-04-18T04:54:41.194578+0000","last_active":"2024-04-18T05:01:07.394838+0000","last_peered":"2024-04-18T05:01:07.394838+0000","last_clean":"2024-04-18T05:01:07.394838+0000","last_became_active":"2024-04-18T04:54:41.190882+0000","last_became_peered":"2024-04-18T04:54:41.190882+0000","last_unstale":"2024-04-18T05:01:07.394838+0000","last_undegraded":"2024-04-18T05:01:07.394838+0000","last_fullsized":"2024-04-18T05:01:07.394838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:45:52.041196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7725,"num_write":337,"num_write_kb":21712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"23'417","reported_seq":490,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.393436+0000","last_change":"2024-04-18T04:54:41.190210+0000","last_active":"2024-04-18T05:01:07.393436+0000","last_peered":"2024-04-18T05:01:07.393436+0000","last_clean":"2024-04-18T05:01:07.393436+0000","last_became_active":"2024-04-18T04:54:41.189813+0000","last_became_peered":"2024-04-18T04:54:41.189813+0000","last_unstale":"2024-04-18T05:01:07.393436+0000","last_undegraded":"2024-04-18T05:01:07.393436+0000","last_fullsized":"2024-04-18T05:01:07.393436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:38:02.632458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":28320,"num_write":390,"num_write_kb":71764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"23'445","reported_seq":532,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.406236+0000","last_change":"2024-04-18T04:54:41.183027+0000","last_active":"2024-04-18T05:01:07.406236+0000","last_peered":"2024-04-18T05:01:07.406236+0000","last_clean":"2024-04-18T05:01:07.406236+0000","last_became_active":"2024-04-18T04:54:41.182713+0000","last_became_peered":"2024-04-18T04:54:41.182713+0000","last_unstale":"2024-04-18T05:01:07.406236+0000","last_undegraded":"2024-04-18T05:01:07.406236+0000","last_fullsized":"2024-04-18T05:01:07.406236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":36644,"num_write":412,"num_write_kb":104908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"23'442","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.364940+0000","last_change":"2024-04-18T04:54:41.186060+0000","last_active":"2024-04-18T05:01:07.364940+0000","last_peered":"2024-04-18T05:01:07.364940+0000","last_clean":"2024-04-18T05:01:07.364940+0000","last_became_active":"2024-04-18T04:54:41.185803+0000","last_became_peered":"2024-04-18T04:54:41.185803+0000","last_unstale":"2024-04-18T05:01:07.364940+0000","last_undegraded":"2024-04-18T05:01:07.364940+0000","last_fullsized":"2024-04-18T05:01:07.364940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:48:04.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21979,"num_write":411,"num_write_kb":59643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"23'407","reported_seq":466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.370476+0000","last_change":"2024-04-18T04:54:41.200802+0000","last_active":"2024-04-18T05:01:07.370476+0000","last_peered":"2024-04-18T05:01:07.370476+0000","last_clean":"2024-04-18T05:01:07.370476+0000","last_became_active":"2024-04-18T04:54:41.198404+0000","last_became_peered":"2024-04-18T04:54:41.198404+0000","last_unstale":"2024-04-18T05:01:07.370476+0000","last_undegraded":"2024-04-18T05:01:07.370476+0000","last_fullsized":"2024-04-18T05:01:07.370476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:56.686481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22314,"num_write":375,"num_write_kb":43056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"23'414","reported_seq":469,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.382501+0000","last_change":"2024-04-18T04:54:41.189568+0000","last_active":"2024-04-18T05:01:07.382501+0000","last_peered":"2024-04-18T05:01:07.382501+0000","last_clean":"2024-04-18T05:01:07.382501+0000","last_became_active":"2024-04-18T04:54:41.188139+0000","last_became_peered":"2024-04-18T04:54:41.188139+0000","last_unstale":"2024-04-18T05:01:07.382501+0000","last_undegraded":"2024-04-18T05:01:07.382501+0000","last_fullsized":"2024-04-18T05:01:07.382501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21874,"num_write":387,"num_write_kb":84204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"23'431","reported_seq":505,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.375011+0000","last_change":"2024-04-18T04:54:41.197901+0000","last_active":"2024-04-18T05:01:07.375011+0000","last_peered":"2024-04-18T05:01:07.375011+0000","last_clean":"2024-04-18T05:01:07.375011+0000","last_became_active":"2024-04-18T04:54:41.197235+0000","last_became_peered":"2024-04-18T04:54:41.197235+0000","last_unstale":"2024-04-18T05:01:07.375011+0000","last_undegraded":"2024-04-18T05:01:07.375011+0000","last_fullsized":"2024-04-18T05:01:07.375011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:41:20.213202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40070,"num_write":398,"num_write_kb":116642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"23'437","reported_seq":508,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377558+0000","last_change":"2024-04-18T04:54:41.188440+0000","last_active":"2024-04-18T05:01:07.377558+0000","last_peered":"2024-04-18T05:01:07.377558+0000","last_clean":"2024-04-18T05:01:07.377558+0000","last_became_active":"2024-04-18T04:54:41.187925+0000","last_became_peered":"2024-04-18T04:54:41.187925+0000","last_unstale":"2024-04-18T05:01:07.377558+0000","last_undegraded":"2024-04-18T05:01:07.377558+0000","last_fullsized":"2024-04-18T05:01:07.377558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27418,"num_write":411,"num_write_kb":67043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"23'413","reported_seq":488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.383040+0000","last_change":"2024-04-18T04:54:41.179672+0000","last_active":"2024-04-18T05:01:07.383040+0000","last_peered":"2024-04-18T05:01:07.383040+0000","last_clean":"2024-04-18T05:01:07.383040+0000","last_became_active":"2024-04-18T04:54:41.178963+0000","last_became_peered":"2024-04-18T04:54:41.178963+0000","last_unstale":"2024-04-18T05:01:07.383040+0000","last_undegraded":"2024-04-18T05:01:07.383040+0000","last_fullsized":"2024-04-18T05:01:07.383040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:56:31.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32437,"num_write":394,"num_write_kb":88243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"23'442","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.366521+0000","last_change":"2024-04-18T04:54:41.182902+0000","last_active":"2024-04-18T05:01:07.366521+0000","last_peered":"2024-04-18T05:01:07.366521+0000","last_clean":"2024-04-18T05:01:07.366521+0000","last_became_active":"2024-04-18T04:54:41.182664+0000","last_became_peered":"2024-04-18T04:54:41.182664+0000","last_unstale":"2024-04-18T05:01:07.366521+0000","last_undegraded":"2024-04-18T05:01:07.366521+0000","last_fullsized":"2024-04-18T05:01:07.366521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:56.408926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34086,"num_write":411,"num_write_kb":96499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"23'434","reported_seq":502,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.406363+0000","last_change":"2024-04-18T04:54:41.187578+0000","last_active":"2024-04-18T05:01:07.406363+0000","last_peered":"2024-04-18T05:01:07.406363+0000","last_clean":"2024-04-18T05:01:07.406363+0000","last_became_active":"2024-04-18T04:54:41.186881+0000","last_became_peered":"2024-04-18T04:54:41.186881+0000","last_unstale":"2024-04-18T05:01:07.406363+0000","last_undegraded":"2024-04-18T05:01:07.406363+0000","last_fullsized":"2024-04-18T05:01:07.406363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:27.817916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":24295,"num_write":395,"num_write_kb":96064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"23'465","reported_seq":582,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.408101+0000","last_change":"2024-04-18T04:54:41.193206+0000","last_active":"2024-04-18T05:01:07.408101+0000","last_peered":"2024-04-18T05:01:07.408101+0000","last_clean":"2024-04-18T05:01:07.408101+0000","last_became_active":"2024-04-18T04:54:41.192740+0000","last_became_peered":"2024-04-18T04:54:41.192740+0000","last_unstale":"2024-04-18T05:01:07.408101+0000","last_undegraded":"2024-04-18T05:01:07.408101+0000","last_fullsized":"2024-04-18T05:01:07.408101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:51:34.311826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61562,"num_write":441,"num_write_kb":100539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"23'390","reported_seq":438,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.411713+0000","last_change":"2024-04-18T04:54:41.192785+0000","last_active":"2024-04-18T05:01:07.411713+0000","last_peered":"2024-04-18T05:01:07.411713+0000","last_clean":"2024-04-18T05:01:07.411713+0000","last_became_active":"2024-04-18T04:54:41.192280+0000","last_became_peered":"2024-04-18T04:54:41.192280+0000","last_unstale":"2024-04-18T05:01:07.411713+0000","last_undegraded":"2024-04-18T05:01:07.411713+0000","last_fullsized":"2024-04-18T05:01:07.411713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18903,"num_write":377,"num_write_kb":34298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"23'490","reported_seq":559,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.381743+0000","last_change":"2024-04-18T04:54:41.193920+0000","last_active":"2024-04-18T05:01:07.381743+0000","last_peered":"2024-04-18T05:01:07.381743+0000","last_clean":"2024-04-18T05:01:07.381743+0000","last_became_active":"2024-04-18T04:54:41.193660+0000","last_became_peered":"2024-04-18T04:54:41.193660+0000","last_unstale":"2024-04-18T05:01:07.381743+0000","last_undegraded":"2024-04-18T05:01:07.381743+0000","last_fullsized":"2024-04-18T05:01:07.381743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:22.072498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26760,"num_write":458,"num_write_kb":125465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"23'432","reported_seq":525,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.392934+0000","last_change":"2024-04-18T04:54:41.190298+0000","last_active":"2024-04-18T05:01:07.392934+0000","last_peered":"2024-04-18T05:01:07.392934+0000","last_clean":"2024-04-18T05:01:07.392934+0000","last_became_active":"2024-04-18T04:54:41.189374+0000","last_became_peered":"2024-04-18T04:54:41.189374+0000","last_unstale":"2024-04-18T05:01:07.392934+0000","last_undegraded":"2024-04-18T05:01:07.392934+0000","last_fullsized":"2024-04-18T05:01:07.392934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43719,"num_write":406,"num_write_kb":145399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"23'384","reported_seq":437,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394954+0000","last_change":"2024-04-18T04:54:41.190403+0000","last_active":"2024-04-18T05:01:07.394954+0000","last_peered":"2024-04-18T05:01:07.394954+0000","last_clean":"2024-04-18T05:01:07.394954+0000","last_became_active":"2024-04-18T04:54:41.189660+0000","last_became_peered":"2024-04-18T04:54:41.189660+0000","last_unstale":"2024-04-18T05:01:07.394954+0000","last_undegraded":"2024-04-18T05:01:07.394954+0000","last_fullsized":"2024-04-18T05:01:07.394954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:34.259279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17737,"num_write":357,"num_write_kb":75727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"23'427","reported_seq":500,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.399293+0000","last_change":"2024-04-18T04:54:41.187370+0000","last_active":"2024-04-18T05:01:07.399293+0000","last_peered":"2024-04-18T05:01:07.399293+0000","last_clean":"2024-04-18T05:01:07.399293+0000","last_became_active":"2024-04-18T04:54:41.186901+0000","last_became_peered":"2024-04-18T04:54:41.186901+0000","last_unstale":"2024-04-18T05:01:07.399293+0000","last_undegraded":"2024-04-18T05:01:07.399293+0000","last_fullsized":"2024-04-18T05:01:07.399293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30499,"num_write":394,"num_write_kb":84601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"23'468","reported_seq":510,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.402883+0000","last_change":"2024-04-18T04:54:41.192719+0000","last_active":"2024-04-18T05:01:07.402883+0000","last_peered":"2024-04-18T05:01:07.402883+0000","last_clean":"2024-04-18T05:01:07.402883+0000","last_became_active":"2024-04-18T04:54:41.192114+0000","last_became_peered":"2024-04-18T04:54:41.192114+0000","last_unstale":"2024-04-18T05:01:07.402883+0000","last_undegraded":"2024-04-18T05:01:07.402883+0000","last_fullsized":"2024-04-18T05:01:07.402883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:33:21.965783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13784,"num_write":434,"num_write_kb":79847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"23'421","reported_seq":471,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.379914+0000","last_change":"2024-04-18T04:54:41.186276+0000","last_active":"2024-04-18T05:01:07.379914+0000","last_peered":"2024-04-18T05:01:07.379914+0000","last_clean":"2024-04-18T05:01:07.379914+0000","last_became_active":"2024-04-18T04:54:41.185915+0000","last_became_peered":"2024-04-18T04:54:41.185915+0000","last_unstale":"2024-04-18T05:01:07.379914+0000","last_undegraded":"2024-04-18T05:01:07.379914+0000","last_fullsized":"2024-04-18T05:01:07.379914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":22283,"num_write":389,"num_write_kb":42482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"23'415","reported_seq":485,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.395003+0000","last_change":"2024-04-18T04:54:41.190283+0000","last_active":"2024-04-18T05:01:07.395003+0000","last_peered":"2024-04-18T05:01:07.395003+0000","last_clean":"2024-04-18T05:01:07.395003+0000","last_became_active":"2024-04-18T04:54:41.189892+0000","last_became_peered":"2024-04-18T04:54:41.189892+0000","last_unstale":"2024-04-18T05:01:07.395003+0000","last_undegraded":"2024-04-18T05:01:07.395003+0000","last_fullsized":"2024-04-18T05:01:07.395003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:53.175178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36029,"num_write":387,"num_write_kb":59223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'420","reported_seq":479,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.410442+0000","last_change":"2024-04-18T04:54:41.187326+0000","last_active":"2024-04-18T05:01:07.410442+0000","last_peered":"2024-04-18T05:01:07.410442+0000","last_clean":"2024-04-18T05:01:07.410442+0000","last_became_active":"2024-04-18T04:54:41.187001+0000","last_became_peered":"2024-04-18T04:54:41.187001+0000","last_unstale":"2024-04-18T05:01:07.410442+0000","last_undegraded":"2024-04-18T05:01:07.410442+0000","last_fullsized":"2024-04-18T05:01:07.410442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19127,"num_write":391,"num_write_kb":83892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'97","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.985326+0000","last_change":"2024-04-18T04:54:40.824658+0000","last_active":"2024-04-18T05:00:02.985326+0000","last_peered":"2024-04-18T05:00:02.985326+0000","last_clean":"2024-04-18T05:00:02.985326+0000","last_became_active":"2024-04-18T04:54:40.823652+0000","last_became_peered":"2024-04-18T04:54:40.823652+0000","last_unstale":"2024-04-18T05:00:02.985326+0000","last_undegraded":"2024-04-18T05:00:02.985326+0000","last_fullsized":"2024-04-18T05:00:02.985326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195462,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"23'366","reported_seq":402,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.382420+0000","last_change":"2024-04-18T04:55:39.828560+0000","last_active":"2024-04-18T05:01:07.382420+0000","last_peered":"2024-04-18T05:01:07.382420+0000","last_clean":"2024-04-18T05:01:07.382420+0000","last_became_active":"2024-04-18T04:55:39.827671+0000","last_became_peered":"2024-04-18T04:55:39.827671+0000","last_unstale":"2024-04-18T05:01:07.382420+0000","last_undegraded":"2024-04-18T05:01:07.382420+0000","last_fullsized":"2024-04-18T05:01:07.382420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:24:21.418171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13158,"num_write":336,"num_write_kb":38014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'539","reported_seq":553,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:00.987547+0000","last_change":"2024-04-18T04:54:40.803244+0000","last_active":"2024-04-18T05:00:00.987547+0000","last_peered":"2024-04-18T05:00:00.987547+0000","last_clean":"2024-04-18T05:00:00.987547+0000","last_became_active":"2024-04-18T04:54:40.802672+0000","last_became_peered":"2024-04-18T04:54:40.802672+0000","last_unstale":"2024-04-18T05:00:00.987547+0000","last_undegraded":"2024-04-18T05:00:00.987547+0000","last_fullsized":"2024-04-18T05:00:00.987547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:56.851301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":487,"num_write_kb":12578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'415","reported_seq":430,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.042647+0000","last_change":"2024-04-18T04:54:40.823675+0000","last_active":"2024-04-18T05:00:02.042647+0000","last_peered":"2024-04-18T05:00:02.042647+0000","last_clean":"2024-04-18T05:00:02.042647+0000","last_became_active":"2024-04-18T04:54:40.823091+0000","last_became_peered":"2024-04-18T04:54:40.823091+0000","last_unstale":"2024-04-18T05:00:02.042647+0000","last_undegraded":"2024-04-18T05:00:02.042647+0000","last_fullsized":"2024-04-18T05:00:02.042647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":4340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"23'429","reported_seq":457,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.413269+0000","last_change":"2024-04-18T04:54:41.200326+0000","last_active":"2024-04-18T05:01:07.413269+0000","last_peered":"2024-04-18T05:01:07.413269+0000","last_clean":"2024-04-18T05:01:07.413269+0000","last_became_active":"2024-04-18T04:54:41.199690+0000","last_became_peered":"2024-04-18T04:54:41.199690+0000","last_unstale":"2024-04-18T05:01:07.413269+0000","last_undegraded":"2024-04-18T05:01:07.413269+0000","last_fullsized":"2024-04-18T05:01:07.413269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5535,"num_write":391,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'954","reported_seq":968,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.039751+0000","last_change":"2024-04-18T04:54:40.805264+0000","last_active":"2024-04-18T05:00:02.039751+0000","last_peered":"2024-04-18T05:00:02.039751+0000","last_clean":"2024-04-18T05:00:02.039751+0000","last_became_active":"2024-04-18T04:54:40.804605+0000","last_became_peered":"2024-04-18T04:54:40.804605+0000","last_unstale":"2024-04-18T05:00:02.039751+0000","last_undegraded":"2024-04-18T05:00:02.039751+0000","last_fullsized":"2024-04-18T05:00:02.039751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:48.991270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"23'422","reported_seq":469,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.372623+0000","last_change":"2024-04-18T04:54:41.175359+0000","last_active":"2024-04-18T05:01:07.372623+0000","last_peered":"2024-04-18T05:01:07.372623+0000","last_clean":"2024-04-18T05:01:07.372623+0000","last_became_active":"2024-04-18T04:54:41.175137+0000","last_became_peered":"2024-04-18T04:54:41.175137+0000","last_unstale":"2024-04-18T05:01:07.372623+0000","last_undegraded":"2024-04-18T05:01:07.372623+0000","last_fullsized":"2024-04-18T05:01:07.372623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:06:24.271204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21971,"num_write":395,"num_write_kb":63063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'67","reported_seq":82,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.319843+0000","last_change":"2024-04-18T04:54:40.798936+0000","last_active":"2024-04-18T05:01:07.319843+0000","last_peered":"2024-04-18T05:01:07.319843+0000","last_clean":"2024-04-18T05:01:07.319843+0000","last_became_active":"2024-04-18T04:54:40.798572+0000","last_became_peered":"2024-04-18T04:54:40.798572+0000","last_unstale":"2024-04-18T05:01:07.319843+0000","last_undegraded":"2024-04-18T05:01:07.319843+0000","last_fullsized":"2024-04-18T05:01:07.319843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'432","reported_seq":484,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.382097+0000","last_change":"2024-04-18T04:54:41.188280+0000","last_active":"2024-04-18T05:01:07.382097+0000","last_peered":"2024-04-18T05:01:07.382097+0000","last_clean":"2024-04-18T05:01:07.382097+0000","last_became_active":"2024-04-18T04:54:41.188012+0000","last_became_peered":"2024-04-18T04:54:41.188012+0000","last_unstale":"2024-04-18T05:01:07.382097+0000","last_undegraded":"2024-04-18T05:01:07.382097+0000","last_fullsized":"2024-04-18T05:01:07.382097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:11.319118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13773,"num_write":397,"num_write_kb":43173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'334","reported_seq":349,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.019065+0000","last_change":"2024-04-18T04:54:40.802894+0000","last_active":"2024-04-18T05:00:05.019065+0000","last_peered":"2024-04-18T05:00:05.019065+0000","last_clean":"2024-04-18T05:00:05.019065+0000","last_became_active":"2024-04-18T04:54:40.801406+0000","last_became_peered":"2024-04-18T04:54:40.801406+0000","last_unstale":"2024-04-18T05:00:05.019065+0000","last_undegraded":"2024-04-18T05:00:05.019065+0000","last_fullsized":"2024-04-18T05:00:05.019065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"23'397","reported_seq":432,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.409498+0000","last_change":"2024-04-18T04:54:41.203407+0000","last_active":"2024-04-18T05:01:07.409498+0000","last_peered":"2024-04-18T05:01:07.409498+0000","last_clean":"2024-04-18T05:01:07.409498+0000","last_became_active":"2024-04-18T04:54:41.203186+0000","last_became_peered":"2024-04-18T04:54:41.203186+0000","last_unstale":"2024-04-18T05:01:07.409498+0000","last_undegraded":"2024-04-18T05:01:07.409498+0000","last_fullsized":"2024-04-18T05:01:07.409498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:23:50.107054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14488,"num_write":364,"num_write_kb":75349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'188","reported_seq":203,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.064184+0000","last_change":"2024-04-18T04:54:40.822014+0000","last_active":"2024-04-18T05:00:06.064184+0000","last_peered":"2024-04-18T05:00:06.064184+0000","last_clean":"2024-04-18T05:00:06.064184+0000","last_became_active":"2024-04-18T04:54:40.820920+0000","last_became_peered":"2024-04-18T04:54:40.820920+0000","last_unstale":"2024-04-18T05:00:06.064184+0000","last_undegraded":"2024-04-18T05:00:06.064184+0000","last_fullsized":"2024-04-18T05:00:06.064184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"23'394","reported_seq":443,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.365245+0000","last_change":"2024-04-18T04:54:41.197254+0000","last_active":"2024-04-18T05:01:07.365245+0000","last_peered":"2024-04-18T05:01:07.365245+0000","last_clean":"2024-04-18T05:01:07.365245+0000","last_became_active":"2024-04-18T04:54:41.196927+0000","last_became_peered":"2024-04-18T04:54:41.196927+0000","last_unstale":"2024-04-18T05:01:07.365245+0000","last_undegraded":"2024-04-18T05:01:07.365245+0000","last_fullsized":"2024-04-18T05:01:07.365245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:01:45.182766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21129,"num_write":360,"num_write_kb":71528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'444","reported_seq":459,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.323010+0000","last_change":"2024-04-18T04:54:40.801789+0000","last_active":"2024-04-18T05:01:07.323010+0000","last_peered":"2024-04-18T05:01:07.323010+0000","last_clean":"2024-04-18T05:01:07.323010+0000","last_became_active":"2024-04-18T04:54:40.801403+0000","last_became_peered":"2024-04-18T04:54:40.801403+0000","last_unstale":"2024-04-18T05:01:07.323010+0000","last_undegraded":"2024-04-18T05:01:07.323010+0000","last_fullsized":"2024-04-18T05:01:07.323010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:15:11.220095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12011434,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":11980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'396","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394971+0000","last_change":"2024-04-18T04:54:41.195518+0000","last_active":"2024-04-18T05:01:07.394971+0000","last_peered":"2024-04-18T05:01:07.394971+0000","last_clean":"2024-04-18T05:01:07.394971+0000","last_became_active":"2024-04-18T04:54:41.195172+0000","last_became_peered":"2024-04-18T04:54:41.195172+0000","last_unstale":"2024-04-18T05:01:07.394971+0000","last_undegraded":"2024-04-18T05:01:07.394971+0000","last_fullsized":"2024-04-18T05:01:07.394971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19873,"num_write":365,"num_write_kb":71837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'583","reported_seq":598,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T04:59:57.951802+0000","last_change":"2024-04-18T04:54:40.818390+0000","last_active":"2024-04-18T04:59:57.951802+0000","last_peered":"2024-04-18T04:59:57.951802+0000","last_clean":"2024-04-18T04:59:57.951802+0000","last_became_active":"2024-04-18T04:54:40.817681+0000","last_became_peered":"2024-04-18T04:54:40.817681+0000","last_unstale":"2024-04-18T04:59:57.951802+0000","last_undegraded":"2024-04-18T04:59:57.951802+0000","last_fullsized":"2024-04-18T04:59:57.951802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"23'417","reported_seq":443,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.392565+0000","last_change":"2024-04-18T04:54:41.194807+0000","last_active":"2024-04-18T05:01:07.392565+0000","last_peered":"2024-04-18T05:01:07.392565+0000","last_clean":"2024-04-18T05:01:07.392565+0000","last_became_active":"2024-04-18T04:54:41.194499+0000","last_became_peered":"2024-04-18T04:54:41.194499+0000","last_unstale":"2024-04-18T05:01:07.392565+0000","last_undegraded":"2024-04-18T05:01:07.392565+0000","last_fullsized":"2024-04-18T05:01:07.392565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":380,"num_write_kb":59449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"23'70","reported_seq":84,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.004709+0000","last_change":"2024-04-18T04:54:40.817631+0000","last_active":"2024-04-18T05:00:06.004709+0000","last_peered":"2024-04-18T05:00:06.004709+0000","last_clean":"2024-04-18T05:00:06.004709+0000","last_became_active":"2024-04-18T04:54:40.817370+0000","last_became_peered":"2024-04-18T04:54:40.817370+0000","last_unstale":"2024-04-18T05:00:06.004709+0000","last_undegraded":"2024-04-18T05:00:06.004709+0000","last_fullsized":"2024-04-18T05:00:06.004709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'400","reported_seq":472,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377439+0000","last_change":"2024-04-18T04:54:41.193363+0000","last_active":"2024-04-18T05:01:07.377439+0000","last_peered":"2024-04-18T05:01:07.377439+0000","last_clean":"2024-04-18T05:01:07.377439+0000","last_became_active":"2024-04-18T04:54:41.192889+0000","last_became_peered":"2024-04-18T04:54:41.192889+0000","last_unstale":"2024-04-18T05:01:07.377439+0000","last_undegraded":"2024-04-18T05:01:07.377439+0000","last_fullsized":"2024-04-18T05:01:07.377439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30891,"num_write":363,"num_write_kb":81664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"23'67","reported_seq":82,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.985062+0000","last_change":"2024-04-18T04:54:40.806633+0000","last_active":"2024-04-18T05:00:03.985062+0000","last_peered":"2024-04-18T05:00:03.985062+0000","last_clean":"2024-04-18T05:00:03.985062+0000","last_became_active":"2024-04-18T04:54:40.805965+0000","last_became_peered":"2024-04-18T04:54:40.805965+0000","last_unstale":"2024-04-18T05:00:03.985062+0000","last_undegraded":"2024-04-18T05:00:03.985062+0000","last_fullsized":"2024-04-18T05:00:03.985062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1124,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'449","reported_seq":495,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.410877+0000","last_change":"2024-04-18T04:54:41.184321+0000","last_active":"2024-04-18T05:01:07.410877+0000","last_peered":"2024-04-18T05:01:07.410877+0000","last_clean":"2024-04-18T05:01:07.410877+0000","last_became_active":"2024-04-18T04:54:41.183838+0000","last_became_peered":"2024-04-18T04:54:41.183838+0000","last_unstale":"2024-04-18T05:01:07.410877+0000","last_undegraded":"2024-04-18T05:01:07.410877+0000","last_fullsized":"2024-04-18T05:01:07.410877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14210,"num_write":423,"num_write_kb":80124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'80","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.004824+0000","last_change":"2024-04-18T04:54:40.818954+0000","last_active":"2024-04-18T05:00:06.004824+0000","last_peered":"2024-04-18T05:00:06.004824+0000","last_clean":"2024-04-18T05:00:06.004824+0000","last_became_active":"2024-04-18T04:54:40.818227+0000","last_became_peered":"2024-04-18T04:54:40.818227+0000","last_unstale":"2024-04-18T05:00:06.004824+0000","last_undegraded":"2024-04-18T05:00:06.004824+0000","last_fullsized":"2024-04-18T05:00:06.004824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:30:25.263089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"23'493","reported_seq":553,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.364760+0000","last_change":"2024-04-18T04:54:41.192227+0000","last_active":"2024-04-18T05:01:07.364760+0000","last_peered":"2024-04-18T05:01:07.364760+0000","last_clean":"2024-04-18T05:01:07.364760+0000","last_became_active":"2024-04-18T04:54:41.187002+0000","last_became_peered":"2024-04-18T04:54:41.187002+0000","last_unstale":"2024-04-18T05:01:07.364760+0000","last_undegraded":"2024-04-18T05:01:07.364760+0000","last_fullsized":"2024-04-18T05:01:07.364760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":24156,"num_write":458,"num_write_kb":105037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'199","reported_seq":214,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.106627+0000","last_change":"2024-04-18T04:54:40.805795+0000","last_active":"2024-04-18T05:00:05.106627+0000","last_peered":"2024-04-18T05:00:05.106627+0000","last_clean":"2024-04-18T05:00:05.106627+0000","last_became_active":"2024-04-18T04:54:40.802550+0000","last_became_peered":"2024-04-18T04:54:40.802550+0000","last_unstale":"2024-04-18T05:00:05.106627+0000","last_undegraded":"2024-04-18T05:00:05.106627+0000","last_fullsized":"2024-04-18T05:00:05.106627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'364","reported_seq":403,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.373214+0000","last_change":"2024-04-18T04:54:41.180426+0000","last_active":"2024-04-18T05:01:07.373214+0000","last_peered":"2024-04-18T05:01:07.373214+0000","last_clean":"2024-04-18T05:01:07.373214+0000","last_became_active":"2024-04-18T04:54:41.179540+0000","last_became_peered":"2024-04-18T04:54:41.179540+0000","last_unstale":"2024-04-18T05:01:07.373214+0000","last_undegraded":"2024-04-18T05:01:07.373214+0000","last_fullsized":"2024-04-18T05:01:07.373214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:38:25.074053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16384,"num_write":332,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'304","reported_seq":319,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:01.025031+0000","last_change":"2024-04-18T04:54:40.804284+0000","last_active":"2024-04-18T05:00:01.025031+0000","last_peered":"2024-04-18T05:00:01.025031+0000","last_clean":"2024-04-18T05:00:01.025031+0000","last_became_active":"2024-04-18T04:54:40.803464+0000","last_became_peered":"2024-04-18T04:54:40.803464+0000","last_unstale":"2024-04-18T05:00:01.025031+0000","last_undegraded":"2024-04-18T05:00:01.025031+0000","last_fullsized":"2024-04-18T05:00:01.025031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:20:52.171667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"23'391","reported_seq":433,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377810+0000","last_change":"2024-04-18T04:54:41.188591+0000","last_active":"2024-04-18T05:01:07.377810+0000","last_peered":"2024-04-18T05:01:07.377810+0000","last_clean":"2024-04-18T05:01:07.377810+0000","last_became_active":"2024-04-18T04:54:41.188152+0000","last_became_peered":"2024-04-18T04:54:41.188152+0000","last_unstale":"2024-04-18T05:01:07.377810+0000","last_undegraded":"2024-04-18T05:01:07.377810+0000","last_fullsized":"2024-04-18T05:01:07.377810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15853,"num_write":356,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'535","reported_seq":549,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.991447+0000","last_change":"2024-04-18T04:54:40.814901+0000","last_active":"2024-04-18T05:00:02.991447+0000","last_peered":"2024-04-18T05:00:02.991447+0000","last_clean":"2024-04-18T05:00:02.991447+0000","last_became_active":"2024-04-18T04:54:40.814207+0000","last_became_peered":"2024-04-18T04:54:40.814207+0000","last_unstale":"2024-04-18T05:00:02.991447+0000","last_undegraded":"2024-04-18T05:00:02.991447+0000","last_fullsized":"2024-04-18T05:00:02.991447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"23'425","reported_seq":468,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.378034+0000","last_change":"2024-04-18T04:54:41.188664+0000","last_active":"2024-04-18T05:01:07.378034+0000","last_peered":"2024-04-18T05:01:07.378034+0000","last_clean":"2024-04-18T05:01:07.378034+0000","last_became_active":"2024-04-18T04:54:41.188249+0000","last_became_peered":"2024-04-18T04:54:41.188249+0000","last_unstale":"2024-04-18T05:01:07.378034+0000","last_undegraded":"2024-04-18T05:01:07.378034+0000","last_fullsized":"2024-04-18T05:01:07.378034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14420,"num_write":396,"num_write_kb":51045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'76","reported_seq":91,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.044489+0000","last_change":"2024-04-18T04:54:40.828447+0000","last_active":"2024-04-18T05:00:05.044489+0000","last_peered":"2024-04-18T05:00:05.044489+0000","last_clean":"2024-04-18T05:00:05.044489+0000","last_became_active":"2024-04-18T04:54:40.823755+0000","last_became_peered":"2024-04-18T04:54:40.823755+0000","last_unstale":"2024-04-18T05:00:05.044489+0000","last_undegraded":"2024-04-18T05:00:05.044489+0000","last_fullsized":"2024-04-18T05:00:05.044489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1706,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'402","reported_seq":434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.371709+0000","last_change":"2024-04-18T04:54:41.186523+0000","last_active":"2024-04-18T05:01:07.371709+0000","last_peered":"2024-04-18T05:01:07.371709+0000","last_clean":"2024-04-18T05:01:07.371709+0000","last_became_active":"2024-04-18T04:54:41.186149+0000","last_became_peered":"2024-04-18T04:54:41.186149+0000","last_unstale":"2024-04-18T05:01:07.371709+0000","last_undegraded":"2024-04-18T05:01:07.371709+0000","last_fullsized":"2024-04-18T05:01:07.371709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7713,"num_write":373,"num_write_kb":46594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T04:58:35.620748+0000","last_change":"2024-04-18T04:54:35.674328+0000","last_active":"2024-04-18T04:58:35.620748+0000","last_peered":"2024-04-18T04:58:35.620748+0000","last_clean":"2024-04-18T04:58:35.620748+0000","last_became_active":"2024-04-18T04:54:35.672457+0000","last_became_peered":"2024-04-18T04:54:35.672457+0000","last_unstale":"2024-04-18T04:58:35.620748+0000","last_undegraded":"2024-04-18T04:58:35.620748+0000","last_fullsized":"2024-04-18T04:58:35.620748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_clean_scrub_stamp":"2024-04-18T04:54:33.597974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:02:10.966568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'71","reported_seq":86,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.016000+0000","last_change":"2024-04-18T04:54:40.802422+0000","last_active":"2024-04-18T05:00:06.016000+0000","last_peered":"2024-04-18T05:00:06.016000+0000","last_clean":"2024-04-18T05:00:06.016000+0000","last_became_active":"2024-04-18T04:54:40.801083+0000","last_became_peered":"2024-04-18T04:54:40.801083+0000","last_unstale":"2024-04-18T05:00:06.016000+0000","last_undegraded":"2024-04-18T05:00:06.016000+0000","last_fullsized":"2024-04-18T05:00:06.016000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'362","reported_seq":382,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.383454+0000","last_change":"2024-04-18T04:54:41.174658+0000","last_active":"2024-04-18T05:01:07.383454+0000","last_peered":"2024-04-18T05:01:07.383454+0000","last_clean":"2024-04-18T05:01:07.383454+0000","last_became_active":"2024-04-18T04:54:41.174391+0000","last_became_peered":"2024-04-18T04:54:41.174391+0000","last_unstale":"2024-04-18T05:01:07.383454+0000","last_undegraded":"2024-04-18T05:01:07.383454+0000","last_fullsized":"2024-04-18T05:01:07.383454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:28:24.015964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1626,"num_write":331,"num_write_kb":26059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'438","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.117713+0000","last_change":"2024-04-18T04:54:40.813770+0000","last_active":"2024-04-18T05:00:05.117713+0000","last_peered":"2024-04-18T05:00:05.117713+0000","last_clean":"2024-04-18T05:00:05.117713+0000","last_became_active":"2024-04-18T04:54:40.813396+0000","last_became_peered":"2024-04-18T04:54:40.813396+0000","last_unstale":"2024-04-18T05:00:05.117713+0000","last_undegraded":"2024-04-18T05:00:05.117713+0000","last_fullsized":"2024-04-18T05:00:05.117713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":379,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'410","reported_seq":523,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394590+0000","last_change":"2024-04-18T04:54:41.195440+0000","last_active":"2024-04-18T05:01:07.394590+0000","last_peered":"2024-04-18T05:01:07.394590+0000","last_clean":"2024-04-18T05:01:07.394590+0000","last_became_active":"2024-04-18T04:54:41.195152+0000","last_became_peered":"2024-04-18T04:54:41.195152+0000","last_unstale":"2024-04-18T05:01:07.394590+0000","last_undegraded":"2024-04-18T05:01:07.394590+0000","last_fullsized":"2024-04-18T05:01:07.394590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":54989,"num_write":377,"num_write_kb":85155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'431","reported_seq":798,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:55.644395+0000","last_change":"2024-04-18T04:54:40.818806+0000","last_active":"2024-04-18T05:00:55.644395+0000","last_peered":"2024-04-18T05:00:55.644395+0000","last_clean":"2024-04-18T05:00:55.644395+0000","last_became_active":"2024-04-18T04:54:40.818113+0000","last_became_peered":"2024-04-18T04:54:40.818113+0000","last_unstale":"2024-04-18T05:00:55.644395+0000","last_undegraded":"2024-04-18T05:00:55.644395+0000","last_fullsized":"2024-04-18T05:00:55.644395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1456426,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":351,"num_read_kb":1645,"num_write":371,"num_write_kb":1672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'416","reported_seq":434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.412599+0000","last_change":"2024-04-18T04:54:41.192576+0000","last_active":"2024-04-18T05:01:07.412599+0000","last_peered":"2024-04-18T05:01:07.412599+0000","last_clean":"2024-04-18T05:01:07.412599+0000","last_became_active":"2024-04-18T04:54:41.192187+0000","last_became_peered":"2024-04-18T04:54:41.192187+0000","last_unstale":"2024-04-18T05:01:07.412599+0000","last_undegraded":"2024-04-18T05:01:07.412599+0000","last_fullsized":"2024-04-18T05:01:07.412599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":364,"num_write":388,"num_write_kb":58777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'517","reported_seq":532,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.991782+0000","last_change":"2024-04-18T04:54:40.820531+0000","last_active":"2024-04-18T05:00:03.991782+0000","last_peered":"2024-04-18T05:00:03.991782+0000","last_clean":"2024-04-18T05:00:03.991782+0000","last_became_active":"2024-04-18T04:54:40.820025+0000","last_became_peered":"2024-04-18T04:54:40.820025+0000","last_unstale":"2024-04-18T05:00:03.991782+0000","last_undegraded":"2024-04-18T05:00:03.991782+0000","last_fullsized":"2024-04-18T05:00:03.991782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:35.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":8474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'404","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374383+0000","last_change":"2024-04-18T04:54:41.186361+0000","last_active":"2024-04-18T05:01:07.374383+0000","last_peered":"2024-04-18T05:01:07.374383+0000","last_clean":"2024-04-18T05:01:07.374383+0000","last_became_active":"2024-04-18T04:54:41.185257+0000","last_became_peered":"2024-04-18T04:54:41.185257+0000","last_unstale":"2024-04-18T05:01:07.374383+0000","last_undegraded":"2024-04-18T05:01:07.374383+0000","last_fullsized":"2024-04-18T05:01:07.374383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14216,"num_write":374,"num_write_kb":63531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'63","reported_seq":78,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.961722+0000","last_change":"2024-04-18T04:54:40.824668+0000","last_active":"2024-04-18T05:00:02.961722+0000","last_peered":"2024-04-18T05:00:02.961722+0000","last_clean":"2024-04-18T05:00:02.961722+0000","last_became_active":"2024-04-18T04:54:40.824206+0000","last_became_peered":"2024-04-18T04:54:40.824206+0000","last_unstale":"2024-04-18T05:00:02.961722+0000","last_undegraded":"2024-04-18T05:00:02.961722+0000","last_fullsized":"2024-04-18T05:00:02.961722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'433","reported_seq":531,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.393697+0000","last_change":"2024-04-18T04:54:41.195487+0000","last_active":"2024-04-18T05:01:07.393697+0000","last_peered":"2024-04-18T05:01:07.393697+0000","last_clean":"2024-04-18T05:01:07.393697+0000","last_became_active":"2024-04-18T04:54:41.195177+0000","last_became_peered":"2024-04-18T04:54:41.195177+0000","last_unstale":"2024-04-18T05:01:07.393697+0000","last_undegraded":"2024-04-18T05:01:07.393697+0000","last_fullsized":"2024-04-18T05:01:07.393697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:25.853413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":41457,"num_write":394,"num_write_kb":79356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'328","reported_seq":343,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.057473+0000","last_change":"2024-04-18T04:54:40.803387+0000","last_active":"2024-04-18T05:00:05.057473+0000","last_peered":"2024-04-18T05:00:05.057473+0000","last_clean":"2024-04-18T05:00:05.057473+0000","last_became_active":"2024-04-18T04:54:40.802902+0000","last_became_peered":"2024-04-18T04:54:40.802902+0000","last_unstale":"2024-04-18T05:00:05.057473+0000","last_undegraded":"2024-04-18T05:00:05.057473+0000","last_fullsized":"2024-04-18T05:00:05.057473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'423","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.404089+0000","last_change":"2024-04-18T04:54:41.195382+0000","last_active":"2024-04-18T05:01:07.404089+0000","last_peered":"2024-04-18T05:01:07.404089+0000","last_clean":"2024-04-18T05:01:07.404089+0000","last_became_active":"2024-04-18T04:54:41.194965+0000","last_became_peered":"2024-04-18T04:54:41.194965+0000","last_unstale":"2024-04-18T05:01:07.404089+0000","last_undegraded":"2024-04-18T05:01:07.404089+0000","last_fullsized":"2024-04-18T05:01:07.404089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:39:50.932794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32152,"num_write":386,"num_write_kb":121188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'116","reported_seq":132,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:12.222119+0000","last_change":"2024-04-18T04:54:40.800651+0000","last_active":"2024-04-18T05:00:12.222119+0000","last_peered":"2024-04-18T05:00:12.222119+0000","last_clean":"2024-04-18T05:00:12.222119+0000","last_became_active":"2024-04-18T04:54:40.798574+0000","last_became_peered":"2024-04-18T04:54:40.798574+0000","last_unstale":"2024-04-18T05:00:12.222119+0000","last_undegraded":"2024-04-18T05:00:12.222119+0000","last_fullsized":"2024-04-18T05:00:12.222119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:55.712985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'326","reported_seq":342,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.386687+0000","last_change":"2024-04-18T04:54:41.191679+0000","last_active":"2024-04-18T05:01:07.386687+0000","last_peered":"2024-04-18T05:01:07.386687+0000","last_clean":"2024-04-18T05:01:07.386687+0000","last_became_active":"2024-04-18T04:54:41.191124+0000","last_became_peered":"2024-04-18T04:54:41.191124+0000","last_unstale":"2024-04-18T05:01:07.386687+0000","last_undegraded":"2024-04-18T05:01:07.386687+0000","last_fullsized":"2024-04-18T05:01:07.386687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.296860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":298,"num_write_kb":17144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'80","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.999053+0000","last_change":"2024-04-18T04:54:40.804085+0000","last_active":"2024-04-18T05:00:05.999053+0000","last_peered":"2024-04-18T05:00:05.999053+0000","last_clean":"2024-04-18T05:00:05.999053+0000","last_became_active":"2024-04-18T04:54:40.803616+0000","last_became_peered":"2024-04-18T04:54:40.803616+0000","last_unstale":"2024-04-18T05:00:05.999053+0000","last_undegraded":"2024-04-18T05:00:05.999053+0000","last_fullsized":"2024-04-18T05:00:05.999053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:55.405415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'465","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.383756+0000","last_change":"2024-04-18T04:54:41.185453+0000","last_active":"2024-04-18T05:01:07.383756+0000","last_peered":"2024-04-18T05:01:07.383756+0000","last_clean":"2024-04-18T05:01:07.383756+0000","last_became_active":"2024-04-18T04:54:41.185217+0000","last_became_peered":"2024-04-18T04:54:41.185217+0000","last_unstale":"2024-04-18T05:01:07.383756+0000","last_undegraded":"2024-04-18T05:01:07.383756+0000","last_fullsized":"2024-04-18T05:01:07.383756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:44:42.484978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8956,"num_write":434,"num_write_kb":97052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'601","reported_seq":617,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.068924+0000","last_change":"2024-04-18T04:54:40.801317+0000","last_active":"2024-04-18T05:00:05.068924+0000","last_peered":"2024-04-18T05:00:05.068924+0000","last_clean":"2024-04-18T05:00:05.068924+0000","last_became_active":"2024-04-18T04:54:40.800598+0000","last_became_peered":"2024-04-18T04:54:40.800598+0000","last_unstale":"2024-04-18T05:00:05.068924+0000","last_undegraded":"2024-04-18T05:00:05.068924+0000","last_fullsized":"2024-04-18T05:00:05.068924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":546,"num_write_kb":4388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'458","reported_seq":503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.330451+0000","last_change":"2024-04-18T04:54:41.197813+0000","last_active":"2024-04-18T05:01:07.330451+0000","last_peered":"2024-04-18T05:01:07.330451+0000","last_clean":"2024-04-18T05:01:07.330451+0000","last_became_active":"2024-04-18T04:54:41.197201+0000","last_became_peered":"2024-04-18T04:54:41.197201+0000","last_unstale":"2024-04-18T05:01:07.330451+0000","last_undegraded":"2024-04-18T05:01:07.330451+0000","last_fullsized":"2024-04-18T05:01:07.330451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21429,"num_write":433,"num_write_kb":71833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'55","reported_seq":71,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.007064+0000","last_change":"2024-04-18T04:54:40.800416+0000","last_active":"2024-04-18T05:00:03.007064+0000","last_peered":"2024-04-18T05:00:03.007064+0000","last_clean":"2024-04-18T05:00:03.007064+0000","last_became_active":"2024-04-18T04:54:40.797471+0000","last_became_peered":"2024-04-18T04:54:40.797471+0000","last_unstale":"2024-04-18T05:00:03.007064+0000","last_undegraded":"2024-04-18T05:00:03.007064+0000","last_fullsized":"2024-04-18T05:00:03.007064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:33.118670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"23'421","reported_seq":479,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.382638+0000","last_change":"2024-04-18T04:54:41.192024+0000","last_active":"2024-04-18T05:01:07.382638+0000","last_peered":"2024-04-18T05:01:07.382638+0000","last_clean":"2024-04-18T05:01:07.382638+0000","last_became_active":"2024-04-18T04:54:41.191488+0000","last_became_peered":"2024-04-18T04:54:41.191488+0000","last_unstale":"2024-04-18T05:01:07.382638+0000","last_undegraded":"2024-04-18T05:01:07.382638+0000","last_fullsized":"2024-04-18T05:01:07.382638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:39:31.336550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23403,"num_write":390,"num_write_kb":67848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'192","reported_seq":208,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.005322+0000","last_change":"2024-04-18T04:54:40.823863+0000","last_active":"2024-04-18T05:00:03.005322+0000","last_peered":"2024-04-18T05:00:03.005322+0000","last_clean":"2024-04-18T05:00:03.005322+0000","last_became_active":"2024-04-18T04:54:40.823277+0000","last_became_peered":"2024-04-18T04:54:40.823277+0000","last_unstale":"2024-04-18T05:00:03.005322+0000","last_undegraded":"2024-04-18T05:00:03.005322+0000","last_fullsized":"2024-04-18T05:00:03.005322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'448","reported_seq":498,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394105+0000","last_change":"2024-04-18T04:54:41.199981+0000","last_active":"2024-04-18T05:01:07.394105+0000","last_peered":"2024-04-18T05:01:07.394105+0000","last_clean":"2024-04-18T05:01:07.394105+0000","last_became_active":"2024-04-18T04:54:41.199700+0000","last_became_peered":"2024-04-18T04:54:41.199700+0000","last_unstale":"2024-04-18T05:01:07.394105+0000","last_undegraded":"2024-04-18T05:01:07.394105+0000","last_fullsized":"2024-04-18T05:01:07.394105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":10662,"num_write":420,"num_write_kb":96864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'127","reported_seq":141,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:01.015287+0000","last_change":"2024-04-18T04:54:40.800740+0000","last_active":"2024-04-18T05:00:01.015287+0000","last_peered":"2024-04-18T05:00:01.015287+0000","last_clean":"2024-04-18T05:00:01.015287+0000","last_became_active":"2024-04-18T04:54:40.800405+0000","last_became_peered":"2024-04-18T04:54:40.800405+0000","last_unstale":"2024-04-18T05:00:01.015287+0000","last_undegraded":"2024-04-18T05:00:01.015287+0000","last_fullsized":"2024-04-18T05:00:01.015287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":8237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'441","reported_seq":502,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.363689+0000","last_change":"2024-04-18T04:54:41.192487+0000","last_active":"2024-04-18T05:01:07.363689+0000","last_peered":"2024-04-18T05:01:07.363689+0000","last_clean":"2024-04-18T05:01:07.363689+0000","last_became_active":"2024-04-18T04:54:41.186301+0000","last_became_peered":"2024-04-18T04:54:41.186301+0000","last_unstale":"2024-04-18T05:01:07.363689+0000","last_undegraded":"2024-04-18T05:01:07.363689+0000","last_fullsized":"2024-04-18T05:01:07.363689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":27247,"num_write":409,"num_write_kb":76591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"23'382","reported_seq":407,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.378209+0000","last_change":"2024-04-18T04:54:41.193260+0000","last_active":"2024-04-18T05:01:07.378209+0000","last_peered":"2024-04-18T05:01:07.378209+0000","last_clean":"2024-04-18T05:01:07.378209+0000","last_became_active":"2024-04-18T04:54:41.192941+0000","last_became_peered":"2024-04-18T04:54:41.192941+0000","last_unstale":"2024-04-18T05:01:07.378209+0000","last_undegraded":"2024-04-18T05:01:07.378209+0000","last_fullsized":"2024-04-18T05:01:07.378209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4755,"num_write":342,"num_write_kb":72428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'357","reported_seq":372,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.067828+0000","last_change":"2024-04-18T04:54:40.800162+0000","last_active":"2024-04-18T05:00:05.067828+0000","last_peered":"2024-04-18T05:00:05.067828+0000","last_clean":"2024-04-18T05:00:05.067828+0000","last_became_active":"2024-04-18T04:54:40.799517+0000","last_became_peered":"2024-04-18T04:54:40.799517+0000","last_unstale":"2024-04-18T05:00:05.067828+0000","last_undegraded":"2024-04-18T05:00:05.067828+0000","last_fullsized":"2024-04-18T05:00:05.067828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"23'382","reported_seq":421,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374639+0000","last_change":"2024-04-18T04:54:41.179695+0000","last_active":"2024-04-18T05:01:07.374639+0000","last_peered":"2024-04-18T05:01:07.374639+0000","last_clean":"2024-04-18T05:01:07.374639+0000","last_became_active":"2024-04-18T04:54:41.179359+0000","last_became_peered":"2024-04-18T04:54:41.179359+0000","last_unstale":"2024-04-18T05:01:07.374639+0000","last_undegraded":"2024-04-18T05:01:07.374639+0000","last_fullsized":"2024-04-18T05:01:07.374639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14401,"num_write":356,"num_write_kb":79542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'289","reported_seq":304,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.057756+0000","last_change":"2024-04-18T04:54:40.801178+0000","last_active":"2024-04-18T05:00:05.057756+0000","last_peered":"2024-04-18T05:00:05.057756+0000","last_clean":"2024-04-18T05:00:05.057756+0000","last_became_active":"2024-04-18T04:54:40.800660+0000","last_became_peered":"2024-04-18T04:54:40.800660+0000","last_unstale":"2024-04-18T05:00:05.057756+0000","last_undegraded":"2024-04-18T05:00:05.057756+0000","last_fullsized":"2024-04-18T05:00:05.057756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":12441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'366","reported_seq":409,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.411914+0000","last_change":"2024-04-18T04:54:41.190055+0000","last_active":"2024-04-18T05:01:07.411914+0000","last_peered":"2024-04-18T05:01:07.411914+0000","last_clean":"2024-04-18T05:01:07.411914+0000","last_became_active":"2024-04-18T04:54:41.189344+0000","last_became_peered":"2024-04-18T04:54:41.189344+0000","last_unstale":"2024-04-18T05:01:07.411914+0000","last_undegraded":"2024-04-18T05:01:07.411914+0000","last_fullsized":"2024-04-18T05:01:07.411914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10936,"num_write":342,"num_write_kb":51086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'86","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.013938+0000","last_change":"2024-04-18T04:54:40.813931+0000","last_active":"2024-04-18T05:00:03.013938+0000","last_peered":"2024-04-18T05:00:03.013938+0000","last_clean":"2024-04-18T05:00:03.013938+0000","last_became_active":"2024-04-18T04:54:40.813290+0000","last_became_peered":"2024-04-18T04:54:40.813290+0000","last_unstale":"2024-04-18T05:00:03.013938+0000","last_undegraded":"2024-04-18T05:00:03.013938+0000","last_fullsized":"2024-04-18T05:00:03.013938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'407","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.385303+0000","last_change":"2024-04-18T04:54:41.192913+0000","last_active":"2024-04-18T05:01:07.385303+0000","last_peered":"2024-04-18T05:01:07.385303+0000","last_clean":"2024-04-18T05:01:07.385303+0000","last_became_active":"2024-04-18T04:54:41.192096+0000","last_became_peered":"2024-04-18T04:54:41.192096+0000","last_unstale":"2024-04-18T05:01:07.385303+0000","last_undegraded":"2024-04-18T05:01:07.385303+0000","last_fullsized":"2024-04-18T05:01:07.385303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:37:53.082409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17335,"num_write":380,"num_write_kb":68515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'130","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.040397+0000","last_change":"2024-04-18T04:54:40.805596+0000","last_active":"2024-04-18T05:00:06.040397+0000","last_peered":"2024-04-18T05:00:06.040397+0000","last_clean":"2024-04-18T05:00:06.040397+0000","last_became_active":"2024-04-18T04:54:40.804913+0000","last_became_peered":"2024-04-18T04:54:40.804913+0000","last_unstale":"2024-04-18T05:00:06.040397+0000","last_undegraded":"2024-04-18T05:00:06.040397+0000","last_fullsized":"2024-04-18T05:00:06.040397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:23:44.772589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2494,"num_read_kb":1324974,"num_write":24555,"num_write_kb":4507656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26500,"ondisk_log_size":26500,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":130916242,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":351,"num_read_kb":1645,"num_write":7226,"num_write_kb":133419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":100597760,"data_stored":261832484,"data_compressed":36635560,"data_compressed_allocated":47603712,"data_compressed_original":209084416,"omap_allocated":0,"internal_metadata":0},"log_size":8833,"ondisk_log_size":8833,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509522,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":5676,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":5812224,"data_stored":14125282,"data_compressed":1836351,"data_compressed_allocated":2379776,"data_compressed_original":10878976,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77800000000000002,"15min":0.83599999999999997},"min":{"1min":0.40100000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.1639999999999999,"5min":1.1910000000000001,"15min":1.2490000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.79100000000000004,"15min":0.83999999999999997},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1259999999999999,"5min":1.262,"15min":1.262},"last":1.194}]},{"osd":1,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0660000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.82899999999999996,"15min":0.84299999999999997},"min":{"1min":0.46500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.226,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.98099999999999998}]},{"osd":2,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.91600000000000004,"15min":0.89000000000000001},"min":{"1min":0.53700000000000003,"5min":0.438,"15min":0.438},"max":{"1min":1.2270000000000001,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86899999999999999,"15min":0.86499999999999999},"min":{"1min":0.48299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1890000000000001,"5min":1.379,"15min":1.4019999999999999},"last":1.123}]},{"osd":3,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1890000000000001,"5min":1.458,"15min":1.458},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.97899999999999998,"15min":0.95099999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.248,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0209999999999999}]},{"osd":4,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.91700000000000004,"15min":0.93100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.1479999999999999,"5min":1.605,"15min":1.605},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.91900000000000004,"15min":0.91100000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.175,"5min":1.546,"15min":1.546},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.98799999999999999,"15min":1.018},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2090000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.998,"15min":1.02},"min":{"1min":0.45000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.236,"5min":1.431,"15min":1.5640000000000001},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.0800000000000001,"15min":1.1120000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.28,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.0609999999999999,"15min":1.048},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.236,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.0760000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509522,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47056,"kb_used_data":7752,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94324784,"statfs":{"total":96636764160,"available":96588578816,"internally_reserved":0,"allocated":7938048,"data_stored":21059926,"data_compressed":3027129,"data_compressed_allocated":3776512,"data_compressed_original":17063936,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.76000000000000001,"15min":0.77600000000000002},"min":{"1min":0.61899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0800000000000001,"5min":1.125,"15min":1.125},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.81299999999999994,"15min":0.85099999999999998},"min":{"1min":0.58599999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0469999999999999,"5min":1.1870000000000001,"15min":1.353},"last":1.0349999999999999}]},{"osd":1,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.84999999999999998,"15min":0.93799999999999994},"min":{"1min":0.68700000000000006,"5min":0.312,"15min":0.312},"max":{"1min":1.1519999999999999,"5min":1.268,"15min":1.8560000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.82099999999999995,"15min":0.85099999999999998},"min":{"1min":0.74099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.038,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.94599999999999995,"15min":0.93600000000000005},"min":{"1min":0.92900000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1919999999999999,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.66000000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1910000000000001,"5min":1.325,"15min":1.325},"last":0.82199999999999995}]},{"osd":3,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.91600000000000004,"15min":0.90500000000000003},"min":{"1min":0.68200000000000005,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.159,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.93899999999999995,"15min":0.98899999999999999},"min":{"1min":0.80800000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1699999999999999,"5min":1.617,"15min":1.617},"last":0.95499999999999996}]},{"osd":4,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.88900000000000001,"15min":0.97899999999999998},"min":{"1min":0.64600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2789999999999999,"5min":1.4990000000000001,"15min":1.631},"last":0.999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97699999999999998,"15min":1.0589999999999999},"min":{"1min":0.71399999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.145,"5min":1.631,"15min":1.631},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.98799999999999999,"15min":1.008},"min":{"1min":0.77300000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.3320000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.0189999999999999,"15min":1.0449999999999999},"min":{"1min":0.73499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.163,"5min":1.673,"15min":1.6739999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0509999999999999,"15min":1.107},"min":{"1min":0.69799999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.248,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.05,"5min":1.0860000000000001,"15min":1.1120000000000001},"min":{"1min":0.78600000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2649999999999999,"5min":1.73,"15min":1.7769999999999999},"last":1.0649999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509521,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66536,"kb_used_data":13280,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94305304,"statfs":{"total":96636764160,"available":96568631296,"internally_reserved":0,"allocated":13598720,"data_stored":35687478,"data_compressed":4904028,"data_compressed_allocated":6356992,"data_compressed_original":28622848,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.76100000000000001,"15min":0.89100000000000001},"min":{"1min":0.57499999999999996,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1499999999999999,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.091},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.79000000000000004,"15min":0.82599999999999996},"min":{"1min":0.60599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.3340000000000001,"5min":1.542,"15min":1.542},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.91200000000000003,"15min":0.91800000000000004},"min":{"1min":0.58799999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.24,"5min":9.8819999999999997,"15min":9.8819999999999997},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.006,"5min":0.89100000000000001,"15min":0.92700000000000005},"min":{"1min":0.626,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.355,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":1.0169999999999999}]},{"osd":2,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.88400000000000001,"15min":0.89000000000000001},"min":{"1min":0.60899999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.177,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.97399999999999998,"15min":0.94799999999999995},"min":{"1min":0.68200000000000005,"5min":0.38,"15min":0.38},"max":{"1min":1.214,"5min":10.031000000000001,"15min":10.031000000000001},"last":0.95299999999999996}]},{"osd":3,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.91700000000000004,"15min":0.95999999999999996},"min":{"1min":0.72899999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.284,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.97599999999999998,"15min":1.014},"min":{"1min":0.72799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2789999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.0660000000000001}]},{"osd":4,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.006,"15min":0.91900000000000004},"min":{"1min":0.63700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.3759999999999999,"5min":9.968,"15min":9.968},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.96899999999999997,"15min":1.02},"min":{"1min":0.624,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.399,"5min":1.631,"15min":1.8440000000000001},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.006,"15min":0.96099999999999997},"min":{"1min":0.60899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4159999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.1020000000000001,"15min":1.036},"min":{"1min":0.752,"5min":0.371,"15min":0.371},"max":{"1min":1.4550000000000001,"5min":10.09,"15min":10.09},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0629999999999999,"15min":1.103},"min":{"1min":0.77800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.528,"5min":1.7050000000000001,"15min":1.944},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.129,"15min":1.151},"min":{"1min":0.72199999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.7070000000000001,"5min":1.97,"15min":1.97},"last":0.97899999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509522,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77376,"kb_used_data":20024,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94294464,"statfs":{"total":96636764160,"available":96557531136,"internally_reserved":0,"allocated":20504576,"data_stored":54614164,"data_compressed":7702565,"data_compressed_allocated":9973760,"data_compressed_original":44273664,"omap_allocated":1592,"internal_metadata":58718664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,0,0,14],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.628,"15min":0.67400000000000004},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.98099999999999998,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.222},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63100000000000001,"15min":0.61699999999999999},"min":{"1min":0.29499999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.91000000000000003,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.23799999999999999}]},{"osd":1,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61899999999999999,"15min":0.63500000000000001},"min":{"1min":0.31900000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.0920000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73699999999999999,"15min":0.69699999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.0720000000000001,"5min":2.601,"15min":2.601},"last":0.252}]},{"osd":2,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.73099999999999998,"15min":0.73399999999999999},"min":{"1min":0.34399999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.359,"5min":1.573,"15min":1.573},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1339999999999999,"5min":1.51,"15min":1.51},"last":0.27700000000000002}]},{"osd":4,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.86399999999999999,"15min":0.85799999999999998},"min":{"1min":0.46600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.202,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.91400000000000003,"15min":0.93600000000000005},"min":{"1min":0.59399999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4199999999999999,"5min":1.524,"15min":1.524},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.61499999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.252,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":21.260000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.008,"15min":1.028},"min":{"1min":0.47899999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.292,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":7.569}]},{"osd":6,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.98299999999999998,"15min":0.97199999999999998},"min":{"1min":0.72599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.282,"5min":1.512,"15min":1.512},"last":7.2729999999999997},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.02,"15min":1.0489999999999999},"min":{"1min":0.72699999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.327,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":4.2199999999999998}]},{"osd":7,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0600000000000001,"15min":1.1100000000000001},"min":{"1min":0.66700000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.371,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.046,"5min":1.0289999999999999,"15min":1.0580000000000001},"min":{"1min":0.60799999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.341,"5min":1.583,"15min":1.583},"last":0.66000000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509521,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59832,"kb_used_data":14768,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94312008,"statfs":{"total":96636764160,"available":96575496192,"internally_reserved":0,"allocated":15122432,"data_stored":34231216,"data_compressed":4539223,"data_compressed_allocated":6156288,"data_compressed_original":25436160,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63500000000000001,"15min":0.59099999999999997},"min":{"1min":0.38300000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.98699999999999999,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.73999999999999999},"min":{"1min":0.29899999999999999,"5min":0.214,"15min":0.214},"max":{"1min":1.1970000000000001,"5min":1.5920000000000001,"15min":1.9239999999999999},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66400000000000003,"15min":0.68400000000000005},"min":{"1min":0.432,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.88200000000000001,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.696,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.755,"15min":0.78200000000000003},"min":{"1min":0.46800000000000003,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.8400000000000001,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.78200000000000003,"15min":0.77700000000000002},"min":{"1min":0.49099999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.7989999999999999,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.92800000000000005,"15min":0.94799999999999995},"min":{"1min":0.56000000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.107,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.98499999999999999,"15min":0.98199999999999998},"min":{"1min":0.72299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.786,"5min":2.133,"15min":2.133},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.98099999999999998,"15min":1.0069999999999999},"min":{"1min":0.72399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":1.292,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.98099999999999998,"15min":0.98499999999999999},"min":{"1min":0.626,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.274,"5min":2.347,"15min":2.347},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":0.98799999999999999,"15min":1.02},"min":{"1min":0.65400000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.024,"5min":3.024,"15min":3.024},"last":1.089},{"interface":"front","average":{"1min":0.997,"5min":1.0409999999999999,"15min":1.0669999999999999},"min":{"1min":0.67800000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.288,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0600000000000001,"15min":1.0760000000000001},"min":{"1min":0.80200000000000005,"5min":0.497,"15min":0.497},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":1.048},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0860000000000001,"15min":1.109},"min":{"1min":0.76100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3680000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.77400000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509523,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78896,"kb_used_data":21544,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94292944,"statfs":{"total":96636764160,"available":96555974656,"internally_reserved":0,"allocated":22061056,"data_stored":54614568,"data_compressed":7565653,"data_compressed_allocated":10006528,"data_compressed_original":42741760,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.63400000000000001,"15min":0.58599999999999997},"min":{"1min":0.318,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":2.177,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.623,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.224,"15min":0.224},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69099999999999995,"15min":0.65900000000000003},"min":{"1min":0.433,"5min":0.22,"15min":0.22},"max":{"1min":1.4339999999999999,"5min":2.629,"15min":2.629},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.67500000000000004,"15min":0.64500000000000002},"min":{"1min":0.44600000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.70799999999999996,"15min":0.60699999999999998},"min":{"1min":0.38300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.575,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.81399999999999995,"15min":0.749},"min":{"1min":0.39500000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.3690000000000002,"5min":3.375,"15min":3.375},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6859999999999999,"5min":2.601,"15min":2.601},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.05,"5min":0.93899999999999995,"15min":0.92500000000000004},"min":{"1min":0.48699999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.2559999999999998,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.0049999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.92200000000000004,"15min":0.90500000000000003},"min":{"1min":0.76500000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.95999999999999996,"15min":0.94499999999999995},"min":{"1min":0.73299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.758,"5min":2.734,"15min":2.734},"last":0.95899999999999996}]},{"osd":6,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.016,"15min":0.98499999999999999},"min":{"1min":0.77100000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.3149999999999999,"5min":2.681,"15min":2.681},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":0.997,"15min":1.0149999999999999},"min":{"1min":0.81699999999999995,"5min":0.499,"15min":0.499},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.83199999999999996,"5min":0.496,"15min":0.496},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.026},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.03,"15min":0.97399999999999998},"min":{"1min":0.65900000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.831,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":1.0509999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47916,"kb_used_data":8612,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94323924,"statfs":{"total":96636764160,"available":96587698176,"internally_reserved":0,"allocated":8818688,"data_stored":24681186,"data_compressed":3524620,"data_compressed_allocated":4517888,"data_compressed_original":20582400,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.75,"15min":0.88900000000000001},"min":{"1min":0.48099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.05,"5min":1.1579999999999999,"15min":1.3080000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.74099999999999999,"15min":0.83199999999999996},"min":{"1min":0.57099999999999995,"5min":0.318,"15min":0.318},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81200000000000006,"15min":0.875},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.149,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.80500000000000005,"15min":0.86299999999999999},"min":{"1min":0.50600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.097,"5min":1.246,"15min":1.246},"last":0.70399999999999996}]},{"osd":2,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.57699999999999996,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92800000000000005,"15min":0.96899999999999997},"min":{"1min":0.53600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1379999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.93799999999999994}]},{"osd":3,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.80600000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.651,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":1.145},{"interface":"front","average":{"1min":1.016,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.68600000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2130000000000001,"5min":3.6280000000000001,"15min":3.6280000000000001},"last":1.028}]},{"osd":5,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95199999999999996,"15min":0.93600000000000005},"min":{"1min":0.47899999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.89000000000000001,"5min":1.008,"15min":1.054},"min":{"1min":0.58999999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.753}]},{"osd":6,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.92000000000000004,"15min":1.006},"min":{"1min":0.61599999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.1890000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.048},{"interface":"front","average":{"1min":1.022,"5min":1.0329999999999999,"15min":1.0589999999999999},"min":{"1min":0.56399999999999995,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.5980000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.101,"15min":1.141},"min":{"1min":0.72999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.246,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.873},{"interface":"front","average":{"1min":1.069,"5min":1.1180000000000001,"15min":1.1479999999999999},"min":{"1min":0.63300000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5409999999999999,"5min":3.9910000000000001,"15min":3.9910000000000001},"last":1.004}]}]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":8536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":8740864,"data_stored":24679416,"data_compressed":3602361,"data_compressed_allocated":4526080,"data_compressed_original":20631552,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.56499999999999995},"min":{"1min":0.42499999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.93799999999999994,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.64400000000000002,"15min":0.69699999999999995},"min":{"1min":0.45200000000000001,"5min":0.193,"15min":0.193},"max":{"1min":1.034,"5min":1.347,"15min":1.347},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67600000000000005,"15min":0.67200000000000004},"min":{"1min":0.53300000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.024,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68000000000000005,"15min":0.66600000000000004},"min":{"1min":0.433,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.022,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.67300000000000004,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1140000000000001,"5min":1.29,"15min":1.29},"last":1.004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.65800000000000003,"15min":0.64200000000000002},"min":{"1min":0.48799999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0149999999999999,"5min":1.034,"15min":1.034},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.91800000000000004,"15min":0.95299999999999996},"min":{"1min":0.79100000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.1930000000000001,"5min":2.456,"15min":2.456},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.85099999999999998,"15min":0.873},"min":{"1min":0.57099999999999995,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2889999999999999,"5min":1.454,"15min":1.6950000000000001},"last":0.92700000000000005}]},{"osd":5,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.96899999999999997,"15min":0.94399999999999995},"min":{"1min":0.78500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4279999999999999,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.93500000000000005,"15min":0.98699999999999999},"min":{"1min":0.81999999999999995,"5min":0.373,"15min":0.373},"max":{"1min":1.234,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.042}]},{"osd":6,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.80500000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3440000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0329999999999999,"15min":0.98099999999999998},"min":{"1min":0.84799999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.506,"5min":3.391,"15min":3.391},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.99099999999999999,"15min":1.0289999999999999},"min":{"1min":0.84999999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.25,"5min":1.4259999999999999,"15min":1.4990000000000001},"last":0.876},{"interface":"front","average":{"1min":1.052,"5min":0.98899999999999999,"15min":0.97499999999999998},"min":{"1min":0.71199999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.3160000000000001,"5min":1.748,"15min":1.748},"last":1.276}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21827584,"data_stored":54529566,"data_compressed":7565653,"data_compressed_allocated":10006528,"data_compressed_original":42741760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14823424,"data_stored":33555846,"data_compressed":4506038,"data_compressed_allocated":6111232,"data_compressed_original":24862720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8507392,"data_stored":24594414,"data_compressed":3602361,"data_compressed_allocated":4526080,"data_compressed_original":20631552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20271104,"data_stored":54529162,"data_compressed":7702565,"data_compressed_allocated":9973760,"data_compressed_original":44273664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8585216,"data_stored":24596184,"data_compressed":3524620,"data_compressed_allocated":4517888,"data_compressed_original":20582400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13299712,"data_stored":35012108,"data_compressed":4870843,"data_compressed_allocated":6311936,"data_compressed_original":28049408,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7704576,"data_stored":20974924,"data_compressed":3027129,"data_compressed_allocated":3776512,"data_compressed_original":17063936,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5578752,"data_stored":14040280,"data_compressed":1836351,"data_compressed_allocated":2379776,"data_compressed_original":10878976,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T05:01:14.821 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T05:01:14.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.978+0000 7f2abc534640 1 Processor -- start 2024-04-18T05:01:14.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.978+0000 7f2abc534640 1 -- start start 2024-04-18T05:01:14.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.978+0000 7f2abc534640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2ab40700e0 0x7f2ab4159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.978+0000 7f2abc534640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab4159700 con 0x7f2ab40707c0 2024-04-18T05:01:14.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.978+0000 7f2abc534640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab4070be0 con 0x7f2ab4153180 2024-04-18T05:01:14.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.978+0000 7f2abc534640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab40c6390 con 0x7f2ab40700e0 2024-04-18T05:01:14.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.978+0000 7f2ab9acf640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2ab40700e0 0x7f2ab4159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.978+0000 7f2ab9acf640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2ab40700e0 0x7f2ab4159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40140/0 (socket says 172.21.15.96:40140) 2024-04-18T05:01:14.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.978+0000 7f2ab9acf640 1 -- 172.21.15.96:0/425350537 learned_addr learned my addr 172.21.15.96:0/425350537 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:14.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.978+0000 7f2abaad1640 1 --1- 172.21.15.96:0/425350537 >> v1:172.21.15.96:6789/0 conn(0x7f2ab40707c0 0x7f2ab40ca300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33278/0 (socket says 172.21.15.96:33278) 2024-04-18T05:01:14.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.978+0000 7f2ab9acf640 1 -- 172.21.15.96:0/425350537 >> v1:172.21.15.139:6789/0 conn(0x7f2ab4153180 legacy=0x7f2ab415c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:14.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.978+0000 7f2ab9acf640 1 -- 172.21.15.96:0/425350537 >> v1:172.21.15.96:6789/0 conn(0x7f2ab40707c0 legacy=0x7f2ab40ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.978+0000 7f2ab9acf640 1 -- 172.21.15.96:0/425350537 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab415cf80 con 0x7f2ab40700e0 2024-04-18T05:01:14.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2ab9acf640 1 --2- 172.21.15.96:0/425350537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab40700e0 0x7f2ab4159b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009870 tx=0x7f2aa401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236ba98d54e2d163 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:14.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2ab92ce640 1 -- 172.21.15.96:0/425350537 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40a8a10 con 0x7f2ab40700e0 2024-04-18T05:01:14.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2ab92ce640 1 -- 172.21.15.96:0/425350537 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa40a8b70 con 0x7f2ab40700e0 2024-04-18T05:01:14.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2ab92ce640 1 -- 172.21.15.96:0/425350537 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40b0440 con 0x7f2ab40700e0 2024-04-18T05:01:14.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abc534640 1 -- 172.21.15.96:0/425350537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab40700e0 msgr2=0x7f2ab4159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abc534640 1 --2- 172.21.15.96:0/425350537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab40700e0 0x7f2ab4159b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009870 tx=0x7f2aa401ed10 comp rx=0 tx=0).stop 2024-04-18T05:01:14.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abc534640 1 -- 172.21.15.96:0/425350537 shutdown_connections 2024-04-18T05:01:14.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abc534640 1 --2- 172.21.15.96:0/425350537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab40700e0 0x7f2ab4159b90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abc534640 1 -- 172.21.15.96:0/425350537 >> 172.21.15.96:0/425350537 conn(0x7f2ab406c750 msgr2=0x7f2ab40c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:14.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abc534640 1 -- 172.21.15.96:0/425350537 shutdown_connections 2024-04-18T05:01:14.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abc534640 1 -- 172.21.15.96:0/425350537 wait complete. 2024-04-18T05:01:14.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abc534640 1 Processor -- start 2024-04-18T05:01:14.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abc534640 1 -- start start 2024-04-18T05:01:14.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abc534640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2ab40700e0 0x7f2ab414ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abc534640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ab40707c0 0x7f2ab40c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abc534640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab4153180 0x7f2ab40c3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abc534640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40c4850 con 0x7f2ab4153180 2024-04-18T05:01:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abc534640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab415be70 con 0x7f2ab40707c0 2024-04-18T05:01:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abc534640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40c2a00 con 0x7f2ab40700e0 2024-04-18T05:01:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abaad1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab4153180 0x7f2ab40c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abaad1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab4153180 0x7f2ab40c3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40154/0 (socket says 172.21.15.96:40154) 2024-04-18T05:01:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abaad1640 1 -- 172.21.15.96:0/4294241842 learned_addr learned my addr 172.21.15.96:0/4294241842 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2aba2d0640 1 --2- 172.21.15.96:0/4294241842 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2ab40700e0 0x7f2ab414ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2ab9acf640 1 --2- 172.21.15.96:0/4294241842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ab40707c0 0x7f2ab40c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abaad1640 1 -- 172.21.15.96:0/4294241842 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2ab40700e0 msgr2=0x7f2ab414ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abaad1640 1 --2- 172.21.15.96:0/4294241842 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2ab40700e0 0x7f2ab414ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abaad1640 1 -- 172.21.15.96:0/4294241842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ab40707c0 msgr2=0x7f2ab40c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abaad1640 1 --2- 172.21.15.96:0/4294241842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ab40707c0 0x7f2ab40c30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:14.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abaad1640 1 -- 172.21.15.96:0/4294241842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa40094d0 con 0x7f2ab4153180 2024-04-18T05:01:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2aba2d0640 1 --2- 172.21.15.96:0/4294241842 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2ab40700e0 0x7f2ab414ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:01:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abaad1640 1 --2- 172.21.15.96:0/4294241842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab4153180 0x7f2ab40c3620 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00c7a0 tx=0x7f2aac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2aaaffd640 1 -- 172.21.15.96:0/4294241842 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac00a640 con 0x7f2ab4153180 2024-04-18T05:01:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2aaaffd640 1 -- 172.21.15.96:0/4294241842 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac00a7a0 con 0x7f2ab4153180 2024-04-18T05:01:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.982+0000 7f2abc534640 1 -- 172.21.15.96:0/4294241842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab40c4ad0 con 0x7f2ab4153180 2024-04-18T05:01:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.986+0000 7f2aaaffd640 1 -- 172.21.15.96:0/4294241842 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac00ab10 con 0x7f2ab4153180 2024-04-18T05:01:14.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.986+0000 7f2abc534640 1 -- 172.21.15.96:0/4294241842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab415c350 con 0x7f2ab4153180 2024-04-18T05:01:14.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.986+0000 7f2abc534640 1 -- 172.21.15.96:0/4294241842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab415c870 con 0x7f2ab4153180 2024-04-18T05:01:14.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.986+0000 7f2aaaffd640 1 -- 172.21.15.96:0/4294241842 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2aac00ac70 con 0x7f2ab4153180 2024-04-18T05:01:14.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.986+0000 7f2aaaffd640 1 --2- 172.21.15.96:0/4294241842 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2a98066690 0x7f2a98068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:14.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.986+0000 7f2aaaffd640 1 -- 172.21.15.96:0/4294241842 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2aac0838a0 con 0x7f2ab4153180 2024-04-18T05:01:14.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.986+0000 7f2aba2d0640 1 --2- 172.21.15.96:0/4294241842 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2a98066690 0x7f2a98068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:14.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.986+0000 7f2aba2d0640 1 --2- 172.21.15.96:0/4294241842 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2a98066690 0x7f2a98068b50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000a850 tx=0x7f2ab0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:14.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:14.990+0000 7f2aaaffd640 1 -- 172.21.15.96:0/4294241842 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2ab415c870 con 0x7f2ab4153180 2024-04-18T05:01:15.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:15.138+0000 7f2abc534640 1 -- 172.21.15.96:0/4294241842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ab415c870 con 0x7f2ab4153180 2024-04-18T05:01:15.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:15.138+0000 7f2aaaffd640 1 -- 172.21.15.96:0/4294241842 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16090 (secure 0 0 0) 0x7f2ab415c870 con 0x7f2ab4153180 2024-04-18T05:01:15.143 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T05:01:15.143 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":23,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:55:39.795060+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:54:39.219441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:54:40.139557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.720340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.767224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.811511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.710188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.860525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.704784+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1b","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T05:01:15.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:15.142+0000 7f2abc534640 1 -- 172.21.15.96:0/4294241842 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2a98066690 msgr2=0x7f2a98068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:15.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:15.142+0000 7f2abc534640 1 --2- 172.21.15.96:0/4294241842 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2a98066690 0x7f2a98068b50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000a850 tx=0x7f2ab0008040 comp rx=0 tx=0).stop 2024-04-18T05:01:15.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:15.142+0000 7f2abc534640 1 -- 172.21.15.96:0/4294241842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab4153180 msgr2=0x7f2ab40c3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:15.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:15.142+0000 7f2abc534640 1 --2- 172.21.15.96:0/4294241842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab4153180 0x7f2ab40c3620 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00c7a0 tx=0x7f2aac00cc60 comp rx=0 tx=0).stop 2024-04-18T05:01:15.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:15.142+0000 7f2abc534640 1 -- 172.21.15.96:0/4294241842 shutdown_connections 2024-04-18T05:01:15.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:15.142+0000 7f2abc534640 1 --2- 172.21.15.96:0/4294241842 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f2a98066690 0x7f2a98068b50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:15.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:15.142+0000 7f2abc534640 1 --2- 172.21.15.96:0/4294241842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab4153180 0x7f2ab40c3620 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:15.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:15.142+0000 7f2abc534640 1 --2- 172.21.15.96:0/4294241842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ab40707c0 0x7f2ab40c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:15.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:15.142+0000 7f2abc534640 1 --2- 172.21.15.96:0/4294241842 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2ab40700e0 0x7f2ab414ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:15.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:15.142+0000 7f2abc534640 1 -- 172.21.15.96:0/4294241842 >> 172.21.15.96:0/4294241842 conn(0x7f2ab406c750 msgr2=0x7f2ab40c9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:15.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:15.142+0000 7f2abc534640 1 -- 172.21.15.96:0/4294241842 shutdown_connections 2024-04-18T05:01:15.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:15.142+0000 7f2abc534640 1 -- 172.21.15.96:0/4294241842 wait complete. 2024-04-18T05:01:16.161 INFO:tasks.ceph:Scrubbing osd.0 2024-04-18T05:01:16.161 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-18T05:01:16.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c35b6640 1 Processor -- start 2024-04-18T05:01:16.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c35b6640 1 -- start start 2024-04-18T05:01:16.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c35b6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20bc14fc60 0x7f20bc06d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c35b6640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f20bc06dd50 0x7f20bc155d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c35b6640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20bc156240 0x7f20bc0c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c35b6640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20bc0c8100 con 0x7f20bc14fc60 2024-04-18T05:01:16.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c35b6640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20bc0c5660 con 0x7f20bc06dd50 2024-04-18T05:01:16.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c35b6640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc156670 con 0x7f20bc156240 2024-04-18T05:01:16.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c1352640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20bc14fc60 0x7f20bc06d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c1352640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20bc14fc60 0x7f20bc06d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40160/0 (socket says 172.21.15.96:40160) 2024-04-18T05:01:16.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c1352640 1 -- 172.21.15.96:0/805593338 learned_addr learned my addr 172.21.15.96:0/805593338 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:16.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c1b53640 1 --2- 172.21.15.96:0/805593338 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20bc156240 0x7f20bc0c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c0b51640 1 --2- 172.21.15.96:0/805593338 >> v2:172.21.15.139:3300/0 conn(0x7f20bc06dd50 0x7f20bc155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c1352640 1 -- 172.21.15.96:0/805593338 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20bc156240 msgr2=0x7f20bc0c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:16.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c1352640 1 --2- 172.21.15.96:0/805593338 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20bc156240 0x7f20bc0c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c1352640 1 -- 172.21.15.96:0/805593338 >> v2:172.21.15.139:3300/0 conn(0x7f20bc06dd50 msgr2=0x7f20bc155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:16.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c1352640 1 --2- 172.21.15.96:0/805593338 >> v2:172.21.15.139:3300/0 conn(0x7f20bc06dd50 0x7f20bc155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c1352640 1 -- 172.21.15.96:0/805593338 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc0c8350 con 0x7f20bc14fc60 2024-04-18T05:01:16.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.298+0000 7f20c0b51640 1 --2- 172.21.15.96:0/805593338 >> v2:172.21.15.139:3300/0 conn(0x7f20bc06dd50 0x7f20bc155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:01:16.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.302+0000 7f20c1352640 1 --2- 172.21.15.96:0/805593338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc14fc60 0x7f20bc06d810 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f20bc073d80 tx=0x7f20b801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7d24b0cff3f089 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:16.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.302+0000 7f20b3fff640 1 -- 172.21.15.96:0/805593338 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80ab600 con 0x7f20bc14fc60 2024-04-18T05:01:16.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.302+0000 7f20b3fff640 1 -- 172.21.15.96:0/805593338 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b80a7050 con 0x7f20bc14fc60 2024-04-18T05:01:16.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.302+0000 7f20b3fff640 1 -- 172.21.15.96:0/805593338 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80ab980 con 0x7f20bc14fc60 2024-04-18T05:01:16.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.302+0000 7f20c35b6640 1 -- 172.21.15.96:0/805593338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc14fc60 msgr2=0x7f20bc06d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.302+0000 7f20c35b6640 1 --2- 172.21.15.96:0/805593338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc14fc60 0x7f20bc06d810 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f20bc073d80 tx=0x7f20b801c460 comp rx=0 tx=0).stop 2024-04-18T05:01:16.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.302+0000 7f20c35b6640 1 -- 172.21.15.96:0/805593338 shutdown_connections 2024-04-18T05:01:16.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.302+0000 7f20c35b6640 1 --2- 172.21.15.96:0/805593338 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20bc156240 0x7f20bc0c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.302+0000 7f20c35b6640 1 --2- 172.21.15.96:0/805593338 >> v2:172.21.15.139:3300/0 conn(0x7f20bc06dd50 0x7f20bc155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.302+0000 7f20c35b6640 1 --2- 172.21.15.96:0/805593338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc14fc60 0x7f20bc06d810 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.302+0000 7f20c35b6640 1 -- 172.21.15.96:0/805593338 >> 172.21.15.96:0/805593338 conn(0x7f20bc06c610 msgr2=0x7f20bc0ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:16.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.302+0000 7f20c35b6640 1 -- 172.21.15.96:0/805593338 shutdown_connections 2024-04-18T05:01:16.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.302+0000 7f20c35b6640 1 -- 172.21.15.96:0/805593338 wait complete. 2024-04-18T05:01:16.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.302+0000 7f20c35b6640 1 Processor -- start 2024-04-18T05:01:16.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.302+0000 7f20c35b6640 1 -- start start 2024-04-18T05:01:16.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c35b6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20bc06dd50 0x7f20bc071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c35b6640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20bc14fc60 0x7f20bc1f49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c35b6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc156240 0x7f20bc1f4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c35b6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc142130 con 0x7f20bc156240 2024-04-18T05:01:16.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c35b6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc1f11c0 con 0x7f20bc06dd50 2024-04-18T05:01:16.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c35b6640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc1f14a0 con 0x7f20bc14fc60 2024-04-18T05:01:16.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c1b53640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc156240 0x7f20bc1f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c1b53640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc156240 0x7f20bc1f4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40176/0 (socket says 172.21.15.96:40176) 2024-04-18T05:01:16.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c1b53640 1 -- 172.21.15.96:0/347052867 learned_addr learned my addr 172.21.15.96:0/347052867 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:16.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c0b51640 1 --2- 172.21.15.96:0/347052867 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20bc14fc60 0x7f20bc1f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c1352640 1 --2- 172.21.15.96:0/347052867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20bc06dd50 0x7f20bc071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c1b53640 1 -- 172.21.15.96:0/347052867 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20bc14fc60 msgr2=0x7f20bc1f49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c1b53640 1 --2- 172.21.15.96:0/347052867 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20bc14fc60 0x7f20bc1f49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c1b53640 1 -- 172.21.15.96:0/347052867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20bc06dd50 msgr2=0x7f20bc071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c1b53640 1 --2- 172.21.15.96:0/347052867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20bc06dd50 0x7f20bc071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c1b53640 1 -- 172.21.15.96:0/347052867 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b80094d0 con 0x7f20bc156240 2024-04-18T05:01:16.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c1b53640 1 --2- 172.21.15.96:0/347052867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc156240 0x7f20bc1f4f00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f20b4007e60 tx=0x7f20b400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:16.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20b1ffb640 1 -- 172.21.15.96:0/347052867 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4014420 con 0x7f20bc156240 2024-04-18T05:01:16.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20b1ffb640 1 -- 172.21.15.96:0/347052867 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b40145a0 con 0x7f20bc156240 2024-04-18T05:01:16.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20b1ffb640 1 -- 172.21.15.96:0/347052867 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4014950 con 0x7f20bc156240 2024-04-18T05:01:16.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c35b6640 1 -- 172.21.15.96:0/347052867 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20bc1f1780 con 0x7f20bc156240 2024-04-18T05:01:16.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c35b6640 1 -- 172.21.15.96:0/347052867 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20bc1f1d40 con 0x7f20bc156240 2024-04-18T05:01:16.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c35b6640 1 -- 172.21.15.96:0/347052867 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f20bc0c8ed0 con 0x7f20bc156240 2024-04-18T05:01:16.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20b1ffb640 1 -- 172.21.15.96:0/347052867 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f20b4014ab0 con 0x7f20bc156240 2024-04-18T05:01:16.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20b1ffb640 1 --2- 172.21.15.96:0/347052867 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f20a0066690 0x7f20a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20b1ffb640 1 -- 172.21.15.96:0/347052867 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f20b4084970 con 0x7f20bc156240 2024-04-18T05:01:16.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.306+0000 7f20c1352640 1 --2- 172.21.15.96:0/347052867 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f20a0066690 0x7f20a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.310+0000 7f20b1ffb640 1 --2- 172.21.15.96:0/347052867 >> [v2:172.21.15.96:6800/27478,v1:172.21.15.96:6801/27478] conn(0x7f20a006e890 0x7f20a0070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.310+0000 7f20b1ffb640 1 -- 172.21.15.96:0/347052867 --> [v2:172.21.15.96:6800/27478,v1:172.21.15.96:6801/27478] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20a0071380 con 0x7f20a006e890 2024-04-18T05:01:16.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.310+0000 7f20b1ffb640 1 -- 172.21.15.96:0/347052867 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20b40892c0 con 0x7f20bc156240 2024-04-18T05:01:16.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.310+0000 7f20c0b51640 1 --2- 172.21.15.96:0/347052867 >> [v2:172.21.15.96:6800/27478,v1:172.21.15.96:6801/27478] conn(0x7f20a006e890 0x7f20a0070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.310+0000 7f20c1352640 1 --2- 172.21.15.96:0/347052867 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f20a0066690 0x7f20a0068b50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f20b80ad000 tx=0x7f20b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:16.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.310+0000 7f20c0b51640 1 --2- 172.21.15.96:0/347052867 >> [v2:172.21.15.96:6800/27478,v1:172.21.15.96:6801/27478] conn(0x7f20a006e890 0x7f20a0070cb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:16.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.310+0000 7f20b1ffb640 1 -- 172.21.15.96:0/347052867 <== osd.0 v2:172.21.15.96:6800/27478 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f20a0071380 con 0x7f20a006e890 2024-04-18T05:01:16.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.322+0000 7f20c35b6640 1 -- 172.21.15.96:0/347052867 --> [v2:172.21.15.96:6800/27478,v1:172.21.15.96:6801/27478] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f20bc1623c0 con 0x7f20a006e890 2024-04-18T05:01:16.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.322+0000 7f20b1ffb640 1 -- 172.21.15.96:0/347052867 <== osd.0 v2:172.21.15.96:6800/27478 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f20ac00c040 con 0x7f20a006e890 2024-04-18T05:01:16.324 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T05:01:16.325 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T05:01:16.325 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T05:01:16.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.322+0000 7f20c35b6640 1 -- 172.21.15.96:0/347052867 >> [v2:172.21.15.96:6800/27478,v1:172.21.15.96:6801/27478] conn(0x7f20a006e890 msgr2=0x7f20a0070cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.322+0000 7f20c35b6640 1 --2- 172.21.15.96:0/347052867 >> [v2:172.21.15.96:6800/27478,v1:172.21.15.96:6801/27478] conn(0x7f20a006e890 0x7f20a0070cb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.322+0000 7f20c35b6640 1 -- 172.21.15.96:0/347052867 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f20a0066690 msgr2=0x7f20a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.322+0000 7f20c35b6640 1 --2- 172.21.15.96:0/347052867 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f20a0066690 0x7f20a0068b50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f20b80ad000 tx=0x7f20b8008040 comp rx=0 tx=0).stop 2024-04-18T05:01:16.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.322+0000 7f20c35b6640 1 -- 172.21.15.96:0/347052867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc156240 msgr2=0x7f20bc1f4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.322+0000 7f20c35b6640 1 --2- 172.21.15.96:0/347052867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20bc156240 0x7f20bc1f4f00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f20b4007e60 tx=0x7f20b400e4b0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.322+0000 7f20c1b53640 1 -- 172.21.15.96:0/347052867 reap_dead start 2024-04-18T05:01:16.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.322+0000 7f20c35b6640 1 -- 172.21.15.96:0/347052867 shutdown_connections 2024-04-18T05:01:16.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.322+0000 7f20c35b6640 1 -- 172.21.15.96:0/347052867 >> 172.21.15.96:0/347052867 conn(0x7f20bc06c610 msgr2=0x7f20bc0c9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:16.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.322+0000 7f20c35b6640 1 -- 172.21.15.96:0/347052867 shutdown_connections 2024-04-18T05:01:16.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.322+0000 7f20c35b6640 1 -- 172.21.15.96:0/347052867 wait complete. 2024-04-18T05:01:16.340 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-18T05:01:16.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f8959361640 1 Processor -- start 2024-04-18T05:01:16.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f8959361640 1 -- start start 2024-04-18T05:01:16.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f8959361640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f89540c5b30 0x7f89540c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f8959361640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f895415a270 0x7f89540c1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f8959361640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f89540c6670 0x7f8954157620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f8959361640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8954157200 con 0x7f89540c5b30 2024-04-18T05:01:16.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f8959361640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89540c6450 con 0x7f89540c6670 2024-04-18T05:01:16.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f8959361640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895406c650 con 0x7f895415a270 2024-04-18T05:01:16.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f8952ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f89540c5b30 0x7f89540c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f8952ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f89540c5b30 0x7f89540c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40184/0 (socket says 172.21.15.96:40184) 2024-04-18T05:01:16.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f8952ffd640 1 -- 172.21.15.96:0/3958312337 learned_addr learned my addr 172.21.15.96:0/3958312337 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:16.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f89527fc640 1 --2- 172.21.15.96:0/3958312337 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f895415a270 0x7f89540c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f89537fe640 1 --2- 172.21.15.96:0/3958312337 >> v2:172.21.15.139:3300/0 conn(0x7f89540c6670 0x7f8954157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f8952ffd640 1 -- 172.21.15.96:0/3958312337 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f895415a270 msgr2=0x7f89540c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:16.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f8952ffd640 1 --2- 172.21.15.96:0/3958312337 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f895415a270 0x7f89540c1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f8952ffd640 1 -- 172.21.15.96:0/3958312337 >> v2:172.21.15.139:3300/0 conn(0x7f89540c6670 msgr2=0x7f8954157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:16.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f8952ffd640 1 --2- 172.21.15.96:0/3958312337 >> v2:172.21.15.139:3300/0 conn(0x7f89540c6670 0x7f8954157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f8952ffd640 1 -- 172.21.15.96:0/3958312337 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89540c1d40 con 0x7f89540c5b30 2024-04-18T05:01:16.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.446+0000 7f89527fc640 1 --2- 172.21.15.96:0/3958312337 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f895415a270 0x7f89540c1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T05:01:16.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8952ffd640 1 --2- 172.21.15.96:0/3958312337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89540c5b30 0x7f89540c5f10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f89540724a0 tx=0x7f894401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bc92461d5dc9cf server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:16.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8951ffb640 1 -- 172.21.15.96:0/3958312337 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89440a89d0 con 0x7f89540c5b30 2024-04-18T05:01:16.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8951ffb640 1 -- 172.21.15.96:0/3958312337 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89440a8b30 con 0x7f89540c5b30 2024-04-18T05:01:16.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8951ffb640 1 -- 172.21.15.96:0/3958312337 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89440b0440 con 0x7f89540c5b30 2024-04-18T05:01:16.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 -- 172.21.15.96:0/3958312337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89540c5b30 msgr2=0x7f89540c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 --2- 172.21.15.96:0/3958312337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89540c5b30 0x7f89540c5f10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f89540724a0 tx=0x7f894401ed10 comp rx=0 tx=0).stop 2024-04-18T05:01:16.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 -- 172.21.15.96:0/3958312337 shutdown_connections 2024-04-18T05:01:16.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 --2- 172.21.15.96:0/3958312337 >> v2:172.21.15.139:3300/0 conn(0x7f89540c6670 0x7f8954157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 --2- 172.21.15.96:0/3958312337 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f895415a270 0x7f89540c1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 --2- 172.21.15.96:0/3958312337 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89540c5b30 0x7f89540c5f10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 -- 172.21.15.96:0/3958312337 >> 172.21.15.96:0/3958312337 conn(0x7f895406a8e0 msgr2=0x7f89540c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:16.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 -- 172.21.15.96:0/3958312337 shutdown_connections 2024-04-18T05:01:16.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 -- 172.21.15.96:0/3958312337 wait complete. 2024-04-18T05:01:16.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 Processor -- start 2024-04-18T05:01:16.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 -- start start 2024-04-18T05:01:16.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89540c5b30 0x7f89540c2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89540c6670 0x7f89541e0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f895415a270 0x7f8954154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89540be1c0 con 0x7f89540c5b30 2024-04-18T05:01:16.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89541e02a0 con 0x7f895415a270 2024-04-18T05:01:16.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89540be3f0 con 0x7f89540c6670 2024-04-18T05:01:16.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8952ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89540c5b30 0x7f89540c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8952ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89540c5b30 0x7f89540c2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40192/0 (socket says 172.21.15.96:40192) 2024-04-18T05:01:16.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8952ffd640 1 -- 172.21.15.96:0/1508859309 learned_addr learned my addr 172.21.15.96:0/1508859309 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:16.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f89527fc640 1 --2- 172.21.15.96:0/1508859309 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89540c6670 0x7f89541e0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8952ffd640 1 -- 172.21.15.96:0/1508859309 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89540c6670 msgr2=0x7f89541e0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8952ffd640 1 --2- 172.21.15.96:0/1508859309 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89540c6670 0x7f89541e0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8952ffd640 1 -- 172.21.15.96:0/1508859309 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f895415a270 msgr2=0x7f8954154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8952ffd640 1 --2- 172.21.15.96:0/1508859309 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f895415a270 0x7f8954154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8952ffd640 1 -- 172.21.15.96:0/1508859309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89440094d0 con 0x7f89540c5b30 2024-04-18T05:01:16.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8952ffd640 1 --2- 172.21.15.96:0/1508859309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89540c5b30 0x7f89540c2130 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f89440b3040 tx=0x7f894401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:16.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f893b7fe640 1 -- 172.21.15.96:0/1508859309 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89440ba600 con 0x7f89540c5b30 2024-04-18T05:01:16.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f893b7fe640 1 -- 172.21.15.96:0/1508859309 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89440ba760 con 0x7f89540c5b30 2024-04-18T05:01:16.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 -- 172.21.15.96:0/1508859309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89540be6b0 con 0x7f89540c5b30 2024-04-18T05:01:16.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f893b7fe640 1 -- 172.21.15.96:0/1508859309 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89440bab10 con 0x7f89540c5b30 2024-04-18T05:01:16.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.450+0000 7f8959361640 1 -- 172.21.15.96:0/1508859309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89540bec70 con 0x7f89540c5b30 2024-04-18T05:01:16.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.454+0000 7f8959361640 1 -- 172.21.15.96:0/1508859309 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895406ca60 con 0x7f89540c5b30 2024-04-18T05:01:16.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.454+0000 7f893b7fe640 1 -- 172.21.15.96:0/1508859309 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89440bac70 con 0x7f89540c5b30 2024-04-18T05:01:16.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.454+0000 7f893b7fe640 1 --2- 172.21.15.96:0/1508859309 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8940066690 0x7f8940068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.454+0000 7f89527fc640 1 --2- 172.21.15.96:0/1508859309 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8940066690 0x7f8940068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.454+0000 7f893b7fe640 1 -- 172.21.15.96:0/1508859309 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8944122760 con 0x7f89540c5b30 2024-04-18T05:01:16.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.454+0000 7f89527fc640 1 --2- 172.21.15.96:0/1508859309 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8940066690 0x7f8940068b50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8954159120 tx=0x7f8948008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:16.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.458+0000 7f893b7fe640 1 -- 172.21.15.96:0/1508859309 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f89440efab0 con 0x7f89540c5b30 2024-04-18T05:01:16.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.602+0000 7f8959361640 1 -- 172.21.15.96:0/1508859309 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f89541e0090 con 0x7f8940066690 2024-04-18T05:01:16.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.606+0000 7f893b7fe640 1 -- 172.21.15.96:0/1508859309 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8948015440 con 0x7f8940066690 2024-04-18T05:01:16.608 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 0 to deep-scrub 2024-04-18T05:01:16.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.606+0000 7f8959361640 1 -- 172.21.15.96:0/1508859309 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8940066690 msgr2=0x7f8940068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.606+0000 7f8959361640 1 --2- 172.21.15.96:0/1508859309 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8940066690 0x7f8940068b50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8954159120 tx=0x7f8948008040 comp rx=0 tx=0).stop 2024-04-18T05:01:16.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.606+0000 7f8959361640 1 -- 172.21.15.96:0/1508859309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89540c5b30 msgr2=0x7f89540c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.606+0000 7f8959361640 1 --2- 172.21.15.96:0/1508859309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89540c5b30 0x7f89540c2130 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f89440b3040 tx=0x7f894401bab0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.606+0000 7f8959361640 1 -- 172.21.15.96:0/1508859309 shutdown_connections 2024-04-18T05:01:16.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.606+0000 7f8959361640 1 --2- 172.21.15.96:0/1508859309 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f8940066690 0x7f8940068b50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.606+0000 7f8959361640 1 --2- 172.21.15.96:0/1508859309 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f895415a270 0x7f8954154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.606+0000 7f8959361640 1 --2- 172.21.15.96:0/1508859309 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89540c6670 0x7f89541e0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.606+0000 7f8959361640 1 --2- 172.21.15.96:0/1508859309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89540c5b30 0x7f89540c2130 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.606+0000 7f8959361640 1 -- 172.21.15.96:0/1508859309 >> 172.21.15.96:0/1508859309 conn(0x7f895406a8e0 msgr2=0x7f895415a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:16.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.606+0000 7f8959361640 1 -- 172.21.15.96:0/1508859309 shutdown_connections 2024-04-18T05:01:16.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.606+0000 7f8959361640 1 -- 172.21.15.96:0/1508859309 wait complete. 2024-04-18T05:01:16.625 INFO:tasks.ceph:Scrubbing osd.1 2024-04-18T05:01:16.626 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-18T05:01:16.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.738+0000 7fc6779bf640 1 Processor -- start 2024-04-18T05:01:16.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.738+0000 7fc6779bf640 1 -- start start 2024-04-18T05:01:16.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.738+0000 7fc6779bf640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc67006fd30 0x7fc6700cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.738+0000 7fc6779bf640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc670153300 0x7fc6700cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.738+0000 7fc6779bf640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc670158f50 con 0x7fc670070110 2024-04-18T05:01:16.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.738+0000 7fc6779bf640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6701591f0 con 0x7fc670153300 2024-04-18T05:01:16.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.738+0000 7fc6779bf640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6701594d0 con 0x7fc67006fd30 2024-04-18T05:01:16.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.738+0000 7fc675f5c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc670153300 0x7fc6700cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.738+0000 7fc675f5c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc670153300 0x7fc6700cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40206/0 (socket says 172.21.15.96:40206) 2024-04-18T05:01:16.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.738+0000 7fc675f5c640 1 -- 172.21.15.96:0/2625559474 learned_addr learned my addr 172.21.15.96:0/2625559474 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:16.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.738+0000 7fc67575b640 1 --2- 172.21.15.96:0/2625559474 >> v2:172.21.15.139:3300/0 conn(0x7fc67006fd30 0x7fc6700cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.738+0000 7fc675f5c640 1 -- 172.21.15.96:0/2625559474 >> v2:172.21.15.139:3300/0 conn(0x7fc67006fd30 msgr2=0x7fc6700cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:16.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.738+0000 7fc675f5c640 1 --2- 172.21.15.96:0/2625559474 >> v2:172.21.15.139:3300/0 conn(0x7fc67006fd30 0x7fc6700cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.738+0000 7fc675f5c640 1 -- 172.21.15.96:0/2625559474 >> v1:172.21.15.96:6789/0 conn(0x7fc670070110 legacy=0x7fc670152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.738+0000 7fc675f5c640 1 -- 172.21.15.96:0/2625559474 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6701597b0 con 0x7fc670153300 2024-04-18T05:01:16.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc675f5c640 1 --2- 172.21.15.96:0/2625559474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc670153300 0x7fc6700cca00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc668009e50 tx=0x7fc66801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be99179d6f7429d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:16.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc667fff640 1 -- 172.21.15.96:0/2625559474 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6680a5730 con 0x7fc670153300 2024-04-18T05:01:16.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc667fff640 1 -- 172.21.15.96:0/2625559474 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6680a5890 con 0x7fc670153300 2024-04-18T05:01:16.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc667fff640 1 -- 172.21.15.96:0/2625559474 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6680a5c20 con 0x7fc670153300 2024-04-18T05:01:16.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc6779bf640 1 -- 172.21.15.96:0/2625559474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc670153300 msgr2=0x7fc6700cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc6779bf640 1 --2- 172.21.15.96:0/2625559474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc670153300 0x7fc6700cca00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc668009e50 tx=0x7fc66801c960 comp rx=0 tx=0).stop 2024-04-18T05:01:16.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc6779bf640 1 -- 172.21.15.96:0/2625559474 shutdown_connections 2024-04-18T05:01:16.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc6779bf640 1 --2- 172.21.15.96:0/2625559474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc670153300 0x7fc6700cca00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc6779bf640 1 --2- 172.21.15.96:0/2625559474 >> v2:172.21.15.139:3300/0 conn(0x7fc67006fd30 0x7fc6700cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc6779bf640 1 -- 172.21.15.96:0/2625559474 >> 172.21.15.96:0/2625559474 conn(0x7fc670069e60 msgr2=0x7fc67006de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:16.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc6779bf640 1 -- 172.21.15.96:0/2625559474 shutdown_connections 2024-04-18T05:01:16.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc6779bf640 1 -- 172.21.15.96:0/2625559474 wait complete. 2024-04-18T05:01:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc6779bf640 1 Processor -- start 2024-04-18T05:01:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc6779bf640 1 -- start start 2024-04-18T05:01:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc6779bf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc67006fd30 0x7fc6701f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc6779bf640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc670070110 0x7fc6701eab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc6779bf640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc670153300 0x7fc6701443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc6779bf640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6700c5f80 con 0x7fc670153300 2024-04-18T05:01:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc6779bf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6700c4ea0 con 0x7fc67006fd30 2024-04-18T05:01:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc6779bf640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6700c59c0 con 0x7fc670070110 2024-04-18T05:01:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc675f5c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc670153300 0x7fc6701443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc675f5c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc670153300 0x7fc6701443f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40208/0 (socket says 172.21.15.96:40208) 2024-04-18T05:01:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc675f5c640 1 -- 172.21.15.96:0/3787921785 learned_addr learned my addr 172.21.15.96:0/3787921785 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc674f5a640 1 --2- 172.21.15.96:0/3787921785 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc670070110 0x7fc6701eab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc67575b640 1 --2- 172.21.15.96:0/3787921785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc67006fd30 0x7fc6701f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc675f5c640 1 -- 172.21.15.96:0/3787921785 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc670070110 msgr2=0x7fc6701eab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc675f5c640 1 --2- 172.21.15.96:0/3787921785 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc670070110 0x7fc6701eab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc675f5c640 1 -- 172.21.15.96:0/3787921785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc67006fd30 msgr2=0x7fc6701f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc675f5c640 1 --2- 172.21.15.96:0/3787921785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc67006fd30 0x7fc6701f21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.742+0000 7fc675f5c640 1 -- 172.21.15.96:0/3787921785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc668009b30 con 0x7fc670153300 2024-04-18T05:01:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc675f5c640 1 --2- 172.21.15.96:0/3787921785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc670153300 0x7fc6701443f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc6680af040 tx=0x7fc668019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc665ffb640 1 -- 172.21.15.96:0/3787921785 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6680a5e10 con 0x7fc670153300 2024-04-18T05:01:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc665ffb640 1 -- 172.21.15.96:0/3787921785 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6680b8470 con 0x7fc670153300 2024-04-18T05:01:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc6779bf640 1 -- 172.21.15.96:0/3787921785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6700c5ca0 con 0x7fc670153300 2024-04-18T05:01:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc665ffb640 1 -- 172.21.15.96:0/3787921785 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6680b8820 con 0x7fc670153300 2024-04-18T05:01:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc6779bf640 1 -- 172.21.15.96:0/3787921785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6701f19c0 con 0x7fc670153300 2024-04-18T05:01:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc6779bf640 1 -- 172.21.15.96:0/3787921785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc6701f1540 con 0x7fc670153300 2024-04-18T05:01:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc665ffb640 1 -- 172.21.15.96:0/3787921785 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc6680039a0 con 0x7fc670153300 2024-04-18T05:01:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc665ffb640 1 --2- 172.21.15.96:0/3787921785 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc6540666c0 0x7fc654068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc67575b640 1 --2- 172.21.15.96:0/3787921785 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc6540666c0 0x7fc654068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc665ffb640 1 -- 172.21.15.96:0/3787921785 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc66811ef20 con 0x7fc670153300 2024-04-18T05:01:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc665ffb640 1 --2- 172.21.15.96:0/3787921785 >> [v2:172.21.15.96:6808/27479,v1:172.21.15.96:6810/27479] conn(0x7fc65406e8c0 0x7fc654070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc665ffb640 1 -- 172.21.15.96:0/3787921785 --> [v2:172.21.15.96:6808/27479,v1:172.21.15.96:6810/27479] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6540713b0 con 0x7fc65406e8c0 2024-04-18T05:01:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc665ffb640 1 -- 172.21.15.96:0/3787921785 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6681215e0 con 0x7fc670153300 2024-04-18T05:01:16.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc674f5a640 1 --2- 172.21.15.96:0/3787921785 >> [v2:172.21.15.96:6808/27479,v1:172.21.15.96:6810/27479] conn(0x7fc65406e8c0 0x7fc654070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc67575b640 1 --2- 172.21.15.96:0/3787921785 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc6540666c0 0x7fc654068b80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc66c009790 tx=0x7fc66c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:16.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc674f5a640 1 --2- 172.21.15.96:0/3787921785 >> [v2:172.21.15.96:6808/27479,v1:172.21.15.96:6810/27479] conn(0x7fc65406e8c0 0x7fc654070ce0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:16.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.746+0000 7fc665ffb640 1 -- 172.21.15.96:0/3787921785 <== osd.1 v2:172.21.15.96:6808/27479 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fc6540713b0 con 0x7fc65406e8c0 2024-04-18T05:01:16.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.758+0000 7fc6779bf640 1 -- 172.21.15.96:0/3787921785 --> [v2:172.21.15.96:6808/27479,v1:172.21.15.96:6810/27479] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc670067050 con 0x7fc65406e8c0 2024-04-18T05:01:16.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.758+0000 7fc665ffb640 1 -- 172.21.15.96:0/3787921785 <== osd.1 v2:172.21.15.96:6808/27479 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc670067050 con 0x7fc65406e8c0 2024-04-18T05:01:16.763 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T05:01:16.763 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T05:01:16.763 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T05:01:16.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.758+0000 7fc6779bf640 1 -- 172.21.15.96:0/3787921785 >> [v2:172.21.15.96:6808/27479,v1:172.21.15.96:6810/27479] conn(0x7fc65406e8c0 msgr2=0x7fc654070ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.762+0000 7fc6779bf640 1 --2- 172.21.15.96:0/3787921785 >> [v2:172.21.15.96:6808/27479,v1:172.21.15.96:6810/27479] conn(0x7fc65406e8c0 0x7fc654070ce0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.762+0000 7fc6779bf640 1 -- 172.21.15.96:0/3787921785 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc6540666c0 msgr2=0x7fc654068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.762+0000 7fc6779bf640 1 --2- 172.21.15.96:0/3787921785 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fc6540666c0 0x7fc654068b80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc66c009790 tx=0x7fc66c008040 comp rx=0 tx=0).stop 2024-04-18T05:01:16.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.762+0000 7fc6779bf640 1 -- 172.21.15.96:0/3787921785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc670153300 msgr2=0x7fc6701443f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.762+0000 7fc6779bf640 1 --2- 172.21.15.96:0/3787921785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc670153300 0x7fc6701443f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc6680af040 tx=0x7fc668019700 comp rx=0 tx=0).stop 2024-04-18T05:01:16.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.762+0000 7fc675f5c640 1 -- 172.21.15.96:0/3787921785 reap_dead start 2024-04-18T05:01:16.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.762+0000 7fc6779bf640 1 -- 172.21.15.96:0/3787921785 shutdown_connections 2024-04-18T05:01:16.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.762+0000 7fc6779bf640 1 -- 172.21.15.96:0/3787921785 >> 172.21.15.96:0/3787921785 conn(0x7fc670069e60 msgr2=0x7fc67006dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:16.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.762+0000 7fc6779bf640 1 -- 172.21.15.96:0/3787921785 shutdown_connections 2024-04-18T05:01:16.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.762+0000 7fc6779bf640 1 -- 172.21.15.96:0/3787921785 wait complete. 2024-04-18T05:01:16.778 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-18T05:01:16.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.882+0000 7f5e7d35c640 1 Processor -- start 2024-04-18T05:01:16.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.882+0000 7f5e7d35c640 1 -- start start 2024-04-18T05:01:16.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.886+0000 7f5e7d35c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e7814fad0 0x7f5e780ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.886+0000 7f5e7d35c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5e780c4660 0x7f5e780c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.886+0000 7f5e7d35c640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e78155fe0 con 0x7f5e780ca470 2024-04-18T05:01:16.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.886+0000 7f5e7d35c640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e780cb280 con 0x7f5e780c4660 2024-04-18T05:01:16.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.886+0000 7f5e7d35c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e78156b80 con 0x7f5e7814fad0 2024-04-18T05:01:16.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.886+0000 7f5e76ffd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e7814fad0 0x7f5e780ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.886+0000 7f5e76ffd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e7814fad0 0x7f5e780ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:49208/0 (socket says 172.21.15.96:49208) 2024-04-18T05:01:16.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.886+0000 7f5e76ffd640 1 -- 172.21.15.96:0/3683908828 learned_addr learned my addr 172.21.15.96:0/3683908828 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:16.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.886+0000 7f5e777fe640 1 --2- 172.21.15.96:0/3683908828 >> v2:172.21.15.139:3300/0 conn(0x7f5e780c4660 0x7f5e780c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.886+0000 7f5e76ffd640 1 -- 172.21.15.96:0/3683908828 >> v2:172.21.15.139:3300/0 conn(0x7f5e780c4660 msgr2=0x7f5e780c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:16.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.886+0000 7f5e76ffd640 1 --2- 172.21.15.96:0/3683908828 >> v2:172.21.15.139:3300/0 conn(0x7f5e780c4660 0x7f5e780c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.886+0000 7f5e76ffd640 1 -- 172.21.15.96:0/3683908828 >> v1:172.21.15.139:6789/0 conn(0x7f5e780ca470 legacy=0x7f5e78156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.886+0000 7f5e76ffd640 1 -- 172.21.15.96:0/3683908828 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e78155cb0 con 0x7f5e7814fad0 2024-04-18T05:01:16.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e76ffd640 1 --2- 172.21.15.96:0/3683908828 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e7814fad0 0x7f5e780ca9f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009870 tx=0x7f5e6c01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67fb06ae02fcab33 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:16.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e75ffb640 1 -- 172.21.15.96:0/3683908828 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0a8a50 con 0x7f5e7814fad0 2024-04-18T05:01:16.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e75ffb640 1 -- 172.21.15.96:0/3683908828 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c0a8bb0 con 0x7f5e7814fad0 2024-04-18T05:01:16.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e75ffb640 1 -- 172.21.15.96:0/3683908828 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0b0440 con 0x7f5e7814fad0 2024-04-18T05:01:16.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 -- 172.21.15.96:0/3683908828 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e7814fad0 msgr2=0x7f5e780ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 --2- 172.21.15.96:0/3683908828 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e7814fad0 0x7f5e780ca9f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009870 tx=0x7f5e6c01ed50 comp rx=0 tx=0).stop 2024-04-18T05:01:16.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 -- 172.21.15.96:0/3683908828 shutdown_connections 2024-04-18T05:01:16.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 --2- 172.21.15.96:0/3683908828 >> v2:172.21.15.139:3300/0 conn(0x7f5e780c4660 0x7f5e780c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 --2- 172.21.15.96:0/3683908828 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e7814fad0 0x7f5e780ca9f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 -- 172.21.15.96:0/3683908828 >> 172.21.15.96:0/3683908828 conn(0x7f5e780c7e80 msgr2=0x7f5e780c8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:16.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 -- 172.21.15.96:0/3683908828 shutdown_connections 2024-04-18T05:01:16.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 -- 172.21.15.96:0/3683908828 wait complete. 2024-04-18T05:01:16.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 Processor -- start 2024-04-18T05:01:16.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 -- start start 2024-04-18T05:01:16.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e780c4660 0x7f5e780c1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e780ca470 0x7f5e7814ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e7814fad0 0x7f5e7814cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e780c15f0 con 0x7f5e780c4660 2024-04-18T05:01:16.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7814e4d0 con 0x7f5e7814fad0 2024-04-18T05:01:16.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7814e780 con 0x7f5e780ca470 2024-04-18T05:01:16.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e76ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e780c4660 0x7f5e780c1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e76ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e780c4660 0x7f5e780c1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40222/0 (socket says 172.21.15.96:40222) 2024-04-18T05:01:16.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e76ffd640 1 -- 172.21.15.96:0/950243070 learned_addr learned my addr 172.21.15.96:0/950243070 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:16.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e767fc640 1 --2- 172.21.15.96:0/950243070 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e780ca470 0x7f5e7814ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e777fe640 1 --2- 172.21.15.96:0/950243070 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e7814fad0 0x7f5e7814cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e76ffd640 1 -- 172.21.15.96:0/950243070 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e780ca470 msgr2=0x7f5e7814ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e76ffd640 1 --2- 172.21.15.96:0/950243070 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e780ca470 0x7f5e7814ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e76ffd640 1 -- 172.21.15.96:0/950243070 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e7814fad0 msgr2=0x7f5e7814cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:16.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e76ffd640 1 --2- 172.21.15.96:0/950243070 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e7814fad0 0x7f5e7814cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:16.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e76ffd640 1 -- 172.21.15.96:0/950243070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c0094d0 con 0x7f5e780c4660 2024-04-18T05:01:16.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e76ffd640 1 --2- 172.21.15.96:0/950243070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e780c4660 0x7f5e780c1080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0b3040 tx=0x7f5e6c01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:16.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e5f7fe640 1 -- 172.21.15.96:0/950243070 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0b9620 con 0x7f5e780c4660 2024-04-18T05:01:16.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e5f7fe640 1 -- 172.21.15.96:0/950243070 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c0b97a0 con 0x7f5e780c4660 2024-04-18T05:01:16.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e7d35c640 1 -- 172.21.15.96:0/950243070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7814ea60 con 0x7f5e780c4660 2024-04-18T05:01:16.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.890+0000 7f5e5f7fe640 1 -- 172.21.15.96:0/950243070 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0b9b50 con 0x7f5e780c4660 2024-04-18T05:01:16.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.894+0000 7f5e7d35c640 1 -- 172.21.15.96:0/950243070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e780c0880 con 0x7f5e780c4660 2024-04-18T05:01:16.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.894+0000 7f5e7d35c640 1 -- 172.21.15.96:0/950243070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e780c3690 con 0x7f5e780c4660 2024-04-18T05:01:16.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.894+0000 7f5e5f7fe640 1 -- 172.21.15.96:0/950243070 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5e6c0b7070 con 0x7f5e780c4660 2024-04-18T05:01:16.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.894+0000 7f5e5f7fe640 1 --2- 172.21.15.96:0/950243070 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5e64066690 0x7f5e64068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:16.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.894+0000 7f5e5f7fe640 1 -- 172.21.15.96:0/950243070 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5e6c122180 con 0x7f5e780c4660 2024-04-18T05:01:16.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.894+0000 7f5e767fc640 1 --2- 172.21.15.96:0/950243070 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5e64066690 0x7f5e64068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:16.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.894+0000 7f5e767fc640 1 --2- 172.21.15.96:0/950243070 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5e64066690 0x7f5e64068b50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5e7814dd70 tx=0x7f5e68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:16.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:16.898+0000 7f5e5f7fe640 1 -- 172.21.15.96:0/950243070 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f5e6c0ef3a0 con 0x7f5e780c4660 2024-04-18T05:01:17.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.046+0000 7f5e7d35c640 1 -- 172.21.15.96:0/950243070 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e780caf30 con 0x7f5e64066690 2024-04-18T05:01:17.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.046+0000 7f5e5f7fe640 1 -- 172.21.15.96:0/950243070 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5e68003980 con 0x7f5e64066690 2024-04-18T05:01:17.049 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 1 to deep-scrub 2024-04-18T05:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.050+0000 7f5e7d35c640 1 -- 172.21.15.96:0/950243070 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5e64066690 msgr2=0x7f5e64068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.050+0000 7f5e7d35c640 1 --2- 172.21.15.96:0/950243070 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5e64066690 0x7f5e64068b50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5e7814dd70 tx=0x7f5e68009040 comp rx=0 tx=0).stop 2024-04-18T05:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.050+0000 7f5e7d35c640 1 -- 172.21.15.96:0/950243070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e780c4660 msgr2=0x7f5e780c1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.050+0000 7f5e7d35c640 1 --2- 172.21.15.96:0/950243070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e780c4660 0x7f5e780c1080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0b3040 tx=0x7f5e6c01baf0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.050+0000 7f5e7d35c640 1 -- 172.21.15.96:0/950243070 shutdown_connections 2024-04-18T05:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.050+0000 7f5e7d35c640 1 --2- 172.21.15.96:0/950243070 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f5e64066690 0x7f5e64068b50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.050+0000 7f5e7d35c640 1 --2- 172.21.15.96:0/950243070 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e7814fad0 0x7f5e7814cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.050+0000 7f5e7d35c640 1 --2- 172.21.15.96:0/950243070 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5e780ca470 0x7f5e7814ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.050+0000 7f5e7d35c640 1 --2- 172.21.15.96:0/950243070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e780c4660 0x7f5e780c1080 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.050+0000 7f5e7d35c640 1 -- 172.21.15.96:0/950243070 >> 172.21.15.96:0/950243070 conn(0x7f5e780c7e80 msgr2=0x7f5e780c9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.050+0000 7f5e7d35c640 1 -- 172.21.15.96:0/950243070 shutdown_connections 2024-04-18T05:01:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.050+0000 7f5e7d35c640 1 -- 172.21.15.96:0/950243070 wait complete. 2024-04-18T05:01:17.067 INFO:tasks.ceph:Scrubbing osd.2 2024-04-18T05:01:17.067 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-18T05:01:17.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee35189640 1 Processor -- start 2024-04-18T05:01:17.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee35189640 1 -- start start 2024-04-18T05:01:17.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee35189640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fee3006ae00 0x7fee30159870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee35189640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fee3006b8f0 0x7fee30163770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee35189640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee300c35d0 con 0x7fee300c9ee0 2024-04-18T05:01:17.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee35189640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee300c55f0 con 0x7fee3006ae00 2024-04-18T05:01:17.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee35189640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee300c3820 con 0x7fee3006b8f0 2024-04-18T05:01:17.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee2ed9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fee3006ae00 0x7fee30159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee2ed9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fee3006ae00 0x7fee30159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40224/0 (socket says 172.21.15.96:40224) 2024-04-18T05:01:17.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee2ed9d640 1 -- 172.21.15.96:0/905223021 learned_addr learned my addr 172.21.15.96:0/905223021 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:17.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee2f59e640 1 --2- 172.21.15.96:0/905223021 >> v2:172.21.15.139:3300/0 conn(0x7fee3006b8f0 0x7fee30163770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee2ed9d640 1 -- 172.21.15.96:0/905223021 >> v2:172.21.15.139:3300/0 conn(0x7fee3006b8f0 msgr2=0x7fee30163770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:17.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee2ed9d640 1 --2- 172.21.15.96:0/905223021 >> v2:172.21.15.139:3300/0 conn(0x7fee3006b8f0 0x7fee30163770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee2ed9d640 1 -- 172.21.15.96:0/905223021 >> v1:172.21.15.96:6789/0 conn(0x7fee300c9ee0 legacy=0x7fee3006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee2ed9d640 1 -- 172.21.15.96:0/905223021 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee300c3b00 con 0x7fee3006ae00 2024-04-18T05:01:17.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee2f59e640 1 --2- 172.21.15.96:0/905223021 >> v2:172.21.15.139:3300/0 conn(0x7fee3006b8f0 0x7fee30163770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:01:17.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.178+0000 7fee2ed9d640 1 --2- 172.21.15.96:0/905223021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee3006ae00 0x7fee30159870 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fee30069ef0 tx=0x7fee2001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd2fd01a278696 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:17.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee2e59c640 1 -- 172.21.15.96:0/905223021 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee200ab600 con 0x7fee3006ae00 2024-04-18T05:01:17.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee2e59c640 1 -- 172.21.15.96:0/905223021 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee200ab760 con 0x7fee3006ae00 2024-04-18T05:01:17.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee2e59c640 1 -- 172.21.15.96:0/905223021 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee200abaf0 con 0x7fee3006ae00 2024-04-18T05:01:17.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 -- 172.21.15.96:0/905223021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee3006ae00 msgr2=0x7fee30159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 --2- 172.21.15.96:0/905223021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee3006ae00 0x7fee30159870 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fee30069ef0 tx=0x7fee2001c4f0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 -- 172.21.15.96:0/905223021 shutdown_connections 2024-04-18T05:01:17.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 --2- 172.21.15.96:0/905223021 >> v2:172.21.15.139:3300/0 conn(0x7fee3006b8f0 0x7fee30163770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 --2- 172.21.15.96:0/905223021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee3006ae00 0x7fee30159870 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 -- 172.21.15.96:0/905223021 >> 172.21.15.96:0/905223021 conn(0x7fee30071760 msgr2=0x7fee30065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:17.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 -- 172.21.15.96:0/905223021 shutdown_connections 2024-04-18T05:01:17.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 -- 172.21.15.96:0/905223021 wait complete. 2024-04-18T05:01:17.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 Processor -- start 2024-04-18T05:01:17.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 -- start start 2024-04-18T05:01:17.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fee3006ae00 0x7fee30150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee3006b8f0 0x7fee300ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee300c9ee0 0x7fee300c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee30150670 con 0x7fee300c9ee0 2024-04-18T05:01:17.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee30145750 con 0x7fee3006b8f0 2024-04-18T05:01:17.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee301f59f0 con 0x7fee3006ae00 2024-04-18T05:01:17.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee2f59e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee300c9ee0 0x7fee300c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee2f59e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee300c9ee0 0x7fee300c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40232/0 (socket says 172.21.15.96:40232) 2024-04-18T05:01:17.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee2f59e640 1 -- 172.21.15.96:0/1948700541 learned_addr learned my addr 172.21.15.96:0/1948700541 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:17.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee2f59e640 1 -- 172.21.15.96:0/1948700541 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fee3006ae00 msgr2=0x7fee30150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee2f59e640 1 --2- 172.21.15.96:0/1948700541 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fee3006ae00 0x7fee30150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee27fff640 1 --2- 172.21.15.96:0/1948700541 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee3006b8f0 0x7fee300ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee2f59e640 1 -- 172.21.15.96:0/1948700541 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee3006b8f0 msgr2=0x7fee300ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee2f59e640 1 --2- 172.21.15.96:0/1948700541 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee3006b8f0 0x7fee300ca9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee2f59e640 1 -- 172.21.15.96:0/1948700541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee200094d0 con 0x7fee300c9ee0 2024-04-18T05:01:17.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee2f59e640 1 --2- 172.21.15.96:0/1948700541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee300c9ee0 0x7fee300c81f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fee2800cdd0 tx=0x7fee2800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:17.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee277fe640 1 -- 172.21.15.96:0/1948700541 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28003ba0 con 0x7fee300c9ee0 2024-04-18T05:01:17.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee277fe640 1 -- 172.21.15.96:0/1948700541 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee28003d00 con 0x7fee300c9ee0 2024-04-18T05:01:17.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 -- 172.21.15.96:0/1948700541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee301f19f0 con 0x7fee300c9ee0 2024-04-18T05:01:17.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee277fe640 1 -- 172.21.15.96:0/1948700541 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28004260 con 0x7fee300c9ee0 2024-04-18T05:01:17.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.182+0000 7fee35189640 1 -- 172.21.15.96:0/1948700541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee301f1fb0 con 0x7fee300c9ee0 2024-04-18T05:01:17.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.186+0000 7fee35189640 1 -- 172.21.15.96:0/1948700541 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fee300c48c0 con 0x7fee300c9ee0 2024-04-18T05:01:17.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.186+0000 7fee277fe640 1 -- 172.21.15.96:0/1948700541 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fee280043c0 con 0x7fee300c9ee0 2024-04-18T05:01:17.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.186+0000 7fee277fe640 1 --2- 172.21.15.96:0/1948700541 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fee10066690 0x7fee10068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.186+0000 7fee277fe640 1 -- 172.21.15.96:0/1948700541 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fee28084910 con 0x7fee300c9ee0 2024-04-18T05:01:17.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.186+0000 7fee2ed9d640 1 --2- 172.21.15.96:0/1948700541 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fee10066690 0x7fee10068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.186+0000 7fee277fe640 1 --2- 172.21.15.96:0/1948700541 >> [v2:172.21.15.96:6811/27481,v1:172.21.15.96:6815/27481] conn(0x7fee1006e890 0x7fee10070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.186+0000 7fee277fe640 1 -- 172.21.15.96:0/1948700541 --> [v2:172.21.15.96:6811/27481,v1:172.21.15.96:6815/27481] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee10071380 con 0x7fee1006e890 2024-04-18T05:01:17.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.186+0000 7fee277fe640 1 -- 172.21.15.96:0/1948700541 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee280892c0 con 0x7fee300c9ee0 2024-04-18T05:01:17.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.186+0000 7fee27fff640 1 --2- 172.21.15.96:0/1948700541 >> [v2:172.21.15.96:6811/27481,v1:172.21.15.96:6815/27481] conn(0x7fee1006e890 0x7fee10070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.186+0000 7fee2ed9d640 1 --2- 172.21.15.96:0/1948700541 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fee10066690 0x7fee10068b50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fee200af000 tx=0x7fee20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:17.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.186+0000 7fee27fff640 1 --2- 172.21.15.96:0/1948700541 >> [v2:172.21.15.96:6811/27481,v1:172.21.15.96:6815/27481] conn(0x7fee1006e890 0x7fee10070cb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:17.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.186+0000 7fee277fe640 1 -- 172.21.15.96:0/1948700541 <== osd.2 v2:172.21.15.96:6811/27481 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fee10071380 con 0x7fee1006e890 2024-04-18T05:01:17.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.198+0000 7fee35189640 1 -- 172.21.15.96:0/1948700541 --> [v2:172.21.15.96:6811/27481,v1:172.21.15.96:6815/27481] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fee300c91b0 con 0x7fee1006e890 2024-04-18T05:01:17.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.198+0000 7fee277fe640 1 -- 172.21.15.96:0/1948700541 <== osd.2 v2:172.21.15.96:6811/27481 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fee180017a0 con 0x7fee1006e890 2024-04-18T05:01:17.202 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T05:01:17.202 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T05:01:17.202 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T05:01:17.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.198+0000 7fee35189640 1 -- 172.21.15.96:0/1948700541 >> [v2:172.21.15.96:6811/27481,v1:172.21.15.96:6815/27481] conn(0x7fee1006e890 msgr2=0x7fee10070cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.198+0000 7fee35189640 1 --2- 172.21.15.96:0/1948700541 >> [v2:172.21.15.96:6811/27481,v1:172.21.15.96:6815/27481] conn(0x7fee1006e890 0x7fee10070cb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.198+0000 7fee35189640 1 -- 172.21.15.96:0/1948700541 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fee10066690 msgr2=0x7fee10068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.198+0000 7fee35189640 1 --2- 172.21.15.96:0/1948700541 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fee10066690 0x7fee10068b50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fee200af000 tx=0x7fee20008040 comp rx=0 tx=0).stop 2024-04-18T05:01:17.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.198+0000 7fee35189640 1 -- 172.21.15.96:0/1948700541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee300c9ee0 msgr2=0x7fee300c81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.198+0000 7fee35189640 1 --2- 172.21.15.96:0/1948700541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee300c9ee0 0x7fee300c81f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fee2800cdd0 tx=0x7fee2800a710 comp rx=0 tx=0).stop 2024-04-18T05:01:17.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.198+0000 7fee2f59e640 1 -- 172.21.15.96:0/1948700541 reap_dead start 2024-04-18T05:01:17.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.198+0000 7fee35189640 1 -- 172.21.15.96:0/1948700541 shutdown_connections 2024-04-18T05:01:17.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.198+0000 7fee35189640 1 -- 172.21.15.96:0/1948700541 >> 172.21.15.96:0/1948700541 conn(0x7fee30071760 msgr2=0x7fee3014d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:17.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.198+0000 7fee35189640 1 -- 172.21.15.96:0/1948700541 shutdown_connections 2024-04-18T05:01:17.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.198+0000 7fee35189640 1 -- 172.21.15.96:0/1948700541 wait complete. 2024-04-18T05:01:17.217 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-18T05:01:17.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.322+0000 7f0319278640 1 Processor -- start 2024-04-18T05:01:17.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.322+0000 7f0319278640 1 -- start start 2024-04-18T05:01:17.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.326+0000 7f0319278640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f031414f300 0x7f03141552b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.326+0000 7f0319278640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f031406d870 0x7f031406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.326+0000 7f0319278640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031406e7e0 con 0x7f031406fdf0 2024-04-18T05:01:17.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.326+0000 7f0319278640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03140c4d80 con 0x7f031406d870 2024-04-18T05:01:17.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.326+0000 7f0319278640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03140c5060 con 0x7f031414f300 2024-04-18T05:01:17.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.326+0000 7f0312ffd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f031414f300 0x7f03141552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.326+0000 7f0312ffd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f031414f300 0x7f03141552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:49244/0 (socket says 172.21.15.96:49244) 2024-04-18T05:01:17.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.326+0000 7f0312ffd640 1 -- 172.21.15.96:0/2167977742 learned_addr learned my addr 172.21.15.96:0/2167977742 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:17.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.326+0000 7f03137fe640 1 --2- 172.21.15.96:0/2167977742 >> v2:172.21.15.139:3300/0 conn(0x7f031406d870 0x7f031406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.326+0000 7f0312ffd640 1 -- 172.21.15.96:0/2167977742 >> v2:172.21.15.139:3300/0 conn(0x7f031406d870 msgr2=0x7f031406dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:17.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.326+0000 7f0312ffd640 1 --2- 172.21.15.96:0/2167977742 >> v2:172.21.15.139:3300/0 conn(0x7f031406d870 0x7f031406dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.326+0000 7f0312ffd640 1 -- 172.21.15.96:0/2167977742 >> v1:172.21.15.139:6789/0 conn(0x7f031406fdf0 legacy=0x7f0314070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.326+0000 7f0312ffd640 1 -- 172.21.15.96:0/2167977742 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03140c5340 con 0x7f031414f300 2024-04-18T05:01:17.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.330+0000 7f0312ffd640 1 --2- 172.21.15.96:0/2167977742 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f031414f300 0x7f03141552b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0304009870 tx=0x7f030401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17cde7783ef7ec67 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:17.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.330+0000 7f0311ffb640 1 -- 172.21.15.96:0/2167977742 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03040ab600 con 0x7f031414f300 2024-04-18T05:01:17.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.330+0000 7f0311ffb640 1 -- 172.21.15.96:0/2167977742 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03040a7050 con 0x7f031414f300 2024-04-18T05:01:17.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.330+0000 7f0311ffb640 1 -- 172.21.15.96:0/2167977742 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03040ab980 con 0x7f031414f300 2024-04-18T05:01:17.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.330+0000 7f0319278640 1 -- 172.21.15.96:0/2167977742 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f031414f300 msgr2=0x7f03141552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.330+0000 7f0319278640 1 --2- 172.21.15.96:0/2167977742 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f031414f300 0x7f03141552b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0304009870 tx=0x7f030401c4d0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.330+0000 7f0319278640 1 -- 172.21.15.96:0/2167977742 shutdown_connections 2024-04-18T05:01:17.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.330+0000 7f0319278640 1 --2- 172.21.15.96:0/2167977742 >> v2:172.21.15.139:3300/0 conn(0x7f031406d870 0x7f031406dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.330+0000 7f0319278640 1 --2- 172.21.15.96:0/2167977742 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f031414f300 0x7f03141552b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.330+0000 7f0319278640 1 -- 172.21.15.96:0/2167977742 >> 172.21.15.96:0/2167977742 conn(0x7f031406a8e0 msgr2=0x7f03140c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:17.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.330+0000 7f0319278640 1 -- 172.21.15.96:0/2167977742 shutdown_connections 2024-04-18T05:01:17.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.330+0000 7f0319278640 1 -- 172.21.15.96:0/2167977742 wait complete. 2024-04-18T05:01:17.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.330+0000 7f0319278640 1 Processor -- start 2024-04-18T05:01:17.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.330+0000 7f0319278640 1 -- start start 2024-04-18T05:01:17.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.330+0000 7f0319278640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f031406d870 0x7f0314141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.330+0000 7f0319278640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f031406fdf0 0x7f031413cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f0319278640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f031414f300 0x7f031413daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f0319278640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03140c8430 con 0x7f031406d870 2024-04-18T05:01:17.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f0319278640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0314141fd0 con 0x7f031406fdf0 2024-04-18T05:01:17.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f0319278640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03141ef240 con 0x7f031414f300 2024-04-18T05:01:17.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f0312ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f031406d870 0x7f0314141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f0312ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f031406d870 0x7f0314141a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40244/0 (socket says 172.21.15.96:40244) 2024-04-18T05:01:17.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f0312ffd640 1 -- 172.21.15.96:0/2815089241 learned_addr learned my addr 172.21.15.96:0/2815089241 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:17.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f03137fe640 1 --2- 172.21.15.96:0/2815089241 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f031414f300 0x7f031413daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f0312ffd640 1 -- 172.21.15.96:0/2815089241 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f031414f300 msgr2=0x7f031413daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f0312ffd640 1 --2- 172.21.15.96:0/2815089241 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f031414f300 0x7f031413daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f03127fc640 1 --2- 172.21.15.96:0/2815089241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f031406fdf0 0x7f031413cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f0312ffd640 1 -- 172.21.15.96:0/2815089241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f031406fdf0 msgr2=0x7f031413cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f0312ffd640 1 --2- 172.21.15.96:0/2815089241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f031406fdf0 0x7f031413cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f0312ffd640 1 -- 172.21.15.96:0/2815089241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03040094d0 con 0x7f031406d870 2024-04-18T05:01:17.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f0312ffd640 1 --2- 172.21.15.96:0/2815089241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f031406d870 0x7f0314141a90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f030401a100 tx=0x7f0304019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:17.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f02fb7fe640 1 -- 172.21.15.96:0/2815089241 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03040ba070 con 0x7f031406d870 2024-04-18T05:01:17.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f02fb7fe640 1 -- 172.21.15.96:0/2815089241 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03040abdb0 con 0x7f031406d870 2024-04-18T05:01:17.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f0319278640 1 -- 172.21.15.96:0/2815089241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03141ef520 con 0x7f031406d870 2024-04-18T05:01:17.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f02fb7fe640 1 -- 172.21.15.96:0/2815089241 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03040b6660 con 0x7f031406d870 2024-04-18T05:01:17.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f0319278640 1 -- 172.21.15.96:0/2815089241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03141efae0 con 0x7f031406d870 2024-04-18T05:01:17.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f0319278640 1 -- 172.21.15.96:0/2815089241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03140670f0 con 0x7f031406d870 2024-04-18T05:01:17.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f02fb7fe640 1 -- 172.21.15.96:0/2815089241 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f03040b2040 con 0x7f031406d870 2024-04-18T05:01:17.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f02fb7fe640 1 --2- 172.21.15.96:0/2815089241 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0300066690 0x7f0300068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f02fb7fe640 1 -- 172.21.15.96:0/2815089241 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f030411db80 con 0x7f031406d870 2024-04-18T05:01:17.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f03127fc640 1 --2- 172.21.15.96:0/2815089241 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0300066690 0x7f0300068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.334+0000 7f03127fc640 1 --2- 172.21.15.96:0/2815089241 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0300066690 0x7f0300068b50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0308007fd0 tx=0x7f0308009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:17.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.338+0000 7f02fb7fe640 1 -- 172.21.15.96:0/2815089241 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f03040eaed0 con 0x7f031406d870 2024-04-18T05:01:17.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.494+0000 7f0319278640 1 -- 172.21.15.96:0/2815089241 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f031413d930 con 0x7f0300066690 2024-04-18T05:01:17.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.494+0000 7f02fb7fe640 1 -- 172.21.15.96:0/2815089241 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f031413d930 con 0x7f0300066690 2024-04-18T05:01:17.498 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 2 to deep-scrub 2024-04-18T05:01:17.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.498+0000 7f0319278640 1 -- 172.21.15.96:0/2815089241 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0300066690 msgr2=0x7f0300068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.498+0000 7f0319278640 1 --2- 172.21.15.96:0/2815089241 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0300066690 0x7f0300068b50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0308007fd0 tx=0x7f0308009040 comp rx=0 tx=0).stop 2024-04-18T05:01:17.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.498+0000 7f0319278640 1 -- 172.21.15.96:0/2815089241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f031406d870 msgr2=0x7f0314141a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.498+0000 7f0319278640 1 --2- 172.21.15.96:0/2815089241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f031406d870 0x7f0314141a90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f030401a100 tx=0x7f0304019270 comp rx=0 tx=0).stop 2024-04-18T05:01:17.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.498+0000 7f0319278640 1 -- 172.21.15.96:0/2815089241 shutdown_connections 2024-04-18T05:01:17.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.498+0000 7f0319278640 1 --2- 172.21.15.96:0/2815089241 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f0300066690 0x7f0300068b50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.498+0000 7f0319278640 1 --2- 172.21.15.96:0/2815089241 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f031414f300 0x7f031413daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.498+0000 7f0319278640 1 --2- 172.21.15.96:0/2815089241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f031406fdf0 0x7f031413cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.498+0000 7f0319278640 1 --2- 172.21.15.96:0/2815089241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f031406d870 0x7f0314141a90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.498+0000 7f0319278640 1 -- 172.21.15.96:0/2815089241 >> 172.21.15.96:0/2815089241 conn(0x7f031406a8e0 msgr2=0x7f03140c9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:17.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.498+0000 7f0319278640 1 -- 172.21.15.96:0/2815089241 shutdown_connections 2024-04-18T05:01:17.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.498+0000 7f0319278640 1 -- 172.21.15.96:0/2815089241 wait complete. 2024-04-18T05:01:17.516 INFO:tasks.ceph:Scrubbing osd.3 2024-04-18T05:01:17.516 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-18T05:01:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.626+0000 7f6dda959640 1 Processor -- start 2024-04-18T05:01:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.626+0000 7f6dda959640 1 -- start start 2024-04-18T05:01:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.626+0000 7f6dda959640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6dd40c3eb0 0x7f6dd40c6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.626+0000 7f6dda959640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd4157900 0x7f6dd4070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.626+0000 7f6dda959640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd40c49d0 con 0x7f6dd4150e30 2024-04-18T05:01:17.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.626+0000 7f6dda959640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd41574e0 con 0x7f6dd40c3eb0 2024-04-18T05:01:17.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.626+0000 7f6dda959640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40c4410 con 0x7f6dd4157900 2024-04-18T05:01:17.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.626+0000 7f6dd8ef6640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd4157900 0x7f6dd4070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.626+0000 7f6dd8ef6640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd4157900 0x7f6dd4070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:49254/0 (socket says 172.21.15.96:49254) 2024-04-18T05:01:17.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.626+0000 7f6dd8ef6640 1 -- 172.21.15.96:0/1774864829 learned_addr learned my addr 172.21.15.96:0/1774864829 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:17.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.626+0000 7f6dcb7fe640 1 --2- 172.21.15.96:0/1774864829 >> v2:172.21.15.139:3300/0 conn(0x7f6dd40c3eb0 0x7f6dd40c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.626+0000 7f6dd8ef6640 1 -- 172.21.15.96:0/1774864829 >> v2:172.21.15.139:3300/0 conn(0x7f6dd40c3eb0 msgr2=0x7f6dd40c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:17.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.626+0000 7f6dd8ef6640 1 --2- 172.21.15.96:0/1774864829 >> v2:172.21.15.139:3300/0 conn(0x7f6dd40c3eb0 0x7f6dd40c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.626+0000 7f6dd8ef6640 1 -- 172.21.15.96:0/1774864829 >> v1:172.21.15.139:6789/0 conn(0x7f6dd4150e30 legacy=0x7f6dd40caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:17.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.626+0000 7f6dd8ef6640 1 -- 172.21.15.96:0/1774864829 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd40c46f0 con 0x7f6dd4157900 2024-04-18T05:01:17.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.630+0000 7f6dd8ef6640 1 --2- 172.21.15.96:0/1774864829 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd4157900 0x7f6dd4070240 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009e50 tx=0x7f6dcc01f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eecf9f4a468af222 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:17.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.630+0000 7f6dd37fe640 1 -- 172.21.15.96:0/1774864829 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc0af400 con 0x7f6dd4157900 2024-04-18T05:01:17.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.630+0000 7f6dd37fe640 1 -- 172.21.15.96:0/1774864829 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc0ab050 con 0x7f6dd4157900 2024-04-18T05:01:17.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.630+0000 7f6dd37fe640 1 -- 172.21.15.96:0/1774864829 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc0af780 con 0x7f6dd4157900 2024-04-18T05:01:17.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.630+0000 7f6dda959640 1 -- 172.21.15.96:0/1774864829 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd4157900 msgr2=0x7f6dd4070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.630+0000 7f6dda959640 1 --2- 172.21.15.96:0/1774864829 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd4157900 0x7f6dd4070240 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009e50 tx=0x7f6dcc01f1e0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.630+0000 7f6dda959640 1 -- 172.21.15.96:0/1774864829 shutdown_connections 2024-04-18T05:01:17.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.630+0000 7f6dda959640 1 --2- 172.21.15.96:0/1774864829 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd4157900 0x7f6dd4070240 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.630+0000 7f6dda959640 1 --2- 172.21.15.96:0/1774864829 >> v2:172.21.15.139:3300/0 conn(0x7f6dd40c3eb0 0x7f6dd40c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.630+0000 7f6dda959640 1 -- 172.21.15.96:0/1774864829 >> 172.21.15.96:0/1774864829 conn(0x7f6dd406de30 msgr2=0x7f6dd406e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:17.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.630+0000 7f6dda959640 1 -- 172.21.15.96:0/1774864829 shutdown_connections 2024-04-18T05:01:17.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.630+0000 7f6dda959640 1 -- 172.21.15.96:0/1774864829 wait complete. 2024-04-18T05:01:17.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dda959640 1 Processor -- start 2024-04-18T05:01:17.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dda959640 1 -- start start 2024-04-18T05:01:17.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dda959640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6dd40c3eb0 0x7f6dd4147b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dda959640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd4150e30 0x7f6dd414b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dda959640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd4157900 0x7f6dd41432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dda959640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd414e890 con 0x7f6dd4150e30 2024-04-18T05:01:17.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dda959640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd414c450 con 0x7f6dd40c3eb0 2024-04-18T05:01:17.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dda959640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4148080 con 0x7f6dd4157900 2024-04-18T05:01:17.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dcb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd4150e30 0x7f6dd414b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dcb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd4150e30 0x7f6dd414b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40250/0 (socket says 172.21.15.96:40250) 2024-04-18T05:01:17.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dcb7fe640 1 -- 172.21.15.96:0/3034661399 learned_addr learned my addr 172.21.15.96:0/3034661399 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:17.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dd8ef6640 1 --2- 172.21.15.96:0/3034661399 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd4157900 0x7f6dd41432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dd3fff640 1 --2- 172.21.15.96:0/3034661399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6dd40c3eb0 0x7f6dd4147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dcb7fe640 1 -- 172.21.15.96:0/3034661399 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd4157900 msgr2=0x7f6dd41432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dcb7fe640 1 --2- 172.21.15.96:0/3034661399 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd4157900 0x7f6dd41432e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dcb7fe640 1 -- 172.21.15.96:0/3034661399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6dd40c3eb0 msgr2=0x7f6dd4147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dcb7fe640 1 --2- 172.21.15.96:0/3034661399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6dd40c3eb0 0x7f6dd4147b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dcb7fe640 1 -- 172.21.15.96:0/3034661399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc009b30 con 0x7f6dd4150e30 2024-04-18T05:01:17.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dd3fff640 1 --2- 172.21.15.96:0/3034661399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6dd40c3eb0 0x7f6dd4147b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:01:17.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dcb7fe640 1 --2- 172.21.15.96:0/3034661399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd4150e30 0x7f6dd414b2b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00e960 tx=0x7f6dbc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:17.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dd17fa640 1 -- 172.21.15.96:0/3034661399 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc009690 con 0x7f6dd4150e30 2024-04-18T05:01:17.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dd17fa640 1 -- 172.21.15.96:0/3034661399 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc00c9a0 con 0x7f6dd4150e30 2024-04-18T05:01:17.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dd17fa640 1 -- 172.21.15.96:0/3034661399 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00cd10 con 0x7f6dd4150e30 2024-04-18T05:01:17.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dda959640 1 -- 172.21.15.96:0/3034661399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd40cb460 con 0x7f6dd4150e30 2024-04-18T05:01:17.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dda959640 1 -- 172.21.15.96:0/3034661399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd4146d80 con 0x7f6dd4150e30 2024-04-18T05:01:17.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dda959640 1 -- 172.21.15.96:0/3034661399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6dd40cb2e0 con 0x7f6dd4150e30 2024-04-18T05:01:17.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.634+0000 7f6dd17fa640 1 -- 172.21.15.96:0/3034661399 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6dbc013470 con 0x7f6dd4150e30 2024-04-18T05:01:17.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.638+0000 7f6dd17fa640 1 --2- 172.21.15.96:0/3034661399 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6db4066690 0x7f6db4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.638+0000 7f6dd17fa640 1 -- 172.21.15.96:0/3034661399 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6dbc0843c0 con 0x7f6dd4150e30 2024-04-18T05:01:17.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.638+0000 7f6dd3fff640 1 --2- 172.21.15.96:0/3034661399 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6db4066690 0x7f6db4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.638+0000 7f6dd17fa640 1 --2- 172.21.15.96:0/3034661399 >> [v2:172.21.15.96:6809/27480,v1:172.21.15.96:6812/27480] conn(0x7f6db406e890 0x7f6db4070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.638+0000 7f6dd17fa640 1 -- 172.21.15.96:0/3034661399 --> [v2:172.21.15.96:6809/27480,v1:172.21.15.96:6812/27480] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6db4071380 con 0x7f6db406e890 2024-04-18T05:01:17.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.638+0000 7f6dd17fa640 1 -- 172.21.15.96:0/3034661399 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6dbc086a80 con 0x7f6dd4150e30 2024-04-18T05:01:17.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.638+0000 7f6dd8ef6640 1 --2- 172.21.15.96:0/3034661399 >> [v2:172.21.15.96:6809/27480,v1:172.21.15.96:6812/27480] conn(0x7f6db406e890 0x7f6db4070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.638+0000 7f6dd3fff640 1 --2- 172.21.15.96:0/3034661399 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6db4066690 0x7f6db4068b50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4003e40 tx=0x7f6dc4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:17.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.638+0000 7f6dd8ef6640 1 --2- 172.21.15.96:0/3034661399 >> [v2:172.21.15.96:6809/27480,v1:172.21.15.96:6812/27480] conn(0x7f6db406e890 0x7f6db4070cb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:17.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.638+0000 7f6dd17fa640 1 -- 172.21.15.96:0/3034661399 <== osd.3 v2:172.21.15.96:6809/27480 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f6db4071380 con 0x7f6db406e890 2024-04-18T05:01:17.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.650+0000 7f6dda959640 1 -- 172.21.15.96:0/3034661399 --> [v2:172.21.15.96:6809/27480,v1:172.21.15.96:6812/27480] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6dd4157100 con 0x7f6db406e890 2024-04-18T05:01:17.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.650+0000 7f6dd17fa640 1 -- 172.21.15.96:0/3034661399 <== osd.3 v2:172.21.15.96:6809/27480 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6dcc009230 con 0x7f6db406e890 2024-04-18T05:01:17.653 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T05:01:17.653 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T05:01:17.653 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T05:01:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.650+0000 7f6dda959640 1 -- 172.21.15.96:0/3034661399 >> [v2:172.21.15.96:6809/27480,v1:172.21.15.96:6812/27480] conn(0x7f6db406e890 msgr2=0x7f6db4070cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.650+0000 7f6dda959640 1 --2- 172.21.15.96:0/3034661399 >> [v2:172.21.15.96:6809/27480,v1:172.21.15.96:6812/27480] conn(0x7f6db406e890 0x7f6db4070cb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.650+0000 7f6dda959640 1 -- 172.21.15.96:0/3034661399 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6db4066690 msgr2=0x7f6db4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.650+0000 7f6dda959640 1 --2- 172.21.15.96:0/3034661399 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6db4066690 0x7f6db4068b50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4003e40 tx=0x7f6dc4009040 comp rx=0 tx=0).stop 2024-04-18T05:01:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.650+0000 7f6dda959640 1 -- 172.21.15.96:0/3034661399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd4150e30 msgr2=0x7f6dd414b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.650+0000 7f6dda959640 1 --2- 172.21.15.96:0/3034661399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dd4150e30 0x7f6dd414b2b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00e960 tx=0x7f6dbc00ee20 comp rx=0 tx=0).stop 2024-04-18T05:01:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.650+0000 7f6dd8ef6640 1 -- 172.21.15.96:0/3034661399 reap_dead start 2024-04-18T05:01:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.650+0000 7f6dda959640 1 -- 172.21.15.96:0/3034661399 shutdown_connections 2024-04-18T05:01:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.650+0000 7f6dda959640 1 -- 172.21.15.96:0/3034661399 >> 172.21.15.96:0/3034661399 conn(0x7f6dd406de30 msgr2=0x7f6dd414fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.650+0000 7f6dda959640 1 -- 172.21.15.96:0/3034661399 shutdown_connections 2024-04-18T05:01:17.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.650+0000 7f6dda959640 1 -- 172.21.15.96:0/3034661399 wait complete. 2024-04-18T05:01:17.667 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-18T05:01:17.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f8040ce0640 1 Processor -- start 2024-04-18T05:01:17.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f8040ce0640 1 -- start start 2024-04-18T05:01:17.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f8040ce0640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f803c0c6830 0x7f803c1562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f8040ce0640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803c06bbd0 con 0x7f803c0c6450 2024-04-18T05:01:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f8040ce0640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803c06be70 con 0x7f803c071160 2024-04-18T05:01:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f8040ce0640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c06c6f0 con 0x7f803c0c6830 2024-04-18T05:01:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803a59c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f803c0c6450 0x7f803c0c1800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33300/0 (socket says 172.21.15.96:33300) 2024-04-18T05:01:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803a59c640 1 -- 172.21.15.96:0/167111191 learned_addr learned my addr 172.21.15.96:0/167111191 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:01:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f8039d9b640 1 --2- 172.21.15.96:0/167111191 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f803c0c6830 0x7f803c1562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803959a640 1 -- 172.21.15.96:0/167111191 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110556900 0 0) 0x7f803c06bbd0 con 0x7f803c0c6450 2024-04-18T05:01:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803959a640 1 -- 172.21.15.96:0/167111191 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8024003530 con 0x7f803c0c6450 2024-04-18T05:01:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803959a640 1 -- 172.21.15.96:0/167111191 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3434467636 0 0) 0x7f8024003530 con 0x7f803c0c6450 2024-04-18T05:01:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803959a640 1 -- 172.21.15.96:0/167111191 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f803c0c6830 msgr2=0x7f803c1562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803959a640 1 --2- 172.21.15.96:0/167111191 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f803c0c6830 0x7f803c1562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803959a640 1 -- 172.21.15.96:0/167111191 >> v1:172.21.15.139:6789/0 conn(0x7f803c071160 legacy=0x7f803c14f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803959a640 1 -- 172.21.15.96:0/167111191 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c06c130 con 0x7f803c0c6450 2024-04-18T05:01:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803959a640 1 -- 172.21.15.96:0/167111191 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f8030001680 con 0x7f803c0c6450 2024-04-18T05:01:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803959a640 1 -- 172.21.15.96:0/167111191 >> v1:172.21.15.96:6789/0 conn(0x7f803c0c6450 legacy=0x7f803c0c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803959a640 1 --2- 172.21.15.96:0/167111191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80240039b0 0x7f8024003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803959a640 1 --2- 172.21.15.96:0/167111191 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f803c0c6830 0x7f80240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803959a640 1 --2- 172.21.15.96:0/167111191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8024004d10 0x7f8024005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803959a640 1 -- 172.21.15.96:0/167111191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c06c6f0 con 0x7f8024004d10 2024-04-18T05:01:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803959a640 1 -- 172.21.15.96:0/167111191 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802400ba40 con 0x7f80240039b0 2024-04-18T05:01:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803959a640 1 -- 172.21.15.96:0/167111191 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802400de10 con 0x7f803c0c6830 2024-04-18T05:01:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803ad9d640 1 --2- 172.21.15.96:0/167111191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8024004d10 0x7f8024005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f8039d9b640 1 --2- 172.21.15.96:0/167111191 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f803c0c6830 0x7f80240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803a59c640 1 --2- 172.21.15.96:0/167111191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80240039b0 0x7f8024003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803ad9d640 1 -- 172.21.15.96:0/167111191 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f803c0c6830 msgr2=0x7f80240047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803ad9d640 1 --2- 172.21.15.96:0/167111191 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f803c0c6830 0x7f80240047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803ad9d640 1 -- 172.21.15.96:0/167111191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80240039b0 msgr2=0x7f8024003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:17.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803ad9d640 1 --2- 172.21.15.96:0/167111191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80240039b0 0x7f8024003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.774+0000 7f803ad9d640 1 -- 172.21.15.96:0/167111191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8024003530 con 0x7f8024004d10 2024-04-18T05:01:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f803ad9d640 1 --2- 172.21.15.96:0/167111191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8024004d10 0x7f8024005190 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8034001e40 tx=0x7f803401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d5d53f07f133fc server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f803959a640 1 -- 172.21.15.96:0/167111191 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034003b80 con 0x7f8024004d10 2024-04-18T05:01:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f803959a640 1 -- 172.21.15.96:0/167111191 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8034003ce0 con 0x7f8024004d10 2024-04-18T05:01:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f803959a640 1 -- 172.21.15.96:0/167111191 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340052c0 con 0x7f8024004d10 2024-04-18T05:01:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f8040ce0640 1 -- 172.21.15.96:0/167111191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8024004d10 msgr2=0x7f8024005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f8040ce0640 1 --2- 172.21.15.96:0/167111191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8024004d10 0x7f8024005190 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8034001e40 tx=0x7f803401c760 comp rx=0 tx=0).stop 2024-04-18T05:01:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f803ad9d640 1 -- 172.21.15.96:0/167111191 reap_dead start 2024-04-18T05:01:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f8040ce0640 1 -- 172.21.15.96:0/167111191 shutdown_connections 2024-04-18T05:01:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f8040ce0640 1 -- 172.21.15.96:0/167111191 >> 172.21.15.96:0/167111191 conn(0x7f803c06a8e0 msgr2=0x7f803c0c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f8040ce0640 1 -- 172.21.15.96:0/167111191 shutdown_connections 2024-04-18T05:01:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f8040ce0640 1 -- 172.21.15.96:0/167111191 wait complete. 2024-04-18T05:01:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f8040ce0640 1 Processor -- start 2024-04-18T05:01:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f8040ce0640 1 -- start start 2024-04-18T05:01:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f8040ce0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f803c0c93b0 0x7f803c1ed860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f8040ce0640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f803c0c9790 0x7f803c1eac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f8040ce0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f803c155850 0x7f803c157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f8040ce0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c159db0 con 0x7f803c155850 2024-04-18T05:01:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f8040ce0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c154a20 con 0x7f803c0c93b0 2024-04-18T05:01:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f8040ce0640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c1ea770 con 0x7f803c0c9790 2024-04-18T05:01:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f803ad9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f803c155850 0x7f803c157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f803ad9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f803c155850 0x7f803c157170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40272/0 (socket says 172.21.15.96:40272) 2024-04-18T05:01:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f803ad9d640 1 -- 172.21.15.96:0/3831795459 learned_addr learned my addr 172.21.15.96:0/3831795459 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f803a59c640 1 --2- 172.21.15.96:0/3831795459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f803c0c93b0 0x7f803c1ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f8039d9b640 1 --2- 172.21.15.96:0/3831795459 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f803c0c9790 0x7f803c1eac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f803ad9d640 1 -- 172.21.15.96:0/3831795459 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f803c0c9790 msgr2=0x7f803c1eac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f803ad9d640 1 --2- 172.21.15.96:0/3831795459 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f803c0c9790 0x7f803c1eac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f803ad9d640 1 -- 172.21.15.96:0/3831795459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f803c0c93b0 msgr2=0x7f803c1ed860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f803ad9d640 1 --2- 172.21.15.96:0/3831795459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f803c0c93b0 0x7f803c1ed860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f803ad9d640 1 -- 172.21.15.96:0/3831795459 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c0c2090 con 0x7f803c155850 2024-04-18T05:01:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.778+0000 7f803a59c640 1 --2- 172.21.15.96:0/3831795459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f803c0c93b0 0x7f803c1ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:01:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.782+0000 7f803ad9d640 1 --2- 172.21.15.96:0/3831795459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f803c155850 0x7f803c157170 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8034098170 tx=0x7f8024005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.782+0000 7f802affd640 1 -- 172.21.15.96:0/3831795459 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034003b80 con 0x7f803c155850 2024-04-18T05:01:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.782+0000 7f802affd640 1 -- 172.21.15.96:0/3831795459 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8034005840 con 0x7f803c155850 2024-04-18T05:01:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.782+0000 7f8040ce0640 1 -- 172.21.15.96:0/3831795459 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803c0c1560 con 0x7f803c155850 2024-04-18T05:01:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.782+0000 7f802affd640 1 -- 172.21.15.96:0/3831795459 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034006d60 con 0x7f803c155850 2024-04-18T05:01:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.782+0000 7f8040ce0640 1 -- 172.21.15.96:0/3831795459 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803c1ede80 con 0x7f803c155850 2024-04-18T05:01:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.782+0000 7f8040ce0640 1 -- 172.21.15.96:0/3831795459 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803c1ea920 con 0x7f803c155850 2024-04-18T05:01:17.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.782+0000 7f802affd640 1 -- 172.21.15.96:0/3831795459 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8034007030 con 0x7f803c155850 2024-04-18T05:01:17.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.782+0000 7f802affd640 1 --2- 172.21.15.96:0/3831795459 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f801c066690 0x7f801c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:17.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.782+0000 7f802affd640 1 -- 172.21.15.96:0/3831795459 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f803411dcb0 con 0x7f803c155850 2024-04-18T05:01:17.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.782+0000 7f803a59c640 1 --2- 172.21.15.96:0/3831795459 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f801c066690 0x7f801c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:17.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.782+0000 7f803a59c640 1 --2- 172.21.15.96:0/3831795459 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f801c066690 0x7f801c068b50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8030004850 tx=0x7f8030009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:17.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.786+0000 7f802affd640 1 -- 172.21.15.96:0/3831795459 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f80340eaf70 con 0x7f803c155850 2024-04-18T05:01:17.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.934+0000 7f8040ce0640 1 -- 172.21.15.96:0/3831795459 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f803c0c1f10 con 0x7f801c066690 2024-04-18T05:01:17.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.934+0000 7f802affd640 1 -- 172.21.15.96:0/3831795459 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f803000d040 con 0x7f801c066690 2024-04-18T05:01:17.938 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 3 to deep-scrub 2024-04-18T05:01:17.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.938+0000 7f8040ce0640 1 -- 172.21.15.96:0/3831795459 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f801c066690 msgr2=0x7f801c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.938+0000 7f8040ce0640 1 --2- 172.21.15.96:0/3831795459 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f801c066690 0x7f801c068b50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8030004850 tx=0x7f8030009040 comp rx=0 tx=0).stop 2024-04-18T05:01:17.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.938+0000 7f8040ce0640 1 -- 172.21.15.96:0/3831795459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f803c155850 msgr2=0x7f803c157170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:17.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.938+0000 7f8040ce0640 1 --2- 172.21.15.96:0/3831795459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f803c155850 0x7f803c157170 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8034098170 tx=0x7f8024005800 comp rx=0 tx=0).stop 2024-04-18T05:01:17.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.938+0000 7f8040ce0640 1 -- 172.21.15.96:0/3831795459 shutdown_connections 2024-04-18T05:01:17.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.938+0000 7f8040ce0640 1 --2- 172.21.15.96:0/3831795459 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f801c066690 0x7f801c068b50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.938+0000 7f8040ce0640 1 --2- 172.21.15.96:0/3831795459 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f803c155850 0x7f803c157170 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.938+0000 7f8040ce0640 1 --2- 172.21.15.96:0/3831795459 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f803c0c9790 0x7f803c1eac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.938+0000 7f8040ce0640 1 --2- 172.21.15.96:0/3831795459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f803c0c93b0 0x7f803c1ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:17.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.938+0000 7f8040ce0640 1 -- 172.21.15.96:0/3831795459 >> 172.21.15.96:0/3831795459 conn(0x7f803c06a8e0 msgr2=0x7f803c0c4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:17.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.938+0000 7f8040ce0640 1 -- 172.21.15.96:0/3831795459 shutdown_connections 2024-04-18T05:01:17.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:17.938+0000 7f8040ce0640 1 -- 172.21.15.96:0/3831795459 wait complete. 2024-04-18T05:01:17.956 INFO:tasks.ceph:Scrubbing osd.4 2024-04-18T05:01:17.956 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-18T05:01:18.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab2f6d640 1 Processor -- start 2024-04-18T05:01:18.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab2f6d640 1 -- start start 2024-04-18T05:01:18.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab2f6d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6aac1532d0 0x7f6aac158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab2f6d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6aac0cacc0 0x7f6aac15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab2f6d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6aac0c3fd0 0x7f6aac0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab2f6d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aac0c5970 con 0x7f6aac0c3fd0 2024-04-18T05:01:18.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab2f6d640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aac1594a0 con 0x7f6aac0cacc0 2024-04-18T05:01:18.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab2f6d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac159f20 con 0x7f6aac1532d0 2024-04-18T05:01:18.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab150a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6aac0c3fd0 0x7f6aac0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab150a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6aac0c3fd0 0x7f6aac0ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40274/0 (socket says 172.21.15.96:40274) 2024-04-18T05:01:18.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab150a640 1 -- 172.21.15.96:0/1966294429 learned_addr learned my addr 172.21.15.96:0/1966294429 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:18.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6aabfff640 1 --2- 172.21.15.96:0/1966294429 >> v2:172.21.15.139:3300/0 conn(0x7f6aac0cacc0 0x7f6aac15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab0d09640 1 --2- 172.21.15.96:0/1966294429 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6aac1532d0 0x7f6aac158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab150a640 1 -- 172.21.15.96:0/1966294429 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6aac1532d0 msgr2=0x7f6aac158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:18.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab150a640 1 --2- 172.21.15.96:0/1966294429 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6aac1532d0 0x7f6aac158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab150a640 1 -- 172.21.15.96:0/1966294429 >> v2:172.21.15.139:3300/0 conn(0x7f6aac0cacc0 msgr2=0x7f6aac15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:18.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab150a640 1 --2- 172.21.15.96:0/1966294429 >> v2:172.21.15.139:3300/0 conn(0x7f6aac0cacc0 0x7f6aac15ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.070+0000 7f6ab150a640 1 -- 172.21.15.96:0/1966294429 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac15d3b0 con 0x7f6aac0c3fd0 2024-04-18T05:01:18.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.074+0000 7f6ab150a640 1 --2- 172.21.15.96:0/1966294429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6aac0c3fd0 0x7f6aac0ce740 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6aac071c00 tx=0x7f6aa401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a7a2528288181 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.074+0000 7f6aab7fe640 1 -- 172.21.15.96:0/1966294429 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40af400 con 0x7f6aac0c3fd0 2024-04-18T05:01:18.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.074+0000 7f6aab7fe640 1 -- 172.21.15.96:0/1966294429 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa40ab050 con 0x7f6aac0c3fd0 2024-04-18T05:01:18.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.074+0000 7f6aab7fe640 1 -- 172.21.15.96:0/1966294429 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40af780 con 0x7f6aac0c3fd0 2024-04-18T05:01:18.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.074+0000 7f6ab2f6d640 1 -- 172.21.15.96:0/1966294429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6aac0c3fd0 msgr2=0x7f6aac0ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.074+0000 7f6ab2f6d640 1 --2- 172.21.15.96:0/1966294429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6aac0c3fd0 0x7f6aac0ce740 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6aac071c00 tx=0x7f6aa401f1e0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.074+0000 7f6ab2f6d640 1 -- 172.21.15.96:0/1966294429 shutdown_connections 2024-04-18T05:01:18.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.074+0000 7f6ab2f6d640 1 --2- 172.21.15.96:0/1966294429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6aac0c3fd0 0x7f6aac0ce740 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.074+0000 7f6ab2f6d640 1 --2- 172.21.15.96:0/1966294429 >> v2:172.21.15.139:3300/0 conn(0x7f6aac0cacc0 0x7f6aac15ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.074+0000 7f6ab2f6d640 1 --2- 172.21.15.96:0/1966294429 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6aac1532d0 0x7f6aac158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.074+0000 7f6ab2f6d640 1 -- 172.21.15.96:0/1966294429 >> 172.21.15.96:0/1966294429 conn(0x7f6aac071760 msgr2=0x7f6aac06b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:18.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.074+0000 7f6ab2f6d640 1 -- 172.21.15.96:0/1966294429 shutdown_connections 2024-04-18T05:01:18.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.074+0000 7f6ab2f6d640 1 -- 172.21.15.96:0/1966294429 wait complete. 2024-04-18T05:01:18.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.074+0000 7f6ab2f6d640 1 Processor -- start 2024-04-18T05:01:18.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.074+0000 7f6ab2f6d640 1 -- start start 2024-04-18T05:01:18.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6ab2f6d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6aac0c3fd0 0x7f6aac1570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6ab2f6d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6aac0cacc0 0x7f6aac15bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6ab2f6d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6aac1532d0 0x7f6aac148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6ab2f6d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac1575f0 con 0x7f6aac0cacc0 2024-04-18T05:01:18.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6ab2f6d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac15b6c0 con 0x7f6aac0c3fd0 2024-04-18T05:01:18.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6ab2f6d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac15b0b0 con 0x7f6aac1532d0 2024-04-18T05:01:18.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aabfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6aac0cacc0 0x7f6aac15bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aabfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6aac0cacc0 0x7f6aac15bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40278/0 (socket says 172.21.15.96:40278) 2024-04-18T05:01:18.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aabfff640 1 -- 172.21.15.96:0/522236547 learned_addr learned my addr 172.21.15.96:0/522236547 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:18.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aabfff640 1 -- 172.21.15.96:0/522236547 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6aac1532d0 msgr2=0x7f6aac148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aabfff640 1 --2- 172.21.15.96:0/522236547 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6aac1532d0 0x7f6aac148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aabfff640 1 -- 172.21.15.96:0/522236547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6aac0c3fd0 msgr2=0x7f6aac1570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6ab0d09640 1 --2- 172.21.15.96:0/522236547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6aac0c3fd0 0x7f6aac1570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aabfff640 1 --2- 172.21.15.96:0/522236547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6aac0c3fd0 0x7f6aac1570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aabfff640 1 -- 172.21.15.96:0/522236547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa4009b30 con 0x7f6aac0cacc0 2024-04-18T05:01:18.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aabfff640 1 --2- 172.21.15.96:0/522236547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6aac0cacc0 0x7f6aac15bb50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c009fd0 tx=0x7f6a9c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aa97fa640 1 -- 172.21.15.96:0/522236547 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00c940 con 0x7f6aac0cacc0 2024-04-18T05:01:18.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aa97fa640 1 -- 172.21.15.96:0/522236547 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c00caa0 con 0x7f6aac0cacc0 2024-04-18T05:01:18.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6ab2f6d640 1 -- 172.21.15.96:0/522236547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aac157910 con 0x7f6aac0cacc0 2024-04-18T05:01:18.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aa97fa640 1 -- 172.21.15.96:0/522236547 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00ce50 con 0x7f6aac0cacc0 2024-04-18T05:01:18.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6ab2f6d640 1 -- 172.21.15.96:0/522236547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aac15b350 con 0x7f6aac0cacc0 2024-04-18T05:01:18.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6ab2f6d640 1 -- 172.21.15.96:0/522236547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6aac159960 con 0x7f6aac0cacc0 2024-04-18T05:01:18.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aa97fa640 1 -- 172.21.15.96:0/522236547 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6a9c013470 con 0x7f6aac0cacc0 2024-04-18T05:01:18.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aa97fa640 1 --2- 172.21.15.96:0/522236547 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6a8c066690 0x7f6a8c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aa97fa640 1 -- 172.21.15.96:0/522236547 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6a9c084720 con 0x7f6aac0cacc0 2024-04-18T05:01:18.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6ab0d09640 1 --2- 172.21.15.96:0/522236547 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6a8c066690 0x7f6a8c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aa97fa640 1 --2- 172.21.15.96:0/522236547 >> [v2:172.21.15.139:6824/27649,v1:172.21.15.139:6825/27649] conn(0x7f6a8c06e890 0x7f6a8c070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aa97fa640 1 -- 172.21.15.96:0/522236547 --> [v2:172.21.15.139:6824/27649,v1:172.21.15.139:6825/27649] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a8c071380 con 0x7f6a8c06e890 2024-04-18T05:01:18.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6aa97fa640 1 -- 172.21.15.96:0/522236547 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a9c084b70 con 0x7f6aac0cacc0 2024-04-18T05:01:18.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6ab150a640 1 --2- 172.21.15.96:0/522236547 >> [v2:172.21.15.139:6824/27649,v1:172.21.15.139:6825/27649] conn(0x7f6a8c06e890 0x7f6a8c070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6ab0d09640 1 --2- 172.21.15.96:0/522236547 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6a8c066690 0x7f6a8c068b50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6a940096f0 tx=0x7f6a94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.078+0000 7f6ab150a640 1 --2- 172.21.15.96:0/522236547 >> [v2:172.21.15.139:6824/27649,v1:172.21.15.139:6825/27649] conn(0x7f6a8c06e890 0x7f6a8c070cb0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.082+0000 7f6aa97fa640 1 -- 172.21.15.96:0/522236547 <== osd.4 v2:172.21.15.139:6824/27649 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f6a8c071380 con 0x7f6a8c06e890 2024-04-18T05:01:18.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.094+0000 7f6ab2f6d640 1 -- 172.21.15.96:0/522236547 --> [v2:172.21.15.139:6824/27649,v1:172.21.15.139:6825/27649] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6aac159680 con 0x7f6a8c06e890 2024-04-18T05:01:18.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.094+0000 7f6aa97fa640 1 -- 172.21.15.96:0/522236547 <== osd.4 v2:172.21.15.139:6824/27649 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6aa4009210 con 0x7f6a8c06e890 2024-04-18T05:01:18.098 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T05:01:18.098 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T05:01:18.098 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T05:01:18.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.094+0000 7f6ab2f6d640 1 -- 172.21.15.96:0/522236547 >> [v2:172.21.15.139:6824/27649,v1:172.21.15.139:6825/27649] conn(0x7f6a8c06e890 msgr2=0x7f6a8c070cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.094+0000 7f6ab2f6d640 1 --2- 172.21.15.96:0/522236547 >> [v2:172.21.15.139:6824/27649,v1:172.21.15.139:6825/27649] conn(0x7f6a8c06e890 0x7f6a8c070cb0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.094+0000 7f6ab2f6d640 1 -- 172.21.15.96:0/522236547 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6a8c066690 msgr2=0x7f6a8c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.094+0000 7f6ab2f6d640 1 --2- 172.21.15.96:0/522236547 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6a8c066690 0x7f6a8c068b50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6a940096f0 tx=0x7f6a94008040 comp rx=0 tx=0).stop 2024-04-18T05:01:18.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.094+0000 7f6ab2f6d640 1 -- 172.21.15.96:0/522236547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6aac0cacc0 msgr2=0x7f6aac15bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.094+0000 7f6ab2f6d640 1 --2- 172.21.15.96:0/522236547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6aac0cacc0 0x7f6aac15bb50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c009fd0 tx=0x7f6a9c00ed40 comp rx=0 tx=0).stop 2024-04-18T05:01:18.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.094+0000 7f6ab150a640 1 -- 172.21.15.96:0/522236547 reap_dead start 2024-04-18T05:01:18.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.094+0000 7f6ab2f6d640 1 -- 172.21.15.96:0/522236547 shutdown_connections 2024-04-18T05:01:18.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.094+0000 7f6ab2f6d640 1 -- 172.21.15.96:0/522236547 >> 172.21.15.96:0/522236547 conn(0x7f6aac071760 msgr2=0x7f6aac1523c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:18.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.094+0000 7f6ab2f6d640 1 -- 172.21.15.96:0/522236547 shutdown_connections 2024-04-18T05:01:18.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.094+0000 7f6ab2f6d640 1 -- 172.21.15.96:0/522236547 wait complete. 2024-04-18T05:01:18.112 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-18T05:01:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.210+0000 7f531c373640 1 Processor -- start 2024-04-18T05:01:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.210+0000 7f531c373640 1 -- start start 2024-04-18T05:01:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.214+0000 7f531c373640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f53140c5b30 0x7f53140c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.214+0000 7f531c373640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f53140c6670 0x7f5314157620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.214+0000 7f531c373640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531406c650 con 0x7f531415a270 2024-04-18T05:01:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.214+0000 7f531c373640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5314157200 con 0x7f53140c5b30 2024-04-18T05:01:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.214+0000 7f531c373640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53140c6450 con 0x7f53140c6670 2024-04-18T05:01:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.214+0000 7f531a910640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f53140c6670 0x7f5314157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.214+0000 7f531a10f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f53140c5b30 0x7f53140c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.214+0000 7f531a910640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f53140c6670 0x7f5314157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:49324/0 (socket says 172.21.15.96:49324) 2024-04-18T05:01:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.214+0000 7f531a910640 1 -- 172.21.15.96:0/3355163411 learned_addr learned my addr 172.21.15.96:0/3355163411 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.214+0000 7f531a910640 1 -- 172.21.15.96:0/3355163411 >> v2:172.21.15.139:3300/0 conn(0x7f53140c5b30 msgr2=0x7f53140c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.214+0000 7f531a910640 1 --2- 172.21.15.96:0/3355163411 >> v2:172.21.15.139:3300/0 conn(0x7f53140c5b30 0x7f53140c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.214+0000 7f531a910640 1 -- 172.21.15.96:0/3355163411 >> v1:172.21.15.139:6789/0 conn(0x7f531415a270 legacy=0x7f53140c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.214+0000 7f531a910640 1 -- 172.21.15.96:0/3355163411 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53140c1500 con 0x7f53140c6670 2024-04-18T05:01:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.214+0000 7f531a910640 1 --2- 172.21.15.96:0/3355163411 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f53140c6670 0x7f5314157620 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f530c009e50 tx=0x7f530c01f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50319fb51313222d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531910d640 1 -- 172.21.15.96:0/3355163411 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c0af400 con 0x7f53140c6670 2024-04-18T05:01:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531910d640 1 -- 172.21.15.96:0/3355163411 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c0ab050 con 0x7f53140c6670 2024-04-18T05:01:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531910d640 1 -- 172.21.15.96:0/3355163411 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c0af780 con 0x7f53140c6670 2024-04-18T05:01:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 -- 172.21.15.96:0/3355163411 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f53140c6670 msgr2=0x7f5314157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 --2- 172.21.15.96:0/3355163411 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f53140c6670 0x7f5314157620 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f530c009e50 tx=0x7f530c01f210 comp rx=0 tx=0).stop 2024-04-18T05:01:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 -- 172.21.15.96:0/3355163411 shutdown_connections 2024-04-18T05:01:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 --2- 172.21.15.96:0/3355163411 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f53140c6670 0x7f5314157620 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 --2- 172.21.15.96:0/3355163411 >> v2:172.21.15.139:3300/0 conn(0x7f53140c5b30 0x7f53140c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 -- 172.21.15.96:0/3355163411 >> 172.21.15.96:0/3355163411 conn(0x7f531406a8e0 msgr2=0x7f53140c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 -- 172.21.15.96:0/3355163411 shutdown_connections 2024-04-18T05:01:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 -- 172.21.15.96:0/3355163411 wait complete. 2024-04-18T05:01:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 Processor -- start 2024-04-18T05:01:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 -- start start 2024-04-18T05:01:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53140c5b30 0x7f53141eca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f53140c6670 0x7f53140c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f531415a270 0x7f53140ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5314148af0 con 0x7f53140c5b30 2024-04-18T05:01:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53140c03f0 con 0x7f531415a270 2024-04-18T05:01:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53141ecfb0 con 0x7f53140c6670 2024-04-18T05:01:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531a10f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53140c5b30 0x7f53141eca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531a10f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53140c5b30 0x7f53141eca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40286/0 (socket says 172.21.15.96:40286) 2024-04-18T05:01:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531a10f640 1 -- 172.21.15.96:0/2353548750 learned_addr learned my addr 172.21.15.96:0/2353548750 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531990e640 1 --2- 172.21.15.96:0/2353548750 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f53140c6670 0x7f53140c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531a910640 1 --2- 172.21.15.96:0/2353548750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f531415a270 0x7f53140ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531a10f640 1 -- 172.21.15.96:0/2353548750 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f53140c6670 msgr2=0x7f53140c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531a10f640 1 --2- 172.21.15.96:0/2353548750 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f53140c6670 0x7f53140c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531a10f640 1 -- 172.21.15.96:0/2353548750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f531415a270 msgr2=0x7f53140ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531a10f640 1 --2- 172.21.15.96:0/2353548750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f531415a270 0x7f53140ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531a10f640 1 -- 172.21.15.96:0/2353548750 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c009b30 con 0x7f53140c5b30 2024-04-18T05:01:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531a910640 1 --2- 172.21.15.96:0/2353548750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f531415a270 0x7f53140ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:01:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531a10f640 1 --2- 172.21.15.96:0/2353548750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53140c5b30 0x7f53141eca70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f531000e930 tx=0x7f531000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f530affd640 1 -- 172.21.15.96:0/2353548750 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310009690 con 0x7f53140c5b30 2024-04-18T05:01:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f530affd640 1 -- 172.21.15.96:0/2353548750 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531000ca00 con 0x7f53140c5b30 2024-04-18T05:01:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 -- 172.21.15.96:0/2353548750 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53140c97b0 con 0x7f53140c5b30 2024-04-18T05:01:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f530affd640 1 -- 172.21.15.96:0/2353548750 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531000cd70 con 0x7f53140c5b30 2024-04-18T05:01:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.218+0000 7f531c373640 1 -- 172.21.15.96:0/2353548750 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53140c0640 con 0x7f53140c5b30 2024-04-18T05:01:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.222+0000 7f531c373640 1 -- 172.21.15.96:0/2353548750 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53140670f0 con 0x7f53140c5b30 2024-04-18T05:01:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.222+0000 7f530affd640 1 -- 172.21.15.96:0/2353548750 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5310013470 con 0x7f53140c5b30 2024-04-18T05:01:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.222+0000 7f530affd640 1 --2- 172.21.15.96:0/2353548750 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f52f8066690 0x7f52f8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.222+0000 7f530affd640 1 -- 172.21.15.96:0/2353548750 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5310084420 con 0x7f53140c5b30 2024-04-18T05:01:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.222+0000 7f531990e640 1 --2- 172.21.15.96:0/2353548750 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f52f8066690 0x7f52f8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.222+0000 7f531990e640 1 --2- 172.21.15.96:0/2353548750 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f52f8066690 0x7f52f8068b50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f531406ccb0 tx=0x7f5304009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.226+0000 7f530affd640 1 -- 172.21.15.96:0/2353548750 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f5310051830 con 0x7f53140c5b30 2024-04-18T05:01:18.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.370+0000 7f531c373640 1 -- 172.21.15.96:0/2353548750 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f531406c370 con 0x7f52f8066690 2024-04-18T05:01:18.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.370+0000 7f530affd640 1 -- 172.21.15.96:0/2353548750 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5304001300 con 0x7f52f8066690 2024-04-18T05:01:18.374 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 4 to deep-scrub 2024-04-18T05:01:18.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.374+0000 7f531c373640 1 -- 172.21.15.96:0/2353548750 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f52f8066690 msgr2=0x7f52f8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.374+0000 7f531c373640 1 --2- 172.21.15.96:0/2353548750 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f52f8066690 0x7f52f8068b50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f531406ccb0 tx=0x7f5304009040 comp rx=0 tx=0).stop 2024-04-18T05:01:18.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.374+0000 7f531c373640 1 -- 172.21.15.96:0/2353548750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53140c5b30 msgr2=0x7f53141eca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.374+0000 7f531c373640 1 --2- 172.21.15.96:0/2353548750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53140c5b30 0x7f53141eca70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f531000e930 tx=0x7f531000edf0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.374+0000 7f531c373640 1 -- 172.21.15.96:0/2353548750 shutdown_connections 2024-04-18T05:01:18.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.374+0000 7f531c373640 1 --2- 172.21.15.96:0/2353548750 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f52f8066690 0x7f52f8068b50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.374+0000 7f531c373640 1 --2- 172.21.15.96:0/2353548750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f531415a270 0x7f53140ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.374+0000 7f531c373640 1 --2- 172.21.15.96:0/2353548750 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f53140c6670 0x7f53140c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.374+0000 7f531c373640 1 --2- 172.21.15.96:0/2353548750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53140c5b30 0x7f53141eca70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.374+0000 7f531c373640 1 -- 172.21.15.96:0/2353548750 >> 172.21.15.96:0/2353548750 conn(0x7f531406a8e0 msgr2=0x7f53140c2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:18.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.374+0000 7f531c373640 1 -- 172.21.15.96:0/2353548750 shutdown_connections 2024-04-18T05:01:18.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.374+0000 7f531c373640 1 -- 172.21.15.96:0/2353548750 wait complete. 2024-04-18T05:01:18.391 INFO:tasks.ceph:Scrubbing osd.5 2024-04-18T05:01:18.392 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-18T05:01:18.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.510+0000 7ff9e9418640 1 Processor -- start 2024-04-18T05:01:18.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.510+0000 7ff9e9418640 1 -- start start 2024-04-18T05:01:18.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.510+0000 7ff9e9418640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff9e40c3650 0x7ff9e40c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.510+0000 7ff9e9418640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e40c8100 con 0x7ff9e4155d00 2024-04-18T05:01:18.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.510+0000 7ff9e9418640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e40c5670 con 0x7ff9e414fcf0 2024-04-18T05:01:18.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.510+0000 7ff9e9418640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e40c8350 con 0x7ff9e40c3650 2024-04-18T05:01:18.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.510+0000 7ff9e27fc640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff9e4155d00 0x7ff9e4156140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33316/0 (socket says 172.21.15.96:33316) 2024-04-18T05:01:18.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.510+0000 7ff9e27fc640 1 -- 172.21.15.96:0/808419818 learned_addr learned my addr 172.21.15.96:0/808419818 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:01:18.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e37fe640 1 --2- 172.21.15.96:0/808419818 >> v2:172.21.15.139:3300/0 conn(0x7ff9e40c3650 0x7ff9e40c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 -- 172.21.15.96:0/808419818 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228137582 0 0) 0x7ff9e40c8100 con 0x7ff9e4155d00 2024-04-18T05:01:18.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 -- 172.21.15.96:0/808419818 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9cc003530 con 0x7ff9e4155d00 2024-04-18T05:01:18.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 -- 172.21.15.96:0/808419818 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 317771550 0 0) 0x7ff9cc003530 con 0x7ff9e4155d00 2024-04-18T05:01:18.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 -- 172.21.15.96:0/808419818 >> v2:172.21.15.139:3300/0 conn(0x7ff9e40c3650 msgr2=0x7ff9e40c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:18.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 --2- 172.21.15.96:0/808419818 >> v2:172.21.15.139:3300/0 conn(0x7ff9e40c3650 0x7ff9e40c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 -- 172.21.15.96:0/808419818 >> v1:172.21.15.139:6789/0 conn(0x7ff9e414fcf0 legacy=0x7ff9e406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 -- 172.21.15.96:0/808419818 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e40c8630 con 0x7ff9e4155d00 2024-04-18T05:01:18.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 -- 172.21.15.96:0/808419818 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7ff9d8001680 con 0x7ff9e4155d00 2024-04-18T05:01:18.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 -- 172.21.15.96:0/808419818 >> v1:172.21.15.96:6789/0 conn(0x7ff9e4155d00 legacy=0x7ff9e4156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 --2- 172.21.15.96:0/808419818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9cc0039d0 0x7ff9cc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 --2- 172.21.15.96:0/808419818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9cc0047d0 0x7ff9cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 --2- 172.21.15.96:0/808419818 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9cc005190 0x7ff9cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 -- 172.21.15.96:0/808419818 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e40c8350 con 0x7ff9cc0039d0 2024-04-18T05:01:18.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 -- 172.21.15.96:0/808419818 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc00c090 con 0x7ff9cc0047d0 2024-04-18T05:01:18.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 -- 172.21.15.96:0/808419818 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc00c250 con 0x7ff9cc005190 2024-04-18T05:01:18.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e2ffd640 1 --2- 172.21.15.96:0/808419818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9cc0039d0 0x7ff9cc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e37fe640 1 --2- 172.21.15.96:0/808419818 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9cc005190 0x7ff9cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e27fc640 1 --2- 172.21.15.96:0/808419818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9cc0047d0 0x7ff9cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e2ffd640 1 -- 172.21.15.96:0/808419818 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9cc005190 msgr2=0x7ff9cc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:18.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e2ffd640 1 --2- 172.21.15.96:0/808419818 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9cc005190 0x7ff9cc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e2ffd640 1 -- 172.21.15.96:0/808419818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9cc0047d0 msgr2=0x7ff9cc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:18.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e2ffd640 1 --2- 172.21.15.96:0/808419818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9cc0047d0 0x7ff9cc004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e2ffd640 1 -- 172.21.15.96:0/808419818 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc003530 con 0x7ff9cc0039d0 2024-04-18T05:01:18.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e37fe640 1 -- 172.21.15.96:0/808419818 reap_dead start 2024-04-18T05:01:18.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e2ffd640 1 --2- 172.21.15.96:0/808419818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9cc0039d0 0x7ff9cc003df0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4001e70 tx=0x7ff9d401c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f551a8cfb323253 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 -- 172.21.15.96:0/808419818 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4003b80 con 0x7ff9cc0039d0 2024-04-18T05:01:18.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 -- 172.21.15.96:0/808419818 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d4003ce0 con 0x7ff9cc0039d0 2024-04-18T05:01:18.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e1ffb640 1 -- 172.21.15.96:0/808419818 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d40052c0 con 0x7ff9cc0039d0 2024-04-18T05:01:18.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e9418640 1 -- 172.21.15.96:0/808419818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9cc0039d0 msgr2=0x7ff9cc003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e9418640 1 --2- 172.21.15.96:0/808419818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9cc0039d0 0x7ff9cc003df0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4001e70 tx=0x7ff9d401c730 comp rx=0 tx=0).stop 2024-04-18T05:01:18.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e9418640 1 -- 172.21.15.96:0/808419818 shutdown_connections 2024-04-18T05:01:18.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e9418640 1 --2- 172.21.15.96:0/808419818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9cc0039d0 0x7ff9cc003df0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e9418640 1 -- 172.21.15.96:0/808419818 >> 172.21.15.96:0/808419818 conn(0x7ff9e406c610 msgr2=0x7ff9e40ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:18.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.514+0000 7ff9e9418640 1 -- 172.21.15.96:0/808419818 shutdown_connections 2024-04-18T05:01:18.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e9418640 1 -- 172.21.15.96:0/808419818 wait complete. 2024-04-18T05:01:18.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e9418640 1 Processor -- start 2024-04-18T05:01:18.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e9418640 1 -- start start 2024-04-18T05:01:18.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e9418640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9cc0039d0 0x7ff9e4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e9418640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e40c63f0 0x7ff9e4140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e9418640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9e4141090 0x7ff9e41f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e9418640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e4154790 con 0x7ff9e40c63f0 2024-04-18T05:01:18.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e9418640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e4141520 con 0x7ff9cc0039d0 2024-04-18T05:01:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e9418640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e41f5850 con 0x7ff9e4141090 2024-04-18T05:01:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e27fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e40c63f0 0x7ff9e4140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e27fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e40c63f0 0x7ff9e4140b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40290/0 (socket says 172.21.15.96:40290) 2024-04-18T05:01:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e27fc640 1 -- 172.21.15.96:0/3778503640 learned_addr learned my addr 172.21.15.96:0/3778503640 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e2ffd640 1 --2- 172.21.15.96:0/3778503640 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9cc0039d0 0x7ff9e4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e37fe640 1 --2- 172.21.15.96:0/3778503640 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9e4141090 0x7ff9e41f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e27fc640 1 -- 172.21.15.96:0/3778503640 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9e4141090 msgr2=0x7ff9e41f1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e27fc640 1 --2- 172.21.15.96:0/3778503640 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff9e4141090 0x7ff9e41f1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e27fc640 1 -- 172.21.15.96:0/3778503640 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9cc0039d0 msgr2=0x7ff9e4071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e27fc640 1 --2- 172.21.15.96:0/3778503640 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9cc0039d0 0x7ff9e4071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e27fc640 1 -- 172.21.15.96:0/3778503640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e41549e0 con 0x7ff9e40c63f0 2024-04-18T05:01:18.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e27fc640 1 --2- 172.21.15.96:0/3778503640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e40c63f0 0x7ff9e4140b50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800d7a0 tx=0x7ff9d800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9cb7fe640 1 -- 172.21.15.96:0/3778503640 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d80072d0 con 0x7ff9e40c63f0 2024-04-18T05:01:18.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9cb7fe640 1 -- 172.21.15.96:0/3778503640 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d8007430 con 0x7ff9e40c63f0 2024-04-18T05:01:18.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e9418640 1 -- 172.21.15.96:0/3778503640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e4154cc0 con 0x7ff9e40c63f0 2024-04-18T05:01:18.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9cb7fe640 1 -- 172.21.15.96:0/3778503640 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d80047f0 con 0x7ff9e40c63f0 2024-04-18T05:01:18.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e9418640 1 -- 172.21.15.96:0/3778503640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e41f5510 con 0x7ff9e40c63f0 2024-04-18T05:01:18.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.518+0000 7ff9e9418640 1 -- 172.21.15.96:0/3778503640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff9e41500d0 con 0x7ff9e40c63f0 2024-04-18T05:01:18.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.522+0000 7ff9cb7fe640 1 -- 172.21.15.96:0/3778503640 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff9d8004950 con 0x7ff9e40c63f0 2024-04-18T05:01:18.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.522+0000 7ff9cb7fe640 1 --2- 172.21.15.96:0/3778503640 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff9d00666c0 0x7ff9d0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.522+0000 7ff9e2ffd640 1 --2- 172.21.15.96:0/3778503640 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff9d00666c0 0x7ff9d0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.522+0000 7ff9cb7fe640 1 -- 172.21.15.96:0/3778503640 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff9d8083ce0 con 0x7ff9e40c63f0 2024-04-18T05:01:18.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.522+0000 7ff9cb7fe640 1 --2- 172.21.15.96:0/3778503640 >> [v2:172.21.15.139:6804/27647,v1:172.21.15.139:6806/27647] conn(0x7ff9d006e8c0 0x7ff9d0070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.522+0000 7ff9cb7fe640 1 -- 172.21.15.96:0/3778503640 --> [v2:172.21.15.139:6804/27647,v1:172.21.15.139:6806/27647] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff9d00713b0 con 0x7ff9d006e8c0 2024-04-18T05:01:18.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.522+0000 7ff9cb7fe640 1 -- 172.21.15.96:0/3778503640 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9d80863a0 con 0x7ff9e40c63f0 2024-04-18T05:01:18.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.522+0000 7ff9e2ffd640 1 --2- 172.21.15.96:0/3778503640 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff9d00666c0 0x7ff9d0068b80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4005000 tx=0x7ff9d4001520 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.522+0000 7ff9e37fe640 1 --2- 172.21.15.96:0/3778503640 >> [v2:172.21.15.139:6804/27647,v1:172.21.15.139:6806/27647] conn(0x7ff9d006e8c0 0x7ff9d0070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.522+0000 7ff9e37fe640 1 --2- 172.21.15.96:0/3778503640 >> [v2:172.21.15.139:6804/27647,v1:172.21.15.139:6806/27647] conn(0x7ff9d006e8c0 0x7ff9d0070ce0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.522+0000 7ff9cb7fe640 1 -- 172.21.15.96:0/3778503640 <== osd.5 v2:172.21.15.139:6804/27647 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7ff9d00713b0 con 0x7ff9d006e8c0 2024-04-18T05:01:18.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.534+0000 7ff9e9418640 1 -- 172.21.15.96:0/3778503640 --> [v2:172.21.15.139:6804/27647,v1:172.21.15.139:6806/27647] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff9e4067050 con 0x7ff9d006e8c0 2024-04-18T05:01:18.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.538+0000 7ff9cb7fe640 1 -- 172.21.15.96:0/3778503640 <== osd.5 v2:172.21.15.139:6804/27647 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff9e4067050 con 0x7ff9d006e8c0 2024-04-18T05:01:18.539 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T05:01:18.540 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T05:01:18.540 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T05:01:18.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.538+0000 7ff9e9418640 1 -- 172.21.15.96:0/3778503640 >> [v2:172.21.15.139:6804/27647,v1:172.21.15.139:6806/27647] conn(0x7ff9d006e8c0 msgr2=0x7ff9d0070ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.538+0000 7ff9e9418640 1 --2- 172.21.15.96:0/3778503640 >> [v2:172.21.15.139:6804/27647,v1:172.21.15.139:6806/27647] conn(0x7ff9d006e8c0 0x7ff9d0070ce0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.538+0000 7ff9e9418640 1 -- 172.21.15.96:0/3778503640 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff9d00666c0 msgr2=0x7ff9d0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.538+0000 7ff9e9418640 1 --2- 172.21.15.96:0/3778503640 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7ff9d00666c0 0x7ff9d0068b80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4005000 tx=0x7ff9d4001520 comp rx=0 tx=0).stop 2024-04-18T05:01:18.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.538+0000 7ff9e9418640 1 -- 172.21.15.96:0/3778503640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e40c63f0 msgr2=0x7ff9e4140b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.538+0000 7ff9e9418640 1 --2- 172.21.15.96:0/3778503640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e40c63f0 0x7ff9e4140b50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800d7a0 tx=0x7ff9d800dc60 comp rx=0 tx=0).stop 2024-04-18T05:01:18.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.538+0000 7ff9e37fe640 1 -- 172.21.15.96:0/3778503640 reap_dead start 2024-04-18T05:01:18.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.538+0000 7ff9e9418640 1 -- 172.21.15.96:0/3778503640 shutdown_connections 2024-04-18T05:01:18.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.538+0000 7ff9e9418640 1 -- 172.21.15.96:0/3778503640 >> 172.21.15.96:0/3778503640 conn(0x7ff9e406c610 msgr2=0x7ff9e40c5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:18.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.538+0000 7ff9e9418640 1 -- 172.21.15.96:0/3778503640 shutdown_connections 2024-04-18T05:01:18.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.538+0000 7ff9e9418640 1 -- 172.21.15.96:0/3778503640 wait complete. 2024-04-18T05:01:18.555 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-18T05:01:18.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.662+0000 7fa765c9a640 1 Processor -- start 2024-04-18T05:01:18.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.662+0000 7fa765c9a640 1 -- start start 2024-04-18T05:01:18.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.662+0000 7fa765c9a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa760158cd0 0x7fa7600c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.662+0000 7fa765c9a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7601595f0 con 0x7fa760153060 2024-04-18T05:01:18.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.662+0000 7fa765c9a640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7601598d0 con 0x7fa760159120 2024-04-18T05:01:18.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.662+0000 7fa765c9a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa760153440 con 0x7fa760158cd0 2024-04-18T05:01:18.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.662+0000 7fa75effd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa760158cd0 0x7fa7600c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.662+0000 7fa75effd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa760158cd0 0x7fa7600c9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40300/0 (socket says 172.21.15.96:40300) 2024-04-18T05:01:18.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.662+0000 7fa75effd640 1 -- 172.21.15.96:0/477421985 learned_addr learned my addr 172.21.15.96:0/477421985 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:18.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.662+0000 7fa75effd640 1 -- 172.21.15.96:0/477421985 >> v1:172.21.15.139:6789/0 conn(0x7fa760159120 legacy=0x7fa7600c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:18.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.662+0000 7fa75effd640 1 -- 172.21.15.96:0/477421985 >> v1:172.21.15.96:6789/0 conn(0x7fa760153060 legacy=0x7fa7600c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.662+0000 7fa75effd640 1 -- 172.21.15.96:0/477421985 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa760159bb0 con 0x7fa760158cd0 2024-04-18T05:01:18.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa75effd640 1 --2- 172.21.15.96:0/477421985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa760158cd0 0x7fa7600c9d30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa748009870 tx=0x7fa74801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322d45472b8a124a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa75e7fc640 1 -- 172.21.15.96:0/477421985 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480a8a10 con 0x7fa760158cd0 2024-04-18T05:01:18.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa75e7fc640 1 -- 172.21.15.96:0/477421985 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7480a8b70 con 0x7fa760158cd0 2024-04-18T05:01:18.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa75e7fc640 1 -- 172.21.15.96:0/477421985 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480b0440 con 0x7fa760158cd0 2024-04-18T05:01:18.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 -- 172.21.15.96:0/477421985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa760158cd0 msgr2=0x7fa7600c9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 --2- 172.21.15.96:0/477421985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa760158cd0 0x7fa7600c9d30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa748009870 tx=0x7fa74801ed10 comp rx=0 tx=0).stop 2024-04-18T05:01:18.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 -- 172.21.15.96:0/477421985 shutdown_connections 2024-04-18T05:01:18.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 --2- 172.21.15.96:0/477421985 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa760158cd0 0x7fa7600c9d30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 -- 172.21.15.96:0/477421985 >> 172.21.15.96:0/477421985 conn(0x7fa76006b470 msgr2=0x7fa76006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:18.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 -- 172.21.15.96:0/477421985 shutdown_connections 2024-04-18T05:01:18.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 -- 172.21.15.96:0/477421985 wait complete. 2024-04-18T05:01:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 Processor -- start 2024-04-18T05:01:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 -- start start 2024-04-18T05:01:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa760153060 0x7fa76013c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa760158cd0 0x7fa7601eeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa760159120 0x7fa760144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa760140ba0 con 0x7fa760158cd0 2024-04-18T05:01:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76013cc30 con 0x7fa760159120 2024-04-18T05:01:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa760140e40 con 0x7fa760153060 2024-04-18T05:01:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa75effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa760158cd0 0x7fa7601eeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa75effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa760158cd0 0x7fa7601eeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40310/0 (socket says 172.21.15.96:40310) 2024-04-18T05:01:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa75effd640 1 -- 172.21.15.96:0/44862458 learned_addr learned my addr 172.21.15.96:0/44862458 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa75effd640 1 -- 172.21.15.96:0/44862458 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa760153060 msgr2=0x7fa76013c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa75effd640 1 --2- 172.21.15.96:0/44862458 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa760153060 0x7fa76013c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa75effd640 1 -- 172.21.15.96:0/44862458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa760159120 msgr2=0x7fa760144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa75effd640 1 --2- 172.21.15.96:0/44862458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa760159120 0x7fa760144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa75effd640 1 -- 172.21.15.96:0/44862458 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7480094d0 con 0x7fa760158cd0 2024-04-18T05:01:18.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa75effd640 1 --2- 172.21.15.96:0/44862458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa760158cd0 0x7fa7601eeb40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa7480b3040 tx=0x7fa74801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa757fff640 1 -- 172.21.15.96:0/44862458 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480b0e40 con 0x7fa760158cd0 2024-04-18T05:01:18.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa757fff640 1 -- 172.21.15.96:0/44862458 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7480bb470 con 0x7fa760158cd0 2024-04-18T05:01:18.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 -- 172.21.15.96:0/44862458 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa760141100 con 0x7fa760158cd0 2024-04-18T05:01:18.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa757fff640 1 -- 172.21.15.96:0/44862458 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480bb820 con 0x7fa760158cd0 2024-04-18T05:01:18.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.666+0000 7fa765c9a640 1 -- 172.21.15.96:0/44862458 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7601f2390 con 0x7fa760158cd0 2024-04-18T05:01:18.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.670+0000 7fa765c9a640 1 -- 172.21.15.96:0/44862458 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7600c4b70 con 0x7fa760158cd0 2024-04-18T05:01:18.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.670+0000 7fa757fff640 1 -- 172.21.15.96:0/44862458 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa7480b7070 con 0x7fa760158cd0 2024-04-18T05:01:18.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.670+0000 7fa757fff640 1 --2- 172.21.15.96:0/44862458 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa740066690 0x7fa740068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.670+0000 7fa757fff640 1 -- 172.21.15.96:0/44862458 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa748122650 con 0x7fa760158cd0 2024-04-18T05:01:18.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.670+0000 7fa75f7fe640 1 --2- 172.21.15.96:0/44862458 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa740066690 0x7fa740068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.670+0000 7fa75f7fe640 1 --2- 172.21.15.96:0/44862458 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa740066690 0x7fa740068b50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa750007fd0 tx=0x7fa750007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.674+0000 7fa757fff640 1 -- 172.21.15.96:0/44862458 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa7600c4b70 con 0x7fa760158cd0 2024-04-18T05:01:18.680 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T05:01:18.682 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T05:01:18.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.822+0000 7fa765c9a640 1 -- 172.21.15.96:0/44862458 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7600c3f60 con 0x7fa740066690 2024-04-18T05:01:18.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.822+0000 7fa757fff640 1 -- 172.21.15.96:0/44862458 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa750003980 con 0x7fa740066690 2024-04-18T05:01:18.825 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 5 to deep-scrub 2024-04-18T05:01:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.822+0000 7fa765c9a640 1 -- 172.21.15.96:0/44862458 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa740066690 msgr2=0x7fa740068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.822+0000 7fa765c9a640 1 --2- 172.21.15.96:0/44862458 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa740066690 0x7fa740068b50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa750007fd0 tx=0x7fa750007d40 comp rx=0 tx=0).stop 2024-04-18T05:01:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.822+0000 7fa765c9a640 1 -- 172.21.15.96:0/44862458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa760158cd0 msgr2=0x7fa7601eeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.822+0000 7fa765c9a640 1 --2- 172.21.15.96:0/44862458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa760158cd0 0x7fa7601eeb40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa7480b3040 tx=0x7fa74801bab0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.822+0000 7fa765c9a640 1 -- 172.21.15.96:0/44862458 shutdown_connections 2024-04-18T05:01:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.822+0000 7fa765c9a640 1 --2- 172.21.15.96:0/44862458 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fa740066690 0x7fa740068b50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.822+0000 7fa765c9a640 1 --2- 172.21.15.96:0/44862458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa760159120 0x7fa760144e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.822+0000 7fa765c9a640 1 --2- 172.21.15.96:0/44862458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa760158cd0 0x7fa7601eeb40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.822+0000 7fa765c9a640 1 --2- 172.21.15.96:0/44862458 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa760153060 0x7fa76013c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.822+0000 7fa765c9a640 1 -- 172.21.15.96:0/44862458 >> 172.21.15.96:0/44862458 conn(0x7fa76006b470 msgr2=0x7fa7600cb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.822+0000 7fa765c9a640 1 -- 172.21.15.96:0/44862458 shutdown_connections 2024-04-18T05:01:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.826+0000 7fa765c9a640 1 -- 172.21.15.96:0/44862458 wait complete. 2024-04-18T05:01:18.846 INFO:tasks.ceph:Scrubbing osd.6 2024-04-18T05:01:18.846 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-18T05:01:18.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.962+0000 7f924093c640 1 Processor -- start 2024-04-18T05:01:18.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.962+0000 7f924093c640 1 -- start start 2024-04-18T05:01:18.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.962+0000 7f924093c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f923c0c8da0 0x7f923c0afe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.962+0000 7f924093c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923c158f00 con 0x7f923c0c99b0 2024-04-18T05:01:18.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.962+0000 7f924093c640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923c1591e0 con 0x7f923c152f10 2024-04-18T05:01:18.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.962+0000 7f924093c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923c0b0570 con 0x7f923c0c8da0 2024-04-18T05:01:18.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.962+0000 7f9239d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f923c0c8da0 0x7f923c0afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.962+0000 7f9239d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f923c0c8da0 0x7f923c0afe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54512/0 (socket says 172.21.15.96:54512) 2024-04-18T05:01:18.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.962+0000 7f9239d9b640 1 -- 172.21.15.96:0/4033238993 learned_addr learned my addr 172.21.15.96:0/4033238993 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:18.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.962+0000 7f923ad9d640 1 --1- 172.21.15.96:0/4033238993 >> v1:172.21.15.96:6789/0 conn(0x7f923c0c99b0 0x7f923c0c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50036/0 (socket says 172.21.15.96:50036) 2024-04-18T05:01:18.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.962+0000 7f9239d9b640 1 -- 172.21.15.96:0/4033238993 >> v1:172.21.15.139:6789/0 conn(0x7f923c152f10 legacy=0x7f923c0c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.962+0000 7f9239d9b640 1 -- 172.21.15.96:0/4033238993 >> v1:172.21.15.96:6789/0 conn(0x7f923c0c99b0 legacy=0x7f923c0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.962+0000 7f9239d9b640 1 -- 172.21.15.96:0/4033238993 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c1594c0 con 0x7f923c0c8da0 2024-04-18T05:01:18.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f9239d9b640 1 --2- 172.21.15.96:0/4033238993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f923c0c8da0 0x7f923c0afe10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9230009870 tx=0x7f923001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e7a18c7e9fed28 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f923959a640 1 -- 172.21.15.96:0/4033238993 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92300a8a50 con 0x7f923c0c8da0 2024-04-18T05:01:18.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f923959a640 1 -- 172.21.15.96:0/4033238993 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92300a8bb0 con 0x7f923c0c8da0 2024-04-18T05:01:18.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f923959a640 1 -- 172.21.15.96:0/4033238993 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92300b0440 con 0x7f923c0c8da0 2024-04-18T05:01:18.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f924093c640 1 -- 172.21.15.96:0/4033238993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f923c0c8da0 msgr2=0x7f923c0afe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f924093c640 1 --2- 172.21.15.96:0/4033238993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f923c0c8da0 0x7f923c0afe10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9230009870 tx=0x7f923001ed50 comp rx=0 tx=0).stop 2024-04-18T05:01:18.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f924093c640 1 -- 172.21.15.96:0/4033238993 shutdown_connections 2024-04-18T05:01:18.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f924093c640 1 --2- 172.21.15.96:0/4033238993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f923c0c8da0 0x7f923c0afe10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f924093c640 1 -- 172.21.15.96:0/4033238993 >> 172.21.15.96:0/4033238993 conn(0x7f923c06e210 msgr2=0x7f923c06e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:18.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f924093c640 1 -- 172.21.15.96:0/4033238993 shutdown_connections 2024-04-18T05:01:18.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f924093c640 1 -- 172.21.15.96:0/4033238993 wait complete. 2024-04-18T05:01:18.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f924093c640 1 Processor -- start 2024-04-18T05:01:18.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f924093c640 1 -- start start 2024-04-18T05:01:18.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f924093c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f923c0c8da0 0x7f923c147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f924093c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f923c0c99b0 0x7f923c145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f924093c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f923c152f10 0x7f923c1583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f924093c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c1ef710 con 0x7f923c0c8da0 2024-04-18T05:01:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f924093c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c1ee880 con 0x7f923c0c99b0 2024-04-18T05:01:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f924093c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c1467c0 con 0x7f923c152f10 2024-04-18T05:01:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f923a59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f923c0c8da0 0x7f923c147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f923a59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f923c0c8da0 0x7f923c147dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54518/0 (socket says 172.21.15.96:54518) 2024-04-18T05:01:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f923a59c640 1 -- 172.21.15.96:0/3662858079 learned_addr learned my addr 172.21.15.96:0/3662858079 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f923ad9d640 1 --2- 172.21.15.96:0/3662858079 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f923c152f10 0x7f923c1583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f9239d9b640 1 --2- 172.21.15.96:0/3662858079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f923c0c99b0 0x7f923c145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f923a59c640 1 -- 172.21.15.96:0/3662858079 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f923c152f10 msgr2=0x7f923c1583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f923a59c640 1 --2- 172.21.15.96:0/3662858079 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f923c152f10 0x7f923c1583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f923a59c640 1 -- 172.21.15.96:0/3662858079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f923c0c99b0 msgr2=0x7f923c145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.966+0000 7f923a59c640 1 --2- 172.21.15.96:0/3662858079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f923c0c99b0 0x7f923c145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f923a59c640 1 -- 172.21.15.96:0/3662858079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92300094d0 con 0x7f923c0c8da0 2024-04-18T05:01:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f923a59c640 1 --2- 172.21.15.96:0/3662858079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f923c0c8da0 0x7f923c147dd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f922c00c3c0 tx=0x7f922c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f922affd640 1 -- 172.21.15.96:0/3662858079 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c0052d0 con 0x7f923c0c8da0 2024-04-18T05:01:18.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f922affd640 1 -- 172.21.15.96:0/3662858079 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922c005430 con 0x7f923c0c8da0 2024-04-18T05:01:18.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f924093c640 1 -- 172.21.15.96:0/3662858079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923c156e40 con 0x7f923c0c8da0 2024-04-18T05:01:18.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f922affd640 1 -- 172.21.15.96:0/3662858079 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c003840 con 0x7f923c0c8da0 2024-04-18T05:01:18.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f924093c640 1 -- 172.21.15.96:0/3662858079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923c1eed70 con 0x7f923c0c8da0 2024-04-18T05:01:18.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f924093c640 1 -- 172.21.15.96:0/3662858079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f923c159a80 con 0x7f923c0c8da0 2024-04-18T05:01:18.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f922affd640 1 -- 172.21.15.96:0/3662858079 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f922c0039a0 con 0x7f923c0c8da0 2024-04-18T05:01:18.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f922affd640 1 --2- 172.21.15.96:0/3662858079 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f921c066690 0x7f921c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f922affd640 1 -- 172.21.15.96:0/3662858079 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f922c083a10 con 0x7f923c0c8da0 2024-04-18T05:01:18.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f9239d9b640 1 --2- 172.21.15.96:0/3662858079 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f921c066690 0x7f921c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f922affd640 1 --2- 172.21.15.96:0/3662858079 >> [v2:172.21.15.139:6816/27650,v1:172.21.15.139:6817/27650] conn(0x7f921c06e890 0x7f921c070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f922affd640 1 -- 172.21.15.96:0/3662858079 --> [v2:172.21.15.139:6816/27650,v1:172.21.15.139:6817/27650] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f921c071380 con 0x7f921c06e890 2024-04-18T05:01:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f922affd640 1 -- 172.21.15.96:0/3662858079 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f922c083e60 con 0x7f923c0c8da0 2024-04-18T05:01:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f9239d9b640 1 --2- 172.21.15.96:0/3662858079 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f921c066690 0x7f921c068b50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f92300b2000 tx=0x7f9230009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f923ad9d640 1 --2- 172.21.15.96:0/3662858079 >> [v2:172.21.15.139:6816/27650,v1:172.21.15.139:6817/27650] conn(0x7f921c06e890 0x7f921c070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.970+0000 7f923ad9d640 1 --2- 172.21.15.96:0/3662858079 >> [v2:172.21.15.139:6816/27650,v1:172.21.15.139:6817/27650] conn(0x7f921c06e890 0x7f921c070cb0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:18.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.974+0000 7f922affd640 1 -- 172.21.15.96:0/3662858079 <== osd.6 v2:172.21.15.139:6816/27650 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f921c071380 con 0x7f921c06e890 2024-04-18T05:01:18.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.986+0000 7f924093c640 1 -- 172.21.15.96:0/3662858079 --> [v2:172.21.15.139:6816/27650,v1:172.21.15.139:6817/27650] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f923c0b0350 con 0x7f921c06e890 2024-04-18T05:01:18.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.986+0000 7f922affd640 1 -- 172.21.15.96:0/3662858079 <== osd.6 v2:172.21.15.139:6816/27650 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9234004b90 con 0x7f921c06e890 2024-04-18T05:01:18.990 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T05:01:18.990 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T05:01:18.990 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T05:01:18.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.986+0000 7f924093c640 1 -- 172.21.15.96:0/3662858079 >> [v2:172.21.15.139:6816/27650,v1:172.21.15.139:6817/27650] conn(0x7f921c06e890 msgr2=0x7f921c070cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.986+0000 7f924093c640 1 --2- 172.21.15.96:0/3662858079 >> [v2:172.21.15.139:6816/27650,v1:172.21.15.139:6817/27650] conn(0x7f921c06e890 0x7f921c070cb0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:18.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.986+0000 7f924093c640 1 -- 172.21.15.96:0/3662858079 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f921c066690 msgr2=0x7f921c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.986+0000 7f924093c640 1 --2- 172.21.15.96:0/3662858079 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f921c066690 0x7f921c068b50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f92300b2000 tx=0x7f9230009040 comp rx=0 tx=0).stop 2024-04-18T05:01:18.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.986+0000 7f924093c640 1 -- 172.21.15.96:0/3662858079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f923c0c8da0 msgr2=0x7f923c147dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:18.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.986+0000 7f924093c640 1 --2- 172.21.15.96:0/3662858079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f923c0c8da0 0x7f923c147dd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f922c00c3c0 tx=0x7f922c00c880 comp rx=0 tx=0).stop 2024-04-18T05:01:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.986+0000 7f923ad9d640 1 -- 172.21.15.96:0/3662858079 reap_dead start 2024-04-18T05:01:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.986+0000 7f924093c640 1 -- 172.21.15.96:0/3662858079 shutdown_connections 2024-04-18T05:01:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.986+0000 7f924093c640 1 -- 172.21.15.96:0/3662858079 >> 172.21.15.96:0/3662858079 conn(0x7f923c06e210 msgr2=0x7f923c0c5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.986+0000 7f924093c640 1 -- 172.21.15.96:0/3662858079 shutdown_connections 2024-04-18T05:01:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:18.986+0000 7f924093c640 1 -- 172.21.15.96:0/3662858079 wait complete. 2024-04-18T05:01:19.007 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-18T05:01:19.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.118+0000 7f41c2e8c640 1 Processor -- start 2024-04-18T05:01:19.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.118+0000 7f41c2e8c640 1 -- start start 2024-04-18T05:01:19.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.118+0000 7f41c2e8c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f41bc150ff0 0x7f41bc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.118+0000 7f41c2e8c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41bc0c7150 0x7f41bc0c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.118+0000 7f41c2e8c640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41bc15b110 con 0x7f41bc06e220 2024-04-18T05:01:19.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.118+0000 7f41c2e8c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41bc066a70 con 0x7f41bc150ff0 2024-04-18T05:01:19.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.118+0000 7f41c2e8c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc0c2c80 con 0x7f41bc0c7150 2024-04-18T05:01:19.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.118+0000 7f41c0c28640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f41bc150ff0 0x7f41bc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.122+0000 7f41c0c28640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f41bc150ff0 0x7f41bc15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54522/0 (socket says 172.21.15.96:54522) 2024-04-18T05:01:19.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.122+0000 7f41c0c28640 1 -- 172.21.15.96:0/1656727833 learned_addr learned my addr 172.21.15.96:0/1656727833 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:19.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.122+0000 7f41c1429640 1 --2- 172.21.15.96:0/1656727833 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41bc0c7150 0x7f41bc0c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.122+0000 7f41c0c28640 1 -- 172.21.15.96:0/1656727833 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41bc0c7150 msgr2=0x7f41bc0c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:19.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.122+0000 7f41c0c28640 1 --2- 172.21.15.96:0/1656727833 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41bc0c7150 0x7f41bc0c91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.122+0000 7f41c0c28640 1 -- 172.21.15.96:0/1656727833 >> v1:172.21.15.139:6789/0 conn(0x7f41bc06e220 legacy=0x7f41bc0c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.122+0000 7f41c0c28640 1 -- 172.21.15.96:0/1656727833 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41bc15a740 con 0x7f41bc150ff0 2024-04-18T05:01:19.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.122+0000 7f41c0c28640 1 --2- 172.21.15.96:0/1656727833 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc150ff0 0x7f41bc15abd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009870 tx=0x7f41ac01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e2a03489808b39 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:19.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.122+0000 7f41bb7fe640 1 -- 172.21.15.96:0/1656727833 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0a8a50 con 0x7f41bc150ff0 2024-04-18T05:01:19.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.122+0000 7f41bb7fe640 1 -- 172.21.15.96:0/1656727833 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac0a8bb0 con 0x7f41bc150ff0 2024-04-18T05:01:19.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.122+0000 7f41bb7fe640 1 -- 172.21.15.96:0/1656727833 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0b0440 con 0x7f41bc150ff0 2024-04-18T05:01:19.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.122+0000 7f41c2e8c640 1 -- 172.21.15.96:0/1656727833 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc150ff0 msgr2=0x7f41bc15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.122+0000 7f41c2e8c640 1 --2- 172.21.15.96:0/1656727833 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc150ff0 0x7f41bc15abd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009870 tx=0x7f41ac01ed50 comp rx=0 tx=0).stop 2024-04-18T05:01:19.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c2e8c640 1 -- 172.21.15.96:0/1656727833 shutdown_connections 2024-04-18T05:01:19.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c2e8c640 1 --2- 172.21.15.96:0/1656727833 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41bc0c7150 0x7f41bc0c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c2e8c640 1 --2- 172.21.15.96:0/1656727833 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc150ff0 0x7f41bc15abd0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c2e8c640 1 -- 172.21.15.96:0/1656727833 >> 172.21.15.96:0/1656727833 conn(0x7f41bc070260 msgr2=0x7f41bc065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:19.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c2e8c640 1 -- 172.21.15.96:0/1656727833 shutdown_connections 2024-04-18T05:01:19.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c2e8c640 1 -- 172.21.15.96:0/1656727833 wait complete. 2024-04-18T05:01:19.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c2e8c640 1 Processor -- start 2024-04-18T05:01:19.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c2e8c640 1 -- start start 2024-04-18T05:01:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c2e8c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41bc06e220 0x7f41bc14e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c2e8c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0c7150 0x7f41bc149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c2e8c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41bc150ff0 0x7f41bc149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c2e8c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc14fdb0 con 0x7f41bc0c7150 2024-04-18T05:01:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c2e8c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc149070 con 0x7f41bc06e220 2024-04-18T05:01:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c2e8c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc159d20 con 0x7f41bc150ff0 2024-04-18T05:01:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41bbfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0c7150 0x7f41bc149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41bbfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0c7150 0x7f41bc149550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54536/0 (socket says 172.21.15.96:54536) 2024-04-18T05:01:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41bbfff640 1 -- 172.21.15.96:0/1523348397 learned_addr learned my addr 172.21.15.96:0/1523348397 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c0c28640 1 --2- 172.21.15.96:0/1523348397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41bc06e220 0x7f41bc14e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c1429640 1 --2- 172.21.15.96:0/1523348397 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41bc150ff0 0x7f41bc149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41bbfff640 1 -- 172.21.15.96:0/1523348397 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41bc150ff0 msgr2=0x7f41bc149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41bbfff640 1 --2- 172.21.15.96:0/1523348397 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41bc150ff0 0x7f41bc149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41bbfff640 1 -- 172.21.15.96:0/1523348397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41bc06e220 msgr2=0x7f41bc14e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41bbfff640 1 --2- 172.21.15.96:0/1523348397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41bc06e220 0x7f41bc14e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41bbfff640 1 -- 172.21.15.96:0/1523348397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac0094d0 con 0x7f41bc0c7150 2024-04-18T05:01:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c1429640 1 --2- 172.21.15.96:0/1523348397 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41bc150ff0 0x7f41bc149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T05:01:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41bbfff640 1 --2- 172.21.15.96:0/1523348397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0c7150 0x7f41bc149550 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f41b000c500 tx=0x7f41b000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41b97fa640 1 -- 172.21.15.96:0/1523348397 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b0005220 con 0x7f41bc0c7150 2024-04-18T05:01:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41b97fa640 1 -- 172.21.15.96:0/1523348397 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b0005380 con 0x7f41bc0c7150 2024-04-18T05:01:19.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41b97fa640 1 -- 172.21.15.96:0/1523348397 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b0007270 con 0x7f41bc0c7150 2024-04-18T05:01:19.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c2e8c640 1 -- 172.21.15.96:0/1523348397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41bc1ed020 con 0x7f41bc0c7150 2024-04-18T05:01:19.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.126+0000 7f41c2e8c640 1 -- 172.21.15.96:0/1523348397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41bc14fa50 con 0x7f41bc0c7150 2024-04-18T05:01:19.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.130+0000 7f41c2e8c640 1 -- 172.21.15.96:0/1523348397 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41bc1ece80 con 0x7f41bc0c7150 2024-04-18T05:01:19.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.130+0000 7f41b97fa640 1 -- 172.21.15.96:0/1523348397 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f41b00073d0 con 0x7f41bc0c7150 2024-04-18T05:01:19.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.130+0000 7f41b97fa640 1 --2- 172.21.15.96:0/1523348397 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f41a8066690 0x7f41a8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.130+0000 7f41b97fa640 1 -- 172.21.15.96:0/1523348397 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f41b00838a0 con 0x7f41bc0c7150 2024-04-18T05:01:19.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.130+0000 7f41c0c28640 1 --2- 172.21.15.96:0/1523348397 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f41a8066690 0x7f41a8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.130+0000 7f41c0c28640 1 --2- 172.21.15.96:0/1523348397 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f41a8066690 0x7f41a8068b50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0b2000 tx=0x7f41ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:19.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.134+0000 7f41b97fa640 1 -- 172.21.15.96:0/1523348397 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f41bc1ece80 con 0x7f41bc0c7150 2024-04-18T05:01:19.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.286+0000 7f41c2e8c640 1 -- 172.21.15.96:0/1523348397 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f41bc0c26c0 con 0x7f41a8066690 2024-04-18T05:01:19.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.286+0000 7f41b97fa640 1 -- 172.21.15.96:0/1523348397 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f41ac0b04c0 con 0x7f41a8066690 2024-04-18T05:01:19.288 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 6 to deep-scrub 2024-04-18T05:01:19.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.286+0000 7f41c2e8c640 1 -- 172.21.15.96:0/1523348397 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f41a8066690 msgr2=0x7f41a8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.286+0000 7f41c2e8c640 1 --2- 172.21.15.96:0/1523348397 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f41a8066690 0x7f41a8068b50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0b2000 tx=0x7f41ac009040 comp rx=0 tx=0).stop 2024-04-18T05:01:19.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.286+0000 7f41c2e8c640 1 -- 172.21.15.96:0/1523348397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0c7150 msgr2=0x7f41bc149550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.286+0000 7f41c2e8c640 1 --2- 172.21.15.96:0/1523348397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0c7150 0x7f41bc149550 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f41b000c500 tx=0x7f41b000c9c0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.286+0000 7f41c2e8c640 1 -- 172.21.15.96:0/1523348397 shutdown_connections 2024-04-18T05:01:19.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.286+0000 7f41c2e8c640 1 --2- 172.21.15.96:0/1523348397 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f41a8066690 0x7f41a8068b50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.286+0000 7f41c2e8c640 1 --2- 172.21.15.96:0/1523348397 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f41bc150ff0 0x7f41bc149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.286+0000 7f41c2e8c640 1 --2- 172.21.15.96:0/1523348397 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41bc0c7150 0x7f41bc149550 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.286+0000 7f41c2e8c640 1 --2- 172.21.15.96:0/1523348397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41bc06e220 0x7f41bc14e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.286+0000 7f41c2e8c640 1 -- 172.21.15.96:0/1523348397 >> 172.21.15.96:0/1523348397 conn(0x7f41bc070260 msgr2=0x7f41bc0c1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:19.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.286+0000 7f41c2e8c640 1 -- 172.21.15.96:0/1523348397 shutdown_connections 2024-04-18T05:01:19.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.286+0000 7f41c2e8c640 1 -- 172.21.15.96:0/1523348397 wait complete. 2024-04-18T05:01:19.306 INFO:tasks.ceph:Scrubbing osd.7 2024-04-18T05:01:19.307 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-18T05:01:19.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.418+0000 7fcb16d5d640 1 Processor -- start 2024-04-18T05:01:19.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.418+0000 7fcb16d5d640 1 -- start start 2024-04-18T05:01:19.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.418+0000 7fcb16d5d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcb1006b1d0 0x7fcb10152a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.418+0000 7fcb16d5d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcb1006b5b0 0x7fcb10152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.418+0000 7fcb16d5d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1006d8d0 con 0x7fcb1015a270 2024-04-18T05:01:19.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.418+0000 7fcb16d5d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb1006cac0 con 0x7fcb1006b5b0 2024-04-18T05:01:19.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.418+0000 7fcb16d5d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1006dbb0 con 0x7fcb1006b1d0 2024-04-18T05:01:19.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.418+0000 7fcb152fa640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fcb1015a270 0x7fcb1015a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50044/0 (socket says 172.21.15.96:50044) 2024-04-18T05:01:19.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.418+0000 7fcb152fa640 1 -- 172.21.15.96:0/442077863 learned_addr learned my addr 172.21.15.96:0/442077863 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:01:19.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.418+0000 7fcb0ffff640 1 --2- 172.21.15.96:0/442077863 >> v2:172.21.15.96:3300/0 conn(0x7fcb1006b5b0 0x7fcb10152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.418+0000 7fcb14af9640 1 --2- 172.21.15.96:0/442077863 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcb1006b1d0 0x7fcb10152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.418+0000 7fcb0ffff640 1 -- 172.21.15.96:0/442077863 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcb1006b1d0 msgr2=0x7fcb10152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:19.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.418+0000 7fcb0ffff640 1 --2- 172.21.15.96:0/442077863 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcb1006b1d0 0x7fcb10152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.418+0000 7fcb0ffff640 1 -- 172.21.15.96:0/442077863 >> v1:172.21.15.96:6789/0 conn(0x7fcb1015a270 legacy=0x7fcb1015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.418+0000 7fcb0ffff640 1 -- 172.21.15.96:0/442077863 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1006de90 con 0x7fcb1006b5b0 2024-04-18T05:01:19.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.422+0000 7fcb0ffff640 1 --2- 172.21.15.96:0/442077863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb1006b5b0 0x7fcb10152fc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcb040097c0 tx=0x7fcb0401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7482272c4bad10 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:19.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.422+0000 7fcb0f7fe640 1 -- 172.21.15.96:0/442077863 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb040a8990 con 0x7fcb1006b5b0 2024-04-18T05:01:19.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.422+0000 7fcb0f7fe640 1 -- 172.21.15.96:0/442077863 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb040a8af0 con 0x7fcb1006b5b0 2024-04-18T05:01:19.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.422+0000 7fcb0f7fe640 1 -- 172.21.15.96:0/442077863 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb040a8e80 con 0x7fcb1006b5b0 2024-04-18T05:01:19.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.422+0000 7fcb16d5d640 1 -- 172.21.15.96:0/442077863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb1006b5b0 msgr2=0x7fcb10152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.422+0000 7fcb16d5d640 1 --2- 172.21.15.96:0/442077863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb1006b5b0 0x7fcb10152fc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcb040097c0 tx=0x7fcb0401ec90 comp rx=0 tx=0).stop 2024-04-18T05:01:19.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.422+0000 7fcb16d5d640 1 -- 172.21.15.96:0/442077863 shutdown_connections 2024-04-18T05:01:19.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.422+0000 7fcb16d5d640 1 --2- 172.21.15.96:0/442077863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb1006b5b0 0x7fcb10152fc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.422+0000 7fcb16d5d640 1 --2- 172.21.15.96:0/442077863 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcb1006b1d0 0x7fcb10152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.422+0000 7fcb16d5d640 1 -- 172.21.15.96:0/442077863 >> 172.21.15.96:0/442077863 conn(0x7fcb100661c0 msgr2=0x7fcb1006fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:19.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.422+0000 7fcb16d5d640 1 -- 172.21.15.96:0/442077863 shutdown_connections 2024-04-18T05:01:19.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.422+0000 7fcb16d5d640 1 -- 172.21.15.96:0/442077863 wait complete. 2024-04-18T05:01:19.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.422+0000 7fcb16d5d640 1 Processor -- start 2024-04-18T05:01:19.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.422+0000 7fcb16d5d640 1 -- start start 2024-04-18T05:01:19.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb16d5d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb1006b1d0 0x7fcb1014d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb16d5d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb1006b5b0 0x7fcb10152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb16d5d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcb1015a270 0x7fcb101532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb16d5d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb10154310 con 0x7fcb1006b5b0 2024-04-18T05:01:19.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb16d5d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb101502f0 con 0x7fcb1006b1d0 2024-04-18T05:01:19.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb16d5d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb10155090 con 0x7fcb1015a270 2024-04-18T05:01:19.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb1006b5b0 0x7fcb10152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb1006b5b0 0x7fcb10152d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54558/0 (socket says 172.21.15.96:54558) 2024-04-18T05:01:19.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0ffff640 1 -- 172.21.15.96:0/2854822133 learned_addr learned my addr 172.21.15.96:0/2854822133 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:19.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb14af9640 1 --2- 172.21.15.96:0/2854822133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb1006b1d0 0x7fcb1014d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0ffff640 1 -- 172.21.15.96:0/2854822133 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcb1015a270 msgr2=0x7fcb101532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0ffff640 1 --2- 172.21.15.96:0/2854822133 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcb1015a270 0x7fcb101532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0ffff640 1 -- 172.21.15.96:0/2854822133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb1006b1d0 msgr2=0x7fcb1014d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0ffff640 1 --2- 172.21.15.96:0/2854822133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb1006b1d0 0x7fcb1014d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0ffff640 1 -- 172.21.15.96:0/2854822133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb04009420 con 0x7fcb1006b5b0 2024-04-18T05:01:19.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0ffff640 1 --2- 172.21.15.96:0/2854822133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb1006b5b0 0x7fcb10152d60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcb040b3040 tx=0x7fcb0401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:19.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0d7fa640 1 -- 172.21.15.96:0/2854822133 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb040b9630 con 0x7fcb1006b5b0 2024-04-18T05:01:19.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0d7fa640 1 -- 172.21.15.96:0/2854822133 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb040b97b0 con 0x7fcb1006b5b0 2024-04-18T05:01:19.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb16d5d640 1 -- 172.21.15.96:0/2854822133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb101548d0 con 0x7fcb1006b5b0 2024-04-18T05:01:19.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0d7fa640 1 -- 172.21.15.96:0/2854822133 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb040b9b60 con 0x7fcb1006b5b0 2024-04-18T05:01:19.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb16d5d640 1 -- 172.21.15.96:0/2854822133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1014fd30 con 0x7fcb1006b5b0 2024-04-18T05:01:19.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb16d5d640 1 -- 172.21.15.96:0/2854822133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb1006e450 con 0x7fcb1006b5b0 2024-04-18T05:01:19.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0d7fa640 1 -- 172.21.15.96:0/2854822133 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcb040b7040 con 0x7fcb1006b5b0 2024-04-18T05:01:19.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0d7fa640 1 --2- 172.21.15.96:0/2854822133 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcafc066690 0x7fcafc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0d7fa640 1 -- 172.21.15.96:0/2854822133 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fcb04122c90 con 0x7fcb1006b5b0 2024-04-18T05:01:19.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb14af9640 1 --2- 172.21.15.96:0/2854822133 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcafc066690 0x7fcafc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0d7fa640 1 --2- 172.21.15.96:0/2854822133 >> [v2:172.21.15.139:6800/27648,v1:172.21.15.139:6801/27648] conn(0x7fcafc06e890 0x7fcafc070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0d7fa640 1 -- 172.21.15.96:0/2854822133 --> [v2:172.21.15.139:6800/27648,v1:172.21.15.139:6801/27648] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcafc071380 con 0x7fcafc06e890 2024-04-18T05:01:19.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb0d7fa640 1 -- 172.21.15.96:0/2854822133 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb041230e0 con 0x7fcb1006b5b0 2024-04-18T05:01:19.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb14af9640 1 --2- 172.21.15.96:0/2854822133 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcafc066690 0x7fcafc068b50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcb000096f0 tx=0x7fcb00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:19.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb152fa640 1 --2- 172.21.15.96:0/2854822133 >> [v2:172.21.15.139:6800/27648,v1:172.21.15.139:6801/27648] conn(0x7fcafc06e890 0x7fcafc070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.426+0000 7fcb152fa640 1 --2- 172.21.15.96:0/2854822133 >> [v2:172.21.15.139:6800/27648,v1:172.21.15.139:6801/27648] conn(0x7fcafc06e890 0x7fcafc070cb0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:19.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.430+0000 7fcb0d7fa640 1 -- 172.21.15.96:0/2854822133 <== osd.7 v2:172.21.15.139:6800/27648 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fcafc071380 con 0x7fcafc06e890 2024-04-18T05:01:19.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.442+0000 7fcb16d5d640 1 -- 172.21.15.96:0/2854822133 --> [v2:172.21.15.139:6800/27648,v1:172.21.15.139:6801/27648] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcb10155200 con 0x7fcafc06e890 2024-04-18T05:01:19.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.442+0000 7fcb0d7fa640 1 -- 172.21.15.96:0/2854822133 <== osd.7 v2:172.21.15.139:6800/27648 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcb10155200 con 0x7fcafc06e890 2024-04-18T05:01:19.446 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-18T05:01:19.446 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T05:01:19.446 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-18T05:01:19.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.442+0000 7fcb16d5d640 1 -- 172.21.15.96:0/2854822133 >> [v2:172.21.15.139:6800/27648,v1:172.21.15.139:6801/27648] conn(0x7fcafc06e890 msgr2=0x7fcafc070cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.442+0000 7fcb16d5d640 1 --2- 172.21.15.96:0/2854822133 >> [v2:172.21.15.139:6800/27648,v1:172.21.15.139:6801/27648] conn(0x7fcafc06e890 0x7fcafc070cb0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.442+0000 7fcb16d5d640 1 -- 172.21.15.96:0/2854822133 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcafc066690 msgr2=0x7fcafc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.442+0000 7fcb16d5d640 1 --2- 172.21.15.96:0/2854822133 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fcafc066690 0x7fcafc068b50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcb000096f0 tx=0x7fcb00008040 comp rx=0 tx=0).stop 2024-04-18T05:01:19.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.442+0000 7fcb16d5d640 1 -- 172.21.15.96:0/2854822133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb1006b5b0 msgr2=0x7fcb10152d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.442+0000 7fcb16d5d640 1 --2- 172.21.15.96:0/2854822133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb1006b5b0 0x7fcb10152d60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcb040b3040 tx=0x7fcb0401ba30 comp rx=0 tx=0).stop 2024-04-18T05:01:19.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.442+0000 7fcb152fa640 1 -- 172.21.15.96:0/2854822133 reap_dead start 2024-04-18T05:01:19.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.442+0000 7fcb16d5d640 1 -- 172.21.15.96:0/2854822133 shutdown_connections 2024-04-18T05:01:19.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.442+0000 7fcb16d5d640 1 -- 172.21.15.96:0/2854822133 >> 172.21.15.96:0/2854822133 conn(0x7fcb100661c0 msgr2=0x7fcb10158210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:19.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.442+0000 7fcb16d5d640 1 -- 172.21.15.96:0/2854822133 shutdown_connections 2024-04-18T05:01:19.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.442+0000 7fcb16d5d640 1 -- 172.21.15.96:0/2854822133 wait complete. 2024-04-18T05:01:19.460 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-18T05:01:19.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.566+0000 7f83c0c31640 1 Processor -- start 2024-04-18T05:01:19.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.566+0000 7f83c0c31640 1 -- start start 2024-04-18T05:01:19.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.566+0000 7f83c0c31640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f83bc15a270 0x7f83bc0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.566+0000 7f83c0c31640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f83bc0c6670 0x7f83bc157620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.566+0000 7f83c0c31640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc06c650 con 0x7f83bc0c5b30 2024-04-18T05:01:19.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.566+0000 7f83c0c31640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc157200 con 0x7f83bc0c6670 2024-04-18T05:01:19.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.566+0000 7f83c0c31640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc0c6450 con 0x7f83bc15a270 2024-04-18T05:01:19.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.566+0000 7f83bad9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f83bc0c6670 0x7f83bc157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.566+0000 7f83bad9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f83bc0c6670 0x7f83bc157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54564/0 (socket says 172.21.15.96:54564) 2024-04-18T05:01:19.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.566+0000 7f83bad9d640 1 -- 172.21.15.96:0/2324086730 learned_addr learned my addr 172.21.15.96:0/2324086730 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:19.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.566+0000 7f83b9d9b640 1 --2- 172.21.15.96:0/2324086730 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f83bc15a270 0x7f83bc0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.566+0000 7f83bad9d640 1 -- 172.21.15.96:0/2324086730 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f83bc15a270 msgr2=0x7f83bc0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:19.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.566+0000 7f83bad9d640 1 --2- 172.21.15.96:0/2324086730 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f83bc15a270 0x7f83bc0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.566+0000 7f83bad9d640 1 -- 172.21.15.96:0/2324086730 >> v1:172.21.15.139:6789/0 conn(0x7f83bc0c5b30 legacy=0x7f83bc0c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.566+0000 7f83bad9d640 1 -- 172.21.15.96:0/2324086730 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc0c1500 con 0x7f83bc0c6670 2024-04-18T05:01:19.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83bad9d640 1 --2- 172.21.15.96:0/2324086730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83bc0c6670 0x7f83bc157620 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009870 tx=0x7f83b401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100b834a8785f5b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:19.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83b959a640 1 -- 172.21.15.96:0/2324086730 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b40a8a50 con 0x7f83bc0c6670 2024-04-18T05:01:19.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83b959a640 1 -- 172.21.15.96:0/2324086730 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b40a8bb0 con 0x7f83bc0c6670 2024-04-18T05:01:19.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83b959a640 1 -- 172.21.15.96:0/2324086730 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b40b0440 con 0x7f83bc0c6670 2024-04-18T05:01:19.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83c0c31640 1 -- 172.21.15.96:0/2324086730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83bc0c6670 msgr2=0x7f83bc157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83c0c31640 1 --2- 172.21.15.96:0/2324086730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83bc0c6670 0x7f83bc157620 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009870 tx=0x7f83b401ed50 comp rx=0 tx=0).stop 2024-04-18T05:01:19.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83c0c31640 1 -- 172.21.15.96:0/2324086730 shutdown_connections 2024-04-18T05:01:19.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83c0c31640 1 --2- 172.21.15.96:0/2324086730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83bc0c6670 0x7f83bc157620 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83c0c31640 1 --2- 172.21.15.96:0/2324086730 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f83bc15a270 0x7f83bc0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83c0c31640 1 -- 172.21.15.96:0/2324086730 >> 172.21.15.96:0/2324086730 conn(0x7f83bc06a8e0 msgr2=0x7f83bc0c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:19.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83c0c31640 1 -- 172.21.15.96:0/2324086730 shutdown_connections 2024-04-18T05:01:19.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83c0c31640 1 -- 172.21.15.96:0/2324086730 wait complete. 2024-04-18T05:01:19.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83c0c31640 1 Processor -- start 2024-04-18T05:01:19.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83c0c31640 1 -- start start 2024-04-18T05:01:19.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83c0c31640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83bc0c5b30 0x7f83bc0ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83c0c31640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83bc0c6670 0x7f83bc155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83c0c31640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f83bc15a270 0x7f83bc0c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83c0c31640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc1ed050 con 0x7f83bc0c5b30 2024-04-18T05:01:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83c0c31640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc1542a0 con 0x7f83bc0c6670 2024-04-18T05:01:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83c0c31640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc0cafb0 con 0x7f83bc15a270 2024-04-18T05:01:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83ba59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83bc0c5b30 0x7f83bc0ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83ba59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83bc0c5b30 0x7f83bc0ca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54576/0 (socket says 172.21.15.96:54576) 2024-04-18T05:01:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83ba59c640 1 -- 172.21.15.96:0/2403447923 learned_addr learned my addr 172.21.15.96:0/2403447923 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83bad9d640 1 --2- 172.21.15.96:0/2403447923 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f83bc15a270 0x7f83bc0c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83b9d9b640 1 --2- 172.21.15.96:0/2403447923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83bc0c6670 0x7f83bc155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83ba59c640 1 -- 172.21.15.96:0/2403447923 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f83bc15a270 msgr2=0x7f83bc0c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83ba59c640 1 --2- 172.21.15.96:0/2403447923 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f83bc15a270 0x7f83bc0c9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83ba59c640 1 -- 172.21.15.96:0/2403447923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83bc0c6670 msgr2=0x7f83bc155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83ba59c640 1 --2- 172.21.15.96:0/2403447923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83bc0c6670 0x7f83bc155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83ba59c640 1 -- 172.21.15.96:0/2403447923 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b40094d0 con 0x7f83bc0c5b30 2024-04-18T05:01:19.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.570+0000 7f83ba59c640 1 --2- 172.21.15.96:0/2403447923 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83bc0c5b30 0x7f83bc0ca990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00c7f0 tx=0x7f83ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:19.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.574+0000 7f83aaffd640 1 -- 172.21.15.96:0/2403447923 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac003b80 con 0x7f83bc0c5b30 2024-04-18T05:01:19.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.574+0000 7f83aaffd640 1 -- 172.21.15.96:0/2403447923 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac003ce0 con 0x7f83bc0c5b30 2024-04-18T05:01:19.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.574+0000 7f83aaffd640 1 -- 172.21.15.96:0/2403447923 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00aa90 con 0x7f83bc0c5b30 2024-04-18T05:01:19.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.574+0000 7f83c0c31640 1 -- 172.21.15.96:0/2403447923 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc1ec6b0 con 0x7f83bc0c5b30 2024-04-18T05:01:19.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.574+0000 7f83c0c31640 1 -- 172.21.15.96:0/2403447923 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc1ecc70 con 0x7f83bc0c5b30 2024-04-18T05:01:19.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.574+0000 7f83c0c31640 1 -- 172.21.15.96:0/2403447923 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc1ed2c0 con 0x7f83bc0c5b30 2024-04-18T05:01:19.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.574+0000 7f83aaffd640 1 -- 172.21.15.96:0/2403447923 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f83ac00abf0 con 0x7f83bc0c5b30 2024-04-18T05:01:19.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.574+0000 7f83aaffd640 1 --2- 172.21.15.96:0/2403447923 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f839c0666c0 0x7f839c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.574+0000 7f83aaffd640 1 -- 172.21.15.96:0/2403447923 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f83ac083f40 con 0x7f83bc0c5b30 2024-04-18T05:01:19.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.574+0000 7f83b9d9b640 1 --2- 172.21.15.96:0/2403447923 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f839c0666c0 0x7f839c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.574+0000 7f83b9d9b640 1 --2- 172.21.15.96:0/2403447923 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f839c0666c0 0x7f839c068b80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f83bc151c30 tx=0x7f83b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:19.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.578+0000 7f83aaffd640 1 -- 172.21.15.96:0/2403447923 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f83ac051320 con 0x7f83bc0c5b30 2024-04-18T05:01:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.726+0000 7f83c0c31640 1 -- 172.21.15.96:0/2403447923 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f83bc06c370 con 0x7f839c0666c0 2024-04-18T05:01:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.726+0000 7f83aaffd640 1 -- 172.21.15.96:0/2403447923 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f83b00118b0 con 0x7f839c0666c0 2024-04-18T05:01:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 7 to deep-scrub 2024-04-18T05:01:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.726+0000 7f83c0c31640 1 -- 172.21.15.96:0/2403447923 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f839c0666c0 msgr2=0x7f839c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.726+0000 7f83c0c31640 1 --2- 172.21.15.96:0/2403447923 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f839c0666c0 0x7f839c068b80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f83bc151c30 tx=0x7f83b0008040 comp rx=0 tx=0).stop 2024-04-18T05:01:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.726+0000 7f83c0c31640 1 -- 172.21.15.96:0/2403447923 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83bc0c5b30 msgr2=0x7f83bc0ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.726+0000 7f83c0c31640 1 --2- 172.21.15.96:0/2403447923 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83bc0c5b30 0x7f83bc0ca990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00c7f0 tx=0x7f83ac00ccb0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.726+0000 7f83c0c31640 1 -- 172.21.15.96:0/2403447923 shutdown_connections 2024-04-18T05:01:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.726+0000 7f83c0c31640 1 --2- 172.21.15.96:0/2403447923 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f839c0666c0 0x7f839c068b80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.726+0000 7f83c0c31640 1 --2- 172.21.15.96:0/2403447923 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f83bc15a270 0x7f83bc0c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.726+0000 7f83c0c31640 1 --2- 172.21.15.96:0/2403447923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83bc0c6670 0x7f83bc155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.726+0000 7f83c0c31640 1 --2- 172.21.15.96:0/2403447923 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83bc0c5b30 0x7f83bc0ca990 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.726+0000 7f83c0c31640 1 -- 172.21.15.96:0/2403447923 >> 172.21.15.96:0/2403447923 conn(0x7f83bc06a8e0 msgr2=0x7f83bc14f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.726+0000 7f83c0c31640 1 -- 172.21.15.96:0/2403447923 shutdown_connections 2024-04-18T05:01:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.726+0000 7f83c0c31640 1 -- 172.21.15.96:0/2403447923 wait complete. 2024-04-18T05:01:19.748 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T05:01:19.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f0422803640 1 Processor -- start 2024-04-18T05:01:19.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f0422803640 1 -- start start 2024-04-18T05:01:19.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f0422803640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f041c1512c0 0x7f041c0cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f0422803640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c0c76d0 con 0x7f041c0c8a50 2024-04-18T05:01:19.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f0422803640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c071d00 con 0x7f041c150ee0 2024-04-18T05:01:19.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f0422803640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041c0c6c80 con 0x7f041c1512c0 2024-04-18T05:01:19.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f0420da0640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f041c0c8a50 0x7f041c0c4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50056/0 (socket says 172.21.15.96:50056) 2024-04-18T05:01:19.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f0420da0640 1 -- 172.21.15.96:0/1143379222 learned_addr learned my addr 172.21.15.96:0/1143379222 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:01:19.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041b7fe640 1 --2- 172.21.15.96:0/1143379222 >> v2:172.21.15.139:3300/0 conn(0x7f041c1512c0 0x7f041c0cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041affd640 1 -- 172.21.15.96:0/1143379222 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4212367446 0 0) 0x7f041c0c76d0 con 0x7f041c0c8a50 2024-04-18T05:01:19.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041affd640 1 -- 172.21.15.96:0/1143379222 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0408003530 con 0x7f041c0c8a50 2024-04-18T05:01:19.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041affd640 1 -- 172.21.15.96:0/1143379222 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 186536337 0 0) 0x7f0408003530 con 0x7f041c0c8a50 2024-04-18T05:01:19.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041affd640 1 -- 172.21.15.96:0/1143379222 >> v2:172.21.15.139:3300/0 conn(0x7f041c1512c0 msgr2=0x7f041c0cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:19.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041affd640 1 --2- 172.21.15.96:0/1143379222 >> v2:172.21.15.139:3300/0 conn(0x7f041c1512c0 0x7f041c0cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041affd640 1 -- 172.21.15.96:0/1143379222 >> v1:172.21.15.139:6789/0 conn(0x7f041c150ee0 legacy=0x7f041c15a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041affd640 1 -- 172.21.15.96:0/1143379222 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c071fe0 con 0x7f041c0c8a50 2024-04-18T05:01:19.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041affd640 1 -- 172.21.15.96:0/1143379222 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f040c001a00 con 0x7f041c0c8a50 2024-04-18T05:01:19.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041affd640 1 -- 172.21.15.96:0/1143379222 >> v1:172.21.15.96:6789/0 conn(0x7f041c0c8a50 legacy=0x7f041c0c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041affd640 1 --2- 172.21.15.96:0/1143379222 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0408003980 0x7f0408003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041affd640 1 --2- 172.21.15.96:0/1143379222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04080047d0 0x7f0408004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041affd640 1 --2- 172.21.15.96:0/1143379222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0408005190 0x7f040800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041affd640 1 -- 172.21.15.96:0/1143379222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0c6c80 con 0x7f0408005190 2024-04-18T05:01:19.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041affd640 1 -- 172.21.15.96:0/1143379222 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040800c030 con 0x7f04080047d0 2024-04-18T05:01:19.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041affd640 1 -- 172.21.15.96:0/1143379222 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040800c1f0 con 0x7f0408003980 2024-04-18T05:01:19.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f0420da0640 1 --2- 172.21.15.96:0/1143379222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0408005190 0x7f040800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f041bfff640 1 --2- 172.21.15.96:0/1143379222 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0408003980 0x7f0408003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f0420da0640 1 -- 172.21.15.96:0/1143379222 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0408003980 msgr2=0x7f0408003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:19.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f0420da0640 1 --2- 172.21.15.96:0/1143379222 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0408003980 0x7f0408003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f0420da0640 1 -- 172.21.15.96:0/1143379222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04080047d0 msgr2=0x7f0408004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:19.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f0420da0640 1 --2- 172.21.15.96:0/1143379222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04080047d0 0x7f0408004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.862+0000 7f0420da0640 1 -- 172.21.15.96:0/1143379222 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0408003530 con 0x7f0408005190 2024-04-18T05:01:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0420da0640 1 -- 172.21.15.96:0/1143379222 reap_dead start 2024-04-18T05:01:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0420da0640 1 --2- 172.21.15.96:0/1143379222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0408005190 0x7f040800b990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f040c00a820 tx=0x7f040c01d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10418fca3fc276f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f041affd640 1 -- 172.21.15.96:0/1143379222 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0072d0 con 0x7f0408005190 2024-04-18T05:01:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f041affd640 1 -- 172.21.15.96:0/1143379222 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c0a8070 con 0x7f0408005190 2024-04-18T05:01:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f041affd640 1 -- 172.21.15.96:0/1143379222 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0076b0 con 0x7f0408005190 2024-04-18T05:01:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0422803640 1 -- 172.21.15.96:0/1143379222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0408005190 msgr2=0x7f040800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0422803640 1 --2- 172.21.15.96:0/1143379222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0408005190 0x7f040800b990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f040c00a820 tx=0x7f040c01d340 comp rx=0 tx=0).stop 2024-04-18T05:01:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0422803640 1 -- 172.21.15.96:0/1143379222 shutdown_connections 2024-04-18T05:01:19.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0422803640 1 --2- 172.21.15.96:0/1143379222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0408005190 0x7f040800b990 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0422803640 1 -- 172.21.15.96:0/1143379222 >> 172.21.15.96:0/1143379222 conn(0x7f041c066250 msgr2=0x7f041c06eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:19.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0422803640 1 -- 172.21.15.96:0/1143379222 shutdown_connections 2024-04-18T05:01:19.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0422803640 1 -- 172.21.15.96:0/1143379222 wait complete. 2024-04-18T05:01:19.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0422803640 1 Processor -- start 2024-04-18T05:01:19.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0422803640 1 -- start start 2024-04-18T05:01:19.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0422803640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0408005190 0x7f041c14baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0422803640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f041c06a9a0 0x7f041c149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0422803640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f041c14a2c0 0x7f041c14c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0422803640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c1ecb80 con 0x7f041c06a9a0 2024-04-18T05:01:19.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0422803640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c1ecfa0 con 0x7f0408005190 2024-04-18T05:01:19.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0422803640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c14bfe0 con 0x7f041c14a2c0 2024-04-18T05:01:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f041b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f041c06a9a0 0x7f041c149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f041b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f041c06a9a0 0x7f041c149d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54596/0 (socket says 172.21.15.96:54596) 2024-04-18T05:01:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f041b7fe640 1 -- 172.21.15.96:0/3977014981 learned_addr learned my addr 172.21.15.96:0/3977014981 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.866+0000 7f0420da0640 1 --2- 172.21.15.96:0/3977014981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f041c14a2c0 0x7f041c14c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f041b7fe640 1 -- 172.21.15.96:0/3977014981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f041c14a2c0 msgr2=0x7f041c14c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f041b7fe640 1 --2- 172.21.15.96:0/3977014981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f041c14a2c0 0x7f041c14c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f041b7fe640 1 -- 172.21.15.96:0/3977014981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0408005190 msgr2=0x7f041c14baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f041bfff640 1 --2- 172.21.15.96:0/3977014981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0408005190 0x7f041c14baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f041b7fe640 1 --2- 172.21.15.96:0/3977014981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0408005190 0x7f041c14baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f041b7fe640 1 -- 172.21.15.96:0/3977014981 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c1ebfb0 con 0x7f041c06a9a0 2024-04-18T05:01:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f0420da0640 1 --2- 172.21.15.96:0/3977014981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f041c14a2c0 0x7f041c14c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:01:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f041b7fe640 1 --2- 172.21.15.96:0/3977014981 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f041c06a9a0 0x7f041c149d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f040400e7c0 tx=0x7f040400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f0418ff9640 1 -- 172.21.15.96:0/3977014981 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040400ee70 con 0x7f041c06a9a0 2024-04-18T05:01:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f0418ff9640 1 -- 172.21.15.96:0/3977014981 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040400c940 con 0x7f041c06a9a0 2024-04-18T05:01:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f0422803640 1 -- 172.21.15.96:0/3977014981 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c1ef6a0 con 0x7f041c06a9a0 2024-04-18T05:01:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f0418ff9640 1 -- 172.21.15.96:0/3977014981 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040400ccf0 con 0x7f041c06a9a0 2024-04-18T05:01:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f0422803640 1 -- 172.21.15.96:0/3977014981 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c1ec4c0 con 0x7f041c06a9a0 2024-04-18T05:01:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f0422803640 1 -- 172.21.15.96:0/3977014981 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041c067050 con 0x7f041c06a9a0 2024-04-18T05:01:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f0418ff9640 1 -- 172.21.15.96:0/3977014981 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0404013470 con 0x7f041c06a9a0 2024-04-18T05:01:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f0418ff9640 1 --2- 172.21.15.96:0/3977014981 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f03fc066690 0x7f03fc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f0418ff9640 1 -- 172.21.15.96:0/3977014981 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f04040841b0 con 0x7f041c06a9a0 2024-04-18T05:01:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f041bfff640 1 --2- 172.21.15.96:0/3977014981 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f03fc066690 0x7f03fc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.870+0000 7f041bfff640 1 --2- 172.21.15.96:0/3977014981 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f03fc066690 0x7f03fc068b50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0414000c10 tx=0x7f0414009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:19.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:19.874+0000 7f0418ff9640 1 -- 172.21.15.96:0/3977014981 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0404051590 con 0x7f041c06a9a0 2024-04-18T05:01:20.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:20.026+0000 7f0422803640 1 -- 172.21.15.96:0/3977014981 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f041c14a6a0 con 0x7f03fc066690 2024-04-18T05:01:20.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:20.038+0000 7f0418ff9640 1 -- 172.21.15.96:0/3977014981 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289417 (secure 0 0 0) 0x7f041c14a6a0 con 0x7f03fc066690 2024-04-18T05:01:20.045 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T05:01:20.047 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T05:01:20.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:20.042+0000 7f0422803640 1 -- 172.21.15.96:0/3977014981 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f03fc066690 msgr2=0x7f03fc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:20.042+0000 7f0422803640 1 --2- 172.21.15.96:0/3977014981 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f03fc066690 0x7f03fc068b50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0414000c10 tx=0x7f0414009040 comp rx=0 tx=0).stop 2024-04-18T05:01:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:20.042+0000 7f0422803640 1 -- 172.21.15.96:0/3977014981 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f041c06a9a0 msgr2=0x7f041c149d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:20.042+0000 7f0422803640 1 --2- 172.21.15.96:0/3977014981 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f041c06a9a0 0x7f041c149d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f040400e7c0 tx=0x7f040400ec80 comp rx=0 tx=0).stop 2024-04-18T05:01:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:20.042+0000 7f0422803640 1 -- 172.21.15.96:0/3977014981 shutdown_connections 2024-04-18T05:01:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:20.042+0000 7f0422803640 1 --2- 172.21.15.96:0/3977014981 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f03fc066690 0x7f03fc068b50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:20.042+0000 7f0422803640 1 --2- 172.21.15.96:0/3977014981 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f041c14a2c0 0x7f041c14c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:20.042+0000 7f0422803640 1 --2- 172.21.15.96:0/3977014981 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f041c06a9a0 0x7f041c149d80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:20.042+0000 7f0422803640 1 --2- 172.21.15.96:0/3977014981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0408005190 0x7f041c14baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:20.042+0000 7f0422803640 1 -- 172.21.15.96:0/3977014981 >> 172.21.15.96:0/3977014981 conn(0x7f041c066250 msgr2=0x7f041c149010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:20.042+0000 7f0422803640 1 -- 172.21.15.96:0/3977014981 shutdown_connections 2024-04-18T05:01:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:20.042+0000 7f0422803640 1 -- 172.21.15.96:0/3977014981 wait complete. 2024-04-18T05:01:20.064 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2024-04-18T05:01:18.706518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":131506610,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":2961,"num_read_kb":1326719,"num_write":31940,"num_write_kb":4643491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35456,"ondisk_log_size":35456,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":454048,"kb_used_data":100192,"kb_used_omap":12,"kb_used_meta":353779,"kb_avail":754520672,"statfs":{"total":773094113280,"available":772629168128,"internally_reserved":0,"allocated":102596608,"data_stored":263693236,"data_compressed":36701930,"data_compressed_allocated":47693824,"data_compressed_original":210231296,"omap_allocated":12744,"internal_metadata":362270264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003834"},"pg_stats":[{"pgid":"3.3f","version":"23'405","reported_seq":439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374066+0000","last_change":"2024-04-18T04:54:41.199306+0000","last_active":"2024-04-18T05:01:07.374066+0000","last_peered":"2024-04-18T05:01:07.374066+0000","last_clean":"2024-04-18T05:01:07.374066+0000","last_became_active":"2024-04-18T04:54:41.199046+0000","last_became_peered":"2024-04-18T04:54:41.199046+0000","last_unstale":"2024-04-18T05:01:07.374066+0000","last_undegraded":"2024-04-18T05:01:07.374066+0000","last_fullsized":"2024-04-18T05:01:07.374066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9249,"num_write":376,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"23'459","reported_seq":499,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.407426+0000","last_change":"2024-04-18T04:54:41.200447+0000","last_active":"2024-04-18T05:01:07.407426+0000","last_peered":"2024-04-18T05:01:07.407426+0000","last_clean":"2024-04-18T05:01:07.407426+0000","last_became_active":"2024-04-18T04:54:41.200136+0000","last_became_peered":"2024-04-18T04:54:41.200136+0000","last_unstale":"2024-04-18T05:01:07.407426+0000","last_undegraded":"2024-04-18T05:01:07.407426+0000","last_fullsized":"2024-04-18T05:01:07.407426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12666,"num_write":430,"num_write_kb":97067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"23'410","reported_seq":455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.396643+0000","last_change":"2024-04-18T04:54:41.185987+0000","last_active":"2024-04-18T05:01:07.396643+0000","last_peered":"2024-04-18T05:01:07.396643+0000","last_clean":"2024-04-18T05:01:07.396643+0000","last_became_active":"2024-04-18T04:54:41.185206+0000","last_became_peered":"2024-04-18T04:54:41.185206+0000","last_unstale":"2024-04-18T05:01:07.396643+0000","last_undegraded":"2024-04-18T05:01:07.396643+0000","last_fullsized":"2024-04-18T05:01:07.396643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":29819,"num_write":382,"num_write_kb":108666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"23'394","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.381024+0000","last_change":"2024-04-18T04:54:41.177487+0000","last_active":"2024-04-18T05:01:07.381024+0000","last_peered":"2024-04-18T05:01:07.381024+0000","last_clean":"2024-04-18T05:01:07.381024+0000","last_became_active":"2024-04-18T04:54:41.177217+0000","last_became_peered":"2024-04-18T04:54:41.177217+0000","last_unstale":"2024-04-18T05:01:07.381024+0000","last_undegraded":"2024-04-18T05:01:07.381024+0000","last_fullsized":"2024-04-18T05:01:07.381024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22571,"num_write":356,"num_write_kb":80073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"23'390","reported_seq":427,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.400041+0000","last_change":"2024-04-18T04:54:41.186573+0000","last_active":"2024-04-18T05:01:07.400041+0000","last_peered":"2024-04-18T05:01:07.400041+0000","last_clean":"2024-04-18T05:01:07.400041+0000","last_became_active":"2024-04-18T04:54:41.186027+0000","last_became_peered":"2024-04-18T04:54:41.186027+0000","last_unstale":"2024-04-18T05:01:07.400041+0000","last_undegraded":"2024-04-18T05:01:07.400041+0000","last_fullsized":"2024-04-18T05:01:07.400041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13089,"num_write":365,"num_write_kb":22615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"23'374","reported_seq":395,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.380560+0000","last_change":"2024-04-18T04:54:41.177550+0000","last_active":"2024-04-18T05:01:07.380560+0000","last_peered":"2024-04-18T05:01:07.380560+0000","last_clean":"2024-04-18T05:01:07.380560+0000","last_became_active":"2024-04-18T04:54:41.177215+0000","last_became_peered":"2024-04-18T04:54:41.177215+0000","last_unstale":"2024-04-18T05:01:07.380560+0000","last_undegraded":"2024-04-18T05:01:07.380560+0000","last_fullsized":"2024-04-18T05:01:07.380560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":350,"num_write_kb":36922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"23'405","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374455+0000","last_change":"2024-04-18T04:54:41.178605+0000","last_active":"2024-04-18T05:01:07.374455+0000","last_peered":"2024-04-18T05:01:07.374455+0000","last_clean":"2024-04-18T05:01:07.374455+0000","last_became_active":"2024-04-18T04:54:41.178094+0000","last_became_peered":"2024-04-18T04:54:41.178094+0000","last_unstale":"2024-04-18T05:01:07.374455+0000","last_undegraded":"2024-04-18T05:01:07.374455+0000","last_fullsized":"2024-04-18T05:01:07.374455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20531,"num_write":378,"num_write_kb":59118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"23'401","reported_seq":438,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.414199+0000","last_change":"2024-04-18T04:54:41.193174+0000","last_active":"2024-04-18T05:01:07.414199+0000","last_peered":"2024-04-18T05:01:07.414199+0000","last_clean":"2024-04-18T05:01:07.414199+0000","last_became_active":"2024-04-18T04:54:41.192678+0000","last_became_peered":"2024-04-18T04:54:41.192678+0000","last_unstale":"2024-04-18T05:01:07.414199+0000","last_undegraded":"2024-04-18T05:01:07.414199+0000","last_fullsized":"2024-04-18T05:01:07.414199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13567,"num_write":364,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"23'436","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.364148+0000","last_change":"2024-04-18T04:54:41.198121+0000","last_active":"2024-04-18T05:01:07.364148+0000","last_peered":"2024-04-18T05:01:07.364148+0000","last_clean":"2024-04-18T05:01:07.364148+0000","last_became_active":"2024-04-18T04:54:41.197832+0000","last_became_peered":"2024-04-18T04:54:41.197832+0000","last_unstale":"2024-04-18T05:01:07.364148+0000","last_undegraded":"2024-04-18T05:01:07.364148+0000","last_fullsized":"2024-04-18T05:01:07.364148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:06.835581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28521,"num_write":411,"num_write_kb":104022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"23'396","reported_seq":437,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.379998+0000","last_change":"2024-04-18T04:54:41.183032+0000","last_active":"2024-04-18T05:01:07.379998+0000","last_peered":"2024-04-18T05:01:07.379998+0000","last_clean":"2024-04-18T05:01:07.379998+0000","last_became_active":"2024-04-18T04:54:41.182698+0000","last_became_peered":"2024-04-18T04:54:41.182698+0000","last_unstale":"2024-04-18T05:01:07.379998+0000","last_undegraded":"2024-04-18T05:01:07.379998+0000","last_fullsized":"2024-04-18T05:01:07.379998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:51.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13914,"num_write":350,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"23'379","reported_seq":427,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377181+0000","last_change":"2024-04-18T04:54:41.187831+0000","last_active":"2024-04-18T05:01:07.377181+0000","last_peered":"2024-04-18T05:01:07.377181+0000","last_clean":"2024-04-18T05:01:07.377181+0000","last_became_active":"2024-04-18T04:54:41.187360+0000","last_became_peered":"2024-04-18T04:54:41.187360+0000","last_unstale":"2024-04-18T05:01:07.377181+0000","last_undegraded":"2024-04-18T05:01:07.377181+0000","last_fullsized":"2024-04-18T05:01:07.377181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:53.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18312,"num_write":357,"num_write_kb":34101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"23'361","reported_seq":410,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377628+0000","last_change":"2024-04-18T04:54:41.188641+0000","last_active":"2024-04-18T05:01:07.377628+0000","last_peered":"2024-04-18T05:01:07.377628+0000","last_clean":"2024-04-18T05:01:07.377628+0000","last_became_active":"2024-04-18T04:54:41.188281+0000","last_became_peered":"2024-04-18T04:54:41.188281+0000","last_unstale":"2024-04-18T05:01:07.377628+0000","last_undegraded":"2024-04-18T05:01:07.377628+0000","last_fullsized":"2024-04-18T05:01:07.377628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21304,"num_write":338,"num_write_kb":54980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"23'375","reported_seq":405,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394838+0000","last_change":"2024-04-18T04:54:41.194578+0000","last_active":"2024-04-18T05:01:07.394838+0000","last_peered":"2024-04-18T05:01:07.394838+0000","last_clean":"2024-04-18T05:01:07.394838+0000","last_became_active":"2024-04-18T04:54:41.190882+0000","last_became_peered":"2024-04-18T04:54:41.190882+0000","last_unstale":"2024-04-18T05:01:07.394838+0000","last_undegraded":"2024-04-18T05:01:07.394838+0000","last_fullsized":"2024-04-18T05:01:07.394838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:45:52.041196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7725,"num_write":337,"num_write_kb":21712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"23'417","reported_seq":490,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.393436+0000","last_change":"2024-04-18T04:54:41.190210+0000","last_active":"2024-04-18T05:01:07.393436+0000","last_peered":"2024-04-18T05:01:07.393436+0000","last_clean":"2024-04-18T05:01:07.393436+0000","last_became_active":"2024-04-18T04:54:41.189813+0000","last_became_peered":"2024-04-18T04:54:41.189813+0000","last_unstale":"2024-04-18T05:01:07.393436+0000","last_undegraded":"2024-04-18T05:01:07.393436+0000","last_fullsized":"2024-04-18T05:01:07.393436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:38:02.632458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":28320,"num_write":390,"num_write_kb":71764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"23'445","reported_seq":532,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.406236+0000","last_change":"2024-04-18T04:54:41.183027+0000","last_active":"2024-04-18T05:01:07.406236+0000","last_peered":"2024-04-18T05:01:07.406236+0000","last_clean":"2024-04-18T05:01:07.406236+0000","last_became_active":"2024-04-18T04:54:41.182713+0000","last_became_peered":"2024-04-18T04:54:41.182713+0000","last_unstale":"2024-04-18T05:01:07.406236+0000","last_undegraded":"2024-04-18T05:01:07.406236+0000","last_fullsized":"2024-04-18T05:01:07.406236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":36644,"num_write":412,"num_write_kb":104908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"23'442","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.364940+0000","last_change":"2024-04-18T04:54:41.186060+0000","last_active":"2024-04-18T05:01:07.364940+0000","last_peered":"2024-04-18T05:01:07.364940+0000","last_clean":"2024-04-18T05:01:07.364940+0000","last_became_active":"2024-04-18T04:54:41.185803+0000","last_became_peered":"2024-04-18T04:54:41.185803+0000","last_unstale":"2024-04-18T05:01:07.364940+0000","last_undegraded":"2024-04-18T05:01:07.364940+0000","last_fullsized":"2024-04-18T05:01:07.364940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:48:04.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21979,"num_write":411,"num_write_kb":59643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"23'407","reported_seq":466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.370476+0000","last_change":"2024-04-18T04:54:41.200802+0000","last_active":"2024-04-18T05:01:07.370476+0000","last_peered":"2024-04-18T05:01:07.370476+0000","last_clean":"2024-04-18T05:01:07.370476+0000","last_became_active":"2024-04-18T04:54:41.198404+0000","last_became_peered":"2024-04-18T04:54:41.198404+0000","last_unstale":"2024-04-18T05:01:07.370476+0000","last_undegraded":"2024-04-18T05:01:07.370476+0000","last_fullsized":"2024-04-18T05:01:07.370476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:56.686481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22314,"num_write":375,"num_write_kb":43056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"23'414","reported_seq":469,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.382501+0000","last_change":"2024-04-18T04:54:41.189568+0000","last_active":"2024-04-18T05:01:07.382501+0000","last_peered":"2024-04-18T05:01:07.382501+0000","last_clean":"2024-04-18T05:01:07.382501+0000","last_became_active":"2024-04-18T04:54:41.188139+0000","last_became_peered":"2024-04-18T04:54:41.188139+0000","last_unstale":"2024-04-18T05:01:07.382501+0000","last_undegraded":"2024-04-18T05:01:07.382501+0000","last_fullsized":"2024-04-18T05:01:07.382501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21874,"num_write":387,"num_write_kb":84204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"23'431","reported_seq":505,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.375011+0000","last_change":"2024-04-18T04:54:41.197901+0000","last_active":"2024-04-18T05:01:07.375011+0000","last_peered":"2024-04-18T05:01:07.375011+0000","last_clean":"2024-04-18T05:01:07.375011+0000","last_became_active":"2024-04-18T04:54:41.197235+0000","last_became_peered":"2024-04-18T04:54:41.197235+0000","last_unstale":"2024-04-18T05:01:07.375011+0000","last_undegraded":"2024-04-18T05:01:07.375011+0000","last_fullsized":"2024-04-18T05:01:07.375011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:41:20.213202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40070,"num_write":398,"num_write_kb":116642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"23'437","reported_seq":508,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377558+0000","last_change":"2024-04-18T04:54:41.188440+0000","last_active":"2024-04-18T05:01:07.377558+0000","last_peered":"2024-04-18T05:01:07.377558+0000","last_clean":"2024-04-18T05:01:07.377558+0000","last_became_active":"2024-04-18T04:54:41.187925+0000","last_became_peered":"2024-04-18T04:54:41.187925+0000","last_unstale":"2024-04-18T05:01:07.377558+0000","last_undegraded":"2024-04-18T05:01:07.377558+0000","last_fullsized":"2024-04-18T05:01:07.377558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27418,"num_write":411,"num_write_kb":67043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"23'413","reported_seq":489,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.383192+0000","last_change":"2024-04-18T04:54:41.179672+0000","last_active":"2024-04-18T05:01:07.383192+0000","last_peered":"2024-04-18T05:01:07.383192+0000","last_clean":"2024-04-18T05:01:07.383192+0000","last_became_active":"2024-04-18T04:54:41.178963+0000","last_became_peered":"2024-04-18T04:54:41.178963+0000","last_unstale":"2024-04-18T05:01:07.383192+0000","last_undegraded":"2024-04-18T05:01:07.383192+0000","last_fullsized":"2024-04-18T05:01:07.383192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32437,"num_write":394,"num_write_kb":88243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"23'442","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.366521+0000","last_change":"2024-04-18T04:54:41.182902+0000","last_active":"2024-04-18T05:01:07.366521+0000","last_peered":"2024-04-18T05:01:07.366521+0000","last_clean":"2024-04-18T05:01:07.366521+0000","last_became_active":"2024-04-18T04:54:41.182664+0000","last_became_peered":"2024-04-18T04:54:41.182664+0000","last_unstale":"2024-04-18T05:01:07.366521+0000","last_undegraded":"2024-04-18T05:01:07.366521+0000","last_fullsized":"2024-04-18T05:01:07.366521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:56.408926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34086,"num_write":411,"num_write_kb":96499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"23'434","reported_seq":502,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.406363+0000","last_change":"2024-04-18T04:54:41.187578+0000","last_active":"2024-04-18T05:01:07.406363+0000","last_peered":"2024-04-18T05:01:07.406363+0000","last_clean":"2024-04-18T05:01:07.406363+0000","last_became_active":"2024-04-18T04:54:41.186881+0000","last_became_peered":"2024-04-18T04:54:41.186881+0000","last_unstale":"2024-04-18T05:01:07.406363+0000","last_undegraded":"2024-04-18T05:01:07.406363+0000","last_fullsized":"2024-04-18T05:01:07.406363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:27.817916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":24295,"num_write":395,"num_write_kb":96064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"23'465","reported_seq":583,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.408187+0000","last_change":"2024-04-18T04:54:41.193206+0000","last_active":"2024-04-18T05:01:07.408187+0000","last_peered":"2024-04-18T05:01:07.408187+0000","last_clean":"2024-04-18T05:01:07.408187+0000","last_became_active":"2024-04-18T04:54:41.192740+0000","last_became_peered":"2024-04-18T04:54:41.192740+0000","last_unstale":"2024-04-18T05:01:07.408187+0000","last_undegraded":"2024-04-18T05:01:07.408187+0000","last_fullsized":"2024-04-18T05:01:07.408187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:51:34.311826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61562,"num_write":441,"num_write_kb":100539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"23'390","reported_seq":439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.411921+0000","last_change":"2024-04-18T04:54:41.192785+0000","last_active":"2024-04-18T05:01:07.411921+0000","last_peered":"2024-04-18T05:01:07.411921+0000","last_clean":"2024-04-18T05:01:07.411921+0000","last_became_active":"2024-04-18T04:54:41.192280+0000","last_became_peered":"2024-04-18T04:54:41.192280+0000","last_unstale":"2024-04-18T05:01:07.411921+0000","last_undegraded":"2024-04-18T05:01:07.411921+0000","last_fullsized":"2024-04-18T05:01:07.411921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:01.677816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18903,"num_write":377,"num_write_kb":34298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"23'490","reported_seq":560,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:13.643675+0000","last_change":"2024-04-18T04:54:41.193920+0000","last_active":"2024-04-18T05:01:13.643675+0000","last_peered":"2024-04-18T05:01:13.643675+0000","last_clean":"2024-04-18T05:01:13.643675+0000","last_became_active":"2024-04-18T04:54:41.193660+0000","last_became_peered":"2024-04-18T04:54:41.193660+0000","last_unstale":"2024-04-18T05:01:13.643675+0000","last_undegraded":"2024-04-18T05:01:13.643675+0000","last_fullsized":"2024-04-18T05:01:13.643675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26760,"num_write":458,"num_write_kb":125465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"23'432","reported_seq":526,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394400+0000","last_change":"2024-04-18T04:54:41.190298+0000","last_active":"2024-04-18T05:01:07.394400+0000","last_peered":"2024-04-18T05:01:07.394400+0000","last_clean":"2024-04-18T05:01:07.394400+0000","last_became_active":"2024-04-18T04:54:41.189374+0000","last_became_peered":"2024-04-18T04:54:41.189374+0000","last_unstale":"2024-04-18T05:01:07.394400+0000","last_undegraded":"2024-04-18T05:01:07.394400+0000","last_fullsized":"2024-04-18T05:01:07.394400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43719,"num_write":406,"num_write_kb":145399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"23'384","reported_seq":438,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.395091+0000","last_change":"2024-04-18T04:54:41.190403+0000","last_active":"2024-04-18T05:01:07.395091+0000","last_peered":"2024-04-18T05:01:07.395091+0000","last_clean":"2024-04-18T05:01:07.395091+0000","last_became_active":"2024-04-18T04:54:41.189660+0000","last_became_peered":"2024-04-18T04:54:41.189660+0000","last_unstale":"2024-04-18T05:01:07.395091+0000","last_undegraded":"2024-04-18T05:01:07.395091+0000","last_fullsized":"2024-04-18T05:01:07.395091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:34.259279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17737,"num_write":357,"num_write_kb":75727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"23'427","reported_seq":500,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.399293+0000","last_change":"2024-04-18T04:54:41.187370+0000","last_active":"2024-04-18T05:01:07.399293+0000","last_peered":"2024-04-18T05:01:07.399293+0000","last_clean":"2024-04-18T05:01:07.399293+0000","last_became_active":"2024-04-18T04:54:41.186901+0000","last_became_peered":"2024-04-18T04:54:41.186901+0000","last_unstale":"2024-04-18T05:01:07.399293+0000","last_undegraded":"2024-04-18T05:01:07.399293+0000","last_fullsized":"2024-04-18T05:01:07.399293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30499,"num_write":394,"num_write_kb":84601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"23'468","reported_seq":510,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.402883+0000","last_change":"2024-04-18T04:54:41.192719+0000","last_active":"2024-04-18T05:01:07.402883+0000","last_peered":"2024-04-18T05:01:07.402883+0000","last_clean":"2024-04-18T05:01:07.402883+0000","last_became_active":"2024-04-18T04:54:41.192114+0000","last_became_peered":"2024-04-18T04:54:41.192114+0000","last_unstale":"2024-04-18T05:01:07.402883+0000","last_undegraded":"2024-04-18T05:01:07.402883+0000","last_fullsized":"2024-04-18T05:01:07.402883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:33:21.965783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13784,"num_write":434,"num_write_kb":79847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"23'421","reported_seq":471,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.379914+0000","last_change":"2024-04-18T04:54:41.186276+0000","last_active":"2024-04-18T05:01:07.379914+0000","last_peered":"2024-04-18T05:01:07.379914+0000","last_clean":"2024-04-18T05:01:07.379914+0000","last_became_active":"2024-04-18T04:54:41.185915+0000","last_became_peered":"2024-04-18T04:54:41.185915+0000","last_unstale":"2024-04-18T05:01:07.379914+0000","last_undegraded":"2024-04-18T05:01:07.379914+0000","last_fullsized":"2024-04-18T05:01:07.379914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":22283,"num_write":389,"num_write_kb":42482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"23'415","reported_seq":486,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.395134+0000","last_change":"2024-04-18T04:54:41.190283+0000","last_active":"2024-04-18T05:01:07.395134+0000","last_peered":"2024-04-18T05:01:07.395134+0000","last_clean":"2024-04-18T05:01:07.395134+0000","last_became_active":"2024-04-18T04:54:41.189892+0000","last_became_peered":"2024-04-18T04:54:41.189892+0000","last_unstale":"2024-04-18T05:01:07.395134+0000","last_undegraded":"2024-04-18T05:01:07.395134+0000","last_fullsized":"2024-04-18T05:01:07.395134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36029,"num_write":387,"num_write_kb":59223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'420","reported_seq":479,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.410442+0000","last_change":"2024-04-18T04:54:41.187326+0000","last_active":"2024-04-18T05:01:07.410442+0000","last_peered":"2024-04-18T05:01:07.410442+0000","last_clean":"2024-04-18T05:01:07.410442+0000","last_became_active":"2024-04-18T04:54:41.187001+0000","last_became_peered":"2024-04-18T04:54:41.187001+0000","last_unstale":"2024-04-18T05:01:07.410442+0000","last_undegraded":"2024-04-18T05:01:07.410442+0000","last_fullsized":"2024-04-18T05:01:07.410442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:57.854812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19127,"num_write":391,"num_write_kb":83892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'97","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.985326+0000","last_change":"2024-04-18T04:54:40.824658+0000","last_active":"2024-04-18T05:00:02.985326+0000","last_peered":"2024-04-18T05:00:02.985326+0000","last_clean":"2024-04-18T05:00:02.985326+0000","last_became_active":"2024-04-18T04:54:40.823652+0000","last_became_peered":"2024-04-18T04:54:40.823652+0000","last_unstale":"2024-04-18T05:00:02.985326+0000","last_undegraded":"2024-04-18T05:00:02.985326+0000","last_fullsized":"2024-04-18T05:00:02.985326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195462,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"23'366","reported_seq":403,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.383027+0000","last_change":"2024-04-18T04:55:39.828560+0000","last_active":"2024-04-18T05:01:07.383027+0000","last_peered":"2024-04-18T05:01:07.383027+0000","last_clean":"2024-04-18T05:01:07.383027+0000","last_became_active":"2024-04-18T04:55:39.827671+0000","last_became_peered":"2024-04-18T04:55:39.827671+0000","last_unstale":"2024-04-18T05:01:07.383027+0000","last_undegraded":"2024-04-18T05:01:07.383027+0000","last_fullsized":"2024-04-18T05:01:07.383027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13158,"num_write":336,"num_write_kb":38014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'539","reported_seq":553,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:00.987547+0000","last_change":"2024-04-18T04:54:40.803244+0000","last_active":"2024-04-18T05:00:00.987547+0000","last_peered":"2024-04-18T05:00:00.987547+0000","last_clean":"2024-04-18T05:00:00.987547+0000","last_became_active":"2024-04-18T04:54:40.802672+0000","last_became_peered":"2024-04-18T04:54:40.802672+0000","last_unstale":"2024-04-18T05:00:00.987547+0000","last_undegraded":"2024-04-18T05:00:00.987547+0000","last_fullsized":"2024-04-18T05:00:00.987547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:27:56.851301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":487,"num_write_kb":12578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'415","reported_seq":430,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.042647+0000","last_change":"2024-04-18T04:54:40.823675+0000","last_active":"2024-04-18T05:00:02.042647+0000","last_peered":"2024-04-18T05:00:02.042647+0000","last_clean":"2024-04-18T05:00:02.042647+0000","last_became_active":"2024-04-18T04:54:40.823091+0000","last_became_peered":"2024-04-18T04:54:40.823091+0000","last_unstale":"2024-04-18T05:00:02.042647+0000","last_undegraded":"2024-04-18T05:00:02.042647+0000","last_fullsized":"2024-04-18T05:00:02.042647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":4340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"23'429","reported_seq":457,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.413269+0000","last_change":"2024-04-18T04:54:41.200326+0000","last_active":"2024-04-18T05:01:07.413269+0000","last_peered":"2024-04-18T05:01:07.413269+0000","last_clean":"2024-04-18T05:01:07.413269+0000","last_became_active":"2024-04-18T04:54:41.199690+0000","last_became_peered":"2024-04-18T04:54:41.199690+0000","last_unstale":"2024-04-18T05:01:07.413269+0000","last_undegraded":"2024-04-18T05:01:07.413269+0000","last_fullsized":"2024-04-18T05:01:07.413269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5535,"num_write":391,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'954","reported_seq":968,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.039751+0000","last_change":"2024-04-18T04:54:40.805264+0000","last_active":"2024-04-18T05:00:02.039751+0000","last_peered":"2024-04-18T05:00:02.039751+0000","last_clean":"2024-04-18T05:00:02.039751+0000","last_became_active":"2024-04-18T04:54:40.804605+0000","last_became_peered":"2024-04-18T04:54:40.804605+0000","last_unstale":"2024-04-18T05:00:02.039751+0000","last_undegraded":"2024-04-18T05:00:02.039751+0000","last_fullsized":"2024-04-18T05:00:02.039751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:48.991270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"23'422","reported_seq":470,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.372744+0000","last_change":"2024-04-18T04:54:41.175359+0000","last_active":"2024-04-18T05:01:07.372744+0000","last_peered":"2024-04-18T05:01:07.372744+0000","last_clean":"2024-04-18T05:01:07.372744+0000","last_became_active":"2024-04-18T04:54:41.175137+0000","last_became_peered":"2024-04-18T04:54:41.175137+0000","last_unstale":"2024-04-18T05:01:07.372744+0000","last_undegraded":"2024-04-18T05:01:07.372744+0000","last_fullsized":"2024-04-18T05:01:07.372744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21971,"num_write":395,"num_write_kb":63063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'67","reported_seq":82,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.319843+0000","last_change":"2024-04-18T04:54:40.798936+0000","last_active":"2024-04-18T05:01:07.319843+0000","last_peered":"2024-04-18T05:01:07.319843+0000","last_clean":"2024-04-18T05:01:07.319843+0000","last_became_active":"2024-04-18T04:54:40.798572+0000","last_became_peered":"2024-04-18T04:54:40.798572+0000","last_unstale":"2024-04-18T05:01:07.319843+0000","last_undegraded":"2024-04-18T05:01:07.319843+0000","last_fullsized":"2024-04-18T05:01:07.319843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'432","reported_seq":485,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.382140+0000","last_change":"2024-04-18T04:54:41.188280+0000","last_active":"2024-04-18T05:01:07.382140+0000","last_peered":"2024-04-18T05:01:07.382140+0000","last_clean":"2024-04-18T05:01:07.382140+0000","last_became_active":"2024-04-18T04:54:41.188012+0000","last_became_peered":"2024-04-18T04:54:41.188012+0000","last_unstale":"2024-04-18T05:01:07.382140+0000","last_undegraded":"2024-04-18T05:01:07.382140+0000","last_fullsized":"2024-04-18T05:01:07.382140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13773,"num_write":397,"num_write_kb":43173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'334","reported_seq":349,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.019065+0000","last_change":"2024-04-18T04:54:40.802894+0000","last_active":"2024-04-18T05:00:05.019065+0000","last_peered":"2024-04-18T05:00:05.019065+0000","last_clean":"2024-04-18T05:00:05.019065+0000","last_became_active":"2024-04-18T04:54:40.801406+0000","last_became_peered":"2024-04-18T04:54:40.801406+0000","last_unstale":"2024-04-18T05:00:05.019065+0000","last_undegraded":"2024-04-18T05:00:05.019065+0000","last_fullsized":"2024-04-18T05:00:05.019065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"23'397","reported_seq":432,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.409498+0000","last_change":"2024-04-18T04:54:41.203407+0000","last_active":"2024-04-18T05:01:07.409498+0000","last_peered":"2024-04-18T05:01:07.409498+0000","last_clean":"2024-04-18T05:01:07.409498+0000","last_became_active":"2024-04-18T04:54:41.203186+0000","last_became_peered":"2024-04-18T04:54:41.203186+0000","last_unstale":"2024-04-18T05:01:07.409498+0000","last_undegraded":"2024-04-18T05:01:07.409498+0000","last_fullsized":"2024-04-18T05:01:07.409498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:23:50.107054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14488,"num_write":364,"num_write_kb":75349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'188","reported_seq":203,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.064184+0000","last_change":"2024-04-18T04:54:40.822014+0000","last_active":"2024-04-18T05:00:06.064184+0000","last_peered":"2024-04-18T05:00:06.064184+0000","last_clean":"2024-04-18T05:00:06.064184+0000","last_became_active":"2024-04-18T04:54:40.820920+0000","last_became_peered":"2024-04-18T04:54:40.820920+0000","last_unstale":"2024-04-18T05:00:06.064184+0000","last_undegraded":"2024-04-18T05:00:06.064184+0000","last_fullsized":"2024-04-18T05:00:06.064184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"23'394","reported_seq":443,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.365245+0000","last_change":"2024-04-18T04:54:41.197254+0000","last_active":"2024-04-18T05:01:07.365245+0000","last_peered":"2024-04-18T05:01:07.365245+0000","last_clean":"2024-04-18T05:01:07.365245+0000","last_became_active":"2024-04-18T04:54:41.196927+0000","last_became_peered":"2024-04-18T04:54:41.196927+0000","last_unstale":"2024-04-18T05:01:07.365245+0000","last_undegraded":"2024-04-18T05:01:07.365245+0000","last_fullsized":"2024-04-18T05:01:07.365245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:01:45.182766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21129,"num_write":360,"num_write_kb":71528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'450","reported_seq":477,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:18.091515+0000","last_change":"2024-04-18T05:01:18.091612+0000","last_active":"2024-04-18T05:01:18.091515+0000","last_peered":"2024-04-18T05:01:18.091515+0000","last_clean":"2024-04-18T05:01:18.091515+0000","last_became_active":"2024-04-18T04:54:40.801403+0000","last_became_peered":"2024-04-18T04:54:40.801403+0000","last_unstale":"2024-04-18T05:01:18.091515+0000","last_undegraded":"2024-04-18T05:01:18.091515+0000","last_fullsized":"2024-04-18T05:01:18.091515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'450","last_scrub_stamp":"2024-04-18T05:01:18.091496+0000","last_deep_scrub":"23'450","last_deep_scrub_stamp":"2024-04-18T05:01:18.091496+0000","last_clean_scrub_stamp":"2024-04-18T05:01:18.091496+0000","objects_scrubbed":8,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:59:33.756145+0000","scrub_duration":0.055952107000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12011434,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":11980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'396","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394971+0000","last_change":"2024-04-18T04:54:41.195518+0000","last_active":"2024-04-18T05:01:07.394971+0000","last_peered":"2024-04-18T05:01:07.394971+0000","last_clean":"2024-04-18T05:01:07.394971+0000","last_became_active":"2024-04-18T04:54:41.195172+0000","last_became_peered":"2024-04-18T04:54:41.195172+0000","last_unstale":"2024-04-18T05:01:07.394971+0000","last_undegraded":"2024-04-18T05:01:07.394971+0000","last_fullsized":"2024-04-18T05:01:07.394971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19873,"num_write":365,"num_write_kb":71837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'583","reported_seq":598,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T04:59:57.951802+0000","last_change":"2024-04-18T04:54:40.818390+0000","last_active":"2024-04-18T04:59:57.951802+0000","last_peered":"2024-04-18T04:59:57.951802+0000","last_clean":"2024-04-18T04:59:57.951802+0000","last_became_active":"2024-04-18T04:54:40.817681+0000","last_became_peered":"2024-04-18T04:54:40.817681+0000","last_unstale":"2024-04-18T04:59:57.951802+0000","last_undegraded":"2024-04-18T04:59:57.951802+0000","last_fullsized":"2024-04-18T04:59:57.951802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"23'417","reported_seq":443,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.392565+0000","last_change":"2024-04-18T04:54:41.194807+0000","last_active":"2024-04-18T05:01:07.392565+0000","last_peered":"2024-04-18T05:01:07.392565+0000","last_clean":"2024-04-18T05:01:07.392565+0000","last_became_active":"2024-04-18T04:54:41.194499+0000","last_became_peered":"2024-04-18T04:54:41.194499+0000","last_unstale":"2024-04-18T05:01:07.392565+0000","last_undegraded":"2024-04-18T05:01:07.392565+0000","last_fullsized":"2024-04-18T05:01:07.392565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:21:49.994781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":380,"num_write_kb":59449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"23'70","reported_seq":84,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.004709+0000","last_change":"2024-04-18T04:54:40.817631+0000","last_active":"2024-04-18T05:00:06.004709+0000","last_peered":"2024-04-18T05:00:06.004709+0000","last_clean":"2024-04-18T05:00:06.004709+0000","last_became_active":"2024-04-18T04:54:40.817370+0000","last_became_peered":"2024-04-18T04:54:40.817370+0000","last_unstale":"2024-04-18T05:00:06.004709+0000","last_undegraded":"2024-04-18T05:00:06.004709+0000","last_fullsized":"2024-04-18T05:00:06.004709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:56:05.832071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'400","reported_seq":472,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377439+0000","last_change":"2024-04-18T04:54:41.193363+0000","last_active":"2024-04-18T05:01:07.377439+0000","last_peered":"2024-04-18T05:01:07.377439+0000","last_clean":"2024-04-18T05:01:07.377439+0000","last_became_active":"2024-04-18T04:54:41.192889+0000","last_became_peered":"2024-04-18T04:54:41.192889+0000","last_unstale":"2024-04-18T05:01:07.377439+0000","last_undegraded":"2024-04-18T05:01:07.377439+0000","last_fullsized":"2024-04-18T05:01:07.377439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30891,"num_write":363,"num_write_kb":81664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"23'67","reported_seq":82,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.985062+0000","last_change":"2024-04-18T04:54:40.806633+0000","last_active":"2024-04-18T05:00:03.985062+0000","last_peered":"2024-04-18T05:00:03.985062+0000","last_clean":"2024-04-18T05:00:03.985062+0000","last_became_active":"2024-04-18T04:54:40.805965+0000","last_became_peered":"2024-04-18T04:54:40.805965+0000","last_unstale":"2024-04-18T05:00:03.985062+0000","last_undegraded":"2024-04-18T05:00:03.985062+0000","last_fullsized":"2024-04-18T05:00:03.985062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1124,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'449","reported_seq":495,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.410877+0000","last_change":"2024-04-18T04:54:41.184321+0000","last_active":"2024-04-18T05:01:07.410877+0000","last_peered":"2024-04-18T05:01:07.410877+0000","last_clean":"2024-04-18T05:01:07.410877+0000","last_became_active":"2024-04-18T04:54:41.183838+0000","last_became_peered":"2024-04-18T04:54:41.183838+0000","last_unstale":"2024-04-18T05:01:07.410877+0000","last_undegraded":"2024-04-18T05:01:07.410877+0000","last_fullsized":"2024-04-18T05:01:07.410877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14210,"num_write":423,"num_write_kb":80124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'80","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:10.004468+0000","last_change":"2024-04-18T04:54:40.818954+0000","last_active":"2024-04-18T05:00:10.004468+0000","last_peered":"2024-04-18T05:00:10.004468+0000","last_clean":"2024-04-18T05:00:10.004468+0000","last_became_active":"2024-04-18T04:54:40.818227+0000","last_became_peered":"2024-04-18T04:54:40.818227+0000","last_unstale":"2024-04-18T05:00:10.004468+0000","last_undegraded":"2024-04-18T05:00:10.004468+0000","last_fullsized":"2024-04-18T05:00:10.004468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"23'493","reported_seq":553,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.364760+0000","last_change":"2024-04-18T04:54:41.192227+0000","last_active":"2024-04-18T05:01:07.364760+0000","last_peered":"2024-04-18T05:01:07.364760+0000","last_clean":"2024-04-18T05:01:07.364760+0000","last_became_active":"2024-04-18T04:54:41.187002+0000","last_became_peered":"2024-04-18T04:54:41.187002+0000","last_unstale":"2024-04-18T05:01:07.364760+0000","last_undegraded":"2024-04-18T05:01:07.364760+0000","last_fullsized":"2024-04-18T05:01:07.364760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":24156,"num_write":458,"num_write_kb":105037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'199","reported_seq":214,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.106627+0000","last_change":"2024-04-18T04:54:40.805795+0000","last_active":"2024-04-18T05:00:05.106627+0000","last_peered":"2024-04-18T05:00:05.106627+0000","last_clean":"2024-04-18T05:00:05.106627+0000","last_became_active":"2024-04-18T04:54:40.802550+0000","last_became_peered":"2024-04-18T04:54:40.802550+0000","last_unstale":"2024-04-18T05:00:05.106627+0000","last_undegraded":"2024-04-18T05:00:05.106627+0000","last_fullsized":"2024-04-18T05:00:05.106627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'364","reported_seq":404,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.381674+0000","last_change":"2024-04-18T04:54:41.180426+0000","last_active":"2024-04-18T05:01:07.381674+0000","last_peered":"2024-04-18T05:01:07.381674+0000","last_clean":"2024-04-18T05:01:07.381674+0000","last_became_active":"2024-04-18T04:54:41.179540+0000","last_became_peered":"2024-04-18T04:54:41.179540+0000","last_unstale":"2024-04-18T05:01:07.381674+0000","last_undegraded":"2024-04-18T05:01:07.381674+0000","last_fullsized":"2024-04-18T05:01:07.381674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16384,"num_write":332,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'304","reported_seq":320,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.025091+0000","last_change":"2024-04-18T04:54:40.804284+0000","last_active":"2024-04-18T05:00:02.025091+0000","last_peered":"2024-04-18T05:00:02.025091+0000","last_clean":"2024-04-18T05:00:02.025091+0000","last_became_active":"2024-04-18T04:54:40.803464+0000","last_became_peered":"2024-04-18T04:54:40.803464+0000","last_unstale":"2024-04-18T05:00:02.025091+0000","last_undegraded":"2024-04-18T05:00:02.025091+0000","last_fullsized":"2024-04-18T05:00:02.025091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"23'391","reported_seq":433,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377810+0000","last_change":"2024-04-18T04:54:41.188591+0000","last_active":"2024-04-18T05:01:07.377810+0000","last_peered":"2024-04-18T05:01:07.377810+0000","last_clean":"2024-04-18T05:01:07.377810+0000","last_became_active":"2024-04-18T04:54:41.188152+0000","last_became_peered":"2024-04-18T04:54:41.188152+0000","last_unstale":"2024-04-18T05:01:07.377810+0000","last_undegraded":"2024-04-18T05:01:07.377810+0000","last_fullsized":"2024-04-18T05:01:07.377810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15853,"num_write":356,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'535","reported_seq":549,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.991447+0000","last_change":"2024-04-18T04:54:40.814901+0000","last_active":"2024-04-18T05:00:02.991447+0000","last_peered":"2024-04-18T05:00:02.991447+0000","last_clean":"2024-04-18T05:00:02.991447+0000","last_became_active":"2024-04-18T04:54:40.814207+0000","last_became_peered":"2024-04-18T04:54:40.814207+0000","last_unstale":"2024-04-18T05:00:02.991447+0000","last_undegraded":"2024-04-18T05:00:02.991447+0000","last_fullsized":"2024-04-18T05:00:02.991447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:59.408019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"23'425","reported_seq":468,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.378034+0000","last_change":"2024-04-18T04:54:41.188664+0000","last_active":"2024-04-18T05:01:07.378034+0000","last_peered":"2024-04-18T05:01:07.378034+0000","last_clean":"2024-04-18T05:01:07.378034+0000","last_became_active":"2024-04-18T04:54:41.188249+0000","last_became_peered":"2024-04-18T04:54:41.188249+0000","last_unstale":"2024-04-18T05:01:07.378034+0000","last_undegraded":"2024-04-18T05:01:07.378034+0000","last_fullsized":"2024-04-18T05:01:07.378034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:30.451002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14420,"num_write":396,"num_write_kb":51045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'76","reported_seq":91,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.044489+0000","last_change":"2024-04-18T04:54:40.828447+0000","last_active":"2024-04-18T05:00:05.044489+0000","last_peered":"2024-04-18T05:00:05.044489+0000","last_clean":"2024-04-18T05:00:05.044489+0000","last_became_active":"2024-04-18T04:54:40.823755+0000","last_became_peered":"2024-04-18T04:54:40.823755+0000","last_unstale":"2024-04-18T05:00:05.044489+0000","last_undegraded":"2024-04-18T05:00:05.044489+0000","last_fullsized":"2024-04-18T05:00:05.044489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1706,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'402","reported_seq":434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.371709+0000","last_change":"2024-04-18T04:54:41.186523+0000","last_active":"2024-04-18T05:01:07.371709+0000","last_peered":"2024-04-18T05:01:07.371709+0000","last_clean":"2024-04-18T05:01:07.371709+0000","last_became_active":"2024-04-18T04:54:41.186149+0000","last_became_peered":"2024-04-18T04:54:41.186149+0000","last_unstale":"2024-04-18T05:01:07.371709+0000","last_undegraded":"2024-04-18T05:01:07.371709+0000","last_fullsized":"2024-04-18T05:01:07.371709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:45.063857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7713,"num_write":373,"num_write_kb":46594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T04:58:35.620748+0000","last_change":"2024-04-18T04:54:35.674328+0000","last_active":"2024-04-18T04:58:35.620748+0000","last_peered":"2024-04-18T04:58:35.620748+0000","last_clean":"2024-04-18T04:58:35.620748+0000","last_became_active":"2024-04-18T04:54:35.672457+0000","last_became_peered":"2024-04-18T04:54:35.672457+0000","last_unstale":"2024-04-18T04:58:35.620748+0000","last_undegraded":"2024-04-18T04:58:35.620748+0000","last_fullsized":"2024-04-18T04:58:35.620748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:33.597974+0000","last_clean_scrub_stamp":"2024-04-18T04:54:33.597974+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:02:10.966568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'71","reported_seq":86,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.016000+0000","last_change":"2024-04-18T04:54:40.802422+0000","last_active":"2024-04-18T05:00:06.016000+0000","last_peered":"2024-04-18T05:00:06.016000+0000","last_clean":"2024-04-18T05:00:06.016000+0000","last_became_active":"2024-04-18T04:54:40.801083+0000","last_became_peered":"2024-04-18T04:54:40.801083+0000","last_unstale":"2024-04-18T05:00:06.016000+0000","last_undegraded":"2024-04-18T05:00:06.016000+0000","last_fullsized":"2024-04-18T05:00:06.016000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:16.547523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'362","reported_seq":383,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.383621+0000","last_change":"2024-04-18T04:54:41.174658+0000","last_active":"2024-04-18T05:01:07.383621+0000","last_peered":"2024-04-18T05:01:07.383621+0000","last_clean":"2024-04-18T05:01:07.383621+0000","last_became_active":"2024-04-18T04:54:41.174391+0000","last_became_peered":"2024-04-18T04:54:41.174391+0000","last_unstale":"2024-04-18T05:01:07.383621+0000","last_undegraded":"2024-04-18T05:01:07.383621+0000","last_fullsized":"2024-04-18T05:01:07.383621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1626,"num_write":331,"num_write_kb":26059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'438","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.117713+0000","last_change":"2024-04-18T04:54:40.813770+0000","last_active":"2024-04-18T05:00:05.117713+0000","last_peered":"2024-04-18T05:00:05.117713+0000","last_clean":"2024-04-18T05:00:05.117713+0000","last_became_active":"2024-04-18T04:54:40.813396+0000","last_became_peered":"2024-04-18T04:54:40.813396+0000","last_unstale":"2024-04-18T05:00:05.117713+0000","last_undegraded":"2024-04-18T05:00:05.117713+0000","last_fullsized":"2024-04-18T05:00:05.117713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":379,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'410","reported_seq":523,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394590+0000","last_change":"2024-04-18T04:54:41.195440+0000","last_active":"2024-04-18T05:01:07.394590+0000","last_peered":"2024-04-18T05:01:07.394590+0000","last_clean":"2024-04-18T05:01:07.394590+0000","last_became_active":"2024-04-18T04:54:41.195152+0000","last_became_peered":"2024-04-18T04:54:41.195152+0000","last_unstale":"2024-04-18T05:01:07.394590+0000","last_undegraded":"2024-04-18T05:01:07.394590+0000","last_fullsized":"2024-04-18T05:01:07.394590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":54989,"num_write":377,"num_write_kb":85155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'431","reported_seq":798,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:55.644395+0000","last_change":"2024-04-18T04:54:40.818806+0000","last_active":"2024-04-18T05:00:55.644395+0000","last_peered":"2024-04-18T05:00:55.644395+0000","last_clean":"2024-04-18T05:00:55.644395+0000","last_became_active":"2024-04-18T04:54:40.818113+0000","last_became_peered":"2024-04-18T04:54:40.818113+0000","last_unstale":"2024-04-18T05:00:55.644395+0000","last_undegraded":"2024-04-18T05:00:55.644395+0000","last_fullsized":"2024-04-18T05:00:55.644395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:36:16.237785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1456426,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":351,"num_read_kb":1645,"num_write":371,"num_write_kb":1672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'416","reported_seq":434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.412599+0000","last_change":"2024-04-18T04:54:41.192576+0000","last_active":"2024-04-18T05:01:07.412599+0000","last_peered":"2024-04-18T05:01:07.412599+0000","last_clean":"2024-04-18T05:01:07.412599+0000","last_became_active":"2024-04-18T04:54:41.192187+0000","last_became_peered":"2024-04-18T04:54:41.192187+0000","last_unstale":"2024-04-18T05:01:07.412599+0000","last_undegraded":"2024-04-18T05:01:07.412599+0000","last_fullsized":"2024-04-18T05:01:07.412599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:27:33.761950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":364,"num_write":388,"num_write_kb":58777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'517","reported_seq":532,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.991782+0000","last_change":"2024-04-18T04:54:40.820531+0000","last_active":"2024-04-18T05:00:03.991782+0000","last_peered":"2024-04-18T05:00:03.991782+0000","last_clean":"2024-04-18T05:00:03.991782+0000","last_became_active":"2024-04-18T04:54:40.820025+0000","last_became_peered":"2024-04-18T04:54:40.820025+0000","last_unstale":"2024-04-18T05:00:03.991782+0000","last_undegraded":"2024-04-18T05:00:03.991782+0000","last_fullsized":"2024-04-18T05:00:03.991782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:35.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":8474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'404","reported_seq":452,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374383+0000","last_change":"2024-04-18T04:54:41.186361+0000","last_active":"2024-04-18T05:01:07.374383+0000","last_peered":"2024-04-18T05:01:07.374383+0000","last_clean":"2024-04-18T05:01:07.374383+0000","last_became_active":"2024-04-18T04:54:41.185257+0000","last_became_peered":"2024-04-18T04:54:41.185257+0000","last_unstale":"2024-04-18T05:01:07.374383+0000","last_undegraded":"2024-04-18T05:01:07.374383+0000","last_fullsized":"2024-04-18T05:01:07.374383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:39.149432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14216,"num_write":374,"num_write_kb":63531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'63","reported_seq":78,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.961722+0000","last_change":"2024-04-18T04:54:40.824668+0000","last_active":"2024-04-18T05:00:02.961722+0000","last_peered":"2024-04-18T05:00:02.961722+0000","last_clean":"2024-04-18T05:00:02.961722+0000","last_became_active":"2024-04-18T04:54:40.824206+0000","last_became_peered":"2024-04-18T04:54:40.824206+0000","last_unstale":"2024-04-18T05:00:02.961722+0000","last_undegraded":"2024-04-18T05:00:02.961722+0000","last_fullsized":"2024-04-18T05:00:02.961722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'433","reported_seq":532,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.393817+0000","last_change":"2024-04-18T04:54:41.195487+0000","last_active":"2024-04-18T05:01:07.393817+0000","last_peered":"2024-04-18T05:01:07.393817+0000","last_clean":"2024-04-18T05:01:07.393817+0000","last_became_active":"2024-04-18T04:54:41.195177+0000","last_became_peered":"2024-04-18T04:54:41.195177+0000","last_unstale":"2024-04-18T05:01:07.393817+0000","last_undegraded":"2024-04-18T05:01:07.393817+0000","last_fullsized":"2024-04-18T05:01:07.393817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":41457,"num_write":394,"num_write_kb":79356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'328","reported_seq":343,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.057473+0000","last_change":"2024-04-18T04:54:40.803387+0000","last_active":"2024-04-18T05:00:05.057473+0000","last_peered":"2024-04-18T05:00:05.057473+0000","last_clean":"2024-04-18T05:00:05.057473+0000","last_became_active":"2024-04-18T04:54:40.802902+0000","last_became_peered":"2024-04-18T04:54:40.802902+0000","last_unstale":"2024-04-18T05:00:05.057473+0000","last_undegraded":"2024-04-18T05:00:05.057473+0000","last_fullsized":"2024-04-18T05:00:05.057473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:31.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'423","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.404089+0000","last_change":"2024-04-18T04:54:41.195382+0000","last_active":"2024-04-18T05:01:07.404089+0000","last_peered":"2024-04-18T05:01:07.404089+0000","last_clean":"2024-04-18T05:01:07.404089+0000","last_became_active":"2024-04-18T04:54:41.194965+0000","last_became_peered":"2024-04-18T04:54:41.194965+0000","last_unstale":"2024-04-18T05:01:07.404089+0000","last_undegraded":"2024-04-18T05:01:07.404089+0000","last_fullsized":"2024-04-18T05:01:07.404089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:39:50.932794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32152,"num_write":386,"num_write_kb":121188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'116","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:13.653815+0000","last_change":"2024-04-18T04:54:40.800651+0000","last_active":"2024-04-18T05:01:13.653815+0000","last_peered":"2024-04-18T05:01:13.653815+0000","last_clean":"2024-04-18T05:01:13.653815+0000","last_became_active":"2024-04-18T04:54:40.798574+0000","last_became_peered":"2024-04-18T04:54:40.798574+0000","last_unstale":"2024-04-18T05:01:13.653815+0000","last_undegraded":"2024-04-18T05:01:13.653815+0000","last_fullsized":"2024-04-18T05:01:13.653815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'326","reported_seq":343,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:13.653842+0000","last_change":"2024-04-18T04:54:41.191679+0000","last_active":"2024-04-18T05:01:13.653842+0000","last_peered":"2024-04-18T05:01:13.653842+0000","last_clean":"2024-04-18T05:01:13.653842+0000","last_became_active":"2024-04-18T04:54:41.191124+0000","last_became_peered":"2024-04-18T04:54:41.191124+0000","last_unstale":"2024-04-18T05:01:13.653842+0000","last_undegraded":"2024-04-18T05:01:13.653842+0000","last_fullsized":"2024-04-18T05:01:13.653842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":298,"num_write_kb":17144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'80","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.999053+0000","last_change":"2024-04-18T04:54:40.804085+0000","last_active":"2024-04-18T05:00:05.999053+0000","last_peered":"2024-04-18T05:00:05.999053+0000","last_clean":"2024-04-18T05:00:05.999053+0000","last_became_active":"2024-04-18T04:54:40.803616+0000","last_became_peered":"2024-04-18T04:54:40.803616+0000","last_unstale":"2024-04-18T05:00:05.999053+0000","last_undegraded":"2024-04-18T05:00:05.999053+0000","last_fullsized":"2024-04-18T05:00:05.999053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:55.405415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'465","reported_seq":513,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:13.653770+0000","last_change":"2024-04-18T04:54:41.185453+0000","last_active":"2024-04-18T05:01:13.653770+0000","last_peered":"2024-04-18T05:01:13.653770+0000","last_clean":"2024-04-18T05:01:13.653770+0000","last_became_active":"2024-04-18T04:54:41.185217+0000","last_became_peered":"2024-04-18T04:54:41.185217+0000","last_unstale":"2024-04-18T05:01:13.653770+0000","last_undegraded":"2024-04-18T05:01:13.653770+0000","last_fullsized":"2024-04-18T05:01:13.653770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8956,"num_write":434,"num_write_kb":97052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'601","reported_seq":617,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.068924+0000","last_change":"2024-04-18T04:54:40.801317+0000","last_active":"2024-04-18T05:00:05.068924+0000","last_peered":"2024-04-18T05:00:05.068924+0000","last_clean":"2024-04-18T05:00:05.068924+0000","last_became_active":"2024-04-18T04:54:40.800598+0000","last_became_peered":"2024-04-18T04:54:40.800598+0000","last_unstale":"2024-04-18T05:00:05.068924+0000","last_undegraded":"2024-04-18T05:00:05.068924+0000","last_fullsized":"2024-04-18T05:00:05.068924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":546,"num_write_kb":4388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'458","reported_seq":504,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.369823+0000","last_change":"2024-04-18T04:54:41.197813+0000","last_active":"2024-04-18T05:01:07.369823+0000","last_peered":"2024-04-18T05:01:07.369823+0000","last_clean":"2024-04-18T05:01:07.369823+0000","last_became_active":"2024-04-18T04:54:41.197201+0000","last_became_peered":"2024-04-18T04:54:41.197201+0000","last_unstale":"2024-04-18T05:01:07.369823+0000","last_undegraded":"2024-04-18T05:01:07.369823+0000","last_fullsized":"2024-04-18T05:01:07.369823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:01.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21429,"num_write":433,"num_write_kb":71833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'55","reported_seq":72,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:13.653701+0000","last_change":"2024-04-18T04:54:40.800416+0000","last_active":"2024-04-18T05:01:13.653701+0000","last_peered":"2024-04-18T05:01:13.653701+0000","last_clean":"2024-04-18T05:01:13.653701+0000","last_became_active":"2024-04-18T04:54:40.797471+0000","last_became_peered":"2024-04-18T04:54:40.797471+0000","last_unstale":"2024-04-18T05:01:13.653701+0000","last_undegraded":"2024-04-18T05:01:13.653701+0000","last_fullsized":"2024-04-18T05:01:13.653701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"23'421","reported_seq":480,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:13.653635+0000","last_change":"2024-04-18T04:54:41.192024+0000","last_active":"2024-04-18T05:01:13.653635+0000","last_peered":"2024-04-18T05:01:13.653635+0000","last_clean":"2024-04-18T05:01:13.653635+0000","last_became_active":"2024-04-18T04:54:41.191488+0000","last_became_peered":"2024-04-18T04:54:41.191488+0000","last_unstale":"2024-04-18T05:01:13.653635+0000","last_undegraded":"2024-04-18T05:01:13.653635+0000","last_fullsized":"2024-04-18T05:01:13.653635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23403,"num_write":390,"num_write_kb":67848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'192","reported_seq":208,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.005322+0000","last_change":"2024-04-18T04:54:40.823863+0000","last_active":"2024-04-18T05:00:03.005322+0000","last_peered":"2024-04-18T05:00:03.005322+0000","last_clean":"2024-04-18T05:00:03.005322+0000","last_became_active":"2024-04-18T04:54:40.823277+0000","last_became_peered":"2024-04-18T04:54:40.823277+0000","last_unstale":"2024-04-18T05:00:03.005322+0000","last_undegraded":"2024-04-18T05:00:03.005322+0000","last_fullsized":"2024-04-18T05:00:03.005322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'448","reported_seq":498,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394105+0000","last_change":"2024-04-18T04:54:41.199981+0000","last_active":"2024-04-18T05:01:07.394105+0000","last_peered":"2024-04-18T05:01:07.394105+0000","last_clean":"2024-04-18T05:01:07.394105+0000","last_became_active":"2024-04-18T04:54:41.199700+0000","last_became_peered":"2024-04-18T04:54:41.199700+0000","last_unstale":"2024-04-18T05:01:07.394105+0000","last_undegraded":"2024-04-18T05:01:07.394105+0000","last_fullsized":"2024-04-18T05:01:07.394105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:36.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":10662,"num_write":420,"num_write_kb":96864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'127","reported_seq":141,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:01.015287+0000","last_change":"2024-04-18T04:54:40.800740+0000","last_active":"2024-04-18T05:00:01.015287+0000","last_peered":"2024-04-18T05:00:01.015287+0000","last_clean":"2024-04-18T05:00:01.015287+0000","last_became_active":"2024-04-18T04:54:40.800405+0000","last_became_peered":"2024-04-18T04:54:40.800405+0000","last_unstale":"2024-04-18T05:00:01.015287+0000","last_undegraded":"2024-04-18T05:00:01.015287+0000","last_fullsized":"2024-04-18T05:00:01.015287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":8237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'441","reported_seq":503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.364099+0000","last_change":"2024-04-18T04:54:41.192487+0000","last_active":"2024-04-18T05:01:07.364099+0000","last_peered":"2024-04-18T05:01:07.364099+0000","last_clean":"2024-04-18T05:01:07.364099+0000","last_became_active":"2024-04-18T04:54:41.186301+0000","last_became_peered":"2024-04-18T04:54:41.186301+0000","last_unstale":"2024-04-18T05:01:07.364099+0000","last_undegraded":"2024-04-18T05:01:07.364099+0000","last_fullsized":"2024-04-18T05:01:07.364099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:30.850431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":27247,"num_write":409,"num_write_kb":76591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"23'382","reported_seq":407,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.378209+0000","last_change":"2024-04-18T04:54:41.193260+0000","last_active":"2024-04-18T05:01:07.378209+0000","last_peered":"2024-04-18T05:01:07.378209+0000","last_clean":"2024-04-18T05:01:07.378209+0000","last_became_active":"2024-04-18T04:54:41.192941+0000","last_became_peered":"2024-04-18T04:54:41.192941+0000","last_unstale":"2024-04-18T05:01:07.378209+0000","last_undegraded":"2024-04-18T05:01:07.378209+0000","last_fullsized":"2024-04-18T05:01:07.378209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:28.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4755,"num_write":342,"num_write_kb":72428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'357","reported_seq":372,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.067828+0000","last_change":"2024-04-18T04:54:40.800162+0000","last_active":"2024-04-18T05:00:05.067828+0000","last_peered":"2024-04-18T05:00:05.067828+0000","last_clean":"2024-04-18T05:00:05.067828+0000","last_became_active":"2024-04-18T04:54:40.799517+0000","last_became_peered":"2024-04-18T04:54:40.799517+0000","last_unstale":"2024-04-18T05:00:05.067828+0000","last_undegraded":"2024-04-18T05:00:05.067828+0000","last_fullsized":"2024-04-18T05:00:05.067828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:09.368943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"23'382","reported_seq":421,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374639+0000","last_change":"2024-04-18T04:54:41.179695+0000","last_active":"2024-04-18T05:01:07.374639+0000","last_peered":"2024-04-18T05:01:07.374639+0000","last_clean":"2024-04-18T05:01:07.374639+0000","last_became_active":"2024-04-18T04:54:41.179359+0000","last_became_peered":"2024-04-18T04:54:41.179359+0000","last_unstale":"2024-04-18T05:01:07.374639+0000","last_undegraded":"2024-04-18T05:01:07.374639+0000","last_fullsized":"2024-04-18T05:01:07.374639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:12.802322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14401,"num_write":356,"num_write_kb":79542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'289","reported_seq":304,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:05.057756+0000","last_change":"2024-04-18T04:54:40.801178+0000","last_active":"2024-04-18T05:00:05.057756+0000","last_peered":"2024-04-18T05:00:05.057756+0000","last_clean":"2024-04-18T05:00:05.057756+0000","last_became_active":"2024-04-18T04:54:40.800660+0000","last_became_peered":"2024-04-18T04:54:40.800660+0000","last_unstale":"2024-04-18T05:00:05.057756+0000","last_undegraded":"2024-04-18T05:00:05.057756+0000","last_fullsized":"2024-04-18T05:00:05.057756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:11.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":12441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'366","reported_seq":409,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.411914+0000","last_change":"2024-04-18T04:54:41.190055+0000","last_active":"2024-04-18T05:01:07.411914+0000","last_peered":"2024-04-18T05:01:07.411914+0000","last_clean":"2024-04-18T05:01:07.411914+0000","last_became_active":"2024-04-18T04:54:41.189344+0000","last_became_peered":"2024-04-18T04:54:41.189344+0000","last_unstale":"2024-04-18T05:01:07.411914+0000","last_undegraded":"2024-04-18T05:01:07.411914+0000","last_fullsized":"2024-04-18T05:01:07.411914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:56.818113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10936,"num_write":342,"num_write_kb":51086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'86","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:03.013938+0000","last_change":"2024-04-18T04:54:40.813931+0000","last_active":"2024-04-18T05:00:03.013938+0000","last_peered":"2024-04-18T05:00:03.013938+0000","last_clean":"2024-04-18T05:00:03.013938+0000","last_became_active":"2024-04-18T04:54:40.813290+0000","last_became_peered":"2024-04-18T04:54:40.813290+0000","last_unstale":"2024-04-18T05:00:03.013938+0000","last_undegraded":"2024-04-18T05:00:03.013938+0000","last_fullsized":"2024-04-18T05:00:03.013938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:51.066393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'407","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.385303+0000","last_change":"2024-04-18T04:54:41.192913+0000","last_active":"2024-04-18T05:01:07.385303+0000","last_peered":"2024-04-18T05:01:07.385303+0000","last_clean":"2024-04-18T05:01:07.385303+0000","last_became_active":"2024-04-18T04:54:41.192096+0000","last_became_peered":"2024-04-18T04:54:41.192096+0000","last_unstale":"2024-04-18T05:01:07.385303+0000","last_undegraded":"2024-04-18T05:01:07.385303+0000","last_fullsized":"2024-04-18T05:01:07.385303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:37:53.082409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17335,"num_write":380,"num_write_kb":68515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'130","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:58.651256+0000","last_change":"2024-04-18T04:54:40.805596+0000","last_active":"2024-04-18T05:00:58.651256+0000","last_peered":"2024-04-18T05:00:58.651256+0000","last_clean":"2024-04-18T05:00:58.651256+0000","last_became_active":"2024-04-18T04:54:40.804913+0000","last_became_peered":"2024-04-18T04:54:40.804913+0000","last_unstale":"2024-04-18T05:00:58.651256+0000","last_undegraded":"2024-04-18T05:00:58.651256+0000","last_fullsized":"2024-04-18T05:00:58.651256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2494,"num_read_kb":1324974,"num_write":24555,"num_write_kb":4507656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26500,"ondisk_log_size":26500,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":130916242,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":351,"num_read_kb":1645,"num_write":7226,"num_write_kb":133419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":100597760,"data_stored":261832484,"data_compressed":36635560,"data_compressed_allocated":47603712,"data_compressed_original":209084416,"omap_allocated":0,"internal_metadata":0},"log_size":8839,"ondisk_log_size":8839,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509523,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":5676,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":5812224,"data_stored":14125282,"data_compressed":1836351,"data_compressed_allocated":2379776,"data_compressed_original":10878976,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77800000000000002,"15min":0.83599999999999997},"min":{"1min":0.40100000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.1639999999999999,"5min":1.1910000000000001,"15min":1.2490000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.79100000000000004,"15min":0.83999999999999997},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1259999999999999,"5min":1.262,"15min":1.262},"last":0.88300000000000001}]},{"osd":1,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0660000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.82899999999999996,"15min":0.84299999999999997},"min":{"1min":0.46500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.226,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.081}]},{"osd":2,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.91600000000000004,"15min":0.89000000000000001},"min":{"1min":0.53700000000000003,"5min":0.438,"15min":0.438},"max":{"1min":1.2270000000000001,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.157},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86899999999999999,"15min":0.86499999999999999},"min":{"1min":0.48299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1890000000000001,"5min":1.379,"15min":1.4019999999999999},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1890000000000001,"5min":1.458,"15min":1.458},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.97899999999999998,"15min":0.95099999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.248,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.83299999999999996}]},{"osd":4,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.91700000000000004,"15min":0.93100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.1479999999999999,"5min":1.605,"15min":1.605},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.91900000000000004,"15min":0.91100000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.175,"5min":1.546,"15min":1.546},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.98799999999999999,"15min":1.018},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2090000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.998,"15min":1.02},"min":{"1min":0.45000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.236,"5min":1.431,"15min":1.5640000000000001},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.0800000000000001,"15min":1.1120000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.28,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.048},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.0609999999999999,"15min":1.048},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.236,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.80900000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509523,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47056,"kb_used_data":7752,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94324784,"statfs":{"total":96636764160,"available":96588578816,"internally_reserved":0,"allocated":7938048,"data_stored":21059926,"data_compressed":3027129,"data_compressed_allocated":3776512,"data_compressed_original":17063936,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.76000000000000001,"15min":0.77600000000000002},"min":{"1min":0.61899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0800000000000001,"5min":1.125,"15min":1.125},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.81299999999999994,"15min":0.85099999999999998},"min":{"1min":0.58599999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0469999999999999,"5min":1.1870000000000001,"15min":1.353},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.84999999999999998,"15min":0.93799999999999994},"min":{"1min":0.68700000000000006,"5min":0.312,"15min":0.312},"max":{"1min":1.1519999999999999,"5min":1.268,"15min":1.8560000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.82099999999999995,"15min":0.85099999999999998},"min":{"1min":0.74099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.038,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.2849999999999999}]},{"osd":2,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.94599999999999995,"15min":0.93600000000000005},"min":{"1min":0.92900000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1919999999999999,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.552},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.66000000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1910000000000001,"5min":1.325,"15min":1.325},"last":1.3220000000000001}]},{"osd":3,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.91600000000000004,"15min":0.90500000000000003},"min":{"1min":0.68200000000000005,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.159,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.3049999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.93899999999999995,"15min":0.98899999999999999},"min":{"1min":0.80800000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1699999999999999,"5min":1.617,"15min":1.617},"last":1.4510000000000001}]},{"osd":4,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.88900000000000001,"15min":0.97899999999999998},"min":{"1min":0.64600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2789999999999999,"5min":1.4990000000000001,"15min":1.631},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97699999999999998,"15min":1.0589999999999999},"min":{"1min":0.71399999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.145,"5min":1.631,"15min":1.631},"last":0.89000000000000001}]},{"osd":5,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.98799999999999999,"15min":1.008},"min":{"1min":0.77300000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.3320000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.0189999999999999,"15min":1.0449999999999999},"min":{"1min":0.73499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.163,"5min":1.673,"15min":1.6739999999999999},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0509999999999999,"15min":1.107},"min":{"1min":0.69799999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.248,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.0860000000000001,"15min":1.1120000000000001},"min":{"1min":0.78600000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2649999999999999,"5min":1.73,"15min":1.7769999999999999},"last":1.1579999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509522,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66536,"kb_used_data":13280,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94305304,"statfs":{"total":96636764160,"available":96568631296,"internally_reserved":0,"allocated":13598720,"data_stored":35687478,"data_compressed":4904028,"data_compressed_allocated":6356992,"data_compressed_original":28622848,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.76100000000000001,"15min":0.89100000000000001},"min":{"1min":0.57499999999999996,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1499999999999999,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.79000000000000004,"15min":0.82599999999999996},"min":{"1min":0.60599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.3340000000000001,"5min":1.542,"15min":1.542},"last":0.89000000000000001}]},{"osd":1,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.91200000000000003,"15min":0.91800000000000004},"min":{"1min":0.58799999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.24,"5min":9.8819999999999997,"15min":9.8819999999999997},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.006,"5min":0.89100000000000001,"15min":0.92700000000000005},"min":{"1min":0.626,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.355,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.88400000000000001,"15min":0.89000000000000001},"min":{"1min":0.60899999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.177,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.97399999999999998,"15min":0.94799999999999995},"min":{"1min":0.68200000000000005,"5min":0.38,"15min":0.38},"max":{"1min":1.214,"5min":10.031000000000001,"15min":10.031000000000001},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.91700000000000004,"15min":0.95999999999999996},"min":{"1min":0.72899999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.284,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.97599999999999998,"15min":1.014},"min":{"1min":0.72799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2789999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.006,"15min":0.91900000000000004},"min":{"1min":0.63700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.3759999999999999,"5min":9.968,"15min":9.968},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.96899999999999997,"15min":1.02},"min":{"1min":0.624,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.399,"5min":1.631,"15min":1.8440000000000001},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.006,"15min":0.96099999999999997},"min":{"1min":0.60899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4159999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.1020000000000001,"15min":1.036},"min":{"1min":0.752,"5min":0.371,"15min":0.371},"max":{"1min":1.4550000000000001,"5min":10.09,"15min":10.09},"last":1}]},{"osd":7,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0629999999999999,"15min":1.103},"min":{"1min":0.77800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.528,"5min":1.7050000000000001,"15min":1.944},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.129,"15min":1.151},"min":{"1min":0.72199999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.7070000000000001,"5min":1.97,"15min":1.97},"last":1.0740000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509523,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77376,"kb_used_data":20024,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94294464,"statfs":{"total":96636764160,"available":96557531136,"internally_reserved":0,"allocated":20504576,"data_stored":54614164,"data_compressed":7702565,"data_compressed_allocated":9973760,"data_compressed_original":44273664,"omap_allocated":1592,"internal_metadata":58718664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.628,"15min":0.67400000000000004},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.98099999999999998,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63100000000000001,"15min":0.61699999999999999},"min":{"1min":0.29499999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.91000000000000003,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61899999999999999,"15min":0.63500000000000001},"min":{"1min":0.31900000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.0920000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73699999999999999,"15min":0.69699999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.0720000000000001,"5min":2.601,"15min":2.601},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.73099999999999998,"15min":0.73399999999999999},"min":{"1min":0.34399999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.359,"5min":1.573,"15min":1.573},"last":0.749},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1339999999999999,"5min":1.51,"15min":1.51},"last":1.1000000000000001}]},{"osd":4,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.86399999999999999,"15min":0.85799999999999998},"min":{"1min":0.46600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.202,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.91400000000000003,"15min":0.93600000000000005},"min":{"1min":0.59399999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4199999999999999,"5min":1.524,"15min":1.524},"last":1.0249999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.61499999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.252,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.008,"15min":1.028},"min":{"1min":0.47899999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.292,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.1739999999999999}]},{"osd":6,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.98299999999999998,"15min":0.97199999999999998},"min":{"1min":0.72599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.282,"5min":1.512,"15min":1.512},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.02,"15min":1.0489999999999999},"min":{"1min":0.72699999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.327,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.88700000000000001}]},{"osd":7,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0600000000000001,"15min":1.1100000000000001},"min":{"1min":0.66700000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.371,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1.22},{"interface":"front","average":{"1min":1.046,"5min":1.0289999999999999,"15min":1.0580000000000001},"min":{"1min":0.60799999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.341,"5min":1.583,"15min":1.583},"last":1.149}]}]},{"osd":1,"up_from":15,"seq":64424509522,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59832,"kb_used_data":14768,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94312008,"statfs":{"total":96636764160,"available":96575496192,"internally_reserved":0,"allocated":15122432,"data_stored":34231216,"data_compressed":4539223,"data_compressed_allocated":6156288,"data_compressed_original":25436160,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63500000000000001,"15min":0.59099999999999997},"min":{"1min":0.38300000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.98699999999999999,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.73999999999999999},"min":{"1min":0.29899999999999999,"5min":0.214,"15min":0.214},"max":{"1min":1.1970000000000001,"5min":1.5920000000000001,"15min":1.9239999999999999},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66400000000000003,"15min":0.68400000000000005},"min":{"1min":0.432,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.88200000000000001,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.696,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.71799999999999997}]},{"osd":3,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.755,"15min":0.78200000000000003},"min":{"1min":0.46800000000000003,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.8400000000000001,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.88,"5min":0.78200000000000003,"15min":0.77700000000000002},"min":{"1min":0.49099999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.7989999999999999,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":0.67900000000000005}]},{"osd":4,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.92800000000000005,"15min":0.94799999999999995},"min":{"1min":0.56000000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.107,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.98499999999999999,"15min":0.98199999999999998},"min":{"1min":0.72299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.786,"5min":2.133,"15min":2.133},"last":0.88400000000000001}]},{"osd":5,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.98099999999999998,"15min":1.0069999999999999},"min":{"1min":0.72399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":1.292,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.98099999999999998,"15min":0.98499999999999999},"min":{"1min":0.626,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.274,"5min":2.347,"15min":2.347},"last":0.90100000000000002}]},{"osd":6,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":0.98799999999999999,"15min":1.02},"min":{"1min":0.65400000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.024,"5min":3.024,"15min":3.024},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.997,"5min":1.0409999999999999,"15min":1.0669999999999999},"min":{"1min":0.67800000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.288,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.014}]},{"osd":7,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0600000000000001,"15min":1.0760000000000001},"min":{"1min":0.80200000000000005,"5min":0.497,"15min":0.497},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0860000000000001,"15min":1.109},"min":{"1min":0.76100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3680000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.94199999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509524,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78896,"kb_used_data":21544,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94292944,"statfs":{"total":96636764160,"available":96555974656,"internally_reserved":0,"allocated":22061056,"data_stored":54614568,"data_compressed":7565653,"data_compressed_allocated":10006528,"data_compressed_original":42741760,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.63400000000000001,"15min":0.58599999999999997},"min":{"1min":0.318,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":2.177,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.623,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.224,"15min":0.224},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69099999999999995,"15min":0.65900000000000003},"min":{"1min":0.433,"5min":0.22,"15min":0.22},"max":{"1min":1.4339999999999999,"5min":2.629,"15min":2.629},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.67500000000000004,"15min":0.64500000000000002},"min":{"1min":0.44600000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.79100000000000004}]},{"osd":3,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.70799999999999996,"15min":0.60699999999999998},"min":{"1min":0.38300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.575,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.81399999999999995,"15min":0.749},"min":{"1min":0.39500000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.3690000000000002,"5min":3.375,"15min":3.375},"last":0.70999999999999996}]},{"osd":4,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6859999999999999,"5min":2.601,"15min":2.601},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.05,"5min":0.93899999999999995,"15min":0.92500000000000004},"min":{"1min":0.48699999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.2559999999999998,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.92200000000000004,"15min":0.90500000000000003},"min":{"1min":0.76500000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.95999999999999996,"15min":0.94499999999999995},"min":{"1min":0.73299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.758,"5min":2.734,"15min":2.734},"last":0.99099999999999999}]},{"osd":6,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.016,"15min":0.98499999999999999},"min":{"1min":0.77100000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.3149999999999999,"5min":2.681,"15min":2.681},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.0860000000000001,"5min":0.997,"15min":1.0149999999999999},"min":{"1min":0.81699999999999995,"5min":0.499,"15min":0.499},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.056}]},{"osd":7,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.83199999999999996,"5min":0.496,"15min":0.496},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.03,"15min":0.97399999999999998},"min":{"1min":0.65900000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.831,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":1.0880000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574932,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47916,"kb_used_data":8612,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94323924,"statfs":{"total":96636764160,"available":96587698176,"internally_reserved":0,"allocated":8818688,"data_stored":24681186,"data_compressed":3524620,"data_compressed_allocated":4517888,"data_compressed_original":20582400,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.75,"15min":0.88900000000000001},"min":{"1min":0.48099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.05,"5min":1.1579999999999999,"15min":1.3080000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.74099999999999999,"15min":0.83199999999999996},"min":{"1min":0.57099999999999995,"5min":0.318,"15min":0.318},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81200000000000006,"15min":0.875},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.149,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.80500000000000005,"15min":0.86299999999999999},"min":{"1min":0.50600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.097,"5min":1.246,"15min":1.246},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.57699999999999996,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92800000000000005,"15min":0.96899999999999997},"min":{"1min":0.53600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1379999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.016}]},{"osd":3,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.80600000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.651,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.016,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.68600000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2130000000000001,"5min":3.6280000000000001,"15min":3.6280000000000001},"last":0.94699999999999995}]},{"osd":5,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95199999999999996,"15min":0.93600000000000005},"min":{"1min":0.47899999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":1.008,"15min":1.054},"min":{"1min":0.58999999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.0609999999999999}]},{"osd":6,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.92000000000000004,"15min":1.006},"min":{"1min":0.61599999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.1890000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.0329999999999999,"15min":1.0589999999999999},"min":{"1min":0.56399999999999995,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.5980000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.101,"15min":1.141},"min":{"1min":0.72999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.246,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.107},{"interface":"front","average":{"1min":1.069,"5min":1.1180000000000001,"15min":1.1479999999999999},"min":{"1min":0.63300000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5409999999999999,"5min":3.9910000000000001,"15min":3.9910000000000001},"last":0.92200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574932,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":8536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":8740864,"data_stored":24679416,"data_compressed":3602361,"data_compressed_allocated":4526080,"data_compressed_original":20631552,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.56499999999999995},"min":{"1min":0.42499999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.93799999999999994,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.64400000000000002,"15min":0.69699999999999995},"min":{"1min":0.45200000000000001,"5min":0.193,"15min":0.193},"max":{"1min":1.034,"5min":1.347,"15min":1.347},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67600000000000005,"15min":0.67200000000000004},"min":{"1min":0.53300000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.024,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68000000000000005,"15min":0.66600000000000004},"min":{"1min":0.433,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.022,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.67300000000000004,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1140000000000001,"5min":1.29,"15min":1.29},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.65800000000000003,"15min":0.64200000000000002},"min":{"1min":0.48799999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0149999999999999,"5min":1.034,"15min":1.034},"last":0.498}]},{"osd":4,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.91800000000000004,"15min":0.95299999999999996},"min":{"1min":0.79100000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.1930000000000001,"5min":2.456,"15min":2.456},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.85099999999999998,"15min":0.873},"min":{"1min":0.57099999999999995,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2889999999999999,"5min":1.454,"15min":1.6950000000000001},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.96899999999999997,"15min":0.94399999999999995},"min":{"1min":0.78500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4279999999999999,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.93500000000000005,"15min":0.98699999999999999},"min":{"1min":0.81999999999999995,"5min":0.373,"15min":0.373},"max":{"1min":1.234,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.80500000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3440000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0329999999999999,"15min":0.98099999999999998},"min":{"1min":0.84799999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.506,"5min":3.391,"15min":3.391},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.99099999999999999,"15min":1.0289999999999999},"min":{"1min":0.84999999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.25,"5min":1.4259999999999999,"15min":1.4990000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.98899999999999999,"15min":0.97499999999999998},"min":{"1min":0.71199999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.3160000000000001,"5min":1.748,"15min":1.748},"last":0.90700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21827584,"data_stored":54529566,"data_compressed":7565653,"data_compressed_allocated":10006528,"data_compressed_original":42741760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14823424,"data_stored":33555846,"data_compressed":4506038,"data_compressed_allocated":6111232,"data_compressed_original":24862720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8507392,"data_stored":24594414,"data_compressed":3602361,"data_compressed_allocated":4526080,"data_compressed_original":20631552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20271104,"data_stored":54529162,"data_compressed":7702565,"data_compressed_allocated":9973760,"data_compressed_original":44273664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8585216,"data_stored":24596184,"data_compressed":3524620,"data_compressed_allocated":4517888,"data_compressed_original":20582400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13299712,"data_stored":35012108,"data_compressed":4870843,"data_compressed_allocated":6311936,"data_compressed_original":28049408,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7704576,"data_stored":20974924,"data_compressed":3027129,"data_compressed_allocated":3776512,"data_compressed_original":17063936,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5578752,"data_stored":14040280,"data_compressed":1836351,"data_compressed_allocated":2379776,"data_compressed_original":10878976,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T05:01:20.072 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.072 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.072 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.072 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.073 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.073 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.073 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.073 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.073 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.073 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.073 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.073 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.073 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.073 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.074 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.074 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.074 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.074 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.074 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.074 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.074 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.074 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.074 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.075 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.075 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.075 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.075 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.075 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.075 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.075 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.075 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.075 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.075 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.076 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.076 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.076 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.076 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.076 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.076 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.076 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.076 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.076 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.076 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.077 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.077 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.077 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.077 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.077 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.077 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.077 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.077 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.077 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.078 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.078 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.078 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.078 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.078 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.078 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.078 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.078 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.078 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.078 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.079 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.079 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-18T04:54:33.597974+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.079 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.079 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.079 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.079 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.079 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.079 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.079 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.080 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.080 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.080 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.080 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.080 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.080 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.080 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.080 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.080 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.080 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.081 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.081 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.081 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.081 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.081 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.081 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.081 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.081 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.081 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.081 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.082 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.082 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.082 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.082 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.082 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:20.082 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T05:01:40.083 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T05:01:40.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.210+0000 7f7252300640 1 Processor -- start 2024-04-18T05:01:40.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.210+0000 7f7252300640 1 -- start start 2024-04-18T05:01:40.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f7252300640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f724c1532d0 0x7f724c158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:40.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f7252300640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f724c0cacc0 0x7f724c15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:40.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f7252300640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f724c15d3b0 con 0x7f724c0c3fd0 2024-04-18T05:01:40.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f7252300640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f724c0c5970 con 0x7f724c0cacc0 2024-04-18T05:01:40.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f7252300640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724c1594a0 con 0x7f724c1532d0 2024-04-18T05:01:40.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f724b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f724c0cacc0 0x7f724c15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:40.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f725089d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f724c0c3fd0 0x7f724c0ce740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50954/0 (socket says 172.21.15.96:50954) 2024-04-18T05:01:40.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f724b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f724c0cacc0 0x7f724c15ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56084/0 (socket says 172.21.15.96:56084) 2024-04-18T05:01:40.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f725089d640 1 -- 172.21.15.96:0/3763716025 learned_addr learned my addr 172.21.15.96:0/3763716025 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:01:40.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f724bfff640 1 --2- 172.21.15.96:0/3763716025 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f724c1532d0 0x7f724c158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:40.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f724b7fe640 1 -- 172.21.15.96:0/3763716025 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f724c1532d0 msgr2=0x7f724c158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:01:40.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f724b7fe640 1 --2- 172.21.15.96:0/3763716025 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f724c1532d0 0x7f724c158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:40.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f724b7fe640 1 -- 172.21.15.96:0/3763716025 >> v1:172.21.15.96:6789/0 conn(0x7f724c0c3fd0 legacy=0x7f724c0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:40.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f724b7fe640 1 -- 172.21.15.96:0/3763716025 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724c1536b0 con 0x7f724c0cacc0 2024-04-18T05:01:40.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f724b7fe640 1 --2- 172.21.15.96:0/3763716025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c0cacc0 0x7f724c15ce70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f72400097f0 tx=0x7f724001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2640e4424629a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:40.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f724affd640 1 -- 172.21.15.96:0/3763716025 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72400a8990 con 0x7f724c0cacc0 2024-04-18T05:01:40.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f724affd640 1 -- 172.21.15.96:0/3763716025 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72400a8af0 con 0x7f724c0cacc0 2024-04-18T05:01:40.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.214+0000 7f724affd640 1 -- 172.21.15.96:0/3763716025 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72400a8e80 con 0x7f724c0cacc0 2024-04-18T05:01:40.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 -- 172.21.15.96:0/3763716025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c0cacc0 msgr2=0x7f724c15ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:40.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 --2- 172.21.15.96:0/3763716025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c0cacc0 0x7f724c15ce70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f72400097f0 tx=0x7f724001ec90 comp rx=0 tx=0).stop 2024-04-18T05:01:40.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 -- 172.21.15.96:0/3763716025 shutdown_connections 2024-04-18T05:01:40.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 --2- 172.21.15.96:0/3763716025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c0cacc0 0x7f724c15ce70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:40.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 --2- 172.21.15.96:0/3763716025 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f724c1532d0 0x7f724c158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:40.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 -- 172.21.15.96:0/3763716025 >> 172.21.15.96:0/3763716025 conn(0x7f724c071760 msgr2=0x7f724c06b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:40.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 -- 172.21.15.96:0/3763716025 shutdown_connections 2024-04-18T05:01:40.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 -- 172.21.15.96:0/3763716025 wait complete. 2024-04-18T05:01:40.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 Processor -- start 2024-04-18T05:01:40.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 -- start start 2024-04-18T05:01:40.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f724c0c3fd0 0x7f724c1573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:40.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c0cacc0 0x7f724c14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:40.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f724c1532d0 0x7f724c14f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:40.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c159f20 con 0x7f724c0cacc0 2024-04-18T05:01:40.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c14d580 con 0x7f724c0c3fd0 2024-04-18T05:01:40.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724c14ef20 con 0x7f724c1532d0 2024-04-18T05:01:40.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f724b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c0cacc0 0x7f724c14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:40.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f724b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c0cacc0 0x7f724c14f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56096/0 (socket says 172.21.15.96:56096) 2024-04-18T05:01:40.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f724b7fe640 1 -- 172.21.15.96:0/2977818724 learned_addr learned my addr 172.21.15.96:0/2977818724 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:01:40.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f724bfff640 1 --2- 172.21.15.96:0/2977818724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f724c0c3fd0 0x7f724c1573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:40.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f724b7fe640 1 -- 172.21.15.96:0/2977818724 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f724c1532d0 msgr2=0x7f724c14f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:40.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f725089d640 1 --2- 172.21.15.96:0/2977818724 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f724c1532d0 0x7f724c14f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:40.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f724b7fe640 1 --2- 172.21.15.96:0/2977818724 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f724c1532d0 0x7f724c14f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:40.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f724b7fe640 1 -- 172.21.15.96:0/2977818724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f724c0c3fd0 msgr2=0x7f724c1573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:40.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f724b7fe640 1 --2- 172.21.15.96:0/2977818724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f724c0c3fd0 0x7f724c1573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:40.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f724b7fe640 1 -- 172.21.15.96:0/2977818724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7240009420 con 0x7f724c0cacc0 2024-04-18T05:01:40.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f724bfff640 1 --2- 172.21.15.96:0/2977818724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f724c0c3fd0 0x7f724c1573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:01:40.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f724b7fe640 1 --2- 172.21.15.96:0/2977818724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c0cacc0 0x7f724c14f3b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f72400b3040 tx=0x7f724001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:40.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7248ff9640 1 -- 172.21.15.96:0/2977818724 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72400b9630 con 0x7f724c0cacc0 2024-04-18T05:01:40.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7248ff9640 1 -- 172.21.15.96:0/2977818724 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72400b97b0 con 0x7f724c0cacc0 2024-04-18T05:01:40.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 -- 172.21.15.96:0/2977818724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724c0b4770 con 0x7f724c0cacc0 2024-04-18T05:01:40.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7248ff9640 1 -- 172.21.15.96:0/2977818724 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72400b9b60 con 0x7f724c0cacc0 2024-04-18T05:01:40.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.218+0000 7f7252300640 1 -- 172.21.15.96:0/2977818724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724c1591b0 con 0x7f724c0cacc0 2024-04-18T05:01:40.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.222+0000 7f7252300640 1 -- 172.21.15.96:0/2977818724 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f724c159010 con 0x7f724c0cacc0 2024-04-18T05:01:40.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.222+0000 7f7248ff9640 1 -- 172.21.15.96:0/2977818724 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f72400b7040 con 0x7f724c0cacc0 2024-04-18T05:01:40.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.222+0000 7f7248ff9640 1 --2- 172.21.15.96:0/2977818724 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7238066690 0x7f7238068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:01:40.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.222+0000 7f7248ff9640 1 -- 172.21.15.96:0/2977818724 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7240122360 con 0x7f724c0cacc0 2024-04-18T05:01:40.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.222+0000 7f724bfff640 1 --2- 172.21.15.96:0/2977818724 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7238066690 0x7f7238068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:01:40.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.222+0000 7f724bfff640 1 --2- 172.21.15.96:0/2977818724 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7238066690 0x7f7238068b50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f723c0097a0 tx=0x7f723c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:01:40.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.226+0000 7f7248ff9640 1 -- 172.21.15.96:0/2977818724 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f724c159010 con 0x7f724c0cacc0 2024-04-18T05:01:40.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.378+0000 7f7252300640 1 -- 172.21.15.96:0/2977818724 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f724c159c40 con 0x7f7238066690 2024-04-18T05:01:40.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.402+0000 7f7248ff9640 1 -- 172.21.15.96:0/2977818724 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289365 (secure 0 0 0) 0x7f723c009d80 con 0x7f7238066690 2024-04-18T05:01:40.410 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T05:01:40.412 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T05:01:40.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.406+0000 7f7252300640 1 -- 172.21.15.96:0/2977818724 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7238066690 msgr2=0x7f7238068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:40.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.406+0000 7f7252300640 1 --2- 172.21.15.96:0/2977818724 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7238066690 0x7f7238068b50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f723c0097a0 tx=0x7f723c008040 comp rx=0 tx=0).stop 2024-04-18T05:01:40.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.406+0000 7f7252300640 1 -- 172.21.15.96:0/2977818724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c0cacc0 msgr2=0x7f724c14f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:01:40.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.406+0000 7f7252300640 1 --2- 172.21.15.96:0/2977818724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c0cacc0 0x7f724c14f3b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f72400b3040 tx=0x7f724001ba30 comp rx=0 tx=0).stop 2024-04-18T05:01:40.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.406+0000 7f7252300640 1 -- 172.21.15.96:0/2977818724 shutdown_connections 2024-04-18T05:01:40.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.406+0000 7f7252300640 1 --2- 172.21.15.96:0/2977818724 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7238066690 0x7f7238068b50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:40.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.406+0000 7f7252300640 1 --2- 172.21.15.96:0/2977818724 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f724c1532d0 0x7f724c14f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:40.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.406+0000 7f7252300640 1 --2- 172.21.15.96:0/2977818724 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c0cacc0 0x7f724c14f3b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:40.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.406+0000 7f7252300640 1 --2- 172.21.15.96:0/2977818724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f724c0c3fd0 0x7f724c1573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:01:40.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.406+0000 7f7252300640 1 -- 172.21.15.96:0/2977818724 >> 172.21.15.96:0/2977818724 conn(0x7f724c071760 msgr2=0x7f724c152240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:01:40.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.406+0000 7f7252300640 1 -- 172.21.15.96:0/2977818724 shutdown_connections 2024-04-18T05:01:40.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:01:40.406+0000 7f7252300640 1 -- 172.21.15.96:0/2977818724 wait complete. 2024-04-18T05:01:40.427 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2024-04-18T05:01:38.713311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":131506610,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":2961,"num_read_kb":1326719,"num_write":31940,"num_write_kb":4643491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20000,"num_omap_keys":40,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35541,"ondisk_log_size":35541,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":454048,"kb_used_data":100192,"kb_used_omap":12,"kb_used_meta":353779,"kb_avail":754520672,"statfs":{"total":773094113280,"available":772629168128,"internally_reserved":0,"allocated":102596608,"data_stored":263693236,"data_compressed":36701930,"data_compressed_allocated":47693824,"data_compressed_original":210231296,"omap_allocated":12744,"internal_metadata":362270264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004335"},"pg_stats":[{"pgid":"3.3f","version":"23'405","reported_seq":440,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374148+0000","last_change":"2024-04-18T04:54:41.199306+0000","last_active":"2024-04-18T05:01:07.374148+0000","last_peered":"2024-04-18T05:01:07.374148+0000","last_clean":"2024-04-18T05:01:07.374148+0000","last_became_active":"2024-04-18T04:54:41.199046+0000","last_became_peered":"2024-04-18T04:54:41.199046+0000","last_unstale":"2024-04-18T05:01:07.374148+0000","last_undegraded":"2024-04-18T05:01:07.374148+0000","last_fullsized":"2024-04-18T05:01:07.374148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9249,"num_write":376,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"23'459","reported_seq":500,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.407587+0000","last_change":"2024-04-18T04:54:41.200447+0000","last_active":"2024-04-18T05:01:07.407587+0000","last_peered":"2024-04-18T05:01:07.407587+0000","last_clean":"2024-04-18T05:01:07.407587+0000","last_became_active":"2024-04-18T04:54:41.200136+0000","last_became_peered":"2024-04-18T04:54:41.200136+0000","last_unstale":"2024-04-18T05:01:07.407587+0000","last_undegraded":"2024-04-18T05:01:07.407587+0000","last_fullsized":"2024-04-18T05:01:07.407587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12666,"num_write":430,"num_write_kb":97067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"23'410","reported_seq":456,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.396755+0000","last_change":"2024-04-18T04:54:41.185987+0000","last_active":"2024-04-18T05:01:07.396755+0000","last_peered":"2024-04-18T05:01:07.396755+0000","last_clean":"2024-04-18T05:01:07.396755+0000","last_became_active":"2024-04-18T04:54:41.185206+0000","last_became_peered":"2024-04-18T04:54:41.185206+0000","last_unstale":"2024-04-18T05:01:07.396755+0000","last_undegraded":"2024-04-18T05:01:07.396755+0000","last_fullsized":"2024-04-18T05:01:07.396755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":29819,"num_write":382,"num_write_kb":108666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"23'394","reported_seq":463,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:27.079767+0000","last_change":"2024-04-18T05:01:27.079963+0000","last_active":"2024-04-18T05:01:27.079767+0000","last_peered":"2024-04-18T05:01:27.079767+0000","last_clean":"2024-04-18T05:01:27.079767+0000","last_became_active":"2024-04-18T04:54:41.177217+0000","last_became_peered":"2024-04-18T04:54:41.177217+0000","last_unstale":"2024-04-18T05:01:27.079767+0000","last_undegraded":"2024-04-18T05:01:27.079767+0000","last_fullsized":"2024-04-18T05:01:27.079767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'394","last_scrub_stamp":"2024-04-18T05:01:27.079715+0000","last_deep_scrub":"23'394","last_deep_scrub_stamp":"2024-04-18T05:01:27.079715+0000","last_clean_scrub_stamp":"2024-04-18T05:01:27.079715+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:14.174781+0000","scrub_duration":0.0048719330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22571,"num_write":356,"num_write_kb":80073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"23'390","reported_seq":428,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.400122+0000","last_change":"2024-04-18T04:54:41.186573+0000","last_active":"2024-04-18T05:01:07.400122+0000","last_peered":"2024-04-18T05:01:07.400122+0000","last_clean":"2024-04-18T05:01:07.400122+0000","last_became_active":"2024-04-18T04:54:41.186027+0000","last_became_peered":"2024-04-18T04:54:41.186027+0000","last_unstale":"2024-04-18T05:01:07.400122+0000","last_undegraded":"2024-04-18T05:01:07.400122+0000","last_fullsized":"2024-04-18T05:01:07.400122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13089,"num_write":365,"num_write_kb":22615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"23'374","reported_seq":406,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:21.018612+0000","last_change":"2024-04-18T05:01:21.018847+0000","last_active":"2024-04-18T05:01:21.018612+0000","last_peered":"2024-04-18T05:01:21.018612+0000","last_clean":"2024-04-18T05:01:21.018612+0000","last_became_active":"2024-04-18T04:54:41.177215+0000","last_became_peered":"2024-04-18T04:54:41.177215+0000","last_unstale":"2024-04-18T05:01:21.018612+0000","last_undegraded":"2024-04-18T05:01:21.018612+0000","last_fullsized":"2024-04-18T05:01:21.018612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'374","last_scrub_stamp":"2024-04-18T05:01:21.018549+0000","last_deep_scrub":"23'374","last_deep_scrub_stamp":"2024-04-18T05:01:21.018549+0000","last_clean_scrub_stamp":"2024-04-18T05:01:21.018549+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:56:14.121491+0000","scrub_duration":0.0045796960000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":350,"num_write_kb":36922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"23'405","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374556+0000","last_change":"2024-04-18T04:54:41.178605+0000","last_active":"2024-04-18T05:01:07.374556+0000","last_peered":"2024-04-18T05:01:07.374556+0000","last_clean":"2024-04-18T05:01:07.374556+0000","last_became_active":"2024-04-18T04:54:41.178094+0000","last_became_peered":"2024-04-18T04:54:41.178094+0000","last_unstale":"2024-04-18T05:01:07.374556+0000","last_undegraded":"2024-04-18T05:01:07.374556+0000","last_fullsized":"2024-04-18T05:01:07.374556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20531,"num_write":378,"num_write_kb":59118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"23'401","reported_seq":439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.414500+0000","last_change":"2024-04-18T04:54:41.193174+0000","last_active":"2024-04-18T05:01:07.414500+0000","last_peered":"2024-04-18T05:01:07.414500+0000","last_clean":"2024-04-18T05:01:07.414500+0000","last_became_active":"2024-04-18T04:54:41.192678+0000","last_became_peered":"2024-04-18T04:54:41.192678+0000","last_unstale":"2024-04-18T05:01:07.414500+0000","last_undegraded":"2024-04-18T05:01:07.414500+0000","last_fullsized":"2024-04-18T05:01:07.414500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13567,"num_write":364,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"23'436","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:32.714698+0000","last_change":"2024-04-18T05:01:32.714899+0000","last_active":"2024-04-18T05:01:32.714698+0000","last_peered":"2024-04-18T05:01:32.714698+0000","last_clean":"2024-04-18T05:01:32.714698+0000","last_became_active":"2024-04-18T04:54:41.197832+0000","last_became_peered":"2024-04-18T04:54:41.197832+0000","last_unstale":"2024-04-18T05:01:32.714698+0000","last_undegraded":"2024-04-18T05:01:32.714698+0000","last_fullsized":"2024-04-18T05:01:32.714698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'436","last_scrub_stamp":"2024-04-18T05:01:32.714644+0000","last_deep_scrub":"23'436","last_deep_scrub_stamp":"2024-04-18T05:01:32.714644+0000","last_clean_scrub_stamp":"2024-04-18T05:01:32.714644+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:15:48.913743+0000","scrub_duration":0.0041060510000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28521,"num_write":411,"num_write_kb":104022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"23'396","reported_seq":438,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.380257+0000","last_change":"2024-04-18T04:54:41.183032+0000","last_active":"2024-04-18T05:01:07.380257+0000","last_peered":"2024-04-18T05:01:07.380257+0000","last_clean":"2024-04-18T05:01:07.380257+0000","last_became_active":"2024-04-18T04:54:41.182698+0000","last_became_peered":"2024-04-18T04:54:41.182698+0000","last_unstale":"2024-04-18T05:01:07.380257+0000","last_undegraded":"2024-04-18T05:01:07.380257+0000","last_fullsized":"2024-04-18T05:01:07.380257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13914,"num_write":350,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"23'379","reported_seq":428,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377273+0000","last_change":"2024-04-18T04:54:41.187831+0000","last_active":"2024-04-18T05:01:07.377273+0000","last_peered":"2024-04-18T05:01:07.377273+0000","last_clean":"2024-04-18T05:01:07.377273+0000","last_became_active":"2024-04-18T04:54:41.187360+0000","last_became_peered":"2024-04-18T04:54:41.187360+0000","last_unstale":"2024-04-18T05:01:07.377273+0000","last_undegraded":"2024-04-18T05:01:07.377273+0000","last_fullsized":"2024-04-18T05:01:07.377273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18312,"num_write":357,"num_write_kb":34101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"23'361","reported_seq":411,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.378366+0000","last_change":"2024-04-18T04:54:41.188641+0000","last_active":"2024-04-18T05:01:07.378366+0000","last_peered":"2024-04-18T05:01:07.378366+0000","last_clean":"2024-04-18T05:01:07.378366+0000","last_became_active":"2024-04-18T04:54:41.188281+0000","last_became_peered":"2024-04-18T04:54:41.188281+0000","last_unstale":"2024-04-18T05:01:07.378366+0000","last_undegraded":"2024-04-18T05:01:07.378366+0000","last_fullsized":"2024-04-18T05:01:07.378366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21304,"num_write":338,"num_write_kb":54980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"23'375","reported_seq":417,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:35.392847+0000","last_change":"2024-04-18T05:01:35.393048+0000","last_active":"2024-04-18T05:01:35.392847+0000","last_peered":"2024-04-18T05:01:35.392847+0000","last_clean":"2024-04-18T05:01:35.392847+0000","last_became_active":"2024-04-18T04:54:41.190882+0000","last_became_peered":"2024-04-18T04:54:41.190882+0000","last_unstale":"2024-04-18T05:01:35.392847+0000","last_undegraded":"2024-04-18T05:01:35.392847+0000","last_fullsized":"2024-04-18T05:01:35.392847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'375","last_scrub_stamp":"2024-04-18T05:01:35.392794+0000","last_deep_scrub":"23'375","last_deep_scrub_stamp":"2024-04-18T05:01:35.392794+0000","last_clean_scrub_stamp":"2024-04-18T05:01:35.392794+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:34.572335+0000","scrub_duration":0.004280786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7725,"num_write":337,"num_write_kb":21712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"23'417","reported_seq":491,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.394801+0000","last_change":"2024-04-18T04:54:41.190210+0000","last_active":"2024-04-18T05:01:07.394801+0000","last_peered":"2024-04-18T05:01:07.394801+0000","last_clean":"2024-04-18T05:01:07.394801+0000","last_became_active":"2024-04-18T04:54:41.189813+0000","last_became_peered":"2024-04-18T04:54:41.189813+0000","last_unstale":"2024-04-18T05:01:07.394801+0000","last_undegraded":"2024-04-18T05:01:07.394801+0000","last_fullsized":"2024-04-18T05:01:07.394801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":28320,"num_write":390,"num_write_kb":71764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"23'445","reported_seq":533,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.406331+0000","last_change":"2024-04-18T04:54:41.183027+0000","last_active":"2024-04-18T05:01:07.406331+0000","last_peered":"2024-04-18T05:01:07.406331+0000","last_clean":"2024-04-18T05:01:07.406331+0000","last_became_active":"2024-04-18T04:54:41.182713+0000","last_became_peered":"2024-04-18T04:54:41.182713+0000","last_unstale":"2024-04-18T05:01:07.406331+0000","last_undegraded":"2024-04-18T05:01:07.406331+0000","last_fullsized":"2024-04-18T05:01:07.406331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":36644,"num_write":412,"num_write_kb":104908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"23'442","reported_seq":508,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.365035+0000","last_change":"2024-04-18T04:54:41.186060+0000","last_active":"2024-04-18T05:01:07.365035+0000","last_peered":"2024-04-18T05:01:07.365035+0000","last_clean":"2024-04-18T05:01:07.365035+0000","last_became_active":"2024-04-18T04:54:41.185803+0000","last_became_peered":"2024-04-18T04:54:41.185803+0000","last_unstale":"2024-04-18T05:01:07.365035+0000","last_undegraded":"2024-04-18T05:01:07.365035+0000","last_fullsized":"2024-04-18T05:01:07.365035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21979,"num_write":411,"num_write_kb":59643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"23'407","reported_seq":467,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.370575+0000","last_change":"2024-04-18T04:54:41.200802+0000","last_active":"2024-04-18T05:01:07.370575+0000","last_peered":"2024-04-18T05:01:07.370575+0000","last_clean":"2024-04-18T05:01:07.370575+0000","last_became_active":"2024-04-18T04:54:41.198404+0000","last_became_peered":"2024-04-18T04:54:41.198404+0000","last_unstale":"2024-04-18T05:01:07.370575+0000","last_undegraded":"2024-04-18T05:01:07.370575+0000","last_fullsized":"2024-04-18T05:01:07.370575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22314,"num_write":375,"num_write_kb":43056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"23'414","reported_seq":481,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:33.639350+0000","last_change":"2024-04-18T05:01:33.639544+0000","last_active":"2024-04-18T05:01:33.639350+0000","last_peered":"2024-04-18T05:01:33.639350+0000","last_clean":"2024-04-18T05:01:33.639350+0000","last_became_active":"2024-04-18T04:54:41.188139+0000","last_became_peered":"2024-04-18T04:54:41.188139+0000","last_unstale":"2024-04-18T05:01:33.639350+0000","last_undegraded":"2024-04-18T05:01:33.639350+0000","last_fullsized":"2024-04-18T05:01:33.639350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'414","last_scrub_stamp":"2024-04-18T05:01:33.639296+0000","last_deep_scrub":"23'414","last_deep_scrub_stamp":"2024-04-18T05:01:33.639296+0000","last_clean_scrub_stamp":"2024-04-18T05:01:33.639296+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:14.073131+0000","scrub_duration":0.0049131380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21874,"num_write":387,"num_write_kb":84204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"23'431","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:17.941813+0000","last_change":"2024-04-18T04:54:41.197901+0000","last_active":"2024-04-18T05:01:17.941813+0000","last_peered":"2024-04-18T05:01:17.941813+0000","last_clean":"2024-04-18T05:01:17.941813+0000","last_became_active":"2024-04-18T04:54:41.197235+0000","last_became_peered":"2024-04-18T04:54:41.197235+0000","last_unstale":"2024-04-18T05:01:17.941813+0000","last_undegraded":"2024-04-18T05:01:17.941813+0000","last_fullsized":"2024-04-18T05:01:17.941813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40070,"num_write":398,"num_write_kb":116642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"23'437","reported_seq":510,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:16.610774+0000","last_change":"2024-04-18T04:54:41.188440+0000","last_active":"2024-04-18T05:01:16.610774+0000","last_peered":"2024-04-18T05:01:16.610774+0000","last_clean":"2024-04-18T05:01:16.610774+0000","last_became_active":"2024-04-18T04:54:41.187925+0000","last_became_peered":"2024-04-18T04:54:41.187925+0000","last_unstale":"2024-04-18T05:01:16.610774+0000","last_undegraded":"2024-04-18T05:01:16.610774+0000","last_fullsized":"2024-04-18T05:01:16.610774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27418,"num_write":411,"num_write_kb":67043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"23'413","reported_seq":490,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:18.377656+0000","last_change":"2024-04-18T04:54:41.179672+0000","last_active":"2024-04-18T05:01:18.377656+0000","last_peered":"2024-04-18T05:01:18.377656+0000","last_clean":"2024-04-18T05:01:18.377656+0000","last_became_active":"2024-04-18T04:54:41.178963+0000","last_became_peered":"2024-04-18T04:54:41.178963+0000","last_unstale":"2024-04-18T05:01:18.377656+0000","last_undegraded":"2024-04-18T05:01:18.377656+0000","last_fullsized":"2024-04-18T05:01:18.377656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32437,"num_write":394,"num_write_kb":88243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"23'442","reported_seq":514,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:17.052531+0000","last_change":"2024-04-18T04:54:41.182902+0000","last_active":"2024-04-18T05:01:17.052531+0000","last_peered":"2024-04-18T05:01:17.052531+0000","last_clean":"2024-04-18T05:01:17.052531+0000","last_became_active":"2024-04-18T04:54:41.182664+0000","last_became_peered":"2024-04-18T04:54:41.182664+0000","last_unstale":"2024-04-18T05:01:17.052531+0000","last_undegraded":"2024-04-18T05:01:17.052531+0000","last_fullsized":"2024-04-18T05:01:17.052531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34086,"num_write":411,"num_write_kb":96499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"23'434","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:30.563054+0000","last_change":"2024-04-18T05:01:30.563054+0000","last_active":"2024-04-18T05:01:30.563054+0000","last_peered":"2024-04-18T05:01:30.563054+0000","last_clean":"2024-04-18T05:01:30.563054+0000","last_became_active":"2024-04-18T04:54:41.186881+0000","last_became_peered":"2024-04-18T04:54:41.186881+0000","last_unstale":"2024-04-18T05:01:30.563054+0000","last_undegraded":"2024-04-18T05:01:30.563054+0000","last_fullsized":"2024-04-18T05:01:30.563054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'434","last_scrub_stamp":"2024-04-18T05:01:30.562793+0000","last_deep_scrub":"23'434","last_deep_scrub_stamp":"2024-04-18T05:01:30.562793+0000","last_clean_scrub_stamp":"2024-04-18T05:01:30.562793+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:30.270048+0000","scrub_duration":0.0049938550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":24295,"num_write":395,"num_write_kb":96064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"23'465","reported_seq":584,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:15.665867+0000","last_change":"2024-04-18T04:54:41.193206+0000","last_active":"2024-04-18T05:01:15.665867+0000","last_peered":"2024-04-18T05:01:15.665867+0000","last_clean":"2024-04-18T05:01:15.665867+0000","last_became_active":"2024-04-18T04:54:41.192740+0000","last_became_peered":"2024-04-18T04:54:41.192740+0000","last_unstale":"2024-04-18T05:01:15.665867+0000","last_undegraded":"2024-04-18T05:01:15.665867+0000","last_fullsized":"2024-04-18T05:01:15.665867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61562,"num_write":441,"num_write_kb":100539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"23'390","reported_seq":440,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:15.665232+0000","last_change":"2024-04-18T04:54:41.192785+0000","last_active":"2024-04-18T05:01:15.665232+0000","last_peered":"2024-04-18T05:01:15.665232+0000","last_clean":"2024-04-18T05:01:15.665232+0000","last_became_active":"2024-04-18T04:54:41.192280+0000","last_became_peered":"2024-04-18T04:54:41.192280+0000","last_unstale":"2024-04-18T05:01:15.665232+0000","last_undegraded":"2024-04-18T05:01:15.665232+0000","last_fullsized":"2024-04-18T05:01:15.665232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18903,"num_write":377,"num_write_kb":34298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"23'490","reported_seq":560,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:13.643675+0000","last_change":"2024-04-18T04:54:41.193920+0000","last_active":"2024-04-18T05:01:13.643675+0000","last_peered":"2024-04-18T05:01:13.643675+0000","last_clean":"2024-04-18T05:01:13.643675+0000","last_became_active":"2024-04-18T04:54:41.193660+0000","last_became_peered":"2024-04-18T04:54:41.193660+0000","last_unstale":"2024-04-18T05:01:13.643675+0000","last_undegraded":"2024-04-18T05:01:13.643675+0000","last_fullsized":"2024-04-18T05:01:13.643675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26760,"num_write":458,"num_write_kb":125465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"23'432","reported_seq":538,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:33.361713+0000","last_change":"2024-04-18T05:01:33.361955+0000","last_active":"2024-04-18T05:01:33.361713+0000","last_peered":"2024-04-18T05:01:33.361713+0000","last_clean":"2024-04-18T05:01:33.361713+0000","last_became_active":"2024-04-18T04:54:41.189374+0000","last_became_peered":"2024-04-18T04:54:41.189374+0000","last_unstale":"2024-04-18T05:01:33.361713+0000","last_undegraded":"2024-04-18T05:01:33.361713+0000","last_fullsized":"2024-04-18T05:01:33.361713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'432","last_scrub_stamp":"2024-04-18T05:01:33.361660+0000","last_deep_scrub":"23'432","last_deep_scrub_stamp":"2024-04-18T05:01:33.361660+0000","last_clean_scrub_stamp":"2024-04-18T05:01:33.361660+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:13.795496+0000","scrub_duration":0.0046135539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43719,"num_write":406,"num_write_kb":145399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"23'384","reported_seq":439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:15.664516+0000","last_change":"2024-04-18T04:54:41.190403+0000","last_active":"2024-04-18T05:01:15.664516+0000","last_peered":"2024-04-18T05:01:15.664516+0000","last_clean":"2024-04-18T05:01:15.664516+0000","last_became_active":"2024-04-18T04:54:41.189660+0000","last_became_peered":"2024-04-18T04:54:41.189660+0000","last_unstale":"2024-04-18T05:01:15.664516+0000","last_undegraded":"2024-04-18T05:01:15.664516+0000","last_fullsized":"2024-04-18T05:01:15.664516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17737,"num_write":357,"num_write_kb":75727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"23'427","reported_seq":501,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.399414+0000","last_change":"2024-04-18T04:54:41.187370+0000","last_active":"2024-04-18T05:01:07.399414+0000","last_peered":"2024-04-18T05:01:07.399414+0000","last_clean":"2024-04-18T05:01:07.399414+0000","last_became_active":"2024-04-18T04:54:41.186901+0000","last_became_peered":"2024-04-18T04:54:41.186901+0000","last_unstale":"2024-04-18T05:01:07.399414+0000","last_undegraded":"2024-04-18T05:01:07.399414+0000","last_fullsized":"2024-04-18T05:01:07.399414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30499,"num_write":394,"num_write_kb":84601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"23'468","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.402976+0000","last_change":"2024-04-18T04:54:41.192719+0000","last_active":"2024-04-18T05:01:07.402976+0000","last_peered":"2024-04-18T05:01:07.402976+0000","last_clean":"2024-04-18T05:01:07.402976+0000","last_became_active":"2024-04-18T04:54:41.192114+0000","last_became_peered":"2024-04-18T04:54:41.192114+0000","last_unstale":"2024-04-18T05:01:07.402976+0000","last_undegraded":"2024-04-18T05:01:07.402976+0000","last_fullsized":"2024-04-18T05:01:07.402976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13784,"num_write":434,"num_write_kb":79847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"23'421","reported_seq":483,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.616261+0000","last_change":"2024-04-18T05:01:31.616457+0000","last_active":"2024-04-18T05:01:31.616261+0000","last_peered":"2024-04-18T05:01:31.616261+0000","last_clean":"2024-04-18T05:01:31.616261+0000","last_became_active":"2024-04-18T04:54:41.185915+0000","last_became_peered":"2024-04-18T04:54:41.185915+0000","last_unstale":"2024-04-18T05:01:31.616261+0000","last_undegraded":"2024-04-18T05:01:31.616261+0000","last_fullsized":"2024-04-18T05:01:31.616261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'421","last_scrub_stamp":"2024-04-18T05:01:31.616202+0000","last_deep_scrub":"23'421","last_deep_scrub_stamp":"2024-04-18T05:01:31.616202+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.616202+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:15:47.815302+0000","scrub_duration":0.0045383150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":22283,"num_write":389,"num_write_kb":42482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"23'415","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:23.083892+0000","last_change":"2024-04-18T05:01:23.084088+0000","last_active":"2024-04-18T05:01:23.083892+0000","last_peered":"2024-04-18T05:01:23.083892+0000","last_clean":"2024-04-18T05:01:23.083892+0000","last_became_active":"2024-04-18T04:54:41.189892+0000","last_became_peered":"2024-04-18T04:54:41.189892+0000","last_unstale":"2024-04-18T05:01:23.083892+0000","last_undegraded":"2024-04-18T05:01:23.083892+0000","last_fullsized":"2024-04-18T05:01:23.083892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'415","last_scrub_stamp":"2024-04-18T05:01:23.083840+0000","last_deep_scrub":"23'415","last_deep_scrub_stamp":"2024-04-18T05:01:23.083840+0000","last_clean_scrub_stamp":"2024-04-18T05:01:23.083840+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:21:47.363582+0000","scrub_duration":0.0047136449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36029,"num_write":387,"num_write_kb":59223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'420","reported_seq":491,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:28.770953+0000","last_change":"2024-04-18T05:01:28.771175+0000","last_active":"2024-04-18T05:01:28.770953+0000","last_peered":"2024-04-18T05:01:28.770953+0000","last_clean":"2024-04-18T05:01:28.770953+0000","last_became_active":"2024-04-18T04:54:41.187001+0000","last_became_peered":"2024-04-18T04:54:41.187001+0000","last_unstale":"2024-04-18T05:01:28.770953+0000","last_undegraded":"2024-04-18T05:01:28.770953+0000","last_fullsized":"2024-04-18T05:01:28.770953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'420","last_scrub_stamp":"2024-04-18T05:01:28.770902+0000","last_deep_scrub":"23'420","last_deep_scrub_stamp":"2024-04-18T05:01:28.770902+0000","last_clean_scrub_stamp":"2024-04-18T05:01:28.770902+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:27.362071+0000","scrub_duration":0.0043507140000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19127,"num_write":391,"num_write_kb":83892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'99","reported_seq":125,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:19.609295+0000","last_change":"2024-04-18T05:01:19.609510+0000","last_active":"2024-04-18T05:01:19.609295+0000","last_peered":"2024-04-18T05:01:19.609295+0000","last_clean":"2024-04-18T05:01:19.609295+0000","last_became_active":"2024-04-18T04:54:40.823652+0000","last_became_peered":"2024-04-18T04:54:40.823652+0000","last_unstale":"2024-04-18T05:01:19.609295+0000","last_undegraded":"2024-04-18T05:01:19.609295+0000","last_fullsized":"2024-04-18T05:01:19.609295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'99","last_scrub_stamp":"2024-04-18T05:01:19.609240+0000","last_deep_scrub":"23'99","last_deep_scrub_stamp":"2024-04-18T05:01:19.609240+0000","last_clean_scrub_stamp":"2024-04-18T05:01:19.609240+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:35.184621+0000","scrub_duration":0.024247222999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195462,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"23'366","reported_seq":403,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.383027+0000","last_change":"2024-04-18T04:55:39.828560+0000","last_active":"2024-04-18T05:01:07.383027+0000","last_peered":"2024-04-18T05:01:07.383027+0000","last_clean":"2024-04-18T05:01:07.383027+0000","last_became_active":"2024-04-18T04:55:39.827671+0000","last_became_peered":"2024-04-18T04:55:39.827671+0000","last_unstale":"2024-04-18T05:01:07.383027+0000","last_undegraded":"2024-04-18T05:01:07.383027+0000","last_fullsized":"2024-04-18T05:01:07.383027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13158,"num_write":336,"num_write_kb":38014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'539","reported_seq":554,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:02.999901+0000","last_change":"2024-04-18T04:54:40.803244+0000","last_active":"2024-04-18T05:00:02.999901+0000","last_peered":"2024-04-18T05:00:02.999901+0000","last_clean":"2024-04-18T05:00:02.999901+0000","last_became_active":"2024-04-18T04:54:40.802672+0000","last_became_peered":"2024-04-18T04:54:40.802672+0000","last_unstale":"2024-04-18T05:00:02.999901+0000","last_undegraded":"2024-04-18T05:00:02.999901+0000","last_fullsized":"2024-04-18T05:00:02.999901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":487,"num_write_kb":12578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'418","reported_seq":445,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:25.397294+0000","last_change":"2024-04-18T05:01:25.397489+0000","last_active":"2024-04-18T05:01:25.397294+0000","last_peered":"2024-04-18T05:01:25.397294+0000","last_clean":"2024-04-18T05:01:25.397294+0000","last_became_active":"2024-04-18T04:54:40.823091+0000","last_became_peered":"2024-04-18T04:54:40.823091+0000","last_unstale":"2024-04-18T05:01:25.397294+0000","last_undegraded":"2024-04-18T05:01:25.397294+0000","last_fullsized":"2024-04-18T05:01:25.397294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'418","last_scrub_stamp":"2024-04-18T05:01:25.397241+0000","last_deep_scrub":"23'418","last_deep_scrub_stamp":"2024-04-18T05:01:25.397241+0000","last_clean_scrub_stamp":"2024-04-18T05:01:25.397241+0000","objects_scrubbed":3,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:03.755258+0000","scrub_duration":0.029980849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":4340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"23'429","reported_seq":469,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:27.513352+0000","last_change":"2024-04-18T05:01:27.513575+0000","last_active":"2024-04-18T05:01:27.513352+0000","last_peered":"2024-04-18T05:01:27.513352+0000","last_clean":"2024-04-18T05:01:27.513352+0000","last_became_active":"2024-04-18T04:54:41.199690+0000","last_became_peered":"2024-04-18T04:54:41.199690+0000","last_unstale":"2024-04-18T05:01:27.513352+0000","last_undegraded":"2024-04-18T05:01:27.513352+0000","last_fullsized":"2024-04-18T05:01:27.513352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'429","last_scrub_stamp":"2024-04-18T05:01:27.513299+0000","last_deep_scrub":"23'429","last_deep_scrub_stamp":"2024-04-18T05:01:27.513299+0000","last_clean_scrub_stamp":"2024-04-18T05:01:27.513299+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:26.692839+0000","scrub_duration":0.0049636610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5535,"num_write":391,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'954","reported_seq":969,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.005713+0000","last_change":"2024-04-18T04:54:40.805264+0000","last_active":"2024-04-18T05:00:06.005713+0000","last_peered":"2024-04-18T05:00:06.005713+0000","last_clean":"2024-04-18T05:00:06.005713+0000","last_became_active":"2024-04-18T04:54:40.804605+0000","last_became_peered":"2024-04-18T04:54:40.804605+0000","last_unstale":"2024-04-18T05:00:06.005713+0000","last_undegraded":"2024-04-18T05:00:06.005713+0000","last_fullsized":"2024-04-18T05:00:06.005713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"23'422","reported_seq":470,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.372744+0000","last_change":"2024-04-18T04:54:41.175359+0000","last_active":"2024-04-18T05:01:07.372744+0000","last_peered":"2024-04-18T05:01:07.372744+0000","last_clean":"2024-04-18T05:01:07.372744+0000","last_became_active":"2024-04-18T04:54:41.175137+0000","last_became_peered":"2024-04-18T04:54:41.175137+0000","last_unstale":"2024-04-18T05:01:07.372744+0000","last_undegraded":"2024-04-18T05:01:07.372744+0000","last_fullsized":"2024-04-18T05:01:07.372744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21971,"num_write":395,"num_write_kb":63063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'68","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:20.781000+0000","last_change":"2024-04-18T05:01:20.781219+0000","last_active":"2024-04-18T05:01:20.781000+0000","last_peered":"2024-04-18T05:01:20.781000+0000","last_clean":"2024-04-18T05:01:20.781000+0000","last_became_active":"2024-04-18T04:54:40.798572+0000","last_became_peered":"2024-04-18T04:54:40.798572+0000","last_unstale":"2024-04-18T05:01:20.781000+0000","last_undegraded":"2024-04-18T05:01:20.781000+0000","last_fullsized":"2024-04-18T05:01:20.781000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'68","last_scrub_stamp":"2024-04-18T05:01:20.780948+0000","last_deep_scrub":"23'68","last_deep_scrub_stamp":"2024-04-18T05:01:20.780948+0000","last_clean_scrub_stamp":"2024-04-18T05:01:20.780948+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:46:12.946774+0000","scrub_duration":0.0073987970000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'432","reported_seq":485,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.382140+0000","last_change":"2024-04-18T04:54:41.188280+0000","last_active":"2024-04-18T05:01:07.382140+0000","last_peered":"2024-04-18T05:01:07.382140+0000","last_clean":"2024-04-18T05:01:07.382140+0000","last_became_active":"2024-04-18T04:54:41.188012+0000","last_became_peered":"2024-04-18T04:54:41.188012+0000","last_unstale":"2024-04-18T05:01:07.382140+0000","last_undegraded":"2024-04-18T05:01:07.382140+0000","last_fullsized":"2024-04-18T05:01:07.382140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13773,"num_write":397,"num_write_kb":43173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'337","reported_seq":364,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:25.419563+0000","last_change":"2024-04-18T05:01:25.419761+0000","last_active":"2024-04-18T05:01:25.419563+0000","last_peered":"2024-04-18T05:01:25.419563+0000","last_clean":"2024-04-18T05:01:25.419563+0000","last_became_active":"2024-04-18T04:54:40.801406+0000","last_became_peered":"2024-04-18T04:54:40.801406+0000","last_unstale":"2024-04-18T05:01:25.419563+0000","last_undegraded":"2024-04-18T05:01:25.419563+0000","last_fullsized":"2024-04-18T05:01:25.419563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'337","last_scrub_stamp":"2024-04-18T05:01:25.419503+0000","last_deep_scrub":"23'337","last_deep_scrub_stamp":"2024-04-18T05:01:25.419503+0000","last_clean_scrub_stamp":"2024-04-18T05:01:25.419503+0000","objects_scrubbed":3,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:24.599044+0000","scrub_duration":0.029230335,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"23'397","reported_seq":433,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.409623+0000","last_change":"2024-04-18T04:54:41.203407+0000","last_active":"2024-04-18T05:01:07.409623+0000","last_peered":"2024-04-18T05:01:07.409623+0000","last_clean":"2024-04-18T05:01:07.409623+0000","last_became_active":"2024-04-18T04:54:41.203186+0000","last_became_peered":"2024-04-18T04:54:41.203186+0000","last_unstale":"2024-04-18T05:01:07.409623+0000","last_undegraded":"2024-04-18T05:01:07.409623+0000","last_fullsized":"2024-04-18T05:01:07.409623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14488,"num_write":364,"num_write_kb":75349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'192","reported_seq":219,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:26.537369+0000","last_change":"2024-04-18T05:01:26.537619+0000","last_active":"2024-04-18T05:01:26.537369+0000","last_peered":"2024-04-18T05:01:26.537369+0000","last_clean":"2024-04-18T05:01:26.537369+0000","last_became_active":"2024-04-18T04:54:40.820920+0000","last_became_peered":"2024-04-18T04:54:40.820920+0000","last_unstale":"2024-04-18T05:01:26.537369+0000","last_undegraded":"2024-04-18T05:01:26.537369+0000","last_fullsized":"2024-04-18T05:01:26.537369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'192","last_scrub_stamp":"2024-04-18T05:01:26.537313+0000","last_deep_scrub":"23'192","last_deep_scrub_stamp":"2024-04-18T05:01:26.537313+0000","last_clean_scrub_stamp":"2024-04-18T05:01:26.537313+0000","objects_scrubbed":4,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:25.128483+0000","scrub_duration":0.010104568,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"23'394","reported_seq":444,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.365837+0000","last_change":"2024-04-18T04:54:41.197254+0000","last_active":"2024-04-18T05:01:07.365837+0000","last_peered":"2024-04-18T05:01:07.365837+0000","last_clean":"2024-04-18T05:01:07.365837+0000","last_became_active":"2024-04-18T04:54:41.196927+0000","last_became_peered":"2024-04-18T04:54:41.196927+0000","last_unstale":"2024-04-18T05:01:07.365837+0000","last_undegraded":"2024-04-18T05:01:07.365837+0000","last_fullsized":"2024-04-18T05:01:07.365837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21129,"num_write":360,"num_write_kb":71528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'450","reported_seq":477,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:18.091515+0000","last_change":"2024-04-18T05:01:18.091612+0000","last_active":"2024-04-18T05:01:18.091515+0000","last_peered":"2024-04-18T05:01:18.091515+0000","last_clean":"2024-04-18T05:01:18.091515+0000","last_became_active":"2024-04-18T04:54:40.801403+0000","last_became_peered":"2024-04-18T04:54:40.801403+0000","last_unstale":"2024-04-18T05:01:18.091515+0000","last_undegraded":"2024-04-18T05:01:18.091515+0000","last_fullsized":"2024-04-18T05:01:18.091515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'450","last_scrub_stamp":"2024-04-18T05:01:18.091496+0000","last_deep_scrub":"23'450","last_deep_scrub_stamp":"2024-04-18T05:01:18.091496+0000","last_clean_scrub_stamp":"2024-04-18T05:01:18.091496+0000","objects_scrubbed":8,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:59:33.756145+0000","scrub_duration":0.055952107000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12011434,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":11980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'396","reported_seq":454,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.395085+0000","last_change":"2024-04-18T04:54:41.195518+0000","last_active":"2024-04-18T05:01:07.395085+0000","last_peered":"2024-04-18T05:01:07.395085+0000","last_clean":"2024-04-18T05:01:07.395085+0000","last_became_active":"2024-04-18T04:54:41.195172+0000","last_became_peered":"2024-04-18T04:54:41.195172+0000","last_unstale":"2024-04-18T05:01:07.395085+0000","last_undegraded":"2024-04-18T05:01:07.395085+0000","last_fullsized":"2024-04-18T05:01:07.395085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19873,"num_write":365,"num_write_kb":71837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'591","reported_seq":618,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:25.610466+0000","last_change":"2024-04-18T05:01:25.610689+0000","last_active":"2024-04-18T05:01:25.610466+0000","last_peered":"2024-04-18T05:01:25.610466+0000","last_clean":"2024-04-18T05:01:25.610466+0000","last_became_active":"2024-04-18T04:54:40.817681+0000","last_became_peered":"2024-04-18T04:54:40.817681+0000","last_unstale":"2024-04-18T05:01:25.610466+0000","last_undegraded":"2024-04-18T05:01:25.610466+0000","last_fullsized":"2024-04-18T05:01:25.610466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'591","last_scrub_stamp":"2024-04-18T05:01:25.610406+0000","last_deep_scrub":"23'591","last_deep_scrub_stamp":"2024-04-18T05:01:25.610406+0000","last_clean_scrub_stamp":"2024-04-18T05:01:25.610406+0000","objects_scrubbed":8,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:03.968423+0000","scrub_duration":0.057537295000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"23'417","reported_seq":444,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.392722+0000","last_change":"2024-04-18T04:54:41.194807+0000","last_active":"2024-04-18T05:01:07.392722+0000","last_peered":"2024-04-18T05:01:07.392722+0000","last_clean":"2024-04-18T05:01:07.392722+0000","last_became_active":"2024-04-18T04:54:41.194499+0000","last_became_peered":"2024-04-18T04:54:41.194499+0000","last_unstale":"2024-04-18T05:01:07.392722+0000","last_undegraded":"2024-04-18T05:01:07.392722+0000","last_fullsized":"2024-04-18T05:01:07.392722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":380,"num_write_kb":59449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"23'70","reported_seq":85,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:06.058399+0000","last_change":"2024-04-18T04:54:40.817631+0000","last_active":"2024-04-18T05:00:06.058399+0000","last_peered":"2024-04-18T05:00:06.058399+0000","last_clean":"2024-04-18T05:00:06.058399+0000","last_became_active":"2024-04-18T04:54:40.817370+0000","last_became_peered":"2024-04-18T04:54:40.817370+0000","last_unstale":"2024-04-18T05:00:06.058399+0000","last_undegraded":"2024-04-18T05:00:06.058399+0000","last_fullsized":"2024-04-18T05:00:06.058399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'400","reported_seq":473,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.377540+0000","last_change":"2024-04-18T04:54:41.193363+0000","last_active":"2024-04-18T05:01:07.377540+0000","last_peered":"2024-04-18T05:01:07.377540+0000","last_clean":"2024-04-18T05:01:07.377540+0000","last_became_active":"2024-04-18T04:54:41.192889+0000","last_became_peered":"2024-04-18T04:54:41.192889+0000","last_unstale":"2024-04-18T05:01:07.377540+0000","last_undegraded":"2024-04-18T05:01:07.377540+0000","last_fullsized":"2024-04-18T05:01:07.377540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30891,"num_write":363,"num_write_kb":81664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"23'69","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:24.422761+0000","last_change":"2024-04-18T05:01:24.423007+0000","last_active":"2024-04-18T05:01:24.422761+0000","last_peered":"2024-04-18T05:01:24.422761+0000","last_clean":"2024-04-18T05:01:24.422761+0000","last_became_active":"2024-04-18T04:54:40.805965+0000","last_became_peered":"2024-04-18T04:54:40.805965+0000","last_unstale":"2024-04-18T05:01:24.422761+0000","last_undegraded":"2024-04-18T05:01:24.422761+0000","last_fullsized":"2024-04-18T05:01:24.422761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'69","last_scrub_stamp":"2024-04-18T05:01:24.422705+0000","last_deep_scrub":"23'69","last_deep_scrub_stamp":"2024-04-18T05:01:24.422705+0000","last_clean_scrub_stamp":"2024-04-18T05:01:24.422705+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:43.392120+0000","scrub_duration":0.0070178870000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1124,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'449","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:29.816906+0000","last_change":"2024-04-18T05:01:29.817094+0000","last_active":"2024-04-18T05:01:29.816906+0000","last_peered":"2024-04-18T05:01:29.816906+0000","last_clean":"2024-04-18T05:01:29.816906+0000","last_became_active":"2024-04-18T04:54:41.183838+0000","last_became_peered":"2024-04-18T04:54:41.183838+0000","last_unstale":"2024-04-18T05:01:29.816906+0000","last_undegraded":"2024-04-18T05:01:29.816906+0000","last_fullsized":"2024-04-18T05:01:29.816906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'449","last_scrub_stamp":"2024-04-18T05:01:29.816853+0000","last_deep_scrub":"23'449","last_deep_scrub_stamp":"2024-04-18T05:01:29.816853+0000","last_clean_scrub_stamp":"2024-04-18T05:01:29.816853+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:45.392233+0000","scrub_duration":0.0047717139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14210,"num_write":423,"num_write_kb":80124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'88","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.337540+0000","last_change":"2024-04-18T05:01:31.337778+0000","last_active":"2024-04-18T05:01:31.337540+0000","last_peered":"2024-04-18T05:01:31.337540+0000","last_clean":"2024-04-18T05:01:31.337540+0000","last_became_active":"2024-04-18T04:54:40.818227+0000","last_became_peered":"2024-04-18T04:54:40.818227+0000","last_unstale":"2024-04-18T05:01:31.337540+0000","last_undegraded":"2024-04-18T05:01:31.337540+0000","last_fullsized":"2024-04-18T05:01:31.337540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'88","last_scrub_stamp":"2024-04-18T05:01:31.337486+0000","last_deep_scrub":"23'88","last_deep_scrub_stamp":"2024-04-18T05:01:31.337486+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.337486+0000","objects_scrubbed":8,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:25.180421+0000","scrub_duration":0.014728473000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"23'493","reported_seq":554,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.364845+0000","last_change":"2024-04-18T04:54:41.192227+0000","last_active":"2024-04-18T05:01:07.364845+0000","last_peered":"2024-04-18T05:01:07.364845+0000","last_clean":"2024-04-18T05:01:07.364845+0000","last_became_active":"2024-04-18T04:54:41.187002+0000","last_became_peered":"2024-04-18T04:54:41.187002+0000","last_unstale":"2024-04-18T05:01:07.364845+0000","last_undegraded":"2024-04-18T05:01:07.364845+0000","last_fullsized":"2024-04-18T05:01:07.364845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":24156,"num_write":458,"num_write_kb":105037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'202","reported_seq":230,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:23.442118+0000","last_change":"2024-04-18T05:01:23.442118+0000","last_active":"2024-04-18T05:01:23.442118+0000","last_peered":"2024-04-18T05:01:23.442118+0000","last_clean":"2024-04-18T05:01:23.442118+0000","last_became_active":"2024-04-18T04:54:40.802550+0000","last_became_peered":"2024-04-18T04:54:40.802550+0000","last_unstale":"2024-04-18T05:01:23.442118+0000","last_undegraded":"2024-04-18T05:01:23.442118+0000","last_fullsized":"2024-04-18T05:01:23.442118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'202","last_scrub_stamp":"2024-04-18T05:01:23.441698+0000","last_deep_scrub":"23'202","last_deep_scrub_stamp":"2024-04-18T05:01:23.441698+0000","last_clean_scrub_stamp":"2024-04-18T05:01:23.441698+0000","objects_scrubbed":3,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:03.875533+0000","scrub_duration":0.030187757999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'364","reported_seq":405,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:17.501479+0000","last_change":"2024-04-18T04:54:41.180426+0000","last_active":"2024-04-18T05:01:17.501479+0000","last_peered":"2024-04-18T05:01:17.501479+0000","last_clean":"2024-04-18T05:01:17.501479+0000","last_became_active":"2024-04-18T04:54:41.179540+0000","last_became_peered":"2024-04-18T04:54:41.179540+0000","last_unstale":"2024-04-18T05:01:17.501479+0000","last_undegraded":"2024-04-18T05:01:17.501479+0000","last_fullsized":"2024-04-18T05:01:17.501479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16384,"num_write":332,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'307","reported_seq":335,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:37.408810+0000","last_change":"2024-04-18T05:01:37.409008+0000","last_active":"2024-04-18T05:01:37.408810+0000","last_peered":"2024-04-18T05:01:37.408810+0000","last_clean":"2024-04-18T05:01:37.408810+0000","last_became_active":"2024-04-18T04:54:40.803464+0000","last_became_peered":"2024-04-18T04:54:40.803464+0000","last_unstale":"2024-04-18T05:01:37.408810+0000","last_undegraded":"2024-04-18T05:01:37.408810+0000","last_fullsized":"2024-04-18T05:01:37.408810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'307","last_scrub_stamp":"2024-04-18T05:01:37.408757+0000","last_deep_scrub":"23'307","last_deep_scrub_stamp":"2024-04-18T05:01:37.408757+0000","last_clean_scrub_stamp":"2024-04-18T05:01:37.408757+0000","objects_scrubbed":3,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:46:50.667816+0000","scrub_duration":0.032088881999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"23'391","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:17.446894+0000","last_change":"2024-04-18T05:01:17.446894+0000","last_active":"2024-04-18T05:01:17.446894+0000","last_peered":"2024-04-18T05:01:17.446894+0000","last_clean":"2024-04-18T05:01:17.446894+0000","last_became_active":"2024-04-18T04:54:41.188152+0000","last_became_peered":"2024-04-18T04:54:41.188152+0000","last_unstale":"2024-04-18T05:01:17.446894+0000","last_undegraded":"2024-04-18T05:01:17.446894+0000","last_fullsized":"2024-04-18T05:01:17.446894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'391","last_scrub_stamp":"2024-04-18T05:01:17.446736+0000","last_deep_scrub":"23'391","last_deep_scrub_stamp":"2024-04-18T05:01:17.446736+0000","last_clean_scrub_stamp":"2024-04-18T05:01:17.446736+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:33.022117+0000","scrub_duration":0.0029989399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15853,"num_write":356,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'537","reported_seq":564,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:26.569521+0000","last_change":"2024-04-18T05:01:26.569720+0000","last_active":"2024-04-18T05:01:26.569521+0000","last_peered":"2024-04-18T05:01:26.569521+0000","last_clean":"2024-04-18T05:01:26.569521+0000","last_became_active":"2024-04-18T04:54:40.814207+0000","last_became_peered":"2024-04-18T04:54:40.814207+0000","last_unstale":"2024-04-18T05:01:26.569521+0000","last_undegraded":"2024-04-18T05:01:26.569521+0000","last_fullsized":"2024-04-18T05:01:26.569521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'537","last_scrub_stamp":"2024-04-18T05:01:26.569462+0000","last_deep_scrub":"23'537","last_deep_scrub_stamp":"2024-04-18T05:01:26.569462+0000","last_clean_scrub_stamp":"2024-04-18T05:01:26.569462+0000","objects_scrubbed":2,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:45.538877+0000","scrub_duration":0.037341881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"23'425","reported_seq":470,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:16.610669+0000","last_change":"2024-04-18T04:54:41.188664+0000","last_active":"2024-04-18T05:01:16.610669+0000","last_peered":"2024-04-18T05:01:16.610669+0000","last_clean":"2024-04-18T05:01:16.610669+0000","last_became_active":"2024-04-18T04:54:41.188249+0000","last_became_peered":"2024-04-18T04:54:41.188249+0000","last_unstale":"2024-04-18T05:01:16.610669+0000","last_undegraded":"2024-04-18T05:01:16.610669+0000","last_fullsized":"2024-04-18T05:01:16.610669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14420,"num_write":396,"num_write_kb":51045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'78","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:27.370536+0000","last_change":"2024-04-18T05:01:27.370727+0000","last_active":"2024-04-18T05:01:27.370536+0000","last_peered":"2024-04-18T05:01:27.370536+0000","last_clean":"2024-04-18T05:01:27.370536+0000","last_became_active":"2024-04-18T04:54:40.823755+0000","last_became_peered":"2024-04-18T04:54:40.823755+0000","last_unstale":"2024-04-18T05:01:27.370536+0000","last_undegraded":"2024-04-18T05:01:27.370536+0000","last_fullsized":"2024-04-18T05:01:27.370536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'78","last_scrub_stamp":"2024-04-18T05:01:27.370484+0000","last_deep_scrub":"23'78","last_deep_scrub_stamp":"2024-04-18T05:01:27.370484+0000","last_clean_scrub_stamp":"2024-04-18T05:01:27.370484+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:42.945865+0000","scrub_duration":0.0074384159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1706,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'402","reported_seq":447,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:20.557186+0000","last_change":"2024-04-18T05:01:20.557186+0000","last_active":"2024-04-18T05:01:20.557186+0000","last_peered":"2024-04-18T05:01:20.557186+0000","last_clean":"2024-04-18T05:01:20.557186+0000","last_became_active":"2024-04-18T04:54:41.186149+0000","last_became_peered":"2024-04-18T04:54:41.186149+0000","last_unstale":"2024-04-18T05:01:20.557186+0000","last_undegraded":"2024-04-18T05:01:20.557186+0000","last_fullsized":"2024-04-18T05:01:20.557186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'402","last_scrub_stamp":"2024-04-18T05:01:20.556880+0000","last_deep_scrub":"23'402","last_deep_scrub_stamp":"2024-04-18T05:01:20.556880+0000","last_clean_scrub_stamp":"2024-04-18T05:01:20.556880+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:19.736421+0000","scrub_duration":0.0048536480000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7713,"num_write":373,"num_write_kb":46594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'119","reported_seq":183,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:19.748996+0000","last_change":"2024-04-18T05:01:19.749081+0000","last_active":"2024-04-18T05:01:19.748996+0000","last_peered":"2024-04-18T05:01:19.748996+0000","last_clean":"2024-04-18T05:01:19.748996+0000","last_became_active":"2024-04-18T04:54:35.672457+0000","last_became_peered":"2024-04-18T04:54:35.672457+0000","last_unstale":"2024-04-18T05:01:19.748996+0000","last_undegraded":"2024-04-18T05:01:19.748996+0000","last_fullsized":"2024-04-18T05:01:19.748996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2024-04-18T05:01:19.748977+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2024-04-18T05:01:19.748977+0000","last_clean_scrub_stamp":"2024-04-18T05:01:19.748977+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:50.211326+0000","scrub_duration":0.0077953190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'71","reported_seq":87,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:55.662398+0000","last_change":"2024-04-18T04:54:40.802422+0000","last_active":"2024-04-18T05:00:55.662398+0000","last_peered":"2024-04-18T05:00:55.662398+0000","last_clean":"2024-04-18T05:00:55.662398+0000","last_became_active":"2024-04-18T04:54:40.801083+0000","last_became_peered":"2024-04-18T04:54:40.801083+0000","last_unstale":"2024-04-18T05:00:55.662398+0000","last_undegraded":"2024-04-18T05:00:55.662398+0000","last_fullsized":"2024-04-18T05:00:55.662398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'362","reported_seq":383,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.383621+0000","last_change":"2024-04-18T04:54:41.174658+0000","last_active":"2024-04-18T05:01:07.383621+0000","last_peered":"2024-04-18T05:01:07.383621+0000","last_clean":"2024-04-18T05:01:07.383621+0000","last_became_active":"2024-04-18T04:54:41.174391+0000","last_became_peered":"2024-04-18T04:54:41.174391+0000","last_unstale":"2024-04-18T05:01:07.383621+0000","last_undegraded":"2024-04-18T05:01:07.383621+0000","last_fullsized":"2024-04-18T05:01:07.383621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1626,"num_write":331,"num_write_kb":26059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'438","reported_seq":454,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:40.658856+0000","last_change":"2024-04-18T04:54:40.813770+0000","last_active":"2024-04-18T05:00:40.658856+0000","last_peered":"2024-04-18T05:00:40.658856+0000","last_clean":"2024-04-18T05:00:40.658856+0000","last_became_active":"2024-04-18T04:54:40.813396+0000","last_became_peered":"2024-04-18T04:54:40.813396+0000","last_unstale":"2024-04-18T05:00:40.658856+0000","last_undegraded":"2024-04-18T05:00:40.658856+0000","last_fullsized":"2024-04-18T05:00:40.658856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":379,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'410","reported_seq":535,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.439531+0000","last_change":"2024-04-18T05:01:31.439720+0000","last_active":"2024-04-18T05:01:31.439531+0000","last_peered":"2024-04-18T05:01:31.439531+0000","last_clean":"2024-04-18T05:01:31.439531+0000","last_became_active":"2024-04-18T04:54:41.195152+0000","last_became_peered":"2024-04-18T04:54:41.195152+0000","last_unstale":"2024-04-18T05:01:31.439531+0000","last_undegraded":"2024-04-18T05:01:31.439531+0000","last_fullsized":"2024-04-18T05:01:31.439531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'410","last_scrub_stamp":"2024-04-18T05:01:31.439482+0000","last_deep_scrub":"23'410","last_deep_scrub_stamp":"2024-04-18T05:01:31.439482+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.439482+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:15:47.638581+0000","scrub_duration":0.0047366739999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":54989,"num_write":377,"num_write_kb":85155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'434","reported_seq":813,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:27.556454+0000","last_change":"2024-04-18T05:01:27.556643+0000","last_active":"2024-04-18T05:01:27.556454+0000","last_peered":"2024-04-18T05:01:27.556454+0000","last_clean":"2024-04-18T05:01:27.556454+0000","last_became_active":"2024-04-18T04:54:40.818113+0000","last_became_peered":"2024-04-18T04:54:40.818113+0000","last_unstale":"2024-04-18T05:01:27.556454+0000","last_undegraded":"2024-04-18T05:01:27.556454+0000","last_fullsized":"2024-04-18T05:01:27.556454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'434","last_scrub_stamp":"2024-04-18T05:01:27.556398+0000","last_deep_scrub":"23'434","last_deep_scrub_stamp":"2024-04-18T05:01:27.556398+0000","last_clean_scrub_stamp":"2024-04-18T05:01:27.556398+0000","objects_scrubbed":4,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:43.131779+0000","scrub_duration":0.020609295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1456426,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":351,"num_read_kb":1645,"num_write":371,"num_write_kb":1672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'416","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:33.488170+0000","last_change":"2024-04-18T05:01:33.488378+0000","last_active":"2024-04-18T05:01:33.488170+0000","last_peered":"2024-04-18T05:01:33.488170+0000","last_clean":"2024-04-18T05:01:33.488170+0000","last_became_active":"2024-04-18T04:54:41.192187+0000","last_became_peered":"2024-04-18T04:54:41.192187+0000","last_unstale":"2024-04-18T05:01:33.488170+0000","last_undegraded":"2024-04-18T05:01:33.488170+0000","last_fullsized":"2024-04-18T05:01:33.488170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'416","last_scrub_stamp":"2024-04-18T05:01:33.488116+0000","last_deep_scrub":"23'416","last_deep_scrub_stamp":"2024-04-18T05:01:33.488116+0000","last_clean_scrub_stamp":"2024-04-18T05:01:33.488116+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:35.745366+0000","scrub_duration":0.0041304510000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":364,"num_write":388,"num_write_kb":58777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'517","reported_seq":533,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:00:55.662336+0000","last_change":"2024-04-18T04:54:40.820531+0000","last_active":"2024-04-18T05:00:55.662336+0000","last_peered":"2024-04-18T05:00:55.662336+0000","last_clean":"2024-04-18T05:00:55.662336+0000","last_became_active":"2024-04-18T04:54:40.820025+0000","last_became_peered":"2024-04-18T04:54:40.820025+0000","last_unstale":"2024-04-18T05:00:55.662336+0000","last_undegraded":"2024-04-18T05:00:55.662336+0000","last_fullsized":"2024-04-18T05:00:55.662336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":8474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'404","reported_seq":464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.502932+0000","last_change":"2024-04-18T05:01:31.503151+0000","last_active":"2024-04-18T05:01:31.502932+0000","last_peered":"2024-04-18T05:01:31.502932+0000","last_clean":"2024-04-18T05:01:31.502932+0000","last_became_active":"2024-04-18T04:54:41.185257+0000","last_became_peered":"2024-04-18T04:54:41.185257+0000","last_unstale":"2024-04-18T05:01:31.502932+0000","last_undegraded":"2024-04-18T05:01:31.502932+0000","last_fullsized":"2024-04-18T05:01:31.502932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'404","last_scrub_stamp":"2024-04-18T05:01:31.502875+0000","last_deep_scrub":"23'404","last_deep_scrub_stamp":"2024-04-18T05:01:31.502875+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.502875+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:33.760126+0000","scrub_duration":0.0037300290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14216,"num_write":374,"num_write_kb":63531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'63","reported_seq":90,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:22.504178+0000","last_change":"2024-04-18T05:01:22.504434+0000","last_active":"2024-04-18T05:01:22.504178+0000","last_peered":"2024-04-18T05:01:22.504178+0000","last_clean":"2024-04-18T05:01:22.504178+0000","last_became_active":"2024-04-18T04:54:40.824206+0000","last_became_peered":"2024-04-18T04:54:40.824206+0000","last_unstale":"2024-04-18T05:01:22.504178+0000","last_undegraded":"2024-04-18T05:01:22.504178+0000","last_fullsized":"2024-04-18T05:01:22.504178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'63","last_scrub_stamp":"2024-04-18T05:01:22.504121+0000","last_deep_scrub":"23'63","last_deep_scrub_stamp":"2024-04-18T05:01:22.504121+0000","last_clean_scrub_stamp":"2024-04-18T05:01:22.504121+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:27:09.070973+0000","scrub_duration":0.003666192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'433","reported_seq":543,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:33.947094+0000","last_change":"2024-04-18T05:01:33.947327+0000","last_active":"2024-04-18T05:01:33.947094+0000","last_peered":"2024-04-18T05:01:33.947094+0000","last_clean":"2024-04-18T05:01:33.947094+0000","last_became_active":"2024-04-18T04:54:41.195177+0000","last_became_peered":"2024-04-18T04:54:41.195177+0000","last_unstale":"2024-04-18T05:01:33.947094+0000","last_undegraded":"2024-04-18T05:01:33.947094+0000","last_fullsized":"2024-04-18T05:01:33.947094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'433","last_scrub_stamp":"2024-04-18T05:01:33.947042+0000","last_deep_scrub":"23'433","last_deep_scrub_stamp":"2024-04-18T05:01:33.947042+0000","last_clean_scrub_stamp":"2024-04-18T05:01:33.947042+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:27.789977+0000","scrub_duration":0.0045580300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":41457,"num_write":394,"num_write_kb":79356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'328","reported_seq":345,"reported_epoch":23,"state":"active+clean+scrubbing+deep","last_fresh":"2024-04-18T05:01:17.941412+0000","last_change":"2024-04-18T05:01:35.669766+0000","last_active":"2024-04-18T05:01:17.941412+0000","last_peered":"2024-04-18T05:01:17.941412+0000","last_clean":"2024-04-18T05:01:17.941412+0000","last_became_active":"2024-04-18T04:54:40.802902+0000","last_became_peered":"2024-04-18T04:54:40.802902+0000","last_unstale":"2024-04-18T05:01:17.941412+0000","last_undegraded":"2024-04-18T05:01:17.941412+0000","last_fullsized":"2024-04-18T05:01:17.941412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'423","reported_seq":521,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:34.360195+0000","last_change":"2024-04-18T05:01:34.360390+0000","last_active":"2024-04-18T05:01:34.360195+0000","last_peered":"2024-04-18T05:01:34.360195+0000","last_clean":"2024-04-18T05:01:34.360195+0000","last_became_active":"2024-04-18T04:54:41.194965+0000","last_became_peered":"2024-04-18T04:54:41.194965+0000","last_unstale":"2024-04-18T05:01:34.360195+0000","last_undegraded":"2024-04-18T05:01:34.360195+0000","last_fullsized":"2024-04-18T05:01:34.360195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'423","last_scrub_stamp":"2024-04-18T05:01:34.360133+0000","last_deep_scrub":"23'423","last_deep_scrub_stamp":"2024-04-18T05:01:34.360133+0000","last_clean_scrub_stamp":"2024-04-18T05:01:34.360133+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:53.329547+0000","scrub_duration":0.0042417540000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32152,"num_write":386,"num_write_kb":121188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'120","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:23.448961+0000","last_change":"2024-04-18T05:01:23.449160+0000","last_active":"2024-04-18T05:01:23.448961+0000","last_peered":"2024-04-18T05:01:23.448961+0000","last_clean":"2024-04-18T05:01:23.448961+0000","last_became_active":"2024-04-18T04:54:40.798574+0000","last_became_peered":"2024-04-18T04:54:40.798574+0000","last_unstale":"2024-04-18T05:01:23.448961+0000","last_undegraded":"2024-04-18T05:01:23.448961+0000","last_fullsized":"2024-04-18T05:01:23.448961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'120","last_scrub_stamp":"2024-04-18T05:01:23.448909+0000","last_deep_scrub":"23'120","last_deep_scrub_stamp":"2024-04-18T05:01:23.448909+0000","last_clean_scrub_stamp":"2024-04-18T05:01:23.448909+0000","objects_scrubbed":4,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:10.543975+0000","scrub_duration":0.027642872999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'326","reported_seq":343,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:13.653842+0000","last_change":"2024-04-18T04:54:41.191679+0000","last_active":"2024-04-18T05:01:13.653842+0000","last_peered":"2024-04-18T05:01:13.653842+0000","last_clean":"2024-04-18T05:01:13.653842+0000","last_became_active":"2024-04-18T04:54:41.191124+0000","last_became_peered":"2024-04-18T04:54:41.191124+0000","last_unstale":"2024-04-18T05:01:13.653842+0000","last_undegraded":"2024-04-18T05:01:13.653842+0000","last_fullsized":"2024-04-18T05:01:13.653842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":298,"num_write_kb":17144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'80","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:10.665221+0000","last_change":"2024-04-18T04:54:40.804085+0000","last_active":"2024-04-18T05:01:10.665221+0000","last_peered":"2024-04-18T05:01:10.665221+0000","last_clean":"2024-04-18T05:01:10.665221+0000","last_became_active":"2024-04-18T04:54:40.803616+0000","last_became_peered":"2024-04-18T04:54:40.803616+0000","last_unstale":"2024-04-18T05:01:10.665221+0000","last_undegraded":"2024-04-18T05:01:10.665221+0000","last_fullsized":"2024-04-18T05:01:10.665221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:39.764486+0000","last_clean_scrub_stamp":"2024-04-18T04:54:39.764486+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'465","reported_seq":513,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:13.653770+0000","last_change":"2024-04-18T04:54:41.185453+0000","last_active":"2024-04-18T05:01:13.653770+0000","last_peered":"2024-04-18T05:01:13.653770+0000","last_clean":"2024-04-18T05:01:13.653770+0000","last_became_active":"2024-04-18T04:54:41.185217+0000","last_became_peered":"2024-04-18T04:54:41.185217+0000","last_unstale":"2024-04-18T05:01:13.653770+0000","last_undegraded":"2024-04-18T05:01:13.653770+0000","last_fullsized":"2024-04-18T05:01:13.653770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8956,"num_write":434,"num_write_kb":97052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'603","reported_seq":631,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:20.459084+0000","last_change":"2024-04-18T05:01:20.459297+0000","last_active":"2024-04-18T05:01:20.459084+0000","last_peered":"2024-04-18T05:01:20.459084+0000","last_clean":"2024-04-18T05:01:20.459084+0000","last_became_active":"2024-04-18T04:54:40.800598+0000","last_became_peered":"2024-04-18T04:54:40.800598+0000","last_unstale":"2024-04-18T05:01:20.459084+0000","last_undegraded":"2024-04-18T05:01:20.459084+0000","last_fullsized":"2024-04-18T05:01:20.459084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'603","last_scrub_stamp":"2024-04-18T05:01:20.459029+0000","last_deep_scrub":"23'603","last_deep_scrub_stamp":"2024-04-18T05:01:20.459029+0000","last_clean_scrub_stamp":"2024-04-18T05:01:20.459029+0000","objects_scrubbed":2,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:27:07.025881+0000","scrub_duration":0.035046730999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":546,"num_write_kb":4388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'458","reported_seq":516,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:23.654905+0000","last_change":"2024-04-18T05:01:23.655141+0000","last_active":"2024-04-18T05:01:23.654905+0000","last_peered":"2024-04-18T05:01:23.654905+0000","last_clean":"2024-04-18T05:01:23.654905+0000","last_became_active":"2024-04-18T04:54:41.197201+0000","last_became_peered":"2024-04-18T04:54:41.197201+0000","last_unstale":"2024-04-18T05:01:23.654905+0000","last_undegraded":"2024-04-18T05:01:23.654905+0000","last_fullsized":"2024-04-18T05:01:23.654905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'458","last_scrub_stamp":"2024-04-18T05:01:23.654853+0000","last_deep_scrub":"23'458","last_deep_scrub_stamp":"2024-04-18T05:01:23.654853+0000","last_clean_scrub_stamp":"2024-04-18T05:01:23.654853+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:23.362109+0000","scrub_duration":0.0048732259999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21429,"num_write":433,"num_write_kb":71833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'59","reported_seq":87,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:19.349316+0000","last_change":"2024-04-18T05:01:19.349515+0000","last_active":"2024-04-18T05:01:19.349316+0000","last_peered":"2024-04-18T05:01:19.349316+0000","last_clean":"2024-04-18T05:01:19.349316+0000","last_became_active":"2024-04-18T04:54:40.797471+0000","last_became_peered":"2024-04-18T04:54:40.797471+0000","last_unstale":"2024-04-18T05:01:19.349316+0000","last_undegraded":"2024-04-18T05:01:19.349316+0000","last_fullsized":"2024-04-18T05:01:19.349316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'59","last_scrub_stamp":"2024-04-18T05:01:19.349260+0000","last_deep_scrub":"23'59","last_deep_scrub_stamp":"2024-04-18T05:01:19.349260+0000","last_clean_scrub_stamp":"2024-04-18T05:01:19.349260+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:21:43.629003+0000","scrub_duration":0.0068506010000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"23'421","reported_seq":480,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:13.653635+0000","last_change":"2024-04-18T04:54:41.192024+0000","last_active":"2024-04-18T05:01:13.653635+0000","last_peered":"2024-04-18T05:01:13.653635+0000","last_clean":"2024-04-18T05:01:13.653635+0000","last_became_active":"2024-04-18T04:54:41.191488+0000","last_became_peered":"2024-04-18T04:54:41.191488+0000","last_unstale":"2024-04-18T05:01:13.653635+0000","last_undegraded":"2024-04-18T05:01:13.653635+0000","last_fullsized":"2024-04-18T05:01:13.653635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23403,"num_write":390,"num_write_kb":67848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'195","reported_seq":223,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:26.364348+0000","last_change":"2024-04-18T05:01:26.364548+0000","last_active":"2024-04-18T05:01:26.364348+0000","last_peered":"2024-04-18T05:01:26.364348+0000","last_clean":"2024-04-18T05:01:26.364348+0000","last_became_active":"2024-04-18T04:54:40.823277+0000","last_became_peered":"2024-04-18T04:54:40.823277+0000","last_unstale":"2024-04-18T05:01:26.364348+0000","last_undegraded":"2024-04-18T05:01:26.364348+0000","last_fullsized":"2024-04-18T05:01:26.364348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'195","last_scrub_stamp":"2024-04-18T05:01:26.364289+0000","last_deep_scrub":"23'195","last_deep_scrub_stamp":"2024-04-18T05:01:26.364289+0000","last_clean_scrub_stamp":"2024-04-18T05:01:26.364289+0000","objects_scrubbed":3,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:24.955459+0000","scrub_duration":0.028608092000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'448","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:34.619186+0000","last_change":"2024-04-18T05:01:34.619396+0000","last_active":"2024-04-18T05:01:34.619186+0000","last_peered":"2024-04-18T05:01:34.619186+0000","last_clean":"2024-04-18T05:01:34.619186+0000","last_became_active":"2024-04-18T04:54:41.199700+0000","last_became_peered":"2024-04-18T04:54:41.199700+0000","last_unstale":"2024-04-18T05:01:34.619186+0000","last_undegraded":"2024-04-18T05:01:34.619186+0000","last_fullsized":"2024-04-18T05:01:34.619186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'448","last_scrub_stamp":"2024-04-18T05:01:34.619131+0000","last_deep_scrub":"23'448","last_deep_scrub_stamp":"2024-04-18T05:01:34.619131+0000","last_clean_scrub_stamp":"2024-04-18T05:01:34.619131+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:53.588546+0000","scrub_duration":0.003693375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":10662,"num_write":420,"num_write_kb":96864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'131","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:34.721575+0000","last_change":"2024-04-18T05:01:34.721856+0000","last_active":"2024-04-18T05:01:34.721575+0000","last_peered":"2024-04-18T05:01:34.721575+0000","last_clean":"2024-04-18T05:01:34.721575+0000","last_became_active":"2024-04-18T04:54:40.800405+0000","last_became_peered":"2024-04-18T04:54:40.800405+0000","last_unstale":"2024-04-18T05:01:34.721575+0000","last_undegraded":"2024-04-18T05:01:34.721575+0000","last_fullsized":"2024-04-18T05:01:34.721575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-04-18T05:01:34.721521+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-04-18T05:01:34.721521+0000","last_clean_scrub_stamp":"2024-04-18T05:01:34.721521+0000","objects_scrubbed":4,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:06.452051+0000","scrub_duration":0.044336153000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":8237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'441","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:18.559227+0000","last_change":"2024-04-18T05:01:18.559314+0000","last_active":"2024-04-18T05:01:18.559227+0000","last_peered":"2024-04-18T05:01:18.559227+0000","last_clean":"2024-04-18T05:01:18.559227+0000","last_became_active":"2024-04-18T04:54:41.186301+0000","last_became_peered":"2024-04-18T04:54:41.186301+0000","last_unstale":"2024-04-18T05:01:18.559227+0000","last_undegraded":"2024-04-18T05:01:18.559227+0000","last_fullsized":"2024-04-18T05:01:18.559227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'441","last_scrub_stamp":"2024-04-18T05:01:18.559208+0000","last_deep_scrub":"23'441","last_deep_scrub_stamp":"2024-04-18T05:01:18.559208+0000","last_clean_scrub_stamp":"2024-04-18T05:01:18.559208+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:58.993043+0000","scrub_duration":0.0020339099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":27247,"num_write":409,"num_write_kb":76591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"23'382","reported_seq":419,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:24.698410+0000","last_change":"2024-04-18T05:01:24.698605+0000","last_active":"2024-04-18T05:01:24.698410+0000","last_peered":"2024-04-18T05:01:24.698410+0000","last_clean":"2024-04-18T05:01:24.698410+0000","last_became_active":"2024-04-18T04:54:41.192941+0000","last_became_peered":"2024-04-18T04:54:41.192941+0000","last_unstale":"2024-04-18T05:01:24.698410+0000","last_undegraded":"2024-04-18T05:01:24.698410+0000","last_fullsized":"2024-04-18T05:01:24.698410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'382","last_scrub_stamp":"2024-04-18T05:01:24.698356+0000","last_deep_scrub":"23'382","last_deep_scrub_stamp":"2024-04-18T05:01:24.698356+0000","last_clean_scrub_stamp":"2024-04-18T05:01:24.698356+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:15.097966+0000","scrub_duration":0.0038559670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4755,"num_write":342,"num_write_kb":72428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'361","reported_seq":388,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:28.505253+0000","last_change":"2024-04-18T05:01:28.505483+0000","last_active":"2024-04-18T05:01:28.505253+0000","last_peered":"2024-04-18T05:01:28.505253+0000","last_clean":"2024-04-18T05:01:28.505253+0000","last_became_active":"2024-04-18T04:54:40.799517+0000","last_became_peered":"2024-04-18T04:54:40.799517+0000","last_unstale":"2024-04-18T05:01:28.505253+0000","last_undegraded":"2024-04-18T05:01:28.505253+0000","last_fullsized":"2024-04-18T05:01:28.505253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'361","last_scrub_stamp":"2024-04-18T05:01:28.505196+0000","last_deep_scrub":"23'361","last_deep_scrub_stamp":"2024-04-18T05:01:28.505196+0000","last_clean_scrub_stamp":"2024-04-18T05:01:28.505196+0000","objects_scrubbed":4,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:28.212451+0000","scrub_duration":0.040738904999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"23'382","reported_seq":433,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:34.697411+0000","last_change":"2024-04-18T05:01:34.697686+0000","last_active":"2024-04-18T05:01:34.697411+0000","last_peered":"2024-04-18T05:01:34.697411+0000","last_clean":"2024-04-18T05:01:34.697411+0000","last_became_active":"2024-04-18T04:54:41.179359+0000","last_became_peered":"2024-04-18T04:54:41.179359+0000","last_unstale":"2024-04-18T05:01:34.697411+0000","last_undegraded":"2024-04-18T05:01:34.697411+0000","last_fullsized":"2024-04-18T05:01:34.697411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'382","last_scrub_stamp":"2024-04-18T05:01:34.697296+0000","last_deep_scrub":"23'382","last_deep_scrub_stamp":"2024-04-18T05:01:34.697296+0000","last_clean_scrub_stamp":"2024-04-18T05:01:34.697296+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:15.131132+0000","scrub_duration":0.0047097220000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14401,"num_write":356,"num_write_kb":79542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'299","reported_seq":326,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:29.589971+0000","last_change":"2024-04-18T05:01:29.590183+0000","last_active":"2024-04-18T05:01:29.589971+0000","last_peered":"2024-04-18T05:01:29.589971+0000","last_clean":"2024-04-18T05:01:29.589971+0000","last_became_active":"2024-04-18T04:54:40.800660+0000","last_became_peered":"2024-04-18T04:54:40.800660+0000","last_unstale":"2024-04-18T05:01:29.589971+0000","last_undegraded":"2024-04-18T05:01:29.589971+0000","last_fullsized":"2024-04-18T05:01:29.589971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'299","last_scrub_stamp":"2024-04-18T05:01:29.589913+0000","last_deep_scrub":"23'299","last_deep_scrub_stamp":"2024-04-18T05:01:29.589913+0000","last_clean_scrub_stamp":"2024-04-18T05:01:29.589913+0000","objects_scrubbed":10,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:19.989522+0000","scrub_duration":0.076672561,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":12441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'366","reported_seq":410,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.412087+0000","last_change":"2024-04-18T04:54:41.190055+0000","last_active":"2024-04-18T05:01:07.412087+0000","last_peered":"2024-04-18T05:01:07.412087+0000","last_clean":"2024-04-18T05:01:07.412087+0000","last_became_active":"2024-04-18T04:54:41.189344+0000","last_became_peered":"2024-04-18T04:54:41.189344+0000","last_unstale":"2024-04-18T05:01:07.412087+0000","last_undegraded":"2024-04-18T05:01:07.412087+0000","last_fullsized":"2024-04-18T05:01:07.412087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10936,"num_write":342,"num_write_kb":51086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'87","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:25.570678+0000","last_change":"2024-04-18T05:01:25.570947+0000","last_active":"2024-04-18T05:01:25.570678+0000","last_peered":"2024-04-18T05:01:25.570678+0000","last_clean":"2024-04-18T05:01:25.570678+0000","last_became_active":"2024-04-18T04:54:40.813290+0000","last_became_peered":"2024-04-18T04:54:40.813290+0000","last_unstale":"2024-04-18T05:01:25.570678+0000","last_undegraded":"2024-04-18T05:01:25.570678+0000","last_fullsized":"2024-04-18T05:01:25.570678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'87","last_scrub_stamp":"2024-04-18T05:01:25.570624+0000","last_deep_scrub":"23'87","last_deep_scrub_stamp":"2024-04-18T05:01:25.570624+0000","last_clean_scrub_stamp":"2024-04-18T05:01:25.570624+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:06.004459+0000","scrub_duration":0.021566535000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'407","reported_seq":465,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.518150+0000","last_change":"2024-04-18T05:01:31.518368+0000","last_active":"2024-04-18T05:01:31.518150+0000","last_peered":"2024-04-18T05:01:31.518150+0000","last_clean":"2024-04-18T05:01:31.518150+0000","last_became_active":"2024-04-18T04:54:41.192096+0000","last_became_peered":"2024-04-18T04:54:41.192096+0000","last_unstale":"2024-04-18T05:01:31.518150+0000","last_undegraded":"2024-04-18T05:01:31.518150+0000","last_fullsized":"2024-04-18T05:01:31.518150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'407","last_scrub_stamp":"2024-04-18T05:01:31.518099+0000","last_deep_scrub":"23'407","last_deep_scrub_stamp":"2024-04-18T05:01:31.518099+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.518099+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:21.917708+0000","scrub_duration":0.0045801699999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17335,"num_write":380,"num_write_kb":68515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'137","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:36.398640+0000","last_change":"2024-04-18T05:01:36.398858+0000","last_active":"2024-04-18T05:01:36.398640+0000","last_peered":"2024-04-18T05:01:36.398640+0000","last_clean":"2024-04-18T05:01:36.398640+0000","last_became_active":"2024-04-18T04:54:40.804913+0000","last_became_peered":"2024-04-18T04:54:40.804913+0000","last_unstale":"2024-04-18T05:01:36.398640+0000","last_undegraded":"2024-04-18T05:01:36.398640+0000","last_fullsized":"2024-04-18T05:01:36.398640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'137","last_scrub_stamp":"2024-04-18T05:01:36.398585+0000","last_deep_scrub":"23'137","last_deep_scrub_stamp":"2024-04-18T05:01:36.398585+0000","last_clean_scrub_stamp":"2024-04-18T05:01:36.398585+0000","objects_scrubbed":7,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:26:25.377881+0000","scrub_duration":0.026464031999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2494,"num_read_kb":1324974,"num_write":24555,"num_write_kb":4507656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26500,"ondisk_log_size":26500,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":130916242,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":351,"num_read_kb":1645,"num_write":7226,"num_write_kb":133419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20000,"num_omap_keys":40,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":100597760,"data_stored":261832484,"data_compressed":36635560,"data_compressed_allocated":47603712,"data_compressed_original":209084416,"omap_allocated":0,"internal_metadata":0},"log_size":8922,"ondisk_log_size":8922,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509527,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":5676,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":5812224,"data_stored":14125282,"data_compressed":1836351,"data_compressed_allocated":2379776,"data_compressed_original":10878976,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77800000000000002,"15min":0.83599999999999997},"min":{"1min":0.40100000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.1639999999999999,"5min":1.1910000000000001,"15min":1.2490000000000001},"last":0.749},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.79100000000000004,"15min":0.83999999999999997},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1259999999999999,"5min":1.262,"15min":1.262},"last":1.071}]},{"osd":1,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0660000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.871},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.82899999999999996,"15min":0.84299999999999997},"min":{"1min":0.46500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.226,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.91600000000000004,"15min":0.89000000000000001},"min":{"1min":0.53700000000000003,"5min":0.438,"15min":0.438},"max":{"1min":1.2270000000000001,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86899999999999999,"15min":0.86499999999999999},"min":{"1min":0.48299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1890000000000001,"5min":1.379,"15min":1.4019999999999999},"last":0.84499999999999997}]},{"osd":3,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1890000000000001,"5min":1.458,"15min":1.458},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.97899999999999998,"15min":0.95099999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.248,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.91700000000000004,"15min":0.93100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.1479999999999999,"5min":1.605,"15min":1.605},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.91900000000000004,"15min":0.91100000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.175,"5min":1.546,"15min":1.546},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.98799999999999999,"15min":1.018},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2090000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.998,"15min":1.02},"min":{"1min":0.45000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.236,"5min":1.431,"15min":1.5640000000000001},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Apr 18 05:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.0800000000000001,"15min":1.1120000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.28,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.018},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.0609999999999999,"15min":1.048},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.236,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.92600000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509527,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47056,"kb_used_data":7752,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94324784,"statfs":{"total":96636764160,"available":96588578816,"internally_reserved":0,"allocated":7938048,"data_stored":21059926,"data_compressed":3027129,"data_compressed_allocated":3776512,"data_compressed_original":17063936,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.76000000000000001,"15min":0.77600000000000002},"min":{"1min":0.61899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0800000000000001,"5min":1.125,"15min":1.125},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.81299999999999994,"15min":0.85099999999999998},"min":{"1min":0.58599999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0469999999999999,"5min":1.1870000000000001,"15min":1.353},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.84999999999999998,"15min":0.93799999999999994},"min":{"1min":0.68700000000000006,"5min":0.312,"15min":0.312},"max":{"1min":1.1519999999999999,"5min":1.268,"15min":1.8560000000000001},"last":1.105},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.82099999999999995,"15min":0.85099999999999998},"min":{"1min":0.74099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.038,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.96299999999999997}]},{"osd":2,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.94599999999999995,"15min":0.93600000000000005},"min":{"1min":0.92900000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1919999999999999,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.66000000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1910000000000001,"5min":1.325,"15min":1.325},"last":0.89900000000000002}]},{"osd":3,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.91600000000000004,"15min":0.90500000000000003},"min":{"1min":0.68200000000000005,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.159,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.93899999999999995,"15min":0.98899999999999999},"min":{"1min":0.80800000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1699999999999999,"5min":1.617,"15min":1.617},"last":1.1339999999999999}]},{"osd":4,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.88900000000000001,"15min":0.97899999999999998},"min":{"1min":0.64600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2789999999999999,"5min":1.4990000000000001,"15min":1.631},"last":1.008},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97699999999999998,"15min":1.0589999999999999},"min":{"1min":0.71399999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.145,"5min":1.631,"15min":1.631},"last":1.0349999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.98799999999999999,"15min":1.008},"min":{"1min":0.77300000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.3320000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.0189999999999999,"15min":1.0449999999999999},"min":{"1min":0.73499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.163,"5min":1.673,"15min":1.6739999999999999},"last":1.071}]},{"osd":7,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0509999999999999,"15min":1.107},"min":{"1min":0.69799999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.248,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.153},{"interface":"front","average":{"1min":1.05,"5min":1.0860000000000001,"15min":1.1120000000000001},"min":{"1min":0.78600000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2649999999999999,"5min":1.73,"15min":1.7769999999999999},"last":1.228}]}]},{"osd":5,"up_from":15,"seq":64424509526,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66536,"kb_used_data":13280,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94305304,"statfs":{"total":96636764160,"available":96568631296,"internally_reserved":0,"allocated":13598720,"data_stored":35687478,"data_compressed":4904028,"data_compressed_allocated":6356992,"data_compressed_original":28622848,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.76100000000000001,"15min":0.89100000000000001},"min":{"1min":0.57499999999999996,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1499999999999999,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.054},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.79000000000000004,"15min":0.82599999999999996},"min":{"1min":0.60599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.3340000000000001,"5min":1.542,"15min":1.542},"last":0.96199999999999997}]},{"osd":1,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.91200000000000003,"15min":0.91800000000000004},"min":{"1min":0.58799999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.24,"5min":9.8819999999999997,"15min":9.8819999999999997},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.006,"5min":0.89100000000000001,"15min":0.92700000000000005},"min":{"1min":0.626,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.355,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":0.92900000000000005}]},{"osd":2,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.88400000000000001,"15min":0.89000000000000001},"min":{"1min":0.60899999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.177,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.97399999999999998,"15min":0.94799999999999995},"min":{"1min":0.68200000000000005,"5min":0.38,"15min":0.38},"max":{"1min":1.214,"5min":10.031000000000001,"15min":10.031000000000001},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.91700000000000004,"15min":0.95999999999999996},"min":{"1min":0.72899999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.284,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.113},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.97599999999999998,"15min":1.014},"min":{"1min":0.72799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2789999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.006,"15min":0.91900000000000004},"min":{"1min":0.63700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.3759999999999999,"5min":9.968,"15min":9.968},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.96899999999999997,"15min":1.02},"min":{"1min":0.624,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.399,"5min":1.631,"15min":1.8440000000000001},"last":1.1739999999999999}]},{"osd":6,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.006,"15min":0.96099999999999997},"min":{"1min":0.60899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4159999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.1020000000000001,"15min":1.036},"min":{"1min":0.752,"5min":0.371,"15min":0.371},"max":{"1min":1.4550000000000001,"5min":10.09,"15min":10.09},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0629999999999999,"15min":1.103},"min":{"1min":0.77800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.528,"5min":1.7050000000000001,"15min":1.944},"last":1.244},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.129,"15min":1.151},"min":{"1min":0.72199999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.7070000000000001,"5min":1.97,"15min":1.97},"last":1.087}]}]},{"osd":3,"up_from":15,"seq":64424509527,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77376,"kb_used_data":20024,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94294464,"statfs":{"total":96636764160,"available":96557531136,"internally_reserved":0,"allocated":20504576,"data_stored":54614164,"data_compressed":7702565,"data_compressed_allocated":9973760,"data_compressed_original":44273664,"omap_allocated":1592,"internal_metadata":58718664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.628,"15min":0.67400000000000004},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.98099999999999998,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63100000000000001,"15min":0.61699999999999999},"min":{"1min":0.29499999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.91000000000000003,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61899999999999999,"15min":0.63500000000000001},"min":{"1min":0.31900000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.0920000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73699999999999999,"15min":0.69699999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.0720000000000001,"5min":2.601,"15min":2.601},"last":0.89800000000000002}]},{"osd":2,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.73099999999999998,"15min":0.73399999999999999},"min":{"1min":0.34399999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.359,"5min":1.573,"15min":1.573},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1339999999999999,"5min":1.51,"15min":1.51},"last":0.74099999999999999}]},{"osd":4,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.86399999999999999,"15min":0.85799999999999998},"min":{"1min":0.46600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.202,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.91400000000000003,"15min":0.93600000000000005},"min":{"1min":0.59399999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4199999999999999,"5min":1.524,"15min":1.524},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.61499999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.252,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.872},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.008,"15min":1.028},"min":{"1min":0.47899999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.292,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.96399999999999997}]},{"osd":6,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.98299999999999998,"15min":0.97199999999999998},"min":{"1min":0.72599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.282,"5min":1.512,"15min":1.512},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.02,"15min":1.0489999999999999},"min":{"1min":0.72699999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.327,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.98999999999999999}]},{"osd":7,"last update":"Thu Apr 18 05:00:45 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0600000000000001,"15min":1.1100000000000001},"min":{"1min":0.66700000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.371,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1.036},{"interface":"front","average":{"1min":1.046,"5min":1.0289999999999999,"15min":1.0580000000000001},"min":{"1min":0.60799999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.341,"5min":1.583,"15min":1.583},"last":1.0129999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509526,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59832,"kb_used_data":14768,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94312008,"statfs":{"total":96636764160,"available":96575496192,"internally_reserved":0,"allocated":15122432,"data_stored":34231216,"data_compressed":4539223,"data_compressed_allocated":6156288,"data_compressed_original":25436160,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63500000000000001,"15min":0.59099999999999997},"min":{"1min":0.38300000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.98699999999999999,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.495},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.73999999999999999},"min":{"1min":0.29899999999999999,"5min":0.214,"15min":0.214},"max":{"1min":1.1970000000000001,"5min":1.5920000000000001,"15min":1.9239999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66400000000000003,"15min":0.68400000000000005},"min":{"1min":0.432,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.88200000000000001,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.696,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.755,"15min":0.78200000000000003},"min":{"1min":0.46800000000000003,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.8400000000000001,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.78200000000000003,"15min":0.77700000000000002},"min":{"1min":0.49099999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.7989999999999999,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":0.94399999999999995}]},{"osd":4,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.92800000000000005,"15min":0.94799999999999995},"min":{"1min":0.56000000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.107,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.98499999999999999,"15min":0.98199999999999998},"min":{"1min":0.72299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.786,"5min":2.133,"15min":2.133},"last":0.90000000000000002}]},{"osd":5,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.98099999999999998,"15min":1.0069999999999999},"min":{"1min":0.72399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":1.292,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":1.056},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.98099999999999998,"15min":0.98499999999999999},"min":{"1min":0.626,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.274,"5min":2.347,"15min":2.347},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":0.98799999999999999,"15min":1.02},"min":{"1min":0.65400000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.024,"5min":3.024,"15min":3.024},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.997,"5min":1.0409999999999999,"15min":1.0669999999999999},"min":{"1min":0.67800000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.288,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.79400000000000004}]},{"osd":7,"last update":"Thu Apr 18 05:00:37 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0600000000000001,"15min":1.0760000000000001},"min":{"1min":0.80200000000000005,"5min":0.497,"15min":0.497},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":1.196},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0860000000000001,"15min":1.109},"min":{"1min":0.76100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3680000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.92400000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509528,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78896,"kb_used_data":21544,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94292944,"statfs":{"total":96636764160,"available":96555974656,"internally_reserved":0,"allocated":22061056,"data_stored":54614568,"data_compressed":7565653,"data_compressed_allocated":10006528,"data_compressed_original":42741760,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.63400000000000001,"15min":0.58599999999999997},"min":{"1min":0.318,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":2.177,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.623,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.224,"15min":0.224},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.67300000000000004}]},{"osd":2,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69099999999999995,"15min":0.65900000000000003},"min":{"1min":0.433,"5min":0.22,"15min":0.22},"max":{"1min":1.4339999999999999,"5min":2.629,"15min":2.629},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.67500000000000004,"15min":0.64500000000000002},"min":{"1min":0.44600000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.96299999999999997}]},{"osd":3,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.70799999999999996,"15min":0.60699999999999998},"min":{"1min":0.38300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.575,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.81399999999999995,"15min":0.749},"min":{"1min":0.39500000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.3690000000000002,"5min":3.375,"15min":3.375},"last":0.72399999999999998}]},{"osd":4,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6859999999999999,"5min":2.601,"15min":2.601},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.05,"5min":0.93899999999999995,"15min":0.92500000000000004},"min":{"1min":0.48699999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.2559999999999998,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.92200000000000004,"15min":0.90500000000000003},"min":{"1min":0.76500000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.024},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.95999999999999996,"15min":0.94499999999999995},"min":{"1min":0.73299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.758,"5min":2.734,"15min":2.734},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.016,"15min":0.98499999999999999},"min":{"1min":0.77100000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.3149999999999999,"5min":2.681,"15min":2.681},"last":0.999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":0.997,"15min":1.0149999999999999},"min":{"1min":0.81699999999999995,"5min":0.499,"15min":0.499},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":0.753}]},{"osd":7,"last update":"Thu Apr 18 05:00:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.83199999999999996,"5min":0.496,"15min":0.496},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":0.878},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.03,"15min":0.97399999999999998},"min":{"1min":0.65900000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.831,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":1.105}]}]},{"osd":4,"up_from":13,"seq":55834574936,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47916,"kb_used_data":8612,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94323924,"statfs":{"total":96636764160,"available":96587698176,"internally_reserved":0,"allocated":8818688,"data_stored":24681186,"data_compressed":3524620,"data_compressed_allocated":4517888,"data_compressed_original":20582400,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.75,"15min":0.88900000000000001},"min":{"1min":0.48099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.05,"5min":1.1579999999999999,"15min":1.3080000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.74099999999999999,"15min":0.83199999999999996},"min":{"1min":0.57099999999999995,"5min":0.318,"15min":0.318},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.77400000000000002}]},{"osd":1,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81200000000000006,"15min":0.875},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.149,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.88},{"interface":"front","average":{"1min":0.876,"5min":0.80500000000000005,"15min":0.86299999999999999},"min":{"1min":0.50600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.097,"5min":1.246,"15min":1.246},"last":0.98799999999999999}]},{"osd":2,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.57699999999999996,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92800000000000005,"15min":0.96899999999999997},"min":{"1min":0.53600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1379999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.81599999999999995}]},{"osd":3,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.80600000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.651,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.68600000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2130000000000001,"5min":3.6280000000000001,"15min":3.6280000000000001},"last":1.0229999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95199999999999996,"15min":0.93600000000000005},"min":{"1min":0.47899999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":1.008,"15min":1.054},"min":{"1min":0.58999999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.1240000000000001}]},{"osd":6,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.92000000000000004,"15min":1.006},"min":{"1min":0.61599999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.1890000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.022,"5min":1.0329999999999999,"15min":1.0589999999999999},"min":{"1min":0.56399999999999995,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.5980000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.1479999999999999}]},{"osd":7,"last update":"Thu Apr 18 05:00:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.101,"15min":1.141},"min":{"1min":0.72999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.246,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.087},{"interface":"front","average":{"1min":1.069,"5min":1.1180000000000001,"15min":1.1479999999999999},"min":{"1min":0.63300000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5409999999999999,"5min":3.9910000000000001,"15min":3.9910000000000001},"last":1.1080000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":8536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":8740864,"data_stored":24679416,"data_compressed":3602361,"data_compressed_allocated":4526080,"data_compressed_original":20631552,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.56499999999999995},"min":{"1min":0.42499999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.93799999999999994,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.64400000000000002,"15min":0.69699999999999995},"min":{"1min":0.45200000000000001,"5min":0.193,"15min":0.193},"max":{"1min":1.034,"5min":1.347,"15min":1.347},"last":0.93200000000000005}]},{"osd":1,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67600000000000005,"15min":0.67200000000000004},"min":{"1min":0.53300000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.024,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.628},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68000000000000005,"15min":0.66600000000000004},"min":{"1min":0.433,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.022,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.67300000000000004,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1140000000000001,"5min":1.29,"15min":1.29},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.65800000000000003,"15min":0.64200000000000002},"min":{"1min":0.48799999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0149999999999999,"5min":1.034,"15min":1.034},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.91800000000000004,"15min":0.95299999999999996},"min":{"1min":0.79100000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.1930000000000001,"5min":2.456,"15min":2.456},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.85099999999999998,"15min":0.873},"min":{"1min":0.57099999999999995,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2889999999999999,"5min":1.454,"15min":1.6950000000000001},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.96899999999999997,"15min":0.94399999999999995},"min":{"1min":0.78500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4279999999999999,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.93500000000000005,"15min":0.98699999999999999},"min":{"1min":0.81999999999999995,"5min":0.373,"15min":0.373},"max":{"1min":1.234,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.1599999999999999}]},{"osd":6,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.80500000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3440000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.117},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0329999999999999,"15min":0.98099999999999998},"min":{"1min":0.84799999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.506,"5min":3.391,"15min":3.391},"last":0.878}]},{"osd":7,"last update":"Thu Apr 18 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.99099999999999999,"15min":1.0289999999999999},"min":{"1min":0.84999999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.25,"5min":1.4259999999999999,"15min":1.4990000000000001},"last":1.022},{"interface":"front","average":{"1min":1.052,"5min":0.98899999999999999,"15min":0.97499999999999998},"min":{"1min":0.71199999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.3160000000000001,"5min":1.748,"15min":1.748},"last":1.0469999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21827584,"data_stored":54529566,"data_compressed":7565653,"data_compressed_allocated":10006528,"data_compressed_original":42741760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14823424,"data_stored":33555846,"data_compressed":4506038,"data_compressed_allocated":6111232,"data_compressed_original":24862720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8507392,"data_stored":24594414,"data_compressed":3602361,"data_compressed_allocated":4526080,"data_compressed_original":20631552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20271104,"data_stored":54529162,"data_compressed":7702565,"data_compressed_allocated":9973760,"data_compressed_original":44273664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8585216,"data_stored":24596184,"data_compressed":3524620,"data_compressed_allocated":4517888,"data_compressed_original":20582400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13299712,"data_stored":35012108,"data_compressed":4870843,"data_compressed_allocated":6311936,"data_compressed_original":28049408,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7704576,"data_stored":20974924,"data_compressed":3027129,"data_compressed_allocated":3776512,"data_compressed_original":17063936,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5578752,"data_stored":14040280,"data_compressed":1836351,"data_compressed_allocated":2379776,"data_compressed_original":10878976,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T05:01:40.434 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.434 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.434 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.434 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.434 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.434 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.435 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.435 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.435 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.435 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.435 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.435 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.435 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.435 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.435 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.435 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.436 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.436 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.436 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.436 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.436 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.436 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.436 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.436 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.436 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.437 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.437 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.437 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.437 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.437 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.437 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.437 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.437 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.438 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.438 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.438 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.438 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.438 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.439 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.439 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.439 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.439 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.439 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.439 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-18T04:54:39.764486+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=39, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.439 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.439 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.440 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:01:40.440 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T05:01:48.786 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T05:01:48.789 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T05:02:00.441 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T05:02:00.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.570+0000 7faa86f09640 1 Processor -- start 2024-04-18T05:02:00.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.574+0000 7faa86f09640 1 -- start start 2024-04-18T05:02:00.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.574+0000 7faa86f09640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faa80153180 0x7faa80159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:00.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.574+0000 7faa86f09640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa80159700 con 0x7faa800707c0 2024-04-18T05:02:00.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.574+0000 7faa86f09640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa80070be0 con 0x7faa800700e0 2024-04-18T05:02:00.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.574+0000 7faa86f09640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa800c6390 con 0x7faa80153180 2024-04-18T05:02:00.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.574+0000 7faa84ca5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faa80153180 0x7faa80159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:00.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.574+0000 7faa84ca5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faa80153180 0x7faa80159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35392/0 (socket says 172.21.15.96:35392) 2024-04-18T05:02:00.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.574+0000 7faa84ca5640 1 -- 172.21.15.96:0/385419204 learned_addr learned my addr 172.21.15.96:0/385419204 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:00.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.574+0000 7faa84ca5640 1 -- 172.21.15.96:0/385419204 >> v1:172.21.15.139:6789/0 conn(0x7faa800700e0 legacy=0x7faa8015c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:02:00.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.574+0000 7faa84ca5640 1 -- 172.21.15.96:0/385419204 >> v1:172.21.15.96:6789/0 conn(0x7faa800707c0 legacy=0x7faa800ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:00.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.574+0000 7faa84ca5640 1 -- 172.21.15.96:0/385419204 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8015cf80 con 0x7faa80153180 2024-04-18T05:02:00.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa84ca5640 1 --2- 172.21.15.96:0/385419204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa80153180 0x7faa80159b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faa78009e50 tx=0x7faa7801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a61635e9626345 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:00.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa7f7fe640 1 -- 172.21.15.96:0/385419204 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa780af400 con 0x7faa80153180 2024-04-18T05:02:00.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa7f7fe640 1 -- 172.21.15.96:0/385419204 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa780ab050 con 0x7faa80153180 2024-04-18T05:02:00.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa7f7fe640 1 -- 172.21.15.96:0/385419204 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa780af780 con 0x7faa80153180 2024-04-18T05:02:00.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa86f09640 1 -- 172.21.15.96:0/385419204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa80153180 msgr2=0x7faa80159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:00.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa86f09640 1 --2- 172.21.15.96:0/385419204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa80153180 0x7faa80159b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faa78009e50 tx=0x7faa7801f1e0 comp rx=0 tx=0).stop 2024-04-18T05:02:00.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa86f09640 1 -- 172.21.15.96:0/385419204 shutdown_connections 2024-04-18T05:02:00.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa86f09640 1 --2- 172.21.15.96:0/385419204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa80153180 0x7faa80159b90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:00.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa86f09640 1 -- 172.21.15.96:0/385419204 >> 172.21.15.96:0/385419204 conn(0x7faa8006c750 msgr2=0x7faa800c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:00.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa86f09640 1 -- 172.21.15.96:0/385419204 shutdown_connections 2024-04-18T05:02:00.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa86f09640 1 -- 172.21.15.96:0/385419204 wait complete. 2024-04-18T05:02:00.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa86f09640 1 Processor -- start 2024-04-18T05:02:00.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa86f09640 1 -- start start 2024-04-18T05:02:00.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa86f09640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa800700e0 0x7faa80150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:00.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa86f09640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa800707c0 0x7faa8014f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:00.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa86f09640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa80153180 0x7faa80148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:00.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa86f09640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8015bba0 con 0x7faa80153180 2024-04-18T05:02:00.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa86f09640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8014e480 con 0x7faa800700e0 2024-04-18T05:02:00.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa86f09640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8015a1a0 con 0x7faa800707c0 2024-04-18T05:02:00.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa854a6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa80153180 0x7faa80148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:00.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa854a6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa80153180 0x7faa80148140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35396/0 (socket says 172.21.15.96:35396) 2024-04-18T05:02:00.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa854a6640 1 -- 172.21.15.96:0/1136740382 learned_addr learned my addr 172.21.15.96:0/1136740382 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:00.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa84ca5640 1 --2- 172.21.15.96:0/1136740382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa800700e0 0x7faa80150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:00.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa7ffff640 1 --2- 172.21.15.96:0/1136740382 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa800707c0 0x7faa8014f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:00.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa854a6640 1 -- 172.21.15.96:0/1136740382 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa800707c0 msgr2=0x7faa8014f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:00.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa854a6640 1 --2- 172.21.15.96:0/1136740382 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa800707c0 0x7faa8014f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:00.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.578+0000 7faa854a6640 1 -- 172.21.15.96:0/1136740382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa800700e0 msgr2=0x7faa80150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:00.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.582+0000 7faa854a6640 1 --2- 172.21.15.96:0/1136740382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa800700e0 0x7faa80150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:00.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.582+0000 7faa854a6640 1 -- 172.21.15.96:0/1136740382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa78009b30 con 0x7faa80153180 2024-04-18T05:02:00.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.582+0000 7faa84ca5640 1 --2- 172.21.15.96:0/1136740382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa800700e0 0x7faa80150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T05:02:00.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.582+0000 7faa854a6640 1 --2- 172.21.15.96:0/1136740382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa80153180 0x7faa80148140 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faa7000c460 tx=0x7faa7000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:00.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.582+0000 7faa7d7fa640 1 -- 172.21.15.96:0/1136740382 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70005220 con 0x7faa80153180 2024-04-18T05:02:00.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.582+0000 7faa7d7fa640 1 -- 172.21.15.96:0/1136740382 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa70005380 con 0x7faa80153180 2024-04-18T05:02:00.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.582+0000 7faa86f09640 1 -- 172.21.15.96:0/1136740382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8015a420 con 0x7faa80153180 2024-04-18T05:02:00.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.582+0000 7faa7d7fa640 1 -- 172.21.15.96:0/1136740382 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70007270 con 0x7faa80153180 2024-04-18T05:02:00.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.582+0000 7faa86f09640 1 -- 172.21.15.96:0/1136740382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8014e6d0 con 0x7faa80153180 2024-04-18T05:02:00.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.582+0000 7faa86f09640 1 -- 172.21.15.96:0/1136740382 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa80067050 con 0x7faa80153180 2024-04-18T05:02:00.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.582+0000 7faa7d7fa640 1 -- 172.21.15.96:0/1136740382 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faa700073d0 con 0x7faa80153180 2024-04-18T05:02:00.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.582+0000 7faa7d7fa640 1 --2- 172.21.15.96:0/1136740382 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa6c066690 0x7faa6c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:00.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.582+0000 7faa7d7fa640 1 -- 172.21.15.96:0/1136740382 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7faa700839d0 con 0x7faa80153180 2024-04-18T05:02:00.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.582+0000 7faa84ca5640 1 --2- 172.21.15.96:0/1136740382 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa6c066690 0x7faa6c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:00.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.582+0000 7faa84ca5640 1 --2- 172.21.15.96:0/1136740382 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa6c066690 0x7faa6c068b50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7faa780b1000 tx=0x7faa780aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:00.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.586+0000 7faa7d7fa640 1 -- 172.21.15.96:0/1136740382 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7faa70050db0 con 0x7faa80153180 2024-04-18T05:02:00.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.742+0000 7faa86f09640 1 -- 172.21.15.96:0/1136740382 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa801590f0 con 0x7faa6c066690 2024-04-18T05:02:00.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.758+0000 7faa7d7fa640 1 -- 172.21.15.96:0/1136740382 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+291663 (secure 0 0 0) 0x7faa780af580 con 0x7faa6c066690 2024-04-18T05:02:00.761 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T05:02:00.763 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T05:02:00.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.762+0000 7faa86f09640 1 -- 172.21.15.96:0/1136740382 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa6c066690 msgr2=0x7faa6c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:00.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.762+0000 7faa86f09640 1 --2- 172.21.15.96:0/1136740382 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa6c066690 0x7faa6c068b50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7faa780b1000 tx=0x7faa780aa000 comp rx=0 tx=0).stop 2024-04-18T05:02:00.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.762+0000 7faa86f09640 1 -- 172.21.15.96:0/1136740382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa80153180 msgr2=0x7faa80148140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:00.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.762+0000 7faa86f09640 1 --2- 172.21.15.96:0/1136740382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa80153180 0x7faa80148140 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faa7000c460 tx=0x7faa7000c920 comp rx=0 tx=0).stop 2024-04-18T05:02:00.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.762+0000 7faa86f09640 1 -- 172.21.15.96:0/1136740382 shutdown_connections 2024-04-18T05:02:00.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.762+0000 7faa86f09640 1 --2- 172.21.15.96:0/1136740382 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faa6c066690 0x7faa6c068b50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:00.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.762+0000 7faa86f09640 1 --2- 172.21.15.96:0/1136740382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa80153180 0x7faa80148140 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:00.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.762+0000 7faa86f09640 1 --2- 172.21.15.96:0/1136740382 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faa800707c0 0x7faa8014f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:00.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.762+0000 7faa86f09640 1 --2- 172.21.15.96:0/1136740382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa800700e0 0x7faa80150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:00.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.762+0000 7faa86f09640 1 -- 172.21.15.96:0/1136740382 >> 172.21.15.96:0/1136740382 conn(0x7faa8006c750 msgr2=0x7faa800ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:00.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.762+0000 7faa86f09640 1 -- 172.21.15.96:0/1136740382 shutdown_connections 2024-04-18T05:02:00.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:00.762+0000 7faa86f09640 1 -- 172.21.15.96:0/1136740382 wait complete. 2024-04-18T05:02:00.780 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2024-04-18T05:02:00.721068+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":131506610,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":2961,"num_read_kb":1326719,"num_write":31940,"num_write_kb":4643491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35573,"ondisk_log_size":35573,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":454048,"kb_used_data":100192,"kb_used_omap":12,"kb_used_meta":353779,"kb_avail":754520672,"statfs":{"total":773094113280,"available":772629168128,"internally_reserved":0,"allocated":102596608,"data_stored":263693236,"data_compressed":36701930,"data_compressed_allocated":47693824,"data_compressed_original":210231296,"omap_allocated":12744,"internal_metadata":362270264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004157"},"pg_stats":[{"pgid":"3.3f","version":"23'405","reported_seq":440,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.374148+0000","last_change":"2024-04-18T04:54:41.199306+0000","last_active":"2024-04-18T05:01:07.374148+0000","last_peered":"2024-04-18T05:01:07.374148+0000","last_clean":"2024-04-18T05:01:07.374148+0000","last_became_active":"2024-04-18T04:54:41.199046+0000","last_became_peered":"2024-04-18T04:54:41.199046+0000","last_unstale":"2024-04-18T05:01:07.374148+0000","last_undegraded":"2024-04-18T05:01:07.374148+0000","last_fullsized":"2024-04-18T05:01:07.374148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9249,"num_write":376,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"23'459","reported_seq":500,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.407587+0000","last_change":"2024-04-18T04:54:41.200447+0000","last_active":"2024-04-18T05:01:07.407587+0000","last_peered":"2024-04-18T05:01:07.407587+0000","last_clean":"2024-04-18T05:01:07.407587+0000","last_became_active":"2024-04-18T04:54:41.200136+0000","last_became_peered":"2024-04-18T04:54:41.200136+0000","last_unstale":"2024-04-18T05:01:07.407587+0000","last_undegraded":"2024-04-18T05:01:07.407587+0000","last_fullsized":"2024-04-18T05:01:07.407587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12666,"num_write":430,"num_write_kb":97067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"23'410","reported_seq":467,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:50.724095+0000","last_change":"2024-04-18T05:01:50.724351+0000","last_active":"2024-04-18T05:01:50.724095+0000","last_peered":"2024-04-18T05:01:50.724095+0000","last_clean":"2024-04-18T05:01:50.724095+0000","last_became_active":"2024-04-18T04:54:41.185206+0000","last_became_peered":"2024-04-18T04:54:41.185206+0000","last_unstale":"2024-04-18T05:01:50.724095+0000","last_undegraded":"2024-04-18T05:01:50.724095+0000","last_fullsized":"2024-04-18T05:01:50.724095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'410","last_scrub_stamp":"2024-04-18T05:01:50.724024+0000","last_deep_scrub":"23'410","last_deep_scrub_stamp":"2024-04-18T05:01:50.724024+0000","last_clean_scrub_stamp":"2024-04-18T05:01:50.724024+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:53:51.231534+0000","scrub_duration":0.0043415509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":29819,"num_write":382,"num_write_kb":108666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"23'394","reported_seq":463,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:27.079767+0000","last_change":"2024-04-18T05:01:27.079963+0000","last_active":"2024-04-18T05:01:27.079767+0000","last_peered":"2024-04-18T05:01:27.079767+0000","last_clean":"2024-04-18T05:01:27.079767+0000","last_became_active":"2024-04-18T04:54:41.177217+0000","last_became_peered":"2024-04-18T04:54:41.177217+0000","last_unstale":"2024-04-18T05:01:27.079767+0000","last_undegraded":"2024-04-18T05:01:27.079767+0000","last_fullsized":"2024-04-18T05:01:27.079767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'394","last_scrub_stamp":"2024-04-18T05:01:27.079715+0000","last_deep_scrub":"23'394","last_deep_scrub_stamp":"2024-04-18T05:01:27.079715+0000","last_clean_scrub_stamp":"2024-04-18T05:01:27.079715+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:14.174781+0000","scrub_duration":0.0048719330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22571,"num_write":356,"num_write_kb":80073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"23'390","reported_seq":428,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.400122+0000","last_change":"2024-04-18T04:54:41.186573+0000","last_active":"2024-04-18T05:01:07.400122+0000","last_peered":"2024-04-18T05:01:07.400122+0000","last_clean":"2024-04-18T05:01:07.400122+0000","last_became_active":"2024-04-18T04:54:41.186027+0000","last_became_peered":"2024-04-18T04:54:41.186027+0000","last_unstale":"2024-04-18T05:01:07.400122+0000","last_undegraded":"2024-04-18T05:01:07.400122+0000","last_fullsized":"2024-04-18T05:01:07.400122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13089,"num_write":365,"num_write_kb":22615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"23'374","reported_seq":406,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:21.018612+0000","last_change":"2024-04-18T05:01:21.018847+0000","last_active":"2024-04-18T05:01:21.018612+0000","last_peered":"2024-04-18T05:01:21.018612+0000","last_clean":"2024-04-18T05:01:21.018612+0000","last_became_active":"2024-04-18T04:54:41.177215+0000","last_became_peered":"2024-04-18T04:54:41.177215+0000","last_unstale":"2024-04-18T05:01:21.018612+0000","last_undegraded":"2024-04-18T05:01:21.018612+0000","last_fullsized":"2024-04-18T05:01:21.018612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'374","last_scrub_stamp":"2024-04-18T05:01:21.018549+0000","last_deep_scrub":"23'374","last_deep_scrub_stamp":"2024-04-18T05:01:21.018549+0000","last_clean_scrub_stamp":"2024-04-18T05:01:21.018549+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:56:14.121491+0000","scrub_duration":0.0045796960000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":350,"num_write_kb":36922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"23'405","reported_seq":464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:57.768929+0000","last_change":"2024-04-18T05:01:57.769173+0000","last_active":"2024-04-18T05:01:57.768929+0000","last_peered":"2024-04-18T05:01:57.768929+0000","last_clean":"2024-04-18T05:01:57.768929+0000","last_became_active":"2024-04-18T04:54:41.178094+0000","last_became_peered":"2024-04-18T04:54:41.178094+0000","last_unstale":"2024-04-18T05:01:57.768929+0000","last_undegraded":"2024-04-18T05:01:57.768929+0000","last_fullsized":"2024-04-18T05:01:57.768929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'405","last_scrub_stamp":"2024-04-18T05:01:57.768876+0000","last_deep_scrub":"23'405","last_deep_scrub_stamp":"2024-04-18T05:01:57.768876+0000","last_clean_scrub_stamp":"2024-04-18T05:01:57.768876+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:20:12.522956+0000","scrub_duration":0.0046398380000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20531,"num_write":378,"num_write_kb":59118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"23'401","reported_seq":450,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:45.657046+0000","last_change":"2024-04-18T05:01:45.657258+0000","last_active":"2024-04-18T05:01:45.657046+0000","last_peered":"2024-04-18T05:01:45.657046+0000","last_clean":"2024-04-18T05:01:45.657046+0000","last_became_active":"2024-04-18T04:54:41.192678+0000","last_became_peered":"2024-04-18T04:54:41.192678+0000","last_unstale":"2024-04-18T05:01:45.657046+0000","last_undegraded":"2024-04-18T05:01:45.657046+0000","last_fullsized":"2024-04-18T05:01:45.657046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'401","last_scrub_stamp":"2024-04-18T05:01:45.656995+0000","last_deep_scrub":"23'401","last_deep_scrub_stamp":"2024-04-18T05:01:45.656995+0000","last_clean_scrub_stamp":"2024-04-18T05:01:45.656995+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:48:24.009251+0000","scrub_duration":0.0050249880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13567,"num_write":364,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"23'436","reported_seq":510,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:32.714899+0000","last_change":"2024-04-18T05:01:32.714899+0000","last_active":"2024-04-18T05:01:32.714899+0000","last_peered":"2024-04-18T05:01:32.714899+0000","last_clean":"2024-04-18T05:01:32.714899+0000","last_became_active":"2024-04-18T04:54:41.197832+0000","last_became_peered":"2024-04-18T04:54:41.197832+0000","last_unstale":"2024-04-18T05:01:32.714899+0000","last_undegraded":"2024-04-18T05:01:32.714899+0000","last_fullsized":"2024-04-18T05:01:32.714899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'436","last_scrub_stamp":"2024-04-18T05:01:32.714644+0000","last_deep_scrub":"23'436","last_deep_scrub_stamp":"2024-04-18T05:01:32.714644+0000","last_clean_scrub_stamp":"2024-04-18T05:01:32.714644+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:15:48.913743+0000","scrub_duration":0.0041060510000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28521,"num_write":411,"num_write_kb":104022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"23'396","reported_seq":439,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:16.610808+0000","last_change":"2024-04-18T04:54:41.183032+0000","last_active":"2024-04-18T05:01:16.610808+0000","last_peered":"2024-04-18T05:01:16.610808+0000","last_clean":"2024-04-18T05:01:16.610808+0000","last_became_active":"2024-04-18T04:54:41.182698+0000","last_became_peered":"2024-04-18T04:54:41.182698+0000","last_unstale":"2024-04-18T05:01:16.610808+0000","last_undegraded":"2024-04-18T05:01:16.610808+0000","last_fullsized":"2024-04-18T05:01:16.610808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13914,"num_write":350,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"23'379","reported_seq":440,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:51.699726+0000","last_change":"2024-04-18T05:01:51.699726+0000","last_active":"2024-04-18T05:01:51.699726+0000","last_peered":"2024-04-18T05:01:51.699726+0000","last_clean":"2024-04-18T05:01:51.699726+0000","last_became_active":"2024-04-18T04:54:41.187360+0000","last_became_peered":"2024-04-18T04:54:41.187360+0000","last_unstale":"2024-04-18T05:01:51.699726+0000","last_undegraded":"2024-04-18T05:01:51.699726+0000","last_fullsized":"2024-04-18T05:01:51.699726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'379","last_scrub_stamp":"2024-04-18T05:01:51.699340+0000","last_deep_scrub":"23'379","last_deep_scrub_stamp":"2024-04-18T05:01:51.699340+0000","last_clean_scrub_stamp":"2024-04-18T05:01:51.699340+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:41.327494+0000","scrub_duration":0.0040993219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18312,"num_write":357,"num_write_kb":34101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"23'361","reported_seq":423,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:48.631167+0000","last_change":"2024-04-18T05:01:48.631167+0000","last_active":"2024-04-18T05:01:48.631167+0000","last_peered":"2024-04-18T05:01:48.631167+0000","last_clean":"2024-04-18T05:01:48.631167+0000","last_became_active":"2024-04-18T04:54:41.188281+0000","last_became_peered":"2024-04-18T04:54:41.188281+0000","last_unstale":"2024-04-18T05:01:48.631167+0000","last_undegraded":"2024-04-18T05:01:48.631167+0000","last_fullsized":"2024-04-18T05:01:48.631167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'361","last_scrub_stamp":"2024-04-18T05:01:48.630905+0000","last_deep_scrub":"23'361","last_deep_scrub_stamp":"2024-04-18T05:01:48.630905+0000","last_clean_scrub_stamp":"2024-04-18T05:01:48.630905+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:53:49.138416+0000","scrub_duration":0.0044141709999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21304,"num_write":338,"num_write_kb":54980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"23'375","reported_seq":418,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:35.393048+0000","last_change":"2024-04-18T05:01:35.393048+0000","last_active":"2024-04-18T05:01:35.393048+0000","last_peered":"2024-04-18T05:01:35.393048+0000","last_clean":"2024-04-18T05:01:35.393048+0000","last_became_active":"2024-04-18T04:54:41.190882+0000","last_became_peered":"2024-04-18T04:54:41.190882+0000","last_unstale":"2024-04-18T05:01:35.393048+0000","last_undegraded":"2024-04-18T05:01:35.393048+0000","last_fullsized":"2024-04-18T05:01:35.393048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'375","last_scrub_stamp":"2024-04-18T05:01:35.392794+0000","last_deep_scrub":"23'375","last_deep_scrub_stamp":"2024-04-18T05:01:35.392794+0000","last_clean_scrub_stamp":"2024-04-18T05:01:35.392794+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:34.572335+0000","scrub_duration":0.004280786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7725,"num_write":337,"num_write_kb":21712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"23'417","reported_seq":503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:38.345013+0000","last_change":"2024-04-18T05:01:38.345013+0000","last_active":"2024-04-18T05:01:38.345013+0000","last_peered":"2024-04-18T05:01:38.345013+0000","last_clean":"2024-04-18T05:01:38.345013+0000","last_became_active":"2024-04-18T04:54:41.189813+0000","last_became_peered":"2024-04-18T04:54:41.189813+0000","last_unstale":"2024-04-18T05:01:38.345013+0000","last_undegraded":"2024-04-18T05:01:38.345013+0000","last_fullsized":"2024-04-18T05:01:38.345013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'417","last_scrub_stamp":"2024-04-18T05:01:38.344763+0000","last_deep_scrub":"23'417","last_deep_scrub_stamp":"2024-04-18T05:01:38.344763+0000","last_clean_scrub_stamp":"2024-04-18T05:01:38.344763+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:28.744373+0000","scrub_duration":0.0043015240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":28320,"num_write":390,"num_write_kb":71764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"23'445","reported_seq":545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:57.613911+0000","last_change":"2024-04-18T05:01:57.614158+0000","last_active":"2024-04-18T05:01:57.613911+0000","last_peered":"2024-04-18T05:01:57.613911+0000","last_clean":"2024-04-18T05:01:57.613911+0000","last_became_active":"2024-04-18T04:54:41.182713+0000","last_became_peered":"2024-04-18T04:54:41.182713+0000","last_unstale":"2024-04-18T05:01:57.613911+0000","last_undegraded":"2024-04-18T05:01:57.613911+0000","last_fullsized":"2024-04-18T05:01:57.613911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'445","last_scrub_stamp":"2024-04-18T05:01:57.613856+0000","last_deep_scrub":"23'445","last_deep_scrub_stamp":"2024-04-18T05:01:57.613856+0000","last_clean_scrub_stamp":"2024-04-18T05:01:57.613856+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:20:12.367937+0000","scrub_duration":0.0045358839999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":36644,"num_write":412,"num_write_kb":104908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"23'442","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:17.941873+0000","last_change":"2024-04-18T04:54:41.186060+0000","last_active":"2024-04-18T05:01:17.941873+0000","last_peered":"2024-04-18T05:01:17.941873+0000","last_clean":"2024-04-18T05:01:17.941873+0000","last_became_active":"2024-04-18T04:54:41.185803+0000","last_became_peered":"2024-04-18T04:54:41.185803+0000","last_unstale":"2024-04-18T05:01:17.941873+0000","last_undegraded":"2024-04-18T05:01:17.941873+0000","last_fullsized":"2024-04-18T05:01:17.941873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21979,"num_write":411,"num_write_kb":59643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"23'407","reported_seq":468,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:17.941778+0000","last_change":"2024-04-18T04:54:41.200802+0000","last_active":"2024-04-18T05:01:17.941778+0000","last_peered":"2024-04-18T05:01:17.941778+0000","last_clean":"2024-04-18T05:01:17.941778+0000","last_became_active":"2024-04-18T04:54:41.198404+0000","last_became_peered":"2024-04-18T04:54:41.198404+0000","last_unstale":"2024-04-18T05:01:17.941778+0000","last_undegraded":"2024-04-18T05:01:17.941778+0000","last_fullsized":"2024-04-18T05:01:17.941778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22314,"num_write":375,"num_write_kb":43056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"23'414","reported_seq":482,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:33.639544+0000","last_change":"2024-04-18T05:01:33.639544+0000","last_active":"2024-04-18T05:01:33.639544+0000","last_peered":"2024-04-18T05:01:33.639544+0000","last_clean":"2024-04-18T05:01:33.639544+0000","last_became_active":"2024-04-18T04:54:41.188139+0000","last_became_peered":"2024-04-18T04:54:41.188139+0000","last_unstale":"2024-04-18T05:01:33.639544+0000","last_undegraded":"2024-04-18T05:01:33.639544+0000","last_fullsized":"2024-04-18T05:01:33.639544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'414","last_scrub_stamp":"2024-04-18T05:01:33.639296+0000","last_deep_scrub":"23'414","last_deep_scrub_stamp":"2024-04-18T05:01:33.639296+0000","last_clean_scrub_stamp":"2024-04-18T05:01:33.639296+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:14.073131+0000","scrub_duration":0.0049131380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21874,"num_write":387,"num_write_kb":84204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"23'431","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:17.941813+0000","last_change":"2024-04-18T04:54:41.197901+0000","last_active":"2024-04-18T05:01:17.941813+0000","last_peered":"2024-04-18T05:01:17.941813+0000","last_clean":"2024-04-18T05:01:17.941813+0000","last_became_active":"2024-04-18T04:54:41.197235+0000","last_became_peered":"2024-04-18T04:54:41.197235+0000","last_unstale":"2024-04-18T05:01:17.941813+0000","last_undegraded":"2024-04-18T05:01:17.941813+0000","last_fullsized":"2024-04-18T05:01:17.941813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40070,"num_write":398,"num_write_kb":116642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"23'437","reported_seq":521,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:43.519732+0000","last_change":"2024-04-18T05:01:43.519933+0000","last_active":"2024-04-18T05:01:43.519732+0000","last_peered":"2024-04-18T05:01:43.519732+0000","last_clean":"2024-04-18T05:01:43.519732+0000","last_became_active":"2024-04-18T04:54:41.187925+0000","last_became_peered":"2024-04-18T04:54:41.187925+0000","last_unstale":"2024-04-18T05:01:43.519732+0000","last_undegraded":"2024-04-18T05:01:43.519732+0000","last_fullsized":"2024-04-18T05:01:43.519732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'437","last_scrub_stamp":"2024-04-18T05:01:43.519674+0000","last_deep_scrub":"23'437","last_deep_scrub_stamp":"2024-04-18T05:01:43.519674+0000","last_clean_scrub_stamp":"2024-04-18T05:01:43.519674+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:48:21.871930+0000","scrub_duration":0.0043357480000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27418,"num_write":411,"num_write_kb":67043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"23'413","reported_seq":501,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:55.416423+0000","last_change":"2024-04-18T05:01:55.416626+0000","last_active":"2024-04-18T05:01:55.416423+0000","last_peered":"2024-04-18T05:01:55.416423+0000","last_clean":"2024-04-18T05:01:55.416423+0000","last_became_active":"2024-04-18T04:54:41.178963+0000","last_became_peered":"2024-04-18T04:54:41.178963+0000","last_unstale":"2024-04-18T05:01:55.416423+0000","last_undegraded":"2024-04-18T05:01:55.416423+0000","last_fullsized":"2024-04-18T05:01:55.416423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'413","last_scrub_stamp":"2024-04-18T05:01:55.416370+0000","last_deep_scrub":"23'413","last_deep_scrub_stamp":"2024-04-18T05:01:55.416370+0000","last_clean_scrub_stamp":"2024-04-18T05:01:55.416370+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:48.998915+0000","scrub_duration":0.0043298499999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32437,"num_write":394,"num_write_kb":88243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"23'442","reported_seq":525,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:35.675375+0000","last_change":"2024-04-18T05:01:35.675569+0000","last_active":"2024-04-18T05:01:35.675375+0000","last_peered":"2024-04-18T05:01:35.675375+0000","last_clean":"2024-04-18T05:01:35.675375+0000","last_became_active":"2024-04-18T04:54:41.182664+0000","last_became_peered":"2024-04-18T04:54:41.182664+0000","last_unstale":"2024-04-18T05:01:35.675375+0000","last_undegraded":"2024-04-18T05:01:35.675375+0000","last_fullsized":"2024-04-18T05:01:35.675375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'442","last_scrub_stamp":"2024-04-18T05:01:35.675317+0000","last_deep_scrub":"23'442","last_deep_scrub_stamp":"2024-04-18T05:01:35.675317+0000","last_clean_scrub_stamp":"2024-04-18T05:01:35.675317+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:54.644731+0000","scrub_duration":0.0049721519999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34086,"num_write":411,"num_write_kb":96499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"23'434","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:30.563054+0000","last_change":"2024-04-18T05:01:30.563054+0000","last_active":"2024-04-18T05:01:30.563054+0000","last_peered":"2024-04-18T05:01:30.563054+0000","last_clean":"2024-04-18T05:01:30.563054+0000","last_became_active":"2024-04-18T04:54:41.186881+0000","last_became_peered":"2024-04-18T04:54:41.186881+0000","last_unstale":"2024-04-18T05:01:30.563054+0000","last_undegraded":"2024-04-18T05:01:30.563054+0000","last_fullsized":"2024-04-18T05:01:30.563054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'434","last_scrub_stamp":"2024-04-18T05:01:30.562793+0000","last_deep_scrub":"23'434","last_deep_scrub_stamp":"2024-04-18T05:01:30.562793+0000","last_clean_scrub_stamp":"2024-04-18T05:01:30.562793+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:30.270048+0000","scrub_duration":0.0049938550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":24295,"num_write":395,"num_write_kb":96064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"23'465","reported_seq":584,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:15.665867+0000","last_change":"2024-04-18T04:54:41.193206+0000","last_active":"2024-04-18T05:01:15.665867+0000","last_peered":"2024-04-18T05:01:15.665867+0000","last_clean":"2024-04-18T05:01:15.665867+0000","last_became_active":"2024-04-18T04:54:41.192740+0000","last_became_peered":"2024-04-18T04:54:41.192740+0000","last_unstale":"2024-04-18T05:01:15.665867+0000","last_undegraded":"2024-04-18T05:01:15.665867+0000","last_fullsized":"2024-04-18T05:01:15.665867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61562,"num_write":441,"num_write_kb":100539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"23'390","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:56.650555+0000","last_change":"2024-04-18T05:01:56.650773+0000","last_active":"2024-04-18T05:01:56.650555+0000","last_peered":"2024-04-18T05:01:56.650555+0000","last_clean":"2024-04-18T05:01:56.650555+0000","last_became_active":"2024-04-18T04:54:41.192280+0000","last_became_peered":"2024-04-18T04:54:41.192280+0000","last_unstale":"2024-04-18T05:01:56.650555+0000","last_undegraded":"2024-04-18T05:01:56.650555+0000","last_fullsized":"2024-04-18T05:01:56.650555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'390","last_scrub_stamp":"2024-04-18T05:01:56.650502+0000","last_deep_scrub":"23'390","last_deep_scrub_stamp":"2024-04-18T05:01:56.650502+0000","last_clean_scrub_stamp":"2024-04-18T05:01:56.650502+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:38:48.995886+0000","scrub_duration":0.0046352370000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18903,"num_write":377,"num_write_kb":34298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"23'490","reported_seq":571,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:43.793817+0000","last_change":"2024-04-18T05:01:43.794083+0000","last_active":"2024-04-18T05:01:43.793817+0000","last_peered":"2024-04-18T05:01:43.793817+0000","last_clean":"2024-04-18T05:01:43.793817+0000","last_became_active":"2024-04-18T04:54:41.193660+0000","last_became_peered":"2024-04-18T04:54:41.193660+0000","last_unstale":"2024-04-18T05:01:43.793817+0000","last_undegraded":"2024-04-18T05:01:43.793817+0000","last_fullsized":"2024-04-18T05:01:43.793817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'490","last_scrub_stamp":"2024-04-18T05:01:43.793766+0000","last_deep_scrub":"23'490","last_deep_scrub_stamp":"2024-04-18T05:01:43.793766+0000","last_clean_scrub_stamp":"2024-04-18T05:01:43.793766+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:17:38.481739+0000","scrub_duration":0.0042736730000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26760,"num_write":458,"num_write_kb":125465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"23'432","reported_seq":538,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:33.361713+0000","last_change":"2024-04-18T05:01:33.361955+0000","last_active":"2024-04-18T05:01:33.361713+0000","last_peered":"2024-04-18T05:01:33.361713+0000","last_clean":"2024-04-18T05:01:33.361713+0000","last_became_active":"2024-04-18T04:54:41.189374+0000","last_became_peered":"2024-04-18T04:54:41.189374+0000","last_unstale":"2024-04-18T05:01:33.361713+0000","last_undegraded":"2024-04-18T05:01:33.361713+0000","last_fullsized":"2024-04-18T05:01:33.361713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'432","last_scrub_stamp":"2024-04-18T05:01:33.361660+0000","last_deep_scrub":"23'432","last_deep_scrub_stamp":"2024-04-18T05:01:33.361660+0000","last_clean_scrub_stamp":"2024-04-18T05:01:33.361660+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:13.795496+0000","scrub_duration":0.0046135539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43719,"num_write":406,"num_write_kb":145399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"23'384","reported_seq":450,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:51.384588+0000","last_change":"2024-04-18T05:01:51.384823+0000","last_active":"2024-04-18T05:01:51.384588+0000","last_peered":"2024-04-18T05:01:51.384588+0000","last_clean":"2024-04-18T05:01:51.384588+0000","last_became_active":"2024-04-18T04:54:41.189660+0000","last_became_peered":"2024-04-18T04:54:41.189660+0000","last_unstale":"2024-04-18T05:01:51.384588+0000","last_undegraded":"2024-04-18T05:01:51.384588+0000","last_fullsized":"2024-04-18T05:01:51.384588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'384","last_scrub_stamp":"2024-04-18T05:01:51.384537+0000","last_deep_scrub":"23'384","last_deep_scrub_stamp":"2024-04-18T05:01:51.384537+0000","last_clean_scrub_stamp":"2024-04-18T05:01:51.384537+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:53:14.493798+0000","scrub_duration":0.0048499229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17737,"num_write":357,"num_write_kb":75727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"23'427","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:42.668726+0000","last_change":"2024-04-18T05:01:42.668920+0000","last_active":"2024-04-18T05:01:42.668726+0000","last_peered":"2024-04-18T05:01:42.668726+0000","last_clean":"2024-04-18T05:01:42.668726+0000","last_became_active":"2024-04-18T04:54:41.186901+0000","last_became_peered":"2024-04-18T04:54:41.186901+0000","last_unstale":"2024-04-18T05:01:42.668726+0000","last_undegraded":"2024-04-18T05:01:42.668726+0000","last_fullsized":"2024-04-18T05:01:42.668726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'427","last_scrub_stamp":"2024-04-18T05:01:42.668666+0000","last_deep_scrub":"23'427","last_deep_scrub_stamp":"2024-04-18T05:01:42.668666+0000","last_clean_scrub_stamp":"2024-04-18T05:01:42.668666+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:53:05.777927+0000","scrub_duration":0.0040391580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30499,"num_write":394,"num_write_kb":84601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"23'468","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:07.402976+0000","last_change":"2024-04-18T04:54:41.192719+0000","last_active":"2024-04-18T05:01:07.402976+0000","last_peered":"2024-04-18T05:01:07.402976+0000","last_clean":"2024-04-18T05:01:07.402976+0000","last_became_active":"2024-04-18T04:54:41.192114+0000","last_became_peered":"2024-04-18T04:54:41.192114+0000","last_unstale":"2024-04-18T05:01:07.402976+0000","last_undegraded":"2024-04-18T05:01:07.402976+0000","last_fullsized":"2024-04-18T05:01:07.402976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13784,"num_write":434,"num_write_kb":79847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"23'421","reported_seq":483,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.616261+0000","last_change":"2024-04-18T05:01:31.616457+0000","last_active":"2024-04-18T05:01:31.616261+0000","last_peered":"2024-04-18T05:01:31.616261+0000","last_clean":"2024-04-18T05:01:31.616261+0000","last_became_active":"2024-04-18T04:54:41.185915+0000","last_became_peered":"2024-04-18T04:54:41.185915+0000","last_unstale":"2024-04-18T05:01:31.616261+0000","last_undegraded":"2024-04-18T05:01:31.616261+0000","last_fullsized":"2024-04-18T05:01:31.616261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'421","last_scrub_stamp":"2024-04-18T05:01:31.616202+0000","last_deep_scrub":"23'421","last_deep_scrub_stamp":"2024-04-18T05:01:31.616202+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.616202+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:15:47.815302+0000","scrub_duration":0.0045383150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":22283,"num_write":389,"num_write_kb":42482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"23'415","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:23.083892+0000","last_change":"2024-04-18T05:01:23.084088+0000","last_active":"2024-04-18T05:01:23.083892+0000","last_peered":"2024-04-18T05:01:23.083892+0000","last_clean":"2024-04-18T05:01:23.083892+0000","last_became_active":"2024-04-18T04:54:41.189892+0000","last_became_peered":"2024-04-18T04:54:41.189892+0000","last_unstale":"2024-04-18T05:01:23.083892+0000","last_undegraded":"2024-04-18T05:01:23.083892+0000","last_fullsized":"2024-04-18T05:01:23.083892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'415","last_scrub_stamp":"2024-04-18T05:01:23.083840+0000","last_deep_scrub":"23'415","last_deep_scrub_stamp":"2024-04-18T05:01:23.083840+0000","last_clean_scrub_stamp":"2024-04-18T05:01:23.083840+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:21:47.363582+0000","scrub_duration":0.0047136449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36029,"num_write":387,"num_write_kb":59223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'420","reported_seq":491,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:28.770953+0000","last_change":"2024-04-18T05:01:28.771175+0000","last_active":"2024-04-18T05:01:28.770953+0000","last_peered":"2024-04-18T05:01:28.770953+0000","last_clean":"2024-04-18T05:01:28.770953+0000","last_became_active":"2024-04-18T04:54:41.187001+0000","last_became_peered":"2024-04-18T04:54:41.187001+0000","last_unstale":"2024-04-18T05:01:28.770953+0000","last_undegraded":"2024-04-18T05:01:28.770953+0000","last_fullsized":"2024-04-18T05:01:28.770953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'420","last_scrub_stamp":"2024-04-18T05:01:28.770902+0000","last_deep_scrub":"23'420","last_deep_scrub_stamp":"2024-04-18T05:01:28.770902+0000","last_clean_scrub_stamp":"2024-04-18T05:01:28.770902+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:27.362071+0000","scrub_duration":0.0043507140000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19127,"num_write":391,"num_write_kb":83892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'99","reported_seq":125,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:19.609295+0000","last_change":"2024-04-18T05:01:19.609510+0000","last_active":"2024-04-18T05:01:19.609295+0000","last_peered":"2024-04-18T05:01:19.609295+0000","last_clean":"2024-04-18T05:01:19.609295+0000","last_became_active":"2024-04-18T04:54:40.823652+0000","last_became_peered":"2024-04-18T04:54:40.823652+0000","last_unstale":"2024-04-18T05:01:19.609295+0000","last_undegraded":"2024-04-18T05:01:19.609295+0000","last_fullsized":"2024-04-18T05:01:19.609295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'99","last_scrub_stamp":"2024-04-18T05:01:19.609240+0000","last_deep_scrub":"23'99","last_deep_scrub_stamp":"2024-04-18T05:01:19.609240+0000","last_clean_scrub_stamp":"2024-04-18T05:01:19.609240+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:35.184621+0000","scrub_duration":0.024247222999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195462,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"23'366","reported_seq":414,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:41.393415+0000","last_change":"2024-04-18T05:01:41.393627+0000","last_active":"2024-04-18T05:01:41.393415+0000","last_peered":"2024-04-18T05:01:41.393415+0000","last_clean":"2024-04-18T05:01:41.393415+0000","last_became_active":"2024-04-18T04:55:39.827671+0000","last_became_peered":"2024-04-18T04:55:39.827671+0000","last_unstale":"2024-04-18T05:01:41.393415+0000","last_undegraded":"2024-04-18T05:01:41.393415+0000","last_fullsized":"2024-04-18T05:01:41.393415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'366","last_scrub_stamp":"2024-04-18T05:01:41.393359+0000","last_deep_scrub":"23'366","last_deep_scrub_stamp":"2024-04-18T05:01:41.393359+0000","last_clean_scrub_stamp":"2024-04-18T05:01:41.393359+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:34.095101+0000","scrub_duration":0.0035216790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13158,"num_write":336,"num_write_kb":38014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'545","reported_seq":571,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:51.750933+0000","last_change":"2024-04-18T05:01:51.751142+0000","last_active":"2024-04-18T05:01:51.750933+0000","last_peered":"2024-04-18T05:01:51.750933+0000","last_clean":"2024-04-18T05:01:51.750933+0000","last_became_active":"2024-04-18T04:54:40.802672+0000","last_became_peered":"2024-04-18T04:54:40.802672+0000","last_unstale":"2024-04-18T05:01:51.750933+0000","last_undegraded":"2024-04-18T05:01:51.750933+0000","last_fullsized":"2024-04-18T05:01:51.750933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'545","last_scrub_stamp":"2024-04-18T05:01:51.750880+0000","last_deep_scrub":"23'545","last_deep_scrub_stamp":"2024-04-18T05:01:51.750880+0000","last_clean_scrub_stamp":"2024-04-18T05:01:51.750880+0000","objects_scrubbed":6,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:20:06.504961+0000","scrub_duration":0.069336696000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":487,"num_write_kb":12578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'418","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:25.397489+0000","last_change":"2024-04-18T05:01:25.397489+0000","last_active":"2024-04-18T05:01:25.397489+0000","last_peered":"2024-04-18T05:01:25.397489+0000","last_clean":"2024-04-18T05:01:25.397489+0000","last_became_active":"2024-04-18T04:54:40.823091+0000","last_became_peered":"2024-04-18T04:54:40.823091+0000","last_unstale":"2024-04-18T05:01:25.397489+0000","last_undegraded":"2024-04-18T05:01:25.397489+0000","last_fullsized":"2024-04-18T05:01:25.397489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'418","last_scrub_stamp":"2024-04-18T05:01:25.397241+0000","last_deep_scrub":"23'418","last_deep_scrub_stamp":"2024-04-18T05:01:25.397241+0000","last_clean_scrub_stamp":"2024-04-18T05:01:25.397241+0000","objects_scrubbed":3,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:03.755258+0000","scrub_duration":0.029980849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":4340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"23'429","reported_seq":470,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:27.513575+0000","last_change":"2024-04-18T05:01:27.513575+0000","last_active":"2024-04-18T05:01:27.513575+0000","last_peered":"2024-04-18T05:01:27.513575+0000","last_clean":"2024-04-18T05:01:27.513575+0000","last_became_active":"2024-04-18T04:54:41.199690+0000","last_became_peered":"2024-04-18T04:54:41.199690+0000","last_unstale":"2024-04-18T05:01:27.513575+0000","last_undegraded":"2024-04-18T05:01:27.513575+0000","last_fullsized":"2024-04-18T05:01:27.513575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'429","last_scrub_stamp":"2024-04-18T05:01:27.513299+0000","last_deep_scrub":"23'429","last_deep_scrub_stamp":"2024-04-18T05:01:27.513299+0000","last_clean_scrub_stamp":"2024-04-18T05:01:27.513299+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:26.692839+0000","scrub_duration":0.0049636610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5535,"num_write":391,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'957","reported_seq":984,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:59.798017+0000","last_change":"2024-04-18T05:01:59.798211+0000","last_active":"2024-04-18T05:01:59.798017+0000","last_peered":"2024-04-18T05:01:59.798017+0000","last_clean":"2024-04-18T05:01:59.798017+0000","last_became_active":"2024-04-18T04:54:40.804605+0000","last_became_peered":"2024-04-18T04:54:40.804605+0000","last_unstale":"2024-04-18T05:01:59.798017+0000","last_undegraded":"2024-04-18T05:01:59.798017+0000","last_fullsized":"2024-04-18T05:01:59.798017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'957","last_scrub_stamp":"2024-04-18T05:01:59.797967+0000","last_deep_scrub":"23'957","last_deep_scrub_stamp":"2024-04-18T05:01:59.797967+0000","last_clean_scrub_stamp":"2024-04-18T05:01:59.797967+0000","objects_scrubbed":3,"log_size":957,"log_dups_size":0,"ondisk_log_size":957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:23:39.299687+0000","scrub_duration":0.060311403999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"23'422","reported_seq":482,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:43.413146+0000","last_change":"2024-04-18T05:01:43.413146+0000","last_active":"2024-04-18T05:01:43.413146+0000","last_peered":"2024-04-18T05:01:43.413146+0000","last_clean":"2024-04-18T05:01:43.413146+0000","last_became_active":"2024-04-18T04:54:41.175137+0000","last_became_peered":"2024-04-18T04:54:41.175137+0000","last_unstale":"2024-04-18T05:01:43.413146+0000","last_undegraded":"2024-04-18T05:01:43.413146+0000","last_fullsized":"2024-04-18T05:01:43.413146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'422","last_scrub_stamp":"2024-04-18T05:01:43.412900+0000","last_deep_scrub":"23'422","last_deep_scrub_stamp":"2024-04-18T05:01:43.412900+0000","last_clean_scrub_stamp":"2024-04-18T05:01:43.412900+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:33.009995+0000","scrub_duration":0.0045663049999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21971,"num_write":395,"num_write_kb":63063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'68","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:20.781219+0000","last_change":"2024-04-18T05:01:20.781219+0000","last_active":"2024-04-18T05:01:20.781219+0000","last_peered":"2024-04-18T05:01:20.781219+0000","last_clean":"2024-04-18T05:01:20.781219+0000","last_became_active":"2024-04-18T04:54:40.798572+0000","last_became_peered":"2024-04-18T04:54:40.798572+0000","last_unstale":"2024-04-18T05:01:20.781219+0000","last_undegraded":"2024-04-18T05:01:20.781219+0000","last_fullsized":"2024-04-18T05:01:20.781219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'68","last_scrub_stamp":"2024-04-18T05:01:20.780948+0000","last_deep_scrub":"23'68","last_deep_scrub_stamp":"2024-04-18T05:01:20.780948+0000","last_clean_scrub_stamp":"2024-04-18T05:01:20.780948+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:46:12.946774+0000","scrub_duration":0.0073987970000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'432","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:39.772765+0000","last_change":"2024-04-18T05:01:39.772765+0000","last_active":"2024-04-18T05:01:39.772765+0000","last_peered":"2024-04-18T05:01:39.772765+0000","last_clean":"2024-04-18T05:01:39.772765+0000","last_became_active":"2024-04-18T04:54:41.188012+0000","last_became_peered":"2024-04-18T04:54:41.188012+0000","last_unstale":"2024-04-18T05:01:39.772765+0000","last_undegraded":"2024-04-18T05:01:39.772765+0000","last_fullsized":"2024-04-18T05:01:39.772765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'432","last_scrub_stamp":"2024-04-18T05:01:39.772470+0000","last_deep_scrub":"23'432","last_deep_scrub_stamp":"2024-04-18T05:01:39.772470+0000","last_clean_scrub_stamp":"2024-04-18T05:01:39.772470+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:46:53.031529+0000","scrub_duration":0.004148026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13773,"num_write":397,"num_write_kb":43173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'337","reported_seq":365,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:25.419761+0000","last_change":"2024-04-18T05:01:25.419761+0000","last_active":"2024-04-18T05:01:25.419761+0000","last_peered":"2024-04-18T05:01:25.419761+0000","last_clean":"2024-04-18T05:01:25.419761+0000","last_became_active":"2024-04-18T04:54:40.801406+0000","last_became_peered":"2024-04-18T04:54:40.801406+0000","last_unstale":"2024-04-18T05:01:25.419761+0000","last_undegraded":"2024-04-18T05:01:25.419761+0000","last_fullsized":"2024-04-18T05:01:25.419761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'337","last_scrub_stamp":"2024-04-18T05:01:25.419503+0000","last_deep_scrub":"23'337","last_deep_scrub_stamp":"2024-04-18T05:01:25.419503+0000","last_clean_scrub_stamp":"2024-04-18T05:01:25.419503+0000","objects_scrubbed":3,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:24.599044+0000","scrub_duration":0.029230335,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"23'397","reported_seq":445,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:43.621015+0000","last_change":"2024-04-18T05:01:43.621015+0000","last_active":"2024-04-18T05:01:43.621015+0000","last_peered":"2024-04-18T05:01:43.621015+0000","last_clean":"2024-04-18T05:01:43.621015+0000","last_became_active":"2024-04-18T04:54:41.203186+0000","last_became_peered":"2024-04-18T04:54:41.203186+0000","last_unstale":"2024-04-18T05:01:43.621015+0000","last_undegraded":"2024-04-18T05:01:43.621015+0000","last_fullsized":"2024-04-18T05:01:43.621015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'397","last_scrub_stamp":"2024-04-18T05:01:43.620765+0000","last_deep_scrub":"23'397","last_deep_scrub_stamp":"2024-04-18T05:01:43.620765+0000","last_clean_scrub_stamp":"2024-04-18T05:01:43.620765+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:38:05.909566+0000","scrub_duration":0.0040642860000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14488,"num_write":364,"num_write_kb":75349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'192","reported_seq":220,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:26.537619+0000","last_change":"2024-04-18T05:01:26.537619+0000","last_active":"2024-04-18T05:01:26.537619+0000","last_peered":"2024-04-18T05:01:26.537619+0000","last_clean":"2024-04-18T05:01:26.537619+0000","last_became_active":"2024-04-18T04:54:40.820920+0000","last_became_peered":"2024-04-18T04:54:40.820920+0000","last_unstale":"2024-04-18T05:01:26.537619+0000","last_undegraded":"2024-04-18T05:01:26.537619+0000","last_fullsized":"2024-04-18T05:01:26.537619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'192","last_scrub_stamp":"2024-04-18T05:01:26.537313+0000","last_deep_scrub":"23'192","last_deep_scrub_stamp":"2024-04-18T05:01:26.537313+0000","last_clean_scrub_stamp":"2024-04-18T05:01:26.537313+0000","objects_scrubbed":4,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:25.128483+0000","scrub_duration":0.010104568,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"23'394","reported_seq":445,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:17.941711+0000","last_change":"2024-04-18T04:54:41.197254+0000","last_active":"2024-04-18T05:01:17.941711+0000","last_peered":"2024-04-18T05:01:17.941711+0000","last_clean":"2024-04-18T05:01:17.941711+0000","last_became_active":"2024-04-18T04:54:41.196927+0000","last_became_peered":"2024-04-18T04:54:41.196927+0000","last_unstale":"2024-04-18T05:01:17.941711+0000","last_undegraded":"2024-04-18T05:01:17.941711+0000","last_fullsized":"2024-04-18T05:01:17.941711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21129,"num_write":360,"num_write_kb":71528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'450","reported_seq":478,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:18.091612+0000","last_change":"2024-04-18T05:01:18.091612+0000","last_active":"2024-04-18T05:01:18.091612+0000","last_peered":"2024-04-18T05:01:18.091612+0000","last_clean":"2024-04-18T05:01:18.091612+0000","last_became_active":"2024-04-18T04:54:40.801403+0000","last_became_peered":"2024-04-18T04:54:40.801403+0000","last_unstale":"2024-04-18T05:01:18.091612+0000","last_undegraded":"2024-04-18T05:01:18.091612+0000","last_fullsized":"2024-04-18T05:01:18.091612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'450","last_scrub_stamp":"2024-04-18T05:01:18.091496+0000","last_deep_scrub":"23'450","last_deep_scrub_stamp":"2024-04-18T05:01:18.091496+0000","last_clean_scrub_stamp":"2024-04-18T05:01:18.091496+0000","objects_scrubbed":8,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:59:33.756145+0000","scrub_duration":0.055952107000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12011434,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":11980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'396","reported_seq":466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:40.449445+0000","last_change":"2024-04-18T05:01:40.449445+0000","last_active":"2024-04-18T05:01:40.449445+0000","last_peered":"2024-04-18T05:01:40.449445+0000","last_clean":"2024-04-18T05:01:40.449445+0000","last_became_active":"2024-04-18T04:54:41.195172+0000","last_became_peered":"2024-04-18T04:54:41.195172+0000","last_unstale":"2024-04-18T05:01:40.449445+0000","last_undegraded":"2024-04-18T05:01:40.449445+0000","last_fullsized":"2024-04-18T05:01:40.449445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'396","last_scrub_stamp":"2024-04-18T05:01:40.449334+0000","last_deep_scrub":"23'396","last_deep_scrub_stamp":"2024-04-18T05:01:40.449334+0000","last_clean_scrub_stamp":"2024-04-18T05:01:40.449334+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:53:03.558595+0000","scrub_duration":0.0033727589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19873,"num_write":365,"num_write_kb":71837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'591","reported_seq":619,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:25.610689+0000","last_change":"2024-04-18T05:01:25.610689+0000","last_active":"2024-04-18T05:01:25.610689+0000","last_peered":"2024-04-18T05:01:25.610689+0000","last_clean":"2024-04-18T05:01:25.610689+0000","last_became_active":"2024-04-18T04:54:40.817681+0000","last_became_peered":"2024-04-18T04:54:40.817681+0000","last_unstale":"2024-04-18T05:01:25.610689+0000","last_undegraded":"2024-04-18T05:01:25.610689+0000","last_fullsized":"2024-04-18T05:01:25.610689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'591","last_scrub_stamp":"2024-04-18T05:01:25.610406+0000","last_deep_scrub":"23'591","last_deep_scrub_stamp":"2024-04-18T05:01:25.610406+0000","last_clean_scrub_stamp":"2024-04-18T05:01:25.610406+0000","objects_scrubbed":8,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:03.968423+0000","scrub_duration":0.057537295000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"23'417","reported_seq":456,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:37.391009+0000","last_change":"2024-04-18T05:01:37.391009+0000","last_active":"2024-04-18T05:01:37.391009+0000","last_peered":"2024-04-18T05:01:37.391009+0000","last_clean":"2024-04-18T05:01:37.391009+0000","last_became_active":"2024-04-18T04:54:41.194499+0000","last_became_peered":"2024-04-18T04:54:41.194499+0000","last_unstale":"2024-04-18T05:01:37.391009+0000","last_undegraded":"2024-04-18T05:01:37.391009+0000","last_fullsized":"2024-04-18T05:01:37.391009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'417","last_scrub_stamp":"2024-04-18T05:01:37.390763+0000","last_deep_scrub":"23'417","last_deep_scrub_stamp":"2024-04-18T05:01:37.390763+0000","last_clean_scrub_stamp":"2024-04-18T05:01:37.390763+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:37.098019+0000","scrub_duration":0.0056180969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":380,"num_write_kb":59449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"23'73","reported_seq":100,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:50.683587+0000","last_change":"2024-04-18T05:01:50.683793+0000","last_active":"2024-04-18T05:01:50.683587+0000","last_peered":"2024-04-18T05:01:50.683587+0000","last_clean":"2024-04-18T05:01:50.683587+0000","last_became_active":"2024-04-18T04:54:40.817370+0000","last_became_peered":"2024-04-18T04:54:40.817370+0000","last_unstale":"2024-04-18T05:01:50.683587+0000","last_undegraded":"2024-04-18T05:01:50.683587+0000","last_fullsized":"2024-04-18T05:01:50.683587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'73","last_scrub_stamp":"2024-04-18T05:01:50.683535+0000","last_deep_scrub":"23'73","last_deep_scrub_stamp":"2024-04-18T05:01:50.683535+0000","last_clean_scrub_stamp":"2024-04-18T05:01:50.683535+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:38:43.028919+0000","scrub_duration":0.0083098029999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'400","reported_seq":474,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:17.941672+0000","last_change":"2024-04-18T04:54:41.193363+0000","last_active":"2024-04-18T05:01:17.941672+0000","last_peered":"2024-04-18T05:01:17.941672+0000","last_clean":"2024-04-18T05:01:17.941672+0000","last_became_active":"2024-04-18T04:54:41.192889+0000","last_became_peered":"2024-04-18T04:54:41.192889+0000","last_unstale":"2024-04-18T05:01:17.941672+0000","last_undegraded":"2024-04-18T05:01:17.941672+0000","last_fullsized":"2024-04-18T05:01:17.941672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30891,"num_write":363,"num_write_kb":81664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"23'69","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:24.423007+0000","last_change":"2024-04-18T05:01:24.423007+0000","last_active":"2024-04-18T05:01:24.423007+0000","last_peered":"2024-04-18T05:01:24.423007+0000","last_clean":"2024-04-18T05:01:24.423007+0000","last_became_active":"2024-04-18T04:54:40.805965+0000","last_became_peered":"2024-04-18T04:54:40.805965+0000","last_unstale":"2024-04-18T05:01:24.423007+0000","last_undegraded":"2024-04-18T05:01:24.423007+0000","last_fullsized":"2024-04-18T05:01:24.423007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'69","last_scrub_stamp":"2024-04-18T05:01:24.422705+0000","last_deep_scrub":"23'69","last_deep_scrub_stamp":"2024-04-18T05:01:24.422705+0000","last_clean_scrub_stamp":"2024-04-18T05:01:24.422705+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:43.392120+0000","scrub_duration":0.0070178870000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1124,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'449","reported_seq":508,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:29.817094+0000","last_change":"2024-04-18T05:01:29.817094+0000","last_active":"2024-04-18T05:01:29.817094+0000","last_peered":"2024-04-18T05:01:29.817094+0000","last_clean":"2024-04-18T05:01:29.817094+0000","last_became_active":"2024-04-18T04:54:41.183838+0000","last_became_peered":"2024-04-18T04:54:41.183838+0000","last_unstale":"2024-04-18T05:01:29.817094+0000","last_undegraded":"2024-04-18T05:01:29.817094+0000","last_fullsized":"2024-04-18T05:01:29.817094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'449","last_scrub_stamp":"2024-04-18T05:01:29.816853+0000","last_deep_scrub":"23'449","last_deep_scrub_stamp":"2024-04-18T05:01:29.816853+0000","last_clean_scrub_stamp":"2024-04-18T05:01:29.816853+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:45.392233+0000","scrub_duration":0.0047717139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14210,"num_write":423,"num_write_kb":80124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'88","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.337778+0000","last_change":"2024-04-18T05:01:31.337778+0000","last_active":"2024-04-18T05:01:31.337778+0000","last_peered":"2024-04-18T05:01:31.337778+0000","last_clean":"2024-04-18T05:01:31.337778+0000","last_became_active":"2024-04-18T04:54:40.818227+0000","last_became_peered":"2024-04-18T04:54:40.818227+0000","last_unstale":"2024-04-18T05:01:31.337778+0000","last_undegraded":"2024-04-18T05:01:31.337778+0000","last_fullsized":"2024-04-18T05:01:31.337778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'88","last_scrub_stamp":"2024-04-18T05:01:31.337486+0000","last_deep_scrub":"23'88","last_deep_scrub_stamp":"2024-04-18T05:01:31.337486+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.337486+0000","objects_scrubbed":8,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:25.180421+0000","scrub_duration":0.014728473000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"23'493","reported_seq":555,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:17.941689+0000","last_change":"2024-04-18T04:54:41.192227+0000","last_active":"2024-04-18T05:01:17.941689+0000","last_peered":"2024-04-18T05:01:17.941689+0000","last_clean":"2024-04-18T05:01:17.941689+0000","last_became_active":"2024-04-18T04:54:41.187002+0000","last_became_peered":"2024-04-18T04:54:41.187002+0000","last_unstale":"2024-04-18T05:01:17.941689+0000","last_undegraded":"2024-04-18T05:01:17.941689+0000","last_fullsized":"2024-04-18T05:01:17.941689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":24156,"num_write":458,"num_write_kb":105037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'202","reported_seq":230,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:23.442118+0000","last_change":"2024-04-18T05:01:23.442118+0000","last_active":"2024-04-18T05:01:23.442118+0000","last_peered":"2024-04-18T05:01:23.442118+0000","last_clean":"2024-04-18T05:01:23.442118+0000","last_became_active":"2024-04-18T04:54:40.802550+0000","last_became_peered":"2024-04-18T04:54:40.802550+0000","last_unstale":"2024-04-18T05:01:23.442118+0000","last_undegraded":"2024-04-18T05:01:23.442118+0000","last_fullsized":"2024-04-18T05:01:23.442118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'202","last_scrub_stamp":"2024-04-18T05:01:23.441698+0000","last_deep_scrub":"23'202","last_deep_scrub_stamp":"2024-04-18T05:01:23.441698+0000","last_clean_scrub_stamp":"2024-04-18T05:01:23.441698+0000","objects_scrubbed":3,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:03.875533+0000","scrub_duration":0.030187757999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'364","reported_seq":416,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:38.816814+0000","last_change":"2024-04-18T05:01:38.817049+0000","last_active":"2024-04-18T05:01:38.816814+0000","last_peered":"2024-04-18T05:01:38.816814+0000","last_clean":"2024-04-18T05:01:38.816814+0000","last_became_active":"2024-04-18T04:54:41.179540+0000","last_became_peered":"2024-04-18T04:54:41.179540+0000","last_unstale":"2024-04-18T05:01:38.816814+0000","last_undegraded":"2024-04-18T05:01:38.816814+0000","last_fullsized":"2024-04-18T05:01:38.816814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'364","last_scrub_stamp":"2024-04-18T05:01:38.816760+0000","last_deep_scrub":"23'364","last_deep_scrub_stamp":"2024-04-18T05:01:38.816760+0000","last_clean_scrub_stamp":"2024-04-18T05:01:38.816760+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:26:27.796056+0000","scrub_duration":0.0043171520000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16384,"num_write":332,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'307","reported_seq":335,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:37.408810+0000","last_change":"2024-04-18T05:01:37.409008+0000","last_active":"2024-04-18T05:01:37.408810+0000","last_peered":"2024-04-18T05:01:37.408810+0000","last_clean":"2024-04-18T05:01:37.408810+0000","last_became_active":"2024-04-18T04:54:40.803464+0000","last_became_peered":"2024-04-18T04:54:40.803464+0000","last_unstale":"2024-04-18T05:01:37.408810+0000","last_undegraded":"2024-04-18T05:01:37.408810+0000","last_fullsized":"2024-04-18T05:01:37.408810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'307","last_scrub_stamp":"2024-04-18T05:01:37.408757+0000","last_deep_scrub":"23'307","last_deep_scrub_stamp":"2024-04-18T05:01:37.408757+0000","last_clean_scrub_stamp":"2024-04-18T05:01:37.408757+0000","objects_scrubbed":3,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:46:50.667816+0000","scrub_duration":0.032088881999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"23'391","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:17.446894+0000","last_change":"2024-04-18T05:01:17.446894+0000","last_active":"2024-04-18T05:01:17.446894+0000","last_peered":"2024-04-18T05:01:17.446894+0000","last_clean":"2024-04-18T05:01:17.446894+0000","last_became_active":"2024-04-18T04:54:41.188152+0000","last_became_peered":"2024-04-18T04:54:41.188152+0000","last_unstale":"2024-04-18T05:01:17.446894+0000","last_undegraded":"2024-04-18T05:01:17.446894+0000","last_fullsized":"2024-04-18T05:01:17.446894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'391","last_scrub_stamp":"2024-04-18T05:01:17.446736+0000","last_deep_scrub":"23'391","last_deep_scrub_stamp":"2024-04-18T05:01:17.446736+0000","last_clean_scrub_stamp":"2024-04-18T05:01:17.446736+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:33.022117+0000","scrub_duration":0.0029989399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15853,"num_write":356,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'537","reported_seq":564,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:26.569521+0000","last_change":"2024-04-18T05:01:26.569720+0000","last_active":"2024-04-18T05:01:26.569521+0000","last_peered":"2024-04-18T05:01:26.569521+0000","last_clean":"2024-04-18T05:01:26.569521+0000","last_became_active":"2024-04-18T04:54:40.814207+0000","last_became_peered":"2024-04-18T04:54:40.814207+0000","last_unstale":"2024-04-18T05:01:26.569521+0000","last_undegraded":"2024-04-18T05:01:26.569521+0000","last_fullsized":"2024-04-18T05:01:26.569521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'537","last_scrub_stamp":"2024-04-18T05:01:26.569462+0000","last_deep_scrub":"23'537","last_deep_scrub_stamp":"2024-04-18T05:01:26.569462+0000","last_clean_scrub_stamp":"2024-04-18T05:01:26.569462+0000","objects_scrubbed":2,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:45.538877+0000","scrub_duration":0.037341881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"23'425","reported_seq":481,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:41.446915+0000","last_change":"2024-04-18T05:01:41.447107+0000","last_active":"2024-04-18T05:01:41.446915+0000","last_peered":"2024-04-18T05:01:41.446915+0000","last_clean":"2024-04-18T05:01:41.446915+0000","last_became_active":"2024-04-18T04:54:41.188249+0000","last_became_peered":"2024-04-18T04:54:41.188249+0000","last_unstale":"2024-04-18T05:01:41.446915+0000","last_undegraded":"2024-04-18T05:01:41.446915+0000","last_fullsized":"2024-04-18T05:01:41.446915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'425","last_scrub_stamp":"2024-04-18T05:01:41.446862+0000","last_deep_scrub":"23'425","last_deep_scrub_stamp":"2024-04-18T05:01:41.446862+0000","last_clean_scrub_stamp":"2024-04-18T05:01:41.446862+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:38:03.735663+0000","scrub_duration":0.0048573399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14420,"num_write":396,"num_write_kb":51045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'78","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:27.370536+0000","last_change":"2024-04-18T05:01:27.370727+0000","last_active":"2024-04-18T05:01:27.370536+0000","last_peered":"2024-04-18T05:01:27.370536+0000","last_clean":"2024-04-18T05:01:27.370536+0000","last_became_active":"2024-04-18T04:54:40.823755+0000","last_became_peered":"2024-04-18T04:54:40.823755+0000","last_unstale":"2024-04-18T05:01:27.370536+0000","last_undegraded":"2024-04-18T05:01:27.370536+0000","last_fullsized":"2024-04-18T05:01:27.370536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'78","last_scrub_stamp":"2024-04-18T05:01:27.370484+0000","last_deep_scrub":"23'78","last_deep_scrub_stamp":"2024-04-18T05:01:27.370484+0000","last_clean_scrub_stamp":"2024-04-18T05:01:27.370484+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:42.945865+0000","scrub_duration":0.0074384159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1706,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'402","reported_seq":447,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:20.557186+0000","last_change":"2024-04-18T05:01:20.557186+0000","last_active":"2024-04-18T05:01:20.557186+0000","last_peered":"2024-04-18T05:01:20.557186+0000","last_clean":"2024-04-18T05:01:20.557186+0000","last_became_active":"2024-04-18T04:54:41.186149+0000","last_became_peered":"2024-04-18T04:54:41.186149+0000","last_unstale":"2024-04-18T05:01:20.557186+0000","last_undegraded":"2024-04-18T05:01:20.557186+0000","last_fullsized":"2024-04-18T05:01:20.557186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'402","last_scrub_stamp":"2024-04-18T05:01:20.556880+0000","last_deep_scrub":"23'402","last_deep_scrub_stamp":"2024-04-18T05:01:20.556880+0000","last_clean_scrub_stamp":"2024-04-18T05:01:20.556880+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:19.736421+0000","scrub_duration":0.0048536480000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7713,"num_write":373,"num_write_kb":46594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'119","reported_seq":183,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:19.748996+0000","last_change":"2024-04-18T05:01:19.749081+0000","last_active":"2024-04-18T05:01:19.748996+0000","last_peered":"2024-04-18T05:01:19.748996+0000","last_clean":"2024-04-18T05:01:19.748996+0000","last_became_active":"2024-04-18T04:54:35.672457+0000","last_became_peered":"2024-04-18T04:54:35.672457+0000","last_unstale":"2024-04-18T05:01:19.748996+0000","last_undegraded":"2024-04-18T05:01:19.748996+0000","last_fullsized":"2024-04-18T05:01:19.748996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2024-04-18T05:01:19.748977+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2024-04-18T05:01:19.748977+0000","last_clean_scrub_stamp":"2024-04-18T05:01:19.748977+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:50.211326+0000","scrub_duration":0.0077953190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'76","reported_seq":103,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:48.714990+0000","last_change":"2024-04-18T05:01:48.715205+0000","last_active":"2024-04-18T05:01:48.714990+0000","last_peered":"2024-04-18T05:01:48.714990+0000","last_clean":"2024-04-18T05:01:48.714990+0000","last_became_active":"2024-04-18T04:54:40.801083+0000","last_became_peered":"2024-04-18T04:54:40.801083+0000","last_unstale":"2024-04-18T05:01:48.714990+0000","last_undegraded":"2024-04-18T05:01:48.714990+0000","last_fullsized":"2024-04-18T05:01:48.714990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'76","last_scrub_stamp":"2024-04-18T05:01:48.714929+0000","last_deep_scrub":"23'76","last_deep_scrub_stamp":"2024-04-18T05:01:48.714929+0000","last_clean_scrub_stamp":"2024-04-18T05:01:48.714929+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:38.343083+0000","scrub_duration":0.010243756999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'362","reported_seq":394,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:48.470235+0000","last_change":"2024-04-18T05:01:48.470434+0000","last_active":"2024-04-18T05:01:48.470235+0000","last_peered":"2024-04-18T05:01:48.470235+0000","last_clean":"2024-04-18T05:01:48.470235+0000","last_became_active":"2024-04-18T04:54:41.174391+0000","last_became_peered":"2024-04-18T04:54:41.174391+0000","last_unstale":"2024-04-18T05:01:48.470235+0000","last_undegraded":"2024-04-18T05:01:48.470235+0000","last_fullsized":"2024-04-18T05:01:48.470235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'362","last_scrub_stamp":"2024-04-18T05:01:48.470181+0000","last_deep_scrub":"23'362","last_deep_scrub_stamp":"2024-04-18T05:01:48.470181+0000","last_clean_scrub_stamp":"2024-04-18T05:01:48.470181+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:46:21.613642+0000","scrub_duration":0.0045936149999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1626,"num_write":331,"num_write_kb":26059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'441","reported_seq":468,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:39.752852+0000","last_change":"2024-04-18T05:01:39.753052+0000","last_active":"2024-04-18T05:01:39.752852+0000","last_peered":"2024-04-18T05:01:39.752852+0000","last_clean":"2024-04-18T05:01:39.752852+0000","last_became_active":"2024-04-18T04:54:40.813396+0000","last_became_peered":"2024-04-18T04:54:40.813396+0000","last_unstale":"2024-04-18T05:01:39.752852+0000","last_undegraded":"2024-04-18T05:01:39.752852+0000","last_fullsized":"2024-04-18T05:01:39.752852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'441","last_scrub_stamp":"2024-04-18T05:01:39.752799+0000","last_deep_scrub":"23'441","last_deep_scrub_stamp":"2024-04-18T05:01:39.752799+0000","last_clean_scrub_stamp":"2024-04-18T05:01:39.752799+0000","objects_scrubbed":3,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:48:18.105055+0000","scrub_duration":0.041934091999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":379,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'410","reported_seq":535,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.439531+0000","last_change":"2024-04-18T05:01:31.439720+0000","last_active":"2024-04-18T05:01:31.439531+0000","last_peered":"2024-04-18T05:01:31.439531+0000","last_clean":"2024-04-18T05:01:31.439531+0000","last_became_active":"2024-04-18T04:54:41.195152+0000","last_became_peered":"2024-04-18T04:54:41.195152+0000","last_unstale":"2024-04-18T05:01:31.439531+0000","last_undegraded":"2024-04-18T05:01:31.439531+0000","last_fullsized":"2024-04-18T05:01:31.439531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'410","last_scrub_stamp":"2024-04-18T05:01:31.439482+0000","last_deep_scrub":"23'410","last_deep_scrub_stamp":"2024-04-18T05:01:31.439482+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.439482+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:15:47.638581+0000","scrub_duration":0.0047366739999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":54989,"num_write":377,"num_write_kb":85155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'434","reported_seq":813,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:27.556454+0000","last_change":"2024-04-18T05:01:27.556643+0000","last_active":"2024-04-18T05:01:27.556454+0000","last_peered":"2024-04-18T05:01:27.556454+0000","last_clean":"2024-04-18T05:01:27.556454+0000","last_became_active":"2024-04-18T04:54:40.818113+0000","last_became_peered":"2024-04-18T04:54:40.818113+0000","last_unstale":"2024-04-18T05:01:27.556454+0000","last_undegraded":"2024-04-18T05:01:27.556454+0000","last_fullsized":"2024-04-18T05:01:27.556454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'434","last_scrub_stamp":"2024-04-18T05:01:27.556398+0000","last_deep_scrub":"23'434","last_deep_scrub_stamp":"2024-04-18T05:01:27.556398+0000","last_clean_scrub_stamp":"2024-04-18T05:01:27.556398+0000","objects_scrubbed":4,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:43.131779+0000","scrub_duration":0.020609295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1456426,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":351,"num_read_kb":1645,"num_write":371,"num_write_kb":1672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'416","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:33.488170+0000","last_change":"2024-04-18T05:01:33.488378+0000","last_active":"2024-04-18T05:01:33.488170+0000","last_peered":"2024-04-18T05:01:33.488170+0000","last_clean":"2024-04-18T05:01:33.488170+0000","last_became_active":"2024-04-18T04:54:41.192187+0000","last_became_peered":"2024-04-18T04:54:41.192187+0000","last_unstale":"2024-04-18T05:01:33.488170+0000","last_undegraded":"2024-04-18T05:01:33.488170+0000","last_fullsized":"2024-04-18T05:01:33.488170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'416","last_scrub_stamp":"2024-04-18T05:01:33.488116+0000","last_deep_scrub":"23'416","last_deep_scrub_stamp":"2024-04-18T05:01:33.488116+0000","last_clean_scrub_stamp":"2024-04-18T05:01:33.488116+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:35.745366+0000","scrub_duration":0.0041304510000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":364,"num_write":388,"num_write_kb":58777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'521","reported_seq":548,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:44.763490+0000","last_change":"2024-04-18T05:01:44.763693+0000","last_active":"2024-04-18T05:01:44.763490+0000","last_peered":"2024-04-18T05:01:44.763490+0000","last_clean":"2024-04-18T05:01:44.763490+0000","last_became_active":"2024-04-18T04:54:40.820025+0000","last_became_peered":"2024-04-18T04:54:40.820025+0000","last_unstale":"2024-04-18T05:01:44.763490+0000","last_undegraded":"2024-04-18T05:01:44.763490+0000","last_fullsized":"2024-04-18T05:01:44.763490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'521","last_scrub_stamp":"2024-04-18T05:01:44.763432+0000","last_deep_scrub":"23'521","last_deep_scrub_stamp":"2024-04-18T05:01:44.763432+0000","last_clean_scrub_stamp":"2024-04-18T05:01:44.763432+0000","objects_scrubbed":4,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:53:45.270943+0000","scrub_duration":0.044834888000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":8474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'404","reported_seq":464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.502932+0000","last_change":"2024-04-18T05:01:31.503151+0000","last_active":"2024-04-18T05:01:31.502932+0000","last_peered":"2024-04-18T05:01:31.502932+0000","last_clean":"2024-04-18T05:01:31.502932+0000","last_became_active":"2024-04-18T04:54:41.185257+0000","last_became_peered":"2024-04-18T04:54:41.185257+0000","last_unstale":"2024-04-18T05:01:31.502932+0000","last_undegraded":"2024-04-18T05:01:31.502932+0000","last_fullsized":"2024-04-18T05:01:31.502932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'404","last_scrub_stamp":"2024-04-18T05:01:31.502875+0000","last_deep_scrub":"23'404","last_deep_scrub_stamp":"2024-04-18T05:01:31.502875+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.502875+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:33.760126+0000","scrub_duration":0.0037300290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14216,"num_write":374,"num_write_kb":63531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'63","reported_seq":90,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:22.504178+0000","last_change":"2024-04-18T05:01:22.504434+0000","last_active":"2024-04-18T05:01:22.504178+0000","last_peered":"2024-04-18T05:01:22.504178+0000","last_clean":"2024-04-18T05:01:22.504178+0000","last_became_active":"2024-04-18T04:54:40.824206+0000","last_became_peered":"2024-04-18T04:54:40.824206+0000","last_unstale":"2024-04-18T05:01:22.504178+0000","last_undegraded":"2024-04-18T05:01:22.504178+0000","last_fullsized":"2024-04-18T05:01:22.504178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'63","last_scrub_stamp":"2024-04-18T05:01:22.504121+0000","last_deep_scrub":"23'63","last_deep_scrub_stamp":"2024-04-18T05:01:22.504121+0000","last_clean_scrub_stamp":"2024-04-18T05:01:22.504121+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:27:09.070973+0000","scrub_duration":0.003666192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'433","reported_seq":543,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:33.947094+0000","last_change":"2024-04-18T05:01:33.947327+0000","last_active":"2024-04-18T05:01:33.947094+0000","last_peered":"2024-04-18T05:01:33.947094+0000","last_clean":"2024-04-18T05:01:33.947094+0000","last_became_active":"2024-04-18T04:54:41.195177+0000","last_became_peered":"2024-04-18T04:54:41.195177+0000","last_unstale":"2024-04-18T05:01:33.947094+0000","last_undegraded":"2024-04-18T05:01:33.947094+0000","last_fullsized":"2024-04-18T05:01:33.947094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'433","last_scrub_stamp":"2024-04-18T05:01:33.947042+0000","last_deep_scrub":"23'433","last_deep_scrub_stamp":"2024-04-18T05:01:33.947042+0000","last_clean_scrub_stamp":"2024-04-18T05:01:33.947042+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:27.789977+0000","scrub_duration":0.0045580300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":41457,"num_write":394,"num_write_kb":79356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'332","reported_seq":359,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:35.699806+0000","last_change":"2024-04-18T05:01:35.700010+0000","last_active":"2024-04-18T05:01:35.699806+0000","last_peered":"2024-04-18T05:01:35.699806+0000","last_clean":"2024-04-18T05:01:35.699806+0000","last_became_active":"2024-04-18T04:54:40.802902+0000","last_became_peered":"2024-04-18T04:54:40.802902+0000","last_unstale":"2024-04-18T05:01:35.699806+0000","last_undegraded":"2024-04-18T05:01:35.699806+0000","last_fullsized":"2024-04-18T05:01:35.699806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'332","last_scrub_stamp":"2024-04-18T05:01:35.699755+0000","last_deep_scrub":"23'332","last_deep_scrub_stamp":"2024-04-18T05:01:35.699755+0000","last_clean_scrub_stamp":"2024-04-18T05:01:35.699755+0000","objects_scrubbed":4,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:43:09.664036+0000","scrub_duration":0.029626237999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'423","reported_seq":521,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:34.360195+0000","last_change":"2024-04-18T05:01:34.360390+0000","last_active":"2024-04-18T05:01:34.360195+0000","last_peered":"2024-04-18T05:01:34.360195+0000","last_clean":"2024-04-18T05:01:34.360195+0000","last_became_active":"2024-04-18T04:54:41.194965+0000","last_became_peered":"2024-04-18T04:54:41.194965+0000","last_unstale":"2024-04-18T05:01:34.360195+0000","last_undegraded":"2024-04-18T05:01:34.360195+0000","last_fullsized":"2024-04-18T05:01:34.360195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'423","last_scrub_stamp":"2024-04-18T05:01:34.360133+0000","last_deep_scrub":"23'423","last_deep_scrub_stamp":"2024-04-18T05:01:34.360133+0000","last_clean_scrub_stamp":"2024-04-18T05:01:34.360133+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:53.329547+0000","scrub_duration":0.0042417540000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32152,"num_write":386,"num_write_kb":121188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'120","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:23.448961+0000","last_change":"2024-04-18T05:01:23.449160+0000","last_active":"2024-04-18T05:01:23.448961+0000","last_peered":"2024-04-18T05:01:23.448961+0000","last_clean":"2024-04-18T05:01:23.448961+0000","last_became_active":"2024-04-18T04:54:40.798574+0000","last_became_peered":"2024-04-18T04:54:40.798574+0000","last_unstale":"2024-04-18T05:01:23.448961+0000","last_undegraded":"2024-04-18T05:01:23.448961+0000","last_fullsized":"2024-04-18T05:01:23.448961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'120","last_scrub_stamp":"2024-04-18T05:01:23.448909+0000","last_deep_scrub":"23'120","last_deep_scrub_stamp":"2024-04-18T05:01:23.448909+0000","last_clean_scrub_stamp":"2024-04-18T05:01:23.448909+0000","objects_scrubbed":4,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:10.543975+0000","scrub_duration":0.027642872999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'326","reported_seq":354,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:47.472228+0000","last_change":"2024-04-18T05:01:47.472434+0000","last_active":"2024-04-18T05:01:47.472228+0000","last_peered":"2024-04-18T05:01:47.472228+0000","last_clean":"2024-04-18T05:01:47.472228+0000","last_became_active":"2024-04-18T04:54:41.191124+0000","last_became_peered":"2024-04-18T04:54:41.191124+0000","last_unstale":"2024-04-18T05:01:47.472228+0000","last_undegraded":"2024-04-18T05:01:47.472228+0000","last_fullsized":"2024-04-18T05:01:47.472228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'326","last_scrub_stamp":"2024-04-18T05:01:47.472175+0000","last_deep_scrub":"23'326","last_deep_scrub_stamp":"2024-04-18T05:01:47.472175+0000","last_clean_scrub_stamp":"2024-04-18T05:01:47.472175+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:15:35.494374+0000","scrub_duration":0.003370414,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":298,"num_write_kb":17144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'84","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:36.679923+0000","last_change":"2024-04-18T05:01:36.680144+0000","last_active":"2024-04-18T05:01:36.679923+0000","last_peered":"2024-04-18T05:01:36.679923+0000","last_clean":"2024-04-18T05:01:36.679923+0000","last_became_active":"2024-04-18T04:54:40.803616+0000","last_became_peered":"2024-04-18T04:54:40.803616+0000","last_unstale":"2024-04-18T05:01:36.679923+0000","last_undegraded":"2024-04-18T05:01:36.679923+0000","last_fullsized":"2024-04-18T05:01:36.679923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'84","last_scrub_stamp":"2024-04-18T05:01:36.679867+0000","last_deep_scrub":"23'84","last_deep_scrub_stamp":"2024-04-18T05:01:36.679867+0000","last_clean_scrub_stamp":"2024-04-18T05:01:36.679867+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:24:19.383527+0000","scrub_duration":0.008721632,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'465","reported_seq":524,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:53.408745+0000","last_change":"2024-04-18T05:01:53.408953+0000","last_active":"2024-04-18T05:01:53.408745+0000","last_peered":"2024-04-18T05:01:53.408745+0000","last_clean":"2024-04-18T05:01:53.408745+0000","last_became_active":"2024-04-18T04:54:41.185217+0000","last_became_peered":"2024-04-18T04:54:41.185217+0000","last_unstale":"2024-04-18T05:01:53.408745+0000","last_undegraded":"2024-04-18T05:01:53.408745+0000","last_fullsized":"2024-04-18T05:01:53.408745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'465","last_scrub_stamp":"2024-04-18T05:01:53.408690+0000","last_deep_scrub":"23'465","last_deep_scrub_stamp":"2024-04-18T05:01:53.408690+0000","last_clean_scrub_stamp":"2024-04-18T05:01:53.408690+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:52:02.665415+0000","scrub_duration":0.0043601559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8956,"num_write":434,"num_write_kb":97052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'603","reported_seq":631,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:20.459084+0000","last_change":"2024-04-18T05:01:20.459297+0000","last_active":"2024-04-18T05:01:20.459084+0000","last_peered":"2024-04-18T05:01:20.459084+0000","last_clean":"2024-04-18T05:01:20.459084+0000","last_became_active":"2024-04-18T04:54:40.800598+0000","last_became_peered":"2024-04-18T04:54:40.800598+0000","last_unstale":"2024-04-18T05:01:20.459084+0000","last_undegraded":"2024-04-18T05:01:20.459084+0000","last_fullsized":"2024-04-18T05:01:20.459084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'603","last_scrub_stamp":"2024-04-18T05:01:20.459029+0000","last_deep_scrub":"23'603","last_deep_scrub_stamp":"2024-04-18T05:01:20.459029+0000","last_clean_scrub_stamp":"2024-04-18T05:01:20.459029+0000","objects_scrubbed":2,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:27:07.025881+0000","scrub_duration":0.035046730999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":546,"num_write_kb":4388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'458","reported_seq":516,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:23.654905+0000","last_change":"2024-04-18T05:01:23.655141+0000","last_active":"2024-04-18T05:01:23.654905+0000","last_peered":"2024-04-18T05:01:23.654905+0000","last_clean":"2024-04-18T05:01:23.654905+0000","last_became_active":"2024-04-18T04:54:41.197201+0000","last_became_peered":"2024-04-18T04:54:41.197201+0000","last_unstale":"2024-04-18T05:01:23.654905+0000","last_undegraded":"2024-04-18T05:01:23.654905+0000","last_fullsized":"2024-04-18T05:01:23.654905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'458","last_scrub_stamp":"2024-04-18T05:01:23.654853+0000","last_deep_scrub":"23'458","last_deep_scrub_stamp":"2024-04-18T05:01:23.654853+0000","last_clean_scrub_stamp":"2024-04-18T05:01:23.654853+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:23.362109+0000","scrub_duration":0.0048732259999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21429,"num_write":433,"num_write_kb":71833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'59","reported_seq":87,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:19.349316+0000","last_change":"2024-04-18T05:01:19.349515+0000","last_active":"2024-04-18T05:01:19.349316+0000","last_peered":"2024-04-18T05:01:19.349316+0000","last_clean":"2024-04-18T05:01:19.349316+0000","last_became_active":"2024-04-18T04:54:40.797471+0000","last_became_peered":"2024-04-18T04:54:40.797471+0000","last_unstale":"2024-04-18T05:01:19.349316+0000","last_undegraded":"2024-04-18T05:01:19.349316+0000","last_fullsized":"2024-04-18T05:01:19.349316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'59","last_scrub_stamp":"2024-04-18T05:01:19.349260+0000","last_deep_scrub":"23'59","last_deep_scrub_stamp":"2024-04-18T05:01:19.349260+0000","last_clean_scrub_stamp":"2024-04-18T05:01:19.349260+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:21:43.629003+0000","scrub_duration":0.0068506010000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"23'421","reported_seq":491,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:45.481650+0000","last_change":"2024-04-18T05:01:45.481843+0000","last_active":"2024-04-18T05:01:45.481650+0000","last_peered":"2024-04-18T05:01:45.481650+0000","last_clean":"2024-04-18T05:01:45.481650+0000","last_became_active":"2024-04-18T04:54:41.191488+0000","last_became_peered":"2024-04-18T04:54:41.191488+0000","last_unstale":"2024-04-18T05:01:45.481650+0000","last_undegraded":"2024-04-18T05:01:45.481650+0000","last_fullsized":"2024-04-18T05:01:45.481650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'421","last_scrub_stamp":"2024-04-18T05:01:45.481596+0000","last_deep_scrub":"23'421","last_deep_scrub_stamp":"2024-04-18T05:01:45.481596+0000","last_clean_scrub_stamp":"2024-04-18T05:01:45.481596+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:26:44.526526+0000","scrub_duration":0.0044098089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23403,"num_write":390,"num_write_kb":67848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'195","reported_seq":223,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:26.364348+0000","last_change":"2024-04-18T05:01:26.364548+0000","last_active":"2024-04-18T05:01:26.364348+0000","last_peered":"2024-04-18T05:01:26.364348+0000","last_clean":"2024-04-18T05:01:26.364348+0000","last_became_active":"2024-04-18T04:54:40.823277+0000","last_became_peered":"2024-04-18T04:54:40.823277+0000","last_unstale":"2024-04-18T05:01:26.364348+0000","last_undegraded":"2024-04-18T05:01:26.364348+0000","last_fullsized":"2024-04-18T05:01:26.364348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'195","last_scrub_stamp":"2024-04-18T05:01:26.364289+0000","last_deep_scrub":"23'195","last_deep_scrub_stamp":"2024-04-18T05:01:26.364289+0000","last_clean_scrub_stamp":"2024-04-18T05:01:26.364289+0000","objects_scrubbed":3,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:24.955459+0000","scrub_duration":0.028608092000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'448","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:34.619186+0000","last_change":"2024-04-18T05:01:34.619396+0000","last_active":"2024-04-18T05:01:34.619186+0000","last_peered":"2024-04-18T05:01:34.619186+0000","last_clean":"2024-04-18T05:01:34.619186+0000","last_became_active":"2024-04-18T04:54:41.199700+0000","last_became_peered":"2024-04-18T04:54:41.199700+0000","last_unstale":"2024-04-18T05:01:34.619186+0000","last_undegraded":"2024-04-18T05:01:34.619186+0000","last_fullsized":"2024-04-18T05:01:34.619186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'448","last_scrub_stamp":"2024-04-18T05:01:34.619131+0000","last_deep_scrub":"23'448","last_deep_scrub_stamp":"2024-04-18T05:01:34.619131+0000","last_clean_scrub_stamp":"2024-04-18T05:01:34.619131+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:53.588546+0000","scrub_duration":0.003693375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":10662,"num_write":420,"num_write_kb":96864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'131","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:34.721575+0000","last_change":"2024-04-18T05:01:34.721856+0000","last_active":"2024-04-18T05:01:34.721575+0000","last_peered":"2024-04-18T05:01:34.721575+0000","last_clean":"2024-04-18T05:01:34.721575+0000","last_became_active":"2024-04-18T04:54:40.800405+0000","last_became_peered":"2024-04-18T04:54:40.800405+0000","last_unstale":"2024-04-18T05:01:34.721575+0000","last_undegraded":"2024-04-18T05:01:34.721575+0000","last_fullsized":"2024-04-18T05:01:34.721575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-04-18T05:01:34.721521+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-04-18T05:01:34.721521+0000","last_clean_scrub_stamp":"2024-04-18T05:01:34.721521+0000","objects_scrubbed":4,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:06.452051+0000","scrub_duration":0.044336153000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":8237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'441","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:18.559227+0000","last_change":"2024-04-18T05:01:18.559314+0000","last_active":"2024-04-18T05:01:18.559227+0000","last_peered":"2024-04-18T05:01:18.559227+0000","last_clean":"2024-04-18T05:01:18.559227+0000","last_became_active":"2024-04-18T04:54:41.186301+0000","last_became_peered":"2024-04-18T04:54:41.186301+0000","last_unstale":"2024-04-18T05:01:18.559227+0000","last_undegraded":"2024-04-18T05:01:18.559227+0000","last_fullsized":"2024-04-18T05:01:18.559227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'441","last_scrub_stamp":"2024-04-18T05:01:18.559208+0000","last_deep_scrub":"23'441","last_deep_scrub_stamp":"2024-04-18T05:01:18.559208+0000","last_clean_scrub_stamp":"2024-04-18T05:01:18.559208+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:58.993043+0000","scrub_duration":0.0020339099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":27247,"num_write":409,"num_write_kb":76591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"23'382","reported_seq":419,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:24.698410+0000","last_change":"2024-04-18T05:01:24.698605+0000","last_active":"2024-04-18T05:01:24.698410+0000","last_peered":"2024-04-18T05:01:24.698410+0000","last_clean":"2024-04-18T05:01:24.698410+0000","last_became_active":"2024-04-18T04:54:41.192941+0000","last_became_peered":"2024-04-18T04:54:41.192941+0000","last_unstale":"2024-04-18T05:01:24.698410+0000","last_undegraded":"2024-04-18T05:01:24.698410+0000","last_fullsized":"2024-04-18T05:01:24.698410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'382","last_scrub_stamp":"2024-04-18T05:01:24.698356+0000","last_deep_scrub":"23'382","last_deep_scrub_stamp":"2024-04-18T05:01:24.698356+0000","last_clean_scrub_stamp":"2024-04-18T05:01:24.698356+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:15.097966+0000","scrub_duration":0.0038559670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4755,"num_write":342,"num_write_kb":72428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'361","reported_seq":388,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:28.505253+0000","last_change":"2024-04-18T05:01:28.505483+0000","last_active":"2024-04-18T05:01:28.505253+0000","last_peered":"2024-04-18T05:01:28.505253+0000","last_clean":"2024-04-18T05:01:28.505253+0000","last_became_active":"2024-04-18T04:54:40.799517+0000","last_became_peered":"2024-04-18T04:54:40.799517+0000","last_unstale":"2024-04-18T05:01:28.505253+0000","last_undegraded":"2024-04-18T05:01:28.505253+0000","last_fullsized":"2024-04-18T05:01:28.505253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'361","last_scrub_stamp":"2024-04-18T05:01:28.505196+0000","last_deep_scrub":"23'361","last_deep_scrub_stamp":"2024-04-18T05:01:28.505196+0000","last_clean_scrub_stamp":"2024-04-18T05:01:28.505196+0000","objects_scrubbed":4,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:28.212451+0000","scrub_duration":0.040738904999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"23'382","reported_seq":433,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:34.697411+0000","last_change":"2024-04-18T05:01:34.697686+0000","last_active":"2024-04-18T05:01:34.697411+0000","last_peered":"2024-04-18T05:01:34.697411+0000","last_clean":"2024-04-18T05:01:34.697411+0000","last_became_active":"2024-04-18T04:54:41.179359+0000","last_became_peered":"2024-04-18T04:54:41.179359+0000","last_unstale":"2024-04-18T05:01:34.697411+0000","last_undegraded":"2024-04-18T05:01:34.697411+0000","last_fullsized":"2024-04-18T05:01:34.697411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'382","last_scrub_stamp":"2024-04-18T05:01:34.697296+0000","last_deep_scrub":"23'382","last_deep_scrub_stamp":"2024-04-18T05:01:34.697296+0000","last_clean_scrub_stamp":"2024-04-18T05:01:34.697296+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:15.131132+0000","scrub_duration":0.0047097220000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14401,"num_write":356,"num_write_kb":79542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'299","reported_seq":326,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:29.589971+0000","last_change":"2024-04-18T05:01:29.590183+0000","last_active":"2024-04-18T05:01:29.589971+0000","last_peered":"2024-04-18T05:01:29.589971+0000","last_clean":"2024-04-18T05:01:29.589971+0000","last_became_active":"2024-04-18T04:54:40.800660+0000","last_became_peered":"2024-04-18T04:54:40.800660+0000","last_unstale":"2024-04-18T05:01:29.589971+0000","last_undegraded":"2024-04-18T05:01:29.589971+0000","last_fullsized":"2024-04-18T05:01:29.589971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'299","last_scrub_stamp":"2024-04-18T05:01:29.589913+0000","last_deep_scrub":"23'299","last_deep_scrub_stamp":"2024-04-18T05:01:29.589913+0000","last_clean_scrub_stamp":"2024-04-18T05:01:29.589913+0000","objects_scrubbed":10,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:19.989522+0000","scrub_duration":0.076672561,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":12441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'366","reported_seq":421,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:54.704571+0000","last_change":"2024-04-18T05:01:54.704778+0000","last_active":"2024-04-18T05:01:54.704571+0000","last_peered":"2024-04-18T05:01:54.704571+0000","last_clean":"2024-04-18T05:01:54.704571+0000","last_became_active":"2024-04-18T04:54:41.189344+0000","last_became_peered":"2024-04-18T04:54:41.189344+0000","last_unstale":"2024-04-18T05:01:54.704571+0000","last_undegraded":"2024-04-18T05:01:54.704571+0000","last_fullsized":"2024-04-18T05:01:54.704571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'366","last_scrub_stamp":"2024-04-18T05:01:54.704518+0000","last_deep_scrub":"23'366","last_deep_scrub_stamp":"2024-04-18T05:01:54.704518+0000","last_clean_scrub_stamp":"2024-04-18T05:01:54.704518+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:44.332672+0000","scrub_duration":0.0037392409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10936,"num_write":342,"num_write_kb":51086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'87","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:25.570678+0000","last_change":"2024-04-18T05:01:25.570947+0000","last_active":"2024-04-18T05:01:25.570678+0000","last_peered":"2024-04-18T05:01:25.570678+0000","last_clean":"2024-04-18T05:01:25.570678+0000","last_became_active":"2024-04-18T04:54:40.813290+0000","last_became_peered":"2024-04-18T04:54:40.813290+0000","last_unstale":"2024-04-18T05:01:25.570678+0000","last_undegraded":"2024-04-18T05:01:25.570678+0000","last_fullsized":"2024-04-18T05:01:25.570678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'87","last_scrub_stamp":"2024-04-18T05:01:25.570624+0000","last_deep_scrub":"23'87","last_deep_scrub_stamp":"2024-04-18T05:01:25.570624+0000","last_clean_scrub_stamp":"2024-04-18T05:01:25.570624+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:06.004459+0000","scrub_duration":0.021566535000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'407","reported_seq":465,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.518150+0000","last_change":"2024-04-18T05:01:31.518368+0000","last_active":"2024-04-18T05:01:31.518150+0000","last_peered":"2024-04-18T05:01:31.518150+0000","last_clean":"2024-04-18T05:01:31.518150+0000","last_became_active":"2024-04-18T04:54:41.192096+0000","last_became_peered":"2024-04-18T04:54:41.192096+0000","last_unstale":"2024-04-18T05:01:31.518150+0000","last_undegraded":"2024-04-18T05:01:31.518150+0000","last_fullsized":"2024-04-18T05:01:31.518150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'407","last_scrub_stamp":"2024-04-18T05:01:31.518099+0000","last_deep_scrub":"23'407","last_deep_scrub_stamp":"2024-04-18T05:01:31.518099+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.518099+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:21.917708+0000","scrub_duration":0.0045801699999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17335,"num_write":380,"num_write_kb":68515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'137","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:36.398640+0000","last_change":"2024-04-18T05:01:36.398858+0000","last_active":"2024-04-18T05:01:36.398640+0000","last_peered":"2024-04-18T05:01:36.398640+0000","last_clean":"2024-04-18T05:01:36.398640+0000","last_became_active":"2024-04-18T04:54:40.804913+0000","last_became_peered":"2024-04-18T04:54:40.804913+0000","last_unstale":"2024-04-18T05:01:36.398640+0000","last_undegraded":"2024-04-18T05:01:36.398640+0000","last_fullsized":"2024-04-18T05:01:36.398640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'137","last_scrub_stamp":"2024-04-18T05:01:36.398585+0000","last_deep_scrub":"23'137","last_deep_scrub_stamp":"2024-04-18T05:01:36.398585+0000","last_clean_scrub_stamp":"2024-04-18T05:01:36.398585+0000","objects_scrubbed":7,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:26:25.377881+0000","scrub_duration":0.026464031999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2494,"num_read_kb":1324974,"num_write":24555,"num_write_kb":4507656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26500,"ondisk_log_size":26500,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":130916242,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":351,"num_read_kb":1645,"num_write":7226,"num_write_kb":133419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":100597760,"data_stored":261832484,"data_compressed":36635560,"data_compressed_allocated":47603712,"data_compressed_original":209084416,"omap_allocated":0,"internal_metadata":0},"log_size":8954,"ondisk_log_size":8954,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509532,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":5676,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":5812224,"data_stored":14125282,"data_compressed":1836351,"data_compressed_allocated":2379776,"data_compressed_original":10878976,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.79300000000000004,"15min":0.83699999999999997},"min":{"1min":0.53100000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.0900000000000001,"5min":1.1910000000000001,"15min":1.2490000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.81000000000000005,"15min":0.84299999999999997},"min":{"1min":0.54400000000000004,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.21,"5min":1.262,"15min":1.262},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.82399999999999995,"15min":0.82199999999999995},"min":{"1min":0.66200000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2310000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.84799999999999998,"15min":0.84899999999999998},"min":{"1min":0.622,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.26,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.90400000000000003}]},{"osd":2,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.92800000000000005,"15min":0.89300000000000002},"min":{"1min":0.56299999999999994,"5min":0.438,"15min":0.438},"max":{"1min":1.3320000000000001,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.88600000000000001,"15min":0.87},"min":{"1min":0.69199999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.218,"5min":1.379,"15min":1.4019999999999999},"last":0.82799999999999996}]},{"osd":3,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.88200000000000001,"15min":0.88500000000000001},"min":{"1min":0.67900000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.032,"5min":1.458,"15min":1.458},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.98799999999999999,"15min":0.95399999999999996},"min":{"1min":0.72599999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.286,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1}]},{"osd":4,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.90800000000000003,"15min":0.92600000000000005},"min":{"1min":0.56999999999999995,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.339,"5min":1.605,"15min":1.605},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.90800000000000003,"15min":0.91200000000000003},"min":{"1min":0.68000000000000005,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.224,"5min":1.546,"15min":1.546},"last":0.79000000000000004}]},{"osd":5,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.97599999999999998,"15min":1.012},"min":{"1min":0.66800000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4379999999999999,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.996,"15min":1.016},"min":{"1min":0.61099999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.2130000000000001,"5min":1.431,"15min":1.5640000000000001},"last":0.96499999999999997}]},{"osd":6,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0640000000000001,"15min":1.103},"min":{"1min":0.70299999999999996,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2929999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.0569999999999999,"15min":1.0469999999999999},"min":{"1min":0.80900000000000005,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2809999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.871}]}]},{"osd":6,"up_from":15,"seq":64424509532,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47056,"kb_used_data":7752,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94324784,"statfs":{"total":96636764160,"available":96588578816,"internally_reserved":0,"allocated":7938048,"data_stored":21059926,"data_compressed":3027129,"data_compressed_allocated":3776512,"data_compressed_original":17063936,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78000000000000003,"15min":0.77700000000000002},"min":{"1min":0.51200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80000000000000004,"15min":0.84499999999999997},"min":{"1min":0.47499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.048,"5min":1.1870000000000001,"15min":1.353},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.88,"15min":0.93300000000000005},"min":{"1min":0.56899999999999995,"5min":0.312,"15min":0.312},"max":{"1min":1.2430000000000001,"5min":1.268,"15min":1.8560000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.83199999999999996,"15min":0.84799999999999998},"min":{"1min":0.55500000000000005,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.2849999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.96799999999999997,"15min":0.94099999999999995},"min":{"1min":0.71499999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.552,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.94799999999999995,"15min":0.93000000000000005},"min":{"1min":0.52300000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3220000000000001,"5min":1.325,"15min":1.325},"last":1.1619999999999999}]},{"osd":3,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.93400000000000005,"15min":0.90900000000000003},"min":{"1min":0.73899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3049999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.753},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.95599999999999996,"15min":0.98599999999999999},"min":{"1min":0.70699999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.4510000000000001,"5min":1.617,"15min":1.617},"last":1.0129999999999999}]},{"osd":4,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.90700000000000003,"15min":0.97299999999999998},"min":{"1min":0.70999999999999996,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1259999999999999,"5min":1.4990000000000001,"15min":1.631},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.002,"5min":0.97899999999999998,"15min":1.052},"min":{"1min":0.71599999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2370000000000001,"5min":1.631,"15min":1.631},"last":1.089}]},{"osd":5,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.98499999999999999,"15min":1.0049999999999999},"min":{"1min":0.69599999999999995,"5min":0.372,"15min":0.372},"max":{"1min":1.28,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0209999999999999,"15min":1.0429999999999999},"min":{"1min":0.64900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.3109999999999999,"5min":1.673,"15min":1.6739999999999999},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0489999999999999,"15min":1.1020000000000001},"min":{"1min":0.67200000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.3959999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0820000000000001,"15min":1.107},"min":{"1min":0.68500000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.268,"5min":1.73,"15min":1.7769999999999999},"last":1.109}]}]},{"osd":5,"up_from":15,"seq":64424509531,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66536,"kb_used_data":13280,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94305304,"statfs":{"total":96636764160,"available":96568631296,"internally_reserved":0,"allocated":13598720,"data_stored":35687478,"data_compressed":4904028,"data_compressed_allocated":6356992,"data_compressed_original":28622848,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.77100000000000002,"15min":0.88600000000000001},"min":{"1min":0.58299999999999996,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.196,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.80600000000000005,"15min":0.82699999999999996},"min":{"1min":0.55600000000000005,"5min":0.309,"15min":0.309},"max":{"1min":1.1850000000000001,"5min":1.542,"15min":1.542},"last":1.135}]},{"osd":1,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.93500000000000005,"15min":0.91700000000000004},"min":{"1min":0.66300000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.169,"5min":9.8819999999999997,"15min":9.8819999999999997},"last":0.999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.90100000000000002,"15min":0.92700000000000005},"min":{"1min":0.73999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1080000000000001,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.89600000000000002,"15min":0.89200000000000002},"min":{"1min":0.70499999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.264,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.97799999999999998,"15min":0.94299999999999995},"min":{"1min":0.67900000000000005,"5min":0.38,"15min":0.38},"max":{"1min":1.1040000000000001,"5min":10.031000000000001,"15min":10.031000000000001},"last":0.872}]},{"osd":3,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.94499999999999995,"15min":0.96099999999999997},"min":{"1min":0.69799999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1859999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.038},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.98699999999999999,"15min":1.0089999999999999},"min":{"1min":0.73199999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.157,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.0680000000000001}]},{"osd":4,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":1.0069999999999999,"15min":0.92000000000000004},"min":{"1min":0.60699999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.23,"5min":9.968,"15min":9.968},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.012,"5min":1,"15min":1.018},"min":{"1min":0.67900000000000005,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2330000000000001,"5min":1.631,"15min":1.8440000000000001},"last":1.1080000000000001}]},{"osd":6,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0189999999999999,"15min":0.96499999999999997},"min":{"1min":0.64500000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.256,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.1180000000000001,"15min":1.038},"min":{"1min":0.76400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.2869999999999999,"5min":10.09,"15min":10.09},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.089,"15min":1.099},"min":{"1min":0.69699999999999995,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.244,"5min":1.7050000000000001,"15min":1.944},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.139,"5min":1.1479999999999999,"15min":1.149},"min":{"1min":0.96599999999999997,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.4159999999999999,"5min":1.97,"15min":1.97},"last":1.228}]}]},{"osd":3,"up_from":15,"seq":64424509532,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77376,"kb_used_data":20024,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94294464,"statfs":{"total":96636764160,"available":96557531136,"internally_reserved":0,"allocated":20504576,"data_stored":54614164,"data_compressed":7702565,"data_compressed_allocated":9973760,"data_compressed_original":44273664,"omap_allocated":1592,"internal_metadata":58718664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63400000000000001,"15min":0.66600000000000004},"min":{"1min":0.222,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.032,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.64100000000000001,"15min":0.61499999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.82299999999999995,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63200000000000001,"15min":0.63400000000000001},"min":{"1min":0.34599999999999997,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.077,"5min":1.0920000000000001,"15min":1.2410000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76000000000000001,"15min":0.69999999999999996},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.1839999999999999,"5min":2.601,"15min":2.601},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.74099999999999999,"15min":0.73199999999999998},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.28499999999999998},"max":{"1min":0.98899999999999999,"5min":1.359,"15min":1.573},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80000000000000004,"15min":0.79400000000000004},"min":{"1min":0.27700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1000000000000001,"5min":1.51,"15min":1.51},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85699999999999998,"15min":0.85599999999999998},"min":{"1min":0.51800000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.224,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92900000000000005,"15min":0.93400000000000005},"min":{"1min":0.66800000000000004,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1279999999999999,"5min":1.524,"15min":1.524},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":2.0219999999999998,"5min":1.167,"15min":1.0049999999999999},"min":{"1min":0.69199999999999995,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":21.260000000000002,"5min":21.260000000000002,"15min":21.260000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.091,"15min":1.0469999999999999},"min":{"1min":0.56999999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":7.569,"5min":7.569,"15min":7.569},"last":1.052}]},{"osd":6,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.0660000000000001,"15min":0.995},"min":{"1min":0.60599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":7.2729999999999997,"5min":7.2729999999999997,"15min":7.2729999999999997},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.0580000000000001,"15min":1.054},"min":{"1min":0.69899999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.2199999999999998,"5min":4.2199999999999998,"15min":4.2199999999999998},"last":0.98199999999999998}]},{"osd":7,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.077,"15min":1.1040000000000001},"min":{"1min":0.57299999999999995,"5min":0.435,"15min":0.435},"max":{"1min":1.3879999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1.103},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.05,"15min":1.0549999999999999},"min":{"1min":0.64500000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0209999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509531,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59832,"kb_used_data":14768,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94312008,"statfs":{"total":96636764160,"available":96575496192,"internally_reserved":0,"allocated":15122432,"data_stored":34231216,"data_compressed":4539223,"data_compressed_allocated":6156288,"data_compressed_original":25436160,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.65000000000000002,"15min":0.59399999999999997},"min":{"1min":0.46600000000000003,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.78700000000000003,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.749},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68200000000000005,"15min":0.73599999999999999},"min":{"1min":0.55100000000000005,"5min":0.214,"15min":0.214},"max":{"1min":0.92600000000000005,"5min":1.5920000000000001,"15min":1.9239999999999999},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Apr 18 05:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.68300000000000005},"min":{"1min":0.49199999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.93799999999999994,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.749,"15min":0.72399999999999998},"min":{"1min":0.505,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.048,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Apr 18 05:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79300000000000004,"15min":0.78400000000000003},"min":{"1min":0.59099999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.0649999999999999,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80700000000000005,"15min":0.77700000000000002},"min":{"1min":0.56899999999999995,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.032,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":0.94599999999999995}]},{"osd":4,"last update":"Thu Apr 18 05:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.94599999999999995,"15min":0.94499999999999995},"min":{"1min":0.72099999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4430000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":0.97999999999999998},"min":{"1min":0.67000000000000004,"5min":0.379,"15min":0.379},"max":{"1min":1.2629999999999999,"5min":2.133,"15min":2.133},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:01:39 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0129999999999999,"15min":1.008},"min":{"1min":0.79000000000000004,"5min":0.313,"15min":0.313},"max":{"1min":1.5660000000000001,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.998,"5min":1.0109999999999999,"15min":0.98599999999999999},"min":{"1min":0.68300000000000005,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3069999999999999,"5min":2.347,"15min":2.347},"last":1.0920000000000001}]},{"osd":6,"last update":"Thu Apr 18 05:01:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0189999999999999,"15min":1.0209999999999999},"min":{"1min":0.73099999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.5009999999999999,"5min":3.024,"15min":3.024},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0549999999999999,"15min":1.0589999999999999},"min":{"1min":0.70599999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.375,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Apr 18 05:01:39 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0960000000000001,"15min":1.077},"min":{"1min":0.92600000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.419,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":1.216},{"interface":"front","average":{"1min":1.054,"5min":1.117,"15min":1.105},"min":{"1min":0.77400000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.339,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.25}]}]},{"osd":0,"up_from":15,"seq":64424509533,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78896,"kb_used_data":21544,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94292944,"statfs":{"total":96636764160,"available":96555974656,"internally_reserved":0,"allocated":22061056,"data_stored":54614568,"data_compressed":7565653,"data_compressed_allocated":10006528,"data_compressed_original":42741760,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65500000000000003,"15min":0.58899999999999997},"min":{"1min":0.497,"5min":0.22800000000000001,"15min":0.19900000000000001},"max":{"1min":0.91600000000000004,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.66700000000000004,"15min":0.70299999999999996},"min":{"1min":0.55800000000000005,"5min":0.23100000000000001,"15min":0.224},"max":{"1min":1.1140000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73199999999999998,"15min":0.66700000000000004},"min":{"1min":0.58399999999999996,"5min":0.22,"15min":0.22},"max":{"1min":0.90000000000000002,"5min":2.629,"15min":2.629},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71499999999999997,"15min":0.65300000000000002},"min":{"1min":0.45000000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.96299999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.61799999999999999},"min":{"1min":0.59799999999999998,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.98699999999999999,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.84599999999999997,"15min":0.754},"min":{"1min":0.64500000000000002,"5min":0.27900000000000003,"15min":0.27100000000000002},"max":{"1min":1.0469999999999999,"5min":3.375,"15min":3.375},"last":0.88300000000000001}]},{"osd":4,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91600000000000004,"15min":0.91100000000000003},"min":{"1min":0.65800000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.099,"5min":2.601,"15min":2.601},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.95899999999999996,"15min":0.92800000000000005},"min":{"1min":0.80300000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.284,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.95699999999999996,"15min":0.91200000000000003},"min":{"1min":0.75,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.474,"5min":1.724,"15min":1.724},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.96799999999999997,"15min":0.94599999999999995},"min":{"1min":0.80300000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.155,"5min":2.734,"15min":2.734},"last":0.96099999999999997}]},{"osd":6,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0529999999999999,"15min":0.99099999999999999},"min":{"1min":0.81399999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3360000000000001,"5min":2.681,"15min":2.681},"last":1.147},{"interface":"front","average":{"1min":1.046,"5min":1.026,"15min":1.016},"min":{"1min":0.753,"5min":0.499,"15min":0.499},"max":{"1min":1.5629999999999999,"5min":2.008,"15min":2.008},"last":1.016}]},{"osd":7,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.056,"15min":1.0309999999999999},"min":{"1min":0.878,"5min":0.53300000000000003,"15min":0.496},"max":{"1min":1.6379999999999999,"5min":2.069,"15min":2.069},"last":1.079},{"interface":"front","average":{"1min":1.04,"5min":1.0580000000000001,"15min":0.97999999999999998},"min":{"1min":0.872,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.232,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":1.046}]}]},{"osd":4,"up_from":13,"seq":55834574940,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47916,"kb_used_data":8612,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94323924,"statfs":{"total":96636764160,"available":96587698176,"internally_reserved":0,"allocated":8818688,"data_stored":24681186,"data_compressed":3524620,"data_compressed_allocated":4517888,"data_compressed_original":20582400,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.76900000000000002,"15min":0.88},"min":{"1min":0.60999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1140000000000001,"5min":1.1579999999999999,"15min":1.3080000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76300000000000001,"15min":0.82699999999999996},"min":{"1min":0.63700000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.97699999999999998,"5min":1.264,"15min":1.264},"last":0.79800000000000004}]},{"osd":1,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82799999999999996,"15min":0.871},"min":{"1min":0.58799999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.119,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.878},{"interface":"front","average":{"1min":0.875,"5min":0.82899999999999996,"15min":0.86199999999999999},"min":{"1min":0.70399999999999996,"5min":0.318,"15min":0.318},"max":{"1min":1.1000000000000001,"5min":1.246,"15min":1.246},"last":0.995}]},{"osd":2,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83499999999999996,"15min":0.85699999999999998},"min":{"1min":0.51700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1479999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.02},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.93799999999999994,"15min":0.96599999999999997},"min":{"1min":0.749,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2889999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.96799999999999997}]},{"osd":3,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.006,"15min":0.997},"min":{"1min":0.69499999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1990000000000001,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":1.075},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0720000000000001,"15min":1.0800000000000001},"min":{"1min":0.94699999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1839999999999999,"5min":3.6280000000000001,"15min":3.6280000000000001},"last":1.1160000000000001}]},{"osd":5,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.93600000000000005,"15min":0.93300000000000005},"min":{"1min":0.60699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.228,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.046,"5min":1.0289999999999999,"15min":1.052},"min":{"1min":0.70899999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.1819999999999999}]},{"osd":6,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.92700000000000005,"15min":0.995},"min":{"1min":0.65800000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.117,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.046,"15min":1.0549999999999999},"min":{"1min":0.75900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.633,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.1000000000000001,"15min":1.133},"min":{"1min":0.69299999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1319999999999999,"15min":1.143},"min":{"1min":0.90000000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.538,"5min":3.9910000000000001,"15min":3.9910000000000001},"last":0.84499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574940,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":8536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":8740864,"data_stored":24679416,"data_compressed":3602361,"data_compressed_allocated":4526080,"data_compressed_original":20631552,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.621,"15min":0.56799999999999995},"min":{"1min":0.443,"5min":0.218,"15min":0.20000000000000001},"max":{"1min":1.1539999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.67500000000000004,"15min":0.70099999999999996},"min":{"1min":0.34699999999999998,"5min":0.193,"15min":0.193},"max":{"1min":1.069,"5min":1.2330000000000001,"15min":1.347},"last":0.76700000000000002}]},{"osd":1,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70499999999999996,"15min":0.67500000000000004},"min":{"1min":0.44600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.96799999999999997,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70199999999999996,"15min":0.66900000000000004},"min":{"1min":0.41199999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.2270000000000001,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.39000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.103,"5min":1.224,"15min":1.29},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.69399999999999995,"15min":0.65100000000000002},"min":{"1min":0.498,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.83099999999999996}]},{"osd":4,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.94799999999999995,"15min":0.95399999999999996},"min":{"1min":0.60299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.2090000000000001,"5min":2.456,"15min":2.456},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.872,"15min":0.875},"min":{"1min":0.73299999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0800000000000001,"5min":1.454,"15min":1.6950000000000001},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.97899999999999998,"15min":0.94499999999999995},"min":{"1min":0.66400000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3049999999999999,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.024,"5min":0.96999999999999997,"15min":0.98699999999999999},"min":{"1min":0.85099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.331,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.94199999999999995}]},{"osd":6,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.93799999999999994,"15min":0.91500000000000004},"min":{"1min":0.65500000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2130000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.038,"15min":0.98299999999999998},"min":{"1min":0.67800000000000005,"5min":0.439,"15min":0.439},"max":{"1min":1.3720000000000001,"5min":3.391,"15min":3.391},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.02,"15min":1.0269999999999999},"min":{"1min":0.77400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.256,"5min":1.4259999999999999,"15min":1.4990000000000001},"last":0.998},{"interface":"front","average":{"1min":1.032,"5min":1.0129999999999999,"15min":0.97899999999999998},"min":{"1min":0.82999999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.276,"5min":1.748,"15min":1.748},"last":0.97899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21827584,"data_stored":54529566,"data_compressed":7565653,"data_compressed_allocated":10006528,"data_compressed_original":42741760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14823424,"data_stored":33555846,"data_compressed":4506038,"data_compressed_allocated":6111232,"data_compressed_original":24862720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8507392,"data_stored":24594414,"data_compressed":3602361,"data_compressed_allocated":4526080,"data_compressed_original":20631552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20271104,"data_stored":54529162,"data_compressed":7702565,"data_compressed_allocated":9973760,"data_compressed_original":44273664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8585216,"data_stored":24596184,"data_compressed":3524620,"data_compressed_allocated":4517888,"data_compressed_original":20582400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13299712,"data_stored":35012108,"data_compressed":4870843,"data_compressed_allocated":6311936,"data_compressed_original":28049408,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7704576,"data_stored":20974924,"data_compressed":3027129,"data_compressed_allocated":3776512,"data_compressed_original":17063936,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5578752,"data_stored":14040280,"data_compressed":1836351,"data_compressed_allocated":2379776,"data_compressed_original":10878976,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T05:02:00.786 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:02:00.786 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:02:00.787 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:02:00.787 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:02:00.787 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:02:00.787 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:02:00.787 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:02:00.787 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:02:00.787 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:02:00.788 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:02:00.788 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:02:00.788 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:02:00.789 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T05:02:18.916 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T05:02:18.920 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T05:02:20.790 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T05:02:20.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.921+0000 7f3965b82640 1 Processor -- start 2024-04-18T05:02:20.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.921+0000 7f3965b82640 1 -- start start 2024-04-18T05:02:20.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.921+0000 7f3965b82640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f39600c6520 0x7f39600c6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:20.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.921+0000 7f3965b82640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3960158890 con 0x7f39600c5d40 2024-04-18T05:02:20.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.921+0000 7f3965b82640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39600c6e90 con 0x7f396014f740 2024-04-18T05:02:20.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.921+0000 7f3965b82640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3960158b30 con 0x7f39600c6520 2024-04-18T05:02:20.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.921+0000 7f395ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f39600c6520 0x7f39600c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:20.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.921+0000 7f395ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f39600c6520 0x7f39600c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38736/0 (socket says 172.21.15.96:38736) 2024-04-18T05:02:20.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.921+0000 7f395ffff640 1 -- 172.21.15.96:0/1071929417 learned_addr learned my addr 172.21.15.96:0/1071929417 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:20.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.921+0000 7f395ffff640 1 -- 172.21.15.96:0/1071929417 >> v1:172.21.15.139:6789/0 conn(0x7f396014f740 legacy=0x7f39600c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:02:20.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.921+0000 7f395ffff640 1 -- 172.21.15.96:0/1071929417 >> v1:172.21.15.96:6789/0 conn(0x7f39600c5d40 legacy=0x7f39600c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:20.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.921+0000 7f395ffff640 1 -- 172.21.15.96:0/1071929417 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3960158e10 con 0x7f39600c6520 2024-04-18T05:02:20.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.925+0000 7f395ffff640 1 --2- 172.21.15.96:0/1071929417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39600c6520 0x7f39600c6950 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3958006fd0 tx=0x7f39580211a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00c0f746f6784f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:20.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.925+0000 7f395e7fc640 1 -- 172.21.15.96:0/1071929417 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958004030 con 0x7f39600c6520 2024-04-18T05:02:20.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.925+0000 7f395e7fc640 1 -- 172.21.15.96:0/1071929417 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39580ad030 con 0x7f39600c6520 2024-04-18T05:02:20.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.925+0000 7f395e7fc640 1 -- 172.21.15.96:0/1071929417 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958004410 con 0x7f39600c6520 2024-04-18T05:02:20.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.925+0000 7f3965b82640 1 -- 172.21.15.96:0/1071929417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39600c6520 msgr2=0x7f39600c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:20.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.925+0000 7f3965b82640 1 --2- 172.21.15.96:0/1071929417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39600c6520 0x7f39600c6950 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3958006fd0 tx=0x7f39580211a0 comp rx=0 tx=0).stop 2024-04-18T05:02:20.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.925+0000 7f3965b82640 1 -- 172.21.15.96:0/1071929417 shutdown_connections 2024-04-18T05:02:20.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.925+0000 7f3965b82640 1 --2- 172.21.15.96:0/1071929417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39600c6520 0x7f39600c6950 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:20.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.925+0000 7f3965b82640 1 -- 172.21.15.96:0/1071929417 >> 172.21.15.96:0/1071929417 conn(0x7f39600cab90 msgr2=0x7f39600cafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:20.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.925+0000 7f3965b82640 1 -- 172.21.15.96:0/1071929417 shutdown_connections 2024-04-18T05:02:20.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.925+0000 7f3965b82640 1 -- 172.21.15.96:0/1071929417 wait complete. 2024-04-18T05:02:20.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.925+0000 7f3965b82640 1 Processor -- start 2024-04-18T05:02:20.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.925+0000 7f3965b82640 1 -- start start 2024-04-18T05:02:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f3965b82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39600c5d40 0x7f3960151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f3965b82640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39600c6520 0x7f39600c3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f3965b82640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f396014f740 0x7f39600c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f3965b82640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3960150da0 con 0x7f39600c6520 2024-04-18T05:02:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f3965b82640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39601eab10 con 0x7f39600c5d40 2024-04-18T05:02:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f3965b82640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39601eadf0 con 0x7f396014f740 2024-04-18T05:02:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f395effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39600c6520 0x7f39600c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f395effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39600c6520 0x7f39600c3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38742/0 (socket says 172.21.15.96:38742) 2024-04-18T05:02:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f395effd640 1 -- 172.21.15.96:0/2509419037 learned_addr learned my addr 172.21.15.96:0/2509419037 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f395f7fe640 1 --2- 172.21.15.96:0/2509419037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39600c5d40 0x7f3960151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f395ffff640 1 --2- 172.21.15.96:0/2509419037 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f396014f740 0x7f39600c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f395effd640 1 -- 172.21.15.96:0/2509419037 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f396014f740 msgr2=0x7f39600c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f395effd640 1 --2- 172.21.15.96:0/2509419037 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f396014f740 0x7f39600c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f395effd640 1 -- 172.21.15.96:0/2509419037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39600c5d40 msgr2=0x7f3960151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f395effd640 1 --2- 172.21.15.96:0/2509419037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39600c5d40 0x7f3960151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f395effd640 1 -- 172.21.15.96:0/2509419037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395800b780 con 0x7f39600c6520 2024-04-18T05:02:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f395effd640 1 --2- 172.21.15.96:0/2509419037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39600c6520 0x7f39600c3150 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f394800c500 tx=0x7f394800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f3957fff640 1 -- 172.21.15.96:0/2509419037 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948005220 con 0x7f39600c6520 2024-04-18T05:02:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f3957fff640 1 -- 172.21.15.96:0/2509419037 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3948005380 con 0x7f39600c6520 2024-04-18T05:02:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f3965b82640 1 -- 172.21.15.96:0/2509419037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3960151060 con 0x7f39600c6520 2024-04-18T05:02:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f3957fff640 1 -- 172.21.15.96:0/2509419037 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948007270 con 0x7f39600c6520 2024-04-18T05:02:20.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f3965b82640 1 -- 172.21.15.96:0/2509419037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3960152a20 con 0x7f39600c6520 2024-04-18T05:02:20.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f3965b82640 1 -- 172.21.15.96:0/2509419037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3960067050 con 0x7f39600c6520 2024-04-18T05:02:20.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f3957fff640 1 -- 172.21.15.96:0/2509419037 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f39480073d0 con 0x7f39600c6520 2024-04-18T05:02:20.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f3957fff640 1 --2- 172.21.15.96:0/2509419037 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3940066690 0x7f3940068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:20.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f395f7fe640 1 --2- 172.21.15.96:0/2509419037 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3940066690 0x7f3940068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:20.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f3957fff640 1 -- 172.21.15.96:0/2509419037 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f3948083ad0 con 0x7f39600c6520 2024-04-18T05:02:20.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.929+0000 7f395f7fe640 1 --2- 172.21.15.96:0/2509419037 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3940066690 0x7f3940068b50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3950009f20 tx=0x7f39500094d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:20.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:20.933+0000 7f3957fff640 1 -- 172.21.15.96:0/2509419037 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f3948050e30 con 0x7f39600c6520 2024-04-18T05:02:21.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:21.089+0000 7f3965b82640 1 -- 172.21.15.96:0/2509419037 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3960150c20 con 0x7f3940066690 2024-04-18T05:02:21.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:21.101+0000 7f3957fff640 1 -- 172.21.15.96:0/2509419037 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+292195 (secure 0 0 0) 0x7f3950009680 con 0x7f3940066690 2024-04-18T05:02:21.104 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T05:02:21.106 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T05:02:21.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:21.105+0000 7f3965b82640 1 -- 172.21.15.96:0/2509419037 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3940066690 msgr2=0x7f3940068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:21.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:21.105+0000 7f3965b82640 1 --2- 172.21.15.96:0/2509419037 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3940066690 0x7f3940068b50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3950009f20 tx=0x7f39500094d0 comp rx=0 tx=0).stop 2024-04-18T05:02:21.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:21.105+0000 7f3965b82640 1 -- 172.21.15.96:0/2509419037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39600c6520 msgr2=0x7f39600c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:21.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:21.105+0000 7f3965b82640 1 --2- 172.21.15.96:0/2509419037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39600c6520 0x7f39600c3150 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f394800c500 tx=0x7f394800c9c0 comp rx=0 tx=0).stop 2024-04-18T05:02:21.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:21.105+0000 7f3965b82640 1 -- 172.21.15.96:0/2509419037 shutdown_connections 2024-04-18T05:02:21.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:21.105+0000 7f3965b82640 1 --2- 172.21.15.96:0/2509419037 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3940066690 0x7f3940068b50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:21.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:21.105+0000 7f3965b82640 1 --2- 172.21.15.96:0/2509419037 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f396014f740 0x7f39600c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:21.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:21.105+0000 7f3965b82640 1 --2- 172.21.15.96:0/2509419037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39600c6520 0x7f39600c3150 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:21.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:21.105+0000 7f3965b82640 1 --2- 172.21.15.96:0/2509419037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39600c5d40 0x7f3960151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:21.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:21.105+0000 7f3965b82640 1 -- 172.21.15.96:0/2509419037 >> 172.21.15.96:0/2509419037 conn(0x7f39600cab90 msgr2=0x7f396014b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:21.105+0000 7f3965b82640 1 -- 172.21.15.96:0/2509419037 shutdown_connections 2024-04-18T05:02:21.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:21.105+0000 7f3965b82640 1 -- 172.21.15.96:0/2509419037 wait complete. 2024-04-18T05:02:21.120 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":250,"stamp":"2024-04-18T05:02:20.728218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":131506610,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":2961,"num_read_kb":1326719,"num_write":31940,"num_write_kb":4643491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35573,"ondisk_log_size":35573,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":454048,"kb_used_data":100192,"kb_used_omap":12,"kb_used_meta":353779,"kb_avail":754520672,"statfs":{"total":773094113280,"available":772629168128,"internally_reserved":0,"allocated":102596608,"data_stored":263693236,"data_compressed":36701930,"data_compressed_allocated":47693824,"data_compressed_original":210231296,"omap_allocated":12744,"internal_metadata":362270264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004257"},"pg_stats":[{"pgid":"3.3f","version":"23'405","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:13.736610+0000","last_change":"2024-04-18T05:02:13.736813+0000","last_active":"2024-04-18T05:02:13.736610+0000","last_peered":"2024-04-18T05:02:13.736610+0000","last_clean":"2024-04-18T05:02:13.736610+0000","last_became_active":"2024-04-18T04:54:41.199046+0000","last_became_peered":"2024-04-18T04:54:41.199046+0000","last_unstale":"2024-04-18T05:02:13.736610+0000","last_undegraded":"2024-04-18T05:02:13.736610+0000","last_fullsized":"2024-04-18T05:02:13.736610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'405","last_scrub_stamp":"2024-04-18T05:02:13.736554+0000","last_deep_scrub":"23'405","last_deep_scrub_stamp":"2024-04-18T05:02:13.736554+0000","last_clean_scrub_stamp":"2024-04-18T05:02:13.736554+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:36:17.201989+0000","scrub_duration":0.0033959929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9249,"num_write":376,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"23'459","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:05.575351+0000","last_change":"2024-04-18T05:02:05.575562+0000","last_active":"2024-04-18T05:02:05.575351+0000","last_peered":"2024-04-18T05:02:05.575351+0000","last_clean":"2024-04-18T05:02:05.575351+0000","last_became_active":"2024-04-18T04:54:41.200136+0000","last_became_peered":"2024-04-18T04:54:41.200136+0000","last_unstale":"2024-04-18T05:02:05.575351+0000","last_undegraded":"2024-04-18T05:02:05.575351+0000","last_fullsized":"2024-04-18T05:02:05.575351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'459","last_scrub_stamp":"2024-04-18T05:02:05.575293+0000","last_deep_scrub":"23'459","last_deep_scrub_stamp":"2024-04-18T05:02:05.575293+0000","last_clean_scrub_stamp":"2024-04-18T05:02:05.575293+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:23:45.077012+0000","scrub_duration":0.0047782500000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12666,"num_write":430,"num_write_kb":97067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"23'410","reported_seq":467,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:50.724095+0000","last_change":"2024-04-18T05:01:50.724351+0000","last_active":"2024-04-18T05:01:50.724095+0000","last_peered":"2024-04-18T05:01:50.724095+0000","last_clean":"2024-04-18T05:01:50.724095+0000","last_became_active":"2024-04-18T04:54:41.185206+0000","last_became_peered":"2024-04-18T04:54:41.185206+0000","last_unstale":"2024-04-18T05:01:50.724095+0000","last_undegraded":"2024-04-18T05:01:50.724095+0000","last_fullsized":"2024-04-18T05:01:50.724095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'410","last_scrub_stamp":"2024-04-18T05:01:50.724024+0000","last_deep_scrub":"23'410","last_deep_scrub_stamp":"2024-04-18T05:01:50.724024+0000","last_clean_scrub_stamp":"2024-04-18T05:01:50.724024+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:53:51.231534+0000","scrub_duration":0.0043415509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":29819,"num_write":382,"num_write_kb":108666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"23'394","reported_seq":463,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:27.079767+0000","last_change":"2024-04-18T05:01:27.079963+0000","last_active":"2024-04-18T05:01:27.079767+0000","last_peered":"2024-04-18T05:01:27.079767+0000","last_clean":"2024-04-18T05:01:27.079767+0000","last_became_active":"2024-04-18T04:54:41.177217+0000","last_became_peered":"2024-04-18T04:54:41.177217+0000","last_unstale":"2024-04-18T05:01:27.079767+0000","last_undegraded":"2024-04-18T05:01:27.079767+0000","last_fullsized":"2024-04-18T05:01:27.079767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'394","last_scrub_stamp":"2024-04-18T05:01:27.079715+0000","last_deep_scrub":"23'394","last_deep_scrub_stamp":"2024-04-18T05:01:27.079715+0000","last_clean_scrub_stamp":"2024-04-18T05:01:27.079715+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:14.174781+0000","scrub_duration":0.0048719330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22571,"num_write":356,"num_write_kb":80073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"23'390","reported_seq":440,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:02.761197+0000","last_change":"2024-04-18T05:02:02.761197+0000","last_active":"2024-04-18T05:02:02.761197+0000","last_peered":"2024-04-18T05:02:02.761197+0000","last_clean":"2024-04-18T05:02:02.761197+0000","last_became_active":"2024-04-18T04:54:41.186027+0000","last_became_peered":"2024-04-18T04:54:41.186027+0000","last_unstale":"2024-04-18T05:02:02.761197+0000","last_undegraded":"2024-04-18T05:02:02.761197+0000","last_fullsized":"2024-04-18T05:02:02.761197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'390","last_scrub_stamp":"2024-04-18T05:02:02.760937+0000","last_deep_scrub":"23'390","last_deep_scrub_stamp":"2024-04-18T05:02:02.760937+0000","last_clean_scrub_stamp":"2024-04-18T05:02:02.760937+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:54:52.380397+0000","scrub_duration":0.0044406979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13089,"num_write":365,"num_write_kb":22615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"23'374","reported_seq":407,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:21.018847+0000","last_change":"2024-04-18T05:01:21.018847+0000","last_active":"2024-04-18T05:01:21.018847+0000","last_peered":"2024-04-18T05:01:21.018847+0000","last_clean":"2024-04-18T05:01:21.018847+0000","last_became_active":"2024-04-18T04:54:41.177215+0000","last_became_peered":"2024-04-18T04:54:41.177215+0000","last_unstale":"2024-04-18T05:01:21.018847+0000","last_undegraded":"2024-04-18T05:01:21.018847+0000","last_fullsized":"2024-04-18T05:01:21.018847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'374","last_scrub_stamp":"2024-04-18T05:01:21.018549+0000","last_deep_scrub":"23'374","last_deep_scrub_stamp":"2024-04-18T05:01:21.018549+0000","last_clean_scrub_stamp":"2024-04-18T05:01:21.018549+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:56:14.121491+0000","scrub_duration":0.0045796960000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":350,"num_write_kb":36922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"23'405","reported_seq":465,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:57.769173+0000","last_change":"2024-04-18T05:01:57.769173+0000","last_active":"2024-04-18T05:01:57.769173+0000","last_peered":"2024-04-18T05:01:57.769173+0000","last_clean":"2024-04-18T05:01:57.769173+0000","last_became_active":"2024-04-18T04:54:41.178094+0000","last_became_peered":"2024-04-18T04:54:41.178094+0000","last_unstale":"2024-04-18T05:01:57.769173+0000","last_undegraded":"2024-04-18T05:01:57.769173+0000","last_fullsized":"2024-04-18T05:01:57.769173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'405","last_scrub_stamp":"2024-04-18T05:01:57.768876+0000","last_deep_scrub":"23'405","last_deep_scrub_stamp":"2024-04-18T05:01:57.768876+0000","last_clean_scrub_stamp":"2024-04-18T05:01:57.768876+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:20:12.522956+0000","scrub_duration":0.0046398380000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20531,"num_write":378,"num_write_kb":59118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"23'401","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:45.657258+0000","last_change":"2024-04-18T05:01:45.657258+0000","last_active":"2024-04-18T05:01:45.657258+0000","last_peered":"2024-04-18T05:01:45.657258+0000","last_clean":"2024-04-18T05:01:45.657258+0000","last_became_active":"2024-04-18T04:54:41.192678+0000","last_became_peered":"2024-04-18T04:54:41.192678+0000","last_unstale":"2024-04-18T05:01:45.657258+0000","last_undegraded":"2024-04-18T05:01:45.657258+0000","last_fullsized":"2024-04-18T05:01:45.657258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'401","last_scrub_stamp":"2024-04-18T05:01:45.656995+0000","last_deep_scrub":"23'401","last_deep_scrub_stamp":"2024-04-18T05:01:45.656995+0000","last_clean_scrub_stamp":"2024-04-18T05:01:45.656995+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:48:24.009251+0000","scrub_duration":0.0050249880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13567,"num_write":364,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"23'436","reported_seq":510,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:32.714899+0000","last_change":"2024-04-18T05:01:32.714899+0000","last_active":"2024-04-18T05:01:32.714899+0000","last_peered":"2024-04-18T05:01:32.714899+0000","last_clean":"2024-04-18T05:01:32.714899+0000","last_became_active":"2024-04-18T04:54:41.197832+0000","last_became_peered":"2024-04-18T04:54:41.197832+0000","last_unstale":"2024-04-18T05:01:32.714899+0000","last_undegraded":"2024-04-18T05:01:32.714899+0000","last_fullsized":"2024-04-18T05:01:32.714899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'436","last_scrub_stamp":"2024-04-18T05:01:32.714644+0000","last_deep_scrub":"23'436","last_deep_scrub_stamp":"2024-04-18T05:01:32.714644+0000","last_clean_scrub_stamp":"2024-04-18T05:01:32.714644+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:15:48.913743+0000","scrub_duration":0.0041060510000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28521,"num_write":411,"num_write_kb":104022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"23'396","reported_seq":450,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:00.764660+0000","last_change":"2024-04-18T05:02:00.764805+0000","last_active":"2024-04-18T05:02:00.764660+0000","last_peered":"2024-04-18T05:02:00.764660+0000","last_clean":"2024-04-18T05:02:00.764660+0000","last_became_active":"2024-04-18T04:54:41.182698+0000","last_became_peered":"2024-04-18T04:54:41.182698+0000","last_unstale":"2024-04-18T05:02:00.764660+0000","last_undegraded":"2024-04-18T05:02:00.764660+0000","last_fullsized":"2024-04-18T05:02:00.764660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'396","last_scrub_stamp":"2024-04-18T05:02:00.764632+0000","last_deep_scrub":"23'396","last_deep_scrub_stamp":"2024-04-18T05:02:00.764632+0000","last_clean_scrub_stamp":"2024-04-18T05:02:00.764632+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:23:36.014680+0000","scrub_duration":0.002420752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13914,"num_write":350,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"23'379","reported_seq":440,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:51.699726+0000","last_change":"2024-04-18T05:01:51.699726+0000","last_active":"2024-04-18T05:01:51.699726+0000","last_peered":"2024-04-18T05:01:51.699726+0000","last_clean":"2024-04-18T05:01:51.699726+0000","last_became_active":"2024-04-18T04:54:41.187360+0000","last_became_peered":"2024-04-18T04:54:41.187360+0000","last_unstale":"2024-04-18T05:01:51.699726+0000","last_undegraded":"2024-04-18T05:01:51.699726+0000","last_fullsized":"2024-04-18T05:01:51.699726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'379","last_scrub_stamp":"2024-04-18T05:01:51.699340+0000","last_deep_scrub":"23'379","last_deep_scrub_stamp":"2024-04-18T05:01:51.699340+0000","last_clean_scrub_stamp":"2024-04-18T05:01:51.699340+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:41.327494+0000","scrub_duration":0.0040993219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18312,"num_write":357,"num_write_kb":34101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"23'361","reported_seq":423,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:48.631167+0000","last_change":"2024-04-18T05:01:48.631167+0000","last_active":"2024-04-18T05:01:48.631167+0000","last_peered":"2024-04-18T05:01:48.631167+0000","last_clean":"2024-04-18T05:01:48.631167+0000","last_became_active":"2024-04-18T04:54:41.188281+0000","last_became_peered":"2024-04-18T04:54:41.188281+0000","last_unstale":"2024-04-18T05:01:48.631167+0000","last_undegraded":"2024-04-18T05:01:48.631167+0000","last_fullsized":"2024-04-18T05:01:48.631167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'361","last_scrub_stamp":"2024-04-18T05:01:48.630905+0000","last_deep_scrub":"23'361","last_deep_scrub_stamp":"2024-04-18T05:01:48.630905+0000","last_clean_scrub_stamp":"2024-04-18T05:01:48.630905+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:53:49.138416+0000","scrub_duration":0.0044141709999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21304,"num_write":338,"num_write_kb":54980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"23'375","reported_seq":418,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:35.393048+0000","last_change":"2024-04-18T05:01:35.393048+0000","last_active":"2024-04-18T05:01:35.393048+0000","last_peered":"2024-04-18T05:01:35.393048+0000","last_clean":"2024-04-18T05:01:35.393048+0000","last_became_active":"2024-04-18T04:54:41.190882+0000","last_became_peered":"2024-04-18T04:54:41.190882+0000","last_unstale":"2024-04-18T05:01:35.393048+0000","last_undegraded":"2024-04-18T05:01:35.393048+0000","last_fullsized":"2024-04-18T05:01:35.393048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'375","last_scrub_stamp":"2024-04-18T05:01:35.392794+0000","last_deep_scrub":"23'375","last_deep_scrub_stamp":"2024-04-18T05:01:35.392794+0000","last_clean_scrub_stamp":"2024-04-18T05:01:35.392794+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:34.572335+0000","scrub_duration":0.004280786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7725,"num_write":337,"num_write_kb":21712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"23'417","reported_seq":503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:38.345013+0000","last_change":"2024-04-18T05:01:38.345013+0000","last_active":"2024-04-18T05:01:38.345013+0000","last_peered":"2024-04-18T05:01:38.345013+0000","last_clean":"2024-04-18T05:01:38.345013+0000","last_became_active":"2024-04-18T04:54:41.189813+0000","last_became_peered":"2024-04-18T04:54:41.189813+0000","last_unstale":"2024-04-18T05:01:38.345013+0000","last_undegraded":"2024-04-18T05:01:38.345013+0000","last_fullsized":"2024-04-18T05:01:38.345013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'417","last_scrub_stamp":"2024-04-18T05:01:38.344763+0000","last_deep_scrub":"23'417","last_deep_scrub_stamp":"2024-04-18T05:01:38.344763+0000","last_clean_scrub_stamp":"2024-04-18T05:01:38.344763+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:28.744373+0000","scrub_duration":0.0043015240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":28320,"num_write":390,"num_write_kb":71764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"23'445","reported_seq":545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:57.613911+0000","last_change":"2024-04-18T05:01:57.614158+0000","last_active":"2024-04-18T05:01:57.613911+0000","last_peered":"2024-04-18T05:01:57.613911+0000","last_clean":"2024-04-18T05:01:57.613911+0000","last_became_active":"2024-04-18T04:54:41.182713+0000","last_became_peered":"2024-04-18T04:54:41.182713+0000","last_unstale":"2024-04-18T05:01:57.613911+0000","last_undegraded":"2024-04-18T05:01:57.613911+0000","last_fullsized":"2024-04-18T05:01:57.613911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'445","last_scrub_stamp":"2024-04-18T05:01:57.613856+0000","last_deep_scrub":"23'445","last_deep_scrub_stamp":"2024-04-18T05:01:57.613856+0000","last_clean_scrub_stamp":"2024-04-18T05:01:57.613856+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:20:12.367937+0000","scrub_duration":0.0045358839999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":36644,"num_write":412,"num_write_kb":104908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"23'442","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:17.941873+0000","last_change":"2024-04-18T04:54:41.186060+0000","last_active":"2024-04-18T05:01:17.941873+0000","last_peered":"2024-04-18T05:01:17.941873+0000","last_clean":"2024-04-18T05:01:17.941873+0000","last_became_active":"2024-04-18T04:54:41.185803+0000","last_became_peered":"2024-04-18T04:54:41.185803+0000","last_unstale":"2024-04-18T05:01:17.941873+0000","last_undegraded":"2024-04-18T05:01:17.941873+0000","last_fullsized":"2024-04-18T05:01:17.941873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21979,"num_write":411,"num_write_kb":59643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"23'407","reported_seq":479,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:13.915250+0000","last_change":"2024-04-18T05:02:13.915450+0000","last_active":"2024-04-18T05:02:13.915250+0000","last_peered":"2024-04-18T05:02:13.915250+0000","last_clean":"2024-04-18T05:02:13.915250+0000","last_became_active":"2024-04-18T04:54:41.198404+0000","last_became_peered":"2024-04-18T04:54:41.198404+0000","last_unstale":"2024-04-18T05:02:13.915250+0000","last_undegraded":"2024-04-18T05:02:13.915250+0000","last_fullsized":"2024-04-18T05:02:13.915250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'407","last_scrub_stamp":"2024-04-18T05:02:13.915197+0000","last_deep_scrub":"23'407","last_deep_scrub_stamp":"2024-04-18T05:02:13.915197+0000","last_clean_scrub_stamp":"2024-04-18T05:02:13.915197+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:44:42.511153+0000","scrub_duration":0.0035698679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22314,"num_write":375,"num_write_kb":43056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"23'414","reported_seq":482,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:33.639544+0000","last_change":"2024-04-18T05:01:33.639544+0000","last_active":"2024-04-18T05:01:33.639544+0000","last_peered":"2024-04-18T05:01:33.639544+0000","last_clean":"2024-04-18T05:01:33.639544+0000","last_became_active":"2024-04-18T04:54:41.188139+0000","last_became_peered":"2024-04-18T04:54:41.188139+0000","last_unstale":"2024-04-18T05:01:33.639544+0000","last_undegraded":"2024-04-18T05:01:33.639544+0000","last_fullsized":"2024-04-18T05:01:33.639544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'414","last_scrub_stamp":"2024-04-18T05:01:33.639296+0000","last_deep_scrub":"23'414","last_deep_scrub_stamp":"2024-04-18T05:01:33.639296+0000","last_clean_scrub_stamp":"2024-04-18T05:01:33.639296+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:14.073131+0000","scrub_duration":0.0049131380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21874,"num_write":387,"num_write_kb":84204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"23'431","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:17.941813+0000","last_change":"2024-04-18T04:54:41.197901+0000","last_active":"2024-04-18T05:01:17.941813+0000","last_peered":"2024-04-18T05:01:17.941813+0000","last_clean":"2024-04-18T05:01:17.941813+0000","last_became_active":"2024-04-18T04:54:41.197235+0000","last_became_peered":"2024-04-18T04:54:41.197235+0000","last_unstale":"2024-04-18T05:01:17.941813+0000","last_undegraded":"2024-04-18T05:01:17.941813+0000","last_fullsized":"2024-04-18T05:01:17.941813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40070,"num_write":398,"num_write_kb":116642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"23'437","reported_seq":521,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:43.519732+0000","last_change":"2024-04-18T05:01:43.519933+0000","last_active":"2024-04-18T05:01:43.519732+0000","last_peered":"2024-04-18T05:01:43.519732+0000","last_clean":"2024-04-18T05:01:43.519732+0000","last_became_active":"2024-04-18T04:54:41.187925+0000","last_became_peered":"2024-04-18T04:54:41.187925+0000","last_unstale":"2024-04-18T05:01:43.519732+0000","last_undegraded":"2024-04-18T05:01:43.519732+0000","last_fullsized":"2024-04-18T05:01:43.519732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'437","last_scrub_stamp":"2024-04-18T05:01:43.519674+0000","last_deep_scrub":"23'437","last_deep_scrub_stamp":"2024-04-18T05:01:43.519674+0000","last_clean_scrub_stamp":"2024-04-18T05:01:43.519674+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:48:21.871930+0000","scrub_duration":0.0043357480000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27418,"num_write":411,"num_write_kb":67043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"23'413","reported_seq":501,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:55.416423+0000","last_change":"2024-04-18T05:01:55.416626+0000","last_active":"2024-04-18T05:01:55.416423+0000","last_peered":"2024-04-18T05:01:55.416423+0000","last_clean":"2024-04-18T05:01:55.416423+0000","last_became_active":"2024-04-18T04:54:41.178963+0000","last_became_peered":"2024-04-18T04:54:41.178963+0000","last_unstale":"2024-04-18T05:01:55.416423+0000","last_undegraded":"2024-04-18T05:01:55.416423+0000","last_fullsized":"2024-04-18T05:01:55.416423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'413","last_scrub_stamp":"2024-04-18T05:01:55.416370+0000","last_deep_scrub":"23'413","last_deep_scrub_stamp":"2024-04-18T05:01:55.416370+0000","last_clean_scrub_stamp":"2024-04-18T05:01:55.416370+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:48.998915+0000","scrub_duration":0.0043298499999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32437,"num_write":394,"num_write_kb":88243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"23'442","reported_seq":525,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:35.675375+0000","last_change":"2024-04-18T05:01:35.675569+0000","last_active":"2024-04-18T05:01:35.675375+0000","last_peered":"2024-04-18T05:01:35.675375+0000","last_clean":"2024-04-18T05:01:35.675375+0000","last_became_active":"2024-04-18T04:54:41.182664+0000","last_became_peered":"2024-04-18T04:54:41.182664+0000","last_unstale":"2024-04-18T05:01:35.675375+0000","last_undegraded":"2024-04-18T05:01:35.675375+0000","last_fullsized":"2024-04-18T05:01:35.675375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'442","last_scrub_stamp":"2024-04-18T05:01:35.675317+0000","last_deep_scrub":"23'442","last_deep_scrub_stamp":"2024-04-18T05:01:35.675317+0000","last_clean_scrub_stamp":"2024-04-18T05:01:35.675317+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:54.644731+0000","scrub_duration":0.0049721519999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34086,"num_write":411,"num_write_kb":96499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"23'434","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:30.563054+0000","last_change":"2024-04-18T05:01:30.563054+0000","last_active":"2024-04-18T05:01:30.563054+0000","last_peered":"2024-04-18T05:01:30.563054+0000","last_clean":"2024-04-18T05:01:30.563054+0000","last_became_active":"2024-04-18T04:54:41.186881+0000","last_became_peered":"2024-04-18T04:54:41.186881+0000","last_unstale":"2024-04-18T05:01:30.563054+0000","last_undegraded":"2024-04-18T05:01:30.563054+0000","last_fullsized":"2024-04-18T05:01:30.563054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'434","last_scrub_stamp":"2024-04-18T05:01:30.562793+0000","last_deep_scrub":"23'434","last_deep_scrub_stamp":"2024-04-18T05:01:30.562793+0000","last_clean_scrub_stamp":"2024-04-18T05:01:30.562793+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:30.270048+0000","scrub_duration":0.0049938550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":24295,"num_write":395,"num_write_kb":96064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"23'465","reported_seq":584,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:15.665867+0000","last_change":"2024-04-18T04:54:41.193206+0000","last_active":"2024-04-18T05:01:15.665867+0000","last_peered":"2024-04-18T05:01:15.665867+0000","last_clean":"2024-04-18T05:01:15.665867+0000","last_became_active":"2024-04-18T04:54:41.192740+0000","last_became_peered":"2024-04-18T04:54:41.192740+0000","last_unstale":"2024-04-18T05:01:15.665867+0000","last_undegraded":"2024-04-18T05:01:15.665867+0000","last_fullsized":"2024-04-18T05:01:15.665867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61562,"num_write":441,"num_write_kb":100539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"23'390","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:56.650555+0000","last_change":"2024-04-18T05:01:56.650773+0000","last_active":"2024-04-18T05:01:56.650555+0000","last_peered":"2024-04-18T05:01:56.650555+0000","last_clean":"2024-04-18T05:01:56.650555+0000","last_became_active":"2024-04-18T04:54:41.192280+0000","last_became_peered":"2024-04-18T04:54:41.192280+0000","last_unstale":"2024-04-18T05:01:56.650555+0000","last_undegraded":"2024-04-18T05:01:56.650555+0000","last_fullsized":"2024-04-18T05:01:56.650555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'390","last_scrub_stamp":"2024-04-18T05:01:56.650502+0000","last_deep_scrub":"23'390","last_deep_scrub_stamp":"2024-04-18T05:01:56.650502+0000","last_clean_scrub_stamp":"2024-04-18T05:01:56.650502+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:38:48.995886+0000","scrub_duration":0.0046352370000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18903,"num_write":377,"num_write_kb":34298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"23'490","reported_seq":571,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:43.793817+0000","last_change":"2024-04-18T05:01:43.794083+0000","last_active":"2024-04-18T05:01:43.793817+0000","last_peered":"2024-04-18T05:01:43.793817+0000","last_clean":"2024-04-18T05:01:43.793817+0000","last_became_active":"2024-04-18T04:54:41.193660+0000","last_became_peered":"2024-04-18T04:54:41.193660+0000","last_unstale":"2024-04-18T05:01:43.793817+0000","last_undegraded":"2024-04-18T05:01:43.793817+0000","last_fullsized":"2024-04-18T05:01:43.793817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'490","last_scrub_stamp":"2024-04-18T05:01:43.793766+0000","last_deep_scrub":"23'490","last_deep_scrub_stamp":"2024-04-18T05:01:43.793766+0000","last_clean_scrub_stamp":"2024-04-18T05:01:43.793766+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:17:38.481739+0000","scrub_duration":0.0042736730000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26760,"num_write":458,"num_write_kb":125465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"23'432","reported_seq":538,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:33.361713+0000","last_change":"2024-04-18T05:01:33.361955+0000","last_active":"2024-04-18T05:01:33.361713+0000","last_peered":"2024-04-18T05:01:33.361713+0000","last_clean":"2024-04-18T05:01:33.361713+0000","last_became_active":"2024-04-18T04:54:41.189374+0000","last_became_peered":"2024-04-18T04:54:41.189374+0000","last_unstale":"2024-04-18T05:01:33.361713+0000","last_undegraded":"2024-04-18T05:01:33.361713+0000","last_fullsized":"2024-04-18T05:01:33.361713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'432","last_scrub_stamp":"2024-04-18T05:01:33.361660+0000","last_deep_scrub":"23'432","last_deep_scrub_stamp":"2024-04-18T05:01:33.361660+0000","last_clean_scrub_stamp":"2024-04-18T05:01:33.361660+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:13.795496+0000","scrub_duration":0.0046135539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43719,"num_write":406,"num_write_kb":145399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"23'384","reported_seq":450,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:51.384588+0000","last_change":"2024-04-18T05:01:51.384823+0000","last_active":"2024-04-18T05:01:51.384588+0000","last_peered":"2024-04-18T05:01:51.384588+0000","last_clean":"2024-04-18T05:01:51.384588+0000","last_became_active":"2024-04-18T04:54:41.189660+0000","last_became_peered":"2024-04-18T04:54:41.189660+0000","last_unstale":"2024-04-18T05:01:51.384588+0000","last_undegraded":"2024-04-18T05:01:51.384588+0000","last_fullsized":"2024-04-18T05:01:51.384588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'384","last_scrub_stamp":"2024-04-18T05:01:51.384537+0000","last_deep_scrub":"23'384","last_deep_scrub_stamp":"2024-04-18T05:01:51.384537+0000","last_clean_scrub_stamp":"2024-04-18T05:01:51.384537+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:53:14.493798+0000","scrub_duration":0.0048499229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17737,"num_write":357,"num_write_kb":75727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"23'427","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:42.668726+0000","last_change":"2024-04-18T05:01:42.668920+0000","last_active":"2024-04-18T05:01:42.668726+0000","last_peered":"2024-04-18T05:01:42.668726+0000","last_clean":"2024-04-18T05:01:42.668726+0000","last_became_active":"2024-04-18T04:54:41.186901+0000","last_became_peered":"2024-04-18T04:54:41.186901+0000","last_unstale":"2024-04-18T05:01:42.668726+0000","last_undegraded":"2024-04-18T05:01:42.668726+0000","last_fullsized":"2024-04-18T05:01:42.668726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'427","last_scrub_stamp":"2024-04-18T05:01:42.668666+0000","last_deep_scrub":"23'427","last_deep_scrub_stamp":"2024-04-18T05:01:42.668666+0000","last_clean_scrub_stamp":"2024-04-18T05:01:42.668666+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:53:05.777927+0000","scrub_duration":0.0040391580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30499,"num_write":394,"num_write_kb":84601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"23'468","reported_seq":522,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:11.912063+0000","last_change":"2024-04-18T05:02:11.912258+0000","last_active":"2024-04-18T05:02:11.912063+0000","last_peered":"2024-04-18T05:02:11.912063+0000","last_clean":"2024-04-18T05:02:11.912063+0000","last_became_active":"2024-04-18T04:54:41.192114+0000","last_became_peered":"2024-04-18T04:54:41.192114+0000","last_unstale":"2024-04-18T05:02:11.912063+0000","last_undegraded":"2024-04-18T05:02:11.912063+0000","last_fullsized":"2024-04-18T05:02:11.912063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'468","last_scrub_stamp":"2024-04-18T05:02:11.912007+0000","last_deep_scrub":"23'468","last_deep_scrub_stamp":"2024-04-18T05:02:11.912007+0000","last_clean_scrub_stamp":"2024-04-18T05:02:11.912007+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:51:42.395879+0000","scrub_duration":0.0047051630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13784,"num_write":434,"num_write_kb":79847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"23'421","reported_seq":483,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.616261+0000","last_change":"2024-04-18T05:01:31.616457+0000","last_active":"2024-04-18T05:01:31.616261+0000","last_peered":"2024-04-18T05:01:31.616261+0000","last_clean":"2024-04-18T05:01:31.616261+0000","last_became_active":"2024-04-18T04:54:41.185915+0000","last_became_peered":"2024-04-18T04:54:41.185915+0000","last_unstale":"2024-04-18T05:01:31.616261+0000","last_undegraded":"2024-04-18T05:01:31.616261+0000","last_fullsized":"2024-04-18T05:01:31.616261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'421","last_scrub_stamp":"2024-04-18T05:01:31.616202+0000","last_deep_scrub":"23'421","last_deep_scrub_stamp":"2024-04-18T05:01:31.616202+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.616202+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:15:47.815302+0000","scrub_duration":0.0045383150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":22283,"num_write":389,"num_write_kb":42482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"23'415","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:23.083892+0000","last_change":"2024-04-18T05:01:23.084088+0000","last_active":"2024-04-18T05:01:23.083892+0000","last_peered":"2024-04-18T05:01:23.083892+0000","last_clean":"2024-04-18T05:01:23.083892+0000","last_became_active":"2024-04-18T04:54:41.189892+0000","last_became_peered":"2024-04-18T04:54:41.189892+0000","last_unstale":"2024-04-18T05:01:23.083892+0000","last_undegraded":"2024-04-18T05:01:23.083892+0000","last_fullsized":"2024-04-18T05:01:23.083892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'415","last_scrub_stamp":"2024-04-18T05:01:23.083840+0000","last_deep_scrub":"23'415","last_deep_scrub_stamp":"2024-04-18T05:01:23.083840+0000","last_clean_scrub_stamp":"2024-04-18T05:01:23.083840+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:21:47.363582+0000","scrub_duration":0.0047136449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36029,"num_write":387,"num_write_kb":59223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'420","reported_seq":492,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:28.771175+0000","last_change":"2024-04-18T05:01:28.771175+0000","last_active":"2024-04-18T05:01:28.771175+0000","last_peered":"2024-04-18T05:01:28.771175+0000","last_clean":"2024-04-18T05:01:28.771175+0000","last_became_active":"2024-04-18T04:54:41.187001+0000","last_became_peered":"2024-04-18T04:54:41.187001+0000","last_unstale":"2024-04-18T05:01:28.771175+0000","last_undegraded":"2024-04-18T05:01:28.771175+0000","last_fullsized":"2024-04-18T05:01:28.771175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'420","last_scrub_stamp":"2024-04-18T05:01:28.770902+0000","last_deep_scrub":"23'420","last_deep_scrub_stamp":"2024-04-18T05:01:28.770902+0000","last_clean_scrub_stamp":"2024-04-18T05:01:28.770902+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:27.362071+0000","scrub_duration":0.0043507140000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19127,"num_write":391,"num_write_kb":83892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'99","reported_seq":126,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:19.609510+0000","last_change":"2024-04-18T05:01:19.609510+0000","last_active":"2024-04-18T05:01:19.609510+0000","last_peered":"2024-04-18T05:01:19.609510+0000","last_clean":"2024-04-18T05:01:19.609510+0000","last_became_active":"2024-04-18T04:54:40.823652+0000","last_became_peered":"2024-04-18T04:54:40.823652+0000","last_unstale":"2024-04-18T05:01:19.609510+0000","last_undegraded":"2024-04-18T05:01:19.609510+0000","last_fullsized":"2024-04-18T05:01:19.609510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'99","last_scrub_stamp":"2024-04-18T05:01:19.609240+0000","last_deep_scrub":"23'99","last_deep_scrub_stamp":"2024-04-18T05:01:19.609240+0000","last_clean_scrub_stamp":"2024-04-18T05:01:19.609240+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:35.184621+0000","scrub_duration":0.024247222999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195462,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"23'366","reported_seq":415,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:41.393627+0000","last_change":"2024-04-18T05:01:41.393627+0000","last_active":"2024-04-18T05:01:41.393627+0000","last_peered":"2024-04-18T05:01:41.393627+0000","last_clean":"2024-04-18T05:01:41.393627+0000","last_became_active":"2024-04-18T04:55:39.827671+0000","last_became_peered":"2024-04-18T04:55:39.827671+0000","last_unstale":"2024-04-18T05:01:41.393627+0000","last_undegraded":"2024-04-18T05:01:41.393627+0000","last_fullsized":"2024-04-18T05:01:41.393627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'366","last_scrub_stamp":"2024-04-18T05:01:41.393359+0000","last_deep_scrub":"23'366","last_deep_scrub_stamp":"2024-04-18T05:01:41.393359+0000","last_clean_scrub_stamp":"2024-04-18T05:01:41.393359+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:34.095101+0000","scrub_duration":0.0035216790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13158,"num_write":336,"num_write_kb":38014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'545","reported_seq":572,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:51.751142+0000","last_change":"2024-04-18T05:01:51.751142+0000","last_active":"2024-04-18T05:01:51.751142+0000","last_peered":"2024-04-18T05:01:51.751142+0000","last_clean":"2024-04-18T05:01:51.751142+0000","last_became_active":"2024-04-18T04:54:40.802672+0000","last_became_peered":"2024-04-18T04:54:40.802672+0000","last_unstale":"2024-04-18T05:01:51.751142+0000","last_undegraded":"2024-04-18T05:01:51.751142+0000","last_fullsized":"2024-04-18T05:01:51.751142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'545","last_scrub_stamp":"2024-04-18T05:01:51.750880+0000","last_deep_scrub":"23'545","last_deep_scrub_stamp":"2024-04-18T05:01:51.750880+0000","last_clean_scrub_stamp":"2024-04-18T05:01:51.750880+0000","objects_scrubbed":6,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:20:06.504961+0000","scrub_duration":0.069336696000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":487,"num_write_kb":12578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'418","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:25.397489+0000","last_change":"2024-04-18T05:01:25.397489+0000","last_active":"2024-04-18T05:01:25.397489+0000","last_peered":"2024-04-18T05:01:25.397489+0000","last_clean":"2024-04-18T05:01:25.397489+0000","last_became_active":"2024-04-18T04:54:40.823091+0000","last_became_peered":"2024-04-18T04:54:40.823091+0000","last_unstale":"2024-04-18T05:01:25.397489+0000","last_undegraded":"2024-04-18T05:01:25.397489+0000","last_fullsized":"2024-04-18T05:01:25.397489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'418","last_scrub_stamp":"2024-04-18T05:01:25.397241+0000","last_deep_scrub":"23'418","last_deep_scrub_stamp":"2024-04-18T05:01:25.397241+0000","last_clean_scrub_stamp":"2024-04-18T05:01:25.397241+0000","objects_scrubbed":3,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:03.755258+0000","scrub_duration":0.029980849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":4340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"23'429","reported_seq":470,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:27.513575+0000","last_change":"2024-04-18T05:01:27.513575+0000","last_active":"2024-04-18T05:01:27.513575+0000","last_peered":"2024-04-18T05:01:27.513575+0000","last_clean":"2024-04-18T05:01:27.513575+0000","last_became_active":"2024-04-18T04:54:41.199690+0000","last_became_peered":"2024-04-18T04:54:41.199690+0000","last_unstale":"2024-04-18T05:01:27.513575+0000","last_undegraded":"2024-04-18T05:01:27.513575+0000","last_fullsized":"2024-04-18T05:01:27.513575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'429","last_scrub_stamp":"2024-04-18T05:01:27.513299+0000","last_deep_scrub":"23'429","last_deep_scrub_stamp":"2024-04-18T05:01:27.513299+0000","last_clean_scrub_stamp":"2024-04-18T05:01:27.513299+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:26.692839+0000","scrub_duration":0.0049636610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5535,"num_write":391,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'957","reported_seq":984,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:59.798017+0000","last_change":"2024-04-18T05:01:59.798211+0000","last_active":"2024-04-18T05:01:59.798017+0000","last_peered":"2024-04-18T05:01:59.798017+0000","last_clean":"2024-04-18T05:01:59.798017+0000","last_became_active":"2024-04-18T04:54:40.804605+0000","last_became_peered":"2024-04-18T04:54:40.804605+0000","last_unstale":"2024-04-18T05:01:59.798017+0000","last_undegraded":"2024-04-18T05:01:59.798017+0000","last_fullsized":"2024-04-18T05:01:59.798017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'957","last_scrub_stamp":"2024-04-18T05:01:59.797967+0000","last_deep_scrub":"23'957","last_deep_scrub_stamp":"2024-04-18T05:01:59.797967+0000","last_clean_scrub_stamp":"2024-04-18T05:01:59.797967+0000","objects_scrubbed":3,"log_size":957,"log_dups_size":0,"ondisk_log_size":957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:23:39.299687+0000","scrub_duration":0.060311403999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"23'422","reported_seq":482,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:43.413146+0000","last_change":"2024-04-18T05:01:43.413146+0000","last_active":"2024-04-18T05:01:43.413146+0000","last_peered":"2024-04-18T05:01:43.413146+0000","last_clean":"2024-04-18T05:01:43.413146+0000","last_became_active":"2024-04-18T04:54:41.175137+0000","last_became_peered":"2024-04-18T04:54:41.175137+0000","last_unstale":"2024-04-18T05:01:43.413146+0000","last_undegraded":"2024-04-18T05:01:43.413146+0000","last_fullsized":"2024-04-18T05:01:43.413146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'422","last_scrub_stamp":"2024-04-18T05:01:43.412900+0000","last_deep_scrub":"23'422","last_deep_scrub_stamp":"2024-04-18T05:01:43.412900+0000","last_clean_scrub_stamp":"2024-04-18T05:01:43.412900+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:33.009995+0000","scrub_duration":0.0045663049999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21971,"num_write":395,"num_write_kb":63063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'68","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:20.781219+0000","last_change":"2024-04-18T05:01:20.781219+0000","last_active":"2024-04-18T05:01:20.781219+0000","last_peered":"2024-04-18T05:01:20.781219+0000","last_clean":"2024-04-18T05:01:20.781219+0000","last_became_active":"2024-04-18T04:54:40.798572+0000","last_became_peered":"2024-04-18T04:54:40.798572+0000","last_unstale":"2024-04-18T05:01:20.781219+0000","last_undegraded":"2024-04-18T05:01:20.781219+0000","last_fullsized":"2024-04-18T05:01:20.781219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'68","last_scrub_stamp":"2024-04-18T05:01:20.780948+0000","last_deep_scrub":"23'68","last_deep_scrub_stamp":"2024-04-18T05:01:20.780948+0000","last_clean_scrub_stamp":"2024-04-18T05:01:20.780948+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:46:12.946774+0000","scrub_duration":0.0073987970000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'432","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:39.772765+0000","last_change":"2024-04-18T05:01:39.772765+0000","last_active":"2024-04-18T05:01:39.772765+0000","last_peered":"2024-04-18T05:01:39.772765+0000","last_clean":"2024-04-18T05:01:39.772765+0000","last_became_active":"2024-04-18T04:54:41.188012+0000","last_became_peered":"2024-04-18T04:54:41.188012+0000","last_unstale":"2024-04-18T05:01:39.772765+0000","last_undegraded":"2024-04-18T05:01:39.772765+0000","last_fullsized":"2024-04-18T05:01:39.772765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'432","last_scrub_stamp":"2024-04-18T05:01:39.772470+0000","last_deep_scrub":"23'432","last_deep_scrub_stamp":"2024-04-18T05:01:39.772470+0000","last_clean_scrub_stamp":"2024-04-18T05:01:39.772470+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:46:53.031529+0000","scrub_duration":0.004148026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13773,"num_write":397,"num_write_kb":43173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'337","reported_seq":365,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:25.419761+0000","last_change":"2024-04-18T05:01:25.419761+0000","last_active":"2024-04-18T05:01:25.419761+0000","last_peered":"2024-04-18T05:01:25.419761+0000","last_clean":"2024-04-18T05:01:25.419761+0000","last_became_active":"2024-04-18T04:54:40.801406+0000","last_became_peered":"2024-04-18T04:54:40.801406+0000","last_unstale":"2024-04-18T05:01:25.419761+0000","last_undegraded":"2024-04-18T05:01:25.419761+0000","last_fullsized":"2024-04-18T05:01:25.419761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'337","last_scrub_stamp":"2024-04-18T05:01:25.419503+0000","last_deep_scrub":"23'337","last_deep_scrub_stamp":"2024-04-18T05:01:25.419503+0000","last_clean_scrub_stamp":"2024-04-18T05:01:25.419503+0000","objects_scrubbed":3,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:24.599044+0000","scrub_duration":0.029230335,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"23'397","reported_seq":445,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:43.621015+0000","last_change":"2024-04-18T05:01:43.621015+0000","last_active":"2024-04-18T05:01:43.621015+0000","last_peered":"2024-04-18T05:01:43.621015+0000","last_clean":"2024-04-18T05:01:43.621015+0000","last_became_active":"2024-04-18T04:54:41.203186+0000","last_became_peered":"2024-04-18T04:54:41.203186+0000","last_unstale":"2024-04-18T05:01:43.621015+0000","last_undegraded":"2024-04-18T05:01:43.621015+0000","last_fullsized":"2024-04-18T05:01:43.621015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'397","last_scrub_stamp":"2024-04-18T05:01:43.620765+0000","last_deep_scrub":"23'397","last_deep_scrub_stamp":"2024-04-18T05:01:43.620765+0000","last_clean_scrub_stamp":"2024-04-18T05:01:43.620765+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:38:05.909566+0000","scrub_duration":0.0040642860000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14488,"num_write":364,"num_write_kb":75349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'192","reported_seq":220,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:26.537619+0000","last_change":"2024-04-18T05:01:26.537619+0000","last_active":"2024-04-18T05:01:26.537619+0000","last_peered":"2024-04-18T05:01:26.537619+0000","last_clean":"2024-04-18T05:01:26.537619+0000","last_became_active":"2024-04-18T04:54:40.820920+0000","last_became_peered":"2024-04-18T04:54:40.820920+0000","last_unstale":"2024-04-18T05:01:26.537619+0000","last_undegraded":"2024-04-18T05:01:26.537619+0000","last_fullsized":"2024-04-18T05:01:26.537619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'192","last_scrub_stamp":"2024-04-18T05:01:26.537313+0000","last_deep_scrub":"23'192","last_deep_scrub_stamp":"2024-04-18T05:01:26.537313+0000","last_clean_scrub_stamp":"2024-04-18T05:01:26.537313+0000","objects_scrubbed":4,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:25.128483+0000","scrub_duration":0.010104568,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"23'394","reported_seq":445,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:17.941711+0000","last_change":"2024-04-18T04:54:41.197254+0000","last_active":"2024-04-18T05:01:17.941711+0000","last_peered":"2024-04-18T05:01:17.941711+0000","last_clean":"2024-04-18T05:01:17.941711+0000","last_became_active":"2024-04-18T04:54:41.196927+0000","last_became_peered":"2024-04-18T04:54:41.196927+0000","last_unstale":"2024-04-18T05:01:17.941711+0000","last_undegraded":"2024-04-18T05:01:17.941711+0000","last_fullsized":"2024-04-18T05:01:17.941711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:54:40.767997+0000","last_clean_scrub_stamp":"2024-04-18T04:54:40.767997+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21129,"num_write":360,"num_write_kb":71528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'450","reported_seq":478,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:18.091612+0000","last_change":"2024-04-18T05:01:18.091612+0000","last_active":"2024-04-18T05:01:18.091612+0000","last_peered":"2024-04-18T05:01:18.091612+0000","last_clean":"2024-04-18T05:01:18.091612+0000","last_became_active":"2024-04-18T04:54:40.801403+0000","last_became_peered":"2024-04-18T04:54:40.801403+0000","last_unstale":"2024-04-18T05:01:18.091612+0000","last_undegraded":"2024-04-18T05:01:18.091612+0000","last_fullsized":"2024-04-18T05:01:18.091612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'450","last_scrub_stamp":"2024-04-18T05:01:18.091496+0000","last_deep_scrub":"23'450","last_deep_scrub_stamp":"2024-04-18T05:01:18.091496+0000","last_clean_scrub_stamp":"2024-04-18T05:01:18.091496+0000","objects_scrubbed":8,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:59:33.756145+0000","scrub_duration":0.055952107000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12011434,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":11980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'396","reported_seq":466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:40.449445+0000","last_change":"2024-04-18T05:01:40.449445+0000","last_active":"2024-04-18T05:01:40.449445+0000","last_peered":"2024-04-18T05:01:40.449445+0000","last_clean":"2024-04-18T05:01:40.449445+0000","last_became_active":"2024-04-18T04:54:41.195172+0000","last_became_peered":"2024-04-18T04:54:41.195172+0000","last_unstale":"2024-04-18T05:01:40.449445+0000","last_undegraded":"2024-04-18T05:01:40.449445+0000","last_fullsized":"2024-04-18T05:01:40.449445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'396","last_scrub_stamp":"2024-04-18T05:01:40.449334+0000","last_deep_scrub":"23'396","last_deep_scrub_stamp":"2024-04-18T05:01:40.449334+0000","last_clean_scrub_stamp":"2024-04-18T05:01:40.449334+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:53:03.558595+0000","scrub_duration":0.0033727589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19873,"num_write":365,"num_write_kb":71837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'591","reported_seq":619,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:25.610689+0000","last_change":"2024-04-18T05:01:25.610689+0000","last_active":"2024-04-18T05:01:25.610689+0000","last_peered":"2024-04-18T05:01:25.610689+0000","last_clean":"2024-04-18T05:01:25.610689+0000","last_became_active":"2024-04-18T04:54:40.817681+0000","last_became_peered":"2024-04-18T04:54:40.817681+0000","last_unstale":"2024-04-18T05:01:25.610689+0000","last_undegraded":"2024-04-18T05:01:25.610689+0000","last_fullsized":"2024-04-18T05:01:25.610689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'591","last_scrub_stamp":"2024-04-18T05:01:25.610406+0000","last_deep_scrub":"23'591","last_deep_scrub_stamp":"2024-04-18T05:01:25.610406+0000","last_clean_scrub_stamp":"2024-04-18T05:01:25.610406+0000","objects_scrubbed":8,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:03.968423+0000","scrub_duration":0.057537295000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"23'417","reported_seq":456,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:37.391009+0000","last_change":"2024-04-18T05:01:37.391009+0000","last_active":"2024-04-18T05:01:37.391009+0000","last_peered":"2024-04-18T05:01:37.391009+0000","last_clean":"2024-04-18T05:01:37.391009+0000","last_became_active":"2024-04-18T04:54:41.194499+0000","last_became_peered":"2024-04-18T04:54:41.194499+0000","last_unstale":"2024-04-18T05:01:37.391009+0000","last_undegraded":"2024-04-18T05:01:37.391009+0000","last_fullsized":"2024-04-18T05:01:37.391009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'417","last_scrub_stamp":"2024-04-18T05:01:37.390763+0000","last_deep_scrub":"23'417","last_deep_scrub_stamp":"2024-04-18T05:01:37.390763+0000","last_clean_scrub_stamp":"2024-04-18T05:01:37.390763+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:37.098019+0000","scrub_duration":0.0056180969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":380,"num_write_kb":59449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"23'73","reported_seq":100,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:50.683587+0000","last_change":"2024-04-18T05:01:50.683793+0000","last_active":"2024-04-18T05:01:50.683587+0000","last_peered":"2024-04-18T05:01:50.683587+0000","last_clean":"2024-04-18T05:01:50.683587+0000","last_became_active":"2024-04-18T04:54:40.817370+0000","last_became_peered":"2024-04-18T04:54:40.817370+0000","last_unstale":"2024-04-18T05:01:50.683587+0000","last_undegraded":"2024-04-18T05:01:50.683587+0000","last_fullsized":"2024-04-18T05:01:50.683587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'73","last_scrub_stamp":"2024-04-18T05:01:50.683535+0000","last_deep_scrub":"23'73","last_deep_scrub_stamp":"2024-04-18T05:01:50.683535+0000","last_clean_scrub_stamp":"2024-04-18T05:01:50.683535+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:38:43.028919+0000","scrub_duration":0.0083098029999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'400","reported_seq":485,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:06.776389+0000","last_change":"2024-04-18T05:02:06.776657+0000","last_active":"2024-04-18T05:02:06.776389+0000","last_peered":"2024-04-18T05:02:06.776389+0000","last_clean":"2024-04-18T05:02:06.776389+0000","last_became_active":"2024-04-18T04:54:41.192889+0000","last_became_peered":"2024-04-18T04:54:41.192889+0000","last_unstale":"2024-04-18T05:02:06.776389+0000","last_undegraded":"2024-04-18T05:02:06.776389+0000","last_fullsized":"2024-04-18T05:02:06.776389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'400","last_scrub_stamp":"2024-04-18T05:02:06.776338+0000","last_deep_scrub":"23'400","last_deep_scrub_stamp":"2024-04-18T05:02:06.776338+0000","last_clean_scrub_stamp":"2024-04-18T05:02:06.776338+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:40.216063+0000","scrub_duration":0.004129326,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30891,"num_write":363,"num_write_kb":81664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"23'69","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:24.423007+0000","last_change":"2024-04-18T05:01:24.423007+0000","last_active":"2024-04-18T05:01:24.423007+0000","last_peered":"2024-04-18T05:01:24.423007+0000","last_clean":"2024-04-18T05:01:24.423007+0000","last_became_active":"2024-04-18T04:54:40.805965+0000","last_became_peered":"2024-04-18T04:54:40.805965+0000","last_unstale":"2024-04-18T05:01:24.423007+0000","last_undegraded":"2024-04-18T05:01:24.423007+0000","last_fullsized":"2024-04-18T05:01:24.423007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'69","last_scrub_stamp":"2024-04-18T05:01:24.422705+0000","last_deep_scrub":"23'69","last_deep_scrub_stamp":"2024-04-18T05:01:24.422705+0000","last_clean_scrub_stamp":"2024-04-18T05:01:24.422705+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:43.392120+0000","scrub_duration":0.0070178870000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1124,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'449","reported_seq":508,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:29.817094+0000","last_change":"2024-04-18T05:01:29.817094+0000","last_active":"2024-04-18T05:01:29.817094+0000","last_peered":"2024-04-18T05:01:29.817094+0000","last_clean":"2024-04-18T05:01:29.817094+0000","last_became_active":"2024-04-18T04:54:41.183838+0000","last_became_peered":"2024-04-18T04:54:41.183838+0000","last_unstale":"2024-04-18T05:01:29.817094+0000","last_undegraded":"2024-04-18T05:01:29.817094+0000","last_fullsized":"2024-04-18T05:01:29.817094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'449","last_scrub_stamp":"2024-04-18T05:01:29.816853+0000","last_deep_scrub":"23'449","last_deep_scrub_stamp":"2024-04-18T05:01:29.816853+0000","last_clean_scrub_stamp":"2024-04-18T05:01:29.816853+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:45.392233+0000","scrub_duration":0.0047717139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14210,"num_write":423,"num_write_kb":80124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'88","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.337778+0000","last_change":"2024-04-18T05:01:31.337778+0000","last_active":"2024-04-18T05:01:31.337778+0000","last_peered":"2024-04-18T05:01:31.337778+0000","last_clean":"2024-04-18T05:01:31.337778+0000","last_became_active":"2024-04-18T04:54:40.818227+0000","last_became_peered":"2024-04-18T04:54:40.818227+0000","last_unstale":"2024-04-18T05:01:31.337778+0000","last_undegraded":"2024-04-18T05:01:31.337778+0000","last_fullsized":"2024-04-18T05:01:31.337778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'88","last_scrub_stamp":"2024-04-18T05:01:31.337486+0000","last_deep_scrub":"23'88","last_deep_scrub_stamp":"2024-04-18T05:01:31.337486+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.337486+0000","objects_scrubbed":8,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:25.180421+0000","scrub_duration":0.014728473000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"23'493","reported_seq":566,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:01.809408+0000","last_change":"2024-04-18T05:02:01.809610+0000","last_active":"2024-04-18T05:02:01.809408+0000","last_peered":"2024-04-18T05:02:01.809408+0000","last_clean":"2024-04-18T05:02:01.809408+0000","last_became_active":"2024-04-18T04:54:41.187002+0000","last_became_peered":"2024-04-18T04:54:41.187002+0000","last_unstale":"2024-04-18T05:02:01.809408+0000","last_undegraded":"2024-04-18T05:02:01.809408+0000","last_fullsized":"2024-04-18T05:02:01.809408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'493","last_scrub_stamp":"2024-04-18T05:02:01.809357+0000","last_deep_scrub":"23'493","last_deep_scrub_stamp":"2024-04-18T05:02:01.809357+0000","last_clean_scrub_stamp":"2024-04-18T05:02:01.809357+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:32:56.562180+0000","scrub_duration":0.0042665050000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":24156,"num_write":458,"num_write_kb":105037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'202","reported_seq":230,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:23.442118+0000","last_change":"2024-04-18T05:01:23.442118+0000","last_active":"2024-04-18T05:01:23.442118+0000","last_peered":"2024-04-18T05:01:23.442118+0000","last_clean":"2024-04-18T05:01:23.442118+0000","last_became_active":"2024-04-18T04:54:40.802550+0000","last_became_peered":"2024-04-18T04:54:40.802550+0000","last_unstale":"2024-04-18T05:01:23.442118+0000","last_undegraded":"2024-04-18T05:01:23.442118+0000","last_fullsized":"2024-04-18T05:01:23.442118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'202","last_scrub_stamp":"2024-04-18T05:01:23.441698+0000","last_deep_scrub":"23'202","last_deep_scrub_stamp":"2024-04-18T05:01:23.441698+0000","last_clean_scrub_stamp":"2024-04-18T05:01:23.441698+0000","objects_scrubbed":3,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:03.875533+0000","scrub_duration":0.030187757999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'364","reported_seq":416,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:38.816814+0000","last_change":"2024-04-18T05:01:38.817049+0000","last_active":"2024-04-18T05:01:38.816814+0000","last_peered":"2024-04-18T05:01:38.816814+0000","last_clean":"2024-04-18T05:01:38.816814+0000","last_became_active":"2024-04-18T04:54:41.179540+0000","last_became_peered":"2024-04-18T04:54:41.179540+0000","last_unstale":"2024-04-18T05:01:38.816814+0000","last_undegraded":"2024-04-18T05:01:38.816814+0000","last_fullsized":"2024-04-18T05:01:38.816814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'364","last_scrub_stamp":"2024-04-18T05:01:38.816760+0000","last_deep_scrub":"23'364","last_deep_scrub_stamp":"2024-04-18T05:01:38.816760+0000","last_clean_scrub_stamp":"2024-04-18T05:01:38.816760+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:26:27.796056+0000","scrub_duration":0.0043171520000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16384,"num_write":332,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'307","reported_seq":335,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:37.408810+0000","last_change":"2024-04-18T05:01:37.409008+0000","last_active":"2024-04-18T05:01:37.408810+0000","last_peered":"2024-04-18T05:01:37.408810+0000","last_clean":"2024-04-18T05:01:37.408810+0000","last_became_active":"2024-04-18T04:54:40.803464+0000","last_became_peered":"2024-04-18T04:54:40.803464+0000","last_unstale":"2024-04-18T05:01:37.408810+0000","last_undegraded":"2024-04-18T05:01:37.408810+0000","last_fullsized":"2024-04-18T05:01:37.408810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'307","last_scrub_stamp":"2024-04-18T05:01:37.408757+0000","last_deep_scrub":"23'307","last_deep_scrub_stamp":"2024-04-18T05:01:37.408757+0000","last_clean_scrub_stamp":"2024-04-18T05:01:37.408757+0000","objects_scrubbed":3,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:46:50.667816+0000","scrub_duration":0.032088881999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"23'391","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:17.446894+0000","last_change":"2024-04-18T05:01:17.446894+0000","last_active":"2024-04-18T05:01:17.446894+0000","last_peered":"2024-04-18T05:01:17.446894+0000","last_clean":"2024-04-18T05:01:17.446894+0000","last_became_active":"2024-04-18T04:54:41.188152+0000","last_became_peered":"2024-04-18T04:54:41.188152+0000","last_unstale":"2024-04-18T05:01:17.446894+0000","last_undegraded":"2024-04-18T05:01:17.446894+0000","last_fullsized":"2024-04-18T05:01:17.446894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'391","last_scrub_stamp":"2024-04-18T05:01:17.446736+0000","last_deep_scrub":"23'391","last_deep_scrub_stamp":"2024-04-18T05:01:17.446736+0000","last_clean_scrub_stamp":"2024-04-18T05:01:17.446736+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:33.022117+0000","scrub_duration":0.0029989399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15853,"num_write":356,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'537","reported_seq":564,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:26.569521+0000","last_change":"2024-04-18T05:01:26.569720+0000","last_active":"2024-04-18T05:01:26.569521+0000","last_peered":"2024-04-18T05:01:26.569521+0000","last_clean":"2024-04-18T05:01:26.569521+0000","last_became_active":"2024-04-18T04:54:40.814207+0000","last_became_peered":"2024-04-18T04:54:40.814207+0000","last_unstale":"2024-04-18T05:01:26.569521+0000","last_undegraded":"2024-04-18T05:01:26.569521+0000","last_fullsized":"2024-04-18T05:01:26.569521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'537","last_scrub_stamp":"2024-04-18T05:01:26.569462+0000","last_deep_scrub":"23'537","last_deep_scrub_stamp":"2024-04-18T05:01:26.569462+0000","last_clean_scrub_stamp":"2024-04-18T05:01:26.569462+0000","objects_scrubbed":2,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:45.538877+0000","scrub_duration":0.037341881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"23'425","reported_seq":481,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:41.446915+0000","last_change":"2024-04-18T05:01:41.447107+0000","last_active":"2024-04-18T05:01:41.446915+0000","last_peered":"2024-04-18T05:01:41.446915+0000","last_clean":"2024-04-18T05:01:41.446915+0000","last_became_active":"2024-04-18T04:54:41.188249+0000","last_became_peered":"2024-04-18T04:54:41.188249+0000","last_unstale":"2024-04-18T05:01:41.446915+0000","last_undegraded":"2024-04-18T05:01:41.446915+0000","last_fullsized":"2024-04-18T05:01:41.446915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'425","last_scrub_stamp":"2024-04-18T05:01:41.446862+0000","last_deep_scrub":"23'425","last_deep_scrub_stamp":"2024-04-18T05:01:41.446862+0000","last_clean_scrub_stamp":"2024-04-18T05:01:41.446862+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:38:03.735663+0000","scrub_duration":0.0048573399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14420,"num_write":396,"num_write_kb":51045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'78","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:27.370536+0000","last_change":"2024-04-18T05:01:27.370727+0000","last_active":"2024-04-18T05:01:27.370536+0000","last_peered":"2024-04-18T05:01:27.370536+0000","last_clean":"2024-04-18T05:01:27.370536+0000","last_became_active":"2024-04-18T04:54:40.823755+0000","last_became_peered":"2024-04-18T04:54:40.823755+0000","last_unstale":"2024-04-18T05:01:27.370536+0000","last_undegraded":"2024-04-18T05:01:27.370536+0000","last_fullsized":"2024-04-18T05:01:27.370536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'78","last_scrub_stamp":"2024-04-18T05:01:27.370484+0000","last_deep_scrub":"23'78","last_deep_scrub_stamp":"2024-04-18T05:01:27.370484+0000","last_clean_scrub_stamp":"2024-04-18T05:01:27.370484+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:42.945865+0000","scrub_duration":0.0074384159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1706,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'402","reported_seq":447,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:20.557186+0000","last_change":"2024-04-18T05:01:20.557186+0000","last_active":"2024-04-18T05:01:20.557186+0000","last_peered":"2024-04-18T05:01:20.557186+0000","last_clean":"2024-04-18T05:01:20.557186+0000","last_became_active":"2024-04-18T04:54:41.186149+0000","last_became_peered":"2024-04-18T04:54:41.186149+0000","last_unstale":"2024-04-18T05:01:20.557186+0000","last_undegraded":"2024-04-18T05:01:20.557186+0000","last_fullsized":"2024-04-18T05:01:20.557186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'402","last_scrub_stamp":"2024-04-18T05:01:20.556880+0000","last_deep_scrub":"23'402","last_deep_scrub_stamp":"2024-04-18T05:01:20.556880+0000","last_clean_scrub_stamp":"2024-04-18T05:01:20.556880+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:19.736421+0000","scrub_duration":0.0048536480000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7713,"num_write":373,"num_write_kb":46594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'119","reported_seq":183,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:19.748996+0000","last_change":"2024-04-18T05:01:19.749081+0000","last_active":"2024-04-18T05:01:19.748996+0000","last_peered":"2024-04-18T05:01:19.748996+0000","last_clean":"2024-04-18T05:01:19.748996+0000","last_became_active":"2024-04-18T04:54:35.672457+0000","last_became_peered":"2024-04-18T04:54:35.672457+0000","last_unstale":"2024-04-18T05:01:19.748996+0000","last_undegraded":"2024-04-18T05:01:19.748996+0000","last_fullsized":"2024-04-18T05:01:19.748996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2024-04-18T05:01:19.748977+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2024-04-18T05:01:19.748977+0000","last_clean_scrub_stamp":"2024-04-18T05:01:19.748977+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:50.211326+0000","scrub_duration":0.0077953190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'76","reported_seq":103,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:48.714990+0000","last_change":"2024-04-18T05:01:48.715205+0000","last_active":"2024-04-18T05:01:48.714990+0000","last_peered":"2024-04-18T05:01:48.714990+0000","last_clean":"2024-04-18T05:01:48.714990+0000","last_became_active":"2024-04-18T04:54:40.801083+0000","last_became_peered":"2024-04-18T04:54:40.801083+0000","last_unstale":"2024-04-18T05:01:48.714990+0000","last_undegraded":"2024-04-18T05:01:48.714990+0000","last_fullsized":"2024-04-18T05:01:48.714990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'76","last_scrub_stamp":"2024-04-18T05:01:48.714929+0000","last_deep_scrub":"23'76","last_deep_scrub_stamp":"2024-04-18T05:01:48.714929+0000","last_clean_scrub_stamp":"2024-04-18T05:01:48.714929+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:38.343083+0000","scrub_duration":0.010243756999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'362","reported_seq":394,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:48.470235+0000","last_change":"2024-04-18T05:01:48.470434+0000","last_active":"2024-04-18T05:01:48.470235+0000","last_peered":"2024-04-18T05:01:48.470235+0000","last_clean":"2024-04-18T05:01:48.470235+0000","last_became_active":"2024-04-18T04:54:41.174391+0000","last_became_peered":"2024-04-18T04:54:41.174391+0000","last_unstale":"2024-04-18T05:01:48.470235+0000","last_undegraded":"2024-04-18T05:01:48.470235+0000","last_fullsized":"2024-04-18T05:01:48.470235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'362","last_scrub_stamp":"2024-04-18T05:01:48.470181+0000","last_deep_scrub":"23'362","last_deep_scrub_stamp":"2024-04-18T05:01:48.470181+0000","last_clean_scrub_stamp":"2024-04-18T05:01:48.470181+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:46:21.613642+0000","scrub_duration":0.0045936149999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1626,"num_write":331,"num_write_kb":26059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'441","reported_seq":468,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:39.752852+0000","last_change":"2024-04-18T05:01:39.753052+0000","last_active":"2024-04-18T05:01:39.752852+0000","last_peered":"2024-04-18T05:01:39.752852+0000","last_clean":"2024-04-18T05:01:39.752852+0000","last_became_active":"2024-04-18T04:54:40.813396+0000","last_became_peered":"2024-04-18T04:54:40.813396+0000","last_unstale":"2024-04-18T05:01:39.752852+0000","last_undegraded":"2024-04-18T05:01:39.752852+0000","last_fullsized":"2024-04-18T05:01:39.752852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'441","last_scrub_stamp":"2024-04-18T05:01:39.752799+0000","last_deep_scrub":"23'441","last_deep_scrub_stamp":"2024-04-18T05:01:39.752799+0000","last_clean_scrub_stamp":"2024-04-18T05:01:39.752799+0000","objects_scrubbed":3,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:48:18.105055+0000","scrub_duration":0.041934091999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":379,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'410","reported_seq":535,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.439531+0000","last_change":"2024-04-18T05:01:31.439720+0000","last_active":"2024-04-18T05:01:31.439531+0000","last_peered":"2024-04-18T05:01:31.439531+0000","last_clean":"2024-04-18T05:01:31.439531+0000","last_became_active":"2024-04-18T04:54:41.195152+0000","last_became_peered":"2024-04-18T04:54:41.195152+0000","last_unstale":"2024-04-18T05:01:31.439531+0000","last_undegraded":"2024-04-18T05:01:31.439531+0000","last_fullsized":"2024-04-18T05:01:31.439531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'410","last_scrub_stamp":"2024-04-18T05:01:31.439482+0000","last_deep_scrub":"23'410","last_deep_scrub_stamp":"2024-04-18T05:01:31.439482+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.439482+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:15:47.638581+0000","scrub_duration":0.0047366739999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":54989,"num_write":377,"num_write_kb":85155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'434","reported_seq":813,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:27.556454+0000","last_change":"2024-04-18T05:01:27.556643+0000","last_active":"2024-04-18T05:01:27.556454+0000","last_peered":"2024-04-18T05:01:27.556454+0000","last_clean":"2024-04-18T05:01:27.556454+0000","last_became_active":"2024-04-18T04:54:40.818113+0000","last_became_peered":"2024-04-18T04:54:40.818113+0000","last_unstale":"2024-04-18T05:01:27.556454+0000","last_undegraded":"2024-04-18T05:01:27.556454+0000","last_fullsized":"2024-04-18T05:01:27.556454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'434","last_scrub_stamp":"2024-04-18T05:01:27.556398+0000","last_deep_scrub":"23'434","last_deep_scrub_stamp":"2024-04-18T05:01:27.556398+0000","last_clean_scrub_stamp":"2024-04-18T05:01:27.556398+0000","objects_scrubbed":4,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:43.131779+0000","scrub_duration":0.020609295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1456426,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":351,"num_read_kb":1645,"num_write":371,"num_write_kb":1672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'416","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:33.488170+0000","last_change":"2024-04-18T05:01:33.488378+0000","last_active":"2024-04-18T05:01:33.488170+0000","last_peered":"2024-04-18T05:01:33.488170+0000","last_clean":"2024-04-18T05:01:33.488170+0000","last_became_active":"2024-04-18T04:54:41.192187+0000","last_became_peered":"2024-04-18T04:54:41.192187+0000","last_unstale":"2024-04-18T05:01:33.488170+0000","last_undegraded":"2024-04-18T05:01:33.488170+0000","last_fullsized":"2024-04-18T05:01:33.488170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'416","last_scrub_stamp":"2024-04-18T05:01:33.488116+0000","last_deep_scrub":"23'416","last_deep_scrub_stamp":"2024-04-18T05:01:33.488116+0000","last_clean_scrub_stamp":"2024-04-18T05:01:33.488116+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:35.745366+0000","scrub_duration":0.0041304510000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":364,"num_write":388,"num_write_kb":58777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'521","reported_seq":548,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:44.763490+0000","last_change":"2024-04-18T05:01:44.763693+0000","last_active":"2024-04-18T05:01:44.763490+0000","last_peered":"2024-04-18T05:01:44.763490+0000","last_clean":"2024-04-18T05:01:44.763490+0000","last_became_active":"2024-04-18T04:54:40.820025+0000","last_became_peered":"2024-04-18T04:54:40.820025+0000","last_unstale":"2024-04-18T05:01:44.763490+0000","last_undegraded":"2024-04-18T05:01:44.763490+0000","last_fullsized":"2024-04-18T05:01:44.763490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'521","last_scrub_stamp":"2024-04-18T05:01:44.763432+0000","last_deep_scrub":"23'521","last_deep_scrub_stamp":"2024-04-18T05:01:44.763432+0000","last_clean_scrub_stamp":"2024-04-18T05:01:44.763432+0000","objects_scrubbed":4,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:53:45.270943+0000","scrub_duration":0.044834888000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":8474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'404","reported_seq":464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.502932+0000","last_change":"2024-04-18T05:01:31.503151+0000","last_active":"2024-04-18T05:01:31.502932+0000","last_peered":"2024-04-18T05:01:31.502932+0000","last_clean":"2024-04-18T05:01:31.502932+0000","last_became_active":"2024-04-18T04:54:41.185257+0000","last_became_peered":"2024-04-18T04:54:41.185257+0000","last_unstale":"2024-04-18T05:01:31.502932+0000","last_undegraded":"2024-04-18T05:01:31.502932+0000","last_fullsized":"2024-04-18T05:01:31.502932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'404","last_scrub_stamp":"2024-04-18T05:01:31.502875+0000","last_deep_scrub":"23'404","last_deep_scrub_stamp":"2024-04-18T05:01:31.502875+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.502875+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:33.760126+0000","scrub_duration":0.0037300290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14216,"num_write":374,"num_write_kb":63531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'63","reported_seq":90,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:22.504178+0000","last_change":"2024-04-18T05:01:22.504434+0000","last_active":"2024-04-18T05:01:22.504178+0000","last_peered":"2024-04-18T05:01:22.504178+0000","last_clean":"2024-04-18T05:01:22.504178+0000","last_became_active":"2024-04-18T04:54:40.824206+0000","last_became_peered":"2024-04-18T04:54:40.824206+0000","last_unstale":"2024-04-18T05:01:22.504178+0000","last_undegraded":"2024-04-18T05:01:22.504178+0000","last_fullsized":"2024-04-18T05:01:22.504178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'63","last_scrub_stamp":"2024-04-18T05:01:22.504121+0000","last_deep_scrub":"23'63","last_deep_scrub_stamp":"2024-04-18T05:01:22.504121+0000","last_clean_scrub_stamp":"2024-04-18T05:01:22.504121+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:27:09.070973+0000","scrub_duration":0.003666192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'433","reported_seq":543,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:33.947094+0000","last_change":"2024-04-18T05:01:33.947327+0000","last_active":"2024-04-18T05:01:33.947094+0000","last_peered":"2024-04-18T05:01:33.947094+0000","last_clean":"2024-04-18T05:01:33.947094+0000","last_became_active":"2024-04-18T04:54:41.195177+0000","last_became_peered":"2024-04-18T04:54:41.195177+0000","last_unstale":"2024-04-18T05:01:33.947094+0000","last_undegraded":"2024-04-18T05:01:33.947094+0000","last_fullsized":"2024-04-18T05:01:33.947094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'433","last_scrub_stamp":"2024-04-18T05:01:33.947042+0000","last_deep_scrub":"23'433","last_deep_scrub_stamp":"2024-04-18T05:01:33.947042+0000","last_clean_scrub_stamp":"2024-04-18T05:01:33.947042+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:27.789977+0000","scrub_duration":0.0045580300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":41457,"num_write":394,"num_write_kb":79356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'332","reported_seq":359,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:35.699806+0000","last_change":"2024-04-18T05:01:35.700010+0000","last_active":"2024-04-18T05:01:35.699806+0000","last_peered":"2024-04-18T05:01:35.699806+0000","last_clean":"2024-04-18T05:01:35.699806+0000","last_became_active":"2024-04-18T04:54:40.802902+0000","last_became_peered":"2024-04-18T04:54:40.802902+0000","last_unstale":"2024-04-18T05:01:35.699806+0000","last_undegraded":"2024-04-18T05:01:35.699806+0000","last_fullsized":"2024-04-18T05:01:35.699806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'332","last_scrub_stamp":"2024-04-18T05:01:35.699755+0000","last_deep_scrub":"23'332","last_deep_scrub_stamp":"2024-04-18T05:01:35.699755+0000","last_clean_scrub_stamp":"2024-04-18T05:01:35.699755+0000","objects_scrubbed":4,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:43:09.664036+0000","scrub_duration":0.029626237999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'423","reported_seq":521,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:34.360195+0000","last_change":"2024-04-18T05:01:34.360390+0000","last_active":"2024-04-18T05:01:34.360195+0000","last_peered":"2024-04-18T05:01:34.360195+0000","last_clean":"2024-04-18T05:01:34.360195+0000","last_became_active":"2024-04-18T04:54:41.194965+0000","last_became_peered":"2024-04-18T04:54:41.194965+0000","last_unstale":"2024-04-18T05:01:34.360195+0000","last_undegraded":"2024-04-18T05:01:34.360195+0000","last_fullsized":"2024-04-18T05:01:34.360195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'423","last_scrub_stamp":"2024-04-18T05:01:34.360133+0000","last_deep_scrub":"23'423","last_deep_scrub_stamp":"2024-04-18T05:01:34.360133+0000","last_clean_scrub_stamp":"2024-04-18T05:01:34.360133+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:53.329547+0000","scrub_duration":0.0042417540000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32152,"num_write":386,"num_write_kb":121188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'120","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:23.448961+0000","last_change":"2024-04-18T05:01:23.449160+0000","last_active":"2024-04-18T05:01:23.448961+0000","last_peered":"2024-04-18T05:01:23.448961+0000","last_clean":"2024-04-18T05:01:23.448961+0000","last_became_active":"2024-04-18T04:54:40.798574+0000","last_became_peered":"2024-04-18T04:54:40.798574+0000","last_unstale":"2024-04-18T05:01:23.448961+0000","last_undegraded":"2024-04-18T05:01:23.448961+0000","last_fullsized":"2024-04-18T05:01:23.448961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'120","last_scrub_stamp":"2024-04-18T05:01:23.448909+0000","last_deep_scrub":"23'120","last_deep_scrub_stamp":"2024-04-18T05:01:23.448909+0000","last_clean_scrub_stamp":"2024-04-18T05:01:23.448909+0000","objects_scrubbed":4,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:10.543975+0000","scrub_duration":0.027642872999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'326","reported_seq":354,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:47.472228+0000","last_change":"2024-04-18T05:01:47.472434+0000","last_active":"2024-04-18T05:01:47.472228+0000","last_peered":"2024-04-18T05:01:47.472228+0000","last_clean":"2024-04-18T05:01:47.472228+0000","last_became_active":"2024-04-18T04:54:41.191124+0000","last_became_peered":"2024-04-18T04:54:41.191124+0000","last_unstale":"2024-04-18T05:01:47.472228+0000","last_undegraded":"2024-04-18T05:01:47.472228+0000","last_fullsized":"2024-04-18T05:01:47.472228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'326","last_scrub_stamp":"2024-04-18T05:01:47.472175+0000","last_deep_scrub":"23'326","last_deep_scrub_stamp":"2024-04-18T05:01:47.472175+0000","last_clean_scrub_stamp":"2024-04-18T05:01:47.472175+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:15:35.494374+0000","scrub_duration":0.003370414,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":298,"num_write_kb":17144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'84","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:36.679923+0000","last_change":"2024-04-18T05:01:36.680144+0000","last_active":"2024-04-18T05:01:36.679923+0000","last_peered":"2024-04-18T05:01:36.679923+0000","last_clean":"2024-04-18T05:01:36.679923+0000","last_became_active":"2024-04-18T04:54:40.803616+0000","last_became_peered":"2024-04-18T04:54:40.803616+0000","last_unstale":"2024-04-18T05:01:36.679923+0000","last_undegraded":"2024-04-18T05:01:36.679923+0000","last_fullsized":"2024-04-18T05:01:36.679923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'84","last_scrub_stamp":"2024-04-18T05:01:36.679867+0000","last_deep_scrub":"23'84","last_deep_scrub_stamp":"2024-04-18T05:01:36.679867+0000","last_clean_scrub_stamp":"2024-04-18T05:01:36.679867+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:24:19.383527+0000","scrub_duration":0.008721632,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'465","reported_seq":524,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:53.408745+0000","last_change":"2024-04-18T05:01:53.408953+0000","last_active":"2024-04-18T05:01:53.408745+0000","last_peered":"2024-04-18T05:01:53.408745+0000","last_clean":"2024-04-18T05:01:53.408745+0000","last_became_active":"2024-04-18T04:54:41.185217+0000","last_became_peered":"2024-04-18T04:54:41.185217+0000","last_unstale":"2024-04-18T05:01:53.408745+0000","last_undegraded":"2024-04-18T05:01:53.408745+0000","last_fullsized":"2024-04-18T05:01:53.408745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'465","last_scrub_stamp":"2024-04-18T05:01:53.408690+0000","last_deep_scrub":"23'465","last_deep_scrub_stamp":"2024-04-18T05:01:53.408690+0000","last_clean_scrub_stamp":"2024-04-18T05:01:53.408690+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:52:02.665415+0000","scrub_duration":0.0043601559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8956,"num_write":434,"num_write_kb":97052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'603","reported_seq":631,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:20.459084+0000","last_change":"2024-04-18T05:01:20.459297+0000","last_active":"2024-04-18T05:01:20.459084+0000","last_peered":"2024-04-18T05:01:20.459084+0000","last_clean":"2024-04-18T05:01:20.459084+0000","last_became_active":"2024-04-18T04:54:40.800598+0000","last_became_peered":"2024-04-18T04:54:40.800598+0000","last_unstale":"2024-04-18T05:01:20.459084+0000","last_undegraded":"2024-04-18T05:01:20.459084+0000","last_fullsized":"2024-04-18T05:01:20.459084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'603","last_scrub_stamp":"2024-04-18T05:01:20.459029+0000","last_deep_scrub":"23'603","last_deep_scrub_stamp":"2024-04-18T05:01:20.459029+0000","last_clean_scrub_stamp":"2024-04-18T05:01:20.459029+0000","objects_scrubbed":2,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:27:07.025881+0000","scrub_duration":0.035046730999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":546,"num_write_kb":4388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'458","reported_seq":516,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:23.654905+0000","last_change":"2024-04-18T05:01:23.655141+0000","last_active":"2024-04-18T05:01:23.654905+0000","last_peered":"2024-04-18T05:01:23.654905+0000","last_clean":"2024-04-18T05:01:23.654905+0000","last_became_active":"2024-04-18T04:54:41.197201+0000","last_became_peered":"2024-04-18T04:54:41.197201+0000","last_unstale":"2024-04-18T05:01:23.654905+0000","last_undegraded":"2024-04-18T05:01:23.654905+0000","last_fullsized":"2024-04-18T05:01:23.654905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'458","last_scrub_stamp":"2024-04-18T05:01:23.654853+0000","last_deep_scrub":"23'458","last_deep_scrub_stamp":"2024-04-18T05:01:23.654853+0000","last_clean_scrub_stamp":"2024-04-18T05:01:23.654853+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:23.362109+0000","scrub_duration":0.0048732259999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21429,"num_write":433,"num_write_kb":71833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'59","reported_seq":87,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:19.349316+0000","last_change":"2024-04-18T05:01:19.349515+0000","last_active":"2024-04-18T05:01:19.349316+0000","last_peered":"2024-04-18T05:01:19.349316+0000","last_clean":"2024-04-18T05:01:19.349316+0000","last_became_active":"2024-04-18T04:54:40.797471+0000","last_became_peered":"2024-04-18T04:54:40.797471+0000","last_unstale":"2024-04-18T05:01:19.349316+0000","last_undegraded":"2024-04-18T05:01:19.349316+0000","last_fullsized":"2024-04-18T05:01:19.349316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'59","last_scrub_stamp":"2024-04-18T05:01:19.349260+0000","last_deep_scrub":"23'59","last_deep_scrub_stamp":"2024-04-18T05:01:19.349260+0000","last_clean_scrub_stamp":"2024-04-18T05:01:19.349260+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:21:43.629003+0000","scrub_duration":0.0068506010000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"23'421","reported_seq":491,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:45.481650+0000","last_change":"2024-04-18T05:01:45.481843+0000","last_active":"2024-04-18T05:01:45.481650+0000","last_peered":"2024-04-18T05:01:45.481650+0000","last_clean":"2024-04-18T05:01:45.481650+0000","last_became_active":"2024-04-18T04:54:41.191488+0000","last_became_peered":"2024-04-18T04:54:41.191488+0000","last_unstale":"2024-04-18T05:01:45.481650+0000","last_undegraded":"2024-04-18T05:01:45.481650+0000","last_fullsized":"2024-04-18T05:01:45.481650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'421","last_scrub_stamp":"2024-04-18T05:01:45.481596+0000","last_deep_scrub":"23'421","last_deep_scrub_stamp":"2024-04-18T05:01:45.481596+0000","last_clean_scrub_stamp":"2024-04-18T05:01:45.481596+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:26:44.526526+0000","scrub_duration":0.0044098089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23403,"num_write":390,"num_write_kb":67848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'195","reported_seq":223,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:26.364348+0000","last_change":"2024-04-18T05:01:26.364548+0000","last_active":"2024-04-18T05:01:26.364348+0000","last_peered":"2024-04-18T05:01:26.364348+0000","last_clean":"2024-04-18T05:01:26.364348+0000","last_became_active":"2024-04-18T04:54:40.823277+0000","last_became_peered":"2024-04-18T04:54:40.823277+0000","last_unstale":"2024-04-18T05:01:26.364348+0000","last_undegraded":"2024-04-18T05:01:26.364348+0000","last_fullsized":"2024-04-18T05:01:26.364348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'195","last_scrub_stamp":"2024-04-18T05:01:26.364289+0000","last_deep_scrub":"23'195","last_deep_scrub_stamp":"2024-04-18T05:01:26.364289+0000","last_clean_scrub_stamp":"2024-04-18T05:01:26.364289+0000","objects_scrubbed":3,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:24.955459+0000","scrub_duration":0.028608092000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'448","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:34.619186+0000","last_change":"2024-04-18T05:01:34.619396+0000","last_active":"2024-04-18T05:01:34.619186+0000","last_peered":"2024-04-18T05:01:34.619186+0000","last_clean":"2024-04-18T05:01:34.619186+0000","last_became_active":"2024-04-18T04:54:41.199700+0000","last_became_peered":"2024-04-18T04:54:41.199700+0000","last_unstale":"2024-04-18T05:01:34.619186+0000","last_undegraded":"2024-04-18T05:01:34.619186+0000","last_fullsized":"2024-04-18T05:01:34.619186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'448","last_scrub_stamp":"2024-04-18T05:01:34.619131+0000","last_deep_scrub":"23'448","last_deep_scrub_stamp":"2024-04-18T05:01:34.619131+0000","last_clean_scrub_stamp":"2024-04-18T05:01:34.619131+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:53.588546+0000","scrub_duration":0.003693375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":10662,"num_write":420,"num_write_kb":96864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'131","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:34.721575+0000","last_change":"2024-04-18T05:01:34.721856+0000","last_active":"2024-04-18T05:01:34.721575+0000","last_peered":"2024-04-18T05:01:34.721575+0000","last_clean":"2024-04-18T05:01:34.721575+0000","last_became_active":"2024-04-18T04:54:40.800405+0000","last_became_peered":"2024-04-18T04:54:40.800405+0000","last_unstale":"2024-04-18T05:01:34.721575+0000","last_undegraded":"2024-04-18T05:01:34.721575+0000","last_fullsized":"2024-04-18T05:01:34.721575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-04-18T05:01:34.721521+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-04-18T05:01:34.721521+0000","last_clean_scrub_stamp":"2024-04-18T05:01:34.721521+0000","objects_scrubbed":4,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:06.452051+0000","scrub_duration":0.044336153000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":8237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'441","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:18.559227+0000","last_change":"2024-04-18T05:01:18.559314+0000","last_active":"2024-04-18T05:01:18.559227+0000","last_peered":"2024-04-18T05:01:18.559227+0000","last_clean":"2024-04-18T05:01:18.559227+0000","last_became_active":"2024-04-18T04:54:41.186301+0000","last_became_peered":"2024-04-18T04:54:41.186301+0000","last_unstale":"2024-04-18T05:01:18.559227+0000","last_undegraded":"2024-04-18T05:01:18.559227+0000","last_fullsized":"2024-04-18T05:01:18.559227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'441","last_scrub_stamp":"2024-04-18T05:01:18.559208+0000","last_deep_scrub":"23'441","last_deep_scrub_stamp":"2024-04-18T05:01:18.559208+0000","last_clean_scrub_stamp":"2024-04-18T05:01:18.559208+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:58.993043+0000","scrub_duration":0.0020339099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":27247,"num_write":409,"num_write_kb":76591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"23'382","reported_seq":420,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:24.698605+0000","last_change":"2024-04-18T05:01:24.698605+0000","last_active":"2024-04-18T05:01:24.698605+0000","last_peered":"2024-04-18T05:01:24.698605+0000","last_clean":"2024-04-18T05:01:24.698605+0000","last_became_active":"2024-04-18T04:54:41.192941+0000","last_became_peered":"2024-04-18T04:54:41.192941+0000","last_unstale":"2024-04-18T05:01:24.698605+0000","last_undegraded":"2024-04-18T05:01:24.698605+0000","last_fullsized":"2024-04-18T05:01:24.698605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'382","last_scrub_stamp":"2024-04-18T05:01:24.698356+0000","last_deep_scrub":"23'382","last_deep_scrub_stamp":"2024-04-18T05:01:24.698356+0000","last_clean_scrub_stamp":"2024-04-18T05:01:24.698356+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:15.097966+0000","scrub_duration":0.0038559670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4755,"num_write":342,"num_write_kb":72428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'361","reported_seq":389,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:28.505483+0000","last_change":"2024-04-18T05:01:28.505483+0000","last_active":"2024-04-18T05:01:28.505483+0000","last_peered":"2024-04-18T05:01:28.505483+0000","last_clean":"2024-04-18T05:01:28.505483+0000","last_became_active":"2024-04-18T04:54:40.799517+0000","last_became_peered":"2024-04-18T04:54:40.799517+0000","last_unstale":"2024-04-18T05:01:28.505483+0000","last_undegraded":"2024-04-18T05:01:28.505483+0000","last_fullsized":"2024-04-18T05:01:28.505483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'361","last_scrub_stamp":"2024-04-18T05:01:28.505196+0000","last_deep_scrub":"23'361","last_deep_scrub_stamp":"2024-04-18T05:01:28.505196+0000","last_clean_scrub_stamp":"2024-04-18T05:01:28.505196+0000","objects_scrubbed":4,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:28.212451+0000","scrub_duration":0.040738904999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"23'382","reported_seq":434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:34.697686+0000","last_change":"2024-04-18T05:01:34.697686+0000","last_active":"2024-04-18T05:01:34.697686+0000","last_peered":"2024-04-18T05:01:34.697686+0000","last_clean":"2024-04-18T05:01:34.697686+0000","last_became_active":"2024-04-18T04:54:41.179359+0000","last_became_peered":"2024-04-18T04:54:41.179359+0000","last_unstale":"2024-04-18T05:01:34.697686+0000","last_undegraded":"2024-04-18T05:01:34.697686+0000","last_fullsized":"2024-04-18T05:01:34.697686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'382","last_scrub_stamp":"2024-04-18T05:01:34.697296+0000","last_deep_scrub":"23'382","last_deep_scrub_stamp":"2024-04-18T05:01:34.697296+0000","last_clean_scrub_stamp":"2024-04-18T05:01:34.697296+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:15.131132+0000","scrub_duration":0.0047097220000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14401,"num_write":356,"num_write_kb":79542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'299","reported_seq":327,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:29.590183+0000","last_change":"2024-04-18T05:01:29.590183+0000","last_active":"2024-04-18T05:01:29.590183+0000","last_peered":"2024-04-18T05:01:29.590183+0000","last_clean":"2024-04-18T05:01:29.590183+0000","last_became_active":"2024-04-18T04:54:40.800660+0000","last_became_peered":"2024-04-18T04:54:40.800660+0000","last_unstale":"2024-04-18T05:01:29.590183+0000","last_undegraded":"2024-04-18T05:01:29.590183+0000","last_fullsized":"2024-04-18T05:01:29.590183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'299","last_scrub_stamp":"2024-04-18T05:01:29.589913+0000","last_deep_scrub":"23'299","last_deep_scrub_stamp":"2024-04-18T05:01:29.589913+0000","last_clean_scrub_stamp":"2024-04-18T05:01:29.589913+0000","objects_scrubbed":10,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:19.989522+0000","scrub_duration":0.076672561,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":12441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'366","reported_seq":421,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:54.704571+0000","last_change":"2024-04-18T05:01:54.704778+0000","last_active":"2024-04-18T05:01:54.704571+0000","last_peered":"2024-04-18T05:01:54.704571+0000","last_clean":"2024-04-18T05:01:54.704571+0000","last_became_active":"2024-04-18T04:54:41.189344+0000","last_became_peered":"2024-04-18T04:54:41.189344+0000","last_unstale":"2024-04-18T05:01:54.704571+0000","last_undegraded":"2024-04-18T05:01:54.704571+0000","last_fullsized":"2024-04-18T05:01:54.704571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'366","last_scrub_stamp":"2024-04-18T05:01:54.704518+0000","last_deep_scrub":"23'366","last_deep_scrub_stamp":"2024-04-18T05:01:54.704518+0000","last_clean_scrub_stamp":"2024-04-18T05:01:54.704518+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:44.332672+0000","scrub_duration":0.0037392409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10936,"num_write":342,"num_write_kb":51086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'87","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:25.570678+0000","last_change":"2024-04-18T05:01:25.570947+0000","last_active":"2024-04-18T05:01:25.570678+0000","last_peered":"2024-04-18T05:01:25.570678+0000","last_clean":"2024-04-18T05:01:25.570678+0000","last_became_active":"2024-04-18T04:54:40.813290+0000","last_became_peered":"2024-04-18T04:54:40.813290+0000","last_unstale":"2024-04-18T05:01:25.570678+0000","last_undegraded":"2024-04-18T05:01:25.570678+0000","last_fullsized":"2024-04-18T05:01:25.570678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'87","last_scrub_stamp":"2024-04-18T05:01:25.570624+0000","last_deep_scrub":"23'87","last_deep_scrub_stamp":"2024-04-18T05:01:25.570624+0000","last_clean_scrub_stamp":"2024-04-18T05:01:25.570624+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:06.004459+0000","scrub_duration":0.021566535000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'407","reported_seq":465,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.518150+0000","last_change":"2024-04-18T05:01:31.518368+0000","last_active":"2024-04-18T05:01:31.518150+0000","last_peered":"2024-04-18T05:01:31.518150+0000","last_clean":"2024-04-18T05:01:31.518150+0000","last_became_active":"2024-04-18T04:54:41.192096+0000","last_became_peered":"2024-04-18T04:54:41.192096+0000","last_unstale":"2024-04-18T05:01:31.518150+0000","last_undegraded":"2024-04-18T05:01:31.518150+0000","last_fullsized":"2024-04-18T05:01:31.518150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'407","last_scrub_stamp":"2024-04-18T05:01:31.518099+0000","last_deep_scrub":"23'407","last_deep_scrub_stamp":"2024-04-18T05:01:31.518099+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.518099+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:21.917708+0000","scrub_duration":0.0045801699999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17335,"num_write":380,"num_write_kb":68515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'137","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:36.398640+0000","last_change":"2024-04-18T05:01:36.398858+0000","last_active":"2024-04-18T05:01:36.398640+0000","last_peered":"2024-04-18T05:01:36.398640+0000","last_clean":"2024-04-18T05:01:36.398640+0000","last_became_active":"2024-04-18T04:54:40.804913+0000","last_became_peered":"2024-04-18T04:54:40.804913+0000","last_unstale":"2024-04-18T05:01:36.398640+0000","last_undegraded":"2024-04-18T05:01:36.398640+0000","last_fullsized":"2024-04-18T05:01:36.398640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'137","last_scrub_stamp":"2024-04-18T05:01:36.398585+0000","last_deep_scrub":"23'137","last_deep_scrub_stamp":"2024-04-18T05:01:36.398585+0000","last_clean_scrub_stamp":"2024-04-18T05:01:36.398585+0000","objects_scrubbed":7,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:26:25.377881+0000","scrub_duration":0.026464031999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2494,"num_read_kb":1324974,"num_write":24555,"num_write_kb":4507656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26500,"ondisk_log_size":26500,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":130916242,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":351,"num_read_kb":1645,"num_write":7226,"num_write_kb":133419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":100597760,"data_stored":261832484,"data_compressed":36635560,"data_compressed_allocated":47603712,"data_compressed_original":209084416,"omap_allocated":0,"internal_metadata":0},"log_size":8954,"ondisk_log_size":8954,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509536,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":5676,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":5812224,"data_stored":14125282,"data_compressed":1836351,"data_compressed_allocated":2379776,"data_compressed_original":10878976,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.79300000000000004,"15min":0.83699999999999997},"min":{"1min":0.53100000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.0900000000000001,"5min":1.1910000000000001,"15min":1.2490000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.81000000000000005,"15min":0.84299999999999997},"min":{"1min":0.54400000000000004,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.21,"5min":1.262,"15min":1.262},"last":0.88100000000000001}]},{"osd":1,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.82399999999999995,"15min":0.82199999999999995},"min":{"1min":0.66200000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2310000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.84799999999999998,"15min":0.84899999999999998},"min":{"1min":0.622,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.26,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.83599999999999997}]},{"osd":2,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.92800000000000005,"15min":0.89300000000000002},"min":{"1min":0.56299999999999994,"5min":0.438,"15min":0.438},"max":{"1min":1.3320000000000001,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.88600000000000001,"15min":0.87},"min":{"1min":0.69199999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.218,"5min":1.379,"15min":1.4019999999999999},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.88200000000000001,"15min":0.88500000000000001},"min":{"1min":0.67900000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.032,"5min":1.458,"15min":1.458},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.98799999999999999,"15min":0.95399999999999996},"min":{"1min":0.72599999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.286,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.92100000000000004}]},{"osd":4,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.90800000000000003,"15min":0.92600000000000005},"min":{"1min":0.56999999999999995,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.339,"5min":1.605,"15min":1.605},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.90800000000000003,"15min":0.91200000000000003},"min":{"1min":0.68000000000000005,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.224,"5min":1.546,"15min":1.546},"last":0.85299999999999998}]},{"osd":5,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.97599999999999998,"15min":1.012},"min":{"1min":0.66800000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4379999999999999,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.996,"15min":1.016},"min":{"1min":0.61099999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.2130000000000001,"5min":1.431,"15min":1.5640000000000001},"last":0.80800000000000005}]},{"osd":6,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0640000000000001,"15min":1.103},"min":{"1min":0.70299999999999996,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2929999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.024,"5min":1.0569999999999999,"15min":1.0469999999999999},"min":{"1min":0.80900000000000005,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2809999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.1240000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509536,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47056,"kb_used_data":7752,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94324784,"statfs":{"total":96636764160,"available":96588578816,"internally_reserved":0,"allocated":7938048,"data_stored":21059926,"data_compressed":3027129,"data_compressed_allocated":3776512,"data_compressed_original":17063936,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78000000000000003,"15min":0.77700000000000002},"min":{"1min":0.51200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80000000000000004,"15min":0.84499999999999997},"min":{"1min":0.47499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.048,"5min":1.1870000000000001,"15min":1.353},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.88,"15min":0.93300000000000005},"min":{"1min":0.56899999999999995,"5min":0.312,"15min":0.312},"max":{"1min":1.2430000000000001,"5min":1.268,"15min":1.8560000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.83199999999999996,"15min":0.84799999999999998},"min":{"1min":0.55500000000000005,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.2849999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.96799999999999997,"15min":0.94099999999999995},"min":{"1min":0.71499999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.552,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.94799999999999995,"15min":0.93000000000000005},"min":{"1min":0.52300000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3220000000000001,"5min":1.325,"15min":1.325},"last":0.873}]},{"osd":3,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.93400000000000005,"15min":0.90900000000000003},"min":{"1min":0.73899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3049999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.95599999999999996,"15min":0.98599999999999999},"min":{"1min":0.70699999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.4510000000000001,"5min":1.617,"15min":1.617},"last":1.0680000000000001}]},{"osd":4,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.90700000000000003,"15min":0.97299999999999998},"min":{"1min":0.70999999999999996,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1259999999999999,"5min":1.4990000000000001,"15min":1.631},"last":1.028},{"interface":"front","average":{"1min":1.002,"5min":0.97899999999999998,"15min":1.052},"min":{"1min":0.71599999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2370000000000001,"5min":1.631,"15min":1.631},"last":1.0449999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.98499999999999999,"15min":1.0049999999999999},"min":{"1min":0.69599999999999995,"5min":0.372,"15min":0.372},"max":{"1min":1.28,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0209999999999999,"15min":1.0429999999999999},"min":{"1min":0.64900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.3109999999999999,"5min":1.673,"15min":1.6739999999999999},"last":0.998}]},{"osd":7,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0489999999999999,"15min":1.1020000000000001},"min":{"1min":0.67200000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.3959999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0820000000000001,"15min":1.107},"min":{"1min":0.68500000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.268,"5min":1.73,"15min":1.7769999999999999},"last":1.125}]}]},{"osd":5,"up_from":15,"seq":64424509535,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66536,"kb_used_data":13280,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94305304,"statfs":{"total":96636764160,"available":96568631296,"internally_reserved":0,"allocated":13598720,"data_stored":35687478,"data_compressed":4904028,"data_compressed_allocated":6356992,"data_compressed_original":28622848,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.77100000000000002,"15min":0.88600000000000001},"min":{"1min":0.58299999999999996,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.196,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.80600000000000005,"15min":0.82699999999999996},"min":{"1min":0.55600000000000005,"5min":0.309,"15min":0.309},"max":{"1min":1.1850000000000001,"5min":1.542,"15min":1.542},"last":0.75}]},{"osd":1,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.93500000000000005,"15min":0.91700000000000004},"min":{"1min":0.66300000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.169,"5min":9.8819999999999997,"15min":9.8819999999999997},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.90100000000000002,"15min":0.92700000000000005},"min":{"1min":0.73999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1080000000000001,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.89600000000000002,"15min":0.89200000000000002},"min":{"1min":0.70499999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.264,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.97799999999999998,"15min":0.94299999999999995},"min":{"1min":0.67900000000000005,"5min":0.38,"15min":0.38},"max":{"1min":1.1040000000000001,"5min":10.031000000000001,"15min":10.031000000000001},"last":0.94799999999999995}]},{"osd":3,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.94499999999999995,"15min":0.96099999999999997},"min":{"1min":0.69799999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1859999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.876},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.98699999999999999,"15min":1.0089999999999999},"min":{"1min":0.73199999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.157,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.89000000000000001}]},{"osd":4,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":1.0069999999999999,"15min":0.92000000000000004},"min":{"1min":0.60699999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.23,"5min":9.968,"15min":9.968},"last":1.069},{"interface":"front","average":{"1min":1.012,"5min":1,"15min":1.018},"min":{"1min":0.67900000000000005,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2330000000000001,"5min":1.631,"15min":1.8440000000000001},"last":1.0309999999999999}]},{"osd":6,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0189999999999999,"15min":0.96499999999999997},"min":{"1min":0.64500000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.256,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.1180000000000001,"15min":1.038},"min":{"1min":0.76400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.2869999999999999,"5min":10.09,"15min":10.09},"last":0.71299999999999997}]},{"osd":7,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.089,"15min":1.099},"min":{"1min":0.69699999999999995,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.244,"5min":1.7050000000000001,"15min":1.944},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.1479999999999999,"15min":1.149},"min":{"1min":0.96599999999999997,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.4159999999999999,"5min":1.97,"15min":1.97},"last":0.996}]}]},{"osd":3,"up_from":15,"seq":64424509536,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77376,"kb_used_data":20024,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94294464,"statfs":{"total":96636764160,"available":96557531136,"internally_reserved":0,"allocated":20504576,"data_stored":54614164,"data_compressed":7702565,"data_compressed_allocated":9973760,"data_compressed_original":44273664,"omap_allocated":1592,"internal_metadata":58718664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63400000000000001,"15min":0.66600000000000004},"min":{"1min":0.222,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.032,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.64100000000000001,"15min":0.61499999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.82299999999999995,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63200000000000001,"15min":0.63400000000000001},"min":{"1min":0.34599999999999997,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.077,"5min":1.0920000000000001,"15min":1.2410000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76000000000000001,"15min":0.69999999999999996},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.1839999999999999,"5min":2.601,"15min":2.601},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.74099999999999999,"15min":0.73199999999999998},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.28499999999999998},"max":{"1min":0.98899999999999999,"5min":1.359,"15min":1.573},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80000000000000004,"15min":0.79400000000000004},"min":{"1min":0.27700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1000000000000001,"5min":1.51,"15min":1.51},"last":0.84599999999999997}]},{"osd":4,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85699999999999998,"15min":0.85599999999999998},"min":{"1min":0.51800000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.224,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92900000000000005,"15min":0.93400000000000005},"min":{"1min":0.66800000000000004,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1279999999999999,"5min":1.524,"15min":1.524},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":2.0219999999999998,"5min":1.167,"15min":1.0049999999999999},"min":{"1min":0.69199999999999995,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":21.260000000000002,"5min":21.260000000000002,"15min":21.260000000000002},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.091,"15min":1.0469999999999999},"min":{"1min":0.56999999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":7.569,"5min":7.569,"15min":7.569},"last":1.141}]},{"osd":6,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.0660000000000001,"15min":0.995},"min":{"1min":0.60599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":7.2729999999999997,"5min":7.2729999999999997,"15min":7.2729999999999997},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.0580000000000001,"15min":1.054},"min":{"1min":0.69899999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.2199999999999998,"5min":4.2199999999999998,"15min":4.2199999999999998},"last":1.109}]},{"osd":7,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.077,"15min":1.1040000000000001},"min":{"1min":0.57299999999999995,"5min":0.435,"15min":0.435},"max":{"1min":1.3879999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.05,"15min":1.0549999999999999},"min":{"1min":0.64500000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.98099999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509535,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59832,"kb_used_data":14768,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94312008,"statfs":{"total":96636764160,"available":96575496192,"internally_reserved":0,"allocated":15122432,"data_stored":34231216,"data_compressed":4539223,"data_compressed_allocated":6156288,"data_compressed_original":25436160,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.65000000000000002,"15min":0.59399999999999997},"min":{"1min":0.46600000000000003,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.78700000000000003,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68200000000000005,"15min":0.73599999999999999},"min":{"1min":0.55100000000000005,"5min":0.214,"15min":0.214},"max":{"1min":0.92600000000000005,"5min":1.5920000000000001,"15min":1.9239999999999999},"last":0.65800000000000003}]},{"osd":2,"last update":"Thu Apr 18 05:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.68300000000000005},"min":{"1min":0.49199999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.93799999999999994,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.749,"15min":0.72399999999999998},"min":{"1min":0.505,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.048,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Apr 18 05:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79300000000000004,"15min":0.78400000000000003},"min":{"1min":0.59099999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.0649999999999999,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80700000000000005,"15min":0.77700000000000002},"min":{"1min":0.56899999999999995,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.032,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Apr 18 05:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.94599999999999995,"15min":0.94499999999999995},"min":{"1min":0.72099999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.4430000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":0.97999999999999998},"min":{"1min":0.67000000000000004,"5min":0.379,"15min":0.379},"max":{"1min":1.2629999999999999,"5min":2.133,"15min":2.133},"last":1.014}]},{"osd":5,"last update":"Thu Apr 18 05:01:39 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0129999999999999,"15min":1.008},"min":{"1min":0.79000000000000004,"5min":0.313,"15min":0.313},"max":{"1min":1.5660000000000001,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.998,"5min":1.0109999999999999,"15min":0.98599999999999999},"min":{"1min":0.68300000000000005,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3069999999999999,"5min":2.347,"15min":2.347},"last":1.1439999999999999}]},{"osd":6,"last update":"Thu Apr 18 05:01:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0189999999999999,"15min":1.0209999999999999},"min":{"1min":0.73099999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.5009999999999999,"5min":3.024,"15min":3.024},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0549999999999999,"15min":1.0589999999999999},"min":{"1min":0.70599999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.375,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Apr 18 05:01:39 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0960000000000001,"15min":1.077},"min":{"1min":0.92600000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.419,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.054,"5min":1.117,"15min":1.105},"min":{"1min":0.77400000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.339,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.238}]}]},{"osd":0,"up_from":15,"seq":64424509537,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78896,"kb_used_data":21544,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94292944,"statfs":{"total":96636764160,"available":96555974656,"internally_reserved":0,"allocated":22061056,"data_stored":54614568,"data_compressed":7565653,"data_compressed_allocated":10006528,"data_compressed_original":42741760,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65500000000000003,"15min":0.58899999999999997},"min":{"1min":0.497,"5min":0.22800000000000001,"15min":0.19900000000000001},"max":{"1min":0.91600000000000004,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.66700000000000004,"15min":0.70299999999999996},"min":{"1min":0.55800000000000005,"5min":0.23100000000000001,"15min":0.224},"max":{"1min":1.1140000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.753}]},{"osd":2,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73199999999999998,"15min":0.66700000000000004},"min":{"1min":0.58399999999999996,"5min":0.22,"15min":0.22},"max":{"1min":0.90000000000000002,"5min":2.629,"15min":2.629},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71499999999999997,"15min":0.65300000000000002},"min":{"1min":0.45000000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.96299999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.877}]},{"osd":3,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.61799999999999999},"min":{"1min":0.59799999999999998,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.98699999999999999,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.622},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.84599999999999997,"15min":0.754},"min":{"1min":0.64500000000000002,"5min":0.27900000000000003,"15min":0.27100000000000002},"max":{"1min":1.0469999999999999,"5min":3.375,"15min":3.375},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91600000000000004,"15min":0.91100000000000003},"min":{"1min":0.65800000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.099,"5min":2.601,"15min":2.601},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.95899999999999996,"15min":0.92800000000000005},"min":{"1min":0.80300000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.284,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.95699999999999996,"15min":0.91200000000000003},"min":{"1min":0.75,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.474,"5min":1.724,"15min":1.724},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.96799999999999997,"15min":0.94599999999999995},"min":{"1min":0.80300000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.155,"5min":2.734,"15min":2.734},"last":0.80500000000000005}]},{"osd":6,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0529999999999999,"15min":0.99099999999999999},"min":{"1min":0.81399999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3360000000000001,"5min":2.681,"15min":2.681},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.046,"5min":1.026,"15min":1.016},"min":{"1min":0.753,"5min":0.499,"15min":0.499},"max":{"1min":1.5629999999999999,"5min":2.008,"15min":2.008},"last":1.0629999999999999}]},{"osd":7,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.056,"15min":1.0309999999999999},"min":{"1min":0.878,"5min":0.53300000000000003,"15min":0.496},"max":{"1min":1.6379999999999999,"5min":2.069,"15min":2.069},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.0580000000000001,"15min":0.97999999999999998},"min":{"1min":0.872,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.232,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":0.96499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574944,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47916,"kb_used_data":8612,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94323924,"statfs":{"total":96636764160,"available":96587698176,"internally_reserved":0,"allocated":8818688,"data_stored":24681186,"data_compressed":3524620,"data_compressed_allocated":4517888,"data_compressed_original":20582400,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.76900000000000002,"15min":0.88},"min":{"1min":0.60999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1140000000000001,"5min":1.1579999999999999,"15min":1.3080000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76300000000000001,"15min":0.82699999999999996},"min":{"1min":0.63700000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.97699999999999998,"5min":1.264,"15min":1.264},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82799999999999996,"15min":0.871},"min":{"1min":0.58799999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.119,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.82899999999999996,"15min":0.86199999999999999},"min":{"1min":0.70399999999999996,"5min":0.318,"15min":0.318},"max":{"1min":1.1000000000000001,"5min":1.246,"15min":1.246},"last":0.88400000000000001}]},{"osd":2,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83499999999999996,"15min":0.85699999999999998},"min":{"1min":0.51700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1479999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.095},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.93799999999999994,"15min":0.96599999999999997},"min":{"1min":0.749,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2889999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.006,"15min":0.997},"min":{"1min":0.69499999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1990000000000001,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0720000000000001,"15min":1.0800000000000001},"min":{"1min":0.94699999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1839999999999999,"5min":3.6280000000000001,"15min":3.6280000000000001},"last":1.121}]},{"osd":5,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.93600000000000005,"15min":0.93300000000000005},"min":{"1min":0.60699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.228,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.046,"5min":1.0289999999999999,"15min":1.052},"min":{"1min":0.70899999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.026}]},{"osd":6,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.92700000000000005,"15min":0.995},"min":{"1min":0.65800000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.117,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.046,"15min":1.0549999999999999},"min":{"1min":0.75900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.633,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.0469999999999999}]},{"osd":7,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.1000000000000001,"15min":1.133},"min":{"1min":0.69299999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1319999999999999,"15min":1.143},"min":{"1min":0.90000000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.538,"5min":3.9910000000000001,"15min":3.9910000000000001},"last":1.135}]}]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":8536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":8740864,"data_stored":24679416,"data_compressed":3602361,"data_compressed_allocated":4526080,"data_compressed_original":20631552,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.621,"15min":0.56799999999999995},"min":{"1min":0.443,"5min":0.218,"15min":0.20000000000000001},"max":{"1min":1.1539999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.67500000000000004,"15min":0.70099999999999996},"min":{"1min":0.34699999999999998,"5min":0.193,"15min":0.193},"max":{"1min":1.069,"5min":1.2330000000000001,"15min":1.347},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70499999999999996,"15min":0.67500000000000004},"min":{"1min":0.44600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.96799999999999997,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70199999999999996,"15min":0.66900000000000004},"min":{"1min":0.41199999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.2270000000000001,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.39000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.103,"5min":1.224,"15min":1.29},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.69399999999999995,"15min":0.65100000000000002},"min":{"1min":0.498,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.94799999999999995,"15min":0.95399999999999996},"min":{"1min":0.60299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.2090000000000001,"5min":2.456,"15min":2.456},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.872,"15min":0.875},"min":{"1min":0.73299999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0800000000000001,"5min":1.454,"15min":1.6950000000000001},"last":1.0529999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.97899999999999998,"15min":0.94499999999999995},"min":{"1min":0.66400000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3049999999999999,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.024,"5min":0.96999999999999997,"15min":0.98699999999999999},"min":{"1min":0.85099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.331,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.0109999999999999}]},{"osd":6,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.93799999999999994,"15min":0.91500000000000004},"min":{"1min":0.65500000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2130000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.038,"15min":0.98299999999999998},"min":{"1min":0.67800000000000005,"5min":0.439,"15min":0.439},"max":{"1min":1.3720000000000001,"5min":3.391,"15min":3.391},"last":0.876}]},{"osd":7,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.02,"15min":1.0269999999999999},"min":{"1min":0.77400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.256,"5min":1.4259999999999999,"15min":1.4990000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.032,"5min":1.0129999999999999,"15min":0.97899999999999998},"min":{"1min":0.82999999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.276,"5min":1.748,"15min":1.748},"last":0.98099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21827584,"data_stored":54529566,"data_compressed":7565653,"data_compressed_allocated":10006528,"data_compressed_original":42741760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14823424,"data_stored":33555846,"data_compressed":4506038,"data_compressed_allocated":6111232,"data_compressed_original":24862720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8507392,"data_stored":24594414,"data_compressed":3602361,"data_compressed_allocated":4526080,"data_compressed_original":20631552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20271104,"data_stored":54529162,"data_compressed":7702565,"data_compressed_allocated":9973760,"data_compressed_original":44273664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8585216,"data_stored":24596184,"data_compressed":3524620,"data_compressed_allocated":4517888,"data_compressed_original":20582400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13299712,"data_stored":35012108,"data_compressed":4870843,"data_compressed_allocated":6311936,"data_compressed_original":28049408,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7704576,"data_stored":20974924,"data_compressed":3027129,"data_compressed_allocated":3776512,"data_compressed_original":17063936,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5578752,"data_stored":14040280,"data_compressed":1836351,"data_compressed_allocated":2379776,"data_compressed_original":10878976,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T05:02:21.126 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:02:21.126 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:02:21.126 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:02:21.126 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-18T04:54:40.767997+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=54, tm_sec=40, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=5, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T05:02:21.127 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T05:02:41.128 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T05:02:41.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.261+0000 7f02dc1e0640 1 Processor -- start 2024-04-18T05:02:41.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.261+0000 7f02dc1e0640 1 -- start start 2024-04-18T05:02:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02dc1e0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f02d40c60e0 0x7f02d414fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02dc1e0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f02d40701b0 0x7f02d4150090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02dc1e0640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d4159380 con 0x7f02d4070a40 2024-04-18T05:02:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02dc1e0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d415a1a0 con 0x7f02d40701b0 2024-04-18T05:02:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02dc1e0640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d4155ce0 con 0x7f02d40c60e0 2024-04-18T05:02:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02d977b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f02d4070a40 0x7f02d4156130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39508/0 (socket says 172.21.15.96:39508) 2024-04-18T05:02:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02d977b640 1 -- 172.21.15.96:0/719038771 learned_addr learned my addr 172.21.15.96:0/719038771 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:02:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02da77d640 1 --2- 172.21.15.96:0/719038771 >> v2:172.21.15.96:3300/0 conn(0x7f02d40701b0 0x7f02d4150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02d9f7c640 1 --2- 172.21.15.96:0/719038771 >> v2:172.21.15.139:3300/0 conn(0x7f02d40c60e0 0x7f02d414fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02da77d640 1 -- 172.21.15.96:0/719038771 >> v2:172.21.15.139:3300/0 conn(0x7f02d40c60e0 msgr2=0x7f02d414fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:02:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02da77d640 1 --2- 172.21.15.96:0/719038771 >> v2:172.21.15.139:3300/0 conn(0x7f02d40c60e0 0x7f02d414fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02da77d640 1 -- 172.21.15.96:0/719038771 >> v1:172.21.15.96:6789/0 conn(0x7f02d4070a40 legacy=0x7f02d4156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02da77d640 1 -- 172.21.15.96:0/719038771 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d4159620 con 0x7f02d40701b0 2024-04-18T05:02:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02da77d640 1 --2- 172.21.15.96:0/719038771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d40701b0 0x7f02d4150090 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f02d406e9f0 tx=0x7f02c401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540e65ccaa426f6e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02d8f7a640 1 -- 172.21.15.96:0/719038771 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40ab650 con 0x7f02d40701b0 2024-04-18T05:02:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02d8f7a640 1 -- 172.21.15.96:0/719038771 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c40ab7b0 con 0x7f02d40701b0 2024-04-18T05:02:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.265+0000 7f02d8f7a640 1 -- 172.21.15.96:0/719038771 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40abb40 con 0x7f02d40701b0 2024-04-18T05:02:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 -- 172.21.15.96:0/719038771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d40701b0 msgr2=0x7f02d4150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 --2- 172.21.15.96:0/719038771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d40701b0 0x7f02d4150090 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f02d406e9f0 tx=0x7f02c401c450 comp rx=0 tx=0).stop 2024-04-18T05:02:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 -- 172.21.15.96:0/719038771 shutdown_connections 2024-04-18T05:02:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 --2- 172.21.15.96:0/719038771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d40701b0 0x7f02d4150090 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 --2- 172.21.15.96:0/719038771 >> v2:172.21.15.139:3300/0 conn(0x7f02d40c60e0 0x7f02d414fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 -- 172.21.15.96:0/719038771 >> 172.21.15.96:0/719038771 conn(0x7f02d406c750 msgr2=0x7f02d40c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 -- 172.21.15.96:0/719038771 shutdown_connections 2024-04-18T05:02:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 -- 172.21.15.96:0/719038771 wait complete. 2024-04-18T05:02:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 Processor -- start 2024-04-18T05:02:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 -- start start 2024-04-18T05:02:41.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d40701b0 0x7f02d415e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02d40c60e0 0x7f02d40c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02d4143f50 0x7f02d40c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d415ecd0 con 0x7f02d40701b0 2024-04-18T05:02:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d4160290 con 0x7f02d4143f50 2024-04-18T05:02:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d40713b0 con 0x7f02d40c60e0 2024-04-18T05:02:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02d9f7c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d40701b0 0x7f02d415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02d9f7c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d40701b0 0x7f02d415e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44820/0 (socket says 172.21.15.96:44820) 2024-04-18T05:02:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02d9f7c640 1 -- 172.21.15.96:0/2489298740 learned_addr learned my addr 172.21.15.96:0/2489298740 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02da77d640 1 --2- 172.21.15.96:0/2489298740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02d4143f50 0x7f02d40c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02d977b640 1 --2- 172.21.15.96:0/2489298740 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02d40c60e0 0x7f02d40c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02d9f7c640 1 -- 172.21.15.96:0/2489298740 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02d40c60e0 msgr2=0x7f02d40c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02d9f7c640 1 --2- 172.21.15.96:0/2489298740 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02d40c60e0 0x7f02d40c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02d9f7c640 1 -- 172.21.15.96:0/2489298740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02d4143f50 msgr2=0x7f02d40c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02d9f7c640 1 --2- 172.21.15.96:0/2489298740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02d4143f50 0x7f02d40c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02d9f7c640 1 -- 172.21.15.96:0/2489298740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c4009420 con 0x7f02d40701b0 2024-04-18T05:02:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02d9f7c640 1 --2- 172.21.15.96:0/2489298740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d40701b0 0x7f02d415e790 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f02cc007e40 tx=0x7f02cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02d27fc640 1 -- 172.21.15.96:0/2489298740 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc014620 con 0x7f02d40701b0 2024-04-18T05:02:41.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02d27fc640 1 -- 172.21.15.96:0/2489298740 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc00ee90 con 0x7f02d40701b0 2024-04-18T05:02:41.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 -- 172.21.15.96:0/2489298740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d415fa10 con 0x7f02d40701b0 2024-04-18T05:02:41.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02d27fc640 1 -- 172.21.15.96:0/2489298740 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc0149c0 con 0x7f02d40701b0 2024-04-18T05:02:41.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.269+0000 7f02dc1e0640 1 -- 172.21.15.96:0/2489298740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d415ffb0 con 0x7f02d40701b0 2024-04-18T05:02:41.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.273+0000 7f02dc1e0640 1 -- 172.21.15.96:0/2489298740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d4067050 con 0x7f02d40701b0 2024-04-18T05:02:41.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.273+0000 7f02d27fc640 1 -- 172.21.15.96:0/2489298740 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f02cc014b20 con 0x7f02d40701b0 2024-04-18T05:02:41.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.273+0000 7f02d27fc640 1 --2- 172.21.15.96:0/2489298740 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02c00666c0 0x7f02c0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.273+0000 7f02d27fc640 1 -- 172.21.15.96:0/2489298740 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f02cc084aa0 con 0x7f02d40701b0 2024-04-18T05:02:41.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.273+0000 7f02d977b640 1 --2- 172.21.15.96:0/2489298740 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02c00666c0 0x7f02c0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:41.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.273+0000 7f02d977b640 1 --2- 172.21.15.96:0/2489298740 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02c00666c0 0x7f02c0068b80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f02d4140350 tx=0x7f02c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:41.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.277+0000 7f02d27fc640 1 -- 172.21.15.96:0/2489298740 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f02cc051df0 con 0x7f02d40701b0 2024-04-18T05:02:41.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.433+0000 7f02dc1e0640 1 -- 172.21.15.96:0/2489298740 --> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02d406e160 con 0x7f02c00666c0 2024-04-18T05:02:41.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.445+0000 7f02d27fc640 1 -- 172.21.15.96:0/2489298740 <== mgr.4104 v2:172.21.15.96:6832/27400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+292442 (secure 0 0 0) 0x7f02c8001380 con 0x7f02c00666c0 2024-04-18T05:02:41.447 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T05:02:41.449 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-18T05:02:41.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.449+0000 7f02dc1e0640 1 -- 172.21.15.96:0/2489298740 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02c00666c0 msgr2=0x7f02c0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.449+0000 7f02dc1e0640 1 --2- 172.21.15.96:0/2489298740 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02c00666c0 0x7f02c0068b80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f02d4140350 tx=0x7f02c8009040 comp rx=0 tx=0).stop 2024-04-18T05:02:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.449+0000 7f02dc1e0640 1 -- 172.21.15.96:0/2489298740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d40701b0 msgr2=0x7f02d415e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.449+0000 7f02dc1e0640 1 --2- 172.21.15.96:0/2489298740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d40701b0 0x7f02d415e790 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f02cc007e40 tx=0x7f02cc00e4b0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.449+0000 7f02dc1e0640 1 -- 172.21.15.96:0/2489298740 shutdown_connections 2024-04-18T05:02:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.449+0000 7f02dc1e0640 1 --2- 172.21.15.96:0/2489298740 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f02c00666c0 0x7f02c0068b80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.449+0000 7f02dc1e0640 1 --2- 172.21.15.96:0/2489298740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02d4143f50 0x7f02d40c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.449+0000 7f02dc1e0640 1 --2- 172.21.15.96:0/2489298740 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f02d40c60e0 0x7f02d40c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.449+0000 7f02dc1e0640 1 --2- 172.21.15.96:0/2489298740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d40701b0 0x7f02d415e790 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.449+0000 7f02dc1e0640 1 -- 172.21.15.96:0/2489298740 >> 172.21.15.96:0/2489298740 conn(0x7f02d406c750 msgr2=0x7f02d4158ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.449+0000 7f02dc1e0640 1 -- 172.21.15.96:0/2489298740 shutdown_connections 2024-04-18T05:02:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.449+0000 7f02dc1e0640 1 -- 172.21.15.96:0/2489298740 wait complete. 2024-04-18T05:02:41.466 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2024-04-18T05:02:40.735436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":131506610,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":2961,"num_read_kb":1326719,"num_write":31940,"num_write_kb":4643491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35573,"ondisk_log_size":35573,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":454048,"kb_used_data":100192,"kb_used_omap":12,"kb_used_meta":353779,"kb_avail":754520672,"statfs":{"total":773094113280,"available":772629168128,"internally_reserved":0,"allocated":102596608,"data_stored":263693236,"data_compressed":36701930,"data_compressed_allocated":47693824,"data_compressed_original":210231296,"omap_allocated":12744,"internal_metadata":362270264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004229"},"pg_stats":[{"pgid":"3.3f","version":"23'405","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:13.736610+0000","last_change":"2024-04-18T05:02:13.736813+0000","last_active":"2024-04-18T05:02:13.736610+0000","last_peered":"2024-04-18T05:02:13.736610+0000","last_clean":"2024-04-18T05:02:13.736610+0000","last_became_active":"2024-04-18T04:54:41.199046+0000","last_became_peered":"2024-04-18T04:54:41.199046+0000","last_unstale":"2024-04-18T05:02:13.736610+0000","last_undegraded":"2024-04-18T05:02:13.736610+0000","last_fullsized":"2024-04-18T05:02:13.736610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'405","last_scrub_stamp":"2024-04-18T05:02:13.736554+0000","last_deep_scrub":"23'405","last_deep_scrub_stamp":"2024-04-18T05:02:13.736554+0000","last_clean_scrub_stamp":"2024-04-18T05:02:13.736554+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:36:17.201989+0000","scrub_duration":0.0033959929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9249,"num_write":376,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"23'459","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:05.575351+0000","last_change":"2024-04-18T05:02:05.575562+0000","last_active":"2024-04-18T05:02:05.575351+0000","last_peered":"2024-04-18T05:02:05.575351+0000","last_clean":"2024-04-18T05:02:05.575351+0000","last_became_active":"2024-04-18T04:54:41.200136+0000","last_became_peered":"2024-04-18T04:54:41.200136+0000","last_unstale":"2024-04-18T05:02:05.575351+0000","last_undegraded":"2024-04-18T05:02:05.575351+0000","last_fullsized":"2024-04-18T05:02:05.575351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'459","last_scrub_stamp":"2024-04-18T05:02:05.575293+0000","last_deep_scrub":"23'459","last_deep_scrub_stamp":"2024-04-18T05:02:05.575293+0000","last_clean_scrub_stamp":"2024-04-18T05:02:05.575293+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:23:45.077012+0000","scrub_duration":0.0047782500000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12666,"num_write":430,"num_write_kb":97067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"23'410","reported_seq":467,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:50.724095+0000","last_change":"2024-04-18T05:01:50.724351+0000","last_active":"2024-04-18T05:01:50.724095+0000","last_peered":"2024-04-18T05:01:50.724095+0000","last_clean":"2024-04-18T05:01:50.724095+0000","last_became_active":"2024-04-18T04:54:41.185206+0000","last_became_peered":"2024-04-18T04:54:41.185206+0000","last_unstale":"2024-04-18T05:01:50.724095+0000","last_undegraded":"2024-04-18T05:01:50.724095+0000","last_fullsized":"2024-04-18T05:01:50.724095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'410","last_scrub_stamp":"2024-04-18T05:01:50.724024+0000","last_deep_scrub":"23'410","last_deep_scrub_stamp":"2024-04-18T05:01:50.724024+0000","last_clean_scrub_stamp":"2024-04-18T05:01:50.724024+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:53:51.231534+0000","scrub_duration":0.0043415509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":29819,"num_write":382,"num_write_kb":108666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"23'394","reported_seq":463,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:27.079767+0000","last_change":"2024-04-18T05:01:27.079963+0000","last_active":"2024-04-18T05:01:27.079767+0000","last_peered":"2024-04-18T05:01:27.079767+0000","last_clean":"2024-04-18T05:01:27.079767+0000","last_became_active":"2024-04-18T04:54:41.177217+0000","last_became_peered":"2024-04-18T04:54:41.177217+0000","last_unstale":"2024-04-18T05:01:27.079767+0000","last_undegraded":"2024-04-18T05:01:27.079767+0000","last_fullsized":"2024-04-18T05:01:27.079767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'394","last_scrub_stamp":"2024-04-18T05:01:27.079715+0000","last_deep_scrub":"23'394","last_deep_scrub_stamp":"2024-04-18T05:01:27.079715+0000","last_clean_scrub_stamp":"2024-04-18T05:01:27.079715+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:14.174781+0000","scrub_duration":0.0048719330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22571,"num_write":356,"num_write_kb":80073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"23'390","reported_seq":440,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:02.761197+0000","last_change":"2024-04-18T05:02:02.761197+0000","last_active":"2024-04-18T05:02:02.761197+0000","last_peered":"2024-04-18T05:02:02.761197+0000","last_clean":"2024-04-18T05:02:02.761197+0000","last_became_active":"2024-04-18T04:54:41.186027+0000","last_became_peered":"2024-04-18T04:54:41.186027+0000","last_unstale":"2024-04-18T05:02:02.761197+0000","last_undegraded":"2024-04-18T05:02:02.761197+0000","last_fullsized":"2024-04-18T05:02:02.761197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'390","last_scrub_stamp":"2024-04-18T05:02:02.760937+0000","last_deep_scrub":"23'390","last_deep_scrub_stamp":"2024-04-18T05:02:02.760937+0000","last_clean_scrub_stamp":"2024-04-18T05:02:02.760937+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:54:52.380397+0000","scrub_duration":0.0044406979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13089,"num_write":365,"num_write_kb":22615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"23'374","reported_seq":407,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:21.018847+0000","last_change":"2024-04-18T05:01:21.018847+0000","last_active":"2024-04-18T05:01:21.018847+0000","last_peered":"2024-04-18T05:01:21.018847+0000","last_clean":"2024-04-18T05:01:21.018847+0000","last_became_active":"2024-04-18T04:54:41.177215+0000","last_became_peered":"2024-04-18T04:54:41.177215+0000","last_unstale":"2024-04-18T05:01:21.018847+0000","last_undegraded":"2024-04-18T05:01:21.018847+0000","last_fullsized":"2024-04-18T05:01:21.018847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'374","last_scrub_stamp":"2024-04-18T05:01:21.018549+0000","last_deep_scrub":"23'374","last_deep_scrub_stamp":"2024-04-18T05:01:21.018549+0000","last_clean_scrub_stamp":"2024-04-18T05:01:21.018549+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:56:14.121491+0000","scrub_duration":0.0045796960000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":350,"num_write_kb":36922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"23'405","reported_seq":465,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:57.769173+0000","last_change":"2024-04-18T05:01:57.769173+0000","last_active":"2024-04-18T05:01:57.769173+0000","last_peered":"2024-04-18T05:01:57.769173+0000","last_clean":"2024-04-18T05:01:57.769173+0000","last_became_active":"2024-04-18T04:54:41.178094+0000","last_became_peered":"2024-04-18T04:54:41.178094+0000","last_unstale":"2024-04-18T05:01:57.769173+0000","last_undegraded":"2024-04-18T05:01:57.769173+0000","last_fullsized":"2024-04-18T05:01:57.769173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'405","last_scrub_stamp":"2024-04-18T05:01:57.768876+0000","last_deep_scrub":"23'405","last_deep_scrub_stamp":"2024-04-18T05:01:57.768876+0000","last_clean_scrub_stamp":"2024-04-18T05:01:57.768876+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:20:12.522956+0000","scrub_duration":0.0046398380000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20531,"num_write":378,"num_write_kb":59118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"23'401","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:45.657258+0000","last_change":"2024-04-18T05:01:45.657258+0000","last_active":"2024-04-18T05:01:45.657258+0000","last_peered":"2024-04-18T05:01:45.657258+0000","last_clean":"2024-04-18T05:01:45.657258+0000","last_became_active":"2024-04-18T04:54:41.192678+0000","last_became_peered":"2024-04-18T04:54:41.192678+0000","last_unstale":"2024-04-18T05:01:45.657258+0000","last_undegraded":"2024-04-18T05:01:45.657258+0000","last_fullsized":"2024-04-18T05:01:45.657258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'401","last_scrub_stamp":"2024-04-18T05:01:45.656995+0000","last_deep_scrub":"23'401","last_deep_scrub_stamp":"2024-04-18T05:01:45.656995+0000","last_clean_scrub_stamp":"2024-04-18T05:01:45.656995+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:48:24.009251+0000","scrub_duration":0.0050249880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13567,"num_write":364,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"23'436","reported_seq":510,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:32.714899+0000","last_change":"2024-04-18T05:01:32.714899+0000","last_active":"2024-04-18T05:01:32.714899+0000","last_peered":"2024-04-18T05:01:32.714899+0000","last_clean":"2024-04-18T05:01:32.714899+0000","last_became_active":"2024-04-18T04:54:41.197832+0000","last_became_peered":"2024-04-18T04:54:41.197832+0000","last_unstale":"2024-04-18T05:01:32.714899+0000","last_undegraded":"2024-04-18T05:01:32.714899+0000","last_fullsized":"2024-04-18T05:01:32.714899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'436","last_scrub_stamp":"2024-04-18T05:01:32.714644+0000","last_deep_scrub":"23'436","last_deep_scrub_stamp":"2024-04-18T05:01:32.714644+0000","last_clean_scrub_stamp":"2024-04-18T05:01:32.714644+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:15:48.913743+0000","scrub_duration":0.0041060510000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28521,"num_write":411,"num_write_kb":104022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"23'396","reported_seq":450,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:00.764660+0000","last_change":"2024-04-18T05:02:00.764805+0000","last_active":"2024-04-18T05:02:00.764660+0000","last_peered":"2024-04-18T05:02:00.764660+0000","last_clean":"2024-04-18T05:02:00.764660+0000","last_became_active":"2024-04-18T04:54:41.182698+0000","last_became_peered":"2024-04-18T04:54:41.182698+0000","last_unstale":"2024-04-18T05:02:00.764660+0000","last_undegraded":"2024-04-18T05:02:00.764660+0000","last_fullsized":"2024-04-18T05:02:00.764660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'396","last_scrub_stamp":"2024-04-18T05:02:00.764632+0000","last_deep_scrub":"23'396","last_deep_scrub_stamp":"2024-04-18T05:02:00.764632+0000","last_clean_scrub_stamp":"2024-04-18T05:02:00.764632+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:23:36.014680+0000","scrub_duration":0.002420752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13914,"num_write":350,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"23'379","reported_seq":440,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:51.699726+0000","last_change":"2024-04-18T05:01:51.699726+0000","last_active":"2024-04-18T05:01:51.699726+0000","last_peered":"2024-04-18T05:01:51.699726+0000","last_clean":"2024-04-18T05:01:51.699726+0000","last_became_active":"2024-04-18T04:54:41.187360+0000","last_became_peered":"2024-04-18T04:54:41.187360+0000","last_unstale":"2024-04-18T05:01:51.699726+0000","last_undegraded":"2024-04-18T05:01:51.699726+0000","last_fullsized":"2024-04-18T05:01:51.699726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'379","last_scrub_stamp":"2024-04-18T05:01:51.699340+0000","last_deep_scrub":"23'379","last_deep_scrub_stamp":"2024-04-18T05:01:51.699340+0000","last_clean_scrub_stamp":"2024-04-18T05:01:51.699340+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:41.327494+0000","scrub_duration":0.0040993219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18312,"num_write":357,"num_write_kb":34101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"23'361","reported_seq":423,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:48.631167+0000","last_change":"2024-04-18T05:01:48.631167+0000","last_active":"2024-04-18T05:01:48.631167+0000","last_peered":"2024-04-18T05:01:48.631167+0000","last_clean":"2024-04-18T05:01:48.631167+0000","last_became_active":"2024-04-18T04:54:41.188281+0000","last_became_peered":"2024-04-18T04:54:41.188281+0000","last_unstale":"2024-04-18T05:01:48.631167+0000","last_undegraded":"2024-04-18T05:01:48.631167+0000","last_fullsized":"2024-04-18T05:01:48.631167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'361","last_scrub_stamp":"2024-04-18T05:01:48.630905+0000","last_deep_scrub":"23'361","last_deep_scrub_stamp":"2024-04-18T05:01:48.630905+0000","last_clean_scrub_stamp":"2024-04-18T05:01:48.630905+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:53:49.138416+0000","scrub_duration":0.0044141709999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21304,"num_write":338,"num_write_kb":54980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"23'375","reported_seq":418,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:35.393048+0000","last_change":"2024-04-18T05:01:35.393048+0000","last_active":"2024-04-18T05:01:35.393048+0000","last_peered":"2024-04-18T05:01:35.393048+0000","last_clean":"2024-04-18T05:01:35.393048+0000","last_became_active":"2024-04-18T04:54:41.190882+0000","last_became_peered":"2024-04-18T04:54:41.190882+0000","last_unstale":"2024-04-18T05:01:35.393048+0000","last_undegraded":"2024-04-18T05:01:35.393048+0000","last_fullsized":"2024-04-18T05:01:35.393048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'375","last_scrub_stamp":"2024-04-18T05:01:35.392794+0000","last_deep_scrub":"23'375","last_deep_scrub_stamp":"2024-04-18T05:01:35.392794+0000","last_clean_scrub_stamp":"2024-04-18T05:01:35.392794+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:34.572335+0000","scrub_duration":0.004280786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7725,"num_write":337,"num_write_kb":21712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"23'417","reported_seq":503,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:38.345013+0000","last_change":"2024-04-18T05:01:38.345013+0000","last_active":"2024-04-18T05:01:38.345013+0000","last_peered":"2024-04-18T05:01:38.345013+0000","last_clean":"2024-04-18T05:01:38.345013+0000","last_became_active":"2024-04-18T04:54:41.189813+0000","last_became_peered":"2024-04-18T04:54:41.189813+0000","last_unstale":"2024-04-18T05:01:38.345013+0000","last_undegraded":"2024-04-18T05:01:38.345013+0000","last_fullsized":"2024-04-18T05:01:38.345013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'417","last_scrub_stamp":"2024-04-18T05:01:38.344763+0000","last_deep_scrub":"23'417","last_deep_scrub_stamp":"2024-04-18T05:01:38.344763+0000","last_clean_scrub_stamp":"2024-04-18T05:01:38.344763+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:28.744373+0000","scrub_duration":0.0043015240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":28320,"num_write":390,"num_write_kb":71764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"23'445","reported_seq":545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:57.613911+0000","last_change":"2024-04-18T05:01:57.614158+0000","last_active":"2024-04-18T05:01:57.613911+0000","last_peered":"2024-04-18T05:01:57.613911+0000","last_clean":"2024-04-18T05:01:57.613911+0000","last_became_active":"2024-04-18T04:54:41.182713+0000","last_became_peered":"2024-04-18T04:54:41.182713+0000","last_unstale":"2024-04-18T05:01:57.613911+0000","last_undegraded":"2024-04-18T05:01:57.613911+0000","last_fullsized":"2024-04-18T05:01:57.613911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'445","last_scrub_stamp":"2024-04-18T05:01:57.613856+0000","last_deep_scrub":"23'445","last_deep_scrub_stamp":"2024-04-18T05:01:57.613856+0000","last_clean_scrub_stamp":"2024-04-18T05:01:57.613856+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:20:12.367937+0000","scrub_duration":0.0045358839999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":36644,"num_write":412,"num_write_kb":104908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"23'442","reported_seq":520,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:27.873787+0000","last_change":"2024-04-18T05:02:27.873994+0000","last_active":"2024-04-18T05:02:27.873787+0000","last_peered":"2024-04-18T05:02:27.873787+0000","last_clean":"2024-04-18T05:02:27.873787+0000","last_became_active":"2024-04-18T04:54:41.185803+0000","last_became_peered":"2024-04-18T04:54:41.185803+0000","last_unstale":"2024-04-18T05:02:27.873787+0000","last_undegraded":"2024-04-18T05:02:27.873787+0000","last_fullsized":"2024-04-18T05:02:27.873787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'442","last_scrub_stamp":"2024-04-18T05:02:27.873731+0000","last_deep_scrub":"23'442","last_deep_scrub_stamp":"2024-04-18T05:02:27.873731+0000","last_clean_scrub_stamp":"2024-04-18T05:02:27.873731+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:15:59.657029+0000","scrub_duration":0.0041892839999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21979,"num_write":411,"num_write_kb":59643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"23'407","reported_seq":479,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:13.915250+0000","last_change":"2024-04-18T05:02:13.915450+0000","last_active":"2024-04-18T05:02:13.915250+0000","last_peered":"2024-04-18T05:02:13.915250+0000","last_clean":"2024-04-18T05:02:13.915250+0000","last_became_active":"2024-04-18T04:54:41.198404+0000","last_became_peered":"2024-04-18T04:54:41.198404+0000","last_unstale":"2024-04-18T05:02:13.915250+0000","last_undegraded":"2024-04-18T05:02:13.915250+0000","last_fullsized":"2024-04-18T05:02:13.915250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'407","last_scrub_stamp":"2024-04-18T05:02:13.915197+0000","last_deep_scrub":"23'407","last_deep_scrub_stamp":"2024-04-18T05:02:13.915197+0000","last_clean_scrub_stamp":"2024-04-18T05:02:13.915197+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:44:42.511153+0000","scrub_duration":0.0035698679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22314,"num_write":375,"num_write_kb":43056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"23'414","reported_seq":482,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:33.639544+0000","last_change":"2024-04-18T05:01:33.639544+0000","last_active":"2024-04-18T05:01:33.639544+0000","last_peered":"2024-04-18T05:01:33.639544+0000","last_clean":"2024-04-18T05:01:33.639544+0000","last_became_active":"2024-04-18T04:54:41.188139+0000","last_became_peered":"2024-04-18T04:54:41.188139+0000","last_unstale":"2024-04-18T05:01:33.639544+0000","last_undegraded":"2024-04-18T05:01:33.639544+0000","last_fullsized":"2024-04-18T05:01:33.639544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'414","last_scrub_stamp":"2024-04-18T05:01:33.639296+0000","last_deep_scrub":"23'414","last_deep_scrub_stamp":"2024-04-18T05:01:33.639296+0000","last_clean_scrub_stamp":"2024-04-18T05:01:33.639296+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:14.073131+0000","scrub_duration":0.0049131380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21874,"num_write":387,"num_write_kb":84204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"23'431","reported_seq":518,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:26.877319+0000","last_change":"2024-04-18T05:02:26.877516+0000","last_active":"2024-04-18T05:02:26.877319+0000","last_peered":"2024-04-18T05:02:26.877319+0000","last_clean":"2024-04-18T05:02:26.877319+0000","last_became_active":"2024-04-18T04:54:41.197235+0000","last_became_peered":"2024-04-18T04:54:41.197235+0000","last_unstale":"2024-04-18T05:02:26.877319+0000","last_undegraded":"2024-04-18T05:02:26.877319+0000","last_fullsized":"2024-04-18T05:02:26.877319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'431","last_scrub_stamp":"2024-04-18T05:02:26.877264+0000","last_deep_scrub":"23'431","last_deep_scrub_stamp":"2024-04-18T05:02:26.877264+0000","last_clean_scrub_stamp":"2024-04-18T05:02:26.877264+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:26:28.176689+0000","scrub_duration":0.0048392720000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40070,"num_write":398,"num_write_kb":116642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"23'437","reported_seq":521,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:43.519732+0000","last_change":"2024-04-18T05:01:43.519933+0000","last_active":"2024-04-18T05:01:43.519732+0000","last_peered":"2024-04-18T05:01:43.519732+0000","last_clean":"2024-04-18T05:01:43.519732+0000","last_became_active":"2024-04-18T04:54:41.187925+0000","last_became_peered":"2024-04-18T04:54:41.187925+0000","last_unstale":"2024-04-18T05:01:43.519732+0000","last_undegraded":"2024-04-18T05:01:43.519732+0000","last_fullsized":"2024-04-18T05:01:43.519732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'437","last_scrub_stamp":"2024-04-18T05:01:43.519674+0000","last_deep_scrub":"23'437","last_deep_scrub_stamp":"2024-04-18T05:01:43.519674+0000","last_clean_scrub_stamp":"2024-04-18T05:01:43.519674+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:48:21.871930+0000","scrub_duration":0.0043357480000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27418,"num_write":411,"num_write_kb":67043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"23'413","reported_seq":501,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:55.416423+0000","last_change":"2024-04-18T05:01:55.416626+0000","last_active":"2024-04-18T05:01:55.416423+0000","last_peered":"2024-04-18T05:01:55.416423+0000","last_clean":"2024-04-18T05:01:55.416423+0000","last_became_active":"2024-04-18T04:54:41.178963+0000","last_became_peered":"2024-04-18T04:54:41.178963+0000","last_unstale":"2024-04-18T05:01:55.416423+0000","last_undegraded":"2024-04-18T05:01:55.416423+0000","last_fullsized":"2024-04-18T05:01:55.416423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'413","last_scrub_stamp":"2024-04-18T05:01:55.416370+0000","last_deep_scrub":"23'413","last_deep_scrub_stamp":"2024-04-18T05:01:55.416370+0000","last_clean_scrub_stamp":"2024-04-18T05:01:55.416370+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:48.998915+0000","scrub_duration":0.0043298499999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32437,"num_write":394,"num_write_kb":88243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"23'442","reported_seq":525,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:35.675375+0000","last_change":"2024-04-18T05:01:35.675569+0000","last_active":"2024-04-18T05:01:35.675375+0000","last_peered":"2024-04-18T05:01:35.675375+0000","last_clean":"2024-04-18T05:01:35.675375+0000","last_became_active":"2024-04-18T04:54:41.182664+0000","last_became_peered":"2024-04-18T04:54:41.182664+0000","last_unstale":"2024-04-18T05:01:35.675375+0000","last_undegraded":"2024-04-18T05:01:35.675375+0000","last_fullsized":"2024-04-18T05:01:35.675375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'442","last_scrub_stamp":"2024-04-18T05:01:35.675317+0000","last_deep_scrub":"23'442","last_deep_scrub_stamp":"2024-04-18T05:01:35.675317+0000","last_clean_scrub_stamp":"2024-04-18T05:01:35.675317+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:54.644731+0000","scrub_duration":0.0049721519999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34086,"num_write":411,"num_write_kb":96499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"23'434","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:30.563054+0000","last_change":"2024-04-18T05:01:30.563054+0000","last_active":"2024-04-18T05:01:30.563054+0000","last_peered":"2024-04-18T05:01:30.563054+0000","last_clean":"2024-04-18T05:01:30.563054+0000","last_became_active":"2024-04-18T04:54:41.186881+0000","last_became_peered":"2024-04-18T04:54:41.186881+0000","last_unstale":"2024-04-18T05:01:30.563054+0000","last_undegraded":"2024-04-18T05:01:30.563054+0000","last_fullsized":"2024-04-18T05:01:30.563054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'434","last_scrub_stamp":"2024-04-18T05:01:30.562793+0000","last_deep_scrub":"23'434","last_deep_scrub_stamp":"2024-04-18T05:01:30.562793+0000","last_clean_scrub_stamp":"2024-04-18T05:01:30.562793+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:30.270048+0000","scrub_duration":0.0049938550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":24295,"num_write":395,"num_write_kb":96064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"23'465","reported_seq":595,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:22.913309+0000","last_change":"2024-04-18T05:02:22.913522+0000","last_active":"2024-04-18T05:02:22.913309+0000","last_peered":"2024-04-18T05:02:22.913309+0000","last_clean":"2024-04-18T05:02:22.913309+0000","last_became_active":"2024-04-18T04:54:41.192740+0000","last_became_peered":"2024-04-18T04:54:41.192740+0000","last_unstale":"2024-04-18T05:02:22.913309+0000","last_undegraded":"2024-04-18T05:02:22.913309+0000","last_fullsized":"2024-04-18T05:02:22.913309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'465","last_scrub_stamp":"2024-04-18T05:02:22.913254+0000","last_deep_scrub":"23'465","last_deep_scrub_stamp":"2024-04-18T05:02:22.913254+0000","last_clean_scrub_stamp":"2024-04-18T05:02:22.913254+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:42:05.990843+0000","scrub_duration":0.0047448960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":61562,"num_write":441,"num_write_kb":100539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"23'390","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:56.650555+0000","last_change":"2024-04-18T05:01:56.650773+0000","last_active":"2024-04-18T05:01:56.650555+0000","last_peered":"2024-04-18T05:01:56.650555+0000","last_clean":"2024-04-18T05:01:56.650555+0000","last_became_active":"2024-04-18T04:54:41.192280+0000","last_became_peered":"2024-04-18T04:54:41.192280+0000","last_unstale":"2024-04-18T05:01:56.650555+0000","last_undegraded":"2024-04-18T05:01:56.650555+0000","last_fullsized":"2024-04-18T05:01:56.650555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'390","last_scrub_stamp":"2024-04-18T05:01:56.650502+0000","last_deep_scrub":"23'390","last_deep_scrub_stamp":"2024-04-18T05:01:56.650502+0000","last_clean_scrub_stamp":"2024-04-18T05:01:56.650502+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:38:48.995886+0000","scrub_duration":0.0046352370000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18903,"num_write":377,"num_write_kb":34298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"23'490","reported_seq":571,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:43.793817+0000","last_change":"2024-04-18T05:01:43.794083+0000","last_active":"2024-04-18T05:01:43.793817+0000","last_peered":"2024-04-18T05:01:43.793817+0000","last_clean":"2024-04-18T05:01:43.793817+0000","last_became_active":"2024-04-18T04:54:41.193660+0000","last_became_peered":"2024-04-18T04:54:41.193660+0000","last_unstale":"2024-04-18T05:01:43.793817+0000","last_undegraded":"2024-04-18T05:01:43.793817+0000","last_fullsized":"2024-04-18T05:01:43.793817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'490","last_scrub_stamp":"2024-04-18T05:01:43.793766+0000","last_deep_scrub":"23'490","last_deep_scrub_stamp":"2024-04-18T05:01:43.793766+0000","last_clean_scrub_stamp":"2024-04-18T05:01:43.793766+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:17:38.481739+0000","scrub_duration":0.0042736730000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26760,"num_write":458,"num_write_kb":125465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"23'432","reported_seq":538,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:33.361713+0000","last_change":"2024-04-18T05:01:33.361955+0000","last_active":"2024-04-18T05:01:33.361713+0000","last_peered":"2024-04-18T05:01:33.361713+0000","last_clean":"2024-04-18T05:01:33.361713+0000","last_became_active":"2024-04-18T04:54:41.189374+0000","last_became_peered":"2024-04-18T04:54:41.189374+0000","last_unstale":"2024-04-18T05:01:33.361713+0000","last_undegraded":"2024-04-18T05:01:33.361713+0000","last_fullsized":"2024-04-18T05:01:33.361713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'432","last_scrub_stamp":"2024-04-18T05:01:33.361660+0000","last_deep_scrub":"23'432","last_deep_scrub_stamp":"2024-04-18T05:01:33.361660+0000","last_clean_scrub_stamp":"2024-04-18T05:01:33.361660+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:13.795496+0000","scrub_duration":0.0046135539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43719,"num_write":406,"num_write_kb":145399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"23'384","reported_seq":450,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:51.384588+0000","last_change":"2024-04-18T05:01:51.384823+0000","last_active":"2024-04-18T05:01:51.384588+0000","last_peered":"2024-04-18T05:01:51.384588+0000","last_clean":"2024-04-18T05:01:51.384588+0000","last_became_active":"2024-04-18T04:54:41.189660+0000","last_became_peered":"2024-04-18T04:54:41.189660+0000","last_unstale":"2024-04-18T05:01:51.384588+0000","last_undegraded":"2024-04-18T05:01:51.384588+0000","last_fullsized":"2024-04-18T05:01:51.384588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'384","last_scrub_stamp":"2024-04-18T05:01:51.384537+0000","last_deep_scrub":"23'384","last_deep_scrub_stamp":"2024-04-18T05:01:51.384537+0000","last_clean_scrub_stamp":"2024-04-18T05:01:51.384537+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:53:14.493798+0000","scrub_duration":0.0048499229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17737,"num_write":357,"num_write_kb":75727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"23'427","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:42.668726+0000","last_change":"2024-04-18T05:01:42.668920+0000","last_active":"2024-04-18T05:01:42.668726+0000","last_peered":"2024-04-18T05:01:42.668726+0000","last_clean":"2024-04-18T05:01:42.668726+0000","last_became_active":"2024-04-18T04:54:41.186901+0000","last_became_peered":"2024-04-18T04:54:41.186901+0000","last_unstale":"2024-04-18T05:01:42.668726+0000","last_undegraded":"2024-04-18T05:01:42.668726+0000","last_fullsized":"2024-04-18T05:01:42.668726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'427","last_scrub_stamp":"2024-04-18T05:01:42.668666+0000","last_deep_scrub":"23'427","last_deep_scrub_stamp":"2024-04-18T05:01:42.668666+0000","last_clean_scrub_stamp":"2024-04-18T05:01:42.668666+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:53:05.777927+0000","scrub_duration":0.0040391580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30499,"num_write":394,"num_write_kb":84601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"23'468","reported_seq":522,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:11.912063+0000","last_change":"2024-04-18T05:02:11.912258+0000","last_active":"2024-04-18T05:02:11.912063+0000","last_peered":"2024-04-18T05:02:11.912063+0000","last_clean":"2024-04-18T05:02:11.912063+0000","last_became_active":"2024-04-18T04:54:41.192114+0000","last_became_peered":"2024-04-18T04:54:41.192114+0000","last_unstale":"2024-04-18T05:02:11.912063+0000","last_undegraded":"2024-04-18T05:02:11.912063+0000","last_fullsized":"2024-04-18T05:02:11.912063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'468","last_scrub_stamp":"2024-04-18T05:02:11.912007+0000","last_deep_scrub":"23'468","last_deep_scrub_stamp":"2024-04-18T05:02:11.912007+0000","last_clean_scrub_stamp":"2024-04-18T05:02:11.912007+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:51:42.395879+0000","scrub_duration":0.0047051630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13784,"num_write":434,"num_write_kb":79847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"23'421","reported_seq":483,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.616261+0000","last_change":"2024-04-18T05:01:31.616457+0000","last_active":"2024-04-18T05:01:31.616261+0000","last_peered":"2024-04-18T05:01:31.616261+0000","last_clean":"2024-04-18T05:01:31.616261+0000","last_became_active":"2024-04-18T04:54:41.185915+0000","last_became_peered":"2024-04-18T04:54:41.185915+0000","last_unstale":"2024-04-18T05:01:31.616261+0000","last_undegraded":"2024-04-18T05:01:31.616261+0000","last_fullsized":"2024-04-18T05:01:31.616261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'421","last_scrub_stamp":"2024-04-18T05:01:31.616202+0000","last_deep_scrub":"23'421","last_deep_scrub_stamp":"2024-04-18T05:01:31.616202+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.616202+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:15:47.815302+0000","scrub_duration":0.0045383150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":22283,"num_write":389,"num_write_kb":42482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"23'415","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:23.083892+0000","last_change":"2024-04-18T05:01:23.084088+0000","last_active":"2024-04-18T05:01:23.083892+0000","last_peered":"2024-04-18T05:01:23.083892+0000","last_clean":"2024-04-18T05:01:23.083892+0000","last_became_active":"2024-04-18T04:54:41.189892+0000","last_became_peered":"2024-04-18T04:54:41.189892+0000","last_unstale":"2024-04-18T05:01:23.083892+0000","last_undegraded":"2024-04-18T05:01:23.083892+0000","last_fullsized":"2024-04-18T05:01:23.083892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'415","last_scrub_stamp":"2024-04-18T05:01:23.083840+0000","last_deep_scrub":"23'415","last_deep_scrub_stamp":"2024-04-18T05:01:23.083840+0000","last_clean_scrub_stamp":"2024-04-18T05:01:23.083840+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:21:47.363582+0000","scrub_duration":0.0047136449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36029,"num_write":387,"num_write_kb":59223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'420","reported_seq":492,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:28.771175+0000","last_change":"2024-04-18T05:01:28.771175+0000","last_active":"2024-04-18T05:01:28.771175+0000","last_peered":"2024-04-18T05:01:28.771175+0000","last_clean":"2024-04-18T05:01:28.771175+0000","last_became_active":"2024-04-18T04:54:41.187001+0000","last_became_peered":"2024-04-18T04:54:41.187001+0000","last_unstale":"2024-04-18T05:01:28.771175+0000","last_undegraded":"2024-04-18T05:01:28.771175+0000","last_fullsized":"2024-04-18T05:01:28.771175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'420","last_scrub_stamp":"2024-04-18T05:01:28.770902+0000","last_deep_scrub":"23'420","last_deep_scrub_stamp":"2024-04-18T05:01:28.770902+0000","last_clean_scrub_stamp":"2024-04-18T05:01:28.770902+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:27.362071+0000","scrub_duration":0.0043507140000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19127,"num_write":391,"num_write_kb":83892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'99","reported_seq":126,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:19.609510+0000","last_change":"2024-04-18T05:01:19.609510+0000","last_active":"2024-04-18T05:01:19.609510+0000","last_peered":"2024-04-18T05:01:19.609510+0000","last_clean":"2024-04-18T05:01:19.609510+0000","last_became_active":"2024-04-18T04:54:40.823652+0000","last_became_peered":"2024-04-18T04:54:40.823652+0000","last_unstale":"2024-04-18T05:01:19.609510+0000","last_undegraded":"2024-04-18T05:01:19.609510+0000","last_fullsized":"2024-04-18T05:01:19.609510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'99","last_scrub_stamp":"2024-04-18T05:01:19.609240+0000","last_deep_scrub":"23'99","last_deep_scrub_stamp":"2024-04-18T05:01:19.609240+0000","last_clean_scrub_stamp":"2024-04-18T05:01:19.609240+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:35.184621+0000","scrub_duration":0.024247222999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195462,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"23'366","reported_seq":415,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:41.393627+0000","last_change":"2024-04-18T05:01:41.393627+0000","last_active":"2024-04-18T05:01:41.393627+0000","last_peered":"2024-04-18T05:01:41.393627+0000","last_clean":"2024-04-18T05:01:41.393627+0000","last_became_active":"2024-04-18T04:55:39.827671+0000","last_became_peered":"2024-04-18T04:55:39.827671+0000","last_unstale":"2024-04-18T05:01:41.393627+0000","last_undegraded":"2024-04-18T05:01:41.393627+0000","last_fullsized":"2024-04-18T05:01:41.393627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'366","last_scrub_stamp":"2024-04-18T05:01:41.393359+0000","last_deep_scrub":"23'366","last_deep_scrub_stamp":"2024-04-18T05:01:41.393359+0000","last_clean_scrub_stamp":"2024-04-18T05:01:41.393359+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:34.095101+0000","scrub_duration":0.0035216790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13158,"num_write":336,"num_write_kb":38014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'545","reported_seq":572,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:51.751142+0000","last_change":"2024-04-18T05:01:51.751142+0000","last_active":"2024-04-18T05:01:51.751142+0000","last_peered":"2024-04-18T05:01:51.751142+0000","last_clean":"2024-04-18T05:01:51.751142+0000","last_became_active":"2024-04-18T04:54:40.802672+0000","last_became_peered":"2024-04-18T04:54:40.802672+0000","last_unstale":"2024-04-18T05:01:51.751142+0000","last_undegraded":"2024-04-18T05:01:51.751142+0000","last_fullsized":"2024-04-18T05:01:51.751142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'545","last_scrub_stamp":"2024-04-18T05:01:51.750880+0000","last_deep_scrub":"23'545","last_deep_scrub_stamp":"2024-04-18T05:01:51.750880+0000","last_clean_scrub_stamp":"2024-04-18T05:01:51.750880+0000","objects_scrubbed":6,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:20:06.504961+0000","scrub_duration":0.069336696000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":487,"num_write_kb":12578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'418","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:25.397489+0000","last_change":"2024-04-18T05:01:25.397489+0000","last_active":"2024-04-18T05:01:25.397489+0000","last_peered":"2024-04-18T05:01:25.397489+0000","last_clean":"2024-04-18T05:01:25.397489+0000","last_became_active":"2024-04-18T04:54:40.823091+0000","last_became_peered":"2024-04-18T04:54:40.823091+0000","last_unstale":"2024-04-18T05:01:25.397489+0000","last_undegraded":"2024-04-18T05:01:25.397489+0000","last_fullsized":"2024-04-18T05:01:25.397489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'418","last_scrub_stamp":"2024-04-18T05:01:25.397241+0000","last_deep_scrub":"23'418","last_deep_scrub_stamp":"2024-04-18T05:01:25.397241+0000","last_clean_scrub_stamp":"2024-04-18T05:01:25.397241+0000","objects_scrubbed":3,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:03.755258+0000","scrub_duration":0.029980849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":4340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"23'429","reported_seq":470,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:27.513575+0000","last_change":"2024-04-18T05:01:27.513575+0000","last_active":"2024-04-18T05:01:27.513575+0000","last_peered":"2024-04-18T05:01:27.513575+0000","last_clean":"2024-04-18T05:01:27.513575+0000","last_became_active":"2024-04-18T04:54:41.199690+0000","last_became_peered":"2024-04-18T04:54:41.199690+0000","last_unstale":"2024-04-18T05:01:27.513575+0000","last_undegraded":"2024-04-18T05:01:27.513575+0000","last_fullsized":"2024-04-18T05:01:27.513575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'429","last_scrub_stamp":"2024-04-18T05:01:27.513299+0000","last_deep_scrub":"23'429","last_deep_scrub_stamp":"2024-04-18T05:01:27.513299+0000","last_clean_scrub_stamp":"2024-04-18T05:01:27.513299+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:26.692839+0000","scrub_duration":0.0049636610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5535,"num_write":391,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'957","reported_seq":984,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:59.798017+0000","last_change":"2024-04-18T05:01:59.798211+0000","last_active":"2024-04-18T05:01:59.798017+0000","last_peered":"2024-04-18T05:01:59.798017+0000","last_clean":"2024-04-18T05:01:59.798017+0000","last_became_active":"2024-04-18T04:54:40.804605+0000","last_became_peered":"2024-04-18T04:54:40.804605+0000","last_unstale":"2024-04-18T05:01:59.798017+0000","last_undegraded":"2024-04-18T05:01:59.798017+0000","last_fullsized":"2024-04-18T05:01:59.798017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'957","last_scrub_stamp":"2024-04-18T05:01:59.797967+0000","last_deep_scrub":"23'957","last_deep_scrub_stamp":"2024-04-18T05:01:59.797967+0000","last_clean_scrub_stamp":"2024-04-18T05:01:59.797967+0000","objects_scrubbed":3,"log_size":957,"log_dups_size":0,"ondisk_log_size":957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:23:39.299687+0000","scrub_duration":0.060311403999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":8668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"23'422","reported_seq":482,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:43.413146+0000","last_change":"2024-04-18T05:01:43.413146+0000","last_active":"2024-04-18T05:01:43.413146+0000","last_peered":"2024-04-18T05:01:43.413146+0000","last_clean":"2024-04-18T05:01:43.413146+0000","last_became_active":"2024-04-18T04:54:41.175137+0000","last_became_peered":"2024-04-18T04:54:41.175137+0000","last_unstale":"2024-04-18T05:01:43.413146+0000","last_undegraded":"2024-04-18T05:01:43.413146+0000","last_fullsized":"2024-04-18T05:01:43.413146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'422","last_scrub_stamp":"2024-04-18T05:01:43.412900+0000","last_deep_scrub":"23'422","last_deep_scrub_stamp":"2024-04-18T05:01:43.412900+0000","last_clean_scrub_stamp":"2024-04-18T05:01:43.412900+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:33.009995+0000","scrub_duration":0.0045663049999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":21971,"num_write":395,"num_write_kb":63063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'68","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:20.781219+0000","last_change":"2024-04-18T05:01:20.781219+0000","last_active":"2024-04-18T05:01:20.781219+0000","last_peered":"2024-04-18T05:01:20.781219+0000","last_clean":"2024-04-18T05:01:20.781219+0000","last_became_active":"2024-04-18T04:54:40.798572+0000","last_became_peered":"2024-04-18T04:54:40.798572+0000","last_unstale":"2024-04-18T05:01:20.781219+0000","last_undegraded":"2024-04-18T05:01:20.781219+0000","last_fullsized":"2024-04-18T05:01:20.781219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'68","last_scrub_stamp":"2024-04-18T05:01:20.780948+0000","last_deep_scrub":"23'68","last_deep_scrub_stamp":"2024-04-18T05:01:20.780948+0000","last_clean_scrub_stamp":"2024-04-18T05:01:20.780948+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:46:12.946774+0000","scrub_duration":0.0073987970000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'432","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:39.772765+0000","last_change":"2024-04-18T05:01:39.772765+0000","last_active":"2024-04-18T05:01:39.772765+0000","last_peered":"2024-04-18T05:01:39.772765+0000","last_clean":"2024-04-18T05:01:39.772765+0000","last_became_active":"2024-04-18T04:54:41.188012+0000","last_became_peered":"2024-04-18T04:54:41.188012+0000","last_unstale":"2024-04-18T05:01:39.772765+0000","last_undegraded":"2024-04-18T05:01:39.772765+0000","last_fullsized":"2024-04-18T05:01:39.772765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'432","last_scrub_stamp":"2024-04-18T05:01:39.772470+0000","last_deep_scrub":"23'432","last_deep_scrub_stamp":"2024-04-18T05:01:39.772470+0000","last_clean_scrub_stamp":"2024-04-18T05:01:39.772470+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:46:53.031529+0000","scrub_duration":0.004148026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13773,"num_write":397,"num_write_kb":43173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'337","reported_seq":365,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:25.419761+0000","last_change":"2024-04-18T05:01:25.419761+0000","last_active":"2024-04-18T05:01:25.419761+0000","last_peered":"2024-04-18T05:01:25.419761+0000","last_clean":"2024-04-18T05:01:25.419761+0000","last_became_active":"2024-04-18T04:54:40.801406+0000","last_became_peered":"2024-04-18T04:54:40.801406+0000","last_unstale":"2024-04-18T05:01:25.419761+0000","last_undegraded":"2024-04-18T05:01:25.419761+0000","last_fullsized":"2024-04-18T05:01:25.419761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'337","last_scrub_stamp":"2024-04-18T05:01:25.419503+0000","last_deep_scrub":"23'337","last_deep_scrub_stamp":"2024-04-18T05:01:25.419503+0000","last_clean_scrub_stamp":"2024-04-18T05:01:25.419503+0000","objects_scrubbed":3,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:24.599044+0000","scrub_duration":0.029230335,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"23'397","reported_seq":445,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:43.621015+0000","last_change":"2024-04-18T05:01:43.621015+0000","last_active":"2024-04-18T05:01:43.621015+0000","last_peered":"2024-04-18T05:01:43.621015+0000","last_clean":"2024-04-18T05:01:43.621015+0000","last_became_active":"2024-04-18T04:54:41.203186+0000","last_became_peered":"2024-04-18T04:54:41.203186+0000","last_unstale":"2024-04-18T05:01:43.621015+0000","last_undegraded":"2024-04-18T05:01:43.621015+0000","last_fullsized":"2024-04-18T05:01:43.621015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'397","last_scrub_stamp":"2024-04-18T05:01:43.620765+0000","last_deep_scrub":"23'397","last_deep_scrub_stamp":"2024-04-18T05:01:43.620765+0000","last_clean_scrub_stamp":"2024-04-18T05:01:43.620765+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:38:05.909566+0000","scrub_duration":0.0040642860000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14488,"num_write":364,"num_write_kb":75349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'192","reported_seq":220,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:26.537619+0000","last_change":"2024-04-18T05:01:26.537619+0000","last_active":"2024-04-18T05:01:26.537619+0000","last_peered":"2024-04-18T05:01:26.537619+0000","last_clean":"2024-04-18T05:01:26.537619+0000","last_became_active":"2024-04-18T04:54:40.820920+0000","last_became_peered":"2024-04-18T04:54:40.820920+0000","last_unstale":"2024-04-18T05:01:26.537619+0000","last_undegraded":"2024-04-18T05:01:26.537619+0000","last_fullsized":"2024-04-18T05:01:26.537619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'192","last_scrub_stamp":"2024-04-18T05:01:26.537313+0000","last_deep_scrub":"23'192","last_deep_scrub_stamp":"2024-04-18T05:01:26.537313+0000","last_clean_scrub_stamp":"2024-04-18T05:01:26.537313+0000","objects_scrubbed":4,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:25.128483+0000","scrub_duration":0.010104568,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"23'394","reported_seq":456,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:21.960960+0000","last_change":"2024-04-18T05:02:21.961219+0000","last_active":"2024-04-18T05:02:21.960960+0000","last_peered":"2024-04-18T05:02:21.960960+0000","last_clean":"2024-04-18T05:02:21.960960+0000","last_became_active":"2024-04-18T04:54:41.196927+0000","last_became_peered":"2024-04-18T04:54:41.196927+0000","last_unstale":"2024-04-18T05:02:21.960960+0000","last_undegraded":"2024-04-18T05:02:21.960960+0000","last_fullsized":"2024-04-18T05:02:21.960960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'394","last_scrub_stamp":"2024-04-18T05:02:21.960905+0000","last_deep_scrub":"23'394","last_deep_scrub_stamp":"2024-04-18T05:02:21.960905+0000","last_clean_scrub_stamp":"2024-04-18T05:02:21.960905+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:12:28.147098+0000","scrub_duration":0.0046870710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":21129,"num_write":360,"num_write_kb":71528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'450","reported_seq":478,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:18.091612+0000","last_change":"2024-04-18T05:01:18.091612+0000","last_active":"2024-04-18T05:01:18.091612+0000","last_peered":"2024-04-18T05:01:18.091612+0000","last_clean":"2024-04-18T05:01:18.091612+0000","last_became_active":"2024-04-18T04:54:40.801403+0000","last_became_peered":"2024-04-18T04:54:40.801403+0000","last_unstale":"2024-04-18T05:01:18.091612+0000","last_undegraded":"2024-04-18T05:01:18.091612+0000","last_fullsized":"2024-04-18T05:01:18.091612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'450","last_scrub_stamp":"2024-04-18T05:01:18.091496+0000","last_deep_scrub":"23'450","last_deep_scrub_stamp":"2024-04-18T05:01:18.091496+0000","last_clean_scrub_stamp":"2024-04-18T05:01:18.091496+0000","objects_scrubbed":8,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:59:33.756145+0000","scrub_duration":0.055952107000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12011434,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":11980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'396","reported_seq":466,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:40.449445+0000","last_change":"2024-04-18T05:01:40.449445+0000","last_active":"2024-04-18T05:01:40.449445+0000","last_peered":"2024-04-18T05:01:40.449445+0000","last_clean":"2024-04-18T05:01:40.449445+0000","last_became_active":"2024-04-18T04:54:41.195172+0000","last_became_peered":"2024-04-18T04:54:41.195172+0000","last_unstale":"2024-04-18T05:01:40.449445+0000","last_undegraded":"2024-04-18T05:01:40.449445+0000","last_fullsized":"2024-04-18T05:01:40.449445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'396","last_scrub_stamp":"2024-04-18T05:01:40.449334+0000","last_deep_scrub":"23'396","last_deep_scrub_stamp":"2024-04-18T05:01:40.449334+0000","last_clean_scrub_stamp":"2024-04-18T05:01:40.449334+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:53:03.558595+0000","scrub_duration":0.0033727589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19873,"num_write":365,"num_write_kb":71837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'591","reported_seq":619,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:25.610689+0000","last_change":"2024-04-18T05:01:25.610689+0000","last_active":"2024-04-18T05:01:25.610689+0000","last_peered":"2024-04-18T05:01:25.610689+0000","last_clean":"2024-04-18T05:01:25.610689+0000","last_became_active":"2024-04-18T04:54:40.817681+0000","last_became_peered":"2024-04-18T04:54:40.817681+0000","last_unstale":"2024-04-18T05:01:25.610689+0000","last_undegraded":"2024-04-18T05:01:25.610689+0000","last_fullsized":"2024-04-18T05:01:25.610689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'591","last_scrub_stamp":"2024-04-18T05:01:25.610406+0000","last_deep_scrub":"23'591","last_deep_scrub_stamp":"2024-04-18T05:01:25.610406+0000","last_clean_scrub_stamp":"2024-04-18T05:01:25.610406+0000","objects_scrubbed":8,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:03.968423+0000","scrub_duration":0.057537295000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":8472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"23'417","reported_seq":456,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:37.391009+0000","last_change":"2024-04-18T05:01:37.391009+0000","last_active":"2024-04-18T05:01:37.391009+0000","last_peered":"2024-04-18T05:01:37.391009+0000","last_clean":"2024-04-18T05:01:37.391009+0000","last_became_active":"2024-04-18T04:54:41.194499+0000","last_became_peered":"2024-04-18T04:54:41.194499+0000","last_unstale":"2024-04-18T05:01:37.391009+0000","last_undegraded":"2024-04-18T05:01:37.391009+0000","last_fullsized":"2024-04-18T05:01:37.391009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'417","last_scrub_stamp":"2024-04-18T05:01:37.390763+0000","last_deep_scrub":"23'417","last_deep_scrub_stamp":"2024-04-18T05:01:37.390763+0000","last_clean_scrub_stamp":"2024-04-18T05:01:37.390763+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:37.098019+0000","scrub_duration":0.0056180969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":380,"num_write_kb":59449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"23'73","reported_seq":100,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:50.683587+0000","last_change":"2024-04-18T05:01:50.683793+0000","last_active":"2024-04-18T05:01:50.683587+0000","last_peered":"2024-04-18T05:01:50.683587+0000","last_clean":"2024-04-18T05:01:50.683587+0000","last_became_active":"2024-04-18T04:54:40.817370+0000","last_became_peered":"2024-04-18T04:54:40.817370+0000","last_unstale":"2024-04-18T05:01:50.683587+0000","last_undegraded":"2024-04-18T05:01:50.683587+0000","last_fullsized":"2024-04-18T05:01:50.683587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'73","last_scrub_stamp":"2024-04-18T05:01:50.683535+0000","last_deep_scrub":"23'73","last_deep_scrub_stamp":"2024-04-18T05:01:50.683535+0000","last_clean_scrub_stamp":"2024-04-18T05:01:50.683535+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:38:43.028919+0000","scrub_duration":0.0083098029999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'400","reported_seq":485,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:06.776389+0000","last_change":"2024-04-18T05:02:06.776657+0000","last_active":"2024-04-18T05:02:06.776389+0000","last_peered":"2024-04-18T05:02:06.776389+0000","last_clean":"2024-04-18T05:02:06.776389+0000","last_became_active":"2024-04-18T04:54:41.192889+0000","last_became_peered":"2024-04-18T04:54:41.192889+0000","last_unstale":"2024-04-18T05:02:06.776389+0000","last_undegraded":"2024-04-18T05:02:06.776389+0000","last_fullsized":"2024-04-18T05:02:06.776389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'400","last_scrub_stamp":"2024-04-18T05:02:06.776338+0000","last_deep_scrub":"23'400","last_deep_scrub_stamp":"2024-04-18T05:02:06.776338+0000","last_clean_scrub_stamp":"2024-04-18T05:02:06.776338+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:40.216063+0000","scrub_duration":0.004129326,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30891,"num_write":363,"num_write_kb":81664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"23'69","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:24.423007+0000","last_change":"2024-04-18T05:01:24.423007+0000","last_active":"2024-04-18T05:01:24.423007+0000","last_peered":"2024-04-18T05:01:24.423007+0000","last_clean":"2024-04-18T05:01:24.423007+0000","last_became_active":"2024-04-18T04:54:40.805965+0000","last_became_peered":"2024-04-18T04:54:40.805965+0000","last_unstale":"2024-04-18T05:01:24.423007+0000","last_undegraded":"2024-04-18T05:01:24.423007+0000","last_fullsized":"2024-04-18T05:01:24.423007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'69","last_scrub_stamp":"2024-04-18T05:01:24.422705+0000","last_deep_scrub":"23'69","last_deep_scrub_stamp":"2024-04-18T05:01:24.422705+0000","last_clean_scrub_stamp":"2024-04-18T05:01:24.422705+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:43.392120+0000","scrub_duration":0.0070178870000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1124,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'449","reported_seq":508,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:29.817094+0000","last_change":"2024-04-18T05:01:29.817094+0000","last_active":"2024-04-18T05:01:29.817094+0000","last_peered":"2024-04-18T05:01:29.817094+0000","last_clean":"2024-04-18T05:01:29.817094+0000","last_became_active":"2024-04-18T04:54:41.183838+0000","last_became_peered":"2024-04-18T04:54:41.183838+0000","last_unstale":"2024-04-18T05:01:29.817094+0000","last_undegraded":"2024-04-18T05:01:29.817094+0000","last_fullsized":"2024-04-18T05:01:29.817094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'449","last_scrub_stamp":"2024-04-18T05:01:29.816853+0000","last_deep_scrub":"23'449","last_deep_scrub_stamp":"2024-04-18T05:01:29.816853+0000","last_clean_scrub_stamp":"2024-04-18T05:01:29.816853+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:45.392233+0000","scrub_duration":0.0047717139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14210,"num_write":423,"num_write_kb":80124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'88","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.337778+0000","last_change":"2024-04-18T05:01:31.337778+0000","last_active":"2024-04-18T05:01:31.337778+0000","last_peered":"2024-04-18T05:01:31.337778+0000","last_clean":"2024-04-18T05:01:31.337778+0000","last_became_active":"2024-04-18T04:54:40.818227+0000","last_became_peered":"2024-04-18T04:54:40.818227+0000","last_unstale":"2024-04-18T05:01:31.337778+0000","last_undegraded":"2024-04-18T05:01:31.337778+0000","last_fullsized":"2024-04-18T05:01:31.337778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'88","last_scrub_stamp":"2024-04-18T05:01:31.337486+0000","last_deep_scrub":"23'88","last_deep_scrub_stamp":"2024-04-18T05:01:31.337486+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.337486+0000","objects_scrubbed":8,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:25.180421+0000","scrub_duration":0.014728473000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"23'493","reported_seq":566,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:02:01.809408+0000","last_change":"2024-04-18T05:02:01.809610+0000","last_active":"2024-04-18T05:02:01.809408+0000","last_peered":"2024-04-18T05:02:01.809408+0000","last_clean":"2024-04-18T05:02:01.809408+0000","last_became_active":"2024-04-18T04:54:41.187002+0000","last_became_peered":"2024-04-18T04:54:41.187002+0000","last_unstale":"2024-04-18T05:02:01.809408+0000","last_undegraded":"2024-04-18T05:02:01.809408+0000","last_fullsized":"2024-04-18T05:02:01.809408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'493","last_scrub_stamp":"2024-04-18T05:02:01.809357+0000","last_deep_scrub":"23'493","last_deep_scrub_stamp":"2024-04-18T05:02:01.809357+0000","last_clean_scrub_stamp":"2024-04-18T05:02:01.809357+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:32:56.562180+0000","scrub_duration":0.0042665050000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":24156,"num_write":458,"num_write_kb":105037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'202","reported_seq":230,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:23.442118+0000","last_change":"2024-04-18T05:01:23.442118+0000","last_active":"2024-04-18T05:01:23.442118+0000","last_peered":"2024-04-18T05:01:23.442118+0000","last_clean":"2024-04-18T05:01:23.442118+0000","last_became_active":"2024-04-18T04:54:40.802550+0000","last_became_peered":"2024-04-18T04:54:40.802550+0000","last_unstale":"2024-04-18T05:01:23.442118+0000","last_undegraded":"2024-04-18T05:01:23.442118+0000","last_fullsized":"2024-04-18T05:01:23.442118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'202","last_scrub_stamp":"2024-04-18T05:01:23.441698+0000","last_deep_scrub":"23'202","last_deep_scrub_stamp":"2024-04-18T05:01:23.441698+0000","last_clean_scrub_stamp":"2024-04-18T05:01:23.441698+0000","objects_scrubbed":3,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:03.875533+0000","scrub_duration":0.030187757999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'364","reported_seq":416,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:38.816814+0000","last_change":"2024-04-18T05:01:38.817049+0000","last_active":"2024-04-18T05:01:38.816814+0000","last_peered":"2024-04-18T05:01:38.816814+0000","last_clean":"2024-04-18T05:01:38.816814+0000","last_became_active":"2024-04-18T04:54:41.179540+0000","last_became_peered":"2024-04-18T04:54:41.179540+0000","last_unstale":"2024-04-18T05:01:38.816814+0000","last_undegraded":"2024-04-18T05:01:38.816814+0000","last_fullsized":"2024-04-18T05:01:38.816814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'364","last_scrub_stamp":"2024-04-18T05:01:38.816760+0000","last_deep_scrub":"23'364","last_deep_scrub_stamp":"2024-04-18T05:01:38.816760+0000","last_clean_scrub_stamp":"2024-04-18T05:01:38.816760+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:26:27.796056+0000","scrub_duration":0.0043171520000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16384,"num_write":332,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'307","reported_seq":335,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:37.408810+0000","last_change":"2024-04-18T05:01:37.409008+0000","last_active":"2024-04-18T05:01:37.408810+0000","last_peered":"2024-04-18T05:01:37.408810+0000","last_clean":"2024-04-18T05:01:37.408810+0000","last_became_active":"2024-04-18T04:54:40.803464+0000","last_became_peered":"2024-04-18T04:54:40.803464+0000","last_unstale":"2024-04-18T05:01:37.408810+0000","last_undegraded":"2024-04-18T05:01:37.408810+0000","last_fullsized":"2024-04-18T05:01:37.408810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'307","last_scrub_stamp":"2024-04-18T05:01:37.408757+0000","last_deep_scrub":"23'307","last_deep_scrub_stamp":"2024-04-18T05:01:37.408757+0000","last_clean_scrub_stamp":"2024-04-18T05:01:37.408757+0000","objects_scrubbed":3,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:46:50.667816+0000","scrub_duration":0.032088881999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"23'391","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:17.446894+0000","last_change":"2024-04-18T05:01:17.446894+0000","last_active":"2024-04-18T05:01:17.446894+0000","last_peered":"2024-04-18T05:01:17.446894+0000","last_clean":"2024-04-18T05:01:17.446894+0000","last_became_active":"2024-04-18T04:54:41.188152+0000","last_became_peered":"2024-04-18T04:54:41.188152+0000","last_unstale":"2024-04-18T05:01:17.446894+0000","last_undegraded":"2024-04-18T05:01:17.446894+0000","last_fullsized":"2024-04-18T05:01:17.446894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'391","last_scrub_stamp":"2024-04-18T05:01:17.446736+0000","last_deep_scrub":"23'391","last_deep_scrub_stamp":"2024-04-18T05:01:17.446736+0000","last_clean_scrub_stamp":"2024-04-18T05:01:17.446736+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:33.022117+0000","scrub_duration":0.0029989399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15853,"num_write":356,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'537","reported_seq":564,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:26.569521+0000","last_change":"2024-04-18T05:01:26.569720+0000","last_active":"2024-04-18T05:01:26.569521+0000","last_peered":"2024-04-18T05:01:26.569521+0000","last_clean":"2024-04-18T05:01:26.569521+0000","last_became_active":"2024-04-18T04:54:40.814207+0000","last_became_peered":"2024-04-18T04:54:40.814207+0000","last_unstale":"2024-04-18T05:01:26.569521+0000","last_undegraded":"2024-04-18T05:01:26.569521+0000","last_fullsized":"2024-04-18T05:01:26.569521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'537","last_scrub_stamp":"2024-04-18T05:01:26.569462+0000","last_deep_scrub":"23'537","last_deep_scrub_stamp":"2024-04-18T05:01:26.569462+0000","last_clean_scrub_stamp":"2024-04-18T05:01:26.569462+0000","objects_scrubbed":2,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:45.538877+0000","scrub_duration":0.037341881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"23'425","reported_seq":481,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:41.446915+0000","last_change":"2024-04-18T05:01:41.447107+0000","last_active":"2024-04-18T05:01:41.446915+0000","last_peered":"2024-04-18T05:01:41.446915+0000","last_clean":"2024-04-18T05:01:41.446915+0000","last_became_active":"2024-04-18T04:54:41.188249+0000","last_became_peered":"2024-04-18T04:54:41.188249+0000","last_unstale":"2024-04-18T05:01:41.446915+0000","last_undegraded":"2024-04-18T05:01:41.446915+0000","last_fullsized":"2024-04-18T05:01:41.446915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'425","last_scrub_stamp":"2024-04-18T05:01:41.446862+0000","last_deep_scrub":"23'425","last_deep_scrub_stamp":"2024-04-18T05:01:41.446862+0000","last_clean_scrub_stamp":"2024-04-18T05:01:41.446862+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:38:03.735663+0000","scrub_duration":0.0048573399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14420,"num_write":396,"num_write_kb":51045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'78","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:27.370536+0000","last_change":"2024-04-18T05:01:27.370727+0000","last_active":"2024-04-18T05:01:27.370536+0000","last_peered":"2024-04-18T05:01:27.370536+0000","last_clean":"2024-04-18T05:01:27.370536+0000","last_became_active":"2024-04-18T04:54:40.823755+0000","last_became_peered":"2024-04-18T04:54:40.823755+0000","last_unstale":"2024-04-18T05:01:27.370536+0000","last_undegraded":"2024-04-18T05:01:27.370536+0000","last_fullsized":"2024-04-18T05:01:27.370536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'78","last_scrub_stamp":"2024-04-18T05:01:27.370484+0000","last_deep_scrub":"23'78","last_deep_scrub_stamp":"2024-04-18T05:01:27.370484+0000","last_clean_scrub_stamp":"2024-04-18T05:01:27.370484+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:42.945865+0000","scrub_duration":0.0074384159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1706,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'402","reported_seq":447,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:20.557186+0000","last_change":"2024-04-18T05:01:20.557186+0000","last_active":"2024-04-18T05:01:20.557186+0000","last_peered":"2024-04-18T05:01:20.557186+0000","last_clean":"2024-04-18T05:01:20.557186+0000","last_became_active":"2024-04-18T04:54:41.186149+0000","last_became_peered":"2024-04-18T04:54:41.186149+0000","last_unstale":"2024-04-18T05:01:20.557186+0000","last_undegraded":"2024-04-18T05:01:20.557186+0000","last_fullsized":"2024-04-18T05:01:20.557186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'402","last_scrub_stamp":"2024-04-18T05:01:20.556880+0000","last_deep_scrub":"23'402","last_deep_scrub_stamp":"2024-04-18T05:01:20.556880+0000","last_clean_scrub_stamp":"2024-04-18T05:01:20.556880+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:19.736421+0000","scrub_duration":0.0048536480000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7713,"num_write":373,"num_write_kb":46594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'119","reported_seq":184,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:19.749081+0000","last_change":"2024-04-18T05:01:19.749081+0000","last_active":"2024-04-18T05:01:19.749081+0000","last_peered":"2024-04-18T05:01:19.749081+0000","last_clean":"2024-04-18T05:01:19.749081+0000","last_became_active":"2024-04-18T04:54:35.672457+0000","last_became_peered":"2024-04-18T04:54:35.672457+0000","last_unstale":"2024-04-18T05:01:19.749081+0000","last_undegraded":"2024-04-18T05:01:19.749081+0000","last_fullsized":"2024-04-18T05:01:19.749081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2024-04-18T05:01:19.748977+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2024-04-18T05:01:19.748977+0000","last_clean_scrub_stamp":"2024-04-18T05:01:19.748977+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:50.211326+0000","scrub_duration":0.0077953190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'76","reported_seq":103,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:48.714990+0000","last_change":"2024-04-18T05:01:48.715205+0000","last_active":"2024-04-18T05:01:48.714990+0000","last_peered":"2024-04-18T05:01:48.714990+0000","last_clean":"2024-04-18T05:01:48.714990+0000","last_became_active":"2024-04-18T04:54:40.801083+0000","last_became_peered":"2024-04-18T04:54:40.801083+0000","last_unstale":"2024-04-18T05:01:48.714990+0000","last_undegraded":"2024-04-18T05:01:48.714990+0000","last_fullsized":"2024-04-18T05:01:48.714990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'76","last_scrub_stamp":"2024-04-18T05:01:48.714929+0000","last_deep_scrub":"23'76","last_deep_scrub_stamp":"2024-04-18T05:01:48.714929+0000","last_clean_scrub_stamp":"2024-04-18T05:01:48.714929+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:38.343083+0000","scrub_duration":0.010243756999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'362","reported_seq":394,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:48.470235+0000","last_change":"2024-04-18T05:01:48.470434+0000","last_active":"2024-04-18T05:01:48.470235+0000","last_peered":"2024-04-18T05:01:48.470235+0000","last_clean":"2024-04-18T05:01:48.470235+0000","last_became_active":"2024-04-18T04:54:41.174391+0000","last_became_peered":"2024-04-18T04:54:41.174391+0000","last_unstale":"2024-04-18T05:01:48.470235+0000","last_undegraded":"2024-04-18T05:01:48.470235+0000","last_fullsized":"2024-04-18T05:01:48.470235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'362","last_scrub_stamp":"2024-04-18T05:01:48.470181+0000","last_deep_scrub":"23'362","last_deep_scrub_stamp":"2024-04-18T05:01:48.470181+0000","last_clean_scrub_stamp":"2024-04-18T05:01:48.470181+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:46:21.613642+0000","scrub_duration":0.0045936149999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1626,"num_write":331,"num_write_kb":26059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'441","reported_seq":469,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:39.753052+0000","last_change":"2024-04-18T05:01:39.753052+0000","last_active":"2024-04-18T05:01:39.753052+0000","last_peered":"2024-04-18T05:01:39.753052+0000","last_clean":"2024-04-18T05:01:39.753052+0000","last_became_active":"2024-04-18T04:54:40.813396+0000","last_became_peered":"2024-04-18T04:54:40.813396+0000","last_unstale":"2024-04-18T05:01:39.753052+0000","last_undegraded":"2024-04-18T05:01:39.753052+0000","last_fullsized":"2024-04-18T05:01:39.753052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'441","last_scrub_stamp":"2024-04-18T05:01:39.752799+0000","last_deep_scrub":"23'441","last_deep_scrub_stamp":"2024-04-18T05:01:39.752799+0000","last_clean_scrub_stamp":"2024-04-18T05:01:39.752799+0000","objects_scrubbed":3,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:48:18.105055+0000","scrub_duration":0.041934091999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":379,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'410","reported_seq":535,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.439531+0000","last_change":"2024-04-18T05:01:31.439720+0000","last_active":"2024-04-18T05:01:31.439531+0000","last_peered":"2024-04-18T05:01:31.439531+0000","last_clean":"2024-04-18T05:01:31.439531+0000","last_became_active":"2024-04-18T04:54:41.195152+0000","last_became_peered":"2024-04-18T04:54:41.195152+0000","last_unstale":"2024-04-18T05:01:31.439531+0000","last_undegraded":"2024-04-18T05:01:31.439531+0000","last_fullsized":"2024-04-18T05:01:31.439531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'410","last_scrub_stamp":"2024-04-18T05:01:31.439482+0000","last_deep_scrub":"23'410","last_deep_scrub_stamp":"2024-04-18T05:01:31.439482+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.439482+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:15:47.638581+0000","scrub_duration":0.0047366739999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":54989,"num_write":377,"num_write_kb":85155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'434","reported_seq":813,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:27.556454+0000","last_change":"2024-04-18T05:01:27.556643+0000","last_active":"2024-04-18T05:01:27.556454+0000","last_peered":"2024-04-18T05:01:27.556454+0000","last_clean":"2024-04-18T05:01:27.556454+0000","last_became_active":"2024-04-18T04:54:40.818113+0000","last_became_peered":"2024-04-18T04:54:40.818113+0000","last_unstale":"2024-04-18T05:01:27.556454+0000","last_undegraded":"2024-04-18T05:01:27.556454+0000","last_fullsized":"2024-04-18T05:01:27.556454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'434","last_scrub_stamp":"2024-04-18T05:01:27.556398+0000","last_deep_scrub":"23'434","last_deep_scrub_stamp":"2024-04-18T05:01:27.556398+0000","last_clean_scrub_stamp":"2024-04-18T05:01:27.556398+0000","objects_scrubbed":4,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:43.131779+0000","scrub_duration":0.020609295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1456426,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":351,"num_read_kb":1645,"num_write":371,"num_write_kb":1672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'416","reported_seq":446,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:33.488170+0000","last_change":"2024-04-18T05:01:33.488378+0000","last_active":"2024-04-18T05:01:33.488170+0000","last_peered":"2024-04-18T05:01:33.488170+0000","last_clean":"2024-04-18T05:01:33.488170+0000","last_became_active":"2024-04-18T04:54:41.192187+0000","last_became_peered":"2024-04-18T04:54:41.192187+0000","last_unstale":"2024-04-18T05:01:33.488170+0000","last_undegraded":"2024-04-18T05:01:33.488170+0000","last_fullsized":"2024-04-18T05:01:33.488170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'416","last_scrub_stamp":"2024-04-18T05:01:33.488116+0000","last_deep_scrub":"23'416","last_deep_scrub_stamp":"2024-04-18T05:01:33.488116+0000","last_clean_scrub_stamp":"2024-04-18T05:01:33.488116+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:35.745366+0000","scrub_duration":0.0041304510000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":364,"num_write":388,"num_write_kb":58777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'521","reported_seq":548,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:44.763490+0000","last_change":"2024-04-18T05:01:44.763693+0000","last_active":"2024-04-18T05:01:44.763490+0000","last_peered":"2024-04-18T05:01:44.763490+0000","last_clean":"2024-04-18T05:01:44.763490+0000","last_became_active":"2024-04-18T04:54:40.820025+0000","last_became_peered":"2024-04-18T04:54:40.820025+0000","last_unstale":"2024-04-18T05:01:44.763490+0000","last_undegraded":"2024-04-18T05:01:44.763490+0000","last_fullsized":"2024-04-18T05:01:44.763490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'521","last_scrub_stamp":"2024-04-18T05:01:44.763432+0000","last_deep_scrub":"23'521","last_deep_scrub_stamp":"2024-04-18T05:01:44.763432+0000","last_clean_scrub_stamp":"2024-04-18T05:01:44.763432+0000","objects_scrubbed":4,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:53:45.270943+0000","scrub_duration":0.044834888000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389148,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":8474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'404","reported_seq":464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.502932+0000","last_change":"2024-04-18T05:01:31.503151+0000","last_active":"2024-04-18T05:01:31.502932+0000","last_peered":"2024-04-18T05:01:31.502932+0000","last_clean":"2024-04-18T05:01:31.502932+0000","last_became_active":"2024-04-18T04:54:41.185257+0000","last_became_peered":"2024-04-18T04:54:41.185257+0000","last_unstale":"2024-04-18T05:01:31.502932+0000","last_undegraded":"2024-04-18T05:01:31.502932+0000","last_fullsized":"2024-04-18T05:01:31.502932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'404","last_scrub_stamp":"2024-04-18T05:01:31.502875+0000","last_deep_scrub":"23'404","last_deep_scrub_stamp":"2024-04-18T05:01:31.502875+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.502875+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:33.760126+0000","scrub_duration":0.0037300290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14216,"num_write":374,"num_write_kb":63531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'63","reported_seq":90,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:22.504178+0000","last_change":"2024-04-18T05:01:22.504434+0000","last_active":"2024-04-18T05:01:22.504178+0000","last_peered":"2024-04-18T05:01:22.504178+0000","last_clean":"2024-04-18T05:01:22.504178+0000","last_became_active":"2024-04-18T04:54:40.824206+0000","last_became_peered":"2024-04-18T04:54:40.824206+0000","last_unstale":"2024-04-18T05:01:22.504178+0000","last_undegraded":"2024-04-18T05:01:22.504178+0000","last_fullsized":"2024-04-18T05:01:22.504178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'63","last_scrub_stamp":"2024-04-18T05:01:22.504121+0000","last_deep_scrub":"23'63","last_deep_scrub_stamp":"2024-04-18T05:01:22.504121+0000","last_clean_scrub_stamp":"2024-04-18T05:01:22.504121+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:27:09.070973+0000","scrub_duration":0.003666192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'433","reported_seq":543,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:33.947094+0000","last_change":"2024-04-18T05:01:33.947327+0000","last_active":"2024-04-18T05:01:33.947094+0000","last_peered":"2024-04-18T05:01:33.947094+0000","last_clean":"2024-04-18T05:01:33.947094+0000","last_became_active":"2024-04-18T04:54:41.195177+0000","last_became_peered":"2024-04-18T04:54:41.195177+0000","last_unstale":"2024-04-18T05:01:33.947094+0000","last_undegraded":"2024-04-18T05:01:33.947094+0000","last_fullsized":"2024-04-18T05:01:33.947094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'433","last_scrub_stamp":"2024-04-18T05:01:33.947042+0000","last_deep_scrub":"23'433","last_deep_scrub_stamp":"2024-04-18T05:01:33.947042+0000","last_clean_scrub_stamp":"2024-04-18T05:01:33.947042+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:58:27.789977+0000","scrub_duration":0.0045580300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":41457,"num_write":394,"num_write_kb":79356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'332","reported_seq":359,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:35.699806+0000","last_change":"2024-04-18T05:01:35.700010+0000","last_active":"2024-04-18T05:01:35.699806+0000","last_peered":"2024-04-18T05:01:35.699806+0000","last_clean":"2024-04-18T05:01:35.699806+0000","last_became_active":"2024-04-18T04:54:40.802902+0000","last_became_peered":"2024-04-18T04:54:40.802902+0000","last_unstale":"2024-04-18T05:01:35.699806+0000","last_undegraded":"2024-04-18T05:01:35.699806+0000","last_fullsized":"2024-04-18T05:01:35.699806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'332","last_scrub_stamp":"2024-04-18T05:01:35.699755+0000","last_deep_scrub":"23'332","last_deep_scrub_stamp":"2024-04-18T05:01:35.699755+0000","last_clean_scrub_stamp":"2024-04-18T05:01:35.699755+0000","objects_scrubbed":4,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:43:09.664036+0000","scrub_duration":0.029626237999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'423","reported_seq":521,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:34.360195+0000","last_change":"2024-04-18T05:01:34.360390+0000","last_active":"2024-04-18T05:01:34.360195+0000","last_peered":"2024-04-18T05:01:34.360195+0000","last_clean":"2024-04-18T05:01:34.360195+0000","last_became_active":"2024-04-18T04:54:41.194965+0000","last_became_peered":"2024-04-18T04:54:41.194965+0000","last_unstale":"2024-04-18T05:01:34.360195+0000","last_undegraded":"2024-04-18T05:01:34.360195+0000","last_fullsized":"2024-04-18T05:01:34.360195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'423","last_scrub_stamp":"2024-04-18T05:01:34.360133+0000","last_deep_scrub":"23'423","last_deep_scrub_stamp":"2024-04-18T05:01:34.360133+0000","last_clean_scrub_stamp":"2024-04-18T05:01:34.360133+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:53.329547+0000","scrub_duration":0.0042417540000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32152,"num_write":386,"num_write_kb":121188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'120","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:23.448961+0000","last_change":"2024-04-18T05:01:23.449160+0000","last_active":"2024-04-18T05:01:23.448961+0000","last_peered":"2024-04-18T05:01:23.448961+0000","last_clean":"2024-04-18T05:01:23.448961+0000","last_became_active":"2024-04-18T04:54:40.798574+0000","last_became_peered":"2024-04-18T04:54:40.798574+0000","last_unstale":"2024-04-18T05:01:23.448961+0000","last_undegraded":"2024-04-18T05:01:23.448961+0000","last_fullsized":"2024-04-18T05:01:23.448961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'120","last_scrub_stamp":"2024-04-18T05:01:23.448909+0000","last_deep_scrub":"23'120","last_deep_scrub_stamp":"2024-04-18T05:01:23.448909+0000","last_clean_scrub_stamp":"2024-04-18T05:01:23.448909+0000","objects_scrubbed":4,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:02:10.543975+0000","scrub_duration":0.027642872999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'326","reported_seq":354,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:47.472228+0000","last_change":"2024-04-18T05:01:47.472434+0000","last_active":"2024-04-18T05:01:47.472228+0000","last_peered":"2024-04-18T05:01:47.472228+0000","last_clean":"2024-04-18T05:01:47.472228+0000","last_became_active":"2024-04-18T04:54:41.191124+0000","last_became_peered":"2024-04-18T04:54:41.191124+0000","last_unstale":"2024-04-18T05:01:47.472228+0000","last_undegraded":"2024-04-18T05:01:47.472228+0000","last_fullsized":"2024-04-18T05:01:47.472228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'326","last_scrub_stamp":"2024-04-18T05:01:47.472175+0000","last_deep_scrub":"23'326","last_deep_scrub_stamp":"2024-04-18T05:01:47.472175+0000","last_clean_scrub_stamp":"2024-04-18T05:01:47.472175+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:15:35.494374+0000","scrub_duration":0.003370414,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":298,"num_write_kb":17144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'84","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:36.679923+0000","last_change":"2024-04-18T05:01:36.680144+0000","last_active":"2024-04-18T05:01:36.679923+0000","last_peered":"2024-04-18T05:01:36.679923+0000","last_clean":"2024-04-18T05:01:36.679923+0000","last_became_active":"2024-04-18T04:54:40.803616+0000","last_became_peered":"2024-04-18T04:54:40.803616+0000","last_unstale":"2024-04-18T05:01:36.679923+0000","last_undegraded":"2024-04-18T05:01:36.679923+0000","last_fullsized":"2024-04-18T05:01:36.679923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'84","last_scrub_stamp":"2024-04-18T05:01:36.679867+0000","last_deep_scrub":"23'84","last_deep_scrub_stamp":"2024-04-18T05:01:36.679867+0000","last_clean_scrub_stamp":"2024-04-18T05:01:36.679867+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:24:19.383527+0000","scrub_duration":0.008721632,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'465","reported_seq":524,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:53.408745+0000","last_change":"2024-04-18T05:01:53.408953+0000","last_active":"2024-04-18T05:01:53.408745+0000","last_peered":"2024-04-18T05:01:53.408745+0000","last_clean":"2024-04-18T05:01:53.408745+0000","last_became_active":"2024-04-18T04:54:41.185217+0000","last_became_peered":"2024-04-18T04:54:41.185217+0000","last_unstale":"2024-04-18T05:01:53.408745+0000","last_undegraded":"2024-04-18T05:01:53.408745+0000","last_fullsized":"2024-04-18T05:01:53.408745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'465","last_scrub_stamp":"2024-04-18T05:01:53.408690+0000","last_deep_scrub":"23'465","last_deep_scrub_stamp":"2024-04-18T05:01:53.408690+0000","last_clean_scrub_stamp":"2024-04-18T05:01:53.408690+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:52:02.665415+0000","scrub_duration":0.0043601559999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8956,"num_write":434,"num_write_kb":97052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'603","reported_seq":631,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:20.459084+0000","last_change":"2024-04-18T05:01:20.459297+0000","last_active":"2024-04-18T05:01:20.459084+0000","last_peered":"2024-04-18T05:01:20.459084+0000","last_clean":"2024-04-18T05:01:20.459084+0000","last_became_active":"2024-04-18T04:54:40.800598+0000","last_became_peered":"2024-04-18T04:54:40.800598+0000","last_unstale":"2024-04-18T05:01:20.459084+0000","last_undegraded":"2024-04-18T05:01:20.459084+0000","last_fullsized":"2024-04-18T05:01:20.459084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'603","last_scrub_stamp":"2024-04-18T05:01:20.459029+0000","last_deep_scrub":"23'603","last_deep_scrub_stamp":"2024-04-18T05:01:20.459029+0000","last_clean_scrub_stamp":"2024-04-18T05:01:20.459029+0000","objects_scrubbed":2,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:27:07.025881+0000","scrub_duration":0.035046730999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":546,"num_write_kb":4388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'458","reported_seq":516,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:23.654905+0000","last_change":"2024-04-18T05:01:23.655141+0000","last_active":"2024-04-18T05:01:23.654905+0000","last_peered":"2024-04-18T05:01:23.654905+0000","last_clean":"2024-04-18T05:01:23.654905+0000","last_became_active":"2024-04-18T04:54:41.197201+0000","last_became_peered":"2024-04-18T04:54:41.197201+0000","last_unstale":"2024-04-18T05:01:23.654905+0000","last_undegraded":"2024-04-18T05:01:23.654905+0000","last_fullsized":"2024-04-18T05:01:23.654905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'458","last_scrub_stamp":"2024-04-18T05:01:23.654853+0000","last_deep_scrub":"23'458","last_deep_scrub_stamp":"2024-04-18T05:01:23.654853+0000","last_clean_scrub_stamp":"2024-04-18T05:01:23.654853+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:23.362109+0000","scrub_duration":0.0048732259999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21429,"num_write":433,"num_write_kb":71833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'59","reported_seq":87,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:19.349316+0000","last_change":"2024-04-18T05:01:19.349515+0000","last_active":"2024-04-18T05:01:19.349316+0000","last_peered":"2024-04-18T05:01:19.349316+0000","last_clean":"2024-04-18T05:01:19.349316+0000","last_became_active":"2024-04-18T04:54:40.797471+0000","last_became_peered":"2024-04-18T04:54:40.797471+0000","last_unstale":"2024-04-18T05:01:19.349316+0000","last_undegraded":"2024-04-18T05:01:19.349316+0000","last_fullsized":"2024-04-18T05:01:19.349316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'59","last_scrub_stamp":"2024-04-18T05:01:19.349260+0000","last_deep_scrub":"23'59","last_deep_scrub_stamp":"2024-04-18T05:01:19.349260+0000","last_clean_scrub_stamp":"2024-04-18T05:01:19.349260+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:21:43.629003+0000","scrub_duration":0.0068506010000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"23'421","reported_seq":491,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:45.481650+0000","last_change":"2024-04-18T05:01:45.481843+0000","last_active":"2024-04-18T05:01:45.481650+0000","last_peered":"2024-04-18T05:01:45.481650+0000","last_clean":"2024-04-18T05:01:45.481650+0000","last_became_active":"2024-04-18T04:54:41.191488+0000","last_became_peered":"2024-04-18T04:54:41.191488+0000","last_unstale":"2024-04-18T05:01:45.481650+0000","last_undegraded":"2024-04-18T05:01:45.481650+0000","last_fullsized":"2024-04-18T05:01:45.481650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'421","last_scrub_stamp":"2024-04-18T05:01:45.481596+0000","last_deep_scrub":"23'421","last_deep_scrub_stamp":"2024-04-18T05:01:45.481596+0000","last_clean_scrub_stamp":"2024-04-18T05:01:45.481596+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:26:44.526526+0000","scrub_duration":0.0044098089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23403,"num_write":390,"num_write_kb":67848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'195","reported_seq":223,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:26.364348+0000","last_change":"2024-04-18T05:01:26.364548+0000","last_active":"2024-04-18T05:01:26.364348+0000","last_peered":"2024-04-18T05:01:26.364348+0000","last_clean":"2024-04-18T05:01:26.364348+0000","last_became_active":"2024-04-18T04:54:40.823277+0000","last_became_peered":"2024-04-18T04:54:40.823277+0000","last_unstale":"2024-04-18T05:01:26.364348+0000","last_undegraded":"2024-04-18T05:01:26.364348+0000","last_fullsized":"2024-04-18T05:01:26.364348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'195","last_scrub_stamp":"2024-04-18T05:01:26.364289+0000","last_deep_scrub":"23'195","last_deep_scrub_stamp":"2024-04-18T05:01:26.364289+0000","last_clean_scrub_stamp":"2024-04-18T05:01:26.364289+0000","objects_scrubbed":3,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:24.955459+0000","scrub_duration":0.028608092000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'448","reported_seq":511,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:34.619186+0000","last_change":"2024-04-18T05:01:34.619396+0000","last_active":"2024-04-18T05:01:34.619186+0000","last_peered":"2024-04-18T05:01:34.619186+0000","last_clean":"2024-04-18T05:01:34.619186+0000","last_became_active":"2024-04-18T04:54:41.199700+0000","last_became_peered":"2024-04-18T04:54:41.199700+0000","last_unstale":"2024-04-18T05:01:34.619186+0000","last_undegraded":"2024-04-18T05:01:34.619186+0000","last_fullsized":"2024-04-18T05:01:34.619186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'448","last_scrub_stamp":"2024-04-18T05:01:34.619131+0000","last_deep_scrub":"23'448","last_deep_scrub_stamp":"2024-04-18T05:01:34.619131+0000","last_clean_scrub_stamp":"2024-04-18T05:01:34.619131+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:14:53.588546+0000","scrub_duration":0.003693375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":10662,"num_write":420,"num_write_kb":96864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'131","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:34.721575+0000","last_change":"2024-04-18T05:01:34.721856+0000","last_active":"2024-04-18T05:01:34.721575+0000","last_peered":"2024-04-18T05:01:34.721575+0000","last_clean":"2024-04-18T05:01:34.721575+0000","last_became_active":"2024-04-18T04:54:40.800405+0000","last_became_peered":"2024-04-18T04:54:40.800405+0000","last_unstale":"2024-04-18T05:01:34.721575+0000","last_undegraded":"2024-04-18T05:01:34.721575+0000","last_fullsized":"2024-04-18T05:01:34.721575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-04-18T05:01:34.721521+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-04-18T05:01:34.721521+0000","last_clean_scrub_stamp":"2024-04-18T05:01:34.721521+0000","objects_scrubbed":4,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:06.452051+0000","scrub_duration":0.044336153000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":8237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'441","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:18.559227+0000","last_change":"2024-04-18T05:01:18.559314+0000","last_active":"2024-04-18T05:01:18.559227+0000","last_peered":"2024-04-18T05:01:18.559227+0000","last_clean":"2024-04-18T05:01:18.559227+0000","last_became_active":"2024-04-18T04:54:41.186301+0000","last_became_peered":"2024-04-18T04:54:41.186301+0000","last_unstale":"2024-04-18T05:01:18.559227+0000","last_undegraded":"2024-04-18T05:01:18.559227+0000","last_fullsized":"2024-04-18T05:01:18.559227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'441","last_scrub_stamp":"2024-04-18T05:01:18.559208+0000","last_deep_scrub":"23'441","last_deep_scrub_stamp":"2024-04-18T05:01:18.559208+0000","last_clean_scrub_stamp":"2024-04-18T05:01:18.559208+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:58.993043+0000","scrub_duration":0.0020339099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":27247,"num_write":409,"num_write_kb":76591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"23'382","reported_seq":420,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:24.698605+0000","last_change":"2024-04-18T05:01:24.698605+0000","last_active":"2024-04-18T05:01:24.698605+0000","last_peered":"2024-04-18T05:01:24.698605+0000","last_clean":"2024-04-18T05:01:24.698605+0000","last_became_active":"2024-04-18T04:54:41.192941+0000","last_became_peered":"2024-04-18T04:54:41.192941+0000","last_unstale":"2024-04-18T05:01:24.698605+0000","last_undegraded":"2024-04-18T05:01:24.698605+0000","last_fullsized":"2024-04-18T05:01:24.698605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'382","last_scrub_stamp":"2024-04-18T05:01:24.698356+0000","last_deep_scrub":"23'382","last_deep_scrub_stamp":"2024-04-18T05:01:24.698356+0000","last_clean_scrub_stamp":"2024-04-18T05:01:24.698356+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:15.097966+0000","scrub_duration":0.0038559670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4755,"num_write":342,"num_write_kb":72428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'361","reported_seq":389,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:28.505483+0000","last_change":"2024-04-18T05:01:28.505483+0000","last_active":"2024-04-18T05:01:28.505483+0000","last_peered":"2024-04-18T05:01:28.505483+0000","last_clean":"2024-04-18T05:01:28.505483+0000","last_became_active":"2024-04-18T04:54:40.799517+0000","last_became_peered":"2024-04-18T04:54:40.799517+0000","last_unstale":"2024-04-18T05:01:28.505483+0000","last_undegraded":"2024-04-18T05:01:28.505483+0000","last_fullsized":"2024-04-18T05:01:28.505483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'361","last_scrub_stamp":"2024-04-18T05:01:28.505196+0000","last_deep_scrub":"23'361","last_deep_scrub_stamp":"2024-04-18T05:01:28.505196+0000","last_clean_scrub_stamp":"2024-04-18T05:01:28.505196+0000","objects_scrubbed":4,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:07:28.212451+0000","scrub_duration":0.040738904999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"23'382","reported_seq":434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:34.697686+0000","last_change":"2024-04-18T05:01:34.697686+0000","last_active":"2024-04-18T05:01:34.697686+0000","last_peered":"2024-04-18T05:01:34.697686+0000","last_clean":"2024-04-18T05:01:34.697686+0000","last_became_active":"2024-04-18T04:54:41.179359+0000","last_became_peered":"2024-04-18T04:54:41.179359+0000","last_unstale":"2024-04-18T05:01:34.697686+0000","last_undegraded":"2024-04-18T05:01:34.697686+0000","last_fullsized":"2024-04-18T05:01:34.697686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'382","last_scrub_stamp":"2024-04-18T05:01:34.697296+0000","last_deep_scrub":"23'382","last_deep_scrub_stamp":"2024-04-18T05:01:34.697296+0000","last_clean_scrub_stamp":"2024-04-18T05:01:34.697296+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:15.131132+0000","scrub_duration":0.0047097220000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14401,"num_write":356,"num_write_kb":79542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'299","reported_seq":327,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:29.590183+0000","last_change":"2024-04-18T05:01:29.590183+0000","last_active":"2024-04-18T05:01:29.590183+0000","last_peered":"2024-04-18T05:01:29.590183+0000","last_clean":"2024-04-18T05:01:29.590183+0000","last_became_active":"2024-04-18T04:54:40.800660+0000","last_became_peered":"2024-04-18T04:54:40.800660+0000","last_unstale":"2024-04-18T05:01:29.590183+0000","last_undegraded":"2024-04-18T05:01:29.590183+0000","last_fullsized":"2024-04-18T05:01:29.590183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'299","last_scrub_stamp":"2024-04-18T05:01:29.589913+0000","last_deep_scrub":"23'299","last_deep_scrub_stamp":"2024-04-18T05:01:29.589913+0000","last_clean_scrub_stamp":"2024-04-18T05:01:29.589913+0000","objects_scrubbed":10,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:19.989522+0000","scrub_duration":0.076672561,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":12441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'366","reported_seq":421,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:54.704571+0000","last_change":"2024-04-18T05:01:54.704778+0000","last_active":"2024-04-18T05:01:54.704571+0000","last_peered":"2024-04-18T05:01:54.704571+0000","last_clean":"2024-04-18T05:01:54.704571+0000","last_became_active":"2024-04-18T04:54:41.189344+0000","last_became_peered":"2024-04-18T04:54:41.189344+0000","last_unstale":"2024-04-18T05:01:54.704571+0000","last_undegraded":"2024-04-18T05:01:54.704571+0000","last_fullsized":"2024-04-18T05:01:54.704571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'366","last_scrub_stamp":"2024-04-18T05:01:54.704518+0000","last_deep_scrub":"23'366","last_deep_scrub_stamp":"2024-04-18T05:01:54.704518+0000","last_clean_scrub_stamp":"2024-04-18T05:01:54.704518+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:44.332672+0000","scrub_duration":0.0037392409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10936,"num_write":342,"num_write_kb":51086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'87","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:25.570947+0000","last_change":"2024-04-18T05:01:25.570947+0000","last_active":"2024-04-18T05:01:25.570947+0000","last_peered":"2024-04-18T05:01:25.570947+0000","last_clean":"2024-04-18T05:01:25.570947+0000","last_became_active":"2024-04-18T04:54:40.813290+0000","last_became_peered":"2024-04-18T04:54:40.813290+0000","last_unstale":"2024-04-18T05:01:25.570947+0000","last_undegraded":"2024-04-18T05:01:25.570947+0000","last_fullsized":"2024-04-18T05:01:25.570947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'87","last_scrub_stamp":"2024-04-18T05:01:25.570624+0000","last_deep_scrub":"23'87","last_deep_scrub_stamp":"2024-04-18T05:01:25.570624+0000","last_clean_scrub_stamp":"2024-04-18T05:01:25.570624+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:06.004459+0000","scrub_duration":0.021566535000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'407","reported_seq":465,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:31.518150+0000","last_change":"2024-04-18T05:01:31.518368+0000","last_active":"2024-04-18T05:01:31.518150+0000","last_peered":"2024-04-18T05:01:31.518150+0000","last_clean":"2024-04-18T05:01:31.518150+0000","last_became_active":"2024-04-18T04:54:41.192096+0000","last_became_peered":"2024-04-18T04:54:41.192096+0000","last_unstale":"2024-04-18T05:01:31.518150+0000","last_undegraded":"2024-04-18T05:01:31.518150+0000","last_fullsized":"2024-04-18T05:01:31.518150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'407","last_scrub_stamp":"2024-04-18T05:01:31.518099+0000","last_deep_scrub":"23'407","last_deep_scrub_stamp":"2024-04-18T05:01:31.518099+0000","last_clean_scrub_stamp":"2024-04-18T05:01:31.518099+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:21.917708+0000","scrub_duration":0.0045801699999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17335,"num_write":380,"num_write_kb":68515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'137","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-18T05:01:36.398640+0000","last_change":"2024-04-18T05:01:36.398858+0000","last_active":"2024-04-18T05:01:36.398640+0000","last_peered":"2024-04-18T05:01:36.398640+0000","last_clean":"2024-04-18T05:01:36.398640+0000","last_became_active":"2024-04-18T04:54:40.804913+0000","last_became_peered":"2024-04-18T04:54:40.804913+0000","last_unstale":"2024-04-18T05:01:36.398640+0000","last_undegraded":"2024-04-18T05:01:36.398640+0000","last_fullsized":"2024-04-18T05:01:36.398640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'137","last_scrub_stamp":"2024-04-18T05:01:36.398585+0000","last_deep_scrub":"23'137","last_deep_scrub_stamp":"2024-04-18T05:01:36.398585+0000","last_clean_scrub_stamp":"2024-04-18T05:01:36.398585+0000","objects_scrubbed":7,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:26:25.377881+0000","scrub_duration":0.026464031999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2494,"num_read_kb":1324974,"num_write":24555,"num_write_kb":4507656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26500,"ondisk_log_size":26500,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":130916242,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":351,"num_read_kb":1645,"num_write":7226,"num_write_kb":133419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":100597760,"data_stored":261832484,"data_compressed":36635560,"data_compressed_allocated":47603712,"data_compressed_original":209084416,"omap_allocated":0,"internal_metadata":0},"log_size":8954,"ondisk_log_size":8954,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66370,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509540,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":5676,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":5812224,"data_stored":14125282,"data_compressed":1836351,"data_compressed_allocated":2379776,"data_compressed_original":10878976,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.79300000000000004,"15min":0.83699999999999997},"min":{"1min":0.53100000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.0900000000000001,"5min":1.1910000000000001,"15min":1.2490000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.81000000000000005,"15min":0.84299999999999997},"min":{"1min":0.54400000000000004,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.21,"5min":1.262,"15min":1.262},"last":0.94299999999999995}]},{"osd":1,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.82399999999999995,"15min":0.82199999999999995},"min":{"1min":0.66200000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2310000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.028},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.84799999999999998,"15min":0.84899999999999998},"min":{"1min":0.622,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.26,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.92800000000000005,"15min":0.89300000000000002},"min":{"1min":0.56299999999999994,"5min":0.438,"15min":0.438},"max":{"1min":1.3320000000000001,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.88600000000000001,"15min":0.87},"min":{"1min":0.69199999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.218,"5min":1.379,"15min":1.4019999999999999},"last":0.85199999999999998}]},{"osd":3,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.88200000000000001,"15min":0.88500000000000001},"min":{"1min":0.67900000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.032,"5min":1.458,"15min":1.458},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.98799999999999999,"15min":0.95399999999999996},"min":{"1min":0.72599999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.286,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.96099999999999997}]},{"osd":4,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.90800000000000003,"15min":0.92600000000000005},"min":{"1min":0.56999999999999995,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.339,"5min":1.605,"15min":1.605},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.90800000000000003,"15min":0.91200000000000003},"min":{"1min":0.68000000000000005,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.224,"5min":1.546,"15min":1.546},"last":0.748}]},{"osd":5,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.97599999999999998,"15min":1.012},"min":{"1min":0.66800000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4379999999999999,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.996,"15min":1.016},"min":{"1min":0.61099999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.2130000000000001,"5min":1.431,"15min":1.5640000000000001},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Apr 18 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0640000000000001,"15min":1.103},"min":{"1min":0.70299999999999996,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2929999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.024,"5min":1.0569999999999999,"15min":1.0469999999999999},"min":{"1min":0.80900000000000005,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2809999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.874}]}]},{"osd":6,"up_from":15,"seq":64424509540,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47056,"kb_used_data":7752,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94324784,"statfs":{"total":96636764160,"available":96588578816,"internally_reserved":0,"allocated":7938048,"data_stored":21059926,"data_compressed":3027129,"data_compressed_allocated":3776512,"data_compressed_original":17063936,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78000000000000003,"15min":0.77700000000000002},"min":{"1min":0.51200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80000000000000004,"15min":0.84499999999999997},"min":{"1min":0.47499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.048,"5min":1.1870000000000001,"15min":1.353},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.88,"15min":0.93300000000000005},"min":{"1min":0.56899999999999995,"5min":0.312,"15min":0.312},"max":{"1min":1.2430000000000001,"5min":1.268,"15min":1.8560000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.83199999999999996,"15min":0.84799999999999998},"min":{"1min":0.55500000000000005,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.2849999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.96799999999999997,"15min":0.94099999999999995},"min":{"1min":0.71499999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.552,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.94799999999999995,"15min":0.93000000000000005},"min":{"1min":0.52300000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3220000000000001,"5min":1.325,"15min":1.325},"last":1.1020000000000001}]},{"osd":3,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.93400000000000005,"15min":0.90900000000000003},"min":{"1min":0.73899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3049999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.95599999999999996,"15min":0.98599999999999999},"min":{"1min":0.70699999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.4510000000000001,"5min":1.617,"15min":1.617},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.90700000000000003,"15min":0.97299999999999998},"min":{"1min":0.70999999999999996,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1259999999999999,"5min":1.4990000000000001,"15min":1.631},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.002,"5min":0.97899999999999998,"15min":1.052},"min":{"1min":0.71599999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2370000000000001,"5min":1.631,"15min":1.631},"last":1.1259999999999999}]},{"osd":5,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.98499999999999999,"15min":1.0049999999999999},"min":{"1min":0.69599999999999995,"5min":0.372,"15min":0.372},"max":{"1min":1.28,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0209999999999999,"15min":1.0429999999999999},"min":{"1min":0.64900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.3109999999999999,"5min":1.673,"15min":1.6739999999999999},"last":1.143}]},{"osd":7,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0489999999999999,"15min":1.1020000000000001},"min":{"1min":0.67200000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.3959999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0820000000000001,"15min":1.107},"min":{"1min":0.68500000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.268,"5min":1.73,"15min":1.7769999999999999},"last":1.0469999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509539,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66536,"kb_used_data":13280,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94305304,"statfs":{"total":96636764160,"available":96568631296,"internally_reserved":0,"allocated":13598720,"data_stored":35687478,"data_compressed":4904028,"data_compressed_allocated":6356992,"data_compressed_original":28622848,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.77100000000000002,"15min":0.88600000000000001},"min":{"1min":0.58299999999999996,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.196,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.80600000000000005,"15min":0.82699999999999996},"min":{"1min":0.55600000000000005,"5min":0.309,"15min":0.309},"max":{"1min":1.1850000000000001,"5min":1.542,"15min":1.542},"last":1.0880000000000001}]},{"osd":1,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.93500000000000005,"15min":0.91700000000000004},"min":{"1min":0.66300000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.169,"5min":9.8819999999999997,"15min":9.8819999999999997},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.90100000000000002,"15min":0.92700000000000005},"min":{"1min":0.73999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1080000000000001,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":0.88900000000000001}]},{"osd":2,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.89600000000000002,"15min":0.89200000000000002},"min":{"1min":0.70499999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.264,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.97799999999999998,"15min":0.94299999999999995},"min":{"1min":0.67900000000000005,"5min":0.38,"15min":0.38},"max":{"1min":1.1040000000000001,"5min":10.031000000000001,"15min":10.031000000000001},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.94499999999999995,"15min":0.96099999999999997},"min":{"1min":0.69799999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1859999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.98699999999999999,"15min":1.0089999999999999},"min":{"1min":0.73199999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.157,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":1.0069999999999999,"15min":0.92000000000000004},"min":{"1min":0.60699999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.23,"5min":9.968,"15min":9.968},"last":0.752},{"interface":"front","average":{"1min":1.012,"5min":1,"15min":1.018},"min":{"1min":0.67900000000000005,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2330000000000001,"5min":1.631,"15min":1.8440000000000001},"last":1.0580000000000001}]},{"osd":6,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0189999999999999,"15min":0.96499999999999997},"min":{"1min":0.64500000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.256,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.1180000000000001,"15min":1.038},"min":{"1min":0.76400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.2869999999999999,"5min":10.09,"15min":10.09},"last":1.016}]},{"osd":7,"last update":"Thu Apr 18 05:01:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.089,"15min":1.099},"min":{"1min":0.69699999999999995,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.244,"5min":1.7050000000000001,"15min":1.944},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.139,"5min":1.1479999999999999,"15min":1.149},"min":{"1min":0.96599999999999997,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.4159999999999999,"5min":1.97,"15min":1.97},"last":0.95399999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509540,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77376,"kb_used_data":20024,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94294464,"statfs":{"total":96636764160,"available":96557531136,"internally_reserved":0,"allocated":20504576,"data_stored":54614164,"data_compressed":7702565,"data_compressed_allocated":9973760,"data_compressed_original":44273664,"omap_allocated":1592,"internal_metadata":58718664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63400000000000001,"15min":0.66600000000000004},"min":{"1min":0.222,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.032,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.64100000000000001,"15min":0.61499999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.82299999999999995,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.018}]},{"osd":1,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63200000000000001,"15min":0.63400000000000001},"min":{"1min":0.34599999999999997,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.077,"5min":1.0920000000000001,"15min":1.2410000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76000000000000001,"15min":0.69999999999999996},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.1839999999999999,"5min":2.601,"15min":2.601},"last":0.93000000000000005}]},{"osd":2,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.74099999999999999,"15min":0.73199999999999998},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.28499999999999998},"max":{"1min":0.98899999999999999,"5min":1.359,"15min":1.573},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80000000000000004,"15min":0.79400000000000004},"min":{"1min":0.27700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1000000000000001,"5min":1.51,"15min":1.51},"last":0.65900000000000003}]},{"osd":4,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85699999999999998,"15min":0.85599999999999998},"min":{"1min":0.51800000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.224,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92900000000000005,"15min":0.93400000000000005},"min":{"1min":0.66800000000000004,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1279999999999999,"5min":1.524,"15min":1.524},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":2.0219999999999998,"5min":1.167,"15min":1.0049999999999999},"min":{"1min":0.69199999999999995,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":21.260000000000002,"5min":21.260000000000002,"15min":21.260000000000002},"last":1.161},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.091,"15min":1.0469999999999999},"min":{"1min":0.56999999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":7.569,"5min":7.569,"15min":7.569},"last":1.2010000000000001}]},{"osd":6,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.0660000000000001,"15min":0.995},"min":{"1min":0.60599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":7.2729999999999997,"5min":7.2729999999999997,"15min":7.2729999999999997},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.0580000000000001,"15min":1.054},"min":{"1min":0.69899999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.2199999999999998,"5min":4.2199999999999998,"15min":4.2199999999999998},"last":1.2390000000000001}]},{"osd":7,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.077,"15min":1.1040000000000001},"min":{"1min":0.57299999999999995,"5min":0.435,"15min":0.435},"max":{"1min":1.3879999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.05,"15min":1.0549999999999999},"min":{"1min":0.64500000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0960000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509539,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59832,"kb_used_data":14768,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94312008,"statfs":{"total":96636764160,"available":96575496192,"internally_reserved":0,"allocated":15122432,"data_stored":34231216,"data_compressed":4539223,"data_compressed_allocated":6156288,"data_compressed_original":25436160,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65800000000000003,"15min":0.60199999999999998},"min":{"1min":0.45700000000000002,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":1.1799999999999999,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68899999999999995,"15min":0.72899999999999998},"min":{"1min":0.432,"5min":0.214,"15min":0.214},"max":{"1min":0.91500000000000004,"5min":1.5920000000000001,"15min":1.9239999999999999},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Apr 18 05:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.54300000000000004,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.82899999999999996,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.745,"15min":0.72499999999999998},"min":{"1min":0.59099999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0129999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.999}]},{"osd":3,"last update":"Thu Apr 18 05:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.80000000000000004,"15min":0.78500000000000003},"min":{"1min":0.68500000000000005,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.96899999999999997,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79300000000000004,"15min":0.77800000000000002},"min":{"1min":0.52500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.1359999999999999,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Apr 18 05:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.92800000000000005,"15min":0.94099999999999995},"min":{"1min":0.71199999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1040000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.004,"5min":0.98799999999999999,"15min":0.98099999999999998},"min":{"1min":0.86699999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.3140000000000001,"5min":2.133,"15min":2.133},"last":1.103}]},{"osd":5,"last update":"Thu Apr 18 05:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.996,"15min":1.0049999999999999},"min":{"1min":0.69199999999999995,"5min":0.313,"15min":0.313},"max":{"1min":1.1839999999999999,"5min":4.5060000000000002,"15min":4.5060000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.99399999999999999,"15min":0.98399999999999999},"min":{"1min":0.81699999999999995,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1439999999999999,"5min":2.347,"15min":2.347},"last":0.95599999999999996}]},{"osd":6,"last update":"Thu Apr 18 05:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0069999999999999,"15min":1.018},"min":{"1min":0.71299999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2929999999999999,"5min":3.024,"15min":3.024},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.036,"15min":1.056},"min":{"1min":0.83199999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1950000000000001,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.044}]},{"osd":7,"last update":"Thu Apr 18 05:02:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.071,"15min":1.0740000000000001},"min":{"1min":0.82299999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.23,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.0920000000000001,"15min":1.101},"min":{"1min":0.77400000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.26,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.137}]}]},{"osd":0,"up_from":15,"seq":64424509541,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78896,"kb_used_data":21544,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94292944,"statfs":{"total":96636764160,"available":96555974656,"internally_reserved":0,"allocated":22061056,"data_stored":54614568,"data_compressed":7565653,"data_compressed_allocated":10006528,"data_compressed_original":42741760,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65500000000000003,"15min":0.58899999999999997},"min":{"1min":0.497,"5min":0.22800000000000001,"15min":0.19900000000000001},"max":{"1min":0.91600000000000004,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.66700000000000004,"15min":0.70299999999999996},"min":{"1min":0.55800000000000005,"5min":0.23100000000000001,"15min":0.224},"max":{"1min":1.1140000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73199999999999998,"15min":0.66700000000000004},"min":{"1min":0.58399999999999996,"5min":0.22,"15min":0.22},"max":{"1min":0.90000000000000002,"5min":2.629,"15min":2.629},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71499999999999997,"15min":0.65300000000000002},"min":{"1min":0.45000000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.96299999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.61799999999999999},"min":{"1min":0.59799999999999998,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.98699999999999999,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.84599999999999997,"15min":0.754},"min":{"1min":0.64500000000000002,"5min":0.27900000000000003,"15min":0.27100000000000002},"max":{"1min":1.0469999999999999,"5min":3.375,"15min":3.375},"last":0.77400000000000002}]},{"osd":4,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91600000000000004,"15min":0.91100000000000003},"min":{"1min":0.65800000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.099,"5min":2.601,"15min":2.601},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.95899999999999996,"15min":0.92800000000000005},"min":{"1min":0.80300000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.284,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.97299999999999998}]},{"osd":5,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.95699999999999996,"15min":0.91200000000000003},"min":{"1min":0.75,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.474,"5min":1.724,"15min":1.724},"last":1.073},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.96799999999999997,"15min":0.94599999999999995},"min":{"1min":0.80300000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.155,"5min":2.734,"15min":2.734},"last":0.94299999999999995}]},{"osd":6,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0529999999999999,"15min":0.99099999999999999},"min":{"1min":0.81399999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3360000000000001,"5min":2.681,"15min":2.681},"last":0.871},{"interface":"front","average":{"1min":1.046,"5min":1.026,"15min":1.016},"min":{"1min":0.753,"5min":0.499,"15min":0.499},"max":{"1min":1.5629999999999999,"5min":2.008,"15min":2.008},"last":0.91200000000000003}]},{"osd":7,"last update":"Thu Apr 18 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.056,"15min":1.0309999999999999},"min":{"1min":0.878,"5min":0.53300000000000003,"15min":0.496},"max":{"1min":1.6379999999999999,"5min":2.069,"15min":2.069},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.0580000000000001,"15min":0.97999999999999998},"min":{"1min":0.872,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.232,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":0.80200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574948,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47916,"kb_used_data":8612,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94323924,"statfs":{"total":96636764160,"available":96587698176,"internally_reserved":0,"allocated":8818688,"data_stored":24681186,"data_compressed":3524620,"data_compressed_allocated":4517888,"data_compressed_original":20582400,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.76900000000000002,"15min":0.88},"min":{"1min":0.60999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1140000000000001,"5min":1.1579999999999999,"15min":1.3080000000000001},"last":1.012},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76300000000000001,"15min":0.82699999999999996},"min":{"1min":0.63700000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.97699999999999998,"5min":1.264,"15min":1.264},"last":1.034}]},{"osd":1,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82799999999999996,"15min":0.871},"min":{"1min":0.58799999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.119,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.82899999999999996,"15min":0.86199999999999999},"min":{"1min":0.70399999999999996,"5min":0.318,"15min":0.318},"max":{"1min":1.1000000000000001,"5min":1.246,"15min":1.246},"last":0.98199999999999998}]},{"osd":2,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83499999999999996,"15min":0.85699999999999998},"min":{"1min":0.51700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1479999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.93799999999999994,"15min":0.96599999999999997},"min":{"1min":0.749,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2889999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.1579999999999999}]},{"osd":3,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.006,"15min":0.997},"min":{"1min":0.69499999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1990000000000001,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":1.137},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0720000000000001,"15min":1.0800000000000001},"min":{"1min":0.94699999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1839999999999999,"5min":3.6280000000000001,"15min":3.6280000000000001},"last":1.095}]},{"osd":5,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.93600000000000005,"15min":0.93300000000000005},"min":{"1min":0.60699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.228,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.746},{"interface":"front","average":{"1min":1.046,"5min":1.0289999999999999,"15min":1.052},"min":{"1min":0.70899999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.92700000000000005,"15min":0.995},"min":{"1min":0.65800000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.117,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.878},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.046,"15min":1.0549999999999999},"min":{"1min":0.75900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.633,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.85199999999999998}]},{"osd":7,"last update":"Thu Apr 18 05:01:47 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.1000000000000001,"15min":1.133},"min":{"1min":0.69299999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1319999999999999,"15min":1.143},"min":{"1min":0.90000000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.538,"5min":3.9910000000000001,"15min":3.9910000000000001},"last":1.0589999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574948,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":8536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":8740864,"data_stored":24679416,"data_compressed":3602361,"data_compressed_allocated":4526080,"data_compressed_original":20631552,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.621,"15min":0.56799999999999995},"min":{"1min":0.443,"5min":0.218,"15min":0.20000000000000001},"max":{"1min":1.1539999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.67500000000000004,"15min":0.70099999999999996},"min":{"1min":0.34699999999999998,"5min":0.193,"15min":0.193},"max":{"1min":1.069,"5min":1.2330000000000001,"15min":1.347},"last":0.74299999999999999}]},{"osd":1,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70499999999999996,"15min":0.67500000000000004},"min":{"1min":0.44600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.96799999999999997,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.876},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70199999999999996,"15min":0.66900000000000004},"min":{"1min":0.41199999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.2270000000000001,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.39000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.103,"5min":1.224,"15min":1.29},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.69399999999999995,"15min":0.65100000000000002},"min":{"1min":0.498,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.94799999999999995,"15min":0.95399999999999996},"min":{"1min":0.60299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.2090000000000001,"5min":2.456,"15min":2.456},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.872,"15min":0.875},"min":{"1min":0.73299999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0800000000000001,"5min":1.454,"15min":1.6950000000000001},"last":0.85299999999999998}]},{"osd":5,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.97899999999999998,"15min":0.94499999999999995},"min":{"1min":0.66400000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3049999999999999,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":1.077},{"interface":"front","average":{"1min":1.024,"5min":0.96999999999999997,"15min":0.98699999999999999},"min":{"1min":0.85099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.331,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.1899999999999999}]},{"osd":6,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.93799999999999994,"15min":0.91500000000000004},"min":{"1min":0.65500000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2130000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.038,"15min":0.98299999999999998},"min":{"1min":0.67800000000000005,"5min":0.439,"15min":0.439},"max":{"1min":1.3720000000000001,"5min":3.391,"15min":3.391},"last":1.143}]},{"osd":7,"last update":"Thu Apr 18 05:01:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.02,"15min":1.0269999999999999},"min":{"1min":0.77400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.256,"5min":1.4259999999999999,"15min":1.4990000000000001},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.0129999999999999,"15min":0.97899999999999998},"min":{"1min":0.82999999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.276,"5min":1.748,"15min":1.748},"last":0.91600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33185,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21827584,"data_stored":54529566,"data_compressed":7565653,"data_compressed_allocated":10006528,"data_compressed_original":42741760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14823424,"data_stored":33555846,"data_compressed":4506038,"data_compressed_allocated":6111232,"data_compressed_original":24862720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8507392,"data_stored":24594414,"data_compressed":3602361,"data_compressed_allocated":4526080,"data_compressed_original":20631552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20271104,"data_stored":54529162,"data_compressed":7702565,"data_compressed_allocated":9973760,"data_compressed_original":44273664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8585216,"data_stored":24596184,"data_compressed":3524620,"data_compressed_allocated":4517888,"data_compressed_original":20582400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13299712,"data_stored":35012108,"data_compressed":4870843,"data_compressed_allocated":6311936,"data_compressed_original":28049408,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7704576,"data_stored":20974924,"data_compressed":3027129,"data_compressed_allocated":3776512,"data_compressed_original":17063936,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5578752,"data_stored":14040280,"data_compressed":1836351,"data_compressed_allocated":2379776,"data_compressed_original":10878976,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T05:02:41.473 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-18T05:02:41.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.633+0000 7f4cb70fb640 1 Processor -- start 2024-04-18T05:02:41.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.633+0000 7f4cb70fb640 1 -- start start 2024-04-18T05:02:41.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.633+0000 7f4cb70fb640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4cb01530d0 0x7f4cb00c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.633+0000 7f4cb70fb640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb00c9cc0 con 0x7f4cb015c320 2024-04-18T05:02:41.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.633+0000 7f4cb70fb640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb01534b0 con 0x7f4cb0159a40 2024-04-18T05:02:41.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.633+0000 7f4cb70fb640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb015c810 con 0x7f4cb01530d0 2024-04-18T05:02:41.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.633+0000 7f4cb4e97640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4cb01530d0 0x7f4cb00c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:41.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.633+0000 7f4cb4e97640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4cb01530d0 0x7f4cb00c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44826/0 (socket says 172.21.15.96:44826) 2024-04-18T05:02:41.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.633+0000 7f4cb4e97640 1 -- 172.21.15.96:0/3108039031 learned_addr learned my addr 172.21.15.96:0/3108039031 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:41.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.633+0000 7f4caffff640 1 --1- 172.21.15.96:0/3108039031 >> v1:172.21.15.96:6789/0 conn(0x7f4cb015c320 0x7f4cb0071590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39510/0 (socket says 172.21.15.96:39510) 2024-04-18T05:02:41.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.633+0000 7f4cb4e97640 1 -- 172.21.15.96:0/3108039031 >> v1:172.21.15.139:6789/0 conn(0x7f4cb0159a40 legacy=0x7f4cb00ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.633+0000 7f4cb4e97640 1 -- 172.21.15.96:0/3108039031 >> v1:172.21.15.96:6789/0 conn(0x7f4cb015c320 legacy=0x7f4cb0071590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.633+0000 7f4cb4e97640 1 -- 172.21.15.96:0/3108039031 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb015caf0 con 0x7f4cb01530d0 2024-04-18T05:02:41.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb4e97640 1 --2- 172.21.15.96:0/3108039031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cb01530d0 0x7f4cb00c90b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009870 tx=0x7f4ca001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5f8bbfac251a17 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:41.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4caf7fe640 1 -- 172.21.15.96:0/3108039031 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00a6040 con 0x7f4cb01530d0 2024-04-18T05:02:41.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4caf7fe640 1 -- 172.21.15.96:0/3108039031 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca00aa600 con 0x7f4cb01530d0 2024-04-18T05:02:41.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4caf7fe640 1 -- 172.21.15.96:0/3108039031 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00aa990 con 0x7f4cb01530d0 2024-04-18T05:02:41.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb70fb640 1 -- 172.21.15.96:0/3108039031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cb01530d0 msgr2=0x7f4cb00c90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb70fb640 1 --2- 172.21.15.96:0/3108039031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cb01530d0 0x7f4cb00c90b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009870 tx=0x7f4ca001c4a0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb70fb640 1 -- 172.21.15.96:0/3108039031 shutdown_connections 2024-04-18T05:02:41.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb70fb640 1 --2- 172.21.15.96:0/3108039031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cb01530d0 0x7f4cb00c90b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb70fb640 1 -- 172.21.15.96:0/3108039031 >> 172.21.15.96:0/3108039031 conn(0x7f4cb006b430 msgr2=0x7f4cb006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:41.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb70fb640 1 -- 172.21.15.96:0/3108039031 shutdown_connections 2024-04-18T05:02:41.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb70fb640 1 -- 172.21.15.96:0/3108039031 wait complete. 2024-04-18T05:02:41.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb70fb640 1 Processor -- start 2024-04-18T05:02:41.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb70fb640 1 -- start start 2024-04-18T05:02:41.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb70fb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cb01530d0 0x7f4cb00b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb70fb640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4cb0159a40 0x7f4cb0147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb70fb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4cb015c320 0x7f4cb0147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb70fb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb0146f70 con 0x7f4cb01530d0 2024-04-18T05:02:41.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb70fb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb0152490 con 0x7f4cb015c320 2024-04-18T05:02:41.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb70fb640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb0151fd0 con 0x7f4cb0159a40 2024-04-18T05:02:41.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb4e97640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cb01530d0 0x7f4cb00b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:41.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb4e97640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cb01530d0 0x7f4cb00b3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44836/0 (socket says 172.21.15.96:44836) 2024-04-18T05:02:41.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb4e97640 1 -- 172.21.15.96:0/791672623 learned_addr learned my addr 172.21.15.96:0/791672623 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:41.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb4e97640 1 -- 172.21.15.96:0/791672623 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4cb0159a40 msgr2=0x7f4cb0147400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.637+0000 7f4cb4e97640 1 --2- 172.21.15.96:0/791672623 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4cb0159a40 0x7f4cb0147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.641+0000 7f4cb4e97640 1 -- 172.21.15.96:0/791672623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4cb015c320 msgr2=0x7f4cb0147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.641+0000 7f4cb4e97640 1 --2- 172.21.15.96:0/791672623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4cb015c320 0x7f4cb0147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.641+0000 7f4cb4e97640 1 -- 172.21.15.96:0/791672623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca00094d0 con 0x7f4cb01530d0 2024-04-18T05:02:41.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.641+0000 7f4cb4e97640 1 --2- 172.21.15.96:0/791672623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cb01530d0 0x7f4cb00b3af0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4ca001a0d0 tx=0x7f4ca001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:41.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.641+0000 7f4cad7fa640 1 -- 172.21.15.96:0/791672623 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00b3800 con 0x7f4cb01530d0 2024-04-18T05:02:41.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.641+0000 7f4cad7fa640 1 -- 172.21.15.96:0/791672623 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca00b3960 con 0x7f4cb01530d0 2024-04-18T05:02:41.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.641+0000 7f4cb70fb640 1 -- 172.21.15.96:0/791672623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb0146040 con 0x7f4cb01530d0 2024-04-18T05:02:41.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.641+0000 7f4cad7fa640 1 -- 172.21.15.96:0/791672623 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00b3d10 con 0x7f4cb01530d0 2024-04-18T05:02:41.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.641+0000 7f4cb70fb640 1 -- 172.21.15.96:0/791672623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb0146600 con 0x7f4cb01530d0 2024-04-18T05:02:41.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.641+0000 7f4cb70fb640 1 -- 172.21.15.96:0/791672623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb0146dd0 con 0x7f4cb01530d0 2024-04-18T05:02:41.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.641+0000 7f4cad7fa640 1 -- 172.21.15.96:0/791672623 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4ca00c6430 con 0x7f4cb01530d0 2024-04-18T05:02:41.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.641+0000 7f4cad7fa640 1 --2- 172.21.15.96:0/791672623 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4c9c066690 0x7f4c9c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.641+0000 7f4caffff640 1 --2- 172.21.15.96:0/791672623 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4c9c066690 0x7f4c9c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:41.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.641+0000 7f4cad7fa640 1 -- 172.21.15.96:0/791672623 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4ca011ef40 con 0x7f4cb01530d0 2024-04-18T05:02:41.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.641+0000 7f4caffff640 1 --2- 172.21.15.96:0/791672623 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4c9c066690 0x7f4c9c068b50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00c4130 tx=0x7f4ca40079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:41.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.645+0000 7f4cad7fa640 1 -- 172.21.15.96:0/791672623 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f4cb0146dd0 con 0x7f4cb01530d0 2024-04-18T05:02:41.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.805+0000 7f4cb70fb640 1 -- 172.21.15.96:0/791672623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f4cb0146dd0 con 0x7f4cb01530d0 2024-04-18T05:02:41.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.813+0000 7f4cad7fa640 1 -- 172.21.15.96:0/791672623 <== mon.0 v2:172.21.15.96:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4ca00ec320 con 0x7f4cb01530d0 2024-04-18T05:02:41.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.813+0000 7f4cad7fa640 1 -- 172.21.15.96:0/791672623 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f4cb0146dd0 con 0x7f4cb01530d0 2024-04-18T05:02:41.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.817+0000 7f4cb70fb640 1 -- 172.21.15.96:0/791672623 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4c9c066690 msgr2=0x7f4c9c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.817+0000 7f4cb70fb640 1 --2- 172.21.15.96:0/791672623 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4c9c066690 0x7f4c9c068b50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00c4130 tx=0x7f4ca40079d0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.817+0000 7f4cb70fb640 1 -- 172.21.15.96:0/791672623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cb01530d0 msgr2=0x7f4cb00b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.817+0000 7f4cb70fb640 1 --2- 172.21.15.96:0/791672623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cb01530d0 0x7f4cb00b3af0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4ca001a0d0 tx=0x7f4ca001ace0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.817+0000 7f4cb70fb640 1 -- 172.21.15.96:0/791672623 shutdown_connections 2024-04-18T05:02:41.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.817+0000 7f4cb70fb640 1 --2- 172.21.15.96:0/791672623 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4c9c066690 0x7f4c9c068b50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.817+0000 7f4cb70fb640 1 --2- 172.21.15.96:0/791672623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4cb015c320 0x7f4cb0147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.817+0000 7f4cb70fb640 1 --2- 172.21.15.96:0/791672623 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4cb0159a40 0x7f4cb0147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.817+0000 7f4cb70fb640 1 --2- 172.21.15.96:0/791672623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cb01530d0 0x7f4cb00b3af0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.817+0000 7f4cb70fb640 1 -- 172.21.15.96:0/791672623 >> 172.21.15.96:0/791672623 conn(0x7f4cb006b430 msgr2=0x7f4cb01569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:41.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.817+0000 7f4cb70fb640 1 -- 172.21.15.96:0/791672623 shutdown_connections 2024-04-18T05:02:41.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.817+0000 7f4cb70fb640 1 -- 172.21.15.96:0/791672623 wait complete. 2024-04-18T05:02:41.833 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-18T05:02:41.834 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T05:02:41.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.953+0000 7fb28f3cc640 1 Processor -- start 2024-04-18T05:02:41.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.953+0000 7fb28f3cc640 1 -- start start 2024-04-18T05:02:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.953+0000 7fb28f3cc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb2880c1870 0x7fb288070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.953+0000 7fb28f3cc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb288156050 0x7fb28806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.953+0000 7fb28f3cc640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2880721e0 con 0x7fb28806d930 2024-04-18T05:02:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.953+0000 7fb28f3cc640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2880c48a0 con 0x7fb2880c1870 2024-04-18T05:02:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.953+0000 7fb28f3cc640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28806e250 con 0x7fb288156050 2024-04-18T05:02:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.953+0000 7fb28c967640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb2880c1870 0x7fb288070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.953+0000 7fb28c967640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb2880c1870 0x7fb288070fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44850/0 (socket says 172.21.15.96:44850) 2024-04-18T05:02:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.953+0000 7fb28c967640 1 -- 172.21.15.96:0/4264844259 learned_addr learned my addr 172.21.15.96:0/4264844259 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.953+0000 7fb28d168640 1 --1- 172.21.15.96:0/4264844259 >> v1:172.21.15.96:6789/0 conn(0x7fb28806d930 0x7fb2880c4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39526/0 (socket says 172.21.15.96:39526) 2024-04-18T05:02:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.953+0000 7fb28d969640 1 --2- 172.21.15.96:0/4264844259 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb288156050 0x7fb28806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.953+0000 7fb28c967640 1 -- 172.21.15.96:0/4264844259 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb288156050 msgr2=0x7fb28806dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:02:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.953+0000 7fb28c967640 1 --2- 172.21.15.96:0/4264844259 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb288156050 0x7fb28806dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.953+0000 7fb28c967640 1 -- 172.21.15.96:0/4264844259 >> v1:172.21.15.96:6789/0 conn(0x7fb28806d930 legacy=0x7fb2880c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.953+0000 7fb28c967640 1 -- 172.21.15.96:0/4264844259 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb288070730 con 0x7fb2880c1870 2024-04-18T05:02:41.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.957+0000 7fb28c967640 1 --2- 172.21.15.96:0/4264844259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2880c1870 0x7fb288070fd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb2840083f0 tx=0x7fb28401f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a73fee8012f630 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:41.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.957+0000 7fb27bfff640 1 -- 172.21.15.96:0/4264844259 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400a2d0 con 0x7fb2880c1870 2024-04-18T05:02:41.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.957+0000 7fb27bfff640 1 -- 172.21.15.96:0/4264844259 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb2840ab050 con 0x7fb2880c1870 2024-04-18T05:02:41.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.957+0000 7fb27bfff640 1 -- 172.21.15.96:0/4264844259 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284008720 con 0x7fb2880c1870 2024-04-18T05:02:41.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.957+0000 7fb28f3cc640 1 -- 172.21.15.96:0/4264844259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2880c1870 msgr2=0x7fb288070fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.957+0000 7fb28f3cc640 1 --2- 172.21.15.96:0/4264844259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2880c1870 0x7fb288070fd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb2840083f0 tx=0x7fb28401f270 comp rx=0 tx=0).stop 2024-04-18T05:02:41.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.957+0000 7fb28f3cc640 1 -- 172.21.15.96:0/4264844259 shutdown_connections 2024-04-18T05:02:41.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.957+0000 7fb28f3cc640 1 --2- 172.21.15.96:0/4264844259 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb288156050 0x7fb28806dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.957+0000 7fb28f3cc640 1 --2- 172.21.15.96:0/4264844259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2880c1870 0x7fb288070fd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.957+0000 7fb28f3cc640 1 -- 172.21.15.96:0/4264844259 >> 172.21.15.96:0/4264844259 conn(0x7fb28806c750 msgr2=0x7fb2880c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:41.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.957+0000 7fb28f3cc640 1 -- 172.21.15.96:0/4264844259 shutdown_connections 2024-04-18T05:02:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.957+0000 7fb28f3cc640 1 -- 172.21.15.96:0/4264844259 wait complete. 2024-04-18T05:02:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.957+0000 7fb28f3cc640 1 Processor -- start 2024-04-18T05:02:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.957+0000 7fb28f3cc640 1 -- start start 2024-04-18T05:02:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28f3cc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb28806d930 0x7fb2880bb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28f3cc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2880c1870 0x7fb2881eb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28f3cc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb288156050 0x7fb2880b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28f3cc640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880b8aa0 con 0x7fb28806d930 2024-04-18T05:02:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28f3cc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880bb5a0 con 0x7fb2880c1870 2024-04-18T05:02:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28f3cc640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2881eb6c0 con 0x7fb288156050 2024-04-18T05:02:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28d168640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb28806d930 0x7fb2880bb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28d168640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb28806d930 0x7fb2880bb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44864/0 (socket says 172.21.15.96:44864) 2024-04-18T05:02:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28d168640 1 -- 172.21.15.96:0/737977577 learned_addr learned my addr 172.21.15.96:0/737977577 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28d969640 1 --2- 172.21.15.96:0/737977577 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb288156050 0x7fb2880b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28d168640 1 -- 172.21.15.96:0/737977577 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb288156050 msgr2=0x7fb2880b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28d168640 1 --2- 172.21.15.96:0/737977577 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb288156050 0x7fb2880b70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28c967640 1 --2- 172.21.15.96:0/737977577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2880c1870 0x7fb2881eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28d168640 1 -- 172.21.15.96:0/737977577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2880c1870 msgr2=0x7fb2881eb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28d168640 1 --2- 172.21.15.96:0/737977577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2880c1870 0x7fb2881eb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:41.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28d168640 1 -- 172.21.15.96:0/737977577 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28400ab50 con 0x7fb28806d930 2024-04-18T05:02:41.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28c967640 1 --2- 172.21.15.96:0/737977577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2880c1870 0x7fb2881eb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:02:41.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28d168640 1 --2- 172.21.15.96:0/737977577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb28806d930 0x7fb2880bb060 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb28000e6b0 tx=0x7fb28000eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:41.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb279ffb640 1 -- 172.21.15.96:0/737977577 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280006c00 con 0x7fb28806d930 2024-04-18T05:02:41.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb279ffb640 1 -- 172.21.15.96:0/737977577 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb280006d60 con 0x7fb28806d930 2024-04-18T05:02:41.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28f3cc640 1 -- 172.21.15.96:0/737977577 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2880b83d0 con 0x7fb28806d930 2024-04-18T05:02:41.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb279ffb640 1 -- 172.21.15.96:0/737977577 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28000c880 con 0x7fb28806d930 2024-04-18T05:02:41.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28f3cc640 1 -- 172.21.15.96:0/737977577 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2880b8c80 con 0x7fb28806d930 2024-04-18T05:02:41.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28f3cc640 1 -- 172.21.15.96:0/737977577 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb288067050 con 0x7fb28806d930 2024-04-18T05:02:41.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb279ffb640 1 -- 172.21.15.96:0/737977577 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb28000c9e0 con 0x7fb28806d930 2024-04-18T05:02:41.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb279ffb640 1 --2- 172.21.15.96:0/737977577 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb26c066690 0x7fb26c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:41.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb279ffb640 1 -- 172.21.15.96:0/737977577 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb2800858e0 con 0x7fb28806d930 2024-04-18T05:02:41.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.961+0000 7fb28c967640 1 --2- 172.21.15.96:0/737977577 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb26c066690 0x7fb26c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:41.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.965+0000 7fb28c967640 1 --2- 172.21.15.96:0/737977577 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb26c066690 0x7fb26c068b50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb2840b1000 tx=0x7fb284004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:41.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:41.969+0000 7fb279ffb640 1 -- 172.21.15.96:0/737977577 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb280052ba0 con 0x7fb28806d930 2024-04-18T05:02:42.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.157+0000 7fb28f3cc640 1 -- 172.21.15.96:0/737977577 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2880caa00 con 0x7fb28806d930 2024-04-18T05:02:42.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.161+0000 7fb279ffb640 1 -- 172.21.15.96:0/737977577 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6313 (secure 0 0 0) 0x7fb28001a090 con 0x7fb28806d930 2024-04-18T05:02:42.160 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T05:02:42.160 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/4225147900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":4225147900},{"type":"v1","addr":"172.21.15.96:6839","nonce":4225147900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:54:41.158866+0000","modified":"2024-04-18T04:55:09.695142+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4273,"mds_1":4249,"mds_2":4239,"mds_3":4232,"mds_4":4229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4229":{"gid":4229,"name":"d","rank":4,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.139:6836/2054604275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2054604275},{"type":"v1","addr":"172.21.15.139:6836","nonce":2054604275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4232":{"gid":4232,"name":"b","rank":3,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.139:6837/2105821790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":2105821790},{"type":"v1","addr":"172.21.15.139:6837","nonce":2105821790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4239":{"gid":4239,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.96:6835/1188672263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1188672263},{"type":"v1","addr":"172.21.15.96:6835","nonce":1188672263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4249":{"gid":4249,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.96:6837/4278976485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":4278976485},{"type":"v1","addr":"172.21.15.96:6837","nonce":4278976485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4273":{"gid":4273,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6833/3935291095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":3935291095},{"type":"v1","addr":"172.21.15.139:6833","nonce":3935291095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T05:02:42.160 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2024-04-18T05:02:42.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.161+0000 7fb28f3cc640 1 -- 172.21.15.96:0/737977577 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb26c066690 msgr2=0x7fb26c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.161+0000 7fb28f3cc640 1 --2- 172.21.15.96:0/737977577 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb26c066690 0x7fb26c068b50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb2840b1000 tx=0x7fb284004ac0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.161+0000 7fb28f3cc640 1 -- 172.21.15.96:0/737977577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb28806d930 msgr2=0x7fb2880bb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.161+0000 7fb28f3cc640 1 --2- 172.21.15.96:0/737977577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb28806d930 0x7fb2880bb060 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb28000e6b0 tx=0x7fb28000eb70 comp rx=0 tx=0).stop 2024-04-18T05:02:42.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.161+0000 7fb28f3cc640 1 -- 172.21.15.96:0/737977577 shutdown_connections 2024-04-18T05:02:42.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.161+0000 7fb28f3cc640 1 --2- 172.21.15.96:0/737977577 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7fb26c066690 0x7fb26c068b50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.161+0000 7fb28f3cc640 1 --2- 172.21.15.96:0/737977577 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb288156050 0x7fb2880b70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.161+0000 7fb28f3cc640 1 --2- 172.21.15.96:0/737977577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2880c1870 0x7fb2881eb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.161+0000 7fb28f3cc640 1 --2- 172.21.15.96:0/737977577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb28806d930 0x7fb2880bb060 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.161+0000 7fb28f3cc640 1 -- 172.21.15.96:0/737977577 >> 172.21.15.96:0/737977577 conn(0x7fb28806c750 msgr2=0x7fb288153360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:42.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.161+0000 7fb28f3cc640 1 -- 172.21.15.96:0/737977577 shutdown_connections 2024-04-18T05:02:42.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.161+0000 7fb28f3cc640 1 -- 172.21.15.96:0/737977577 wait complete. 2024-04-18T05:02:42.177 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T05:02:42.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.301+0000 7f6e89aaa640 1 Processor -- start 2024-04-18T05:02:42.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.301+0000 7f6e89aaa640 1 -- start start 2024-04-18T05:02:42.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.305+0000 7f6e89aaa640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e840c9160 0x7f6e840c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.305+0000 7f6e89aaa640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6e840c9f00 0x7f6e8415cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.305+0000 7f6e89aaa640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e841533c0 con 0x7f6e84152fe0 2024-04-18T05:02:42.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.305+0000 7f6e89aaa640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e840ca370 con 0x7f6e840c9f00 2024-04-18T05:02:42.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.305+0000 7f6e89aaa640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e84066940 con 0x7f6e840c9160 2024-04-18T05:02:42.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.305+0000 7f6e7bfff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e840c9160 0x7f6e840c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.305+0000 7f6e83fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6e840c9f00 0x7f6e8415cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.305+0000 7f6e83fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6e840c9f00 0x7f6e8415cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.96:60520/0 (socket says 172.21.15.96:60520) 2024-04-18T05:02:42.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.305+0000 7f6e83fff640 1 -- 172.21.15.96:0/554800623 learned_addr learned my addr 172.21.15.96:0/554800623 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:42.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.305+0000 7f6e7bfff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e840c9160 0x7f6e840c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.96:33622/0 (socket says 172.21.15.96:33622) 2024-04-18T05:02:42.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.305+0000 7f6e83fff640 1 -- 172.21.15.96:0/554800623 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e840c9160 msgr2=0x7f6e840c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:02:42.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.305+0000 7f6e83fff640 1 --2- 172.21.15.96:0/554800623 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e840c9160 0x7f6e840c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.305+0000 7f6e83fff640 1 -- 172.21.15.96:0/554800623 >> v1:172.21.15.139:6789/0 conn(0x7f6e84152fe0 legacy=0x7f6e8415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.305+0000 7f6e83fff640 1 -- 172.21.15.96:0/554800623 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e84159c50 con 0x7f6e840c9f00 2024-04-18T05:02:42.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e83fff640 1 --2- 172.21.15.96:0/554800623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e840c9f00 0x7f6e8415cb90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009e50 tx=0x7f6e7c01f210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=164555f3eb070d07 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:42.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e82ffd640 1 -- 172.21.15.96:0/554800623 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0af400 con 0x7f6e840c9f00 2024-04-18T05:02:42.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e82ffd640 1 -- 172.21.15.96:0/554800623 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6e7c0ab050 con 0x7f6e840c9f00 2024-04-18T05:02:42.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e82ffd640 1 -- 172.21.15.96:0/554800623 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0af7a0 con 0x7f6e840c9f00 2024-04-18T05:02:42.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 -- 172.21.15.96:0/554800623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e840c9f00 msgr2=0x7f6e8415cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 --2- 172.21.15.96:0/554800623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e840c9f00 0x7f6e8415cb90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009e50 tx=0x7f6e7c01f210 comp rx=0 tx=0).stop 2024-04-18T05:02:42.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 -- 172.21.15.96:0/554800623 shutdown_connections 2024-04-18T05:02:42.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 --2- 172.21.15.96:0/554800623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e840c9f00 0x7f6e8415cb90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 --2- 172.21.15.96:0/554800623 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e840c9160 0x7f6e840c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 -- 172.21.15.96:0/554800623 >> 172.21.15.96:0/554800623 conn(0x7f6e84071760 msgr2=0x7f6e84065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:42.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 -- 172.21.15.96:0/554800623 shutdown_connections 2024-04-18T05:02:42.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 -- 172.21.15.96:0/554800623 wait complete. 2024-04-18T05:02:42.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 Processor -- start 2024-04-18T05:02:42.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 -- start start 2024-04-18T05:02:42.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e840c9160 0x7f6e840b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e840c9f00 0x7f6e840b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e84152fe0 0x7f6e84158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e841eee20 con 0x7f6e84152fe0 2024-04-18T05:02:42.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e84143d20 con 0x7f6e840c9160 2024-04-18T05:02:42.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e841ee7a0 con 0x7f6e840c9f00 2024-04-18T05:02:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e83fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e84152fe0 0x7f6e84158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e83fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e84152fe0 0x7f6e84158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44878/0 (socket says 172.21.15.96:44878) 2024-04-18T05:02:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e83fff640 1 -- 172.21.15.96:0/4165832539 learned_addr learned my addr 172.21.15.96:0/4165832539 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e837fe640 1 --2- 172.21.15.96:0/4165832539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e840c9160 0x7f6e840b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e7bfff640 1 --2- 172.21.15.96:0/4165832539 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e840c9f00 0x7f6e840b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e83fff640 1 -- 172.21.15.96:0/4165832539 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e840c9f00 msgr2=0x7f6e840b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e83fff640 1 --2- 172.21.15.96:0/4165832539 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e840c9f00 0x7f6e840b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e83fff640 1 -- 172.21.15.96:0/4165832539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e840c9160 msgr2=0x7f6e840b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e83fff640 1 --2- 172.21.15.96:0/4165832539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e840c9160 0x7f6e840b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e83fff640 1 -- 172.21.15.96:0/4165832539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c009b30 con 0x7f6e84152fe0 2024-04-18T05:02:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e83fff640 1 --2- 172.21.15.96:0/4165832539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e84152fe0 0x7f6e84158a60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c01d8c0 tx=0x7f6e7c01bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e80ff9640 1 -- 172.21.15.96:0/4165832539 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0afdd0 con 0x7f6e84152fe0 2024-04-18T05:02:42.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e80ff9640 1 -- 172.21.15.96:0/4165832539 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6e7c009510 con 0x7f6e84152fe0 2024-04-18T05:02:42.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.309+0000 7f6e89aaa640 1 -- 172.21.15.96:0/4165832539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e84143f50 con 0x7f6e84152fe0 2024-04-18T05:02:42.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.313+0000 7f6e80ff9640 1 -- 172.21.15.96:0/4165832539 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0b9670 con 0x7f6e84152fe0 2024-04-18T05:02:42.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.313+0000 7f6e89aaa640 1 -- 172.21.15.96:0/4165832539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e841eea40 con 0x7f6e84152fe0 2024-04-18T05:02:42.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.313+0000 7f6e89aaa640 1 -- 172.21.15.96:0/4165832539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e841ee600 con 0x7f6e84152fe0 2024-04-18T05:02:42.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.313+0000 7f6e80ff9640 1 -- 172.21.15.96:0/4165832539 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6e7c0b6070 con 0x7f6e84152fe0 2024-04-18T05:02:42.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.313+0000 7f6e80ff9640 1 --2- 172.21.15.96:0/4165832539 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6e64066690 0x7f6e64068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.313+0000 7f6e80ff9640 1 -- 172.21.15.96:0/4165832539 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6e7c1223e0 con 0x7f6e84152fe0 2024-04-18T05:02:42.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.313+0000 7f6e837fe640 1 --2- 172.21.15.96:0/4165832539 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6e64066690 0x7f6e64068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.313+0000 7f6e837fe640 1 --2- 172.21.15.96:0/4165832539 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6e64066690 0x7f6e64068b50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e740015b0 tx=0x7f6e74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:42.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.317+0000 7f6e80ff9640 1 -- 172.21.15.96:0/4165832539 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6e841ee600 con 0x7f6e84152fe0 2024-04-18T05:02:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.493+0000 7f6e89aaa640 1 -- 172.21.15.96:0/4165832539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e841eef60 con 0x7f6e84152fe0 2024-04-18T05:02:42.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.497+0000 7f6e80ff9640 1 -- 172.21.15.96:0/4165832539 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6313 (secure 0 0 0) 0x7f6e841eef60 con 0x7f6e84152fe0 2024-04-18T05:02:42.495 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T05:02:42.496 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/4225147900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":4225147900},{"type":"v1","addr":"172.21.15.96:6839","nonce":4225147900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:54:41.158866+0000","modified":"2024-04-18T04:55:09.695142+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4273,"mds_1":4249,"mds_2":4239,"mds_3":4232,"mds_4":4229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4229":{"gid":4229,"name":"d","rank":4,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.139:6836/2054604275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2054604275},{"type":"v1","addr":"172.21.15.139:6836","nonce":2054604275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4232":{"gid":4232,"name":"b","rank":3,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.139:6837/2105821790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":2105821790},{"type":"v1","addr":"172.21.15.139:6837","nonce":2105821790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4239":{"gid":4239,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.96:6835/1188672263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1188672263},{"type":"v1","addr":"172.21.15.96:6835","nonce":1188672263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4249":{"gid":4249,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.96:6837/4278976485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":4278976485},{"type":"v1","addr":"172.21.15.96:6837","nonce":4278976485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4273":{"gid":4273,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6833/3935291095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":3935291095},{"type":"v1","addr":"172.21.15.139:6833","nonce":3935291095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T05:02:42.496 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2024-04-18T05:02:42.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.497+0000 7f6e89aaa640 1 -- 172.21.15.96:0/4165832539 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6e64066690 msgr2=0x7f6e64068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.497+0000 7f6e89aaa640 1 --2- 172.21.15.96:0/4165832539 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6e64066690 0x7f6e64068b50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e740015b0 tx=0x7f6e74009040 comp rx=0 tx=0).stop 2024-04-18T05:02:42.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.497+0000 7f6e89aaa640 1 -- 172.21.15.96:0/4165832539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e84152fe0 msgr2=0x7f6e84158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.497+0000 7f6e89aaa640 1 --2- 172.21.15.96:0/4165832539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e84152fe0 0x7f6e84158a60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c01d8c0 tx=0x7f6e7c01bfb0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.497+0000 7f6e89aaa640 1 -- 172.21.15.96:0/4165832539 shutdown_connections 2024-04-18T05:02:42.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.497+0000 7f6e89aaa640 1 --2- 172.21.15.96:0/4165832539 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f6e64066690 0x7f6e64068b50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.497+0000 7f6e89aaa640 1 --2- 172.21.15.96:0/4165832539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e84152fe0 0x7f6e84158a60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.497+0000 7f6e89aaa640 1 --2- 172.21.15.96:0/4165832539 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6e840c9f00 0x7f6e840b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.497+0000 7f6e89aaa640 1 --2- 172.21.15.96:0/4165832539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e840c9160 0x7f6e840b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.497+0000 7f6e89aaa640 1 -- 172.21.15.96:0/4165832539 >> 172.21.15.96:0/4165832539 conn(0x7f6e84071760 msgr2=0x7f6e84065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.497+0000 7f6e89aaa640 1 -- 172.21.15.96:0/4165832539 shutdown_connections 2024-04-18T05:02:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.497+0000 7f6e89aaa640 1 -- 172.21.15.96:0/4165832539 wait complete. 2024-04-18T05:02:42.514 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T05:02:42.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.621+0000 7f76741f1640 1 Processor -- start 2024-04-18T05:02:42.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.621+0000 7f76741f1640 1 -- start start 2024-04-18T05:02:42.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f76741f1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f766c1532d0 0x7f766c158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f76741f1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f766c0c3fd0 0x7f766c0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f76741f1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766c1536b0 con 0x7f766c0cacc0 2024-04-18T05:02:42.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f76741f1640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766c0c5970 con 0x7f766c1532d0 2024-04-18T05:02:42.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f76741f1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c1594a0 con 0x7f766c0c3fd0 2024-04-18T05:02:42.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f767178c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f766c0cacc0 0x7f766c15ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39540/0 (socket says 172.21.15.96:39540) 2024-04-18T05:02:42.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f767178c640 1 -- 172.21.15.96:0/2402483491 learned_addr learned my addr 172.21.15.96:0/2402483491 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:02:42.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7671f8d640 1 --2- 172.21.15.96:0/2402483491 >> v2:172.21.15.139:3300/0 conn(0x7f766c1532d0 0x7f766c158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f767278e640 1 --2- 172.21.15.96:0/2402483491 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f766c0c3fd0 0x7f766c0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7670f8b640 1 -- 172.21.15.96:0/2402483491 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126077980 0 0) 0x7f766c1536b0 con 0x7f766c0cacc0 2024-04-18T05:02:42.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7670f8b640 1 -- 172.21.15.96:0/2402483491 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7658003530 con 0x7f766c0cacc0 2024-04-18T05:02:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7670f8b640 1 -- 172.21.15.96:0/2402483491 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2886170698 0 0) 0x7f7658003530 con 0x7f766c0cacc0 2024-04-18T05:02:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7670f8b640 1 -- 172.21.15.96:0/2402483491 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f766c0c3fd0 msgr2=0x7f766c0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:02:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7670f8b640 1 --2- 172.21.15.96:0/2402483491 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f766c0c3fd0 0x7f766c0ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7670f8b640 1 -- 172.21.15.96:0/2402483491 >> v2:172.21.15.139:3300/0 conn(0x7f766c1532d0 msgr2=0x7f766c158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:02:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7670f8b640 1 --2- 172.21.15.96:0/2402483491 >> v2:172.21.15.139:3300/0 conn(0x7f766c1532d0 0x7f766c158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7670f8b640 1 -- 172.21.15.96:0/2402483491 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c159680 con 0x7f766c0cacc0 2024-04-18T05:02:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7670f8b640 1 -- 172.21.15.96:0/2402483491 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f765c001680 con 0x7f766c0cacc0 2024-04-18T05:02:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7670f8b640 1 -- 172.21.15.96:0/2402483491 >> v1:172.21.15.96:6789/0 conn(0x7f766c0cacc0 legacy=0x7f766c15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7670f8b640 1 --2- 172.21.15.96:0/2402483491 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7658003980 0x7f7658003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7670f8b640 1 --2- 172.21.15.96:0/2402483491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7658004370 0x7f7658004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7670f8b640 1 --2- 172.21.15.96:0/2402483491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7658004ec0 0x7f765800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7670f8b640 1 -- 172.21.15.96:0/2402483491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c0c5970 con 0x7f7658004ec0 2024-04-18T05:02:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7670f8b640 1 -- 172.21.15.96:0/2402483491 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c1594a0 con 0x7f7658004370 2024-04-18T05:02:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7670f8b640 1 -- 172.21.15.96:0/2402483491 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765800bed0 con 0x7f7658003980 2024-04-18T05:02:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7671f8d640 1 --2- 172.21.15.96:0/2402483491 >> v2:172.21.15.139:3300/0 conn(0x7f766c1532d0 0x7f766c158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T05:02:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f767278e640 1 --2- 172.21.15.96:0/2402483491 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f766c0c3fd0 0x7f766c0ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T05:02:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f767278e640 1 --2- 172.21.15.96:0/2402483491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7658004ec0 0x7f765800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f767178c640 1 --2- 172.21.15.96:0/2402483491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7658004370 0x7f7658004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f767278e640 1 -- 172.21.15.96:0/2402483491 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7658003980 msgr2=0x7f7658003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:02:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f7671f8d640 1 --2- 172.21.15.96:0/2402483491 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7658003980 0x7f7658003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f767278e640 1 --2- 172.21.15.96:0/2402483491 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7658003980 0x7f7658003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f767278e640 1 -- 172.21.15.96:0/2402483491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7658004370 msgr2=0x7f7658004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:02:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f767278e640 1 --2- 172.21.15.96:0/2402483491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7658004370 0x7f7658004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f767278e640 1 -- 172.21.15.96:0/2402483491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7658003530 con 0x7f7658004ec0 2024-04-18T05:02:42.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.625+0000 7f767278e640 1 --2- 172.21.15.96:0/2402483491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7658004ec0 0x7f765800b990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f766c072660 tx=0x7f766401cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bfce007ddbe2edb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:42.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f7670f8b640 1 -- 172.21.15.96:0/2402483491 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76640a5d50 con 0x7f7658004ec0 2024-04-18T05:02:42.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f7670f8b640 1 -- 172.21.15.96:0/2402483491 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f766400f040 con 0x7f7658004ec0 2024-04-18T05:02:42.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f7670f8b640 1 -- 172.21.15.96:0/2402483491 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7664003be0 con 0x7f7658004ec0 2024-04-18T05:02:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76741f1640 1 -- 172.21.15.96:0/2402483491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7658004ec0 msgr2=0x7f765800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76741f1640 1 --2- 172.21.15.96:0/2402483491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7658004ec0 0x7f765800b990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f766c072660 tx=0x7f766401cd00 comp rx=0 tx=0).stop 2024-04-18T05:02:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f767278e640 1 -- 172.21.15.96:0/2402483491 reap_dead start 2024-04-18T05:02:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76741f1640 1 -- 172.21.15.96:0/2402483491 shutdown_connections 2024-04-18T05:02:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76741f1640 1 -- 172.21.15.96:0/2402483491 >> 172.21.15.96:0/2402483491 conn(0x7f766c071760 msgr2=0x7f766c06b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76741f1640 1 -- 172.21.15.96:0/2402483491 shutdown_connections 2024-04-18T05:02:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76741f1640 1 -- 172.21.15.96:0/2402483491 wait complete. 2024-04-18T05:02:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76741f1640 1 Processor -- start 2024-04-18T05:02:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76741f1640 1 -- start start 2024-04-18T05:02:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76741f1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7658004ec0 0x7f766c0c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76741f1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f766c158ed0 0x7f766c151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76741f1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f766c153d30 0x7f766c1570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76741f1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c159f20 con 0x7f766c153d30 2024-04-18T05:02:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76741f1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c1ee8b0 con 0x7f7658004ec0 2024-04-18T05:02:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76741f1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c1eeb90 con 0x7f766c158ed0 2024-04-18T05:02:42.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f767278e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f766c153d30 0x7f766c1570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f767278e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f766c153d30 0x7f766c1570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44894/0 (socket says 172.21.15.96:44894) 2024-04-18T05:02:42.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f767278e640 1 -- 172.21.15.96:0/1517903080 learned_addr learned my addr 172.21.15.96:0/1517903080 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:42.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f7671f8d640 1 --2- 172.21.15.96:0/1517903080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7658004ec0 0x7f766c0c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f767178c640 1 --2- 172.21.15.96:0/1517903080 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f766c158ed0 0x7f766c151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f767278e640 1 -- 172.21.15.96:0/1517903080 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f766c158ed0 msgr2=0x7f766c151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f767278e640 1 --2- 172.21.15.96:0/1517903080 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f766c158ed0 0x7f766c151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f767278e640 1 -- 172.21.15.96:0/1517903080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7658004ec0 msgr2=0x7f766c0c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f767278e640 1 --2- 172.21.15.96:0/1517903080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7658004ec0 0x7f766c0c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f767278e640 1 -- 172.21.15.96:0/1517903080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c1eee70 con 0x7f766c153d30 2024-04-18T05:02:42.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f767278e640 1 --2- 172.21.15.96:0/1517903080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f766c153d30 0x7f766c1570b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f766401c770 tx=0x7f7664009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:42.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76627fc640 1 -- 172.21.15.96:0/1517903080 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76640a5b50 con 0x7f766c153d30 2024-04-18T05:02:42.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76627fc640 1 -- 172.21.15.96:0/1517903080 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f76640a5cb0 con 0x7f766c153d30 2024-04-18T05:02:42.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76741f1640 1 -- 172.21.15.96:0/1517903080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766c1ef150 con 0x7f766c153d30 2024-04-18T05:02:42.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76627fc640 1 -- 172.21.15.96:0/1517903080 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7664004250 con 0x7f766c153d30 2024-04-18T05:02:42.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.629+0000 7f76741f1640 1 -- 172.21.15.96:0/1517903080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766c1ee560 con 0x7f766c153d30 2024-04-18T05:02:42.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.633+0000 7f76741f1640 1 -- 172.21.15.96:0/1517903080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766c1ee560 con 0x7f766c153d30 2024-04-18T05:02:42.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.633+0000 7f76627fc640 1 -- 172.21.15.96:0/1517903080 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f76640043b0 con 0x7f766c153d30 2024-04-18T05:02:42.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.633+0000 7f76627fc640 1 --2- 172.21.15.96:0/1517903080 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7650066690 0x7f7650068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.633+0000 7f76627fc640 1 -- 172.21.15.96:0/1517903080 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f766411f870 con 0x7f766c153d30 2024-04-18T05:02:42.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.633+0000 7f7671f8d640 1 --2- 172.21.15.96:0/1517903080 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7650066690 0x7f7650068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.633+0000 7f7671f8d640 1 --2- 172.21.15.96:0/1517903080 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7650066690 0x7f7650068b50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7668009cf0 tx=0x7f7668008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:42.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.637+0000 7f76627fc640 1 -- 172.21.15.96:0/1517903080 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f76640ecbc0 con 0x7f766c153d30 2024-04-18T05:02:42.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.797+0000 7f76741f1640 1 -- 172.21.15.96:0/1517903080 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f766c1ee560 con 0x7f766c153d30 2024-04-18T05:02:42.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.797+0000 7f76627fc640 1 -- 172.21.15.96:0/1517903080 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16090 (secure 0 0 0) 0x7f76640eeaf0 con 0x7f766c153d30 2024-04-18T05:02:42.798 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-18T05:02:42.798 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":23,"fsid":"8d7e5b20-8020-4511-8581-fbe2b42a23db","created":"2024-04-18T04:54:23.931663+0000","modified":"2024-04-18T04:55:39.795060+0000","last_up_change":"2024-04-18T04:54:34.602636+0000","last_in_change":"2024-04-18T04:54:26.227201+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:54:32.641813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:54:39.219441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:54:40.139557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c224c98-68f4-4b58-8fcc-f52da6840a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":27478},{"type":"v1","addr":"172.21.15.96:6801","nonce":27478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":27478},{"type":"v1","addr":"172.21.15.96:6803","nonce":27478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":27478},{"type":"v1","addr":"172.21.15.96:6807","nonce":27478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":27478},{"type":"v1","addr":"172.21.15.96:6805","nonce":27478}]},"public_addr":"172.21.15.96:6801/27478","cluster_addr":"172.21.15.96:6803/27478","heartbeat_back_addr":"172.21.15.96:6807/27478","heartbeat_front_addr":"172.21.15.96:6805/27478","state":["exists","up"]},{"osd":1,"uuid":"f549b00e-f0eb-4405-af21-810ee96bca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":27479},{"type":"v1","addr":"172.21.15.96:6810","nonce":27479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6813","nonce":27479},{"type":"v1","addr":"172.21.15.96:6816","nonce":27479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6825","nonce":27479},{"type":"v1","addr":"172.21.15.96:6828","nonce":27479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":27479},{"type":"v1","addr":"172.21.15.96:6822","nonce":27479}]},"public_addr":"172.21.15.96:6810/27479","cluster_addr":"172.21.15.96:6816/27479","heartbeat_back_addr":"172.21.15.96:6828/27479","heartbeat_front_addr":"172.21.15.96:6822/27479","state":["exists","up"]},{"osd":2,"uuid":"696a7659-c87a-4d40-8b78-a34663f26cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":27481},{"type":"v1","addr":"172.21.15.96:6815","nonce":27481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":27481},{"type":"v1","addr":"172.21.15.96:6821","nonce":27481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":27481},{"type":"v1","addr":"172.21.15.96:6831","nonce":27481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":27481},{"type":"v1","addr":"172.21.15.96:6829","nonce":27481}]},"public_addr":"172.21.15.96:6815/27481","cluster_addr":"172.21.15.96:6821/27481","heartbeat_back_addr":"172.21.15.96:6831/27481","heartbeat_front_addr":"172.21.15.96:6829/27481","state":["exists","up"]},{"osd":3,"uuid":"3478e035-79f8-42c6-8fd3-9bcaa33b81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6809","nonce":27480},{"type":"v1","addr":"172.21.15.96:6812","nonce":27480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":27480},{"type":"v1","addr":"172.21.15.96:6817","nonce":27480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":27480},{"type":"v1","addr":"172.21.15.96:6827","nonce":27480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":27480},{"type":"v1","addr":"172.21.15.96:6823","nonce":27480}]},"public_addr":"172.21.15.96:6812/27480","cluster_addr":"172.21.15.96:6817/27480","heartbeat_back_addr":"172.21.15.96:6827/27480","heartbeat_front_addr":"172.21.15.96:6823/27480","state":["exists","up"]},{"osd":4,"uuid":"153e8e45-7303-4173-97ab-f99f7243c9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":27649},{"type":"v1","addr":"172.21.15.139:6825","nonce":27649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":27649},{"type":"v1","addr":"172.21.15.139:6827","nonce":27649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":27649},{"type":"v1","addr":"172.21.15.139:6831","nonce":27649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":27649},{"type":"v1","addr":"172.21.15.139:6829","nonce":27649}]},"public_addr":"172.21.15.139:6825/27649","cluster_addr":"172.21.15.139:6827/27649","heartbeat_back_addr":"172.21.15.139:6831/27649","heartbeat_front_addr":"172.21.15.139:6829/27649","state":["exists","up"]},{"osd":5,"uuid":"3c75746b-7345-48b7-8c5d-22cd241b77c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":27647},{"type":"v1","addr":"172.21.15.139:6806","nonce":27647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":27647},{"type":"v1","addr":"172.21.15.139:6809","nonce":27647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":27647},{"type":"v1","addr":"172.21.15.139:6815","nonce":27647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6811","nonce":27647},{"type":"v1","addr":"172.21.15.139:6813","nonce":27647}]},"public_addr":"172.21.15.139:6806/27647","cluster_addr":"172.21.15.139:6809/27647","heartbeat_back_addr":"172.21.15.139:6815/27647","heartbeat_front_addr":"172.21.15.139:6813/27647","state":["exists","up"]},{"osd":6,"uuid":"874be4c3-b94e-40f8-8cc9-cc5782741a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":27650},{"type":"v1","addr":"172.21.15.139:6817","nonce":27650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":27650},{"type":"v1","addr":"172.21.15.139:6819","nonce":27650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":27650},{"type":"v1","addr":"172.21.15.139:6823","nonce":27650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":27650},{"type":"v1","addr":"172.21.15.139:6821","nonce":27650}]},"public_addr":"172.21.15.139:6817/27650","cluster_addr":"172.21.15.139:6819/27650","heartbeat_back_addr":"172.21.15.139:6823/27650","heartbeat_front_addr":"172.21.15.139:6821/27650","state":["exists","up"]},{"osd":7,"uuid":"7e1bf3d6-f0b9-48e1-a8b8-7fb47eb786d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":27648},{"type":"v1","addr":"172.21.15.139:6801","nonce":27648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":27648},{"type":"v1","addr":"172.21.15.139:6803","nonce":27648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":27648},{"type":"v1","addr":"172.21.15.139:6812","nonce":27648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":27648},{"type":"v1","addr":"172.21.15.139:6807","nonce":27648}]},"public_addr":"172.21.15.139:6801/27648","cluster_addr":"172.21.15.139:6803/27648","heartbeat_back_addr":"172.21.15.139:6812/27648","heartbeat_front_addr":"172.21.15.139:6807/27648","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.720340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.767224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.548270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.811511+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:32.303124+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.710188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.860525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:54:31.704784+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1b","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T05:02:42.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.801+0000 7f76741f1640 1 -- 172.21.15.96:0/1517903080 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7650066690 msgr2=0x7f7650068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.801+0000 7f76741f1640 1 --2- 172.21.15.96:0/1517903080 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7650066690 0x7f7650068b50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7668009cf0 tx=0x7f7668008040 comp rx=0 tx=0).stop 2024-04-18T05:02:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.801+0000 7f76741f1640 1 -- 172.21.15.96:0/1517903080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f766c153d30 msgr2=0x7f766c1570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.801+0000 7f76741f1640 1 --2- 172.21.15.96:0/1517903080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f766c153d30 0x7f766c1570b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f766401c770 tx=0x7f7664009750 comp rx=0 tx=0).stop 2024-04-18T05:02:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.801+0000 7f76741f1640 1 -- 172.21.15.96:0/1517903080 shutdown_connections 2024-04-18T05:02:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.801+0000 7f76741f1640 1 --2- 172.21.15.96:0/1517903080 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f7650066690 0x7f7650068b50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.801+0000 7f76741f1640 1 --2- 172.21.15.96:0/1517903080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f766c153d30 0x7f766c1570b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.801+0000 7f76741f1640 1 --2- 172.21.15.96:0/1517903080 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f766c158ed0 0x7f766c151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.801+0000 7f76741f1640 1 --2- 172.21.15.96:0/1517903080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7658004ec0 0x7f766c0c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.801+0000 7f76741f1640 1 -- 172.21.15.96:0/1517903080 >> 172.21.15.96:0/1517903080 conn(0x7f766c071760 msgr2=0x7f766c0cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.801+0000 7f76741f1640 1 -- 172.21.15.96:0/1517903080 shutdown_connections 2024-04-18T05:02:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.801+0000 7f76741f1640 1 -- 172.21.15.96:0/1517903080 wait complete. 2024-04-18T05:02:42.817 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-18T05:02:42.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a51bab640 1 Processor -- start 2024-04-18T05:02:42.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a51bab640 1 -- start start 2024-04-18T05:02:42.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a51bab640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9a4c0c5b30 0x7f9a4c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a51bab640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9a4c0c6670 0x7f9a4c157620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a51bab640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4c06c650 con 0x7f9a4c15a270 2024-04-18T05:02:42.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a51bab640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4c157200 con 0x7f9a4c0c5b30 2024-04-18T05:02:42.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a51bab640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0c6450 con 0x7f9a4c0c6670 2024-04-18T05:02:42.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a4b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9a4c0c5b30 0x7f9a4c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a4b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9a4c0c5b30 0x7f9a4c0c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44910/0 (socket says 172.21.15.96:44910) 2024-04-18T05:02:42.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a4b7fe640 1 -- 172.21.15.96:0/3359571604 learned_addr learned my addr 172.21.15.96:0/3359571604 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:42.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a4bfff640 1 --2- 172.21.15.96:0/3359571604 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9a4c0c6670 0x7f9a4c157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a4b7fe640 1 -- 172.21.15.96:0/3359571604 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9a4c0c6670 msgr2=0x7f9a4c157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:02:42.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a4b7fe640 1 --2- 172.21.15.96:0/3359571604 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9a4c0c6670 0x7f9a4c157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a4b7fe640 1 -- 172.21.15.96:0/3359571604 >> v1:172.21.15.96:6789/0 conn(0x7f9a4c15a270 legacy=0x7f9a4c0c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a4b7fe640 1 -- 172.21.15.96:0/3359571604 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c0c1500 con 0x7f9a4c0c5b30 2024-04-18T05:02:42.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a4bfff640 1 --2- 172.21.15.96:0/3359571604 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9a4c0c6670 0x7f9a4c157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T05:02:42.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.941+0000 7f9a4a7fc640 1 -- 172.21.15.96:0/3359571604 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903237006 0 0) 0x7f9a4c06c650 con 0x7f9a4c15a270 2024-04-18T05:02:42.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a4b7fe640 1 --2- 172.21.15.96:0/3359571604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a4c0c5b30 0x7f9a4c0c5f10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009870 tx=0x7f9a3c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b64bdb59849f7e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:42.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a4a7fc640 1 -- 172.21.15.96:0/3359571604 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0a8a50 con 0x7f9a4c0c5b30 2024-04-18T05:02:42.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a4a7fc640 1 -- 172.21.15.96:0/3359571604 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9a3c0a8bb0 con 0x7f9a4c0c5b30 2024-04-18T05:02:42.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a4a7fc640 1 -- 172.21.15.96:0/3359571604 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0b0440 con 0x7f9a4c0c5b30 2024-04-18T05:02:42.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a51bab640 1 -- 172.21.15.96:0/3359571604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a4c0c5b30 msgr2=0x7f9a4c0c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a51bab640 1 --2- 172.21.15.96:0/3359571604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a4c0c5b30 0x7f9a4c0c5f10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009870 tx=0x7f9a3c01ed50 comp rx=0 tx=0).stop 2024-04-18T05:02:42.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a51bab640 1 -- 172.21.15.96:0/3359571604 shutdown_connections 2024-04-18T05:02:42.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a51bab640 1 --2- 172.21.15.96:0/3359571604 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9a4c0c6670 0x7f9a4c157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a51bab640 1 --2- 172.21.15.96:0/3359571604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a4c0c5b30 0x7f9a4c0c5f10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a51bab640 1 -- 172.21.15.96:0/3359571604 >> 172.21.15.96:0/3359571604 conn(0x7f9a4c06a8e0 msgr2=0x7f9a4c0c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:42.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a51bab640 1 -- 172.21.15.96:0/3359571604 shutdown_connections 2024-04-18T05:02:42.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a51bab640 1 -- 172.21.15.96:0/3359571604 wait complete. 2024-04-18T05:02:42.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a51bab640 1 Processor -- start 2024-04-18T05:02:42.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a51bab640 1 -- start start 2024-04-18T05:02:42.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a51bab640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a4c0c5b30 0x7f9a4c0bf250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a51bab640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9a4c0c6670 0x7f9a4c14a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a51bab640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a4c15a270 0x7f9a4c147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a51bab640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c14ade0 con 0x7f9a4c0c5b30 2024-04-18T05:02:42.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a51bab640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0c81a0 con 0x7f9a4c15a270 2024-04-18T05:02:42.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a51bab640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c14ab00 con 0x7f9a4c0c6670 2024-04-18T05:02:42.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a4b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a4c0c5b30 0x7f9a4c0bf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a4b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a4c0c5b30 0x7f9a4c0bf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44920/0 (socket says 172.21.15.96:44920) 2024-04-18T05:02:42.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a4b7fe640 1 -- 172.21.15.96:0/2170866781 learned_addr learned my addr 172.21.15.96:0/2170866781 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:42.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a4b7fe640 1 -- 172.21.15.96:0/2170866781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9a4c0c6670 msgr2=0x7f9a4c14a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a4bfff640 1 --2- 172.21.15.96:0/2170866781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a4c15a270 0x7f9a4c147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a4affd640 1 --2- 172.21.15.96:0/2170866781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9a4c0c6670 0x7f9a4c14a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a4b7fe640 1 --2- 172.21.15.96:0/2170866781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9a4c0c6670 0x7f9a4c14a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a4b7fe640 1 -- 172.21.15.96:0/2170866781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a4c15a270 msgr2=0x7f9a4c147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:42.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a4b7fe640 1 --2- 172.21.15.96:0/2170866781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a4c15a270 0x7f9a4c147c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:42.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a4b7fe640 1 -- 172.21.15.96:0/2170866781 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c0094d0 con 0x7f9a4c0c5b30 2024-04-18T05:02:42.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.945+0000 7f9a4b7fe640 1 --2- 172.21.15.96:0/2170866781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a4c0c5b30 0x7f9a4c0bf250 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0097c0 tx=0x7f9a3c01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:42.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.949+0000 7f9a33fff640 1 -- 172.21.15.96:0/2170866781 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0b9630 con 0x7f9a4c0c5b30 2024-04-18T05:02:42.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.949+0000 7f9a33fff640 1 -- 172.21.15.96:0/2170866781 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9a3c0b9790 con 0x7f9a4c0c5b30 2024-04-18T05:02:42.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.949+0000 7f9a51bab640 1 -- 172.21.15.96:0/2170866781 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4c1ecff0 con 0x7f9a4c0c5b30 2024-04-18T05:02:42.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.949+0000 7f9a33fff640 1 -- 172.21.15.96:0/2170866781 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0b9b60 con 0x7f9a4c0c5b30 2024-04-18T05:02:42.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.949+0000 7f9a51bab640 1 -- 172.21.15.96:0/2170866781 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4c0bf790 con 0x7f9a4c0c5b30 2024-04-18T05:02:42.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.949+0000 7f9a51bab640 1 -- 172.21.15.96:0/2170866781 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4c0670f0 con 0x7f9a4c0c5b30 2024-04-18T05:02:42.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.949+0000 7f9a33fff640 1 -- 172.21.15.96:0/2170866781 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9a3c0b7040 con 0x7f9a4c0c5b30 2024-04-18T05:02:42.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.949+0000 7f9a33fff640 1 --2- 172.21.15.96:0/2170866781 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9a38066690 0x7f9a38068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:42.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.949+0000 7f9a33fff640 1 -- 172.21.15.96:0/2170866781 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f9a3c1221f0 con 0x7f9a4c0c5b30 2024-04-18T05:02:42.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.949+0000 7f9a4affd640 1 --2- 172.21.15.96:0/2170866781 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9a38066690 0x7f9a38068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:42.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.949+0000 7f9a4affd640 1 --2- 172.21.15.96:0/2170866781 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9a38066690 0x7f9a38068b50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c14b5e0 tx=0x7f9a40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:42.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:42.953+0000 7f9a33fff640 1 -- 172.21.15.96:0/2170866781 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9a3c0ef5d0 con 0x7f9a4c0c5b30 2024-04-18T05:02:43.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.145+0000 7f9a51bab640 1 -- 172.21.15.96:0/2170866781 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9a4c0c5910 con 0x7f9a4c0c5b30 2024-04-18T05:02:43.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.161+0000 7f9a33fff640 1 -- 172.21.15.96:0/2170866781 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9a3c0f2bf0 con 0x7f9a4c0c5b30 2024-04-18T05:02:43.162 INFO:teuthology.orchestra.run.smithi096.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-18T05:02:43.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.165+0000 7f9a51bab640 1 -- 172.21.15.96:0/2170866781 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9a38066690 msgr2=0x7f9a38068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:43.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.165+0000 7f9a51bab640 1 --2- 172.21.15.96:0/2170866781 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9a38066690 0x7f9a38068b50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c14b5e0 tx=0x7f9a40009040 comp rx=0 tx=0).stop 2024-04-18T05:02:43.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.165+0000 7f9a51bab640 1 -- 172.21.15.96:0/2170866781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a4c0c5b30 msgr2=0x7f9a4c0bf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:43.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.165+0000 7f9a51bab640 1 --2- 172.21.15.96:0/2170866781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a4c0c5b30 0x7f9a4c0bf250 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0097c0 tx=0x7f9a3c01baf0 comp rx=0 tx=0).stop 2024-04-18T05:02:43.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.165+0000 7f9a51bab640 1 -- 172.21.15.96:0/2170866781 shutdown_connections 2024-04-18T05:02:43.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.165+0000 7f9a51bab640 1 --2- 172.21.15.96:0/2170866781 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f9a38066690 0x7f9a38068b50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:43.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.165+0000 7f9a51bab640 1 --2- 172.21.15.96:0/2170866781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a4c15a270 0x7f9a4c147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:43.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.165+0000 7f9a51bab640 1 --2- 172.21.15.96:0/2170866781 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9a4c0c6670 0x7f9a4c14a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:43.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.165+0000 7f9a51bab640 1 --2- 172.21.15.96:0/2170866781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a4c0c5b30 0x7f9a4c0bf250 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:43.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.165+0000 7f9a51bab640 1 -- 172.21.15.96:0/2170866781 >> 172.21.15.96:0/2170866781 conn(0x7f9a4c06a8e0 msgr2=0x7f9a4c0c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:43.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.165+0000 7f9a51bab640 1 -- 172.21.15.96:0/2170866781 shutdown_connections 2024-04-18T05:02:43.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.165+0000 7f9a51bab640 1 -- 172.21.15.96:0/2170866781 wait complete. 2024-04-18T05:02:43.181 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-18T05:02:43.199 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2024-04-18T05:02:43.211 INFO:tasks.ceph.mds.e.smithi096.stdout:starting mds.e at 2024-04-18T05:02:43.246 INFO:tasks.ceph.mds.f.smithi139.stdout:starting mds.f at 2024-04-18T05:02:43.258 INFO:tasks.ceph.mds.b.smithi139.stdout:starting mds.b at 2024-04-18T05:02:43.259 INFO:tasks.ceph.mds.d.smithi139.stdout:starting mds.d at 2024-04-18T05:02:43.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f4491537640 1 Processor -- start 2024-04-18T05:02:43.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f4491537640 1 -- start start 2024-04-18T05:02:43.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f4491537640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f448c153050 0x7f448c0cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:43.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f4491537640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f448c0cd0a0 0x7f448c06fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:43.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f4491537640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f448c070010 0x7f448c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:43.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f4491537640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448c06ca90 con 0x7f448c0cd0a0 2024-04-18T05:02:43.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f4491537640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448c15c5a0 con 0x7f448c070010 2024-04-18T05:02:43.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f4491537640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c0ca460 con 0x7f448c153050 2024-04-18T05:02:43.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f448a7fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f448c0cd0a0 0x7f448c06fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:43.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f448a7fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f448c0cd0a0 0x7f448c06fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44960/0 (socket says 172.21.15.96:44960) 2024-04-18T05:02:43.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f448a7fc640 1 -- 172.21.15.96:0/3909512953 learned_addr learned my addr 172.21.15.96:0/3909512953 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:43.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f448b7fe640 1 --2- 172.21.15.96:0/3909512953 >> v2:172.21.15.139:3300/0 conn(0x7f448c070010 0x7f448c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:43.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f448affd640 1 --2- 172.21.15.96:0/3909512953 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f448c153050 0x7f448c0cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:43.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f448a7fc640 1 -- 172.21.15.96:0/3909512953 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f448c153050 msgr2=0x7f448c0cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:02:43.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f448a7fc640 1 --2- 172.21.15.96:0/3909512953 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f448c153050 0x7f448c0cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:43.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f448a7fc640 1 -- 172.21.15.96:0/3909512953 >> v2:172.21.15.139:3300/0 conn(0x7f448c070010 msgr2=0x7f448c15ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:02:43.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f448a7fc640 1 --2- 172.21.15.96:0/3909512953 >> v2:172.21.15.139:3300/0 conn(0x7f448c070010 0x7f448c15ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:43.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f448a7fc640 1 -- 172.21.15.96:0/3909512953 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c159dd0 con 0x7f448c0cd0a0 2024-04-18T05:02:43.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f448affd640 1 --2- 172.21.15.96:0/3909512953 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f448c153050 0x7f448c0cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T05:02:43.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f448a7fc640 1 --2- 172.21.15.96:0/3909512953 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f448c0cd0a0 0x7f448c06fad0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f448c06d730 tx=0x7f448001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46dcaf61e98b279d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:43.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f4489ffb640 1 -- 172.21.15.96:0/3909512953 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800a89d0 con 0x7f448c0cd0a0 2024-04-18T05:02:43.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f4489ffb640 1 -- 172.21.15.96:0/3909512953 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f44800a8b30 con 0x7f448c0cd0a0 2024-04-18T05:02:43.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.297+0000 7f4489ffb640 1 -- 172.21.15.96:0/3909512953 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800b0440 con 0x7f448c0cd0a0 2024-04-18T05:02:43.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 -- 172.21.15.96:0/3909512953 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f448c0cd0a0 msgr2=0x7f448c06fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:43.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 --2- 172.21.15.96:0/3909512953 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f448c0cd0a0 0x7f448c06fad0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f448c06d730 tx=0x7f448001ed10 comp rx=0 tx=0).stop 2024-04-18T05:02:43.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 -- 172.21.15.96:0/3909512953 shutdown_connections 2024-04-18T05:02:43.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 --2- 172.21.15.96:0/3909512953 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f448c0cd0a0 0x7f448c06fad0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:43.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 --2- 172.21.15.96:0/3909512953 >> v2:172.21.15.139:3300/0 conn(0x7f448c070010 0x7f448c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:43.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 --2- 172.21.15.96:0/3909512953 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f448c153050 0x7f448c0cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:43.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 -- 172.21.15.96:0/3909512953 >> 172.21.15.96:0/3909512953 conn(0x7f448c069e60 msgr2=0x7f448c06de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:43.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 -- 172.21.15.96:0/3909512953 shutdown_connections 2024-04-18T05:02:43.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 -- 172.21.15.96:0/3909512953 wait complete. 2024-04-18T05:02:43.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 Processor -- start 2024-04-18T05:02:43.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 -- start start 2024-04-18T05:02:43.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f448c070010 0x7f448c1e37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:43.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f448c0cd0a0 0x7f448c1eee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:43.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f448c153050 0x7f448c0cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:43.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c14a4f0 con 0x7f448c070010 2024-04-18T05:02:43.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c1567f0 con 0x7f448c0cd0a0 2024-04-18T05:02:43.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c156ad0 con 0x7f448c153050 2024-04-18T05:02:43.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f448affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f448c070010 0x7f448c1e37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:43.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f448affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f448c070010 0x7f448c1e37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44966/0 (socket says 172.21.15.96:44966) 2024-04-18T05:02:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f448affd640 1 -- 172.21.15.96:0/2503025878 learned_addr learned my addr 172.21.15.96:0/2503025878 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f448b7fe640 1 --2- 172.21.15.96:0/2503025878 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f448c153050 0x7f448c0cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f448a7fc640 1 --2- 172.21.15.96:0/2503025878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f448c0cd0a0 0x7f448c1eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f448affd640 1 -- 172.21.15.96:0/2503025878 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f448c153050 msgr2=0x7f448c0cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f448affd640 1 --2- 172.21.15.96:0/2503025878 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f448c153050 0x7f448c0cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f448affd640 1 -- 172.21.15.96:0/2503025878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f448c0cd0a0 msgr2=0x7f448c1eee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f448affd640 1 --2- 172.21.15.96:0/2503025878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f448c0cd0a0 0x7f448c1eee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f448affd640 1 -- 172.21.15.96:0/2503025878 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44800094d0 con 0x7f448c070010 2024-04-18T05:02:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f448b7fe640 1 --2- 172.21.15.96:0/2503025878 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f448c153050 0x7f448c0cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T05:02:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f448affd640 1 --2- 172.21.15.96:0/2503025878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f448c070010 0x7f448c1e37a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f447c00d800 tx=0x7f447c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f44737fe640 1 -- 172.21.15.96:0/2503025878 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c0096c0 con 0x7f448c070010 2024-04-18T05:02:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f44737fe640 1 -- 172.21.15.96:0/2503025878 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f447c009820 con 0x7f448c070010 2024-04-18T05:02:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f44737fe640 1 -- 172.21.15.96:0/2503025878 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c009bf0 con 0x7f448c070010 2024-04-18T05:02:43.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 -- 172.21.15.96:0/2503025878 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448c1ee600 con 0x7f448c070010 2024-04-18T05:02:43.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 -- 172.21.15.96:0/2503025878 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448c14e370 con 0x7f448c070010 2024-04-18T05:02:43.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.301+0000 7f4491537640 1 -- 172.21.15.96:0/2503025878 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f448c067050 con 0x7f448c070010 2024-04-18T05:02:43.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.305+0000 7f44737fe640 1 -- 172.21.15.96:0/2503025878 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f447c009d50 con 0x7f448c070010 2024-04-18T05:02:43.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.305+0000 7f44737fe640 1 --2- 172.21.15.96:0/2503025878 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4478066690 0x7f4478068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:43.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.305+0000 7f44737fe640 1 -- 172.21.15.96:0/2503025878 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6168+0+0 (secure 0 0 0) 0x7f447c084bc0 con 0x7f448c070010 2024-04-18T05:02:43.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.305+0000 7f448a7fc640 1 --2- 172.21.15.96:0/2503025878 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4478066690 0x7f4478068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:43.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.305+0000 7f448a7fc640 1 --2- 172.21.15.96:0/2503025878 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4478066690 0x7f4478068b50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f44800b2000 tx=0x7f4480008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:43.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.309+0000 7f44737fe640 1 -- 172.21.15.96:0/2503025878 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f447c051c20 con 0x7f448c070010 2024-04-18T05:02:43.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:43.493+0000 7f4491537640 1 -- 172.21.15.96:0/2503025878 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f448c148cf0 con 0x7f448c070010 2024-04-18T05:02:44.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.165+0000 7f44737fe640 1 -- 172.21.15.96:0/2503025878 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f447c053b50 con 0x7f448c070010 2024-04-18T05:02:44.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.169+0000 7f4491537640 1 -- 172.21.15.96:0/2503025878 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4478066690 msgr2=0x7f4478068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:44.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.169+0000 7f4491537640 1 --2- 172.21.15.96:0/2503025878 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4478066690 0x7f4478068b50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f44800b2000 tx=0x7f4480008040 comp rx=0 tx=0).stop 2024-04-18T05:02:44.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.169+0000 7f4491537640 1 -- 172.21.15.96:0/2503025878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f448c070010 msgr2=0x7f448c1e37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:44.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.169+0000 7f4491537640 1 --2- 172.21.15.96:0/2503025878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f448c070010 0x7f448c1e37a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f447c00d800 tx=0x7f447c00dcc0 comp rx=0 tx=0).stop 2024-04-18T05:02:44.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.169+0000 7f4491537640 1 -- 172.21.15.96:0/2503025878 shutdown_connections 2024-04-18T05:02:44.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.169+0000 7f4491537640 1 --2- 172.21.15.96:0/2503025878 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f4478066690 0x7f4478068b50 secure :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f44800b2000 tx=0x7f4480008040 comp rx=0 tx=0).stop 2024-04-18T05:02:44.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.169+0000 7f4491537640 1 --2- 172.21.15.96:0/2503025878 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f448c153050 0x7f448c0cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:44.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.169+0000 7f4491537640 1 --2- 172.21.15.96:0/2503025878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f448c0cd0a0 0x7f448c1eee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:44.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.169+0000 7f4491537640 1 --2- 172.21.15.96:0/2503025878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f448c070010 0x7f448c1e37a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:44.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.169+0000 7f4491537640 1 -- 172.21.15.96:0/2503025878 >> 172.21.15.96:0/2503025878 conn(0x7f448c069e60 msgr2=0x7f448c1494f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:44.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.169+0000 7f4491537640 1 -- 172.21.15.96:0/2503025878 shutdown_connections 2024-04-18T05:02:44.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.169+0000 7f4491537640 1 -- 172.21.15.96:0/2503025878 wait complete. 2024-04-18T05:02:44.188 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-18T05:02:44.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.361+0000 7faf6181f640 1 Processor -- start 2024-04-18T05:02:44.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.361+0000 7faf6181f640 1 -- start start 2024-04-18T05:02:44.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.361+0000 7faf6181f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf5c1532d0 0x7faf5c158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:44.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.361+0000 7faf6181f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faf5c0c3fd0 0x7faf5c0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:44.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.361+0000 7faf6181f640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5c1536b0 con 0x7faf5c0cacc0 2024-04-18T05:02:44.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.361+0000 7faf6181f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5c0c5970 con 0x7faf5c0c3fd0 2024-04-18T05:02:44.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.361+0000 7faf6181f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c1594a0 con 0x7faf5c1532d0 2024-04-18T05:02:44.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.361+0000 7faf5b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faf5c0c3fd0 0x7faf5c0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:44.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.361+0000 7faf5b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faf5c0c3fd0 0x7faf5c0ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44968/0 (socket says 172.21.15.96:44968) 2024-04-18T05:02:44.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.361+0000 7faf5b7fe640 1 -- 172.21.15.96:0/3984110129 learned_addr learned my addr 172.21.15.96:0/3984110129 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:44.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.361+0000 7faf5affd640 1 --2- 172.21.15.96:0/3984110129 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf5c1532d0 0x7faf5c158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:44.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.361+0000 7faf5b7fe640 1 -- 172.21.15.96:0/3984110129 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf5c1532d0 msgr2=0x7faf5c158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:02:44.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.361+0000 7faf5b7fe640 1 --2- 172.21.15.96:0/3984110129 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf5c1532d0 0x7faf5c158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:44.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.361+0000 7faf5b7fe640 1 -- 172.21.15.96:0/3984110129 >> v1:172.21.15.139:6789/0 conn(0x7faf5c0cacc0 legacy=0x7faf5c15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:44.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.361+0000 7faf5b7fe640 1 -- 172.21.15.96:0/3984110129 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c159680 con 0x7faf5c0c3fd0 2024-04-18T05:02:44.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.365+0000 7faf5b7fe640 1 --2- 172.21.15.96:0/3984110129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf5c0c3fd0 0x7faf5c0ce740 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faf54009e50 tx=0x7faf5401f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07517982cf08a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:44.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.365+0000 7faf5a7fc640 1 -- 172.21.15.96:0/3984110129 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540af400 con 0x7faf5c0c3fd0 2024-04-18T05:02:44.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.365+0000 7faf5a7fc640 1 -- 172.21.15.96:0/3984110129 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faf540ab050 con 0x7faf5c0c3fd0 2024-04-18T05:02:44.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.365+0000 7faf5a7fc640 1 -- 172.21.15.96:0/3984110129 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540af7a0 con 0x7faf5c0c3fd0 2024-04-18T05:02:44.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.365+0000 7faf6181f640 1 -- 172.21.15.96:0/3984110129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf5c0c3fd0 msgr2=0x7faf5c0ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:44.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.365+0000 7faf6181f640 1 --2- 172.21.15.96:0/3984110129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf5c0c3fd0 0x7faf5c0ce740 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faf54009e50 tx=0x7faf5401f210 comp rx=0 tx=0).stop 2024-04-18T05:02:44.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.365+0000 7faf6181f640 1 -- 172.21.15.96:0/3984110129 shutdown_connections 2024-04-18T05:02:44.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.365+0000 7faf6181f640 1 --2- 172.21.15.96:0/3984110129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf5c0c3fd0 0x7faf5c0ce740 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:44.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.365+0000 7faf6181f640 1 --2- 172.21.15.96:0/3984110129 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf5c1532d0 0x7faf5c158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:44.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.365+0000 7faf6181f640 1 -- 172.21.15.96:0/3984110129 >> 172.21.15.96:0/3984110129 conn(0x7faf5c071760 msgr2=0x7faf5c06b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:44.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.365+0000 7faf6181f640 1 -- 172.21.15.96:0/3984110129 shutdown_connections 2024-04-18T05:02:44.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.365+0000 7faf6181f640 1 -- 172.21.15.96:0/3984110129 wait complete. 2024-04-18T05:02:44.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.365+0000 7faf6181f640 1 Processor -- start 2024-04-18T05:02:44.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.365+0000 7faf6181f640 1 -- start start 2024-04-18T05:02:44.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf6181f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf5c0c3fd0 0x7faf5c14daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:44.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf6181f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf5c0cacc0 0x7faf5c15bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:44.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf6181f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf5c1532d0 0x7faf5c14efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:44.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf6181f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c159f20 con 0x7faf5c0cacc0 2024-04-18T05:02:44.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf6181f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c158fc0 con 0x7faf5c0c3fd0 2024-04-18T05:02:44.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf6181f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c14eba0 con 0x7faf5c1532d0 2024-04-18T05:02:44.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf527fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf5c0cacc0 0x7faf5c15bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:44.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf527fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf5c0cacc0 0x7faf5c15bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44970/0 (socket says 172.21.15.96:44970) 2024-04-18T05:02:44.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf527fc640 1 -- 172.21.15.96:0/3422778071 learned_addr learned my addr 172.21.15.96:0/3422778071 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:44.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf5affd640 1 --2- 172.21.15.96:0/3422778071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf5c0c3fd0 0x7faf5c14daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:44.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf5b7fe640 1 --2- 172.21.15.96:0/3422778071 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf5c1532d0 0x7faf5c14efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:44.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf527fc640 1 -- 172.21.15.96:0/3422778071 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf5c1532d0 msgr2=0x7faf5c14efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:44.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf527fc640 1 --2- 172.21.15.96:0/3422778071 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf5c1532d0 0x7faf5c14efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:44.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf527fc640 1 -- 172.21.15.96:0/3422778071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf5c0c3fd0 msgr2=0x7faf5c14daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:44.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf527fc640 1 --2- 172.21.15.96:0/3422778071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf5c0c3fd0 0x7faf5c14daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:44.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf527fc640 1 -- 172.21.15.96:0/3422778071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf54009b30 con 0x7faf5c0cacc0 2024-04-18T05:02:44.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf527fc640 1 --2- 172.21.15.96:0/3422778071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf5c0cacc0 0x7faf5c15bbc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faf4400c500 tx=0x7faf4400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:44.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf58ff9640 1 -- 172.21.15.96:0/3422778071 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf440052d0 con 0x7faf5c0cacc0 2024-04-18T05:02:44.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf58ff9640 1 -- 172.21.15.96:0/3422778071 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faf44005430 con 0x7faf5c0cacc0 2024-04-18T05:02:44.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf6181f640 1 -- 172.21.15.96:0/3422778071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5c157e20 con 0x7faf5c0cacc0 2024-04-18T05:02:44.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf58ff9640 1 -- 172.21.15.96:0/3422778071 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf44012850 con 0x7faf5c0cacc0 2024-04-18T05:02:44.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf6181f640 1 -- 172.21.15.96:0/3422778071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c153a70 con 0x7faf5c0cacc0 2024-04-18T05:02:44.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf6181f640 1 -- 172.21.15.96:0/3422778071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5c14ece0 con 0x7faf5c0cacc0 2024-04-18T05:02:44.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf58ff9640 1 -- 172.21.15.96:0/3422778071 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf440129b0 con 0x7faf5c0cacc0 2024-04-18T05:02:44.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf58ff9640 1 --2- 172.21.15.96:0/3422778071 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faf3c0666c0 0x7faf3c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:44.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf5affd640 1 --2- 172.21.15.96:0/3422778071 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faf3c0666c0 0x7faf3c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:44.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf58ff9640 1 -- 172.21.15.96:0/3422778071 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6168+0+0 (secure 0 0 0) 0x7faf44083ec0 con 0x7faf5c0cacc0 2024-04-18T05:02:44.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.369+0000 7faf5affd640 1 --2- 172.21.15.96:0/3422778071 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faf3c0666c0 0x7faf3c068b80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00b930 tx=0x7faf4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:44.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.373+0000 7faf58ff9640 1 -- 172.21.15.96:0/3422778071 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7faf5c14ece0 con 0x7faf5c0cacc0 2024-04-18T05:02:44.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:44.537+0000 7faf6181f640 1 -- 172.21.15.96:0/3422778071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faf5c14ece0 con 0x7faf5c0cacc0 2024-04-18T05:02:45.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.173+0000 7faf58ff9640 1 -- 172.21.15.96:0/3422778071 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7faf5c14ece0 con 0x7faf5c0cacc0 2024-04-18T05:02:45.174 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' removed 2024-04-18T05:02:45.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.177+0000 7faf6181f640 1 -- 172.21.15.96:0/3422778071 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faf3c0666c0 msgr2=0x7faf3c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:45.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.177+0000 7faf6181f640 1 --2- 172.21.15.96:0/3422778071 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faf3c0666c0 0x7faf3c068b80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00b930 tx=0x7faf4c008040 comp rx=0 tx=0).stop 2024-04-18T05:02:45.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.177+0000 7faf6181f640 1 -- 172.21.15.96:0/3422778071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf5c0cacc0 msgr2=0x7faf5c15bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:45.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.177+0000 7faf6181f640 1 --2- 172.21.15.96:0/3422778071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf5c0cacc0 0x7faf5c15bbc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faf4400c500 tx=0x7faf4400c9c0 comp rx=0 tx=0).stop 2024-04-18T05:02:45.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.177+0000 7faf6181f640 1 -- 172.21.15.96:0/3422778071 shutdown_connections 2024-04-18T05:02:45.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.177+0000 7faf6181f640 1 --2- 172.21.15.96:0/3422778071 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7faf3c0666c0 0x7faf3c068b80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:45.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.177+0000 7faf6181f640 1 --2- 172.21.15.96:0/3422778071 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf5c1532d0 0x7faf5c14efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:45.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.177+0000 7faf6181f640 1 --2- 172.21.15.96:0/3422778071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf5c0cacc0 0x7faf5c15bbc0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:45.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.177+0000 7faf6181f640 1 --2- 172.21.15.96:0/3422778071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf5c0c3fd0 0x7faf5c14daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:45.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.177+0000 7faf6181f640 1 -- 172.21.15.96:0/3422778071 >> 172.21.15.96:0/3422778071 conn(0x7faf5c071760 msgr2=0x7faf5c0c94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:45.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.177+0000 7faf6181f640 1 -- 172.21.15.96:0/3422778071 shutdown_connections 2024-04-18T05:02:45.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.177+0000 7faf6181f640 1 -- 172.21.15.96:0/3422778071 wait complete. 2024-04-18T05:02:45.201 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-18T05:02:45.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3cd4cb4640 1 Processor -- start 2024-04-18T05:02:45.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3cd4cb4640 1 -- start start 2024-04-18T05:02:45.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3cd4cb4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3cd00c3650 0x7f3cd00c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:45.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3cd4cb4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd00c8100 con 0x7f3cd0155d00 2024-04-18T05:02:45.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3cd4cb4640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd00c5660 con 0x7f3cd014fc60 2024-04-18T05:02:45.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3cd4cb4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00c8350 con 0x7f3cd00c3650 2024-04-18T05:02:45.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccdd9b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f3cd0155d00 0x7f3cd0156170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39580/0 (socket says 172.21.15.96:39580) 2024-04-18T05:02:45.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccdd9b640 1 -- 172.21.15.96:0/3052030254 learned_addr learned my addr 172.21.15.96:0/3052030254 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-18T05:02:45.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3cced9d640 1 --2- 172.21.15.96:0/3052030254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3cd00c3650 0x7f3cd00c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:45.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccd59a640 1 -- 172.21.15.96:0/3052030254 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262283836 0 0) 0x7f3cd00c8100 con 0x7f3cd0155d00 2024-04-18T05:02:45.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccd59a640 1 -- 172.21.15.96:0/3052030254 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cb8003530 con 0x7f3cd0155d00 2024-04-18T05:02:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccd59a640 1 -- 172.21.15.96:0/3052030254 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1799742801 0 0) 0x7f3cb8003530 con 0x7f3cd0155d00 2024-04-18T05:02:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccd59a640 1 -- 172.21.15.96:0/3052030254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3cd00c3650 msgr2=0x7f3cd00c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:02:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccd59a640 1 --2- 172.21.15.96:0/3052030254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3cd00c3650 0x7f3cd00c3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccd59a640 1 -- 172.21.15.96:0/3052030254 >> v1:172.21.15.139:6789/0 conn(0x7f3cd014fc60 legacy=0x7f3cd006d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccd59a640 1 -- 172.21.15.96:0/3052030254 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd00c8630 con 0x7f3cd0155d00 2024-04-18T05:02:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccd59a640 1 -- 172.21.15.96:0/3052030254 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2581624113 0 0) 0x7f3cc4001680 con 0x7f3cd0155d00 2024-04-18T05:02:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccd59a640 1 -- 172.21.15.96:0/3052030254 >> v1:172.21.15.96:6789/0 conn(0x7f3cd0155d00 legacy=0x7f3cd0156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccd59a640 1 --2- 172.21.15.96:0/3052030254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cb80039b0 0x7f3cb8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccd59a640 1 --2- 172.21.15.96:0/3052030254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3cd00c3650 0x7f3cb80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccd59a640 1 --2- 172.21.15.96:0/3052030254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb8004d10 0x7f3cb8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccd59a640 1 -- 172.21.15.96:0/3052030254 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00c8350 con 0x7f3cb80039b0 2024-04-18T05:02:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccd59a640 1 -- 172.21.15.96:0/3052030254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb800bac0 con 0x7f3cb8004d10 2024-04-18T05:02:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccd59a640 1 -- 172.21.15.96:0/3052030254 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb800bc80 con 0x7f3cd00c3650 2024-04-18T05:02:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3cce59c640 1 --2- 172.21.15.96:0/3052030254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cb80039b0 0x7f3cb8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.325+0000 7f3ccdd9b640 1 --2- 172.21.15.96:0/3052030254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3cd00c3650 0x7f3cb80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3cced9d640 1 --2- 172.21.15.96:0/3052030254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb8004d10 0x7f3cb8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3cce59c640 1 -- 172.21.15.96:0/3052030254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3cd00c3650 msgr2=0x7f3cb80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:02:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3cce59c640 1 --2- 172.21.15.96:0/3052030254 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3cd00c3650 0x7f3cb80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3cce59c640 1 -- 172.21.15.96:0/3052030254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb8004d10 msgr2=0x7f3cb8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T05:02:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3cce59c640 1 --2- 172.21.15.96:0/3052030254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cb8004d10 0x7f3cb8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:45.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3cce59c640 1 -- 172.21.15.96:0/3052030254 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb8003530 con 0x7f3cb80039b0 2024-04-18T05:02:45.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3cce59c640 1 --2- 172.21.15.96:0/3052030254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cb80039b0 0x7f3cb8003dd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0001360 tx=0x7f3cc001e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c33fb8d80c1e70c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:45.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3ccd59a640 1 -- 172.21.15.96:0/3052030254 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc00052d0 con 0x7f3cb80039b0 2024-04-18T05:02:45.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3ccd59a640 1 -- 172.21.15.96:0/3052030254 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3cc0005450 con 0x7f3cb80039b0 2024-04-18T05:02:45.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3ccd59a640 1 -- 172.21.15.96:0/3052030254 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0003860 con 0x7f3cb80039b0 2024-04-18T05:02:45.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3cd4cb4640 1 -- 172.21.15.96:0/3052030254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cb80039b0 msgr2=0x7f3cb8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:45.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3cd4cb4640 1 --2- 172.21.15.96:0/3052030254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cb80039b0 0x7f3cb8003dd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0001360 tx=0x7f3cc001e540 comp rx=0 tx=0).stop 2024-04-18T05:02:45.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3cced9d640 1 -- 172.21.15.96:0/3052030254 reap_dead start 2024-04-18T05:02:45.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3cd4cb4640 1 -- 172.21.15.96:0/3052030254 shutdown_connections 2024-04-18T05:02:45.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3cd4cb4640 1 -- 172.21.15.96:0/3052030254 >> 172.21.15.96:0/3052030254 conn(0x7f3cd006c610 msgr2=0x7f3cd00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:45.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3cd4cb4640 1 -- 172.21.15.96:0/3052030254 shutdown_connections 2024-04-18T05:02:45.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.329+0000 7f3cd4cb4640 1 -- 172.21.15.96:0/3052030254 wait complete. 2024-04-18T05:02:45.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cd4cb4640 1 Processor -- start 2024-04-18T05:02:45.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cd4cb4640 1 -- start start 2024-04-18T05:02:45.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cd4cb4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3cb80039b0 0x7f3cd013ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:45.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cd4cb4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd01512e0 0x7f3cd0070d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:45.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cd4cb4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cd0151e60 0x7f3cd01522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:45.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cd4cb4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd0143a40 con 0x7f3cd01512e0 2024-04-18T05:02:45.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cd4cb4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd01503e0 con 0x7f3cd0151e60 2024-04-18T05:02:45.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cd4cb4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd0143ed0 con 0x7f3cb80039b0 2024-04-18T05:02:45.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3ccdd9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd01512e0 0x7f3cd0070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:45.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3ccdd9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd01512e0 0x7f3cd0070d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44996/0 (socket says 172.21.15.96:44996) 2024-04-18T05:02:45.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3ccdd9b640 1 -- 172.21.15.96:0/2862539751 learned_addr learned my addr 172.21.15.96:0/2862539751 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-18T05:02:45.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cced9d640 1 --2- 172.21.15.96:0/2862539751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cd0151e60 0x7f3cd01522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cce59c640 1 --2- 172.21.15.96:0/2862539751 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3cb80039b0 0x7f3cd013ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3ccdd9b640 1 -- 172.21.15.96:0/2862539751 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3cb80039b0 msgr2=0x7f3cd013ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3ccdd9b640 1 --2- 172.21.15.96:0/2862539751 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3cb80039b0 0x7f3cd013ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3ccdd9b640 1 -- 172.21.15.96:0/2862539751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cd0151e60 msgr2=0x7f3cd01522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3ccdd9b640 1 --2- 172.21.15.96:0/2862539751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cd0151e60 0x7f3cd01522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3ccdd9b640 1 -- 172.21.15.96:0/2862539751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd0150650 con 0x7f3cd01512e0 2024-04-18T05:02:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3ccdd9b640 1 --2- 172.21.15.96:0/2862539751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd01512e0 0x7f3cd0070d10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4001060 tx=0x7f3cc400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cbeffd640 1 -- 172.21.15.96:0/2862539751 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc400c8d0 con 0x7f3cd01512e0 2024-04-18T05:02:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cbeffd640 1 -- 172.21.15.96:0/2862539751 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3cc400ca30 con 0x7f3cd01512e0 2024-04-18T05:02:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cd4cb4640 1 -- 172.21.15.96:0/2862539751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd01433f0 con 0x7f3cd01512e0 2024-04-18T05:02:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cbeffd640 1 -- 172.21.15.96:0/2862539751 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc400ce00 con 0x7f3cd01512e0 2024-04-18T05:02:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cd4cb4640 1 -- 172.21.15.96:0/2862539751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd0151720 con 0x7f3cd01512e0 2024-04-18T05:02:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cd4cb4640 1 -- 172.21.15.96:0/2862539751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd0067050 con 0x7f3cd01512e0 2024-04-18T05:02:45.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cbeffd640 1 -- 172.21.15.96:0/2862539751 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3cc401d460 con 0x7f3cd01512e0 2024-04-18T05:02:45.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cbeffd640 1 --2- 172.21.15.96:0/2862539751 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3cb0066690 0x7f3cb0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T05:02:45.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.333+0000 7f3cce59c640 1 --2- 172.21.15.96:0/2862539751 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3cb0066690 0x7f3cb0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T05:02:45.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.337+0000 7f3cbeffd640 1 -- 172.21.15.96:0/2862539751 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5730+0+0 (secure 0 0 0) 0x7f3cc40841c0 con 0x7f3cd01512e0 2024-04-18T05:02:45.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.337+0000 7f3cce59c640 1 --2- 172.21.15.96:0/2862539751 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3cb0066690 0x7f3cb0068b50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0001750 tx=0x7f3cc00011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T05:02:45.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.341+0000 7f3cbeffd640 1 -- 172.21.15.96:0/2862539751 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f3cc4051480 con 0x7f3cd01512e0 2024-04-18T05:02:45.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:45.501+0000 7f3cd4cb4640 1 -- 172.21.15.96:0/2862539751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3cd0143b80 con 0x7f3cd01512e0 2024-04-18T05:02:46.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:46.189+0000 7f3cbeffd640 1 -- 172.21.15.96:0/2862539751 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3cc4054aa0 con 0x7f3cd01512e0 2024-04-18T05:02:46.190 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' removed 2024-04-18T05:02:46.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:46.193+0000 7f3cd4cb4640 1 -- 172.21.15.96:0/2862539751 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3cb0066690 msgr2=0x7f3cb0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:46.193+0000 7f3cd4cb4640 1 --2- 172.21.15.96:0/2862539751 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3cb0066690 0x7f3cb0068b50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0001750 tx=0x7f3cc00011a0 comp rx=0 tx=0).stop 2024-04-18T05:02:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:46.193+0000 7f3cd4cb4640 1 -- 172.21.15.96:0/2862539751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd01512e0 msgr2=0x7f3cd0070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T05:02:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:46.193+0000 7f3cd4cb4640 1 --2- 172.21.15.96:0/2862539751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd01512e0 0x7f3cd0070d10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4001060 tx=0x7f3cc400ec80 comp rx=0 tx=0).stop 2024-04-18T05:02:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:46.193+0000 7f3cd4cb4640 1 -- 172.21.15.96:0/2862539751 shutdown_connections 2024-04-18T05:02:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:46.193+0000 7f3cd4cb4640 1 --2- 172.21.15.96:0/2862539751 >> [v2:172.21.15.96:6832/27400,v1:172.21.15.96:6833/27400] conn(0x7f3cb0066690 0x7f3cb0068b50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:46.193+0000 7f3cd4cb4640 1 --2- 172.21.15.96:0/2862539751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cd0151e60 0x7f3cd01522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:46.193+0000 7f3cd4cb4640 1 --2- 172.21.15.96:0/2862539751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd01512e0 0x7f3cd0070d10 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:46.193+0000 7f3cd4cb4640 1 --2- 172.21.15.96:0/2862539751 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3cb80039b0 0x7f3cd013ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T05:02:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:46.193+0000 7f3cd4cb4640 1 -- 172.21.15.96:0/2862539751 >> 172.21.15.96:0/2862539751 conn(0x7f3cd006c610 msgr2=0x7f3cd006d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T05:02:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:46.193+0000 7f3cd4cb4640 1 -- 172.21.15.96:0/2862539751 shutdown_connections 2024-04-18T05:02:46.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-18T05:02:46.193+0000 7f3cd4cb4640 1 -- 172.21.15.96:0/2862539751 wait complete. 2024-04-18T05:02:46.216 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-18T05:02:46.216 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-18T05:02:46.216 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:46.227 INFO:tasks.ceph.mds.a:Stopped 2024-04-18T05:02:46.227 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-18T05:02:46.227 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:46.288 INFO:tasks.ceph.mds.c:Stopped 2024-04-18T05:02:46.289 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-18T05:02:46.289 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:46.348 INFO:tasks.ceph.mds.e:Stopped 2024-04-18T05:02:46.348 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-18T05:02:46.348 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:46.391 INFO:tasks.ceph.mds.b:Stopped 2024-04-18T05:02:46.392 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-18T05:02:46.392 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:46.406 INFO:tasks.ceph.mds.d:Stopped 2024-04-18T05:02:46.406 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-18T05:02:46.406 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:46.458 INFO:tasks.ceph.mds.f:Stopped 2024-04-18T05:02:46.458 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-18T05:02:46.458 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-18T05:02:46.458 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:46.539 INFO:tasks.ceph.osd.0:Stopped 2024-04-18T05:02:46.540 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-18T05:02:46.540 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:49.105 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T05:02:49.108 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T05:02:49.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-18T05:02:52.642 INFO:tasks.ceph.osd.1:Stopped 2024-04-18T05:02:52.643 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-18T05:02:52.643 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:52.708 INFO:tasks.ceph.osd.2:Stopped 2024-04-18T05:02:52.708 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-18T05:02:52.708 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:52.805 INFO:tasks.ceph.osd.3:Stopped 2024-04-18T05:02:52.805 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-18T05:02:52.805 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:52.877 INFO:tasks.ceph.osd.4:Stopped 2024-04-18T05:02:52.877 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-18T05:02:52.877 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:52.962 INFO:tasks.ceph.osd.5:Stopped 2024-04-18T05:02:52.962 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-18T05:02:52.962 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:53.050 INFO:tasks.ceph.osd.6:Stopped 2024-04-18T05:02:53.050 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-18T05:02:53.051 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:55.123 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-18T05:02:55.123 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-18T05:02:59.153 INFO:tasks.ceph.osd.7:Stopped 2024-04-18T05:02:59.154 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-18T05:02:59.154 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-18T05:02:59.154 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:59.184 INFO:tasks.ceph.mgr.y:Stopped 2024-04-18T05:02:59.184 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-18T05:02:59.184 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:59.215 INFO:tasks.ceph.mgr.x:Stopped 2024-04-18T05:02:59.215 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-18T05:02:59.215 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-18T05:02:59.215 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:59.241 INFO:tasks.ceph.mon.a:Stopped 2024-04-18T05:02:59.241 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-18T05:02:59.241 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:59.272 INFO:tasks.ceph.mon.b:Stopped 2024-04-18T05:02:59.273 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-18T05:02:59.273 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T05:02:59.327 INFO:tasks.ceph.mon.c:Stopped 2024-04-18T05:02:59.327 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-18T05:02:59.328 DEBUG:teuthology.orchestra.run.smithi096:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | head -n 1 2024-04-18T05:02:59.349 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T05:02:59.349 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-18T05:02:59.671 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T05:02:59.671 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-18T05:02:59.926 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T05:02:59.926 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-18T05:03:00.116 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T05:03:00.116 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-18T05:03:00.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-18T05:03:00.301 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-18T05:03:00.301 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-18T05:03:00.433 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-18T05:03:00.434 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-18T05:03:00.690 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-18T05:03:00.690 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-18T05:03:00.871 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-18T05:03:00.872 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-18T05:03:01.080 INFO:tasks.ceph:Archiving mon data... 2024-04-18T05:03:01.081 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661535/data/mon.a.tgz 2024-04-18T05:03:01.081 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-18T05:03:01.087 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.KZK8ZoOK8x 2024-04-18T05:03:01.088 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.KZK8ZoOK8x 2024-04-18T05:03:01.228 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.KZK8ZoOK8x 2024-04-18T05:03:01.291 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.KZK8ZoOK8x is 418KB 2024-04-18T05:03:01.353 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.KZK8ZoOK8x 2024-04-18T05:03:01.357 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661535/data/mon.b.tgz 2024-04-18T05:03:01.358 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2024-04-18T05:03:01.363 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.386sIt3rpj 2024-04-18T05:03:01.364 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.386sIt3rpj 2024-04-18T05:03:01.517 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.386sIt3rpj 2024-04-18T05:03:01.579 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.386sIt3rpj is 446KB 2024-04-18T05:03:01.642 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.386sIt3rpj 2024-04-18T05:03:01.648 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661535/data/mon.c.tgz 2024-04-18T05:03:01.649 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2024-04-18T05:03:01.696 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.j1wo1x6I7Y 2024-04-18T05:03:01.696 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.j1wo1x6I7Y 2024-04-18T05:03:01.840 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.j1wo1x6I7Y 2024-04-18T05:03:01.899 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.j1wo1x6I7Y is 455KB 2024-04-18T05:03:01.962 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.j1wo1x6I7Y 2024-04-18T05:03:01.968 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-18T05:03:01.968 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T05:03:01.970 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T05:03:02.024 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-18T05:03:02.025 DEBUG:teuthology.orchestra.run.smithi096:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-18T05:03:02.028 DEBUG:teuthology.orchestra.run.smithi139:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-18T05:03:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-18T05:03:02.096 INFO:teuthology.orchestra.run.smithi139.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-18T05:03:02.100 INFO:tasks.ceph:Archiving crash dumps... 2024-04-18T05:03:02.101 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661535/remote/smithi096/crash 2024-04-18T05:03:02.102 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T05:03:02.115 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661535/remote/smithi139/crash 2024-04-18T05:03:02.116 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T05:03:02.153 INFO:tasks.ceph:Shutting down logrotate 2024-04-18T05:03:02.153 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T05:03:02.160 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T05:03:02.242 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-18T05:03:02.255 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-18T05:03:02.268 INFO:tasks.ceph:Compressing logs... 2024-04-18T05:03:02.268 DEBUG:teuthology.orchestra.run.smithi096:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T05:03:02.300 DEBUG:teuthology.orchestra.run.smithi139:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T05:04:05.841 INFO:tasks.ceph:Archiving logs... 2024-04-18T05:04:05.841 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661535/remote/smithi096/log 2024-04-18T05:04:05.843 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T05:04:10.000 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661535/remote/smithi139/log 2024-04-18T05:04:10.001 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T05:04:16.811 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-18T05:04:16.821 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-18T05:04:16.821 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T05:04:16.824 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T05:04:16.900 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-18T05:04:16.912 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-18T05:04:16.912 DEBUG:teuthology.orchestra.run.smithi096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T05:04:16.915 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T05:04:16.925 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T05:04:16.925 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-04-18T05:04:16.925 INFO:teuthology.orchestra.run.smithi096.stdout:*hv01.front.sepi 67.205.162.81 3 u 3 64 377 0.063 -3.100 0.901 2024-04-18T05:04:16.925 INFO:teuthology.orchestra.run.smithi096.stdout:+hv02.front.sepi 63.231.80.2 3 u 61 64 377 0.075 +0.203 0.905 2024-04-18T05:04:16.926 INFO:teuthology.orchestra.run.smithi096.stdout:+hv03.front.sepi 74.6.168.72 3 u 63 64 377 0.100 -0.016 0.908 2024-04-18T05:04:16.926 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-18T05:04:16.928 INFO:teuthology.orchestra.run.smithi139.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T05:04:16.928 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================== 2024-04-18T05:04:16.928 INFO:teuthology.orchestra.run.smithi139.stdout:*hv01.front.sepi 67.205.162.81 3 u 66 64 377 0.074 -2.675 1.024 2024-04-18T05:04:16.928 INFO:teuthology.orchestra.run.smithi139.stdout:+hv02.front.sepi 63.231.80.2 3 u 5 64 377 0.105 +0.073 1.697 2024-04-18T05:04:16.928 INFO:teuthology.orchestra.run.smithi139.stdout:+hv03.front.sepi 74.6.168.72 3 u 63 64 377 0.061 -0.278 1.133 2024-04-18T05:04:16.928 INFO:teuthology.orchestra.run.smithi139.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-18T05:04:16.929 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-18T05:04:16.943 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-18T05:04:16.943 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-18T05:04:16.959 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-18T05:04:17.053 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-18T05:04:17.069 INFO:teuthology.task.internal:Duration was 1213.649260 seconds 2024-04-18T05:04:17.069 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-18T05:04:17.082 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-18T05:04:17.083 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T05:04:17.085 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T05:04:17.128 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-18T05:04:17.129 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi096.front.sepia.ceph.com 2024-04-18T05:04:17.129 DEBUG:teuthology.orchestra.run.smithi096:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T05:04:17.175 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2024-04-18T05:04:17.176 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T05:04:17.187 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-18T05:04:17.187 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T05:04:17.220 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T05:04:17.256 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-18T05:04:17.256 DEBUG:teuthology.orchestra.run.smithi096:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T05:04:17.287 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T05:04:17.354 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-18T05:04:17.367 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-18T05:04:17.368 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T05:04:17.380 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T05:04:17.393 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-18T05:04:17.405 DEBUG:teuthology.orchestra.run.smithi096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T05:04:17.424 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T05:04:17.433 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = core 2024-04-18T05:04:17.446 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2024-04-18T05:04:17.475 DEBUG:teuthology.orchestra.run.smithi096:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T05:04:17.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T05:04:17.499 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T05:04:17.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T05:04:17.525 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-18T05:04:17.537 INFO:teuthology.task.internal:Transferring archived files... 2024-04-18T05:04:17.538 DEBUG:teuthology.misc:Transferring archived files from smithi096:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661535/remote/smithi096 2024-04-18T05:04:17.538 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T05:04:17.564 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661535/remote/smithi139 2024-04-18T05:04:17.565 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T05:04:17.585 INFO:teuthology.task.internal:Removing archive directory... 2024-04-18T05:04:17.586 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T05:04:17.607 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T05:04:17.628 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-18T05:04:17.641 INFO:teuthology.task.internal:Not uploading archives. 2024-04-18T05:04:17.641 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-18T05:04:17.654 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-18T05:04:17.655 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T05:04:17.657 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T05:04:17.660 INFO:teuthology.orchestra.run.smithi096.stdout: 658617 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 05:04 /home/ubuntu/cephtest 2024-04-18T05:04:17.675 INFO:teuthology.orchestra.run.smithi139.stdout: 658464 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 05:04 /home/ubuntu/cephtest 2024-04-18T05:04:17.676 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-18T05:04:17.688 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-18T05:04:17.811 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} duration: 1213.649260044098 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-18T05:04:17.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T05:04:17.929 INFO:teuthology.run:pass